Role of neural network models for developing speech systems
Indian Academy of Sciences (India)
These prosody models are further examined for applications such as text to speech synthesis, speech recognition, speaker recognition and language identiﬁcation. Neural network models in voice conversion system are explored for capturing the mapping functions between source and target speakers at source, system and ...
Dynamic causal models of neural system dynamics: current state ...
Indian Academy of Sciences (India)
2006-09-28
Sep 28, 2006 ... Keywords. Dynamic causal modelling; EEG; effective connectivity; event-related potentials; fMRI; neural system ... In this article, we review the conceptual and mathematical basis of DCM and its implementation for functional magnetic resonance imaging data and event-related potentials. After introducing ...
Neural system modeling and simulation using Hybrid Functional Petri Net.
Tang, Yin; Wang, Fei
2012-02-01
The Petri net formalism has been proved to be powerful in biological modeling. It not only boasts of a most intuitive graphical presentation but also combines the methods of classical systems biology with the discrete modeling technique. Hybrid Functional Petri Net (HFPN) was proposed specially for biological system modeling. An array of well-constructed biological models using HFPN yielded very interesting results. In this paper, we propose a method to represent neural system behavior, where biochemistry and electrical chemistry are both included using the Petri net formalism. We built a model for the adrenergic system using HFPN and employed quantitative analysis. Our simulation results match the biological data well, showing that the model is very effective. Predictions made on our model further manifest the modeling power of HFPN and improve the understanding of the adrenergic system. The file of our model and more results with their analysis are available in our supplementary material.
Internal models and neural computation in the vestibular system.
Green, Andrea M; Angelaki, Dora E
2010-01-01
The vestibular system is vital for motor control and spatial self-motion perception. Afferents from the otolith organs and the semicircular canals converge with optokinetic, somatosensory and motor-related signals in the vestibular nuclei, which are reciprocally interconnected with the vestibulocerebellar cortex and deep cerebellar nuclei. Here, we review the properties of the many cell types in the vestibular nuclei, as well as some fundamental computations implemented within this brainstem-cerebellar circuitry. These include the sensorimotor transformations for reflex generation, the neural computations for inertial motion estimation, the distinction between active and passive head movements, as well as the integration of vestibular and proprioceptive information for body motion estimation. A common theme in the solution to such computational problems is the concept of internal models and their neural implementation. Recent studies have shed new insights into important organizational principles that closely resemble those proposed for other sensorimotor systems, where their neural basis has often been more difficult to identify. As such, the vestibular system provides an excellent model to explore common neural processing strategies relevant both for reflexive and for goal-directed, voluntary movement as well as perception.
The Artifical Neural Network as means for modeling Nonlinear Systems
Drábek Oldøich; Taufer Ivan
1998-01-01
The paper deals with nonlinear system identification based on neural network. The topic of this publication is simulation of training and testing a neural network. A contribution is assigned to technologists which are good at the clasical identification problems but their knowledges about identification based on neural network are only on the stage of theoretical bases.
The Artifical Neural Network as means for modeling Nonlinear Systems
Directory of Open Access Journals (Sweden)
Drábek Oldøich
1998-12-01
Full Text Available The paper deals with nonlinear system identification based on neural network. The topic of this publication is simulation of training and testing a neural network. A contribution is assigned to technologists which are good at the clasical identification problems but their knowledges about identification based on neural network are only on the stage of theoretical bases.
Fuzzy stochastic neural network model for structural system identification
Jiang, Xiaomo; Mahadevan, Sankaran; Yuan, Yong
2017-01-01
This paper presents a dynamic fuzzy stochastic neural network model for nonparametric system identification using ambient vibration data. The model is developed to handle two types of imprecision in the sensed data: fuzzy information and measurement uncertainties. The dimension of the input vector is determined by using the false nearest neighbor approach. A Bayesian information criterion is applied to obtain the optimum number of stochastic neurons in the model. A fuzzy C-means clustering algorithm is employed as a data mining tool to divide the sensed data into clusters with common features. The fuzzy stochastic model is created by combining the fuzzy clusters of input vectors with the radial basis activation functions in the stochastic neural network. A natural gradient method is developed based on the Kullback-Leibler distance criterion for quick convergence of the model training. The model is validated using a power density pseudospectrum approach and a Bayesian hypothesis testing-based metric. The proposed methodology is investigated with numerically simulated data from a Markov Chain model and a two-story planar frame, and experimentally sensed data from ambient vibration data of a benchmark structure.
Evolvable synthetic neural system
Curtis, Steven A. (Inventor)
2009-01-01
An evolvable synthetic neural system includes an evolvable neural interface operably coupled to at least one neural basis function. Each neural basis function includes an evolvable neural interface operably coupled to a heuristic neural system to perform high-level functions and an autonomic neural system to perform low-level functions. In some embodiments, the evolvable synthetic neural system is operably coupled to one or more evolvable synthetic neural systems in a hierarchy.
Reliability Modeling of Microelectromechanical Systems Using Neural Networks
Perera. J. Sebastian
2000-01-01
Microelectromechanical systems (MEMS) are a broad and rapidly expanding field that is currently receiving a great deal of attention because of the potential to significantly improve the ability to sense, analyze, and control a variety of processes, such as heating and ventilation systems, automobiles, medicine, aeronautical flight, military surveillance, weather forecasting, and space exploration. MEMS are very small and are a blend of electrical and mechanical components, with electrical and mechanical systems on one chip. This research establishes reliability estimation and prediction for MEMS devices at the conceptual design phase using neural networks. At the conceptual design phase, before devices are built and tested, traditional methods of quantifying reliability are inadequate because the device is not in existence and cannot be tested to establish the reliability distributions. A novel approach using neural networks is created to predict the overall reliability of a MEMS device based on its components and each component's attributes. The methodology begins with collecting attribute data (fabrication process, physical specifications, operating environment, property characteristics, packaging, etc.) and reliability data for many types of microengines. The data are partitioned into training data (the majority) and validation data (the remainder). A neural network is applied to the training data (both attribute and reliability); the attributes become the system inputs and reliability data (cycles to failure), the system output. After the neural network is trained with sufficient data. the validation data are used to verify the neural networks provided accurate reliability estimates. Now, the reliability of a new proposed MEMS device can be estimated by using the appropriate trained neural networks developed in this work.
Modeling of the height control system using artificial neural networks
Directory of Open Access Journals (Sweden)
A. R Tahavvor
2016-09-01
Full Text Available Introduction Automation of agricultural and machinery construction has generally been enhanced by intelligent control systems due to utility and efficiency rising, ease of use, profitability and upgrading according to market demand. A broad variety of industrial merchandise are now supplied with computerized control systems of earth moving processes to be performed by construction and agriculture field vehicle such as grader, backhoe, tractor and scraper machines. A height control machine which is used in measuring base thickness is consisted of two mechanical and electronic parts. The mechanical part is consisted of conveyor belt, main body, electrical engine and invertors while the electronic part is consisted of ultrasonic, wave transmitter and receiver sensor, electronic board, control set, and microcontroller. The main job of these controlling devices consists of the topographic surveying, cutting and filling of elevated and spotted low area, and these actions fundamentally dependent onthe machine's ability in elevation and thickness measurement and control. In this study, machine was first tested and then some experiments were conducted for data collection. Study of system modeling in artificial neural networks (ANN was done for measuring, controlling the height for bases by input variable input vectors such as sampling time, probe speed, conveyer speed, sound wave speed and speed sensor are finally the maximum and minimum probe output vector on various conditions. The result reveals the capability of this procedure for experimental recognition of sensors' behavior and improvement of field machine control systems. Inspection, calibration and response, diagnosis of the elevation control system in combination with machine function can also be evaluated by some extra development of this system. Materials and Methods Designing and manufacture of the planned apparatus classified in three dissimilar, mechanical and electronic module, courses of
Analysis of the developing neural system using an in vitro model by Raman spectroscopy.
Hashimoto, Kosuke; Kudoh, Suguru N; Sato, Hidetoshi
2015-04-07
We developed an in vitro model of early neural cell development. The maturation of a normal neural cell was studied in vitro using Raman spectroscopy for 120 days. The Raman spectra datasets were analyzed by principal component analysis (PCA) to investigate the relationship between maturation stages and molecular composition changes in neural cells. According to the PCA, the Raman spectra datasets can be classified into four larger groups. Previous electrophysiological studies have suggested that a normal neural cell goes through three maturation states. The groups we observed by Raman analysis showed good agreement with the electrophysiological results, except with the addition of a fourth state. The results demonstrated that Raman analysis was powerful to investigate the daily changes in molecular composition of the growing neural cell. This in vitro model system may be useful for future studies of the effects of endocrine disrupters in the developing early neural system.
Artificial neural network modelling
Samarasinghe, Sandhya
2016-01-01
This book covers theoretical aspects as well as recent innovative applications of Artificial Neural networks (ANNs) in natural, environmental, biological, social, industrial and automated systems. It presents recent results of ANNs in modelling small, large and complex systems under three categories, namely, 1) Networks, Structure Optimisation, Robustness and Stochasticity 2) Advances in Modelling Biological and Environmental Systems and 3) Advances in Modelling Social and Economic Systems. The book aims at serving undergraduates, postgraduates and researchers in ANN computational modelling. .
A Comparative Study of Neural Networks and Fuzzy Systems in Modeling of a Nonlinear Dynamic System
Directory of Open Access Journals (Sweden)
Metin Demirtas
2011-07-01
Full Text Available The aim of this paper is to compare the neural networks and fuzzy modeling approaches on a nonlinear system. We have taken Permanent Magnet Brushless Direct Current (PMBDC motor data and have generated models using both approaches. The predictive performance of both methods was compared on the data set for model configurations. The paper describes the results of these tests and discusses the effects of changing model parameters on predictive and practical performance. Modeling sensitivity was used to compare for two methods.
Cheng, Longlong; Zhang, Guangju; Wan, Baikun; Hao, Linlin; Qi, Hongzhi; Ming, Dong
2009-01-01
Functional electrical stimulation (FES) has been widely used in the area of neural engineering. It utilizes electrical current to activate nerves innervating extremities affected by paralysis. An effective combination of a traditional PID controller and a neural network, being capable of nonlinear expression and adaptive learning property, supply a more reliable approach to construct FES controller that help the paraplegia complete the action they want. A FES system tuned by Radial Basis Function (RBF) Neural Network-based Proportional-Integral-Derivative (PID) model was designed to control the knee joint according to the desired trajectory through stimulation of lower limbs muscles in this paper. Experiment result shows that the FES system with RBF Neural Network-based PID model get a better performance when tracking the preset trajectory of knee angle comparing with the system adjusted by Ziegler- Nichols tuning PID model.
Brown, Ramsay A; Swanson, Larry W
2013-09-01
Systematic description and the unambiguous communication of findings and models remain among the unresolved fundamental challenges in systems neuroscience. No common descriptive frameworks exist to describe systematically the connective architecture of the nervous system, even at the grossest level of observation. Furthermore, the accelerating volume of novel data generated on neural connectivity outpaces the rate at which this data is curated into neuroinformatics databases to synthesize digitally systems-level insights from disjointed reports and observations. To help address these challenges, we propose the Neural Systems Language (NSyL). NSyL is a modeling language to be used by investigators to encode and communicate systematically reports of neural connectivity from neuroanatomy and brain imaging. NSyL engenders systematic description and communication of connectivity irrespective of the animal taxon described, experimental or observational technique implemented, or nomenclature referenced. As a language, NSyL is internally consistent, concise, and comprehensible to both humans and computers. NSyL is a promising development for systematizing the representation of neural architecture, effectively managing the increasing volume of data on neural connectivity and streamlining systems neuroscience research. Here we present similar precedent systems, how NSyL extends existing frameworks, and the reasoning behind NSyL's development. We explore NSyL's potential for balancing robustness and consistency in representation by encoding previously reported assertions of connectivity from the literature as examples. Finally, we propose and discuss the implications of a framework for how NSyL will be digitally implemented in the future to streamline curation of experimental results and bridge the gaps among anatomists, imagers, and neuroinformatics databases. Copyright © 2013 Wiley Periodicals, Inc.
Xu, Tao; Xiao, Na; Zhai, Xiaolong; Kwan Chan, Pak; Tin, Chung
2018-02-01
Damage to the brain, as a result of various medical conditions, impacts the everyday life of patients and there is still no complete cure to neurological disorders. Neuroprostheses that can functionally replace the damaged neural circuit have recently emerged as a possible solution to these problems. Here we describe the development of a real-time cerebellar neuroprosthetic system to substitute neural function in cerebellar circuitry for learning delay eyeblink conditioning (DEC). The system was empowered by a biologically realistic spiking neural network (SNN) model of the cerebellar neural circuit, which considers the neuronal population and anatomical connectivity of the network. The model simulated synaptic plasticity critical for learning DEC. This SNN model was carefully implemented on a field programmable gate array (FPGA) platform for real-time simulation. This hardware system was interfaced in in vivo experiments with anesthetized rats and it used neural spikes recorded online from the animal to learn and trigger conditioned eyeblink in the animal during training. This rat-FPGA hybrid system was able to process neuronal spikes in real-time with an embedded cerebellum model of ~10 000 neurons and reproduce learning of DEC with different inter-stimulus intervals. Our results validated that the system performance is physiologically relevant at both the neural (firing pattern) and behavioral (eyeblink pattern) levels. This integrated system provides the sufficient computation power for mimicking the cerebellar circuit in real-time. The system interacts with the biological system naturally at the spike level and can be generalized for including other neural components (neuron types and plasticity) and neural functions for potential neuroprosthetic applications.
Xu, Tao; Xiao, Na; Zhai, Xiaolong; Chan, Pak Kwan; Tin, Chung
2018-02-01
Objective. Damage to the brain, as a result of various medical conditions, impacts the everyday life of patients and there is still no complete cure to neurological disorders. Neuroprostheses that can functionally replace the damaged neural circuit have recently emerged as a possible solution to these problems. Here we describe the development of a real-time cerebellar neuroprosthetic system to substitute neural function in cerebellar circuitry for learning delay eyeblink conditioning (DEC). Approach. The system was empowered by a biologically realistic spiking neural network (SNN) model of the cerebellar neural circuit, which considers the neuronal population and anatomical connectivity of the network. The model simulated synaptic plasticity critical for learning DEC. This SNN model was carefully implemented on a field programmable gate array (FPGA) platform for real-time simulation. This hardware system was interfaced in in vivo experiments with anesthetized rats and it used neural spikes recorded online from the animal to learn and trigger conditioned eyeblink in the animal during training. Main results. This rat-FPGA hybrid system was able to process neuronal spikes in real-time with an embedded cerebellum model of ~10 000 neurons and reproduce learning of DEC with different inter-stimulus intervals. Our results validated that the system performance is physiologically relevant at both the neural (firing pattern) and behavioral (eyeblink pattern) levels. Significance. This integrated system provides the sufficient computation power for mimicking the cerebellar circuit in real-time. The system interacts with the biological system naturally at the spike level and can be generalized for including other neural components (neuron types and plasticity) and neural functions for potential neuroprosthetic applications.
Feasibility of Using Neural Network Models to Accelerate the Testing of Mechanical Systems
Fusaro, Robert L.
1998-01-01
Verification testing is an important aspect of the design process for mechanical mechanisms, and full-scale, full-length life testing is typically used to qualify any new component for use in space. However, as the required life specification is increased, full-length life tests become more costly and lengthen the development time. At the NASA Lewis Research Center, we theorized that neural network systems may be able to model the operation of a mechanical device. If so, the resulting neural network models could simulate long-term mechanical testing with data from a short-term test. This combination of computer modeling and short-term mechanical testing could then be used to verify the reliability of mechanical systems, thereby eliminating the costs associated with long-term testing. Neural network models could also enable designers to predict the performance of mechanisms at the conceptual design stage by entering the critical parameters as input and running the model to predict performance. The purpose of this study was to assess the potential of using neural networks to predict the performance and life of mechanical systems. To do this, we generated a neural network system to model wear obtained from three accelerated testing devices: 1) A pin-on-disk tribometer; 2) A line-contact rub-shoe tribometer; 3) A four-ball tribometer.
Prediction of a model enzymatic acidolysis system using neural networks
Directory of Open Access Journals (Sweden)
Güven, Aytaç
2008-12-01
Full Text Available A model for the acidolysis of trinolein and palmitic acid under the catalysis of immobilized sn-1,3 specific lipase was presented in this study. A neural networks (NN based model was developed for the prediction of the concentrations of the major reaction products of this reaction (1-palmitoyl-2,3-oleoyl-glycerol (POO 1,3-dipalmitoyl-2-oleoyl-glycerol (POP and triolein (OOO. Substrate ratio (SR, reaction temperature (T and reaction time (t were used as input parameters. The optimal architecture of the proposed NN model, which consists of one input layer with three inputs, one hidden layer with seven neurons and one output layer with three outputs, wass able to predict the reaction products concentration with a mean square error (MSE of less than 1.5 and R2 of 0.999. and explicit formulation of the proposed NN is presented. Considerable good performance is achieved in modeling the acidolysis reaction using neuronal networks.En este estudio se presenta un modelo para la acidólisis de la trilinoleina y el ácido palmítico mediante la catálisis con una lipasa específica sn-1,3 inmovilizada. Un modelo basado en redes neuronales (NN ha sido desarrollado para la predicción de la concentración de los principales productos de esta reacción (1-palmitoil-2,3-oleoil-glicerol (POO, 1,3-dipalmitoil-2-oleoil-glicerol (POP y trioleina (OOO. Se han usado como parámetros de entrada: la proporción del sustrato (SR, la temperatura de reacción (T y el tiempo de reacción (t. La arquitectura óptima del modelo de NN propuesto, que consiste en una capa de entrada con tres entradas, una capa oculta con siete neuronas y una capa de salida con tres salidas, fue capaz de predecir la concentración de los productos de reacción con un error cuadrático medio (MSE de menos de 1.5 y una R2 de 0.999 . Se presenta una formulación explícita del modelo NN propuesto. Se obtienen muy buenos resultados en la predicción de la reacciones de acidólisis mediante el uso de
Neural Network Based Model of an Industrial Oil-Fired Boiler System ...
African Journals Online (AJOL)
In this study, an oil-fired boiler system is modeled as a multivariable plant with two inputs (feed water rate and oil-fired flow rate) and two outputs (steam temperature and pressure). The plant parameters are modeled using artificial neural network, based on experimental data collected directly from the physical plant.
Gain Scheduling Control of Nonlinear Systems Based on Neural State Space Models
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon; Stoustrup, Jakob
2003-01-01
This paper presents a novel method for gain scheduling control of nonlinear systems based on extraction of local linear state space models from neural networks with direct application to robust control. A neural state space model of the system is first trained based on in- and output training sam...... control can be achieved by interpolating between each controller.In this paper, we propose to use the Youla-Jabr-Bongiorno-Kucera parameterization to achieve a smooth scheduling between the operating points with certain stability guarantees....
Using System Dynamic Model and Neural Network Model to Analyse Water Scarcity in Sudan
Li, Y.; Tang, C.; Xu, L.; Ye, S.
2017-07-01
Many parts of the world are facing the problem of Water Scarcity. Analysing Water Scarcity quantitatively is an important step to solve the problem. Water scarcity in a region is gauged by WSI (water scarcity index), which incorporate water supply and water demand. To get the WSI, Neural Network Model and SDM (System Dynamic Model) that depict how environmental and social factors affect water supply and demand are developed to depict how environmental and social factors affect water supply and demand. The uneven distribution of water resource and water demand across a region leads to an uneven distribution of WSI within this region. To predict WSI for the future, logistic model, Grey Prediction, and statistics are applied in predicting variables. Sudan suffers from severe water scarcity problem with WSI of 1 in 2014, water resource unevenly distributed. According to the result of modified model, after the intervention, Sudan’s water situation will become better.
Directory of Open Access Journals (Sweden)
Natalia A. Tomashenko
2016-11-01
Full Text Available Subject of Research. We study speaker adaptation of deep neural network (DNN acoustic models in automatic speech recognition systems. The aim of speaker adaptation techniques is to improve the accuracy of the speech recognition system for a particular speaker. Method. A novel method for training and adaptation of deep neural network acoustic models has been developed. It is based on using an auxiliary GMM (Gaussian Mixture Models model and GMMD (GMM-derived features. The principle advantage of the proposed GMMD features is the possibility of performing the adaptation of a DNN through the adaptation of the auxiliary GMM. In the proposed approach any methods for the adaptation of the auxiliary GMM can be used, hence, it provides a universal method for transferring adaptation algorithms developed for GMMs to DNN adaptation.Main Results. The effectiveness of the proposed approach was shown by means of one of the most common adaptation algorithms for GMM models – MAP (Maximum A Posteriori adaptation. Different ways of integration of the proposed approach into state-of-the-art DNN architecture have been proposed and explored. Analysis of choosing the type of the auxiliary GMM model is given. Experimental results on the TED-LIUM corpus demonstrate that, in an unsupervised adaptation mode, the proposed adaptation technique can provide, approximately, a 11–18% relative word error reduction (WER on different adaptation sets, compared to the speaker-independent DNN system built on conventional features, and a 3–6% relative WER reduction compared to the SAT-DNN trained on fMLLR adapted features.
Directory of Open Access Journals (Sweden)
Jing Lu
2014-11-01
Full Text Available We propose a weather prediction model in this article based on neural network and fuzzy inference system (NFIS-WPM, and then apply it to predict daily fuzzy precipitation given meteorological premises for testing. The model consists of two parts: the first part is the “fuzzy rule-based neural network”, which simulates sequential relations among fuzzy sets using artificial neural network; and the second part is the “neural fuzzy inference system”, which is based on the first part, but could learn new fuzzy rules from the previous ones according to the algorithm we proposed. NFIS-WPM (High Pro and NFIS-WPM (Ave are improved versions of this model. It is well known that the need for accurate weather prediction is apparent when considering the benefits. However, the excessive pursuit of accuracy in weather prediction makes some of the “accurate” prediction results meaningless and the numerical prediction model is often complex and time-consuming. By adapting this novel model to a precipitation prediction problem, we make the predicted outcomes of precipitation more accurate and the prediction methods simpler than by using the complex numerical forecasting model that would occupy large computation resources, be time-consuming and which has a low predictive accuracy rate. Accordingly, we achieve more accurate predictive precipitation results than by using traditional artificial neural networks that have low predictive accuracy.
Federal Laboratory Consortium — As part of the Electrical and Computer Engineering Department and The Institute for System Research, the Neural Systems Laboratory studies the functionality of the...
Comparison of different computer models of the neural control system of the lower urinary tract
van Duin, F.; Rosier, P. F.; Bemelmans, B. L.; Wijkstra, H.; Debruyne, F. M.; van Oosterom, A.
2000-01-01
This paper presents a series of five models that were formulated for describing the neural control of the lower urinary tract in humans. A parsimonious formulation of the effect of the sympathetic system, the pre-optic area, and urethral afferents on the simulated behavior are included. In spite of
Evolvable Neural Software System
Curtis, Steven A.
2009-01-01
The Evolvable Neural Software System (ENSS) is composed of sets of Neural Basis Functions (NBFs), which can be totally autonomously created and removed according to the changing needs and requirements of the software system. The resulting structure is both hierarchical and self-similar in that a given set of NBFs may have a ruler NBF, which in turn communicates with other sets of NBFs. These sets of NBFs may function as nodes to a ruler node, which are also NBF constructs. In this manner, the synthetic neural system can exhibit the complexity, three-dimensional connectivity, and adaptability of biological neural systems. An added advantage of ENSS over a natural neural system is its ability to modify its core genetic code in response to environmental changes as reflected in needs and requirements. The neural system is fully adaptive and evolvable and is trainable before release. It continues to rewire itself while on the job. The NBF is a unique, bilevel intelligence neural system composed of a higher-level heuristic neural system (HNS) and a lower-level, autonomic neural system (ANS). Taken together, the HNS and the ANS give each NBF the complete capabilities of a biological neural system to match sensory inputs to actions. Another feature of the NBF is the Evolvable Neural Interface (ENI), which links the HNS and ANS. The ENI solves the interface problem between these two systems by actively adapting and evolving from a primitive initial state (a Neural Thread) to a complicated, operational ENI and successfully adapting to a training sequence of sensory input. This simulates the adaptation of a biological neural system in a developmental phase. Within the greater multi-NBF and multi-node ENSS, self-similar ENI s provide the basis for inter-NBF and inter-node connectivity.
Biological neural networks as model systems for designing future parallel processing computers
Ross, Muriel D.
1991-01-01
One of the more interesting debates of the present day centers on whether human intelligence can be simulated by computer. The author works under the premise that neurons individually are not smart at all. Rather, they are physical units which are impinged upon continuously by other matter that influences the direction of voltage shifts across the units membranes. It is only the action of a great many neurons, billions in the case of the human nervous system, that intelligent behavior emerges. What is required to understand even the simplest neural system is painstaking analysis, bit by bit, of the architecture and the physiological functioning of its various parts. The biological neural network studied, the vestibular utricular and saccular maculas of the inner ear, are among the most simple of the mammalian neural networks to understand and model. While there is still a long way to go to understand even this most simple neural network in sufficient detail for extrapolation to computers and robots, a start was made. Moreover, the insights obtained and the technologies developed help advance the understanding of the more complex neural networks that underlie human intelligence.
Hermantoro; Rudiyanto; Slamet Suprayogi
2008-01-01
Land evaluation for specific purpose in plantation sector become very important due to increasing the competition in land use and the development of plantation sector. Land evaluation produces information of land economic values for specific land use. The objective of the research is to develop land evaluation method for cocoa estate using integrated model Artificial Neural Network (ANN) and Geographical Information System (GIS). Back propagation ANN model were used to predict cocoa yield bas...
NONLINEAR SYSTEM MODELING USING SINGLE NEURON CASCADED NEURAL NETWORK FOR REAL-TIME APPLICATIONS
Directory of Open Access Journals (Sweden)
S. Himavathi
2012-04-01
Full Text Available Neural Networks (NN have proved its efficacy for nonlinear system modeling. NN based controllers and estimators for nonlinear systems provide promising alternatives to the conventional counterpart. However, NN models have to meet the stringent requirements on execution time for its effective use in real time applications. This requires the NN model to be structurally compact and computationally less complex. In this paper a parametric method of analysis is adopted to determine the compact and faster NN model among various neural network architectures. This work proves through analysis and examples that the Single Neuron Cascaded (SNC architecture is distinct in providing compact and simpler models requiring lower execution time. The unique structural growth of SNC architecture enables automation in design. The SNC Network is shown to combine the advantages of both single and multilayer neural network architectures. Extensive analysis on selected architectures and their models for four benchmark nonlinear theoretical plants and a practical application are tested. A performance comparison of the NN models is presented to demonstrate the superiority of the single neuron cascaded architecture for online real time applications.
Neural Network Model Of The PXIE RFQ Cooling System and Resonant Frequency Response
Energy Technology Data Exchange (ETDEWEB)
Edelen, Auralee [Fermilab; Biedron, Sandra [Colorado State U., Fort Collins; Bowring, Daniel [Fermilab; Chase, Brian [Fermilab; Edelen, Jonathan [Fermilab; Milton, Stephen [Colorado State U., Fort Collins; Steimel, Jim [Fermilab
2016-06-01
As part of the PIP-II Injector Experiment (PXIE) accel-erator, a four-vane radio frequency quadrupole (RFQ) accelerates a 30-keV, 1-mA to 10-mA H' ion beam to 2.1 MeV. It is designed to operate at a frequency of 162.5 MHz with arbitrary duty factor, including continuous wave (CW) mode. The resonant frequency is controlled solely by a water-cooling system. We present an initial neural network model of the RFQ frequency response to changes in the cooling system and RF power conditions during pulsed operation. A neural network model will be used in a model predictive control scheme to regulate the resonant frequency of the RFQ.
Internal models and neural computation in the vestibular system
Green, Andrea M.; Dora E. Angelaki
2010-01-01
The vestibular system is vital for motor control and spatial self-motion perception. Afferents from the otolith organs and the semicircular canals converge with optokinetic, somatosensory and motor-related signals in the vestibular nuclei, which are reciprocally interconnected with the vestibulocerebellar cortex and deep cerebellar nuclei. Here, we review the properties of the many cell types in the vestibular nuclei, as well as some fundamental computations implemented within this brainstem–...
Pusuluri, Sai Teja
Energy landscapes are often used as metaphors for phenomena in biology, social sciences and finance. Different methods have been implemented in the past for the construction of energy landscapes. Neural network models based on spin glass physics provide an excellent mathematical framework for the construction of energy landscapes. This framework uses a minimal number of parameters and constructs the landscape using data from the actual phenomena. In the past neural network models were used to mimic the storage and retrieval process of memories (patterns) in the brain. With advances in the field now, these models are being used in machine learning, deep learning and modeling of complex phenomena. Most of the past literature focuses on increasing the storage capacity and stability of stored patterns in the network but does not study these models from a modeling perspective or an energy landscape perspective. This dissertation focuses on neural network models both from a modeling perspective and from an energy landscape perspective. I firstly show how the cellular interconversion phenomenon can be modeled as a transition between attractor states on an epigenetic landscape constructed using neural network models. The model allows the identification of a reaction coordinate of cellular interconversion by analyzing experimental and simulation time course data. Monte Carlo simulations of the model show that the initial phase of cellular interconversion is a Poisson process and the later phase of cellular interconversion is a deterministic process. Secondly, I explore the static features of landscapes generated using neural network models, such as sizes of basins of attraction and densities of metastable states. The simulation results show that the static landscape features are strongly dependent on the correlation strength and correlation structure between patterns. Using different hierarchical structures of the correlation between patterns affects the landscape features
Oliveira, José J.
2017-10-01
In this paper, we investigate the global convergence of solutions of non-autonomous Hopfield neural network models with discrete time-varying delays, infinite distributed delays, and possible unbounded coefficient functions. Instead of using Lyapunov functionals, we explore intrinsic features between the non-autonomous systems and their asymptotic systems to ensure the boundedness and global convergence of the solutions of the studied models. Our results are new and complement known results in the literature. The theoretical analysis is illustrated with some examples and numerical simulations.
Energy Technology Data Exchange (ETDEWEB)
Thyagarajan, T.; Ponnavaikko, M. [Crescent Engineering Coll., Madras (India); Shanmugam, J. [Madras Inst. of Tech. (India); Panda, R.C.; Rao, P.G. [Central Leather Research Inst., Madras (India)
1998-07-01
This paper reviews the developments in the model based control of drying systems using Artificial Neural Networks (ANNs). Survey of current research works reveals the growing interest in the application of ANN in modeling and control of non-linear, dynamic and time-variant systems. Over 115 articles published in this area are reviewed. All landmark papers are systematically classified in chronological order, in three distinct categories; namely, conventional feedback controllers, model based controllers using conventional methods and model based controllers using ANN for drying process. The principles of ANN are presented in detail. The problems and issues of the drying system and the features of various ANN models are dealt with up-to-date. ANN based controllers lead to smoother controller outputs, which would increase actuator life. The paper concludes with suggestions for improving the existing modeling techniques as applied to predicting the performance characteristics of dryers. The hybridization techniques, namely, neural with fuzzy logic and genetic algorithms, presented, provide, directions for pursuing further research for the implementation of appropriate control strategies. The authors opine that the information presented here would be highly beneficial for pursuing research in modeling and control of drying process using ANN. 118 refs.
An Intelligent Ensemble Neural Network Model for Wind Speed Prediction in Renewable Energy Systems
Ranganayaki, V.; Deepa, S. N.
2016-01-01
Various criteria are proposed to select the number of hidden neurons in artificial neural network (ANN) models and based on the criterion evolved an intelligent ensemble neural network model is proposed to predict wind speed in renewable energy applications. The intelligent ensemble neural model based wind speed forecasting is designed by averaging the forecasted values from multiple neural network models which includes multilayer perceptron (MLP), multilayer adaptive linear neuron (Madaline), back propagation neural network (BPN), and probabilistic neural network (PNN) so as to obtain better accuracy in wind speed prediction with minimum error. The random selection of hidden neurons numbers in artificial neural network results in overfitting or underfitting problem. This paper aims to avoid the occurrence of overfitting and underfitting problems. The selection of number of hidden neurons is done in this paper employing 102 criteria; these evolved criteria are verified by the computed various error values. The proposed criteria for fixing hidden neurons are validated employing the convergence theorem. The proposed intelligent ensemble neural model is applied for wind speed prediction application considering the real time wind data collected from the nearby locations. The obtained simulation results substantiate that the proposed ensemble model reduces the error value to minimum and enhances the accuracy. The computed results prove the effectiveness of the proposed ensemble neural network (ENN) model with respect to the considered error factors in comparison with that of the earlier models available in the literature. PMID:27034973
An Intelligent Ensemble Neural Network Model for Wind Speed Prediction in Renewable Energy Systems.
Ranganayaki, V; Deepa, S N
2016-01-01
Various criteria are proposed to select the number of hidden neurons in artificial neural network (ANN) models and based on the criterion evolved an intelligent ensemble neural network model is proposed to predict wind speed in renewable energy applications. The intelligent ensemble neural model based wind speed forecasting is designed by averaging the forecasted values from multiple neural network models which includes multilayer perceptron (MLP), multilayer adaptive linear neuron (Madaline), back propagation neural network (BPN), and probabilistic neural network (PNN) so as to obtain better accuracy in wind speed prediction with minimum error. The random selection of hidden neurons numbers in artificial neural network results in overfitting or underfitting problem. This paper aims to avoid the occurrence of overfitting and underfitting problems. The selection of number of hidden neurons is done in this paper employing 102 criteria; these evolved criteria are verified by the computed various error values. The proposed criteria for fixing hidden neurons are validated employing the convergence theorem. The proposed intelligent ensemble neural model is applied for wind speed prediction application considering the real time wind data collected from the nearby locations. The obtained simulation results substantiate that the proposed ensemble model reduces the error value to minimum and enhances the accuracy. The computed results prove the effectiveness of the proposed ensemble neural network (ENN) model with respect to the considered error factors in comparison with that of the earlier models available in the literature.
DECISION WITH ARTIFICIAL NEURAL NETWORKS IN DISCRETE EVENT SIMULATION MODELS ON A TRAFFIC SYSTEM
Directory of Open Access Journals (Sweden)
Marília Gonçalves Dutra da Silva
2016-04-01
Full Text Available ABSTRACT This work aims to demonstrate the use of a mechanism to be applied in the development of the discrete-event simulation models that perform decision operations through the implementation of an artificial neural network. Actions that involve complex operations performed by a human agent in a process, for example, are often modeled in simplified form with the usual mechanisms of simulation software. Therefore, it was chosen a traffic system controlled by a traffic officer with a flow of vehicles and pedestrians to demonstrate the proposed solution. From a module built in simulation software itself, it was possible to connect the algorithm for intelligent decision to the simulation model. The results showed that the model elaborated responded as expected when it was submitted to actions, which required different decisions to maintain the operation of the system with changes in the flow of people and vehicles.
A Neural Network Architecture For Rapid Model Indexing In Computer Vision Systems
Pawlicki, Ted
1988-03-01
Models of objects stored in memory have been shown to be useful for guiding the processing of computer vision systems. A major consideration in such systems, however, is how stored models are initially accessed and indexed by the system. As the number of stored models increases, the time required to search memory for the correct model becomes high. Parallel distributed, connectionist, neural networks' have been shown to have appealing content addressable memory properties. This paper discusses an architecture for efficient storage and reference of model memories stored as stable patterns of activity in a parallel, distributed, connectionist, neural network. The emergent properties of content addressability and resistance to noise are exploited to perform indexing of the appropriate object centered model from image centered primitives. The system consists of three network modules each of which represent information relative to a different frame of reference. The model memory network is a large state space vector where fields in the vector correspond to ordered component objects and relative, object based spatial relationships between the component objects. The component assertion network represents evidence about the existence of object primitives in the input image. It establishes local frames of reference for object primitives relative to the image based frame of reference. The spatial relationship constraint network is an intermediate representation which enables the association between the object based and the image based frames of reference. This intermediate level represents information about possible object orderings and establishes relative spatial relationships from the image based information in the component assertion network below. It is also constrained by the lawful object orderings in the model memory network above. The system design is consistent with current psychological theories of recognition by component. It also seems to support Marr's notions
Goal-Directed Behavior and Instrumental Devaluation: A Neural System-Level Computational Model.
Mannella, Francesco; Mirolli, Marco; Baldassarre, Gianluca
2016-01-01
Devaluation is the key experimental paradigm used to demonstrate the presence of instrumental behaviors guided by goals in mammals. We propose a neural system-level computational model to address the question of which brain mechanisms allow the current value of rewards to control instrumental actions. The model pivots on and shows the computational soundness of the hypothesis for which the internal representation of instrumental manipulanda (e.g., levers) activate the representation of rewards (or "action-outcomes", e.g., foods) while attributing to them a value which depends on the current internal state of the animal (e.g., satiation for some but not all foods). The model also proposes an initial hypothesis of the integrated system of key brain components supporting this process and allowing the recalled outcomes to bias action selection: (a) the sub-system formed by the basolateral amygdala and insular cortex acquiring the manipulanda-outcomes associations and attributing the current value to the outcomes; (b) three basal ganglia-cortical loops selecting respectively goals, associative sensory representations, and actions; (c) the cortico-cortical and striato-nigro-striatal neural pathways supporting the selection, and selection learning, of actions based on habits and goals. The model reproduces and explains the results of several devaluation experiments carried out with control rats and rats with pre- and post-training lesions of the basolateral amygdala, the nucleus accumbens core, the prelimbic cortex, and the dorso-medial striatum. The results support the soundness of the hypotheses of the model and show its capacity to integrate, at the system-level, the operations of the key brain structures underlying devaluation. Based on its hypotheses and predictions, the model also represents an operational framework to support the design and analysis of new experiments on the motivational aspects of goal-directed behavior.
Directory of Open Access Journals (Sweden)
K Sedhuraman
2012-12-01
Full Text Available In this paper, a novel reactive power based model reference neural learning adaptive system (RP-MRNLAS is proposed. The model reference adaptive system (MRAS based speed estimation is one of the most popular methods used for sensor-less controlled induction motor drives. In conventional MRAS, the error adaptation is done using a Proportional-integral-(PI. The non-linear mapping capability of a neural network (NN and the powerful learning algorithms have increased the applications of NN in power electronics and drives. Thus, a neural learning algorithm is used for the adaptation mechanism in MRAS and is often referred to as a model reference neural learning adaptive system (MRNLAS. In MRNLAS, the error between the reference and neural learning adaptive models is back propagated to adjust the weights of the neural network for rotor speed estimation. The two different methods of MRNLAS are flux based (RF-MRNLAS and reactive power based (RP-MRNLAS. The reactive power- based methods are simple and free from integral equations as compared to flux based methods. The advantage of the reactive power based method and the NN learning algorithms are exploited in this work to yield a RPMRNLAS. The performance of the proposed RP-MRNLAS is analyzed extensively. The proposed RP-MRNLAS is compared in terms of accuracy and integrator drift problems with popular rotor flux-based MRNLAS for the same system and validated through Matlab/Simulink. The superiority of the RP- MRNLAS technique is demonstrated
A 3D human neural cell culture system for modeling Alzheimer’s disease
Kim, Young Hye; Choi, Se Hoon; D’Avanzo, Carla; Hebisch, Matthias; Sliwinski, Christopher; Bylykbashi, Enjana; Washicosky, Kevin J.; Klee, Justin B.; Brüstle, Oliver; Tanzi, Rudolph E.; Kim, Doo Yeon
2015-01-01
Stem cell technologies have facilitated the development of human cellular disease models that can be used to study pathogenesis and test therapeutic candidates. These models hold promise for complex neurological diseases such as Alzheimer’s disease (AD) because existing animal models have been unable to fully recapitulate all aspects of pathology. We recently reported the characterization of a novel three-dimensional (3D) culture system that exhibits key events in AD pathogenesis, including extracellular aggregation of β-amyloid and accumulation of hyperphosphorylated tau. Here we provide instructions for the generation and analysis of 3D human neural cell cultures, including the production of genetically modified human neural progenitor cells (hNPCs) with familial AD mutations, the differentiation of the hNPCs in a 3D matrix, and the analysis of AD pathogenesis. The 3D culture generation takes 1–2 days. The aggregation of β-amyloid is observed after 6-weeks of differentiation followed by robust tau pathology after 10–14 weeks. PMID:26068894
Biological channel modeling and implantable UWB antenna design for neural recording systems.
Bahrami, Hadi; Mirbozorgi, S Abdollah; Rusch, Leslie A; Gosselin, Benoit
2015-01-01
Ultrawideband (UWB) short-range communication systems have proved to be valuable in medical technology, particularly for implanted devices, due to their low-power consumption, low cost, small size, and high data rates. Neural activity monitoring in the brain requires high data rate (800 kb/s per neural sensor), and we target a system supporting a large number of sensors, in particular, aggregate transmission above 430 Mb/s (∼512 sensors). Knowledge of channel behavior is required to determine the maximum allowable power to 1) respect ANSI guidelines for avoiding tissue damage, and 2) respect FCC guidelines on unlicensed transmissions. We utilize a realistic model of the biological channel to inform the design of antennas for the implanted transmitter and the external receiver under these requirements. Antennas placement is examined under two scenarios having contrasting power constraints. Performance of the system within the biological tissues is examined via simulation and experiment. Our miniaturized antennas, 12 mm ×12 mm, need worst-case receiver sensitivities of -38 and -30.5 dBm for the first and second scenarios, respectively. These sensitivities allow us to successfully detect signals transmitted through tissues in the 3.1-10.6-GHz UWB band.
Olyaee, Saeed; Ebrahimpour, Reza; Hamedi, Samaneh; Jafarlou, Farzad M.
2009-08-01
Periodic nonlinearity is the main limitation on the accuracy of the nano-displacement measurements in the heterodyne interferometers. It is mainly produced by non-ideal polarized beams of the leaser and imperfect alignment of the optical components. In this paper, we model the periodic nonlinearity resulting from non-orthogonality and ellipticity of the laser beam by using combination of neural networks such as stacked generalization method and mixture of experts. The ensemble neural networks used for nonlinearity modeling are compared with single neural networks such as multi layer percepterons and radial basis function.
Ceylan, Halil; Gopalakrishnan, Kasthurirangan; Birkan Bayrak, Mustafa; Guclu, Alper
2013-09-01
The need to rapidly and cost-effectively evaluate the present condition of pavement infrastructure is a critical issue concerning the deterioration of ageing transportation infrastructure all around the world. Nondestructive testing (NDT) and evaluation methods are well-suited for characterising materials and determining structural integrity of pavement systems. The falling weight deflectometer (FWD) is a NDT equipment used to assess the structural condition of highway and airfield pavement systems and to determine the moduli of pavement layers. This involves static or dynamic inverse analysis (referred to as backcalculation) of FWD deflection profiles in the pavement surface under a simulated truck load. The main objective of this study was to employ biologically inspired computational systems to develop robust pavement layer moduli backcalculation algorithms that can tolerate noise or inaccuracies in the FWD deflection data collected in the field. Artificial neural systems, also known as artificial neural networks (ANNs), are valuable computational intelligence tools that are increasingly being used to solve resource-intensive complex engineering problems. Unlike the linear elastic layered theory commonly used in pavement layer backcalculation, non-linear unbound aggregate base and subgrade soil response models were used in an axisymmetric finite element structural analysis programme to generate synthetic database for training and testing the ANN models. In order to develop more robust networks that can tolerate the noisy or inaccurate pavement deflection patterns in the NDT data, several network architectures were trained with varying levels of noise in them. The trained ANN models were capable of rapidly predicting the pavement layer moduli and critical pavement responses (tensile strains at the bottom of the asphalt concrete layer, compressive strains on top of the subgrade layer and the deviator stresses on top of the subgrade layer), and also pavement
Emergence of gamma motor activity in an artificial neural network model of the corticospinal system.
Grandjean, Bernard; Maier, Marc A
2017-02-01
Muscle spindle discharge during active movement is a function of mechanical and neural parameters. Muscle length changes (and their derivatives) represent its primary mechanical, fusimotor drive its neural component. However, neither the action nor the function of fusimotor and in particular of γ-drive, have been clearly established, since γ-motor activity during voluntary, non-locomotor movements remains largely unknown. Here, using a computational approach, we explored whether γ-drive emerges in an artificial neural network model of the corticospinal system linked to a biomechanical antagonist wrist simulator. The wrist simulator included length-sensitive and γ-drive-dependent type Ia and type II muscle spindle activity. Network activity and connectivity were derived by a gradient descent algorithm to generate reciprocal, known target α-motor unit activity during wrist flexion-extension (F/E) movements. Two tasks were simulated: an alternating F/E task and a slow F/E tracking task. Emergence of γ-motor activity in the alternating F/E network was a function of α-motor unit drive: if muscle afferent (together with supraspinal) input was required for driving α-motor units, then γ-drive emerged in the form of α-γ coactivation, as predicted by empirical studies. In the slow F/E tracking network, γ-drive emerged in the form of α-γ dissociation and provided critical, bidirectional muscle afferent activity to the cortical network, containing known bidirectional target units. The model thus demonstrates the complementary aspects of spindle output and hence γ-drive: i) muscle spindle activity as a driving force of α-motor unit activity, and ii) afferent activity providing continuous sensory information, both of which crucially depend on γ-drive.
Guarneri, Paolo; Rocca, Gianpiero; Gobbi, Massimiliano
2008-09-01
This paper deals with the simulation of the tire/suspension dynamics by using recurrent neural networks (RNNs). RNNs are derived from the multilayer feedforward neural networks, by adding feedback connections between output and input layers. The optimal network architecture derives from a parametric analysis based on the optimal tradeoff between network accuracy and size. The neural network can be trained with experimental data obtained in the laboratory from simulated road profiles (cleats). The results obtained from the neural network demonstrate good agreement with the experimental results over a wide range of operation conditions. The NN model can be effectively applied as a part of vehicle system model to accurately predict elastic bushings and tire dynamics behavior. Although the neural network model, as a black-box model, does not provide a good insight of the physical behavior of the tire/suspension system, it is a useful tool for assessing vehicle ride and noise, vibration, harshness (NVH) performance due to its good computational efficiency and accuracy.
What ethologically based models have taught us about the neural systems underlying fear and anxiety
Directory of Open Access Journals (Sweden)
N.S. Canteras
2012-04-01
Full Text Available Classical Pavlovian fear conditioning to painful stimuli has provided the generally accepted view of a core system centered in the central amygdala to organize fear responses. Ethologically based models using other sources of threat likely to be expected in a natural environment, such as predators or aggressive dominant conspecifics, have challenged this concept of a unitary core circuit for fear processing. We discuss here what the ethologically based models have told us about the neural systems organizing fear responses. We explored the concept that parallel paths process different classes of threats, and that these different paths influence distinct regions in the periaqueductal gray - a critical element for the organization of all kinds of fear responses. Despite this parallel processing of different kinds of threats, we have discussed an interesting emerging view that common cortical-hippocampal-amygdalar paths seem to be engaged in fear conditioning to painful stimuli, to predators and, perhaps, to aggressive dominant conspecifics as well. Overall, the aim of this review is to bring into focus a more global and comprehensive view of the systems organizing fear responses.
Directory of Open Access Journals (Sweden)
Hermantoro
2008-04-01
Full Text Available Land evaluation for specific purpose in plantation sector become very important due to increasing the competition in land use and the development of plantation sector. Land evaluation produces information of land economic values for specific land use. The objective of the research is to develop land evaluation method for cocoa estate using integrated model Artificial Neural Network (ANN and Geographical Information System (GIS. Back propagation ANN model were used to predict cocoa yield base on land qualities parameter. The result shows that the best of ANN model to predict cocoa yield have 15 input layer, 15 hidden layer, and 1 output layer. with the determination coefficient (r2 of 0.99 and Root Mean Square Error (RMSE of 93.83 in the training process, otherwise in the testing found the r2of O. 76 and RMSE of 113.83. In verification stage the integrated model ofANN and GIS was used to evaluate land suitability of Wijayaarga Cocoa Plantation is seem accurate in predicting cocoa yield and easers to mapping the land suitability unit.
Elman neural network for modeling and predictive control of delayed dynamic systems
Directory of Open Access Journals (Sweden)
Wysocki Antoni
2016-03-01
Full Text Available The objective of this paper is to present a modified structure and a training algorithm of the recurrent Elman neural network which makes it possible to explicitly take into account the time-delay of the process and a Model Predictive Control (MPC algorithm for such a network. In MPC the predicted output trajectory is repeatedly linearized on-line along the future input trajectory, which leads to a quadratic optimization problem, nonlinear optimization is not necessary. A strongly nonlinear benchmark process (a simulated neutralization reactor is considered to show advantages of the modified Elman neural network and the discussed MPC algorithm. The modified neural model is more precise and has a lower number of parameters in comparison with the classical Elman structure. The discussed MPC algorithm with on-line linearization gives similar trajectories as MPC with nonlinear optimization repeated at each sampling instant.
Bamford, Simeon A; Hogri, Roni; Giovannucci, Andrea; Taub, Aryeh H; Herreros, Ivan; Verschure, Paul F M J; Mintz, Matti; Del Giudice, Paolo
2012-07-01
A very-large-scale integration field-programmable mixed-signal array specialized for neural signal processing and neural modeling has been designed. This has been fabricated as a core on a chip prototype intended for use in an implantable closed-loop prosthetic system aimed at rehabilitation of the learning of a discrete motor response. The chosen experimental context is cerebellar classical conditioning of the eye-blink response. The programmable system is based on the intimate mixing of switched capacitor analog techniques with low speed digital computation; power saving innovations within this framework are presented. The utility of the system is demonstrated by the implementation of a motor classical conditioning model applied to eye-blink conditioning in real time with associated neural signal processing. Paired conditioned and unconditioned stimuli were repeatedly presented to an anesthetized rat and recordings were taken simultaneously from two precerebellar nuclei. These paired stimuli were detected in real time from this multichannel data. This resulted in the acquisition of a trigger for a well-timed conditioned eye-blink response, and repetition of unpaired trials constructed from the same data led to the extinction of the conditioned response trigger, compatible with natural cerebellar learning in awake animals.
Sunal, Cynthia Szymanski; Karr, Charles L.; Sunal, Dennis W.
2003-01-01
Students' conceptions of three major artificial intelligence concepts used in the modeling of systems in science, fuzzy logic, neural networks, and genetic algorithms were investigated before and after a higher education science course. Students initially explored their prior ideas related to the three concepts through active tasks. Then,…
A free geometry model-independent neural eye-gaze tracking system.
Gneo, Massimo; Schmid, Maurizio; Conforto, Silvia; D'Alessio, Tommaso
2012-11-16
Eye Gaze Tracking Systems (EGTSs) estimate the Point Of Gaze (POG) of a user. In diagnostic applications EGTSs are used to study oculomotor characteristics and abnormalities, whereas in interactive applications EGTSs are proposed as input devices for human computer interfaces (HCI), e.g. to move a cursor on the screen when mouse control is not possible, such as in the case of assistive devices for people suffering from locked-in syndrome. If the user's head remains still and the cornea rotates around its fixed centre, the pupil follows the eye in the images captured from one or more cameras, whereas the outer corneal reflection generated by an IR light source, i.e. glint, can be assumed as a fixed reference point. According to the so-called pupil centre corneal reflection method (PCCR), the POG can be thus estimated from the pupil-glint vector. A new model-independent EGTS based on the PCCR is proposed. The mapping function based on artificial neural networks allows to avoid any specific model assumption and approximation either for the user's eye physiology or for the system initial setup admitting a free geometry positioning for the user and the system components. The robustness of the proposed EGTS is proven by assessing its accuracy when tested on real data coming from: i) different healthy users; ii) different geometric settings of the camera and the light sources; iii) different protocols based on the observation of points on a calibration grid and halfway points of a test grid. The achieved accuracy is approximately 0.49°, 0.41°, and 0.62° for respectively the horizontal, vertical and radial error of the POG. The results prove the validity of the proposed approach as the proposed system performs better than EGTSs designed for HCI which, even if equipped with superior hardware, show accuracy values in the range 0.6°-1°.
Hierarchical neural network model of the visual system determining figure/ground relation
Kikuchi, Masayuki
2017-07-01
One of the most important functions of the visual perception in the brain is figure/ground interpretation from input images. Figural region in 2D image corresponding to object in 3D space are distinguished from background region extended behind the object. Previously the author proposed a neural network model of figure/ground separation constructed on the standpoint that local geometric features such as curvatures and outer angles at corners are extracted and propagated along input contour in a single layer network (Kikuchi & Akashi, 2001). However, such a processing principle has the defect that signal propagation requires manyiterations despite the fact that actual visual system determines figure/ground relation within the short period (Zhou et al., 2000). In order to attain speed-up for determining figure/ground, this study incorporates hierarchical architecture into the previous model. This study confirmed the effect of the hierarchization as for the computation time by simulation. As the number of layers increased, the required computation time reduced. However, such speed-up effect was saturatedas the layers increased to some extent. This study attempted to explain this saturation effect by the notion of average distance between vertices in the area of complex network, and succeeded to mimic the saturation effect by computer simulation.
Control System Design for Cylindrical Tank Process Using Neural Model Predictive Control Technique
Directory of Open Access Journals (Sweden)
M. Sridevi
2010-10-01
Full Text Available Chemical manufacturing and process industry requires innovative technologies for process identification. This paper deals with model identification and control of cylindrical process. Model identification of the process was done using ARMAX technique. A neural model predictive controller was designed for the identified model. The performance of the controllers was evaluated using MATLAB software. The performance of NMPC controller was compared with Smith Predictor controller and IMC controller based on rise time, settling time, overshoot and ISE and it was found that the NMPC controller is better suited for this process.
Hemmen, J; Schulten, Klaus
1994-01-01
Since the appearance of Vol. 1 of Models of Neural Networks in 1991, the theory of neural nets has focused on two paradigms: information coding through coherent firing of the neurons and functional feedback. Information coding through coherent neuronal firing exploits time as a cardinal degree of freedom. This capacity of a neural network rests on the fact that the neuronal action potential is a short, say 1 ms, spike, localized in space and time. Spatial as well as temporal correlations of activity may represent different states of a network. In particular, temporal correlations of activity may express that neurons process the same "object" of, for example, a visual scene by spiking at the very same time. The traditional description of a neural network through a firing rate, the famous S-shaped curve, presupposes a wide time window of, say, at least 100 ms. It thus fails to exploit the capacity to "bind" sets of coherently firing neurons for the purpose of both scene segmentation and figure-ground segregatio...
A free geometry model-independent neural eye-gaze tracking system
Directory of Open Access Journals (Sweden)
Gneo Massimo
2012-11-01
Full Text Available Abstract Background Eye Gaze Tracking Systems (EGTSs estimate the Point Of Gaze (POG of a user. In diagnostic applications EGTSs are used to study oculomotor characteristics and abnormalities, whereas in interactive applications EGTSs are proposed as input devices for human computer interfaces (HCI, e.g. to move a cursor on the screen when mouse control is not possible, such as in the case of assistive devices for people suffering from locked-in syndrome. If the user’s head remains still and the cornea rotates around its fixed centre, the pupil follows the eye in the images captured from one or more cameras, whereas the outer corneal reflection generated by an IR light source, i.e. glint, can be assumed as a fixed reference point. According to the so-called pupil centre corneal reflection method (PCCR, the POG can be thus estimated from the pupil-glint vector. Methods A new model-independent EGTS based on the PCCR is proposed. The mapping function based on artificial neural networks allows to avoid any specific model assumption and approximation either for the user’s eye physiology or for the system initial setup admitting a free geometry positioning for the user and the system components. The robustness of the proposed EGTS is proven by assessing its accuracy when tested on real data coming from: i different healthy users; ii different geometric settings of the camera and the light sources; iii different protocols based on the observation of points on a calibration grid and halfway points of a test grid. Results The achieved accuracy is approximately 0.49°, 0.41°, and 0.62° for respectively the horizontal, vertical and radial error of the POG. Conclusions The results prove the validity of the proposed approach as the proposed system performs better than EGTSs designed for HCI which, even if equipped with superior hardware, show accuracy values in the range 0.6°-1°.
Directory of Open Access Journals (Sweden)
Ch. Sanjay
2014-12-01
Full Text Available In machining processes, drilling operation is material removal process that has been widely used in manufacturing since industrial revolution. The useful life of cutting tool and its operating conditions largely controls the economics of machining operations. Drilling is most frequently performed material removing process and is used as a preliminary step for many operations, such as reaming, tapping, and boring. Drill wear has a bad effect on the surface finish and dimensional accuracy of the work piece. The surface finish of a machined part is one of the most important quality characteristics in manufacturing industries. The primary objective of this research is the prediction of suitable parameters for surface roughness in drilling. Cutting speed, cutting force, and machining time were given as inputs to the adaptive fuzzy neural network and neuro-fuzzy analysis for estimating the values of surface roughness by using 2, 3, 4, and 5 membership functions. The best structures were selected based on minimum of summation of square with the actual values with the estimated values by artificial neural fuzzy inference system (ANFIS and neuro-fuzzy systems. For artificial neural network (ANN analysis, the number of neurons was selected from 1, 2, 3, … , 20. The learning rate was selected as .5 and .5 smoothing factor was used. The inputs were selected as cutting speed, feed, machining time, and thrust force. The best structures of neural networks were selected based on the criteria as the minimum of summation of square with the actual value of surface roughness. Drilling experiments with 10 mm size were performed at two cutting speeds and feeds. Comparative analysis has been done between the actual values and the estimated values obtained by ANFIS, neuro-fuzzy, and ANN analysis.
Directory of Open Access Journals (Sweden)
Fengxia Xu
2014-01-01
Full Text Available U-model can approximate a large class of smooth nonlinear time-varying delay system to any accuracy by using time-varying delay parameters polynomial. This paper proposes a new approach, namely, U-model approach, to solving the problems of analysis and synthesis for nonlinear systems. Based on the idea of discrete-time U-model with time-varying delay, the identification algorithm of adaptive neural network is given for the nonlinear model. Then, the controller is designed by using the Newton-Raphson formula and the stability analysis is given for the closed-loop nonlinear systems. Finally, illustrative examples are given to show the validity and applicability of the obtained results.
Beyond GLMs: a generative mixture modeling approach to neural system identification.
Directory of Open Access Journals (Sweden)
Lucas Theis
Full Text Available Generalized linear models (GLMs represent a popular choice for the probabilistic characterization of neural spike responses. While GLMs are attractive for their computational tractability, they also impose strong assumptions and thus only allow for a limited range of stimulus-response relationships to be discovered. Alternative approaches exist that make only very weak assumptions but scale poorly to high-dimensional stimulus spaces. Here we seek an approach which can gracefully interpolate between the two extremes. We extend two frequently used special cases of the GLM-a linear and a quadratic model-by assuming that the spike-triggered and non-spike-triggered distributions can be adequately represented using Gaussian mixtures. Because we derive the model from a generative perspective, its components are easy to interpret as they correspond to, for example, the spike-triggered distribution and the interspike interval distribution. The model is able to capture complex dependencies on high-dimensional stimuli with far fewer parameters than other approaches such as histogram-based methods. The added flexibility comes at the cost of a non-concave log-likelihood. We show that in practice this does not have to be an issue and the mixture-based model is able to outperform generalized linear and quadratic models.
National Research Council Canada - National Science Library
Omidvar, Omid; Elliott, David L
1997-01-01
... is reprinted with permission from A. Barto, "Reinforcement Learning," Handbook of Brain Theory and Neural Networks, M.A. Arbib, ed.. The MIT Press, Cambridge, MA, pp. 804-809, 1995. Chapter 4, Figures 4-5 and 7-9 and Tables 2-5, are reprinted with permission, from S. Cho, "Map Formation in Proprioceptive Cortex," International Jour...
Spike Neural Models Part II: Abstract Neural Models
Johnson, Melissa G.; Chartier, Sylvain
2018-01-01
Neurons are complex cells that require a lot of time and resources to model completely. In spiking neural networks (SNN) though, not all that complexity is required. Therefore simple, abstract models are often used. These models save time, use less computer resources, and are easier to understand. This tutorial presents two such models: Izhikevich's model, which is biologically realistic in the resulting spike trains but not in the parameters, and the Leaky Integrate and Fire (LIF) model whic...
A spiking neural network model of 3D perception for event-based neuromorphic stereo vision systems
Osswald, Marc; Ieng, Sio-Hoi; Benosman, Ryad; Indiveri, Giacomo
2017-01-01
Stereo vision is an important feature that enables machine vision systems to perceive their environment in 3D. While machine vision has spawned a variety of software algorithms to solve the stereo-correspondence problem, their implementation and integration in small, fast, and efficient hardware vision systems remains a difficult challenge. Recent advances made in neuromorphic engineering offer a possible solution to this problem, with the use of a new class of event-based vision sensors and neural processing devices inspired by the organizing principles of the brain. Here we propose a radically novel model that solves the stereo-correspondence problem with a spiking neural network that can be directly implemented with massively parallel, compact, low-latency and low-power neuromorphic engineering devices. We validate the model with experimental results, highlighting features that are in agreement with both computational neuroscience stereo vision theories and experimental findings. We demonstrate its features with a prototype neuromorphic hardware system and provide testable predictions on the role of spike-based representations and temporal dynamics in biological stereo vision processing systems.
A spiking neural network model of 3D perception for event-based neuromorphic stereo vision systems.
Osswald, Marc; Ieng, Sio-Hoi; Benosman, Ryad; Indiveri, Giacomo
2017-01-12
Stereo vision is an important feature that enables machine vision systems to perceive their environment in 3D. While machine vision has spawned a variety of software algorithms to solve the stereo-correspondence problem, their implementation and integration in small, fast, and efficient hardware vision systems remains a difficult challenge. Recent advances made in neuromorphic engineering offer a possible solution to this problem, with the use of a new class of event-based vision sensors and neural processing devices inspired by the organizing principles of the brain. Here we propose a radically novel model that solves the stereo-correspondence problem with a spiking neural network that can be directly implemented with massively parallel, compact, low-latency and low-power neuromorphic engineering devices. We validate the model with experimental results, highlighting features that are in agreement with both computational neuroscience stereo vision theories and experimental findings. We demonstrate its features with a prototype neuromorphic hardware system and provide testable predictions on the role of spike-based representations and temporal dynamics in biological stereo vision processing systems.
Vos, JE; vanHeijst, JJ; Greuters, S; Silva, FL; Principe, JC; Almeida, LB
1997-01-01
An artificial neural network model is presented in which the development is simulated of a baby's ability to control movement of his forearm around the elbow, until he is capable of goal-directed reaching. The neural network implementation provides the facility to change the number of nodes (or
Directory of Open Access Journals (Sweden)
Li Zeng
2015-11-01
Full Text Available This article puts forward inductive magnetic suspension spherical active joints and has researched on its mechanism. The expression of motor’s electromagnetic torque is derived from the point of power balance of three-dimensional electromagnetic model, and on the basis of the air gap magnetic flux density distribution, we establish the joint’s mathematical model of electromagnetic levitation force. The relationship between the two of displacement, angle, and current and the transfer function expression of motor system are derived by the state equation and the inverse system theory We established the inverse system of joint’s original system using fuzzy neural network theory and simplified coupling relationship of the motor’s complex multivariable to establish ANFIS model of joint’s inverse system. An internal model controller with high robustness and stability was designed, and an internal model control joint pseudo linear system was built. According to the simulation analysis and experimental verification of the joint control system, the conclusion indicates that the rotor has quick dynamic response and high robustness.
Problems of large neurodynamics system modeling: optical synergetics and neural networks
Vorontsov, Mikhail A.
1991-04-01
The possibilities of modeling developed neuronetwork dynamics are investigated by nonlinear coherent optical systems with a 2-D feedback. A comparative analysis of neuron-like systems of various physical nature has been made. The results of experimental investigations of nonlinear optical system dynamics with nonlocal connections are discussed.
Neural network modeling of energy use and greenhouse gas emissions of watermelon production systems
Directory of Open Access Journals (Sweden)
Ashkan Nabavi-Pelesaraei
2016-01-01
Full Text Available This study was conducted in order to determine energy consumption, model and analyze the input–output, energy efficiencies and GHG emissions for watermelon production using artificial neural networks (ANNs in the Guilan province of Iran, based on three different farm sizes. For this purpose, the initial data was collected from 120 watermelon producers in Langroud and Chaf region, two small cities in the Guilan province. The results indicated that total average energy input for watermelon production was 40228.98 MJ ha–1. Also, chemical fertilizers (with 76.49% were the highest energy inputs for watermelon production. Moreover, the share of non-renewable energy (with 96.24% was more than renewable energy (with 3.76% in watermelon production. The rate of energy use efficiency, energy productivity and net energy was calculated as 1.29, 0.68 kg MJ−1 and 11733.64 MJ ha−1, respectively. With respect to GHG analysis, the average of total GHG emissions was calculated about 1015 kgCO2eq. ha−1. The results illustrated that share of nitrogen (with 54.23% was the highest in GHG emissions for watermelon production, followed by diesel fuel (with 16.73% and electricity (with 15.45%. In this study, Levenberg–Marquardt learning Algorithm was used for training ANNs based on data collected from watermelon producers. The ANN model with 11–10–2 structure was the best one for predicting the watermelon yield and GHG emissions. In the best topology, the coefficient of determination (R2 was calculated as 0.969 and 0.995 for yield and GHG emissions of watermelon production, respectively. Furthermore, the results of sensitivity analysis revealed that the seed and human labor had the highest sensitivity in modeling of watermelon yield and GHG emissions, respectively.
Wei, Jiaqiang; Peng, Mengdong; Li, Qing; Wang, Yining
2016-11-09
To explore the feasibility of a novel computer color-matching (CCM) system based on the improved back-propagation neural network (BPNN) model by comparing it with the traditional visual method. Forty-three metal-ceramic specimens were fabricated by proportionally mixing porcelain powders. Thirty-nine specimens were randomly selected to train the BPNN model, while the remaining four specimens were used to test and calibrate the model. A CCM system based on the improved BPNN model was constructed using MATLAB software. A comparison of the novel CCM system and the traditional visual method was conducted by evaluating the color reproduction results of 10 maxillary central incisors. Metal-ceramic specimens were fabricated using two color reproduction approaches. Color distributions (L*, a*, and b*) of the target teeth and of the corresponding metal-ceramic specimens were measured using a spectroradiometer. Color differences (ΔE) and color distributions (ΔL*, Δa*, and Δb*) between the teeth and their corresponding specimens were calculated. The average ΔE value of the CCM system was 1.89 ± 0.75, which was lower than that of the visual approach (3.54 ± 1.11, p systems, except for ΔL* (p > 0.05). The novel CCM system produced greater accuracy in color reproduction within the given color space than the traditional visual approach. © 2016 by the American College of Prosthodontists.
Degenerate coding in neural systems.
Leonardo, Anthony
2005-11-01
When the dimensionality of a neural circuit is substantially larger than the dimensionality of the variable it encodes, many different degenerate network states can produce the same output. In this review I will discuss three different neural systems that are linked by this theme. The pyloric network of the lobster, the song control system of the zebra finch, and the odor encoding system of the locust, while different in design, all contain degeneracies between their internal parameters and the outputs they encode. Indeed, although the dynamics of song generation and odor identification are quite different, computationally, odor recognition can be thought of as running the song generation circuitry backwards. In both of these systems, degeneracy plays a vital role in mapping a sparse neural representation devoid of correlations onto external stimuli (odors or song structure) that are strongly correlated. I argue that degeneracy between input and output states is an inherent feature of many neural systems, which can be exploited as a fault-tolerant method of reliably learning, generating, and discriminating closely related patterns.
Memory Storage and Neural Systems.
Alkon, Daniel L.
1989-01-01
Investigates memory storage and molecular nature of associative-memory formation by analyzing Pavlovian conditioning in marine snails and rabbits. Presented is the design of a computer-based memory system (neural networks) using the rules acquired in the investigation. Reports that the artificial network recognized patterns well. (YP)
Neural modeling of prefrontal executive function
Energy Technology Data Exchange (ETDEWEB)
Levine, D.S. [Univ. of Texas, Arlington, TX (United States)
1996-12-31
Brain executive function is based in a distributed system whereby prefrontal cortex is interconnected with other cortical. and subcortical loci. Executive function is divided roughly into three interacting parts: affective guidance of responses; linkage among working memory representations; and forming complex behavioral schemata. Neural network models of each of these parts are reviewed and fit into a preliminary theoretical framework.
Generalization performance of regularized neural network models
DEFF Research Database (Denmark)
Larsen, Jan; Hansen, Lars Kai
1994-01-01
Architecture optimization is a fundamental problem of neural network modeling. The optimal architecture is defined as the one which minimizes the generalization error. This paper addresses estimation of the generalization performance of regularized, complete neural network models. Regularization...
Plant Growth Models Using Artificial Neural Networks
Bubenheim, David
1997-01-01
In this paper, we descrive our motivation and approach to devloping models and the neural network architecture. Initial use of the artificial neural network for modeling the single plant process of transpiration is presented.
Directory of Open Access Journals (Sweden)
Francois M Lambert
2012-04-01
Full Text Available Studies of behavioral consequences after unilateral labyrinthectomy have a long tradition in the quest of determining rules and limitations of the CNS to exert plastic changes that assist the recuperation from the loss of sensory inputs. Frogs were among the first animal models to illustrate general principles of regenerative capacity and reorganizational neural flexibility after a vestibular lesion. The continuous successful use of the latter animals is in part based on the easy access and identifiability of nerve branches to inner ear organs for surgical intervention, the possibility to employ whole brain preparations for in vitro studies and the limited degree of freedom of postural reflexes for quantification of behavioral impairments and subsequent improvements. Major discoveries that increased the knowledge of post-lesional reactive mechanisms in the central nervous system include alterations in vestibular commissural signal processing and activation of cooperative changes in excitatory and inhibitory inputs to disfacilitated neurons. Moreover, the observed increase of synaptic efficacy in propriospinal circuits illustrates the importance of limb proprioceptive inputs for postural recovery. Accumulated evidence suggests that the lesion-induced neural plasticity is not a goal-directed process that aims towards a meaningful restoration of vestibular reflexes but rather attempts a survival of those neurons that have lost their excitatory inputs. Accordingly, the reaction mechanism causes an improvement of some components but also a deterioration of other aspects as seen by spatio-temporally inappropriate vestibulo-motor responses, similar to the consequences of plasticity processes in various sensory systems and species. The generality of the findings indicate that frogs continue to form a highly amenable vertebrate model system for exploring molecular and physiological events during cellular and network reorganization after a loss of
Energy Technology Data Exchange (ETDEWEB)
Mellit, A. [Univ. Center of Medea, Inst. of Engineering Sciences, Ain Dahab (Algeria); Benghanem, M. [Univ. of Sciences and Technology Houari Boumediene (USTHB), Faculty of Electrical Engineering, Algiers (Algeria); Arab, A. Hadj [Development Center of Renewable Energy (CDER), Algiers (Algeria); CIEMAT, Dept. de Energias Renerables, Madrid (Spain); Guessoum, A. [Ministry for the Higher Education and Scientific Research, Algiers (Algeria)
2005-08-01
In this paper we investigate, the possibility of using an adaptive Artificial Neural Network (ANN), in order to find a suitable model for sizing Stand-Alone Photovoltaic (SAPV) systems, based on a minimum of input data. The model combines Radial Basis Function (RBF) network and Infinite Impulse Response (IIR) filter in order to accelerate the convergence of the network. For the sizing of a photovoltaic (PV) systems, we need to determine the optimal sizing coefficients (K{sub PV}, K{sub B}). These coefficients allow us to determine the number of solar panels and storage batteries necessary to satisfy a given consumption, especially in isolated sites where the global solar radiation data is not always available. These coefficients are considered the most important parameters for sizing a PV system. Results obtained by classical models (analytical, numerical, analytical-numerical, B-spline function) and new models like feed-forward (MLP), radial basis function (RBF), MLP-IIR and RBF-IIR are compared with experimental sizing coefficients in order to illustrate the accuracy of the new developed model. This model has been trained by using 200 known optimal sizing coefficients corresponding to 200 locations in Algeria. In this way, the adaptive model was trained to accept and handle a number of unusual cases. The unknown validation sizing coefficients set produced very accurate estimation with a correlation coefficient of 98%. This result indicates that the proposed method can be successfully used for the estimation of optimal sizing coefficients of SAPV systems for any locations in Algeria. The methodology proposed in this paper however, can be generalized using different locations of the world. (Author)
Weather forecasting based on hybrid neural model
Saba, Tanzila; Rehman, Amjad; AlGhamdi, Jarallah S.
2017-02-01
Making deductions and expectations about climate has been a challenge all through mankind's history. Challenges with exact meteorological directions assist to foresee and handle problems well in time. Different strategies have been investigated using various machine learning techniques in reported forecasting systems. Current research investigates climate as a major challenge for machine information mining and deduction. Accordingly, this paper presents a hybrid neural model (MLP and RBF) to enhance the accuracy of weather forecasting. Proposed hybrid model ensure precise forecasting due to the specialty of climate anticipating frameworks. The study concentrates on the data representing Saudi Arabia weather forecasting. The main input features employed to train individual and hybrid neural networks that include average dew point, minimum temperature, maximum temperature, mean temperature, average relative moistness, precipitation, normal wind speed, high wind speed and average cloudiness. The output layer composed of two neurons to represent rainy and dry weathers. Moreover, trial and error approach is adopted to select an appropriate number of inputs to the hybrid neural network. Correlation coefficient, RMSE and scatter index are the standard yard sticks adopted for forecast accuracy measurement. On individual standing MLP forecasting results are better than RBF, however, the proposed simplified hybrid neural model comes out with better forecasting accuracy as compared to both individual networks. Additionally, results are better than reported in the state of art, using a simple neural structure that reduces training time and complexity.
Weather forecasting based on hybrid neural model
Saba, Tanzila; Rehman, Amjad; AlGhamdi, Jarallah S.
2017-11-01
Making deductions and expectations about climate has been a challenge all through mankind's history. Challenges with exact meteorological directions assist to foresee and handle problems well in time. Different strategies have been investigated using various machine learning techniques in reported forecasting systems. Current research investigates climate as a major challenge for machine information mining and deduction. Accordingly, this paper presents a hybrid neural model (MLP and RBF) to enhance the accuracy of weather forecasting. Proposed hybrid model ensure precise forecasting due to the specialty of climate anticipating frameworks. The study concentrates on the data representing Saudi Arabia weather forecasting. The main input features employed to train individual and hybrid neural networks that include average dew point, minimum temperature, maximum temperature, mean temperature, average relative moistness, precipitation, normal wind speed, high wind speed and average cloudiness. The output layer composed of two neurons to represent rainy and dry weathers. Moreover, trial and error approach is adopted to select an appropriate number of inputs to the hybrid neural network. Correlation coefficient, RMSE and scatter index are the standard yard sticks adopted for forecast accuracy measurement. On individual standing MLP forecasting results are better than RBF, however, the proposed simplified hybrid neural model comes out with better forecasting accuracy as compared to both individual networks. Additionally, results are better than reported in the state of art, using a simple neural structure that reduces training time and complexity.
Neural network modeling of emotion
Levine, Daniel S.
2007-03-01
This article reviews the history and development of computational neural network modeling of cognitive and behavioral processes that involve emotion. The exposition starts with models of classical conditioning dating from the early 1970s. Then it proceeds toward models of interactions between emotion and attention. Then models of emotional influences on decision making are reviewed, including some speculative (not and not yet simulated) models of the evolution of decision rules. Through the late 1980s, the neural networks developed to model emotional processes were mainly embodiments of significant functional principles motivated by psychological data. In the last two decades, network models of these processes have become much more detailed in their incorporation of known physiological properties of specific brain regions, while preserving many of the psychological principles from the earlier models. Most network models of emotional processes so far have dealt with positive and negative emotion in general, rather than specific emotions such as fear, joy, sadness, and anger. But a later section of this article reviews a few models relevant to specific emotions: one family of models of auditory fear conditioning in rats, and one model of induced pleasure enhancing creativity in humans. Then models of emotional disorders are reviewed. The article concludes with philosophical statements about the essential contributions of emotion to intelligent behavior and the importance of quantitative theories and models to the interdisciplinary enterprise of understanding the interactions of emotion, cognition, and behavior.
Nagai, Takayuki; Ikegami, Yasuhiro; Mizumachi, Hideyuki; Shirakigawa, Nana; Ijima, Hiroyuki
2017-10-01
Two-dimensional monolayer culture is the most popular cell culture method. However, the cells may not respond as they do in vivo because the culture conditions are different from in vivo conditions. However, hydrogel-embedding culture, which cultures cells in a biocompatible culture substrate, can produce in vivo-like cell responses, but in situ evaluation of cells in a gel is difficult. In this study, we realized an in vivo-like environment in vitro to produce cell responses similar to those in vivo and established an in situ evaluation system for hydrogel-embedded cell responses. The extracellular matrix (ECM)-modeled gel consisted of collagen and heparin (Hep-col) to mimic an in vivo-like environment. The Hep-col gel could immobilize growth factors, which is important for ECM functions. Neural stem/progenitor cells cultured in the Hep-col gel grew and differentiated more actively than in collagen, indicating an in vivo-like environment in the Hep-col gel. Second, a thin-layered gel culture system was developed to realize in situ evaluation of the gel-embedded cells. Cells in a 200-μm-thick gel could be evaluated clearly by a phase-contrast microscope and immunofluorescence staining through reduced optical and diffusional effects. Finally, we found that the neural cells cultured in this system had synaptic connections and neuronal action potentials by immunofluorescence staining and Ca2+ imaging. In conclusion, this culture method may be a valuable evaluation system for neurotoxicity testing. Copyright © 2017 The Society for Biotechnology, Japan. Published by Elsevier B.V. All rights reserved.
Chang, C L; Liu, H C
2015-09-01
The trophic state index, and in particular, the Carlson Trophic State Index (CTSI), is critical for evaluating reservoir water quality. Despite its common use in evaluating static water quality, the reliability of the CTSI may decrease when water turbidity is high. Therefore, this study examines the reliability of the CTSI and uses the Back-Propagation Neural Network (BPNN) model to create a new trophic state index. Fuzzy theory, rather than binary logic, is implemented to classify the trophic status into its three grades. The results show that compared to the CTSI with traditional classification, the new index with fuzzy classification can improve trophic status evaluation with high water turbidity. A reliable trophic state index can correctly describe reservoir water quality and allow relevant agencies to address proper water quality management strategies for a reservoir system.
Brüderle, Daniel; Petrovici, Mihai A; Vogginger, Bernhard; Ehrlich, Matthias; Pfeil, Thomas; Millner, Sebastian; Grübl, Andreas; Wendt, Karsten; Müller, Eric; Schwartz, Marc-Olivier; de Oliveira, Dan Husmann; Jeltsch, Sebastian; Fieres, Johannes; Schilling, Moritz; Müller, Paul; Breitwieser, Oliver; Petkov, Venelin; Muller, Lyle; Davison, Andrew P; Krishnamurthy, Pradeep; Kremkow, Jens; Lundqvist, Mikael; Muller, Eilif; Partzsch, Johannes; Scholze, Stefan; Zühl, Lukas; Mayr, Christian; Destexhe, Alain; Diesmann, Markus; Potjans, Tobias C; Lansner, Anders; Schüffny, René; Schemmel, Johannes; Meier, Karlheinz
2011-05-01
In this article, we present a methodological framework that meets novel requirements emerging from upcoming types of accelerated and highly configurable neuromorphic hardware systems. We describe in detail a device with 45 million programmable and dynamic synapses that is currently under development, and we sketch the conceptual challenges that arise from taking this platform into operation. More specifically, we aim at the establishment of this neuromorphic system as a flexible and neuroscientifically valuable modeling tool that can be used by non-hardware experts. We consider various functional aspects to be crucial for this purpose, and we introduce a consistent workflow with detailed descriptions of all involved modules that implement the suggested steps: The integration of the hardware interface into the simulator-independent model description language PyNN; a fully automated translation between the PyNN domain and appropriate hardware configurations; an executable specification of the future neuromorphic system that can be seamlessly integrated into this biology-to-hardware mapping process as a test bench for all software layers and possible hardware design modifications; an evaluation scheme that deploys models from a dedicated benchmark library, compares the results generated by virtual or prototype hardware devices with reference software simulations and analyzes the differences. The integration of these components into one hardware-software workflow provides an ecosystem for ongoing preparative studies that support the hardware design process and represents the basis for the maturity of the model-to-hardware mapping software. The functionality and flexibility of the latter is proven with a variety of experimental results.
UAV Trajectory Modeling Using Neural Networks
Xue, Min
2017-01-01
Massive small unmanned aerial vehicles are envisioned to operate in the near future. While there are lots of research problems need to be addressed before dense operations can happen, trajectory modeling remains as one of the keys to understand and develop policies, regulations, and requirements for safe and efficient unmanned aerial vehicle operations. The fidelity requirement of a small unmanned vehicle trajectory model is high because these vehicles are sensitive to winds due to their small size and low operational altitude. Both vehicle control systems and dynamic models are needed for trajectory modeling, which makes the modeling a great challenge, especially considering the fact that manufactures are not willing to share their control systems. This work proposed to use a neural network approach for modelling small unmanned vehicle's trajectory without knowing its control system and bypassing exhaustive efforts for aerodynamic parameter identification. As a proof of concept, instead of collecting data from flight tests, this work used the trajectory data generated by a mathematical vehicle model for training and testing the neural network. The results showed great promise because the trained neural network can predict 4D trajectories accurately, and prediction errors were less than 2:0 meters in both temporal and spatial dimensions.
Energy Technology Data Exchange (ETDEWEB)
Mellit, A. [University Center of Medea, Institute of Engineering Sciences, Ain Dahab (Algeria); Benghanem, M. [University of Sciences Technology Houari Boumediene (USTHB), Faculty of ElectricalEngineering, El-Alia, Algiers (Algeria); Hadj Arab, A. [Development Center of Renewable Energy (CDER), Bouzareah, Algiers (Algeria); Guessoum, A. [Ministry for the Higher Education and Scientific Research, Algiers (Algeria)
2004-07-01
The objective of this work is to train the MLP-IIR model to learn the estimation and modeling of the optimal sizing coefficients of stand-alone PV system with a minimum of input data. Once trained, the MLP-IIR estimates these coefficients faster. The validation of the model was performed with unknown sizing coefficient, which the network has not seen before. The ability of the network to make acceptable estimations even in an unusual day is an advantage of the present method. It should be stressed that the training of the network required about 1 minute on a Pentium III 800MHz machine. The estimation with correlation coefficient of 98 % was obtained. This accuracy is well within the acceptable level used by design engineers. The traditional methods of sizing PV system (empirical, analytical, numerical and hybrid) allows to estimate the sizing of PV system for one given site, and requires the availability of several parameters such as the daily solar radiation data, altitude, longitude, the load, the characteristics of stand alone PV system, the inclination of the panels and to take very much computing time for estimation of optimal coefficients. On the other hand, the model that we developed allows estimating the PV-array area and the storage capacity from a minimum input data (altitude, longitude) based on the optimal sizing coefficients and does not take much time for simulation. The advantage of this model is to estimate of the PV-array area and the storage capacity in any site in Algeria particularly in isolated sites, where the global solar radiation data is not always available. Also, this presents a good result compared between other neural network architecture. The results have been obtained for Algerian meteorological data, but the methodology can be applied to any geographical area. (orig.)
Neural models of schizophrenia
Heckers, Stephan
2000-01-01
Hallucinations and delusions - two diagnostic features of psychosis shared across the spectrum of heterogeneous schizophrenia constructs - can be described in terms of the pathophysiology of sensory information processing: hallucination is the impaired ability to classify representations as internally or externally generated, while delusion is the immutable linking of representations with each other in the absence of external dependency. The key anatomical systems in higher-order information ...
Energy Technology Data Exchange (ETDEWEB)
Rosiek, S.; Batlles, F.J. [Dpto. Fisica Aplicada, Universidad de Almeria, 04120 Almeria (Spain); CIESOL, Joint Centre University of Almeria-CIEMAT, 04120 Almeria (Spain)
2010-12-15
This paper proposes Artificial Neural Networks (ANN) to model a solar-assisted air-conditioning system installed in the Solar Energy Research Center (CIESOL). This system consists mainly of the single-effect LiBr-H{sub 2}0 absorption chiller fed by water provided from either solar collectors or hot water storage tanks. The present work describes the total solar cooling systems based on absorption chiller and provided only with solar collectors. The experimental data were collected during the cooling period of 2008. ANN was used with the main goal of predicting the efficiency of the chiller and global system using the lowest number of input variables. The configuration 7-8-4 (7 inputs, 8 hidden and 4 output neurons) was found to be the optimal topology. The results demonstrate the accuracy ANN's predictions with a Root Mean Square Error (RMSE) of less than 1.9% and practically null deviation, which can be considered very satisfactory. (author)
Directory of Open Access Journals (Sweden)
Ja’fari A.
2014-01-01
Full Text Available Image logs provide useful information for fracture study in naturally fractured reservoir. Fracture dip, azimuth, aperture and fracture density can be obtained from image logs and have great importance in naturally fractured reservoir characterization. Imaging all fractured parts of hydrocarbon reservoirs and interpreting the results is expensive and time consuming. In this study, an improved method to make a quantitative correlation between fracture densities obtained from image logs and conventional well log data by integration of different artificial intelligence systems was proposed. The proposed method combines the results of Adaptive Neuro-Fuzzy Inference System (ANFIS and Neural Networks (NN algorithms for overall estimation of fracture density from conventional well log data. A simple averaging method was used to obtain a better result by combining results of ANFIS and NN. The algorithm applied on other wells of the field to obtain fracture density. In order to model the fracture density in the reservoir, we used variography and sequential simulation algorithms like Sequential Indicator Simulation (SIS and Truncated Gaussian Simulation (TGS. The overall algorithm applied to Asmari reservoir one of the SW Iranian oil fields. Histogram analysis applied to control the quality of the obtained models. Results of this study show that for higher number of fracture facies the TGS algorithm works better than SIS but in small number of fracture facies both algorithms provide approximately same results.
Molga, E.J.; van Woezik, B.A.A.; Westerterp, K.R.
2000-01-01
Application of neural networks to model the conversion rates of a heterogeneous oxidation reaction has been investigated — oxidation of 2-octanol with nitric acid has been considered as a case study. Due to a more complex and unknown kinetics of the investigated reaction the proposed approach based
Runoff Modelling in Urban Storm Drainage by Neural Networks
DEFF Research Database (Denmark)
Rasmussen, Michael R.; Brorsen, Michael; Schaarup-Jensen, Kjeld
1995-01-01
A neural network is used to simulate folw and water levels in a sewer system. The calibration of th neural network is based on a few measured events and the network is validated against measureed events as well as flow simulated with the MOUSE model (Lindberg and Joergensen, 1986). The neural...... network is used to compute flow or water level at selected points in the sewer system, and to forecast the flow from a small residential area. The main advantages of the neural network are the build-in self calibration procedure and high speed performance, but the neural network cannot be used to extract...... knowledge of the runoff process. The neural network was found to simulate 150 times faster than e.g. the MOUSE model....
The LILARTI neural network system
Energy Technology Data Exchange (ETDEWEB)
Allen, J.D. Jr.; Schell, F.M.; Dodd, C.V.
1992-10-01
The material of this Technical Memorandum is intended to provide the reader with conceptual and technical background information on the LILARTI neural network system of detail sufficient to confer an understanding of the LILARTI method as it is presently allied and to facilitate application of the method to problems beyond the scope of this document. Of particular importance in this regard are the descriptive sections and the Appendices which include operating instructions, partial listings of program output and data files, and network construction information.
UAV Trajectory Modeling Using Neural Networks
Xue, Min
2017-01-01
Large amount of small Unmanned Aerial Vehicles (sUAVs) are projected to operate in the near future. Potential sUAV applications include, but not limited to, search and rescue, inspection and surveillance, aerial photography and video, precision agriculture, and parcel delivery. sUAVs are expected to operate in the uncontrolled Class G airspace, which is at or below 500 feet above ground level (AGL), where many static and dynamic constraints exist, such as ground properties and terrains, restricted areas, various winds, manned helicopters, and conflict avoidance among sUAVs. How to enable safe, efficient, and massive sUAV operations at the low altitude airspace remains a great challenge. NASA's Unmanned aircraft system Traffic Management (UTM) research initiative works on establishing infrastructure and developing policies, requirement, and rules to enable safe and efficient sUAVs' operations. To achieve this goal, it is important to gain insights of future UTM traffic operations through simulations, where the accurate trajectory model plays an extremely important role. On the other hand, like what happens in current aviation development, trajectory modeling should also serve as the foundation for any advanced concepts and tools in UTM. Accurate models of sUAV dynamics and control systems are very important considering the requirement of the meter level precision in UTM operations. The vehicle dynamics are relatively easy to derive and model, however, vehicle control systems remain unknown as they are usually kept by manufactures as a part of intellectual properties. That brings challenges to trajectory modeling for sUAVs. How to model the vehicle's trajectories with unknown control system? This work proposes to use a neural network to model a vehicle's trajectory. The neural network is first trained to learn the vehicle's responses at numerous conditions. Once being fully trained, given current vehicle states, winds, and desired future trajectory, the neural
Schapiro, Anna C; Turk-Browne, Nicholas B; Botvinick, Matthew M; Norman, Kenneth A
2017-01-05
A growing literature suggests that the hippocampus is critical for the rapid extraction of regularities from the environment. Although this fits with the known role of the hippocampus in rapid learning, it seems at odds with the idea that the hippocampus specializes in memorizing individual episodes. In particular, the Complementary Learning Systems theory argues that there is a computational trade-off between learning the specifics of individual experiences and regularities that hold across those experiences. We asked whether it is possible for the hippocampus to handle both statistical learning and memorization of individual episodes. We exposed a neural network model that instantiates known properties of hippocampal projections and subfields to sequences of items with temporal regularities. We found that the monosynaptic pathway-the pathway connecting entorhinal cortex directly to region CA1-was able to support statistical learning, while the trisynaptic pathway-connecting entorhinal cortex to CA1 through dentate gyrus and CA3-learned individual episodes, with apparent representations of regularities resulting from associative reactivation through recurrence. Thus, in paradigms involving rapid learning, the computational trade-off between learning episodes and regularities may be handled by separate anatomical pathways within the hippocampus itself.This article is part of the themed issue 'New frontiers for statistical learning in the cognitive sciences'. © 2016 The Author(s).
Green, Stephen A.; Bronner, Marianne E.
2014-01-01
Summary Lampreys are a group of jawless fishes that serve as an important point of comparison for studies of vertebrate evolution. Lampreys and hagfishes are agnathan fishes, the cyclostomes, which sit at a crucial phylogenetic position as the only living sister group of the jawed vertebrates. Comparisons between cyclostomes and jawed vertebrates can help identify shared derived (i.e. synapomorphic) traits that might have been inherited from ancestral early vertebrates, if unlikely to have arisen convergently by chance. One example of a uniquely vertebrate trait is the neural crest, an embryonic tissue that produces many cell types crucial to vertebrate features, such as the craniofacial skeleton, pigmentation of the skin, and much of the peripheral nervous system (Gans and Northcutt, 1983). Invertebrate chordates arguably lack unambiguous neural crest homologs, yet have cells with some similarities, making comparisons with lampreys and jawed vertebrates essential for inferring characteristics of development in early vertebrates, and how they may have evolved from nonvertebrate chordates. Here we review recent research on cyclostome neural crest development, including research on lamprey gene regulatory networks and differentiated neural crest fates. PMID:24560767
Sequential neural models with stochastic layers
DEFF Research Database (Denmark)
Fraccaro, Marco; Sønderby, Søren Kaae; Paquet, Ulrich
2016-01-01
How can we efficiently propagate uncertainty in a latent state representation with recurrent neural networks? This paper introduces stochastic recurrent neural networks which glue a deterministic recurrent neural network and a state space model together to form a stochastic and sequential neural ...... the uncertainty in a latent path, like a state space model, we improve the state of the art results on the Blizzard and TIMIT speech modeling data sets by a large margin, while achieving comparable performances to competing methods on polyphonic music modeling....
Artificial Neural Network Model for Predicting Compressive
Directory of Open Access Journals (Sweden)
Salim T. Yousif
2013-05-01
Full Text Available Compressive strength of concrete is a commonly used criterion in evaluating concrete. Although testing of the compressive strength of concrete specimens is done routinely, it is performed on the 28th day after concrete placement. Therefore, strength estimation of concrete at early time is highly desirable. This study presents the effort in applying neural network-based system identification techniques to predict the compressive strength of concrete based on concrete mix proportions, maximum aggregate size (MAS, and slump of fresh concrete. Back-propagation neural networks model is successively developed, trained, and tested using actual data sets of concrete mix proportions gathered from literature. The test of the model by un-used data within the range of input parameters shows that the maximum absolute error for model is about 20% and 88% of the output results has absolute errors less than 10%. The parametric study shows that water/cement ratio (w/c is the most significant factor affecting the output of the model. The results showed that neural networks has strong potential as a feasible tool for predicting compressive strength of concrete.
Advanced models of neural networks nonlinear dynamics and stochasticity in biological neurons
Rigatos, Gerasimos G
2015-01-01
This book provides a complete study on neural structures exhibiting nonlinear and stochastic dynamics, elaborating on neural dynamics by introducing advanced models of neural networks. It overviews the main findings in the modelling of neural dynamics in terms of electrical circuits and examines their stability properties with the use of dynamical systems theory. It is suitable for researchers and postgraduate students engaged with neural networks and dynamical systems theory.
2012-03-22
Flights on Air Frame 854 1 251 59.2 NFAPT Number of Flights on Autopilot Type 772 1 447 146 NFLOC Number of Flights at Location 805 1 564 206 NFP ...DSTNLF 5 TIME 6 DSLF 7 DSLM 8 TEMP 9 MAXWIND 10 MAN 11 NFTN 12 NFP 13 NFAF 14 NFTOT 15 NFLOC 16 PROT 17 NOISE The test set...The architecture for the 7-feature model (containing features MAN, NFTN, NFP , NFAF, NFTOT, NFLOC, and PROT) was constructed and 100 networks using
Hybrid neural network bushing model for vehicle dynamics simulation
Energy Technology Data Exchange (ETDEWEB)
Sohn, Jeong Hyun [Pukyong National University, Busan (Korea, Republic of); Lee, Seung Kyu [Hyosung Corporation, Changwon (Korea, Republic of); Yoo, Wan Suk [Pusan National University, Busan (Korea, Republic of)
2008-12-15
Although the linear model was widely used for the bushing model in vehicle suspension systems, it could not express the nonlinear characteristics of bushing in terms of the amplitude and the frequency. An artificial neural network model was suggested to consider the hysteretic responses of bushings. This model, however, often diverges due to the uncertainties of the neural network under the unexpected excitation inputs. In this paper, a hybrid neural network bushing model combining linear and neural network is suggested. A linear model was employed to represent linear stiffness and damping effects, and the artificial neural network algorithm was adopted to take into account the hysteretic responses. A rubber test was performed to capture bushing characteristics, where sine excitation with different frequencies and amplitudes is applied. Random test results were used to update the weighting factors of the neural network model. It is proven that the proposed model has more robust characteristics than a simple neural network model under step excitation input. A full car simulation was carried out to verify the proposed bushing models. It was shown that the hybrid model results are almost identical to the linear model under several maneuvers
Central neural circuitry in the jellyfish Aglantha: a model 'simple nervous system'.
Mackie, George O
2004-01-01
Like other hydrozoan medusae, Aglantha lacks a brain, but the two marginal nerve rings function together as a central nervous system. Twelve neuronal and two excitable epithelial conduction systems are described and their interactions summarized. Aglantha differs from most medusae in having giant axons. It can swim and contract its tentacles in two distinct ways (escape and slow). Escape responses are mediated primarily by giant axons but conventional interneurons are also involved in transmission of information within the nerve rings during one form of escape behavior. Surprisingly, giant axons provide the motor pathway to the swim muscles in both escape and slow swimming. This is possible because these axons can conduct calcium spikes as well as sodium spikes and do so on an either/or basis without overlap. The synaptic and ionic bases for these responses are reviewed. During feeding, the manubrium performs highly accurate flexions to points at the margin. At the same time, the oral lips flare open. The directional flexions are conducted by FMRFamide immunoreactive nerves, the lip flaring by an excitable epithelium lining the radial canals. Inhibition of swimming during feeding is due to impulses propagated centrifugally in the same epithelium. Aglantha probably evolved from an ancestor possessing a relatively simple wiring plan, as seen in other hydromedusae. Acquisition of giant axons resulted in considerable modification of this basic plan, and required novel solutions to the problems of integrating escape with non-escape circuitry. Copyright 2004 S. Karger AG, Basel
Directory of Open Access Journals (Sweden)
Akihiro eEguchi
2015-08-01
Full Text Available Neurons in successive stages of the primate ventral visual pathway encode the spatial structure of visual objects. In this paper, we investigate through computer simulation how these cell firing properties may develop through unsupervised visually-guided learning. Individual neurons in the model are shown to exploit statistical regularity and temporal continuity of the visual inputs during training to learn firing properties that are similar to neurons in V4 and TEO. Neurons in V4 encode the conformation of boundary contour elements at a particular position within an object regardless of the location of the object on the retina, while neurons in TEO integrate information from multiple boundary contour elements. This representation goes beyond mere object recognition, in which neurons simply respond to the presence of a whole object, but provides an essential foundation from which the brain is subsequently able to recognise the whole object.
An Artificial Neural Network Modeling for Force Control System of a Robotic Pruning Machine
Directory of Open Access Journals (Sweden)
Ali Hashemi
2014-06-01
Full Text Available Nowadays, there has been an increasing application of pruning robots for planted forests due to the growing concern on the efficiency and safety issues. Power consumption and working time of agricultural machines have become important issues due to the high value of energy in modern world. In this study, different multi-layer back-propagation networks were utilized for mapping the complex and highly interactive of pruning process parameters and to predict power consumption and cutting time of a force control equipped robotic pruning machine by knowing input parameters such as: rotation speed, stalk diameter, and sensitivity coefficient. Results showed significant effects of all input parameters on output parameters except rotational speed on cutting time. Therefore, for reducing the wear of cutting system, a less rotational speed in every sensitivity coefficient should be selected.
Directory of Open Access Journals (Sweden)
Wilfredo Blanco
2017-09-01
Full Text Available Early in development, neural systems have primarily excitatory coupling, where even GABAergic synapses are excitatory. Many of these systems exhibit spontaneous episodes of activity that have been characterized through both experimental and computational studies. As development progress the neural system goes through many changes, including synaptic remodeling, intrinsic plasticity in the ion channel expression, and a transformation of GABAergic synapses from excitatory to inhibitory. What effect each of these, and other, changes have on the network behavior is hard to know from experimental studies since they all happen in parallel. One advantage of a computational approach is that one has the ability to study developmental changes in isolation. Here, we examine the effects of GABAergic synapse polarity change on the spontaneous activity of both a mean field and a neural network model that has both glutamatergic and GABAergic coupling, representative of a developing neural network. We find some intuitive behavioral changes as the GABAergic neurons go from excitatory to inhibitory, shared by both models, such as a decrease in the duration of episodes. We also find some paradoxical changes in the activity that are only present in the neural network model. In particular, we find that during early development the inter-episode durations become longer on average, while later in development they become shorter. In addressing this unexpected finding, we uncover a priming effect that is particularly important for a small subset of neurons, called the “intermediate neurons.” We characterize these neurons and demonstrate why they are crucial to episode initiation, and why the paradoxical behavioral change result from priming of these neurons. The study illustrates how even arguably the simplest of developmental changes that occurs in neural systems can present non-intuitive behaviors. It also makes predictions about neural network behavioral changes
Spiking Neural P Systems with Communication on Request.
Pan, Linqiang; Păun, Gheorghe; Zhang, Gexiang; Neri, Ferrante
2017-12-01
Spiking Neural [Formula: see text] Systems are Neural System models characterized by the fact that each neuron mimics a biological cell and the communication between neurons is based on spikes. In the Spiking Neural [Formula: see text] systems investigated so far, the application of evolution rules depends on the contents of a neuron (checked by means of a regular expression). In these [Formula: see text] systems, a specified number of spikes are consumed and a specified number of spikes are produced, and then sent to each of the neurons linked by a synapse to the evolving neuron. [Formula: see text]In the present work, a novel communication strategy among neurons of Spiking Neural [Formula: see text] Systems is proposed. In the resulting models, called Spiking Neural [Formula: see text] Systems with Communication on Request, the spikes are requested from neighboring neurons, depending on the contents of the neuron (still checked by means of a regular expression). Unlike the traditional Spiking Neural [Formula: see text] systems, no spikes are consumed or created: the spikes are only moved along synapses and replicated (when two or more neurons request the contents of the same neuron). [Formula: see text]The Spiking Neural [Formula: see text] Systems with Communication on Request are proved to be computationally universal, that is, equivalent with Turing machines as long as two types of spikes are used. Following this work, further research questions are listed to be open problems.
Neural network based system for equipment surveillance
Vilim, R.B.; Gross, K.C.; Wegerich, S.W.
1998-04-28
A method and system are disclosed for performing surveillance of transient signals of an industrial device to ascertain the operating state. The method and system involves the steps of reading into a memory training data, determining neural network weighting values until achieving target outputs close to the neural network output. If the target outputs are inadequate, wavelet parameters are determined to yield neural network outputs close to the desired set of target outputs and then providing signals characteristic of an industrial process and comparing the neural network output to the industrial process signals to evaluate the operating state of the industrial process. 33 figs.
Galeazzi, Juan M.; Navajas, Joaquin; Mender, Bedeho M. W.; Quian Quiroga, Rodrigo; Minini, Loredana; Stringer, Simon M.
2016-01-01
ABSTRACT Neurons have been found in the primate brain that respond to objects in specific locations in hand-centered coordinates. A key theoretical challenge is to explain how such hand-centered neuronal responses may develop through visual experience. In this paper we show how hand-centered visual receptive fields can develop using an artificial neural network model, VisNet, of the primate visual system when driven by gaze changes recorded from human test subjects as they completed a jigsaw....
Neural and Neural Gray-Box Modeling for Entry Temperature Prediction in a Hot Strip Mill
Barrios, José Angel; Torres-Alvarado, Miguel; Cavazos, Alberto; Leduc, Luis
2011-10-01
In hot strip mills, initial controller set points have to be calculated before the steel bar enters the mill. Calculations rely on the good knowledge of rolling variables. Measurements are available only after the bar has entered the mill, and therefore they have to be estimated. Estimation of process variables, particularly that of temperature, is of crucial importance for the bar front section to fulfill quality requirements, and the same must be performed in the shortest possible time to preserve heat. Currently, temperature estimation is performed by physical modeling; however, it is highly affected by measurement uncertainties, variations in the incoming bar conditions, and final product changes. In order to overcome these problems, artificial intelligence techniques such as artificial neural networks and fuzzy logic have been proposed. In this article, neural network-based systems, including neural-based Gray-Box models, are applied to estimate scale breaker entry temperature, given its importance, and their performance is compared to that of the physical model used in plant. Several neural systems and several neural-based Gray-Box models are designed and tested with real data. Taking advantage of the flexibility of neural networks for input incorporation, several factors which are believed to have influence on the process are also tested. The systems proposed in this study were proven to have better performance indexes and hence better prediction capabilities than the physical models currently used in plant.
Computational modeling of neural plasticity for self-organization of neural networks.
Chrol-Cannon, Joseph; Jin, Yaochu
2014-11-01
Self-organization in biological nervous systems during the lifetime is known to largely occur through a process of plasticity that is dependent upon the spike-timing activity in connected neurons. In the field of computational neuroscience, much effort has been dedicated to building up computational models of neural plasticity to replicate experimental data. Most recently, increasing attention has been paid to understanding the role of neural plasticity in functional and structural neural self-organization, as well as its influence on the learning performance of neural networks for accomplishing machine learning tasks such as classification and regression. Although many ideas and hypothesis have been suggested, the relationship between the structure, dynamics and learning performance of neural networks remains elusive. The purpose of this article is to review the most important computational models for neural plasticity and discuss various ideas about neural plasticity's role. Finally, we suggest a few promising research directions, in particular those along the line that combines findings in computational neuroscience and systems biology, and their synergetic roles in understanding learning, memory and cognition, thereby bridging the gap between computational neuroscience, systems biology and computational intelligence. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.
Wei-Bo Chen; Wen-Cheng Liu
2015-01-01
In this study, two artificial neural network models (i.e., a radial basis function neural network, RBFN, and an adaptive neurofuzzy inference system approach, ANFIS) and a multilinear regression (MLR) model were developed to simulate the DO, TP, Chl a, and SD in the Mingder Reservoir of central Taiwan. The input variables of the neural network and the MLR models were determined using linear regression. The performances were evaluated using the RBFN, ANFIS, and MLR models based on statistical ...
Flood routing modelling with Artificial Neural Networks
Directory of Open Access Journals (Sweden)
R. Peters
2006-01-01
Full Text Available For the modelling of the flood routing in the lower reaches of the Freiberger Mulde river and its tributaries the one-dimensional hydrodynamic modelling system HEC-RAS has been applied. Furthermore, this model was used to generate a database to train multilayer feedforward networks. To guarantee numerical stability for the hydrodynamic modelling of some 60 km of streamcourse an adequate resolution in space requires very small calculation time steps, which are some two orders of magnitude smaller than the input data resolution. This leads to quite high computation requirements seriously restricting the application – especially when dealing with real time operations such as online flood forecasting. In order to solve this problem we tested the application of Artificial Neural Networks (ANN. First studies show the ability of adequately trained multilayer feedforward networks (MLFN to reproduce the model performance.
Giuseppina, Nicolosi; Salvatore, Tirrito
2015-12-01
Wireless Sensor Networks (WSNs) were studied by researchers in order to manage Heating, Ventilating and Air-Conditioning (HVAC) indoor systems. WSN can be useful specially to regulate indoor confort in a urban canyon scenario, where the thermal parameters vary rapidly, influenced by outdoor climate changing. This paper shows an innovative neural network approach, by using WSN data collected, in order to forecast the indoor temperature to varying the outdoor conditions based on climate parameters and boundary conditions typically of urban canyon. In this work more attention will be done to influence of traffic jam and number of vehicles in queue.
Short-term synaptic plasticity and heterogeneity in neural systems
Mejias, J. F.; Kappen, H. J.; Longtin, A.; Torres, J. J.
2013-01-01
We review some recent results on neural dynamics and information processing which arise when considering several biophysical factors of interest, in particular, short-term synaptic plasticity and neural heterogeneity. The inclusion of short-term synaptic plasticity leads to enhanced long-term memory capacities, a higher robustness of memory to noise, and irregularity in the duration of the so-called up cortical states. On the other hand, considering some level of neural heterogeneity in neuron models allows neural systems to optimize information transmission in rate coding and temporal coding, two strategies commonly used by neurons to codify information in many brain areas. In all these studies, analytical approximations can be made to explain the underlying dynamics of these neural systems.
Spiking modular neural networks: A neural network modeling approach for hydrological processes
National Research Council Canada - National Science Library
Kamban Parasuraman; Amin Elshorbagy; Sean K. Carey
2006-01-01
.... In this study, a novel neural network model called the spiking modular neural networks (SMNNs) is proposed. An SMNN consists of an input layer, a spiking layer, and an associator neural network layer...
Wang, L. M.
2017-09-01
A novel model-free adaptive sliding mode strategy is proposed for a generalized projective synchronization (GPS) between two entirely unknown fractional-order chaotic systems subject to the external disturbances. To solve the difficulties from the little knowledge about the master-slave system and to overcome the bad effects of the external disturbances on the generalized projective synchronization, the radial basis function neural networks are used to approach the packaged unknown master system and the packaged unknown slave system (including the external disturbances). Consequently, based on the slide mode technology and the neural network theory, a model-free adaptive sliding mode controller is designed to guarantee asymptotic stability of the generalized projective synchronization error. The main contribution of this paper is that a control strategy is provided for the generalized projective synchronization between two entirely unknown fractional-order chaotic systems subject to the unknown external disturbances, and the proposed control strategy only requires that the master system has the same fractional orders as the slave system. Moreover, the proposed method allows us to achieve all kinds of generalized projective chaos synchronizations by turning the user-defined parameters onto the desired values. Simulation results show the effectiveness of the proposed method and the robustness of the controlled system.
Two stage neural network modelling for robust model predictive control.
Patan, Krzysztof
2017-11-02
The paper proposes a novel robust model predictive control scheme realized by means of artificial neural networks. The neural networks are used twofold: to design the so-called fundamental model of a plant and to catch uncertainty associated with the plant model. In order to simplify the optimization process carried out within the framework of predictive control an instantaneous linearization is applied which renders it possible to define the optimization problem in the form of constrained quadratic programming. Stability of the proposed control system is also investigated by showing that a cost function is monotonically decreasing with respect to time. Derived robust model predictive control is tested and validated on the example of a pneumatic servomechanism working at different operating regimes. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.
Haring, Alexander P; Sontheimer, Harald; Johnson, Blake N
2017-06-01
Translational challenges associated with reductionist modeling approaches, as well as ethical concerns and economic implications of small animal testing, drive the need for developing microphysiological neural systems for modeling human neurological diseases, disorders, and injuries. Here, we provide a comprehensive review of microphysiological brain and neural systems-on-a-chip (NSCs) for modeling higher order trajectories in the human nervous system. Societal, economic, and national security impacts of neurological diseases, disorders, and injuries are highlighted to identify critical NSC application spaces. Hierarchical design and manufacturing of NSCs are discussed with distinction for surface- and bulk-based systems. Three broad NSC classes are identified and reviewed: microfluidic NSCs, compartmentalized NSCs, and hydrogel NSCs. Emerging areas and future directions are highlighted, including the application of 3D printing to design and manufacturing of next-generation NSCs, the use of stem cells for constructing patient-specific NSCs, and the application of human NSCs to 'personalized neurology'. Technical hurdles and remaining challenges are discussed. This review identifies the state-of-the-art design methodologies, manufacturing approaches, and performance capabilities of NSCs. This work suggests NSCs appear poised to revolutionize the modeling of human neurological diseases, disorders, and injuries.
Struzyna, Laura A; Adewole, Dayo O; Gordián-Vélez, Wisberty J; Grovola, Michael R; Burrell, Justin C; Katiyar, Kritika S; Petrov, Dmitriy; Harris, James P; Cullen, D Kacy
2017-05-31
Functional recovery rarely occurs following injury or disease-induced degeneration within the central nervous system (CNS) due to the inhibitory environment and the limited capacity for neurogenesis. We are developing a strategy to simultaneously address neuronal and axonal pathway loss within the damaged CNS. This manuscript presents the fabrication protocol for micro-tissue engineered neural networks (micro-TENNs), implantable constructs consisting of neurons and aligned axonal tracts spanning the extracellular matrix (ECM) lumen of a preformed hydrogel cylinder hundreds of microns in diameter that may extend centimeters in length. Neuronal aggregates are delimited to the extremes of the three-dimensional encasement and are spanned by axonal projections. Micro-TENNs are uniquely poised as a strategy for CNS reconstruction, emulating aspects of brain connectome cytoarchitecture and potentially providing means for network replacement. The neuronal aggregates may synapse with host tissue to form new functional relays to restore and/or modulate missing or damaged circuitry. These constructs may also act as pro-regenerative "living scaffolds" capable of exploiting developmental mechanisms for cell migration and axonal pathfinding, providing synergistic structural and soluble cues based on the state of regeneration. Micro-TENNs are fabricated by pouring liquid hydrogel into a cylindrical mold containing a longitudinally centered needle. Once the hydrogel has gelled, the needle is removed, leaving a hollow micro-column. An ECM solution is added to the lumen to provide an environment suitable for neuronal adhesion and axonal outgrowth. Dissociated neurons are mechanically aggregated for precise seeding within one or both ends of the micro-column. This methodology reliably produces self-contained miniature constructs with long-projecting axonal tracts that may recapitulate features of brain neuroanatomy. Synaptic immunolabeling and genetically encoded calcium
Neural systems for tactual memories.
Bonda, E; Petrides, M; Evans, A
1996-04-01
1. The aim of this study was to investigate the neural systems involved in the memory processing of experiences through touch. 2. Regional cerebral blood flow was measured with positron emission tomography by means of the water bolus H2(15)O methodology in human subjects as they performed tasks involving different levels of tactual memory. In one of the experimental tasks, the subjects had to palpate nonsense shapes to match each one to a previously learned set, thus requiring constant reference to long-term memory. The other experimental task involved judgements of the recent recurrence of shapes during the scanning period. A set of three control tasks was used to control for the type of exploratory movements and sensory processing inherent in the two experimental tasks. 3. Comparisons of the distribution of activity between the experimental and the control tasks were carried out by means of the subtraction method. In relation to the control conditions, the two experimental tasks requiring memory resulted in significant changes within the posteroventral insula and the central opercular region. In addition, the task requiring recall from long-term memory yielded changes in the perirhinal cortex. 4. The above findings demonstrated that a ventrally directed parietoinsular pathway, leading to the posteroventral insula and the perirhinal cortex, constitutes a system by which long-lasting representations of tactual experiences are formed. It is proposed that the posteroventral insula is involved in tactual feature analysis, by analogy with the similar role of the inferotemporal cortex in vision, whereas the perirhinal cortex is further involved in the integration of these features into long-lasting representations of somatosensory experiences.
Artificial neural network modeling of dissolved oxygen in reservoir.
Chen, Wei-Bo; Liu, Wen-Cheng
2014-02-01
The water quality of reservoirs is one of the key factors in the operation and water quality management of reservoirs. Dissolved oxygen (DO) in water column is essential for microorganisms and a significant indicator of the state of aquatic ecosystems. In this study, two artificial neural network (ANN) models including back propagation neural network (BPNN) and adaptive neural-based fuzzy inference system (ANFIS) approaches and multilinear regression (MLR) model were developed to estimate the DO concentration in the Feitsui Reservoir of northern Taiwan. The input variables of the neural network are determined as water temperature, pH, conductivity, turbidity, suspended solids, total hardness, total alkalinity, and ammonium nitrogen. The performance of the ANN models and MLR model was assessed through the mean absolute error, root mean square error, and correlation coefficient computed from the measured and model-simulated DO values. The results reveal that ANN estimation performances were superior to those of MLR. Comparing to the BPNN and ANFIS models through the performance criteria, the ANFIS model is better than the BPNN model for predicting the DO values. Study results show that the neural network particularly using ANFIS model is able to predict the DO concentrations with reasonable accuracy, suggesting that the neural network is a valuable tool for reservoir management in Taiwan.
System Identification, Prediction, Simulation and Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1997-01-01
a Gauss-Newton search direction is applied. 3) Amongst numerous model types, often met in control applications, only the Non-linear ARMAX (NARMAX) model, representing input/output description, is examined. A simulated example confirms that a neural network has the potential to perform excellent System...... Identification, Prediction, Simulation and Control of a dynamic, non-linear and noisy process. Further, the difficulties to control a practical non-linear laboratory process in a satisfactory way by using a traditional controller are overcomed by using a trained neural network to perform non-linear System......The intention of this paper is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...
Energy Technology Data Exchange (ETDEWEB)
Mellit, A. [University Centre of Medea, Institute of Science Engineering, Medea (Algeria). Department of Electronics; Benghanem, M. [University of Sciences and Technologies Houari Boumadiene, Algiers (Algeria). Faculty of Electrical Engineering; Kalogirou, S.A. [Higher Technical Institute, Nicosia (Cyprus). Department of Mechanical Engineering
2007-02-15
This paper presents an adaptive artificial neural network (ANN) for modeling and simulation of a Stand-Alone photovoltaic (SAPV) system operating under variable climatic conditions. The ANN combines the Levenberg-Marquardt algorithm (LM) with an infinite impulse response (IIR) filter in order to accelerate the convergence of the network. SAPV systems are widely used in renewable energy source (RES) applications and it is important to be able to evaluate the performance of installed systems. The modeling of the complete SAPV system is achieved by combining the models of the different components of the system (PV-generator, battery and regulator). A global model can identify the SAPV characteristics by knowing only the climatological conditions. In addition, a new procedure proposed for SAPV system sizing is presented in this work. Different measured signals of solar radiation sequences and electrical parameters (photovoltaic voltage and current) from a SAPV system installed at the south of Algeria have been recorded during a period of 5-years. These signals have been used for the training and testing the developed models, one for each component of the system and a global model of the complete system. The ANN model predictions allow the users of SAPV systems to predict the different signals for each model and identify the output current of the system for different climatological conditions. The comparison between simulated and experimental signals of the SAPV gave good results. The correlation coefficient obtained varies from 90% to 96% for each estimated signals, which is considered satisfactory. A comparison between multilayer perceptron (MLP), radial basis function (RBF) network and the proposed LM-IIR model is presented in order to confirm the advantage of this model. (author)
Optimal Decision Making in Neural Inhibition Models
van Ravenzwaaij, Don; van der Maas, Han L. J.; Wagenmakers, Eric-Jan
2012-01-01
In their influential "Psychological Review" article, Bogacz, Brown, Moehlis, Holmes, and Cohen (2006) discussed optimal decision making as accomplished by the drift diffusion model (DDM). The authors showed that neural inhibition models, such as the leaky competing accumulator model (LCA) and the feedforward inhibition model (FFI), can mimic the…
Neural network system for traffic flow management
Gilmore, John F.; Elibiary, Khalid J.; Petersson, L. E. Rickard
1992-09-01
Atlanta will be the home of several special events during the next five years ranging from the 1996 Olympics to the 1994 Super Bowl. When combined with the existing special events (Braves, Falcons, and Hawks games, concerts, festivals, etc.), the need to effectively manage traffic flow from surface streets to interstate highways is apparent. This paper describes a system for traffic event response and management for intelligent navigation utilizing signals (TERMINUS) developed at Georgia Tech for adaptively managing special event traffic flows in the Atlanta, Georgia area. TERMINUS (the original name given Atlanta, Georgia based upon its role as a rail line terminating center) is an intelligent surface street signal control system designed to manage traffic flow in Metro Atlanta. The system consists of three components. The first is a traffic simulation of the downtown Atlanta area around Fulton County Stadium that models the flow of traffic when a stadium event lets out. Parameters for the surrounding area include modeling for events during various times of day (such as rush hour). The second component is a computer graphics interface with the simulation that shows the traffic flows achieved based upon intelligent control system execution. The final component is the intelligent control system that manages surface street light signals based upon feedback from control sensors that dynamically adapt the intelligent controller's decision making process. The intelligent controller is a neural network model that allows TERMINUS to control the configuration of surface street signals to optimize the flow of traffic away from special events.
Novel mathematical neural models for visual attention
DEFF Research Database (Denmark)
Li, Kang
Visual attention has been extensively studied in psychology, but some fundamental questions remain controversial. We focus on two questions in this study. First, we investigate how a neuron in visual cortex responds to multiple stimuli inside the receptive eld, described by either a response...... for the visual attention theories and spiking neuron models for single spike trains. Statistical inference and model selection are performed and various numerical methods are explored. The designed methods also give a framework for neural coding under visual attention theories. We conduct both analysis on real...... system, supported by simulation study. Finally, we present the decoding of multiple temporal stimuli under these visual attention theories, also in a realistic biophysical situation with simulations....
Numerical analysis of modeling based on improved Elman neural network.
Jie, Shao; Li, Wang; WeiSong, Zhao; YaQin, Zhong; Malekian, Reza
2014-01-01
A modeling based on the improved Elman neural network (IENN) is proposed to analyze the nonlinear circuits with the memory effect. The hidden layer neurons are activated by a group of Chebyshev orthogonal basis functions instead of sigmoid functions in this model. The error curves of the sum of squared error (SSE) varying with the number of hidden neurons and the iteration step are studied to determine the number of the hidden layer neurons. Simulation results of the half-bridge class-D power amplifier (CDPA) with two-tone signal and broadband signals as input have shown that the proposed behavioral modeling can reconstruct the system of CDPAs accurately and depict the memory effect of CDPAs well. Compared with Volterra-Laguerre (VL) model, Chebyshev neural network (CNN) model, and basic Elman neural network (BENN) model, the proposed model has better performance.
Numerical Analysis of Modeling Based on Improved Elman Neural Network
Directory of Open Access Journals (Sweden)
Shao Jie
2014-01-01
Full Text Available A modeling based on the improved Elman neural network (IENN is proposed to analyze the nonlinear circuits with the memory effect. The hidden layer neurons are activated by a group of Chebyshev orthogonal basis functions instead of sigmoid functions in this model. The error curves of the sum of squared error (SSE varying with the number of hidden neurons and the iteration step are studied to determine the number of the hidden layer neurons. Simulation results of the half-bridge class-D power amplifier (CDPA with two-tone signal and broadband signals as input have shown that the proposed behavioral modeling can reconstruct the system of CDPAs accurately and depict the memory effect of CDPAs well. Compared with Volterra-Laguerre (VL model, Chebyshev neural network (CNN model, and basic Elman neural network (BENN model, the proposed model has better performance.
Spencer, Brian; Potkar, Rewati; Metcalf, Jeff; Thrin, Ivy; Adame, Anthony; Rockenstein, Edward; Masliah, Eliezer
2016-01-22
Neuropeptide Y (NPY) is one of the most abundant protein transmitters in the central nervous system with roles in a variety of biological functions including: food intake, cardiovascular regulation, cognition, seizure activity, circadian rhythms, and neurogenesis. Reduced NPY and NPY receptor expression is associated with numerous neurodegenerative disorders including Alzheimer disease (AD). To determine whether replacement of NPY could ameliorate some of the neurodegenerative and behavioral pathology associated with AD, we generated a lentiviral vector expressing NPY fused to a brain transport peptide (apoB) for widespread CNS delivery in an APP-transgenic (tg) mouse model of AD. The recombinant NPY-apoB effectively reversed neurodegenerative pathology and behavioral deficits although it had no effect on accumulation of Aβ. The subgranular zone of the hippocampus showed a significant increase in proliferation of neural precursor cells without further differentiation into neurons. The neuroprotective and neurogenic effects of NPY-apoB appeared to involve signaling via ERK and Akt through the NPY R1 and NPY R2 receptors. Thus, widespread CNS-targeted delivery of NPY appears to be effective at reversing the neuronal and glial pathology associated with Aβ accumulation while also increasing NPC proliferation. Overall, increased delivery of NPY to the CNS for AD might be an effective therapy especially if combined with an anti-Aβ therapeutic. © 2016 by The American Society for Biochemistry and Molecular Biology, Inc.
Neural networks as models of psychopathology.
Aakerlund, L; Hemmingsen, R
1998-04-01
Neural network modeling is situated between neurobiology, cognitive science, and neuropsychology. The structural and functional resemblance with biological computation has made artificial neural networks (ANN) useful for exploring the relationship between neurobiology and computational performance, i.e., cognition and behavior. This review provides an introduction to the theory of ANN and how they have linked theories from neurobiology and psychopathology in schizophrenia, affective disorders, and dementia.
Neural network approaches for noisy language modeling.
Li, Jun; Ouazzane, Karim; Kazemian, Hassan B; Afzal, Muhammad Sajid
2013-11-01
Text entry from people is not only grammatical and distinct, but also noisy. For example, a user's typing stream contains all the information about the user's interaction with computer using a QWERTY keyboard, which may include the user's typing mistakes as well as specific vocabulary, typing habit, and typing performance. In particular, these features are obvious in disabled users' typing streams. This paper proposes a new concept called noisy language modeling by further developing information theory and applies neural networks to one of its specific application-typing stream. This paper experimentally uses a neural network approach to analyze the disabled users' typing streams both in general and specific ways to identify their typing behaviors and subsequently, to make typing predictions and typing corrections. In this paper, a focused time-delay neural network (FTDNN) language model, a time gap model, a prediction model based on time gap, and a probabilistic neural network model (PNN) are developed. A 38% first hitting rate (HR) and a 53% first three HR in symbol prediction are obtained based on the analysis of a user's typing history through the FTDNN language modeling, while the modeling results using the time gap prediction model and the PNN model demonstrate that the correction rates lie predominantly in between 65% and 90% with the current testing samples, and 70% of all test scores above basic correction rates, respectively. The modeling process demonstrates that a neural network is a suitable and robust language modeling tool to analyze the noisy language stream. The research also paves the way for practical application development in areas such as informational analysis, text prediction, and error correction by providing a theoretical basis of neural network approaches for noisy language modeling.
Neural Networks for Modeling and Control of Particle Accelerators
Edelen, A. L.; Biedron, S. G.; Chase, B. E.; Edstrom, D.; Milton, S. V.; Stabile, P.
2016-04-01
Particle accelerators are host to myriad nonlinear and complex physical phenomena. They often involve a multitude of interacting systems, are subject to tight performance demands, and should be able to run for extended periods of time with minimal interruptions. Often times, traditional control techniques cannot fully meet these requirements. One promising avenue is to introduce machine learning and sophisticated control techniques inspired by artificial intelligence, particularly in light of recent theoretical and practical advances in these fields. Within machine learning and artificial intelligence, neural networks are particularly well-suited to modeling, control, and diagnostic analysis of complex, nonlinear, and time-varying systems, as well as systems with large parameter spaces. Consequently, the use of neural network-based modeling and control techniques could be of significant benefit to particle accelerators. For the same reasons, particle accelerators are also ideal test-beds for these techniques. Many early attempts to apply neural networks to particle accelerators yielded mixed results due to the relative immaturity of the technology for such tasks. The purpose of this paper is to re-introduce neural networks to the particle accelerator community and report on some work in neural network control that is being conducted as part of a dedicated collaboration between Fermilab and Colorado State University (CSU). We describe some of the challenges of particle accelerator control, highlight recent advances in neural network techniques, discuss some promising avenues for incorporating neural networks into particle accelerator control systems, and describe a neural network-based control system that is being developed for resonance control of an RF electron gun at the Fermilab Accelerator Science and Technology (FAST) facility, including initial experimental results from a benchmark controller.
ARTIFICIAL NEURAL NETWORK FOR MODELS OF HUMAN OPERATOR
Directory of Open Access Journals (Sweden)
Martin Ruzek
2017-12-01
Full Text Available This paper presents a new approach to mental functions modeling with the use of artificial neural networks. The artificial neural networks seems to be a promising method for the modeling of a human operator because the architecture of the ANN is directly inspired by the biological neuron. On the other hand, the classical paradigms of artificial neural networks are not suitable because they simplify too much the real processes in biological neural network. The search for a compromise between the complexity of biological neural network and the practical feasibility of the artificial network led to a new learning algorithm. This algorithm is based on the classical multilayered neural network; however, the learning rule is different. The neurons are updating their parameters in a way that is similar to real biological processes. The basic idea is that the neurons are competing for resources and the criterion to decide which neuron will survive is the usefulness of the neuron to the whole neural network. The neuron is not using "teacher" or any kind of superior system, the neuron receives only the information that is present in the biological system. The learning process can be seen as searching of some equilibrium point that is equal to a state with maximal importance of the neuron for the neural network. This position can change if the environment changes. The name of this type of learning, the homeostatic artificial neural network, originates from this idea, as it is similar to the process of homeostasis known in any living cell. The simulation results suggest that this type of learning can be useful also in other tasks of artificial learning and recognition.
NNSYSID - toolbox for system identification with neural networks
DEFF Research Database (Denmark)
Norgaard, M.; Ravn, Ole; Poulsen, Niels Kjølstad
2002-01-01
The NNSYSID toolset for System Identification has been developed as an add on to MATLAB(R). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains a number of nonlinear model structures based on neural networks, effective training algorithms...
PREDIKSI FOREX MENGGUNAKAN MODEL NEURAL NETWORK
Directory of Open Access Journals (Sweden)
R. Hadapiningradja Kusumodestoni
2015-11-01
Full Text Available ABSTRAK Prediksi adalah salah satu teknik yang paling penting dalam menjalankan bisnis forex. Keputusan dalam memprediksi adalah sangatlah penting, karena dengan prediksi dapat membantu mengetahui nilai forex di waktu tertentu kedepan sehingga dapat mengurangi resiko kerugian. Tujuan dari penelitian ini dimaksudkan memprediksi bisnis fores menggunakan model neural network dengan data time series per 1 menit untuk mengetahui nilai akurasi prediksi sehingga dapat mengurangi resiko dalam menjalankan bisnis forex. Metode penelitian pada penelitian ini meliputi metode pengumpulan data kemudian dilanjutkan ke metode training, learning, testing menggunakan neural network. Setelah di evaluasi hasil penelitian ini menunjukan bahwa penerapan algoritma Neural Network mampu untuk memprediksi forex dengan tingkat akurasi prediksi 0.431 +/- 0.096 sehingga dengan prediksi ini dapat membantu mengurangi resiko dalam menjalankan bisnis forex. Kata kunci: prediksi, forex, neural network.
Bayesian Recurrent Neural Network for Language Modeling.
Chien, Jen-Tzung; Ku, Yuan-Chu
2016-02-01
A language model (LM) is calculated as the probability of a word sequence that provides the solution to word prediction for a variety of information systems. A recurrent neural network (RNN) is powerful to learn the large-span dynamics of a word sequence in the continuous space. However, the training of the RNN-LM is an ill-posed problem because of too many parameters from a large dictionary size and a high-dimensional hidden layer. This paper presents a Bayesian approach to regularize the RNN-LM and apply it for continuous speech recognition. We aim to penalize the too complicated RNN-LM by compensating for the uncertainty of the estimated model parameters, which is represented by a Gaussian prior. The objective function in a Bayesian classification network is formed as the regularized cross-entropy error function. The regularized model is constructed not only by calculating the regularized parameters according to the maximum a posteriori criterion but also by estimating the Gaussian hyperparameter by maximizing the marginal likelihood. A rapid approximation to a Hessian matrix is developed to implement the Bayesian RNN-LM (BRNN-LM) by selecting a small set of salient outer-products. The proposed BRNN-LM achieves a sparser model than the RNN-LM. Experiments on different corpora show the robustness of system performance by applying the rapid BRNN-LM under different conditions.
Energy Technology Data Exchange (ETDEWEB)
Barros, Paulo Sergio de Souza; Silva, Jorge Wagner Esteves da; Schirru, Roberto [Universidade Federal, Rio de Janeiro, RJ (Brazil). Coordenacao dos Programas de Pos-graduacao de Engenharia. Programa de Engenharia Nuclear]. E-mail: wagner@lmp.ufrj.br; schirru@lmp.ufrj.br
2000-07-01
From the several available diagnostic techniques, the non-invasive ones are the less aggressive to the human body. The use of radionuclides for renal function evaluation seems to be more secure than the other diagnostic procedures. However, the use of radioactive materials, makes it necessary to maximize the beneficial effects of this technique, conducing inevitably to the development of support tools for the analysis of their results. The objective of this work is to improve a system model for image analysis of scintillation. The detection and identification of renal anomalies is done by means of analysis of parts of the image, taking in account the spatial distribution of those anomalies. Geometric operations in conjunction with the segmentation technique enable the improvement of image analysis information processing. In this work, we look for the best artificial neural network architectures to introduce the knowledge of the medical expert into the diagnostic system. The search of the best neural network architectures, the geometric techniques and the image segmentation technique permitted a significant improvement of diagnostic analysis model by using scintillation. (author)
Dutt-Mazumder, Aviroop; Button, Chris; Robins, Anthony; Bartlett, Roger
2011-12-01
Recent studies have explored the organization of player movements in team sports using a range of statistical tools. However, the factors that best explain the performance of association football teams remain elusive. Arguably, this is due to the high-dimensional behavioural outputs that illustrate the complex, evolving configurations typical of team games. According to dynamical system analysts, movement patterns in team sports exhibit nonlinear self-organizing features. Nonlinear processing tools (i.e. Artificial Neural Networks; ANNs) are becoming increasingly popular to investigate the coordination of participants in sports competitions. ANNs are well suited to describing high-dimensional data sets with nonlinear attributes, however, limited information concerning the processes required to apply ANNs exists. This review investigates the relative value of various ANN learning approaches used in sports performance analysis of team sports focusing on potential applications for association football. Sixty-two research sources were summarized and reviewed from electronic literature search engines such as SPORTDiscus, Google Scholar, IEEE Xplore, Scirus, ScienceDirect and Elsevier. Typical ANN learning algorithms can be adapted to perform pattern recognition and pattern classification. Particularly, dimensionality reduction by a Kohonen feature map (KFM) can compress chaotic high-dimensional datasets into low-dimensional relevant information. Such information would be useful for developing effective training drills that should enhance self-organizing coordination among players. We conclude that ANN-based qualitative analysis is a promising approach to understand the dynamical attributes of association football players.
Galeazzi, Juan M; Navajas, Joaquín; Mender, Bedeho M W; Quian Quiroga, Rodrigo; Minini, Loredana; Stringer, Simon M
2016-01-01
Neurons have been found in the primate brain that respond to objects in specific locations in hand-centered coordinates. A key theoretical challenge is to explain how such hand-centered neuronal responses may develop through visual experience. In this paper we show how hand-centered visual receptive fields can develop using an artificial neural network model, VisNet, of the primate visual system when driven by gaze changes recorded from human test subjects as they completed a jigsaw. A camera mounted on the head captured images of the hand and jigsaw, while eye movements were recorded using an eye-tracking device. This combination of data allowed us to reconstruct the retinal images seen as humans undertook the jigsaw task. These retinal images were then fed into the neural network model during self-organization of its synaptic connectivity using a biologically plausible trace learning rule. A trace learning mechanism encourages neurons in the model to learn to respond to input images that tend to occur in close temporal proximity. In the data recorded from human subjects, we found that the participant's gaze often shifted through a sequence of locations around a fixed spatial configuration of the hand and one of the jigsaw pieces. In this case, trace learning should bind these retinal images together onto the same subset of output neurons. The simulation results consequently confirmed that some cells learned to respond selectively to the hand and a jigsaw piece in a fixed spatial configuration across different retinal views.
An artificial neural network controller for intelligent transportation systems applications
Energy Technology Data Exchange (ETDEWEB)
Vitela, J.E.; Hanebutte, U.R.; Reifman, J. [Argonne National Lab., IL (United States). Reactor Analysis Div.
1996-04-01
An Autonomous Intelligent Cruise Control (AICC) has been designed using a feedforward artificial neural network, as an example for utilizing artificial neural networks for nonlinear control problems arising in intelligent transportation systems applications. The AICC is based on a simple nonlinear model of the vehicle dynamics. A Neural Network Controller (NNC) code developed at Argonne National Laboratory to control discrete dynamical systems was used for this purpose. In order to test the NNC, an AICC-simulator containing graphical displays was developed for a system of two vehicles driving in a single lane. Two simulation cases are shown, one involving a lead vehicle with constant velocity and the other a lead vehicle with varying acceleration. More realistic vehicle dynamic models will be considered in future work.
Epigenomic Landscapes of hESC-Derived Neural Rosettes: Modeling Neural Tube Formation and Diseases.
Valensisi, Cristina; Andrus, Colin; Buckberry, Sam; Doni Jayavelu, Naresh; Lund, Riikka J; Lister, Ryan; Hawkins, R David
2017-08-08
We currently lack a comprehensive understanding of the mechanisms underlying neural tube formation and their contributions to neural tube defects (NTDs). Developing a model to study such a complex morphogenetic process, especially one that models human-specific aspects, is critical. Three-dimensional, human embryonic stem cell (hESC)-derived neural rosettes (NRs) provide a powerful resource for in vitro modeling of human neural tube formation. Epigenomic maps reveal enhancer elements unique to NRs relative to 2D systems. A master regulatory network illustrates that key NR properties are related to their epigenomic landscapes. We found that folate-associated DNA methylation changes were enriched within NR regulatory elements near genes involved in neural tube formation and metabolism. Our comprehensive regulatory maps offer insights into the mechanisms by which folate may prevent NTDs. Lastly, our distal regulatory maps provide a better understanding of the potential role of neurological-disorder-associated SNPs. Copyright © 2017 The Author(s). Published by Elsevier Inc. All rights reserved.
Kong-A-Siou, Line; Fleury, Perrine; Johannet, Anne; Borrell Estupina, Valérie; Pistre, Séverin; Dörfliger, Nathalie
2014-11-01
Karst aquifers can provide previously untapped freshwater resources and have thus generated considerable interest among stakeholders involved in the water supply sector. Here we compare the capacity of two systemic models to simulate the discharge and piezometry of a karst aquifer. Systemic models have the advantage of allowing the study of heterogeneous, complex karst systems without relying on extensive geographical and meteorological datasets. The effectiveness and complementarity of the two models are evaluated for a range of hydrologic conditions and for three methods to estimate evapotranspiration (Monteith, a priori ET, and effective rainfall). The first model is a reservoir model (referred to as VENSIM, after the software used), which is designed with just one reservoir so as to be as parsimonious as possible. The second model is a neural network (NN) model. The models are designed to simulate the rainfall-runoff and rainfall-water level relations in a karst conduit. The Lez aquifer, a karst aquifer located near the city of Montpellier in southern France and a critical water resource, was chosen to compare the two models. Simulated discharge and water level were compared after completing model design and calibration. The results suggest that the NN model is more effective at incorporating the nonlinearity of the karst spring for extreme events (extreme low and high water levels), whereas VENSIM provides a better representation of intermediate-amplitude water level fluctuations. VENSIM is sensitive to the method used to estimate evapotranspiration, whereas the NN model is not. Given that the NN model performs better for extreme events, it is better for operational applications (predicting floods or determining water pumping height). VENSIM, on the other hand, seems more appropriate for representing the hydrologic state of the basin during intermediate periods, when several effects are at work: rain, evapotranspiration, development of vegetation, etc. A
Empirical generalization assessment of neural network models
DEFF Research Database (Denmark)
Larsen, Jan; Hansen, Lars Kai
1995-01-01
This paper addresses the assessment of generalization performance of neural network models by use of empirical techniques. We suggest to use the cross-validation scheme combined with a resampling technique to obtain an estimate of the generalization performance distribution of a specific model...
A quantum-implementable neural network model
Chen, Jialin; Wang, Lingli; Charbon, Edoardo
2017-10-01
A quantum-implementable neural network, namely quantum probability neural network (QPNN) model, is proposed in this paper. QPNN can use quantum parallelism to trace all possible network states to improve the result. Due to its unique quantum nature, this model is robust to several quantum noises under certain conditions, which can be efficiently implemented by the qubus quantum computer. Another advantage is that QPNN can be used as memory to retrieve the most relevant data and even to generate new data. The MATLAB experimental results of Iris data classification and MNIST handwriting recognition show that much less neuron resources are required in QPNN to obtain a good result than the classical feedforward neural network. The proposed QPNN model indicates that quantum effects are useful for real-life classification tasks.
Neural-network-based fuzzy logic decision systems
Kulkarni, Arun D.; Giridhar, G. B.; Coca, Praveen
1994-10-01
During the last few years there has been a large and energetic upswing in research efforts aimed at synthesizing fuzzy logic with neural networks. This combination of neural networks and fuzzy logic seems natural because the two approaches generally attack the design of `intelligent' system from quite different angles. Neural networks provide algorithms for learning, classification, and optimization whereas fuzzy logic often deals with issues such as reasoning in a high (semantic or linguistic) level. Consequently the two technologies complement each other. In this paper, we combine neural networks with fuzzy logic techniques. We propose an artificial neural network (ANN) model for a fuzzy logic decision system. The model consists of six layers. The first three layers map the input variables to fuzzy set membership functions. The last three layers implement the decision rules. The model learns the decision rules using a supervised gradient descent procedure. As an illustration we considered two examples. The first example deals with pixel classification in multispectral satellite images. In our second example we used the fuzzy decision system to analyze data from magnetic resonance imaging (MRI) scans for tissue classification.
Spiking neural P systems with multiple channels.
Peng, Hong; Yang, Jinyu; Wang, Jun; Wang, Tao; Sun, Zhang; Song, Xiaoxiao; Luo, Xiaohui; Huang, Xiangnian
2017-11-01
Spiking neural P systems (SNP systems, in short) are a class of distributed parallel computing systems inspired from the neurophysiological behavior of biological spiking neurons. In this paper, we investigate a new variant of SNP systems in which each neuron has one or more synaptic channels, called spiking neural P systems with multiple channels (SNP-MC systems, in short). The spiking rules with channel label are introduced to handle the firing mechanism of neurons, where the channel labels indicate synaptic channels of transmitting the generated spikes. The computation power of SNP-MC systems is investigated. Specifically, we prove that SNP-MC systems are Turing universal as both number generating and number accepting devices. Copyright © 2017 Elsevier Ltd. All rights reserved.
Evolution of Neural Dynamics in an Ecological Model
Directory of Open Access Journals (Sweden)
Steven Williams
2017-07-01
Full Text Available What is the optimal level of chaos in a computational system? If a system is too chaotic, it cannot reliably store information. If it is too ordered, it cannot transmit information. A variety of computational systems exhibit dynamics at the “edge of chaos”, the transition between the ordered and chaotic regimes. In this work, we examine the evolved neural networks of Polyworld, an artificial life model consisting of a simulated ecology populated with biologically inspired agents. As these agents adapt to their environment, their initially simple neural networks become increasingly capable of exhibiting rich dynamics. Dynamical systems analysis reveals that natural selection drives these networks toward the edge of chaos until the agent population is able to sustain itself. After this point, the evolutionary trend stabilizes, with neural dynamics remaining on average significantly far from the transition to chaos.
Space-time system architecture for the neural optical computing
Lo, Yee-Man V.
1991-02-01
The brain can perform the tasks of associative recall detection recognition and optimization. In this paper space-time system field models of the brain are introduced. They are called the space-time maximum likelihood associative memory system (ST-ML-AMS) and the space-time adaptive learning system (ST-ALS). Performance of the system is analyzed using the probability of error in memory recall (PEMR) and the space-time neural capacity (ST-NC). 1.
Evaluating neural networks and artificial intelligence systems
Alberts, David S.
1994-02-01
Systems have no intrinsic value in and of themselves, but rather derive value from the contributions they make to the missions, decisions, and tasks they are intended to support. The estimation of the cost-effectiveness of systems is a prerequisite for rational planning, budgeting, and investment documents. Neural network and expert system applications, although similar in their incorporation of a significant amount of decision-making capability, differ from each other in ways that affect the manner in which they can be evaluated. Both these types of systems are, by definition, evolutionary systems, which also impacts their evaluation. This paper discusses key aspects of neural network and expert system applications and their impact on the evaluation process. A practical approach or methodology for evaluating a certain class of expert systems that are particularly difficult to measure using traditional evaluation approaches is presented.
Directory of Open Access Journals (Sweden)
Rena R. Timirualeeva
2015-01-01
Full Text Available The article describes the methodology of modeling andstructuring of business networks theory. Accounting ofenvironmental factors mega-, macro- and mesolevels, theinternal state of the managed system and the error management command execution by control system implemented inthis. The proposed methodology can improve the quality of enterprise management of resort complex through a moreﬂexible response to changes in the parameters of the internaland external environments.
Artificial neural network cardiopulmonary modeling and diagnosis
Kangas, Lars J.; Keller, Paul E.
1997-01-01
The present invention is a method of diagnosing a cardiopulmonary condition in an individual by comparing data from a progressive multi-stage test for the individual to a non-linear multi-variate model, preferably a recurrent artificial neural network having sensor fusion. The present invention relies on a cardiovascular model developed from physiological measurements of an individual. Any differences between the modeled parameters and the parameters of an individual at a given time are used for diagnosis.
Neural Plasticity in the Gustatory System
Hill, David L.
2004-01-01
Sensory systems adapt to changing environmental influences by coordinated alterations in structure and function. These alterations are referred to as plastic changes. The gustatory system displays numerous plastic changes even in receptor cells. This review focuses on the plasticity of gustatory structures through the first synaptic relay in the brain. Unlike other sensory systems, there is a remarkable amount of environmentally induced changes in these peripheral-most neural structures. The ...
A hyperstable neural network for the modelling and control of ...
Indian Academy of Sciences (India)
A multivariable hyperstable robust adaptive decoupling control algorithm based on a neural network is presented for the control of nonlinear multivariable coupled systems with unknown parameters and structure. The Popov theorem is used in the design of the controller. The modelling errors, coupling action and other ...
Transformation of Neural State Space Models into LFT Models for Robust Control Design
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon; Trangbæk, Klaus
2000-01-01
This paper considers the extraction of linear state space models and uncertainty models from neural networks trained as state estimators with direct application to robust control. A new method for writing a neural state space model in a linear fractional transformation form in a non-conservative ......-conservative way is proposed, and it is demonstrated how a standard robust control law can be designed for a system described by means of a multi layer perceptron....
A neural model of hierarchical reinforcement learning.
Rasmussen, Daniel; Voelker, Aaron; Eliasmith, Chris
2017-01-01
We develop a novel, biologically detailed neural model of reinforcement learning (RL) processes in the brain. This model incorporates a broad range of biological features that pose challenges to neural RL, such as temporally extended action sequences, continuous environments involving unknown time delays, and noisy/imprecise computations. Most significantly, we expand the model into the realm of hierarchical reinforcement learning (HRL), which divides the RL process into a hierarchy of actions at different levels of abstraction. Here we implement all the major components of HRL in a neural model that captures a variety of known anatomical and physiological properties of the brain. We demonstrate the performance of the model in a range of different environments, in order to emphasize the aim of understanding the brain's general reinforcement learning ability. These results show that the model compares well to previous modelling work and demonstrates improved performance as a result of its hierarchical ability. We also show that the model's behaviour is consistent with available data on human hierarchical RL, and generate several novel predictions.
System and method for determining stability of a neural system
Curtis, Steven A. (Inventor)
2011-01-01
Disclosed are methods, systems, and computer-readable media for determining stability of a neural system. The method includes tracking a function world line of an N element neural system within at least one behavioral space, determining whether the tracking function world line is approaching a psychological stability surface, and implementing a quantitative solution that corrects instability if the tracked function world line is approaching the psychological stability surface.
A NEURAL OSCILLATOR-NETWORK MODEL OF TEMPORAL PATTERN GENERATION
Schomaker, Lambert
Most contemporary neural network models deal with essentially static, perceptual problems of classification and transformation. Models such as multi-layer feedforward perceptrons generally do not incorporate time as an essential dimension, whereas biological neural networks are inherently temporal
Unveiling neural coupling within the sensorimotor system : directionality and nonlinearity
Yang, Y.; Dewald, J.P.A.; van der Helm, F.C.T.; Schouten, A.C.
2017-01-01
Neural coupling between the central nervous system and the periphery is essential for the neural control of movement. Corticomuscular coherence is a popular linear technique to assess synchronised oscillatory activity in the sensorimotor system. This oscillatory coupling originates from ascending
KCNQ potassium channels in sensory system and neural circuits.
Wang, Jing-jing; Li, Yang
2016-01-01
M channels, an important regulator of neural excitability, are composed of four subunits of the Kv7 (KCNQ) K(+) channel family. M channels were named as such because their activity was suppressed by stimulation of muscarinic acetylcholine receptors. These channels are of particular interest because they are activated at the subthreshold membrane potentials. Furthermore, neural KCNQ channels are drug targets for the treatments of epilepsy and a variety of neurological disorders, including chronic and neuropathic pain, deafness, and mental illness. This review will update readers on the roles of KCNQ channels in the sensory system and neural circuits as well as discuss their respective mechanisms and the implications for physiology and medicine. We will also consider future perspectives and the development of additional pharmacological models, such as seizure, stroke, pain and mental illness, which work in combination with drug-design targeting of KCNQ channels. These models will hopefully deepen our understanding of KCNQ channels and provide general therapeutic prospects of related channelopathies.
Neural decision model of business capitalization
Directory of Open Access Journals (Sweden)
Martin Pokorný
2007-01-01
Full Text Available The topic of this article is focused on problems related to enterprise financial supervising. In the concrete, the situation of enterprise investment policy evaluation is described here. In this case, as a convenient tool for decision support, the approach of artificial intelligence was selected, particularly the model of neuron network. For the purpose of enterprise economic state evaluation, we use four input variables which describe the economic state. Three main variables are selected and the fourth one is the additional. The coding of main variables is chosen with the respect to the possible states of the enterprise. The multilayer neuron network was used for evaluation.The neural network can solve problems, which are hardly solvable for a manager because there can exist a lot of factors affecting the final decision. We have to take into account the fact that sometimes the situation is too complex. In this case, when the system gives incorrect result, it is possible to extend the current learning set and add adequate patterns which will help the system to recognize states of the enterprise.
A NEURAL NETWORK BASED IRIS RECOGNITION SYSTEM FOR PERSONAL IDENTIFICATION
Directory of Open Access Journals (Sweden)
Usham Dias
2010-10-01
Full Text Available This paper presents biometric personal identification based on iris recognition using artificial neural networks. Personal identification system consists of localization of the iris region, normalization, enhancement and then iris pattern recognition using neural network. In this paper, through results obtained, we have shown that a person’s left and right eye are unique. In this paper, we also show that the network is sensitive to the initial weights and that over-training gives bad results. We also propose a fast algorithm for the localization of the inner and outer boundaries of the iris region. Results of simulations illustrate the effectiveness of the neural system in personal identification. Finally a hardware iris recognition model is proposed and implementation aspects are discussed.
A neural network model of causative actions.
Lee-Hand, Jeremy; Knott, Alistair
2015-01-01
A common idea in models of action representation is that actions are represented in terms of their perceptual effects (see e.g., Prinz, 1997; Hommel et al., 2001; Sahin et al., 2007; Umiltà et al., 2008; Hommel, 2013). In this paper we extend existing models of effect-based action representations to account for a novel distinction. Some actions bring about effects that are independent events in their own right: for instance, if John smashes a cup, he brings about the event of the cup smashing. Other actions do not bring about such effects. For instance, if John grabs a cup, this action does not cause the cup to "do" anything: a grab action has well-defined perceptual effects, but these are not registered by the perceptual system that detects independent events involving external objects in the world. In our model, effect-based actions are implemented in several distinct neural circuits, which are organized into a hierarchy based on the complexity of their associated perceptual effects. The circuit at the top of this hierarchy is responsible for actions that bring about independently perceivable events. This circuit receives input from the perceptual module that recognizes arbitrary events taking place in the world, and learns movements that reliably cause such events. We assess our model against existing experimental observations about effect-based motor representations, and make some novel experimental predictions. We also consider the possibility that the "causative actions" circuit in our model can be identified with a motor pathway reported in other work, specializing in "functional" actions on manipulable tools (Bub et al., 2008; Binkofski and Buxbaum, 2013).
Product Cost Management Structures: a review and neural network modelling
Directory of Open Access Journals (Sweden)
P. Jha
2003-11-01
Full Text Available This paper reviews the growth of approaches in product costing and draws synergies with information management and resource planning systems, to investigate potential application of state of the art modelling techniques of neural networks. Increasing demands on costing systems to serve multiple decision-making objectives, have made it essential to use better techniques for analysis of available data. This need is highlighted in the paper. The approach of neural networks, which have several analogous facets to complement and aid the information demands of modern product costing, Enterprise Resource Planning (ERP structures and the dominant-computing environment (for information management in the object oriented paradigm form the domain for investigation. Simulated data is used in neural network applications across activities that consume resources and deliver products, to generate information for monitoring and control decisions. The results in application for feature extraction and variation detection and their implications are presented in the paper.
DEFF Research Database (Denmark)
Roudi, Yasser; Tyrcha, Joanna; Hertz, John
2009-01-01
(dansk abstrakt findes ikke) We study pairwise Ising models for describing the statistics of multi-neuron spike trains, using data from a simulated cortical network. We explore efficient ways of finding the optimal couplings in these models and examine their statistical properties. To do this, we...
Artificial Neural Network Modeling of an Inverse Fluidized Bed ...
African Journals Online (AJOL)
The application of neural networks to model a laboratory scale inverse fluidized bed reactor has been studied. A Radial Basis Function neural network has been successfully employed for the modeling of the inverse fluidized bed reactor. In the proposed model, the trained neural network represents the kinetics of biological ...
Temporal-pattern learning in neural models
Genís, Carme Torras
1985-01-01
While the ability of animals to learn rhythms is an unquestionable fact, the underlying neurophysiological mechanisms are still no more than conjectures. This monograph explores the requirements of such mechanisms, reviews those previously proposed and postulates a new one based on a direct electric coding of stimulation frequencies. Experi mental support for the option taken is provided both at the single neuron and neural network levels. More specifically, the material presented divides naturally into four parts: a description of the experimental and theoretical framework where this work becomes meaningful (Chapter 2), a detailed specifica tion of the pacemaker neuron model proposed together with its valida tion through simulation (Chapter 3), an analytic study of the behavior of this model when submitted to rhythmic stimulation (Chapter 4) and a description of the neural network model proposed for learning, together with an analysis of the simulation results obtained when varying seve ral factors r...
NNSYSID and NNCTRL Tools for system identification and control with neural networks
DEFF Research Database (Denmark)
Nørgaard, Magnus; Ravn, Ole; Poulsen, Niels Kjølstad
2001-01-01
a number of nonlinear model structures based on neural networks, effective training algorithms and tools for model validation and model structure selection. The NNCTRL toolkit is an add-on to NNSYSID and provides tools for design and simulation of control systems based on neural networks. The user can......Two toolsets for use with MATLAB have been developed: the neural network based system identification toolbox (NNSYSID) and the neural network based control system design toolkit (NNCTRL). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains...... choose among several designs such as direct inverse control, internal model control, nonlinear feedforward, feedback linearisation, optimal control, gain scheduling based on instantaneous linearisation of neural network models and nonlinear model predictive control. This article gives an overview...
NNSYSID and NNCTRL Tools for system identification and control with neural networks
DEFF Research Database (Denmark)
Nørgaard, Magnus; Ravn, Ole; Poulsen, Niels Kjølstad
2001-01-01
choose among several designs such as direct inverse control, internal model control, nonlinear feedforward, feedback linearisation, optimal control, gain scheduling based on instantaneous linearisation of neural network models and nonlinear model predictive control. This article gives an overview......Two toolsets for use with MATLAB have been developed: the neural network based system identification toolbox (NNSYSID) and the neural network based control system design toolkit (NNCTRL). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains...... a number of nonlinear model structures based on neural networks, effective training algorithms and tools for model validation and model structure selection. The NNCTRL toolkit is an add-on to NNSYSID and provides tools for design and simulation of control systems based on neural networks. The user can...
Modelling Framework of a Neural Object Recognition
Directory of Open Access Journals (Sweden)
Aswathy K S
2016-02-01
Full Text Available In many industrial, medical and scientific image processing applications, various feature and pattern recognition techniques are used to match specific features in an image with a known template. Despite the capabilities of these techniques, some applications require simultaneous analysis of multiple, complex, and irregular features within an image as in semiconductor wafer inspection. In wafer inspection discovered defects are often complex and irregular and demand more human-like inspection techniques to recognize irregularities. By incorporating neural network techniques such image processing systems with much number of images can be trained until the system eventually learns to recognize irregularities. The aim of this project is to develop a framework of a machine-learning system that can classify objects of different category. The framework utilizes the toolboxes in the Matlab such as Computer Vision Toolbox, Neural Network Toolbox etc.
Simulating neural systems with Xyce.
Energy Technology Data Exchange (ETDEWEB)
Schiek, Richard Louis; Thornquist, Heidi K.; Mei, Ting; Warrender, Christina E.; Aimone, James Bradley; Teeter, Corinne; Duda, Alex M.
2012-12-01
Sandias parallel circuit simulator, Xyce, can address large scale neuron simulations in a new way extending the range within which one can perform high-fidelity, multi-compartment neuron simulations. This report documents the implementation of neuron devices in Xyce, their use in simulation and analysis of neuron systems.
Optical neural network system for pose determination of spinning satellites
Lee, Andrew; Casasent, David
1990-01-01
An optical neural network architecture and algorithm based on a Hopfield optimization network are presented for multitarget tracking. This tracker utilizes a neuron for every possible target track, and a quadratic energy function of neural activities which is minimized using gradient descent neural evolution. The neural net tracker is demonstrated as part of a system for determining position and orientation (pose) of spinning satellites with respect to a robotic spacecraft. The input to the system is time sequence video from a single camera. Novelty detection and filtering are utilized to locate and segment novel regions from the input images. The neural net multitarget tracker determines the correspondences (or tracks) of the novel regions as a function of time, and hence the paths of object (satellite) parts. The path traced out by a given part or region is approximately elliptical in image space, and the position, shape and orientation of the ellipse are functions of the satellite geometry and its pose. Having a geometric model of the satellite, and the elliptical path of a part in image space, the three-dimensional pose of the satellite is determined. Digital simulation results using this algorithm are presented for various satellite poses and lighting conditions.
IMPLEMENTATION OF NEURAL - CRYPTOGRAPHIC SYSTEM USING FPGA
Directory of Open Access Journals (Sweden)
KARAM M. Z. OTHMAN
2011-08-01
Full Text Available Modern cryptography techniques are virtually unbreakable. As the Internet and other forms of electronic communication become more prevalent, electronic security is becoming increasingly important. Cryptography is used to protect e-mail messages, credit card information, and corporate data. The design of the cryptography system is a conventional cryptography that uses one key for encryption and decryption process. The chosen cryptography algorithm is stream cipher algorithm that encrypt one bit at a time. The central problem in the stream-cipher cryptography is the difficulty of generating a long unpredictable sequence of binary signals from short and random key. Pseudo random number generators (PRNG have been widely used to construct this key sequence. The pseudo random number generator was designed using the Artificial Neural Networks (ANN. The Artificial Neural Networks (ANN providing the required nonlinearity properties that increases the randomness statistical properties of the pseudo random generator. The learning algorithm of this neural network is backpropagation learning algorithm. The learning process was done by software program in Matlab (software implementation to get the efficient weights. Then, the learned neural network was implemented using field programmable gate array (FPGA.
Optimizing neural network models: motivation and case studies
Harp, S A; T. Samad
2012-01-01
Practical successes have been achieved with neural network models in a variety of domains, including energy-related industry. The large, complex design space presented by neural networks is only minimally explored in current practice. The satisfactory results that nevertheless have been obtained testify that neural networks are a robust modeling technology; at the same time, however, the lack of a systematic design approach implies that the best neural network models generally rem...
Geminiani, Alice; Casellato, Claudia; Antonietti, Alberto; D'Angelo, Egidio; Pedrocchi, Alessandra
2017-01-10
The cerebellum plays a crucial role in sensorimotor control and cerebellar disorders compromise adaptation and learning of motor responses. However, the link between alterations at network level and cerebellar dysfunction is still unclear. In principle, this understanding would benefit of the development of an artificial system embedding the salient neuronal and plastic properties of the cerebellum and operating in closed-loop. To this aim, we have exploited a realistic spiking computational model of the cerebellum to analyze the network correlates of cerebellar impairment. The model was modified to reproduce three different damages of the cerebellar cortex: (i) a loss of the main output neurons (Purkinje Cells), (ii) a lesion to the main cerebellar afferents (Mossy Fibers), and (iii) a damage to a major mechanism of synaptic plasticity (Long Term Depression). The modified network models were challenged with an Eye-Blink Classical Conditioning test, a standard learning paradigm used to evaluate cerebellar impairment, in which the outcome was compared to reference results obtained in human or animal experiments. In all cases, the model reproduced the partial and delayed conditioning typical of the pathologies, indicating that an intact cerebellar cortex functionality is required to accelerate learning by transferring acquired information to the cerebellar nuclei. Interestingly, depending on the type of lesion, the redistribution of synaptic plasticity and response timing varied greatly generating specific adaptation patterns. Thus, not only the present work extends the generalization capabilities of the cerebellar spiking model to pathological cases, but also predicts how changes at the neuronal level are distributed across the network, making it usable to infer cerebellar circuit alterations occurring in cerebellar pathologies.
Capacitive MEMS accelerometer wide range modeling using artificial neural network
A. Baharodimehr; A. Abolfazl Suratgar; H. Sadeghi
2009-01-01
This paper presents a nonlinear model for a capacitive microelectromechanical accelerometer (MEMA). System parameters ofthe accelerometer are developed using the effect of cubic term of the folded‐flexure spring. To solve this equation, we use theFEA method. The neural network (NN) uses the Levenberg‐Marquardt (LM) method for training the system to have a moreaccurate response. The designed NN can identify and predict the displacement of the movable mass of accelerometer. Thesimulation result...
Capacitive MEMS accelerometer wide range modeling using artificial neural network
Directory of Open Access Journals (Sweden)
A. Baharodimehr
2009-08-01
Full Text Available This paper presents a nonlinear model for a capacitive microelectromechanical accelerometer (MEMA. System parameters ofthe accelerometer are developed using the effect of cubic term of the folded‐flexure spring. To solve this equation, we use theFEA method. The neural network (NN uses the Levenberg‐Marquardt (LM method for training the system to have a moreaccurate response. The designed NN can identify and predict the displacement of the movable mass of accelerometer. Thesimulation results are very promising.
Synthetic neural modeling applied to a real-world artifact.
Edelman, G M; Reeke, G N; Gall, W E; Tononi, G; Williams, D.; Sporns, O.
1992-01-01
We describe the general design, operating principles, and performance of a neurally organized, multiply adaptive device (NOMAD) under control of a nervous system simulated in a computer. The complete system, Darwin IV, is the latest in a series of models based on the theory of neuronal group selection, which postulates that adaptive behavior is the result of selection in somatic time among synaptic populations. The simulated brain of Darwin IV includes visual and motor areas that are connecte...
Directory of Open Access Journals (Sweden)
Hegazy Rezk
2015-09-01
Full Text Available This paper presents a new Matlab/Simulink model of a PV module and a maximum power point tracking (MPPT system for high efficiency InGaP/InGaAs/Ge triple-junction solar cell. The proposed technique is based on Artificial Neural Network. The equivalent circuit model of the triple-junction solar cell includes the parameters of each sub-cell. It is also include the effect of the temperature variations on the energy gap of each sub-cell as well as the diode reverse saturation currents. The implementation of a PV model is based on the triple-junction solar cell in the form of masked block in Matlab/Simulink software package that has a user-friendly icon and dialog. It is fast and accurate technique to follow the maximum power point. The simulation results of the proposed MPPT technique are compared with Perturb and Observe MPPT technique. The output power and energy of the proposed technique are higher than that of the Perturb and Observe MPPT technique. The proposed technique increases the output energy per day for a one PV module from 3.37 kW h to 3.75 kW h, i.e. a percentage of 11.28%.
Energy Technology Data Exchange (ETDEWEB)
Mjalli, F.S.; Al-Asheh, S. [Chemical Engineering Department, Qatar University, Doha (Qatar)
2005-10-01
In this work advanced nonlinear neural networks based control system design algorithms are adopted to control a mechanistic model for an ethanol fermentation process. The process model equations for such systems are highly nonlinear. A neural network strategy has been implemented in this work for capturing the dynamics of the mechanistic model for the fermentation process. The neural network achieved has been validated against the mechanistic model. Two neural network based nonlinear control strategies have also been adopted using the model identified. The performance of the feedback linearization technique was compared to neural network model predictive control in terms of stability and set point tracking capabilities. Under servo conditions, the feedback linearization algorithm gave comparable tracking and stability. The feedback linearization controller achieved the control target faster than the model predictive one but with vigorous and sudden controller moves. (Abstract Copyright [2005], Wiley Periodicals, Inc.)
Neural Network Program Package for Prosody Modeling
Directory of Open Access Journals (Sweden)
J. Santarius
2004-04-01
Full Text Available This contribution describes the programme for one part of theautomatic Text-to-Speech (TTS synthesis. Some experiments (for example[14] documented the considerable improvement of the naturalness ofsynthetic speech, but this approach requires completing the inputfeature values by hand. This completing takes a lot of time for bigfiles. We need to improve the prosody by other approaches which useonly automatically classified features (input parameters. Theartificial neural network (ANN approach is used for the modeling ofprosody parameters. The program package contains all modules necessaryfor the text and speech signal pre-processing, neural network training,sensitivity analysis, result processing and a module for the creationof the input data protocol for Czech speech synthesizer ARTIC [1].
The Criticality Hypothesis in Neural Systems
Karimipanah, Yahya
in studying neuronal avalanches. Finally, we show in a computational model that two prevalent features of cortical single-neuron activity, irregular spiking and the decline of response variability at stimulus onset, both are emergent properties of a recurrent network operating near criticality. Our findings establish criticality as a unifying principle for the statistics of single-neuron spiking and the collective behavior of recurrent circuits in cerebral cortex. Moreover, as the observed decline in response variability is regarded as an essential mechanism to enhance response fidelity to stimuli, our discovery of its relation to network criticality offers a starting point toward unraveling the possible roles of critical dynamics in neural coding.
Temporal Modeling of Neural Net Input/Output Behaviors: The Case of XOR
Directory of Open Access Journals (Sweden)
Bernard P. Zeigler
2017-01-01
Full Text Available In the context of the modeling and simulation of neural nets, we formulate definitions for the behavioral realization of memoryless functions. The definitions of realization are substantively different for deterministic and stochastic systems constructed of neuron-inspired components. In contrast to earlier generations of neural net models, third generation spiking neural nets exhibit important temporal and dynamic properties, and random neural nets provide alternative probabilistic approaches. Our definitions of realization are based on the Discrete Event System Specification (DEVS formalism that fundamentally include temporal and probabilistic characteristics of neuron system inputs, state, and outputs. The realizations that we construct—in particular for the Exclusive Or (XOR logic gate—provide insight into the temporal and probabilistic characteristics that real neural systems might display. Our results provide a solid system-theoretical foundation and simulation modeling framework for the high-performance computational support of such applications.
Identification of the non-linear systems using internal recurrent neural networks
Directory of Open Access Journals (Sweden)
Bogdan CODRES
2006-12-01
Full Text Available In the past years utilization of neural networks took a distinct ampleness because of the following properties: distributed representation of information, capacity of generalization in case of uncontained situation in training data set, tolerance to noise, resistance to partial destruction, parallel processing. Another major advantage of neural networks is that they allow us to obtain the model of the investigated system, systems that is not necessarily to be linear. In fact, the true value of neural networks is seen in the case of identification and control of nonlinear systems. In this paper there are presented some identification techniques using neural networks.
Hamon, Annaïg; Roger, Jérôme E.; Yang, Xian‐Jie
2016-01-01
Retinal dystrophies are a major cause of blindness for which there are currently no curative treatments. Transplantation of stem cell‐derived neuronal progenitors to replace lost cells has been widely investigated as a therapeutic option. Another promising strategy would be to trigger self‐repair mechanisms in patients, through the recruitment of endogenous cells with stemness properties. Accumulating evidence in the past 15 year0s has revealed that several retinal cell types possess neurogenic potential, thus opening new avenues for regenerative medicine. Among them, Müller glial cells have been shown to be able to undergo a reprogramming process to re‐acquire a stem/progenitor state, allowing them to proliferate and generate new neurons for repair following retinal damages. Although Müller cell–dependent spontaneous regeneration is remarkable in some species such as the fish, it is extremely limited and ineffective in mammals. Understanding the cellular events and molecular mechanisms underlying Müller cell activities in species endowed with regenerative capacities could provide knowledge to unlock the restricted potential of their mammalian counterparts. In this context, the present review provides an overview of Müller cell responses to injury across vertebrate model systems and summarizes recent advances in this rapidly evolving field. Developmental Dynamics 245:727–738, 2016. © 2015 The Authors. Developmental Dynamics published by Wiley Periodicals, Inc. PMID:26661417
Yolmeh, Mahmoud; Habibi Najafi, Mohammad B; Salehi, Fakhreddin
2014-01-01
Annatto is commonly used as a coloring agent in the food industry and has antimicrobial and antioxidant properties. In this study, genetic algorithm-artificial neural network (GA-ANN) and adaptive neuro-fuzzy inference system (ANFIS) models were used to predict the effect of annatto dye on Salmonella enteritidis in mayonnaise. The GA-ANN and ANFIS were fed with 3 inputs of annatto dye concentration (0, 0.1, 0.2 and 0.4%), storage temperature (4 and 25°C) and storage time (1-20 days) for prediction of S. enteritidis population. Both models were trained with experimental data. The results showed that the annatto dye was able to reduce of S. enteritidis and its effect was stronger at 25°C than 4°C. The developed GA-ANN, which included 8 hidden neurons, could predict S. enteritidis population with correlation coefficient of 0.999. The overall agreement between ANFIS predictions and experimental data was also very good (r=0.998). Sensitivity analysis results showed that storage temperature was the most sensitive factor for prediction of S. enteritidis population. Copyright © 2014 Elsevier Ltd. All rights reserved.
Directory of Open Access Journals (Sweden)
Faa-Jeng Lin
2014-01-01
Full Text Available This study presents a new active and reactive power control scheme for a single-stage three-phase grid-connected photovoltaic (PV system during grid faults. The presented PV system utilizes a single-stage three-phase current-controlled voltage-source inverter to achieve the maximum power point tracking (MPPT control of the PV panel with the function of low voltage ride through (LVRT. Moreover, a formula based on positive sequence voltage for evaluating the percentage of voltage sag is derived to determine the ratio of the injected reactive current to satisfy the LVRT regulations. To reduce the risk of overcurrent during LVRT operation, a current limit is predefined for the injection of reactive current. Furthermore, the control of active and reactive power is designed using a two-dimensional recurrent fuzzy cerebellar model articulation neural network (2D-RFCMANN. In addition, the online learning laws of 2D-RFCMANN are derived according to gradient descent method with varied learning-rate coefficients for network parameters to assure the convergence of the tracking error. Finally, some experimental tests are realized to validate the effectiveness of the proposed control scheme.
Neural systems for choice and valuation with counterfactual learning signals.
Tobia, M J; Guo, R; Schwarze, U; Boehmer, W; Gläscher, J; Finckh, B; Marschner, A; Büchel, C; Obermayer, K; Sommer, T
2014-04-01
The purpose of this experiment was to test a computational model of reinforcement learning with and without fictive prediction error (FPE) signals to investigate how counterfactual consequences contribute to acquired representations of action-specific expected value, and to determine the functional neuroanatomy and neuromodulator systems that are involved. 80 male participants underwent dietary depletion of either tryptophan or tyrosine/phenylalanine to manipulate serotonin (5HT) and dopamine (DA), respectively. They completed 80 rounds (240 trials) of a strategic sequential investment task that required accepting interim losses in order to access a lucrative state and maximize long-term gains, while being scanned. We extended the standard Q-learning model by incorporating both counterfactual gains and losses into separate error signals. The FPE model explained the participants' data significantly better than a model that did not include counterfactual learning signals. Expected value from the FPE model was significantly correlated with BOLD signal change in the ventromedial prefrontal cortex (vmPFC) and posterior orbitofrontal cortex (OFC), whereas expected value from the standard model did not predict changes in neural activity. The depletion procedure revealed significantly different neural responses to expected value in the vmPFC, caudate, and dopaminergic midbrain in the vicinity of the substantia nigra (SN). Differences in neural activity were not evident in the standard Q-learning computational model. These findings demonstrate that FPE signals are an important component of valuation for decision making, and that the neural representation of expected value incorporates cortical and subcortical structures via interactions among serotonergic and dopaminergic modulator systems. Copyright © 2013 Elsevier Inc. All rights reserved.
An integrated modelling framework for neural circuits with multiple neuromodulators.
Joshi, Alok; Youssofzadeh, Vahab; Vemana, Vinith; McGinnity, T M; Prasad, Girijesh; Wong-Lin, KongFatt
2017-01-01
Neuromodulators are endogenous neurochemicals that regulate biophysical and biochemical processes, which control brain function and behaviour, and are often the targets of neuropharmacological drugs. Neuromodulator effects are generally complex partly owing to the involvement of broad innervation, co-release of neuromodulators, complex intra- and extrasynaptic mechanism, existence of multiple receptor subtypes and high interconnectivity within the brain. In this work, we propose an efficient yet sufficiently realistic computational neural modelling framework to study some of these complex behaviours. Specifically, we propose a novel dynamical neural circuit model that integrates the effective neuromodulator-induced currents based on various experimental data (e.g. electrophysiology, neuropharmacology and voltammetry). The model can incorporate multiple interacting brain regions, including neuromodulator sources, simulate efficiently and easily extendable to large-scale brain models, e.g. for neuroimaging purposes. As an example, we model a network of mutually interacting neural populations in the lateral hypothalamus, dorsal raphe nucleus and locus coeruleus, which are major sources of neuromodulator orexin/hypocretin, serotonin and norepinephrine/noradrenaline, respectively, and which play significant roles in regulating many physiological functions. We demonstrate that such a model can provide predictions of systemic drug effects of the popular antidepressants (e.g. reuptake inhibitors), neuromodulator antagonists or their combinations. Finally, we developed user-friendly graphical user interface software for model simulation and visualization for both fundamental sciences and pharmacological studies. © 2017 The Authors.
Short-Term Load Forecasting Model Based on Quantum Elman Neural Networks
Directory of Open Access Journals (Sweden)
Zhisheng Zhang
2016-01-01
Full Text Available Short-term load forecasting model based on quantum Elman neural networks was constructed in this paper. The quantum computation and Elman feedback mechanism were integrated into quantum Elman neural networks. Quantum computation can effectively improve the approximation capability and the information processing ability of the neural networks. Quantum Elman neural networks have not only the feedforward connection but also the feedback connection. The feedback connection between the hidden nodes and the context nodes belongs to the state feedback in the internal system, which has formed specific dynamic memory performance. Phase space reconstruction theory is the theoretical basis of constructing the forecasting model. The training samples are formed by means of K-nearest neighbor approach. Through the example simulation, the testing results show that the model based on quantum Elman neural networks is better than the model based on the quantum feedforward neural network, the model based on the conventional Elman neural network, and the model based on the conventional feedforward neural network. So the proposed model can effectively improve the prediction accuracy. The research in the paper makes a theoretical foundation for the practical engineering application of the short-term load forecasting model based on quantum Elman neural networks.
Modeling Broadband Microwave Structures by Artificial Neural Networks
Directory of Open Access Journals (Sweden)
V. Otevrel
2004-06-01
Full Text Available The paper describes the exploitation of feed-forward neural networksand recurrent neural networks for replacing full-wave numerical modelsof microwave structures in complex microwave design tools. Building aneural model, attention is turned to the modeling accuracy and to theefficiency of building a model. Dealing with the accuracy, we describea method of increasing it by successive completing a training set.Neural models are mutually compared in order to highlight theiradvantages and disadvantages. As a reference model for comparisons,approximations based on standard cubic splines are used. Neural modelsare used to replace both the time-domain numeric models and thefrequency-domain ones.
Adaptive model predictive process control using neural networks
Buescher, K.L.; Baum, C.C.; Jones, R.D.
1997-08-19
A control system for controlling the output of at least one plant process output parameter is implemented by adaptive model predictive control using a neural network. An improved method and apparatus provides for sampling plant output and control input at a first sampling rate to provide control inputs at the fast rate. The MPC system is, however, provided with a network state vector that is constructed at a second, slower rate so that the input control values used by the MPC system are averaged over a gapped time period. Another improvement is a provision for on-line training that may include difference training, curvature training, and basis center adjustment to maintain the weights and basis centers of the neural in an updated state that can follow changes in the plant operation apart from initial off-line training data. 46 figs.
On the Computational Power of Spiking Neural P Systems with Self-Organization
Wang, Xun; Song, Tao; Gong, Faming; Zheng, Pan
2016-06-01
Neural-like computing models are versatile computing mechanisms in the field of artificial intelligence. Spiking neural P systems (SN P systems for short) are one of the recently developed spiking neural network models inspired by the way neurons communicate. The communications among neurons are essentially achieved by spikes, i. e. short electrical pulses. In terms of motivation, SN P systems fall into the third generation of neural network models. In this study, a novel variant of SN P systems, namely SN P systems with self-organization, is introduced, and the computational power of the system is investigated and evaluated. It is proved that SN P systems with self-organization are capable of computing and accept the family of sets of Turing computable natural numbers. Moreover, with 87 neurons the system can compute any Turing computable recursive function, thus achieves Turing universality. These results demonstrate promising initiatives to solve an open problem arisen by Gh Păun.
DEFF Research Database (Denmark)
Kooths, Stefan; Mitze, Timo Friedel; Ringhut, Eric
2004-01-01
This paper compares the predictive power of linear econometric and non-linear computational models for forecasting the inflation rate in the European Monetary Union (EMU). Various models of both types are developed using different monetary and real activity indicators. They are compared according...
Directory of Open Access Journals (Sweden)
C. Si-Moussa
2008-03-01
Full Text Available Artificial neural networks are applied to high-pressure vapor liquid equilibrium (VLE related literature data to develop and validate a model capable of predicting VLE of six CO2-ester binaries (CO2-ethyl caprate, CO2-ethyl caproate, CO2-ethyl caprylate, CO2-diethyl carbonate, CO2-ethyl butyrate and CO2-isopropyl acetate. A feed forward, back propagation network is used with one hidden layer. The model has five inputs (two intensive state variables and three pure ester properties and two outputs (two intensive state variables.The network is systematically trained with 112 data points in the temperature and pressure ranges (308.2-328.2 K, (1.665-9.218 MPa respectively and is validated with 56 data points in the temperature range (308.2-328.2 K. Different combinations of network architecture and training algorithms are studied. The training and validation strategy is focused on the use of a validation agreement vector, determined from linear regression analysis of the plots of the predicted versus experimental outputs, as an indication of the predictive ability of the neural network model. Statistical analyses of the predictability of the optimised neural network model show excellent agreement with experimental data (a coefficient of correlation equal to 0.9995 and 0.9886, and a root mean square error equal to 0.0595 and 0.00032 for the predicted equilibrium pressure and CO2 vapor phase composition respectively. Furthermore, the comparison in terms of average absolute relative deviation between the predicted results for each binary for the whole temperature range and literature results predicted by some cubic equation of state with various mixing rules and excess Gibbs energy models shows that the artificial neural network model gives far better results.
Current approaches to model extracellular electrical neural microstimulation
Directory of Open Access Journals (Sweden)
Sébastien eJoucla
2014-02-01
Full Text Available Nowadays, high-density microelectrode arrays provide unprecedented possibilities to precisely activate spatially well-controlled central nervous system (CNS areas. However, this requires optimizing stimulating devices, which in turn requires a good understanding of the effects of microstimulation on cells and tissues. In this context, modeling approaches provide flexible ways to predict the outcome of electrical stimulation in terms of CNS activation. In this paper, we present state-of-the-art modeling methods with sufficient details to allow the reader to rapidly build numerical models of neuronal extracellular microstimulation. These include 1 the computation of the electrical potential field created by the stimulation in the tissue, and 2 the response of a target neuron to this field. Two main approaches are described: First we describe the classical hybrid approach that combines the finite element modeling of the potential field with the calculation of the neuron’s response in a cable equation framework (compartmentalized neuron models. Then, we present a whole finite element approach allows the simultaneous calculation of the extracellular and intracellular potentials, by representing the neuronal membrane with a thin-film approximation. This approach was previously introduced in the frame of neural recording, but has never been implemented to determine the effect of extracellular stimulation on the neural response at a sub-compartment level. Here, we show on an example that the latter modeling scheme can reveal important sub-compartment behavior of the neural membrane that cannot be resolved using the hybrid approach. The goal of this paper is also to describe in detail the practical implementation of these methods to allow the reader to easily build new models using standard software packages. These modeling paradigms, depending on the situation, should help build more efficient high-density neural prostheses for CNS rehabilitation.
Neural Network Model of memory retrieval
Directory of Open Access Journals (Sweden)
Stefano eRecanatesi
2015-12-01
Full Text Available Human memory can store large amount of information. Nevertheless, recalling is often achallenging task. In a classical free recall paradigm, where participants are asked to repeat abriefly presented list of words, people make mistakes for lists as short as 5 words. We present amodel for memory retrieval based on a Hopfield neural network where transition between itemsare determined by similarities in their long-term memory representations. Meanfield analysis ofthe model reveals stable states of the network corresponding (1 to single memory representationsand (2 intersection between memory representations. We show that oscillating feedback inhibitionin the presence of noise induces transitions between these states triggering the retrieval ofdifferent memories. The network dynamics qualitatively predicts the distribution of time intervalsrequired to recall new memory items observed in experiments. It shows that items having largernumber of neurons in their representation are statistically easier to recall and reveals possiblebottlenecks in our ability of retrieving memories. Overall, we propose a neural network model ofinformation retrieval broadly compatible with experimental observations and is consistent with ourrecent graphical model (Romani et al., 2013.
Automated Modeling of Microwave Structures by Enhanced Neural Networks
Directory of Open Access Journals (Sweden)
Z. Raida
2006-12-01
Full Text Available The paper describes the methodology of the automated creation of neural models of microwave structures. During the creation process, artificial neural networks are trained using the combination of the particle swarm optimization and the quasi-Newton method to avoid critical training problems of the conventional neural nets. In the paper, neural networks are used to approximate the behavior of a planar microwave filter (moment method, Zeland IE3D. In order to evaluate the efficiency of neural modeling, global optimizations are performed using numerical models and neural ones. Both approaches are compared from the viewpoint of CPU-time demands and the accuracy. Considering conclusions, methodological recommendations for including neural networks to the microwave design are formulated.
Extended Neural Metastability in an Embodied Model of Sensorimotor Coupling
Aguilera, Miguel; Bedia, Manuel G.; Barandiaran, Xabier E.
2016-01-01
The hypothesis that brain organization is based on mechanisms of metastable synchronization in neural assemblies has been popularized during the last decades of neuroscientific research. Nevertheless, the role of body and environment for understanding the functioning of metastable assemblies is frequently dismissed. The main goal of this paper is to investigate the contribution of sensorimotor coupling to neural and behavioral metastability using a minimal computational model of plastic neural ensembles embedded in a robotic agent in a behavioral preference task. Our hypothesis is that, under some conditions, the metastability of the system is not restricted to the brain but extends to the system composed by the interaction of brain, body and environment. We test this idea, comparing an agent in continuous interaction with its environment in a task demanding behavioral flexibility with an equivalent model from the point of view of “internalist neuroscience.” A statistical characterization of our model and tools from information theory allow us to show how (1) the bidirectional coupling between agent and environment brings the system closer to a regime of criticality and triggers the emergence of additional metastable states which are not found in the brain in isolation but extended to the whole system of sensorimotor interaction, (2) the synaptic plasticity of the agent is fundamental to sustain open structures in the neural controller of the agent flexibly engaging and disengaging different behavioral patterns that sustain sensorimotor metastable states, and (3) these extended metastable states emerge when the agent generates an asymmetrical circular loop of causal interaction with its environment, in which the agent responds to variability of the environment at fast timescales while acting over the environment at slow timescales, suggesting the constitution of the agent as an autonomous entity actively modulating its sensorimotor coupling with the world. We
Convergent evolution of neural systems in ctenophores.
Moroz, Leonid L
2015-02-15
Neurons are defined as polarized secretory cells specializing in directional propagation of electrical signals leading to the release of extracellular messengers - features that enable them to transmit information, primarily chemical in nature, beyond their immediate neighbors without affecting all intervening cells en route. Multiple origins of neurons and synapses from different classes of ancestral secretory cells might have occurred more than once during ~600 million years of animal evolution with independent events of nervous system centralization from a common bilaterian/cnidarian ancestor without the bona fide central nervous system. Ctenophores, or comb jellies, represent an example of extensive parallel evolution in neural systems. First, recent genome analyses place ctenophores as a sister group to other animals. Second, ctenophores have a smaller complement of pan-animal genes controlling canonical neurogenic, synaptic, muscle and immune systems, and developmental pathways than most other metazoans. However, comb jellies are carnivorous marine animals with a complex neuromuscular organization and sophisticated patterns of behavior. To sustain these functions, they have evolved a number of unique molecular innovations supporting the hypothesis of massive homoplasies in the organization of integrative and locomotory systems. Third, many bilaterian/cnidarian neuron-specific genes and 'classical' neurotransmitter pathways are either absent or, if present, not expressed in ctenophore neurons (e.g. the bilaterian/cnidarian neurotransmitter, γ-amino butyric acid or GABA, is localized in muscles and presumed bilaterian neuron-specific RNA-binding protein Elav is found in non-neuronal cells). Finally, metabolomic and pharmacological data failed to detect either the presence or any physiological action of serotonin, dopamine, noradrenaline, adrenaline, octopamine, acetylcholine or histamine - consistent with the hypothesis that ctenophore neural systems evolved
Neural Computations in a Dynamical System with Multiple Time Scales
Mi, Yuanyuan; Lin, Xiaohan; Wu, Si
2016-01-01
Neural systems display rich short-term dynamics at various levels, e.g., spike-frequency adaptation (SFA) at the single-neuron level, and short-term facilitation (STF) and depression (STD) at the synapse level. These dynamical features typically cover a broad range of time scales and exhibit large diversity in different brain regions. It remains unclear what is the computational benefit for the brain to have such variability in short-term dynamics. In this study, we propose that the brain can exploit such dynamical features to implement multiple seemingly contradictory computations in a single neural circuit. To demonstrate this idea, we use continuous attractor neural network (CANN) as a working model and include STF, SFA and STD with increasing time constants in its dynamics. Three computational tasks are considered, which are persistent activity, adaptation, and anticipative tracking. These tasks require conflicting neural mechanisms, and hence cannot be implemented by a single dynamical feature or any combination with similar time constants. However, with properly coordinated STF, SFA and STD, we show that the network is able to implement the three computational tasks concurrently. We hope this study will shed light on the understanding of how the brain orchestrates its rich dynamics at various levels to realize diverse cognitive functions. PMID:27679569
A neural network model for texture discrimination.
Xing, J; Gerstein, G L
1993-01-01
A model of texture discrimination in visual cortex was built using a feedforward network with lateral interactions among relatively realistic spiking neural elements. The elements have various membrane currents, equilibrium potentials and time constants, with action potentials and synapses. The model is derived from the modified programs of MacGregor (1987). Gabor-like filters are applied to overlapping regions in the original image; the neural network with lateral excitatory and inhibitory interactions then compares and adjusts the Gabor amplitudes in order to produce the actual texture discrimination. Finally, a combination layer selects and groups various representations in the output of the network to form the final transformed image material. We show that both texture segmentation and detection of texture boundaries can be represented in the firing activity of such a network for a wide variety of synthetic to natural images. Performance details depend most strongly on the global balance of strengths of the excitatory and inhibitory lateral interconnections. The spatial distribution of lateral connective strengths has relatively little effect. Detailed temporal firing activities of single elements in the lateral connected network were examined under various stimulus conditions. Results show (as in area 17 of cortex) that a single element's response to image features local to its receptive field can be altered by changes in the global context.
Evolutionary Computation and Its Applications in Neural and Fuzzy Systems
Directory of Open Access Journals (Sweden)
Biaobiao Zhang
2011-01-01
Full Text Available Neural networks and fuzzy systems are two soft-computing paradigms for system modelling. Adapting a neural or fuzzy system requires to solve two optimization problems: structural optimization and parametric optimization. Structural optimization is a discrete optimization problem which is very hard to solve using conventional optimization techniques. Parametric optimization can be solved using conventional optimization techniques, but the solution may be easily trapped at a bad local optimum. Evolutionary computation is a general-purpose stochastic global optimization approach under the universally accepted neo-Darwinian paradigm, which is a combination of the classical Darwinian evolutionary theory, the selectionism of Weismann, and the genetics of Mendel. Evolutionary algorithms are a major approach to adaptation and optimization. In this paper, we first introduce evolutionary algorithms with emphasis on genetic algorithms and evolutionary strategies. Other evolutionary algorithms such as genetic programming, evolutionary programming, particle swarm optimization, immune algorithm, and ant colony optimization are also described. Some topics pertaining to evolutionary algorithms are also discussed, and a comparison between evolutionary algorithms and simulated annealing is made. Finally, the application of EAs to the learning of neural networks as well as to the structural and parametric adaptations of fuzzy systems is also detailed.
Reversible neural stem cell niche dysfunction in a model of multiple sclerosis
DEFF Research Database (Denmark)
Rasmussen, Stine; Imitola, Jaime; Ayuso-Sacido, Angel
2011-01-01
OBJECTIVE: The subventricular zone (SVZ) of the brain constitutes a niche for neural stem and progenitor cells that can initiate repair after central nervous system (CNS) injury. In a relapsing-remitting model of experimental autoimmune encephalomyelitis (EAE), the neural stem cells (NSCs) become...
COMPUTER-SIMULATED NEURAL NETWORKS - AN APPROPRIATE MODEL FOR MOTOR DEVELOPMENT
VOS, JE; SCHEEPSTRA, KA
The idea of an artificial neural network is introduced in a historical context, and the essential aspect of it, viz., the modifiable synapse, is compared to the aspect of plasticity in the natural nervous system. Based on such an artificial neural network, a model is presented for the way in which
Spacecraft Neural Network Control System Design using FPGA
Hanaa T. El-Madany; Faten H. Fahmy; Ninet M. A. El-Rahman; Hassen T. Dorrah
2011-01-01
Designing and implementing intelligent systems has become a crucial factor for the innovation and development of better products of space technologies. A neural network is a parallel system, capable of resolving paradigms that linear computing cannot. Field programmable gate array (FPGA) is a digital device that owns reprogrammable properties and robust flexibility. For the neural network based instrument prototype in real time application, conventional specific VLSI neural chip design suffer...
Intelligent reservoir operation system based on evolving artificial neural networks
Chaves, Paulo; Chang, Fi-John
2008-06-01
We propose a novel intelligent reservoir operation system based on an evolving artificial neural network (ANN). Evolving means the parameters of the ANN model are identified by the GA evolutionary optimization technique. Accordingly, the ANN model should represent the operational strategies of reservoir operation. The main advantages of the Evolving ANN Intelligent System (ENNIS) are as follows: (i) only a small number of parameters to be optimized even for long optimization horizons, (ii) easy to handle multiple decision variables, and (iii) the straightforward combination of the operation model with other prediction models. The developed intelligent system was applied to the operation of the Shihmen Reservoir in North Taiwan, to investigate its applicability and practicability. The proposed method is first built to a simple formulation for the operation of the Shihmen Reservoir, with single objective and single decision. Its results were compared to those obtained by dynamic programming. The constructed network proved to be a good operational strategy. The method was then built and applied to the reservoir with multiple (five) decision variables. The results demonstrated that the developed evolving neural networks improved the operation performance of the reservoir when compared to its current operational strategy. The system was capable of successfully simultaneously handling various decision variables and provided reasonable and suitable decisions.
Woodward, Alexander; Froese, Tom; Ikegami, Takashi
2015-02-01
The state space of a conventional Hopfield network typically exhibits many different attractors of which only a small subset satisfies constraints between neurons in a globally optimal fashion. It has recently been demonstrated that combining Hebbian learning with occasional alterations of normal neural states avoids this problem by means of self-organized enlargement of the best basins of attraction. However, so far it is not clear to what extent this process of self-optimization is also operative in real brains. Here we demonstrate that it can be transferred to more biologically plausible neural networks by implementing a self-optimizing spiking neural network model. In addition, by using this spiking neural network to emulate a Hopfield network with Hebbian learning, we attempt to make a connection between rate-based and temporal coding based neural systems. Although further work is required to make this model more realistic, it already suggests that the efficacy of the self-optimizing process is independent from the simplifying assumptions of a conventional Hopfield network. We also discuss natural and cultural processes that could be responsible for occasional alteration of neural firing patterns in actual brains. Copyright © 2014 Elsevier Ltd. All rights reserved.
Nonlinear modeling of neural population dynamics for hippocampal prostheses.
Song, Dong; Chan, Rosa H M; Marmarelis, Vasilis Z; Hampson, Robert E; Deadwyler, Sam A; Berger, Theodore W
2009-11-01
Developing a neural prosthesis for the damaged hippocampus requires restoring the transformation of population neural activities performed by the hippocampal circuitry. To bypass a damaged region, output spike trains need to be predicted from the input spike trains and then reinstated through stimulation. We formulate a multiple-input, multiple-output (MIMO) nonlinear dynamic model for the input-output transformation of spike trains. In this approach, a MIMO model comprises a series of physiologically-plausible multiple-input, single-output (MISO) neuron models that consist of five components each: (1) feedforward Volterra kernels transforming the input spike trains into the synaptic potential, (2) a feedback kernel transforming the output spikes into the spike-triggered after-potential, (3) a noise term capturing the system uncertainty, (4) an adder generating the pre-threshold potential, and (5) a threshold function generating output spikes. It is shown that this model is equivalent to a generalized linear model with a probit link function. To reduce model complexity and avoid overfitting, statistical model selection and cross-validation methods are employed to choose the significant inputs and interactions between inputs. The model is applied successfully to the hippocampal CA3-CA1 population dynamics. Such a model can serve as a computational basis for the development of hippocampal prostheses.
A simple mechanical system for studying adaptive oscillatory neural networks
DEFF Research Database (Denmark)
Jouffroy, Guillaume; Jouffroy, Jerome
model, etc.) might be too complex to study. In this paper, we use a comparatively simple mechanical system, the nonholonomic vehicle referred to as the Roller-Racer, as a means towards testing different learning strategies for an Recurrent Neural Network-based (RNN) controller/guidance system. After...... a brief description of the Roller-Racer, we present as a preliminary study an RNN-based feed-forward controller whose parameters are obtained through the well-known teacher forcing learning algorithm, extended to learn signals with a continuous component....
Neural Networks for Modeling and Control of Particle Accelerators
Edelen, A.L.; Chase, B.E.; Edstrom, D.; Milton, S.V.; Stabile, P.
2016-01-01
We describe some of the challenges of particle accelerator control, highlight recent advances in neural network techniques, discuss some promising avenues for incorporating neural networks into particle accelerator control systems, and describe a neural network-based control system that is being developed for resonance control of an RF electron gun at the Fermilab Accelerator Science and Technology (FAST) facility, including initial experimental results from a benchmark controller.
Corner, Michael A
2013-05-22
In the early 1960s intrinsically generated widespread neuronal discharges were discovered to be the basis for the earliest motor behavior throughout the animal kingdom. The pattern generating system is in fact programmed into the developing nervous system, in a regionally specific manner, already at the early neural plate stage. Such rhythmically modulated phasic bursts were next discovered to be a general feature of developing neural networks and, largely on the basis of experimental interventions in cultured neural tissues, to contribute significantly to their morpho-physiological maturation. In particular, the level of spontaneous synchronized bursting is homeostatically regulated, and has the effect of constraining the development of excessive network excitability. After birth or hatching, this "slow-wave" activity pattern becomes sporadically suppressed in favor of sensory oriented "waking" behaviors better adapted to dealing with environmental contingencies. It nevertheless reappears periodically as "sleep" at several species-specific points in the diurnal/nocturnal cycle. Although this "default" behavior pattern evolves with development, its essential features are preserved throughout the life cycle, and are based upon a few simple mechanisms which can be both experimentally demonstrated and simulated by computer modeling. In contrast, a late onto- and phylogenetic aspect of sleep, viz., the intermittent "paradoxical" activation of the forebrain so as to mimic waking activity, is much less well understood as regards its contribution to brain development. Some recent findings dealing with this question by means of cholinergically induced "aroused" firing patterns in developing neocortical cell cultures, followed by quantitative electrophysiological assays of immediate and longterm sequelae, will be discussed in connection with their putative implications for sleep ontogeny.
Heddam, Salim
2014-01-01
In this study, we present application of an artificial intelligence (AI) technique model called dynamic evolving neural-fuzzy inference system (DENFIS) based on an evolving clustering method (ECM), for modelling dissolved oxygen concentration in a river. To demonstrate the forecasting capability of DENFIS, a one year period from 1 January 2009 to 30 December 2009, of hourly experimental water quality data collected by the United States Geological Survey (USGS Station No: 420853121505500) station at Klamath River at Miller Island Boat Ramp, OR, USA, were used for model development. Two DENFIS-based models are presented and compared. The two DENFIS systems are: (1) offline-based system named DENFIS-OF, and (2) online-based system, named DENFIS-ON. The input variables used for the two models are water pH, temperature, specific conductance, and sensor depth. The performances of the models are evaluated using root mean square errors (RMSE), mean absolute error (MAE), Willmott index of agreement (d) and correlation coefficient (CC) statistics. The lowest root mean square error and highest correlation coefficient values were obtained with the DENFIS-ON method. The results obtained with DENFIS models are compared with linear (multiple linear regression, MLR) and nonlinear (multi-layer perceptron neural networks, MLPNN) methods. This study demonstrates that DENFIS-ON investigated herein outperforms all the proposed techniques for DO modelling.
Research on quasi-dynamic calibration model of plastic sensitive element based on neural networks
Wang, Fang; Kong, Deren; Yang, Lixia; Zhang, Zouzou
2017-08-01
Quasi-dynamic calibration accuracy of the plastic sensitive element depends on the accuracy of the fitting model between pressure and deformation. By using the excellent nonlinear mapping ability of RBF (Radial Basis Function) neural network, a calibration model is established which use the peak pressure as the input and use the deformation of the plastic sensitive element as the output in this paper. The calibration experiments of a batch of copper cylinders are carried out on the quasi-dynamic pressure calibration device, which pressure range is within the range of 200MPa to 700MPa. The experiment data are acquired according to the standard pressure monitoring system. The network train and study are done to quasi dynamic calibration model based on neural network by using MATLAB neural network toolbox. Taking the testing samples as the research object, the prediction accuracy of neural network model is compared with the exponential fitting model and the second-order polynomial fitting model. The results show that prediction of the neural network model is most close to the testing samples, and the accuracy of prediction model based on neural network is better than 0.5%, respectively one order higher than the second-order polynomial fitting model and two orders higher than the exponential fitting model. The quasi-dynamic calibration model between pressure peak and deformation of plastic sensitive element, which is based on neural network, provides important basis for creating higher accuracy quasi-dynamic calibration table.
Bio-Inspired Neural Model for Learning Dynamic Models
Duong, Tuan; Duong, Vu; Suri, Ronald
2009-01-01
A neural-network mathematical model that, relative to prior such models, places greater emphasis on some of the temporal aspects of real neural physical processes, has been proposed as a basis for massively parallel, distributed algorithms that learn dynamic models of possibly complex external processes by means of learning rules that are local in space and time. The algorithms could be made to perform such functions as recognition and prediction of words in speech and of objects depicted in video images. The approach embodied in this model is said to be "hardware-friendly" in the following sense: The algorithms would be amenable to execution by special-purpose computers implemented as very-large-scale integrated (VLSI) circuits that would operate at relatively high speeds and low power demands.
Artificial Neural Network System for Thyroid Diagnosis
Directory of Open Access Journals (Sweden)
Mazin Abdulrasool Hameed
2017-05-01
Full Text Available Thyroid disease is one of major causes of severe medical problems for human beings. Therefore, proper diagnosis of thyroid disease is considered as an important issue to determine treatment for patients. This paper focuses on using Artificial Neural Network (ANN as a significant technique of artificial intelligence to diagnose thyroid diseases. The continuous values of three laboratory blood tests are used as input signals to the proposed system of ANN. All types of thyroid diseases that may occur in patients are taken into account in design of system, as well as the high accuracy of the detection and categorization of thyroid diseases are considered in the system. A multilayer feedforward architecture of ANN is adopted in the proposed design, and the back propagation is selected as learning algorithm to accomplish the training process. The result of this research shows that the proposed ANN system is able to precisely diagnose thyroid disease, and can be exploited in practical uses. The system is simulated via MATLAB software to evaluate its performance
A case for spiking neural network simulation based on configurable multiple-FPGA systems.
Yang, Shufan; Wu, Qiang; Li, Renfa
2011-09-01
Recent neuropsychological research has begun to reveal that neurons encode information in the timing of spikes. Spiking neural network simulations are a flexible and powerful method for investigating the behaviour of neuronal systems. Simulation of the spiking neural networks in software is unable to rapidly generate output spikes in large-scale of neural network. An alternative approach, hardware implementation of such system, provides the possibility to generate independent spikes precisely and simultaneously output spike waves in real time, under the premise that spiking neural network can take full advantage of hardware inherent parallelism. We introduce a configurable FPGA-oriented hardware platform for spiking neural network simulation in this work. We aim to use this platform to combine the speed of dedicated hardware with the programmability of software so that it might allow neuroscientists to put together sophisticated computation experiments of their own model. A feed-forward hierarchy network is developed as a case study to describe the operation of biological neural systems (such as orientation selectivity of visual cortex) and computational models of such systems. This model demonstrates how a feed-forward neural network constructs the circuitry required for orientation selectivity and provides platform for reaching a deeper understanding of the primate visual system. In the future, larger scale models based on this framework can be used to replicate the actual architecture in visual cortex, leading to more detailed predictions and insights into visual perception phenomenon.
Assessment of neural networks performance in modeling rainfall ...
African Journals Online (AJOL)
This paper presents the evaluation of performance of Neural Network (NN) model in predicting the behavioral pattern of rainfall depths of some locations in the North Central zones of Nigeria. The input to the model is the consecutive rainfall depths data obtained from the Nigerian Meteorological (NiMET) Agency. The neural ...
Artificial Neural Network Modeling of an Inverse Fluidized Bed ...
African Journals Online (AJOL)
MICHAEL
modeling of the inverse fluidized bed reactor. In the proposed model, the trained neural network represents the kinetics of biological decomposition of pollutants in the reactor. The neural network has been trained with experimental data obtained from an inverse fluidized bed reactor treating the starch industry wastewater.
A Bayesian framework for simultaneously modeling neural and behavioral data.
Turner, Brandon M; Forstmann, Birte U; Wagenmakers, Eric-Jan; Brown, Scott D; Sederberg, Per B; Steyvers, Mark
2013-05-15
Scientists who study cognition infer underlying processes either by observing behavior (e.g., response times, percentage correct) or by observing neural activity (e.g., the BOLD response). These two types of observations have traditionally supported two separate lines of study. The first is led by cognitive modelers, who rely on behavior alone to support their computational theories. The second is led by cognitive neuroimagers, who rely on statistical models to link patterns of neural activity to experimental manipulations, often without any attempt to make a direct connection to an explicit computational theory. Here we present a flexible Bayesian framework for combining neural and cognitive models. Joining neuroimaging and computational modeling in a single hierarchical framework allows the neural data to influence the parameters of the cognitive model and allows behavioral data, even in the absence of neural data, to constrain the neural model. Critically, our Bayesian approach can reveal interactions between behavioral and neural parameters, and hence between neural activity and cognitive mechanisms. We demonstrate the utility of our approach with applications to simulated fMRI data with a recognition model and to diffusion-weighted imaging data with a response time model of perceptual choice. Copyright © 2013 Elsevier Inc. All rights reserved.
A Bayesian framework for simultaneously modeling neural and behavioral data✩
Turner, Brandon M.; Forstmann, Birte U.; Wagenmakers, Eric-Jan; Brown, Scott D.; Sederberg, Per B.; Steyvers, Mark
2013-01-01
Scientists who study cognition infer underlying processes either by observing behavior (e.g., response times, percentage correct) or by observing neural activity (e.g., the BOLD response). These two types of observations have traditionally supported two separate lines of study. The first is led by cognitive modelers, who rely on behavior alone to support their computational theories. The second is led by cognitive neuroimagers, who rely on statistical models to link patterns of neural activity to experimental manipulations, often without any attempt to make a direct connection to an explicit computational theory. Here we present a flexible Bayesian framework for combining neural and cognitive models. Joining neuroimaging and computational modeling in a single hierarchical framework allows the neural data to influence the parameters of the cognitive model and allows behavioral data, even in the absence of neural data, to constrain the neural model. Critically, our Bayesian approach can reveal interactions between behavioral and neural parameters, and hence between neural activity and cognitive mechanisms. We demonstrate the utility of our approach with applications to simulated fMRI data with a recognition model and to diffusion-weighted imaging data with a response time model of perceptual choice. PMID:23370060
Engineering neural systems for high-level problem solving.
Sylvester, Jared; Reggia, James
2016-07-01
There is a long-standing, sometimes contentious debate in AI concerning the relative merits of a symbolic, top-down approach vs. a neural, bottom-up approach to engineering intelligent machine behaviors. While neurocomputational methods excel at lower-level cognitive tasks (incremental learning for pattern classification, low-level sensorimotor control, fault tolerance and processing of noisy data, etc.), they are largely non-competitive with top-down symbolic methods for tasks involving high-level cognitive problem solving (goal-directed reasoning, metacognition, planning, etc.). Here we take a step towards addressing this limitation by developing a purely neural framework named galis. Our goal in this work is to integrate top-down (non-symbolic) control of a neural network system with more traditional bottom-up neural computations. galis is based on attractor networks that can be "programmed" with temporal sequences of hand-crafted instructions that control problem solving by gating the activity retention of, communication between, and learning done by other neural networks. We demonstrate the effectiveness of this approach by showing that it can be applied successfully to solve sequential card matching problems, using both human performance and a top-down symbolic algorithm as experimental controls. Solving this kind of problem makes use of top-down attention control and the binding together of visual features in ways that are easy for symbolic AI systems but not for neural networks to achieve. Our model can not only be instructed on how to solve card matching problems successfully, but its performance also qualitatively (and sometimes quantitatively) matches the performance of both human subjects that we had perform the same task and the top-down symbolic algorithm that we used as an experimental control. We conclude that the core principles underlying the galis framework provide a promising approach to engineering purely neurocomputational systems for problem
Neural Network for Optimization of Existing Control Systems
DEFF Research Database (Denmark)
Madsen, Per Printz
1995-01-01
The purpose of this paper is to develop methods to use Neural Network based Controllers (NNC) as an optimization tool for existing control systems.......The purpose of this paper is to develop methods to use Neural Network based Controllers (NNC) as an optimization tool for existing control systems....
Fault diagnosis in satellite attitude control systems using artificial neural networkk
Ayodele I., Olanipekun
The nonlinear behavior exhibited by altitude control system processes and also the presence of external constraints on the operating conditions causes hitch in the dynamics of system processes. This research work proposes a fault detection/tolerant prediction in an altitude control system. This is done through the artificial neural network fault detection by deploying the neural network approach. A fault detection and isolation module is developed in the actuator system of the Altitude Control System, thereby achieving the goal of this thesis. This can be done by two basic classification stages: Neural Residual Generator (Neural Observer)- This stage is responsible for generating residual errors that can reflect the real behavior of the entire process as against its normal conditions. Adaptive Neural Classifier - This stage is responsible for managing the isolation task of the fault detected by evaluating the generated residual errors from the neural estimator which gives detailed information about faults detected e.g., fault location and time. These two stages can be implemented by executing the tasks listed below: 1. Study and develop a generic three axis stabilized altitude control model based on the reaction wheels. This is established with three separate PD controllers designed for each reaction wheel of the satellite axis using the Matlab - SIMULINK. 2. Develop a dynamic neural network residual generator based on Dynamic Multilayer Perceptron Network (DMLP) which is then applied to the reaction wheel model designed commonly called the actuator in the altitude control system of a satellite 3. Develop a neural network adaptive classifier based on the Learning Vector Quantization (LVQ) model which is used for the isolation concept. The advantages of the proposed dynamic neural network and neural adaptive classifier approach are showcased.
Artificial neural network modeling of p-cresol photodegradation.
Abdollahi, Yadollah; Zakaria, Azmi; Abbasiyannejad, Mina; Masoumi, Hamid Reza Fard; Moghaddam, Mansour Ghaffari; Matori, Khamirul Amin; Jahangirian, Hossein; Keshavarzi, Ashkan
2013-06-03
The complexity of reactions and kinetic is the current problem of photodegradation processes. Recently, artificial neural networks have been widely used to solve the problems because of their reliable, robust, and salient characteristics in capturing the non-linear relationships between variables in complex systems. In this study, an artificial neural network was applied for modeling p-cresol photodegradation. To optimize the network, the independent variables including irradiation time, pH, photocatalyst amount and concentration of p-cresol were used as the input parameters, while the photodegradation% was selected as output. The photodegradation% was obtained from the performance of the experimental design of the variables under UV irradiation. The network was trained by Quick propagation (QP) and the other three algorithms as a model. To determine the number of hidden layer nodes in the model, the root mean squared error of testing set was minimized. After minimizing the error, the topologies of the algorithms were compared by coefficient of determination and absolute average deviation. The comparison indicated that the Quick propagation algorithm had minimum root mean squared error, 1.3995, absolute average deviation, 3.0478, and maximum coefficient of determination, 0.9752, for the testing data set. The validation test results of the artificial neural network based on QP indicated that the root mean squared error was 4.11, absolute average deviation was 8.071 and the maximum coefficient of determination was 0.97. Artificial neural network based on Quick propagation algorithm with topology 4-10-1 gave the best performance in this study.
Neural Network Based Intrusion Detection System for Critical Infrastructures
Energy Technology Data Exchange (ETDEWEB)
Todd Vollmer; Ondrej Linda; Milos Manic
2009-07-01
Resiliency and security in control systems such as SCADA and Nuclear plant’s in today’s world of hackers and malware are a relevant concern. Computer systems used within critical infrastructures to control physical functions are not immune to the threat of cyber attacks and may be potentially vulnerable. Tailoring an intrusion detection system to the specifics of critical infrastructures can significantly improve the security of such systems. The IDS-NNM – Intrusion Detection System using Neural Network based Modeling, is presented in this paper. The main contributions of this work are: 1) the use and analyses of real network data (data recorded from an existing critical infrastructure); 2) the development of a specific window based feature extraction technique; 3) the construction of training dataset using randomly generated intrusion vectors; 4) the use of a combination of two neural network learning algorithms – the Error-Back Propagation and Levenberg-Marquardt, for normal behavior modeling. The presented algorithm was evaluated on previously unseen network data. The IDS-NNM algorithm proved to be capable of capturing all intrusion attempts presented in the network communication while not generating any false alerts.
Neural Net Gains Estimation Based on an Equivalent Model
Directory of Open Access Journals (Sweden)
Karen Alicia Aguilar Cruz
2016-01-01
Full Text Available A model of an Equivalent Artificial Neural Net (EANN describes the gains set, viewed as parameters in a layer, and this consideration is a reproducible process, applicable to a neuron in a neural net (NN. The EANN helps to estimate the NN gains or parameters, so we propose two methods to determine them. The first considers a fuzzy inference combined with the traditional Kalman filter, obtaining the equivalent model and estimating in a fuzzy sense the gains matrix A and the proper gain K into the traditional filter identification. The second develops a direct estimation in state space, describing an EANN using the expected value and the recursive description of the gains estimation. Finally, a comparison of both descriptions is performed; highlighting the analytical method describes the neural net coefficients in a direct form, whereas the other technique requires selecting into the Knowledge Base (KB the factors based on the functional error and the reference signal built with the past information of the system.
Computational models of the neural control of breathing.
Molkov, Yaroslav I; Rubin, Jonathan E; Rybak, Ilya A; Smith, Jeffrey C
2017-03-01
The ongoing process of breathing underlies the gas exchange essential for mammalian life. Each respiratory cycle ensues from the activity of rhythmic neural circuits in the brainstem, shaped by various modulatory signals, including mechanoreceptor feedback sensitive to lung inflation and chemoreceptor feedback dependent on gas composition in blood and tissues. This paper reviews a variety of computational models designed to reproduce experimental findings related to the neural control of breathing and generate predictions for future experimental testing. The review starts from the description of the core respiratory network in the brainstem, representing the central pattern generator (CPG) responsible for producing rhythmic respiratory activity, and progresses to encompass additional complexities needed to simulate different metabolic challenges, closed-loop feedback control including the lungs, and interactions between the respiratory and autonomic nervous systems. The integrated models considered in this review share a common framework including a distributed CPG core network responsible for generating the baseline three-phase pattern of rhythmic neural activity underlying normal breathing. WIREs Syst Biol Med 2017, 9:e1371. doi: 10.1002/wsbm.1371 For further resources related to this article, please visit the WIREs website. © 2016 Wiley Periodicals, Inc.
Optical Neural Network Models Applied To Logic Program Execution
Stormon, Charles D.
1988-05-01
Logic programming is being used extensively by Artificial Intelligence researchers to solve problems including natural language processing and expert systems. These languages, of which Prolog is the most widely used, promise to revolutionize software engineering, but much greater performance is needed. Researchers have demonstrated the applicability of neural network models to the solution of certain NP-complete problems, but these methods are not obviously applicable to the execution of logic programs. This paper outlines the use of neural networks in four aspects of the logic program execution cycle, and discusses results of a simulation of three of these. Four neural network functional units are described, called the substitution agent, the clause filter, the structure processor, and the heuristics generator, respectively. Simulation results suggest that the system described may provide several orders of magnitude improvement in execution speed for large logic programs. However, practical implementation of the proposed architecture will require the application of optical computing techniques due to the large number of neurons required, and the need for massive, adaptive connectivity.
Hybrid energy system evaluation in water supply system energy production: neural network approach
Energy Technology Data Exchange (ETDEWEB)
Goncalves, Fabio V.; Ramos, Helena M. [Civil Engineering Department, Instituto Superior Tecnico, Technical University of Lisbon, Av. Rovisco Pais, 1049-001, Lisbon (Portugal); Reis, Luisa Fernanda R. [Universidade de Sao Paulo, EESC/USP, Departamento de Hidraulica e Saneamento., Avenida do Trabalhador Saocarlense, 400, Sao Carlos-SP (Brazil)
2010-07-01
Water supply systems are large consumers of energy and the use of hybrid systems for green energy production is this new proposal. This work presents a computational model based on neural networks to determine the best configuration of a hybrid system to generate energy in water supply systems. In this study the energy sources to make this hybrid system can be the national power grid, micro-hydro and wind turbines. The artificial neural network is composed of six layers, trained to use data generated by a model of hybrid configuration and an economic simulator - CES. The reason for the development of an advanced model of forecasting based on neural networks is to allow rapid simulation and proper interaction with hydraulic and power model simulator - HPS. The results show that this computational model is useful as advanced decision support system in the design of configurations of hybrid power systems applied to water supply systems, improving the solutions in the development of its global energy efficiency.
Directory of Open Access Journals (Sweden)
Wei-Bo Chen
2015-01-01
Full Text Available In this study, two artificial neural network models (i.e., a radial basis function neural network, RBFN, and an adaptive neurofuzzy inference system approach, ANFIS and a multilinear regression (MLR model were developed to simulate the DO, TP, Chl a, and SD in the Mingder Reservoir of central Taiwan. The input variables of the neural network and the MLR models were determined using linear regression. The performances were evaluated using the RBFN, ANFIS, and MLR models based on statistical errors, including the mean absolute error, the root mean square error, and the correlation coefficient, computed from the measured and the model-simulated DO, TP, Chl a, and SD values. The results indicate that the performance of the ANFIS model is superior to those of the MLR and RBFN models. The study results show that the neural network using the ANFIS model is suitable for simulating the water quality variables with reasonable accuracy, suggesting that the ANFIS model can be used as a valuable tool for reservoir management in Taiwan.
SpikingLab: modelling agents controlled by Spiking Neural Networks in Netlogo.
Jimenez-Romero, Cristian; Johnson, Jeffrey
2017-01-01
The scientific interest attracted by Spiking Neural Networks (SNN) has lead to the development of tools for the simulation and study of neuronal dynamics ranging from phenomenological models to the more sophisticated and biologically accurate Hodgkin-and-Huxley-based and multi-compartmental models. However, despite the multiple features offered by neural modelling tools, their integration with environments for the simulation of robots and agents can be challenging and time consuming. The implementation of artificial neural circuits to control robots generally involves the following tasks: (1) understanding the simulation tools, (2) creating the neural circuit in the neural simulator, (3) linking the simulated neural circuit with the environment of the agent and (4) programming the appropriate interface in the robot or agent to use the neural controller. The accomplishment of the above-mentioned tasks can be challenging, especially for undergraduate students or novice researchers. This paper presents an alternative tool which facilitates the simulation of simple SNN circuits using the multi-agent simulation and the programming environment Netlogo (educational software that simplifies the study and experimentation of complex systems). The engine proposed and implemented in Netlogo for the simulation of a functional model of SNN is a simplification of integrate and fire (I&F) models. The characteristics of the engine (including neuronal dynamics, STDP learning and synaptic delay) are demonstrated through the implementation of an agent representing an artificial insect controlled by a simple neural circuit. The setup of the experiment and its outcomes are described in this work.
Neural Network Based Intelligent Sootblowing System
Energy Technology Data Exchange (ETDEWEB)
Mark Rhode
2005-04-01
. Due to the composition of coal, particulate matter is also a by-product of coal combustion. Modern day utility boilers are usually fitted with electrostatic precipitators to aid in the collection of particulate matter. Although extremely efficient, these devices are sensitive to rapid changes in inlet mass concentration as well as total mass loading. Traditionally, utility boilers are equipped with devices known as sootblowers, which use, steam, water or air to dislodge and clean the surfaces within the boiler and are operated based upon established rule or operator's judgment. Poor sootblowing regimes can influence particulate mass loading to the electrostatic precipitators. The project applied a neural network intelligent sootblowing system in conjunction with state-of-the-art controls and instruments to optimize the operation of a utility boiler and systematically control boiler slagging/fouling. This optimization process targeted reduction of NOx of 30%, improved efficiency of 2% and a reduction in opacity of 5%. The neural network system proved to be a non-invasive system which can readily be adapted to virtually any utility boiler. Specific conclusions from this neural network application are listed below. These conclusions should be used in conjunction with the specific details provided in the technical discussions of this report to develop a thorough understanding of the process.
Ocean wave prediction using numerical and neural network models
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Prabaharan, N.
This paper presents an overview of the development of the numerical wave prediction models and recently used neural networks for ocean wave hindcasting and forecasting. The numerical wave models express the physical concepts of the phenomena...
Analog neural network-based helicopter gearbox health monitoring system.
Monsen, P T; Dzwonczyk, M; Manolakos, E S
1995-12-01
The development of a reliable helicopter gearbox health monitoring system (HMS) has been the subject of considerable research over the past 15 years. The deployment of such a system could lead to a significant saving in lives and vehicles as well as dramatically reduce the cost of helicopter maintenance. Recent research results indicate that a neural network-based system could provide a viable solution to the problem. This paper presents two neural network-based realizations of an HMS system. A hybrid (digital/analog) neural system is proposed as an extremely accurate off-line monitoring tool used to reduce helicopter gearbox maintenance costs. In addition, an all analog neural network is proposed as a real-time helicopter gearbox fault monitor that can exploit the ability of an analog neural network to directly compute the discrete Fourier transform (DFT) as a sum of weighted samples. Hardware performance results are obtained using the Integrated Neural Computing Architecture (INCA/1) analog neural network platform that was designed and developed at The Charles Stark Draper Laboratory. The results indicate that it is possible to achieve a 100% fault detection rate with 0% false alarm rate by performing a DFT directly on the first layer of INCA/1 followed by a small-size two-layer feed-forward neural network and a simple post-processing majority voting stage.
The ctenophore genome and the evolutionary origins of neural systems
Moroz, Leonid L.; Kocot, Kevin M.; Citarella, Mathew R.; Dosung, Sohn; Norekian, Tigran P.; Povolotskaya, Inna S.; Grigorenko, Anastasia P.; Dailey, Christopher; Berezikov, Eugene; Buckley, Katherine M.; Ptitsyn, Andrey; Reshetov, Denis; Mukherjee, Krishanu; Moroz, Tatiana P.; Bobkova, Yelena; Yu, Fahong; Kapitonov, Vladimir V.; Jurka, Jerzy; Bobkov, Yuri V.; Swore, Joshua J.; Girardo, David O.; Fodor, Alexander; Gusev, Fedor; Sanford, Rachel; Bruders, Rebecca; Kittler, Ellen; Mills, Claudia E.; Rast, Jonathan P.; Derelle, Romain; Solovyev, Victor V.; Kondrashov, Fyodor A.; Swalla, Billie J.; Sweedler, Jonathan V.; Rogaev, Evgeny I.; Halanych, Kenneth M.; Kohn, Andrea B.
2014-01-01
The origins of neural systems remain unresolved. In contrast to other basal metazoans, ctenophores (comb jellies) have both complex nervous and mesoderm-derived muscular systems. These holoplanktonic predators also have sophisticated ciliated locomotion, behaviour and distinct development. Here we
Neural network models: Insights and prescriptions from practical applications
Energy Technology Data Exchange (ETDEWEB)
Samad, T. [Honeywell Technology Center, Minneapolis, MN (United States)
1995-12-31
Neural networks are no longer just a research topic; numerous applications are now testament to their practical utility. In the course of developing these applications, researchers and practitioners have been faced with a variety of issues. This paper briefly discusses several of these, noting in particular the rich connections between neural networks and other, more conventional technologies. A more comprehensive version of this paper is under preparation that will include illustrations on real examples. Neural networks are being applied in several different ways. Our focus here is on neural networks as modeling technology. However, much of the discussion is also relevant to other types of applications such as classification, control, and optimization.
A Chinese Named Entity Recognition System with Neural Networks
Directory of Open Access Journals (Sweden)
Yi Hui-Kang
2017-01-01
Full Text Available Named entity recognition (NER is a typical sequential labeling problem that plays an important role in natural language processing (NLP systems. In this paper, we discussed the details of applying a comprehensive model aggregating neural networks and conditional random field (CRF on Chinese NER tasks, and how to discovery character level features when implement a NER system in word level. We compared the difference between Chinese and English when modeling the character embeddings. We developed a NER system based on our analysis, it works well on the ACE 2004 and SIGHAN bakeoff 2006 MSRA dataset, and doesn’t rely on any gazetteers or handcraft features. We obtained F1 score of 82.3% on MSRA 2006.
Identification of Complex Dynamical Systems with Neural Networks (2/2)
CERN. Geneva
2016-01-01
The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...
Identification of Complex Dynamical Systems with Neural Networks (1/2)
CERN. Geneva
2016-01-01
The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...
Neural Systems for Speech and Song in Autism
Lai, Grace; Pantazatos, Spiro P.; Schneider, Harry; Hirsch, Joy
2012-01-01
Despite language disabilities in autism, music abilities are frequently preserved. Paradoxically, brain regions associated with these functions typically overlap, enabling investigation of neural organization supporting speech and song in autism. Neural systems sensitive to speech and song were compared in low-functioning autistic and age-matched…
Predictive Control of Hydronic Floor Heating Systems using Neural Networks and Genetic Algorithms
DEFF Research Database (Denmark)
Vinther, Kasper; Green, Torben; Østergaard, Søren
2017-01-01
This paper presents the use a neural network and a micro genetic algorithm to optimize future set-points in existing hydronic floor heating systems for improved energy efficiency. The neural network can be trained to predict the impact of changes in set-points on future room temperatures. Additio...... space is not guaranteed. Evaluation of the performance of multiple neural networks is performed, using different levels of information, and optimization results are presented on a detailed house simulation model.......This paper presents the use a neural network and a micro genetic algorithm to optimize future set-points in existing hydronic floor heating systems for improved energy efficiency. The neural network can be trained to predict the impact of changes in set-points on future room temperatures...
Directory of Open Access Journals (Sweden)
David Overbye
2005-06-01
Full Text Available In this paper we examine the impact of channel fading on the bit error rate of a DS-CDMA communication system. The system employs detectors that incorporate neural networks effecting methods of independent component analysis (ICA, subspace estimation of channel noise, and Hopfield type neural networks. The Rayleigh fading channel model is used. When employed in a Rayleigh fading environment, the ICA neural network detectors that give superior performance in a flat fading channel did not retain this superior performance. We then present a new method of compensating for channel fading based on the incorporation of priors in the ICA neural network learning algorithms. When the ICA neural network detectors were compensated using the incorporation of priors, they give significantly better performance than the traditional detectors and the uncompensated ICA detectors. Keywords: CDMA, Multi-user Detection, Rayleigh Fading, Multipath Detection, Independent Component Analysis, Prior Probability Hebbian Learning, Natural Gradient
Forecasting volatility with neural regression: a contribution to model adequacy.
Refenes, A N; Holt, W T
2001-01-01
Neural nets' usefulness for forecasting is limited by problems of overfitting and the lack of rigorous procedures for model identification, selection and adequacy testing. This paper describes a methodology for neural model misspecification testing. We introduce a generalization of the Durbin-Watson statistic for neural regression and discuss the general issues of misspecification testing using residual analysis. We derive a generalized influence matrix for neural estimators which enables us to evaluate the distribution of the statistic. We deploy Monte Carlo simulation to compare the power of the test for neural and linear regressors. While residual testing is not a sufficient condition for model adequacy, it is nevertheless a necessary condition to demonstrate that the model is a good approximation to the data generating process, particularly as neural-network estimation procedures are susceptible to partial convergence. The work is also an important step toward developing rigorous procedures for neural model identification, selection and adequacy testing which have started to appear in the literature. We demonstrate its applicability in the nontrivial problem of forecasting implied volatility innovations using high-frequency stock index options. Each step of the model building process is validated using statistical tests to verify variable significance and model adequacy with the results confirming the presence of nonlinear relationships in implied volatility innovations.
Synthetic neural modeling applied to a real-world artifact.
Edelman, G M; Reeke, G N; Gall, W E; Tononi, G; Williams, D; Sporns, O
1992-08-01
We describe the general design, operating principles, and performance of a neurally organized, multiply adaptive device (NOMAD) under control of a nervous system simulated in a computer. The complete system, Darwin IV, is the latest in a series of models based on the theory of neuronal group selection, which postulates that adaptive behavior is the result of selection in somatic time among synaptic populations. The simulated brain of Darwin IV includes visual and motor areas that are connected with NOMAD by telemetry. Under suitable conditions, Darwin IV can be trained to track a light moving in a random path. After such training, it can approach colored blocks and collect them to a home position. Following a series of contacts with such blocks, value signals received through a "snout" that senses conductivity allow it to sort these blocks on the basis of differences in color associated with differences in their conductivity. Darwin IV represents a new approach to synthetic neural modeling (SNM), a technique in which large-scale computer simulations are employed to analyze the interactions among the nervous system, the phenotype, and the environment of a designed organism as behavior develops. Darwin IV retains the advantages of SNM while avoiding the difficulties and pitfalls of attempting to simulate a rich environment in addition to a brain.
A neural model of valuation and information virality.
Scholz, Christin; Baek, Elisa C; O'Donnell, Matthew Brook; Kim, Hyun Suk; Cappella, Joseph N; Falk, Emily B
2017-03-14
Information sharing is an integral part of human interaction that serves to build social relationships and affects attitudes and behaviors in individuals and large groups. We present a unifying neurocognitive framework of mechanisms underlying information sharing at scale (virality). We argue that expectations regarding self-related and social consequences of sharing (e.g., in the form of potential for self-enhancement or social approval) are integrated into a domain-general value signal that encodes the value of sharing a piece of information. This value signal translates into population-level virality. In two studies (n = 41 and 39 participants), we tested these hypotheses using functional neuroimaging. Neural activity in response to 80 New York Times articles was observed in theory-driven regions of interest associated with value, self, and social cognitions. This activity then was linked to objectively logged population-level data encompassing n = 117,611 internet shares of the articles. In both studies, activity in neural regions associated with self-related and social cognition was indirectly related to population-level sharing through increased neural activation in the brain's value system. Neural activity further predicted population-level outcomes over and above the variance explained by article characteristics and commonly used self-report measures of sharing intentions. This parsimonious framework may help advance theory, improve predictive models, and inform new approaches to effective intervention. More broadly, these data shed light on the core functions of sharing-to express ourselves in positive ways and to strengthen our social bonds.
Spike neural models (part I: The Hodgkin-Huxley model
Directory of Open Access Journals (Sweden)
Johnson, Melissa G.
2017-05-01
Full Text Available Artificial neural networks, or ANNs, have grown a lot since their inception back in the 1940s. But no matter the changes, one of the most important components of neural networks is still the node, which represents the neuron. Within spiking neural networks, the node is especially important because it contains the functions and properties of neurons that are necessary for their network. One important aspect of neurons is the ionic flow which produces action potentials, or spikes. Forces of diffusion and electrostatic pressure work together with the physical properties of the cell to move ions around changing the cell membrane potential which ultimately produces the action potential. This tutorial reviews the Hodkgin-Huxley model and shows how it simulates the ionic flow of the giant squid axon via four differential equations. The model is implemented in Matlab using Euler's Method to approximate the differential equations. By using Euler's method, an extra parameter is created, the time step. This new parameter needs to be carefully considered or the results of the node may be impaired.
System identification of an unmanned quadcopter system using MRAN neural
Pairan, M. F.; Shamsudin, S. S.
2017-12-01
This project presents the performance analysis of the radial basis function neural network (RBF) trained with Minimal Resource Allocating Network (MRAN) algorithm for real-time identification of quadcopter. MRAN’s performance is compared with the RBF with Constant Trace algorithm for 2500 input-output pair data sampling. MRAN utilizes adding and pruning hidden neuron strategy to obtain optimum RBF structure, increase prediction accuracy and reduce training time. The results indicate that MRAN algorithm produces fast training time and more accurate prediction compared with standard RBF. The model proposed in this paper is capable of identifying and modelling a nonlinear representation of the quadcopter flight dynamics.
Testing Neural Models of the Development of Infant Visual Attention
Richards, John E.; Hunter, Sharon K.
2002-01-01
Several models of the development of infant visual attention have used information about neural development. Most of these models have been based on nonhuman animal studies and have relied on indirect measures of neural development in human infants. This article discusses methods for studying a “neurodevelopmental” model of infant visual attention using indirect and direct measures of cortical activity. We concentrate on the effect of attention on eye movement control and show how animal-base...
Functional Modeling of Neural-Glia Interaction
DEFF Research Database (Denmark)
Postnov, D.E.; Brazhe, N.A.; Sosnovtseva, Olga
2012-01-01
Functional modeling is an approach that focuses on the representation of the qualitative dynamics of the individual components (e.g. cells) of a system and on the structure of the interaction network.......Functional modeling is an approach that focuses on the representation of the qualitative dynamics of the individual components (e.g. cells) of a system and on the structure of the interaction network....
Simulation of Missile Autopilot with Two-Rate Hybrid Neural Network System
Directory of Open Access Journals (Sweden)
ASTROV, I.
2007-04-01
Full Text Available This paper proposes a two-rate hybrid neural network system, which consists of two artificial neural network subsystems. These neural network subsystems are used as the dynamic subsystems controllers.1 This is because such neuromorphic controllers are especially suitable to control complex systems. An illustrative example - two-rate neural network hybrid control of decomposed stochastic model of a rigid guided missile over different operating conditions - was carried out using the proposed two-rate state-space decomposition technique. This example demonstrates that this research technique results in simplified low-order autonomous control subsystems with various speeds of actuation, and shows the quality of the proposed technique. The obtained results show that the control tasks for the autonomous subsystems can be solved more qualitatively than for the original system. The simulation and animation results with use of software package Simulink demonstrate that this research technique would work for real-time stochastic systems.
Neural field model of memory-guided search
Kilpatrick, Zachary P.; Poll, Daniel B.
2017-12-01
Many organisms can remember locations they have previously visited during a search. Visual search experiments have shown exploration is guided away from these locations, reducing redundancies in the search path before finding a hidden target. We develop and analyze a two-layer neural field model that encodes positional information during a search task. A position-encoding layer sustains a bump attractor corresponding to the searching agent's current location, and search is modeled by velocity input that propagates the bump. A memory layer sustains persistent activity bounded by a wave front, whose edges expand in response to excitatory input from the position layer. Search can then be biased in response to remembered locations, influencing velocity inputs to the position layer. Asymptotic techniques are used to reduce the dynamics of our model to a low-dimensional system of equations that track the bump position and front boundary. Performance is compared for different target-finding tasks.
Reconstructing neural dynamics using data assimilation with multiple models
Hamilton, Franz; Cressman, John; Peixoto, Nathalia; Sauer, Timothy
2014-09-01
Assimilation of data with models of physical processes is a critical component of modern scientific analysis. In recent years, nonlinear versions of Kalman filtering have been developed, in addition to methods that estimate model parameters in parallel with the system state. We propose a substantial extension of these tools to deal with the specific case of unmodeled variables, when training data from the variable is avaiable. The method uses a stack of several, nonidentical copies of a physical model to jointly reconstruct the variable in question. We demonstrate the ability of this technique to accurately recover an unmodeled experimental quantity, such as an ion concentration, from a single voltage trace after the training period is completed. The method is applied to reconstruct the potassium concentration in a neural culture from multielectrode array voltage measurements.
A hybrid neural network model for noisy data regression.
Lee, Eric W M; Lim, Chee Peng; Yuen, Richard K K; Lo, S M
2004-04-01
A hybrid neural network model, based on the fusion of fuzzy adaptive resonance theory (FA ART) and the general regression neural network (GRNN), is proposed in this paper. Both FA and the GRNN are incremental learning systems and are very fast in network training. The proposed hybrid model, denoted as GRNNFA, is able to retain these advantages and, at the same time, to reduce the computational requirements in calculating and storing information of the kernels. A clustering version of the GRNN is designed with data compression by FA for noise removal. An adaptive gradient-based kernel width optimization algorithm has also been devised. Convergence of the gradient descent algorithm can be accelerated by the geometric incremental growth of the updating factor. A series of experiments with four benchmark datasets have been conducted to assess and compare effectiveness of GRNNFA with other approaches. The GRNNFA model is also employed in a novel application task for predicting the evacuation time of patrons at typical karaoke centers in Hong Kong in the event of fire. The results positively demonstrate the applicability of GRNNFA in noisy data regression problems.
Dopamine system: Manager of neural pathways
Directory of Open Access Journals (Sweden)
Simon eHong
2013-12-01
Full Text Available There are a growing number of roles that midbrain dopamine (DA neurons assume, such as, reward, aversion, alerting and vigor. Here I propose a theory that may be able to explain why the suggested functions of DA came about. It has been suggested that largely parallel cortico-basal ganglia-thalamo-cortico loops exist to control different aspects of behavior. I propose that (1 the midbrain DA system is organized in a similar manner, with different groups of DA neurons corresponding to these parallel neural pathways (NPs. The DA system can be viewed as the manager of these parallel NPs in that it recruits and activates only the task-relevant NPs when they are needed. It is likely that the functions of those NPs that have been consistently activated by the corresponding DA groups are facilitated. I also propose that (2 there are two levels of DA roles: the How and What roles. The How role is encoded in tonic and phasic DA neuron firing patterns and gives a directive to its target NP: how vigorously its function needs to be carried out. The tonic DA firing is to maintain a certain level of DA in the target NPs to support their expected behavioral and mental functions; it is only when a sudden unexpected boost or suppression of activity is required by the relevant target NP that DA neurons in the corresponding NP act in a phasic manner. The What role is the implementational aspect of the role of DA in the target NP, such as binding to D1 receptors to boost working memory. This What aspect of DA explains why DA seems to assume different functions depending on the region of the brain in which it is involved. In terms of the role of the lateral habenula (LHb, the LHb is expected to suppress maladaptive behaviors and mental processes by controlling the DA system. The demand-based smart management by the DA system may have given animals an edge in evolution with adaptive behaviors and a better survival rate in resource-scarce situations.
Optical production systems using neural networks and symbolic substitution
Botha, Elizabeth; Casasent, David; Barnard, Etienne
1988-01-01
Two optical implementations of production systems are advanced. The production systems operate on a knowledge base where facts and rules are encoded as formulas in propositional calculus. The first implementation is a binary neural network. An analog neural network is used to include reasoning with uncertainties. The second implementation uses a new optical symbolic substitution correlator. This implementation is useful when a set of similar situations has to be handled in parallel on one processor.
DEFF Research Database (Denmark)
Dasgupta, Sakyasingha; Goldschmidt, Dennis; Wörgötter, Florentin
2015-01-01
movements, (2) distributed (at each leg) recurrent neural network based adaptive forward models with efference copies as internal models for sensory predictions and instantaneous state estimations, and (3) searching and elevation control for adapting the movement of an individual leg to deal with different...... conditions, like uneven terrains, gaps, obstacles etc. Biological study has revealed that such complex behaviors are a result of a combination of biomechanics and neural mechanism thus representing the true nature of embodied interactions. While the biomechanics helps maintain flexibility and sustain...... a variety of movements, the neural mechanisms generate movements while making appropriate predictions crucial for achieving adaptation. Such predictions or planning ahead can be achieved by way of internal models that are grounded in the overall behavior of the animal. Inspired by these findings, we present...
Hybrid fault diagnosis of nonlinear systems using neural parameter estimators.
Sobhani-Tehrani, E; Talebi, H A; Khorasani, K
2014-02-01
This paper presents a novel integrated hybrid approach for fault diagnosis (FD) of nonlinear systems taking advantage of both the system's mathematical model and the adaptive nonlinear approximation capability of computational intelligence techniques. Unlike most FD techniques, the proposed solution simultaneously accomplishes fault detection, isolation, and identification (FDII) within a unified diagnostic module. At the core of this solution is a bank of adaptive neural parameter estimators (NPEs) associated with a set of single-parameter fault models. The NPEs continuously estimate unknown fault parameters (FPs) that are indicators of faults in the system. Two NPE structures, series-parallel and parallel, are developed with their exclusive set of desirable attributes. The parallel scheme is extremely robust to measurement noise and possesses a simpler, yet more solid, fault isolation logic. In contrast, the series-parallel scheme displays short FD delays and is robust to closed-loop system transients due to changes in control commands. Finally, a fault tolerant observer (FTO) is designed to extend the capability of the two NPEs that originally assumes full state measurements for systems that have only partial state measurements. The proposed FTO is a neural state estimator that can estimate unmeasured states even in the presence of faults. The estimated and the measured states then comprise the inputs to the two proposed FDII schemes. Simulation results for FDII of reaction wheels of a three-axis stabilized satellite in the presence of disturbances and noise demonstrate the effectiveness of the proposed FDII solutions under partial state measurements. Copyright © 2013 Elsevier Ltd. All rights reserved.
Acquiring neural signals for developing a perception and cognition model
Li, Wei; Li, Yunyi; Chen, Genshe; Shen, Dan; Blasch, Erik; Pham, Khanh; Lynch, Robert
2012-06-01
The understanding of how humans process information, determine salience, and combine seemingly unrelated information is essential to automated processing of large amounts of information that is partially relevant, or of unknown relevance. Recent neurological science research in human perception, and in information science regarding contextbased modeling, provides us with a theoretical basis for using a bottom-up approach for automating the management of large amounts of information in ways directly useful for human operators. However, integration of human intelligence into a game theoretic framework for dynamic and adaptive decision support needs a perception and cognition model. For the purpose of cognitive modeling, we present a brain-computer-interface (BCI) based humanoid robot system to acquire brainwaves during human mental activities of imagining a humanoid robot-walking behavior. We use the neural signals to investigate relationships between complex humanoid robot behaviors and human mental activities for developing the perception and cognition model. The BCI system consists of a data acquisition unit with an electroencephalograph (EEG), a humanoid robot, and a charge couple CCD camera. An EEG electrode cup acquires brainwaves from the skin surface on scalp. The humanoid robot has 20 degrees of freedom (DOFs); 12 DOFs located on hips, knees, and ankles for humanoid robot walking, 6 DOFs on shoulders and arms for arms motion, and 2 DOFs for head yaw and pitch motion. The CCD camera takes video clips of the human subject's hand postures to identify mental activities that are correlated to the robot-walking behaviors. We use the neural signals to investigate relationships between complex humanoid robot behaviors and human mental activities for developing the perception and cognition model.
Small-signal neural models and their applications.
Basu, Arindam
2012-02-01
This paper introduces the use of the concept of small-signal analysis, commonly used in circuit design, for understanding neural models. We show that neural models, varying in complexity from Hodgkin-Huxley to integrate and fire have similar small-signal models when their corresponding differential equations are close to the same bifurcation with respect to input current. Three applications of small-signal neural models are shown. First, some of the properties of cortical neurons described by Izhikevich are explained intuitively through small-signal analysis. Second, we use small-signal models for deriving parameters for a simple neural model (such as resonate and fire) from a more complicated but biophysically relevant one like Morris-Lecar. We show similarity in the subthreshold behavior of the simple and complicated model when they are close to a Hopf bifurcation and a saddle-node bifurcation. Hence, this is useful to correctly tune simple neural models for large-scale cortical simulations. Finaly, the biasing regime of a silicon ion channel is derived by comparing its small-signal model with a Hodgkin-Huxley-type model.
Neural - fuzzy approach for system identification
Tien, B.T.
1997-01-01
Most real-world processes have nonlinear and complex dynamics. Conventional methods of constructing nonlinear models from first principles are time consuming and require a level of knowledge about the internal functioning of the system that is often not available. Consequently, in such
DEFF Research Database (Denmark)
Chon, K H; Hoyer, D; Armoundas, A A
1999-01-01
error is obtained by subtracting the corrupt signal of the estimated ARMA model obtained via the deterministic estimation step from the system output response. We present computer simulation examples to show the efficacy of the proposed stochastic recurrent neural network approach in obtaining accurate......In this study, we introduce a new approach for estimating linear and nonlinear stochastic autoregressive moving average (ARMA) model parameters, given a corrupt signal, using artificial recurrent neural networks. This new approach is a two-step approach in which the parameters of the deterministic...... part of the stochastic ARMA model are first estimated via a three-layer artificial neural network (deterministic estimation step) and then reestimated using the prediction error as one of the inputs to the artificial neural networks in an iterative algorithm (stochastic estimation step). The prediction...
Stability Analysis of Neural Networks-Based System Identification
Directory of Open Access Journals (Sweden)
Talel Korkobi
2008-01-01
Full Text Available This paper treats some problems related to nonlinear systems identification. A stability analysis neural network model for identifying nonlinear dynamic systems is presented. A constrained adaptive stable backpropagation updating law is presented and used in the proposed identification approach. The proposed backpropagation training algorithm is modified to obtain an adaptive learning rate guarantying convergence stability. The proposed learning rule is the backpropagation algorithm under the condition that the learning rate belongs to a specified range defining the stability domain. Satisfying such condition, unstable phenomena during the learning process are avoided. A Lyapunov analysis leads to the computation of the expression of a convenient adaptive learning rate verifying the convergence stability criteria. Finally, the elaborated training algorithm is applied in several simulations. The results confirm the effectiveness of the CSBP algorithm.
Models of neural networks IV early vision and attention
Cowan, Jack; Domany, Eytan
2002-01-01
Close this book for a moment and look around you. You scan the scene by directing your attention, and gaze, at certain specific objects. Despite the background, you discern them. The process is partially intentional and partially preattentive. How all this can be done is described in the fourth volume of Models of Neural Networks devoted to Early Vision and Atten tion that you are holding in your hands. Early vision comprises the first stages of visual information processing. It is as such a scientific challenge whose clarification calls for a penetrating review. Here you see the result. The Heraeus Foundation (Hanau) is to be thanked for its support during the initial phase of this project. John Hertz, who has extensive experience in both computational and ex perimental neuroscience, provides in "Neurons, Networks, and Cognition" to neural modeling. John Van Opstal explains in a theoretical introduction "The Gaze Control System" how the eye's gaze control is performed and presents a novel theoretical des...
Genetic learning in rule-based and neural systems
Smith, Robert E.
1993-01-01
The design of neural networks and fuzzy systems can involve complex, nonlinear, and ill-conditioned optimization problems. Often, traditional optimization schemes are inadequate or inapplicable for such tasks. Genetic Algorithms (GA's) are a class of optimization procedures whose mechanics are based on those of natural genetics. Mathematical arguments show how GAs bring substantial computational leverage to search problems, without requiring the mathematical characteristics often necessary for traditional optimization schemes (e.g., modality, continuity, availability of derivative information, etc.). GA's have proven effective in a variety of search tasks that arise in neural networks and fuzzy systems. This presentation begins by introducing the mechanism and theoretical underpinnings of GA's. GA's are then related to a class of rule-based machine learning systems called learning classifier systems (LCS's). An LCS implements a low-level production-system that uses a GA as its primary rule discovery mechanism. This presentation illustrates how, despite its rule-based framework, an LCS can be thought of as a competitive neural network. Neural network simulator code for an LCS is presented. In this context, the GA is doing more than optimizing and objective function. It is searching for an ecology of hidden nodes with limited connectivity. The GA attempts to evolve this ecology such that effective neural network performance results. The GA is particularly well adapted to this task, given its naturally-inspired basis. The LCS/neural network analogy extends itself to other, more traditional neural networks. Conclusions to the presentation discuss the implications of using GA's in ecological search problems that arise in neural and fuzzy systems.
Neural network models of learning and categorization in multigame experiments
Directory of Open Access Journals (Sweden)
Davide eMarchiori
2011-12-01
Full Text Available Previous research has shown that regret-driven neural networks predict behavior in repeated completely mixed games remarkably well, substantially equating the performance of the most accurate established models of learning. This result prompts the question of what is the added value of modeling learning through neural networks. We submit that this modeling approach allows for models that are able to distinguish among and respond differently to different payoff structures. Moreover, the process of categorization of a game is implicitly carried out by these models, thus without the need of any external explicit theory of similarity between games. To validate our claims, we designed and ran two multigame experiments in which subjects faced, in random sequence, different instances of two completely mixed 2x2 games. Then, we tested on our experimental data two regret-driven neural network models, and compared their performance with that of other established models of learning and Nash equilibrium.
Complex Environmental Data Modelling Using Adaptive General Regression Neural Networks
Kanevski, Mikhail
2015-04-01
The research deals with an adaptation and application of Adaptive General Regression Neural Networks (GRNN) to high dimensional environmental data. GRNN [1,2,3] are efficient modelling tools both for spatial and temporal data and are based on nonparametric kernel methods closely related to classical Nadaraya-Watson estimator. Adaptive GRNN, using anisotropic kernels, can be also applied for features selection tasks when working with high dimensional data [1,3]. In the present research Adaptive GRNN are used to study geospatial data predictability and relevant feature selection using both simulated and real data case studies. The original raw data were either three dimensional monthly precipitation data or monthly wind speeds embedded into 13 dimensional space constructed by geographical coordinates and geo-features calculated from digital elevation model. GRNN were applied in two different ways: 1) adaptive GRNN with the resulting list of features ordered according to their relevancy; and 2) adaptive GRNN applied to evaluate all possible models N [in case of wind fields N=(2^13 -1)=8191] and rank them according to the cross-validation error. In both cases training were carried out applying leave-one-out procedure. An important result of the study is that the set of the most relevant features depends on the month (strong seasonal effect) and year. The predictabilities of precipitation and wind field patterns, estimated using the cross-validation and testing errors of raw and shuffled data, were studied in detail. The results of both approaches were qualitatively and quantitatively compared. In conclusion, Adaptive GRNN with their ability to select features and efficient modelling of complex high dimensional data can be widely used in automatic/on-line mapping and as an integrated part of environmental decision support systems. 1. Kanevski M., Pozdnoukhov A., Timonin V. Machine Learning for Spatial Environmental Data. Theory, applications and software. EPFL Press
Neural Network Model for Prediction of Discharged from the Catchments of Langat River, Malaysia
Directory of Open Access Journals (Sweden)
Z. Ahmad
2010-09-01
Full Text Available Artificial neural networks have been shown to be able to approximate any continuous non-linear functions and have been used to build data base empirical models for non-linear processes. In this study, neural networks models were used to model the daily river flows or discharged in Langat River, Malaysia. Two possible ways of modelling were implemented which is by time series prediction and by the dynamics function of the system which include the past value of the discharged and also the rainfall in the input. The sum square error (SSE, residue analysis and correlation coefficient based on the observed and prediction output is chosen as the criteria of selection of which models is appropriate. It was found that the developed neural networks models using dynamics function provided satisfactory model discharges.
Multiple neural network approaches to clinical expert systems
Stubbs, Derek F.
1990-08-01
We briefly review the concept of computer aided medical diagnosis and more extensively review the the existing literature on neural network applications in the field. Neural networks can function as simple expert systems for diagnosis or prognosis. Using a public database we develop a neural network for the diagnosis of a major presenting symptom while discussing the development process and possible approaches. MEDICAL EXPERTS SYSTEMS COMPUTER AIDED DIAGNOSIS Biomedicine is an incredibly diverse and multidisciplinary field and it is not surprising that neural networks with their many applications are finding more and more applications in the highly non-linear field of biomedicine. I want to concentrate on neural networks as medical expert systems for clinical diagnosis or prognosis. Expert Systems started out as a set of computerized " ifthen" rules. Everything was reduced to boolean logic and the promised land of computer experts was said to be in sight. It never came. Why? First the computer code explodes as the number of " ifs" increases. All the " ifs" have to interact. Second experts are not very good at reducing expertise to language. It turns out that experts recognize patterns and have non-verbal left-brain intuition decision processes. Third learning by example rather than learning by rule is the way natural brains works and making computers work by rule-learning is hideously labor intensive. Neural networks can learn from example. They learn the results
Concurrent heterogeneous neural model simulation on real-time neuromimetic hardware.
Rast, Alexander; Galluppi, Francesco; Davies, Sergio; Plana, Luis; Patterson, Cameron; Sharp, Thomas; Lester, David; Furber, Steve
2011-11-01
Dedicated hardware is becoming increasingly essential to simulate emerging very-large-scale neural models. Equally, however, it needs to be able to support multiple models of the neural dynamics, possibly operating simultaneously within the same system. This may be necessary either to simulate large models with heterogeneous neural types, or to simplify simulation and analysis of detailed, complex models in a large simulation by isolating the new model to a small subpopulation of a larger overall network. The SpiNNaker neuromimetic chip is a dedicated neural processor able to support such heterogeneous simulations. Implementing these models on-chip uses an integrated library-based tool chain incorporating the emerging PyNN interface that allows a modeller to input a high-level description and use an automated process to generate an on-chip simulation. Simulations using both LIF and Izhikevich models demonstrate the ability of the SpiNNaker system to generate and simulate heterogeneous networks on-chip, while illustrating, through the network-scale effects of wavefront synchronisation and burst gating, methods that can provide effective behavioural abstractions for large-scale hardware modelling. SpiNNaker's asynchronous virtual architecture permits greater scope for model exploration, with scalable levels of functional and temporal abstraction, than conventional (or neuromorphic) computing platforms. The complete system illustrates a potential path to understanding the neural model of computation, by building (and breaking) neural models at various scales, connecting the blocks, then comparing them against the biology: computational cognitive neuroscience. Copyright © 2011 Elsevier Ltd. All rights reserved.
BOOK REVIEW: Theory of Neural Information Processing Systems
Galla, Tobias
2006-04-01
It is difficult not to be amazed by the ability of the human brain to process, to structure and to memorize information. Even by the toughest standards the behaviour of this network of about 1011 neurons qualifies as complex, and both the scientific community and the public take great interest in the growing field of neuroscience. The scientific endeavour to learn more about the function of the brain as an information processing system is here a truly interdisciplinary one, with important contributions from biology, computer science, physics, engineering and mathematics as the authors quite rightly point out in the introduction of their book. The role of the theoretical disciplines here is to provide mathematical models of information processing systems and the tools to study them. These models and tools are at the centre of the material covered in the book by Coolen, Kühn and Sollich. The book is divided into five parts, providing basic introductory material on neural network models as well as the details of advanced techniques to study them. A mathematical appendix complements the main text. The range of topics is extremely broad, still the presentation is concise and the book well arranged. To stress the breadth of the book let me just mention a few keywords here: the material ranges from the basics of perceptrons and recurrent network architectures to more advanced aspects such as Bayesian learning and support vector machines; Shannon's theory of information and the definition of entropy are discussed, and a chapter on Amari's information geometry is not missing either. Finally the statistical mechanics chapters cover Gardner theory and the replica analysis of the Hopfield model, not without being preceded by a brief introduction of the basic concepts of equilibrium statistical physics. The book also contains a part on effective theories of the macroscopic dynamics of neural networks. Many dynamical aspects of neural networks are usually hard to find in the
Neural Networks and Their Application to Air Force Personnel Modeling
1991-11-01
breadth of techniques provides fertile ground against which to compare the results obtained with neural networks. ", Most of the models in reenlistment or...Specialties (MOSs) receiving SRBs were taken from the 1980 and 1981 Enlisted Master Files ( EMFs ). These 98 MOSs were then aggregated into 15 Career Management... mechanisms , and architectures. Neural Networks, 1(1), 17-62. Hagiwara, M. (1990). Accelerated backpropagation using unlearning based on a Hebb rule
Stimulus-dependent maximum entropy models of neural population codes.
Directory of Open Access Journals (Sweden)
Einat Granot-Atedgi
Full Text Available Neural populations encode information about their stimulus in a collective fashion, by joint activity patterns of spiking and silence. A full account of this mapping from stimulus to neural activity is given by the conditional probability distribution over neural codewords given the sensory input. For large populations, direct sampling of these distributions is impossible, and so we must rely on constructing appropriate models. We show here that in a population of 100 retinal ganglion cells in the salamander retina responding to temporal white-noise stimuli, dependencies between cells play an important encoding role. We introduce the stimulus-dependent maximum entropy (SDME model-a minimal extension of the canonical linear-nonlinear model of a single neuron, to a pairwise-coupled neural population. We find that the SDME model gives a more accurate account of single cell responses and in particular significantly outperforms uncoupled models in reproducing the distributions of population codewords emitted in response to a stimulus. We show how the SDME model, in conjunction with static maximum entropy models of population vocabulary, can be used to estimate information-theoretic quantities like average surprise and information transmission in a neural population.
Building an Early Warning System for Crude Oil Price Using Neural Network
Directory of Open Access Journals (Sweden)
Wonho Song
2010-12-01
Full Text Available In this paper, a crisis index for the oil price shock is defined and a neural network model is specified for the prediction of the crisis index. This paper contributes to the literature in three ways. First, we build an early warning system for crude oil price. Although the oil price became one of the most important price index recently, no research efforts have been made to build an early warning system for crude oil price. Second, the neural network (NN model is used to construct the early warning sysIn this paper, a crisis index for the oil price shock is defined and a neural network model is specified for the prediction of the crisis index. This paper contributes to the literature in three ways. First, we build an early warning system for crude oil price. Although the oil price became one of the most important price index recently, no research efforts have been made to build an early warning system for crude oil price. Second, the neural network (NN model is used to construct the early warning system. Most early warning systems are built based on the signaling approach. In this paper, we show that the neural network models are more flexible and have greater potential as EWS than the signaling approach. Third, we allow the multi-level crisis index. Previous models allowed only a zero/one crisis index whereas our model permits as many levels as possible. With this new model, we try to answer whether the oil price collapse following the historical peak in 2008 was predictable. We compare the results from the NN model with those from the ordered probit (OP model, and show that the oil price crisis and the following crash were predictable by the NN model, but not by the OP model.
Yin, Ming; Ghovanloo, Maysam
2009-08-01
We have used a well-known technique in wireless communication, pulse width modulation (PWM) of time division multiplexed (TDM) signals, within the architecture of a novel wireless integrated neural recording (WINeR) system. We have evaluated the performance of the PWM-based architecture and indicated its accuracy and potential sources of error through detailed theoretical analysis, simulations, and measurements on a setup consisting of a 15-channel WINeR prototype as the transmitter and two types of receivers; an Agilent 89600 vector signal analyzer and a custom wideband receiver, with 36 and 75 MHz of maximum bandwidth, respectively. Furthermore, we present simulation results from a realistic MATLAB-Simulink model of the entire WINeR system to observe the system behavior in response to changes in various parameters. We have concluded that the 15-ch WINeR prototype, which is fabricated in a 0.5- mum standard CMOS process and consumes 4.5 mW from +/-1.5 V supplies, can acquire and wirelessly transmit up to 320 k-samples/s to a 75-MHz receiver with 8.4 bits of resolution, which is equivalent to a wireless data rate of approximately 2.56 Mb/s.
Stochastic Neural Field Theory and the System-Size Expansion
Bressloff, Paul C.
2010-01-01
We analyze a master equation formulation of stochastic neurodynamics for a network of synaptically coupled homogeneous neuronal populations each consisting of N identical neurons. The state of the network is specified by the fraction of active or spiking neurons in each population, and transition rates are chosen so that in the thermodynamic or deterministic limit (N → ∞) we recover standard activity-based or voltage-based rate models. We derive the lowest order corrections to these rate equations for large but finite N using two different approximation schemes, one based on the Van Kampen system-size expansion and the other based on path integral methods. Both methods yield the same series expansion of the moment equations, which at O(1/N) can be truncated to form a closed system of equations for the first-and second-order moments. Taking a continuum limit of the moment equations while keeping the system size N fixed generates a system of integrodifferential equations for the mean and covariance of the corresponding stochastic neural field model. We also show how the path integral approach can be used to study large deviation or rare event statistics underlying escape from the basin of attraction of a stable fixed point of the mean-field dynamics; such an analysis is not possible using the system-size expansion since the latter cannot accurately determine exponentially small transitions. © by SIAM.
Constitutive Modelling of INCONEL 718 using Artificial Neural Network
Abiriand Bhekisipho Twala, Olufunminiyi
2017-08-01
Artificial neural network is used to model INCONEL 718 in this paper. The model accounts for precipitate hardening in the alloy. The input variables for the neural network model are strain, strain rate, temperature and microstructure state. The output variable is the flow stress. The early stopping technique is combined with Bayesian regularization process in training the network. Sample and non-sample measurement data were taken from the literature. The model predictions of flow stress of the alloy are in good agreement with experimental measurements.
An ART neural network model of discrimination shift learning
Raijmakers, M.E.J.; Coffey, E.; Stevenson, C.; Winkel, J.; Berkeljon, A.; Taatgen, N.; van Rijn, H.
2009-01-01
We present an ART-based neural network model (adapted from [2]) of the development of discrimination-shift learning that models the trial-by-trial learning process in great detail. In agreement with the results of human participants (4-20 years of age) in [1] the model revealed two distinct learning
Mantovanelli, Ivana C. C.; Rivera, Elmer Ccopa; da Costa, Aline C.; Filho, Rubens Maciel
In this work a procedure for the development of a robust mathematical model for an industrial alcoholic fermentation process was evaluated. The proposed model is a hybrid neural model, which combines mass and energy balance equations with functional link networks to describe the kinetics. These networks have been shown to have a good nonlinear approximation capability, although the estimation of its weights is linear. The proposed model considers the effect of temperature on the kinetics and has the neural network weights reestimated always so that a change in operational conditions occurs. This allow to follow the system behavior when changes in operating conditions occur.
DEFF Research Database (Denmark)
Chon, K H; Holstein-Rathlou, N H; Marsh, D J
1998-01-01
kernel estimation method based on Laguerre expansions. The results for the two types of artificial neural networks and the Volterra models are comparable in terms of normalized mean square error (NMSE) of the respective output prediction for independent testing data. However, the Volterra models obtained......In this paper, feedforward neural networks with two types of activation functions (sigmoidal and polynomial) are utilized for modeling the nonlinear dynamic relation between renal blood pressure and flow data, and their performance is compared to Volterra models obtained by use of the leading...... via the Laguerre expansion technique achieve this prediction NMSE with approximately half the number of free parameters relative to either neural-network model. However, both approaches are deemed effective in modeling nonlinear dynamic systems and their cooperative use is recommended in general....
Artificial neural network model for earthquake prediction with radon monitoring
Energy Technology Data Exchange (ETDEWEB)
Kuelahci, Fatih [Science and Art Faculty, Physics Department, Firat University, Elazig 23169 (Turkey)], E-mail: fatihkulahci@firat.edu.tr; Inceoez, Murat [Engineering Faculty, Geology Department, Firat University, Elazig 23169 (Turkey); Dogru, Mahmut [Science and Art Faculty, Physics Department, Firat University, Elazig 23169 (Turkey)], E-mail: mdogru@firat.edu.tr; Aksoy, Ercan [Engineering Faculty, Geology Department, Firat University, Elazig 23169 (Turkey); Baykara, Oktay [Education Faculty, Science Education Division, Firat University, Elazig 23169 (Turkey)
2009-01-15
Apart from the linear monitoring studies concerning the relationship between radon and earthquake, an artificial neural networks (ANNs) model approach is presented starting out from non-linear changes of the eight different parameters during the earthquake occurrence. A three-layer Levenberg-Marquardt feedforward learning algorithm is used to model the earthquake prediction process in the East Anatolian Fault System (EAFS). The proposed ANN system employs individual training strategy with fixed-weight and supervised models leading to estimations. The average relative error between the magnitudes of the earthquakes acquired by ANN and measured data is about 2.3%. The relative error between the test and earthquake data varies between 0% and 12%. In addition, the factor analysis was applied on all data and the model output values to see the statistical variation. The total variance of 80.18% was explained with four factors by this analysis. Consequently, it can be concluded that ANN approach is a potential alternative to other models with complex mathematical operations.
Peng, Jinzhu; Dubay, Rickey
2011-10-01
In this paper, an adaptive control approach based on the neural networks is presented to control a DC motor system with dead-zone characteristics (DZC), where two neural networks are proposed to formulate the traditional identification and control approaches. First, a Wiener-type neural network (WNN) is proposed to identify the motor DZC, which formulates the Wiener model with a linear dynamic block in cascade with a nonlinear static gain. Second, a feedforward neural network is proposed to formulate the traditional PID controller, termed as PID-type neural network (PIDNN), which is then used to control and compensate for the DZC. In this way, the DC motor system with DZC is identified by the WNN identifier, which provides model information to the PIDNN controller in order to make it adaptive. Back-propagation algorithms are used to train both neural networks. Also, stability and convergence analysis are conducted using the Lyapunov theorem. Finally, experiments on the DC motor system demonstrated accurate identification and good compensation for dead-zone with improved control performance over the conventional PID control. Copyright © 2011 ISA. Published by Elsevier Ltd. All rights reserved.
Forecast of consumer behaviour based on neural networks models comparison
Directory of Open Access Journals (Sweden)
Michael Štencl
2012-01-01
Full Text Available The aim of this article is comparison of accuracy level of forecasted values of several artificial neural network models. The comparison is performed on datasets of Czech household consumption values. Several statistical models often resolve this task with more or fewer restrictions. In previous work where models’ input conditions were not so strict and model with missing data was used (the time series didn’t contain many values we have obtained comparably good results with artificial neural networks. Two views – practical and theoretical, motivate the purpose of this study. Forecasting models for medium term prognosis of the main trends of Czech household consumption is part of the faculty research design grant MSM 6215648904/03/02 (Sub-task 5.3 which defines the practical purpose. Testing of nonlinear autoregressive artificial neural network model compared with feed-forward neural network and radial basis function neural network defines the theoretical purpose. The performance metrics of the models were evaluated using a combination of common error metrics, namely Correlation Coefficient and Mean Square Error, together with the number of epochs and/or main prediction error.
Artificial neural networks modeling gene-environment interaction
Directory of Open Access Journals (Sweden)
Günther Frauke
2012-05-01
Full Text Available Abstract Background Gene-environment interactions play an important role in the etiological pathway of complex diseases. An appropriate statistical method for handling a wide variety of complex situations involving interactions between variables is still lacking, especially when continuous variables are involved. The aim of this paper is to explore the ability of neural networks to model different structures of gene-environment interactions. A simulation study is set up to compare neural networks with standard logistic regression models. Eight different structures of gene-environment interactions are investigated. These structures are characterized by penetrance functions that are based on sigmoid functions or on combinations of linear and non-linear effects of a continuous environmental factor and a genetic factor with main effect or with a masking effect only. Results In our simulation study, neural networks are more successful in modeling gene-environment interactions than logistic regression models. This outperfomance is especially pronounced when modeling sigmoid penetrance functions, when distinguishing between linear and nonlinear components, and when modeling masking effects of the genetic factor. Conclusion Our study shows that neural networks are a promising approach for analyzing gene-environment interactions. Especially, if no prior knowledge of the correct nature of the relationship between co-variables and response variable is present, neural networks provide a valuable alternative to regression methods that are limited to the analysis of linearly separable data.
Standard representation and unified stability analysis for dynamic artificial neural network models.
Kim, Kwang-Ki K; Patrón, Ernesto Ríos; Braatz, Richard D
2017-12-02
An overview is provided of dynamic artificial neural network models (DANNs) for nonlinear dynamical system identification and control problems, and convex stability conditions are proposed that are less conservative than past results. The three most popular classes of dynamic artificial neural network models are described, with their mathematical representations and architectures followed by transformations based on their block diagrams that are convenient for stability and performance analyses. Classes of nonlinear dynamical systems that are universally approximated by such models are characterized, which include rigorous upper bounds on the approximation errors. A unified framework and linear matrix inequality-based stability conditions are described for different classes of dynamic artificial neural network models that take additional information into account such as local slope restrictions and whether the nonlinearities within the DANNs are odd. A theoretical example shows reduced conservatism obtained by the conditions. Copyright © 2017. Published by Elsevier Ltd.
Stability of a neural predictive controller scheme on a neural model
DEFF Research Database (Denmark)
Luther, Jim Benjamin; Sørensen, Paul Haase
2009-01-01
In previous works presenting various forms of neural-network-based predictive controllers, the main emphasis has been on the implementation aspects, i.e. the development of a robust optimization algorithm for the controller, which will be able to perform in real time. However, the stability issue....... The resulting controller is tested on a nonlinear pneumatic servo system....
National Research Council Canada - National Science Library
Napolitano, Marcello
2002-01-01
This project focused on investigating the potential of on-line learning 'hardware-based' neural approximators and controllers to provide fault tolerance capabilities following sensor and actuator failures...
On-line identification of hybrid systems using an adaptive growing and pruning RBF neural network
DEFF Research Database (Denmark)
Alizadeh, Tohid
2008-01-01
This paper introduces an adaptive growing and pruning radial basis function (GAP-RBF) neural network for on-line identification of hybrid systems. The main idea is to identify a global nonlinear model that can predict the continuous outputs of hybrid systems. In the proposed approach, GAP-RBF neu...
Directory of Open Access Journals (Sweden)
Poramate eManoonpong
2013-02-01
Full Text Available Living creatures, like walking animals, have found fascinating solutions for the problem of locomotion control. Their movements show the impression of elegance including versatile, energy-efficient, and adaptable locomotion. During the last few decades, roboticists have tried to imitate such natural properties with artificial legged locomotion systems by using different approaches including machine learning algorithms, classical engineering control techniques, and biologically-inspired control mechanisms. However, their levels of performance are still far from the natural ones. By contrast, animal locomotion mechanisms seem to largely depend not only on central mechanisms (central pattern generators, CPGs and sensory feedback (afferent-based control but also on internal forward models (efference copies. They are used to a different degree in different animals. Generally, CPGs organize basic rhythmic motions which are shaped by sensory feedback while internal models are used for sensory prediction and state estimations. According to this concept, we present here adaptive neural locomotion control consisting of a CPG mechanism with neuromodulation and local leg control mechanisms based on sensory feedback and adaptive neural forward models with efference copies. This neural closed-loop controller enables a walking machine to perform a multitude of different walking patterns including insect-like leg movements and gaits as well as energy-efficient locomotion. In addition, the forward models allow the machine to autonomously adapt its locomotion to deal with a change of terrain, losing of ground contact during stance phase, stepping on or hitting an obstacle during swing phase, leg damage, and even to promote cockroach-like climbing behavior. Thus, the results presented here show that the employed embodied neural closed-loop system can be a powerful way for developing robust and adaptable machines.
Manoonpong, Poramate; Parlitz, Ulrich; Wörgötter, Florentin
2013-01-01
Living creatures, like walking animals, have found fascinating solutions for the problem of locomotion control. Their movements show the impression of elegance including versatile, energy-efficient, and adaptable locomotion. During the last few decades, roboticists have tried to imitate such natural properties with artificial legged locomotion systems by using different approaches including machine learning algorithms, classical engineering control techniques, and biologically-inspired control mechanisms. However, their levels of performance are still far from the natural ones. By contrast, animal locomotion mechanisms seem to largely depend not only on central mechanisms (central pattern generators, CPGs) and sensory feedback (afferent-based control) but also on internal forward models (efference copies). They are used to a different degree in different animals. Generally, CPGs organize basic rhythmic motions which are shaped by sensory feedback while internal models are used for sensory prediction and state estimations. According to this concept, we present here adaptive neural locomotion control consisting of a CPG mechanism with neuromodulation and local leg control mechanisms based on sensory feedback and adaptive neural forward models with efference copies. This neural closed-loop controller enables a walking machine to perform a multitude of different walking patterns including insect-like leg movements and gaits as well as energy-efficient locomotion. In addition, the forward models allow the machine to autonomously adapt its locomotion to deal with a change of terrain, losing of ground contact during stance phase, stepping on or hitting an obstacle during swing phase, leg damage, and even to promote cockroach-like climbing behavior. Thus, the results presented here show that the employed embodied neural closed-loop system can be a powerful way for developing robust and adaptable machines.
Reduced-Order Modeling for Flutter/LCO Using Recurrent Artificial Neural Network
Yao, Weigang; Liou, Meng-Sing
2012-01-01
The present study demonstrates the efficacy of a recurrent artificial neural network to provide a high fidelity time-dependent nonlinear reduced-order model (ROM) for flutter/limit-cycle oscillation (LCO) modeling. An artificial neural network is a relatively straightforward nonlinear method for modeling an input-output relationship from a set of known data, for which we use the radial basis function (RBF) with its parameters determined through a training process. The resulting RBF neural network, however, is only static and is not yet adequate for an application to problems of dynamic nature. The recurrent neural network method [1] is applied to construct a reduced order model resulting from a series of high-fidelity time-dependent data of aero-elastic simulations. Once the RBF neural network ROM is constructed properly, an accurate approximate solution can be obtained at a fraction of the cost of a full-order computation. The method derived during the study has been validated for predicting nonlinear aerodynamic forces in transonic flow and is capable of accurate flutter/LCO simulations. The obtained results indicate that the present recurrent RBF neural network is accurate and efficient for nonlinear aero-elastic system analysis
SCYNet. Testing supersymmetric models at the LHC with neural networks
Energy Technology Data Exchange (ETDEWEB)
Bechtle, Philip; Belkner, Sebastian; Hamer, Matthias [Universitaet Bonn, Bonn (Germany); Dercks, Daniel [Universitaet Hamburg, Hamburg (Germany); Keller, Tim; Kraemer, Michael; Sarrazin, Bjoern; Schuette-Engel, Jan; Tattersall, Jamie [RWTH Aachen University, Institute for Theoretical Particle Physics and Cosmology, Aachen (Germany)
2017-10-15
SCYNet (SUSY Calculating Yield Net) is a tool for testing supersymmetric models against LHC data. It uses neural network regression for a fast evaluation of the profile likelihood ratio. Two neural network approaches have been developed: one network has been trained using the parameters of the 11-dimensional phenomenological Minimal Supersymmetric Standard Model (pMSSM-11) as an input and evaluates the corresponding profile likelihood ratio within milliseconds. It can thus be used in global pMSSM-11 fits without time penalty. In the second approach, the neural network has been trained using model-independent signature-related objects, such as energies and particle multiplicities, which were estimated from the parameters of a given new physics model. (orig.)
SCYNet: testing supersymmetric models at the LHC with neural networks
Bechtle, Philip; Belkner, Sebastian; Dercks, Daniel; Hamer, Matthias; Keller, Tim; Krämer, Michael; Sarrazin, Björn; Schütte-Engel, Jan; Tattersall, Jamie
2017-10-01
SCYNet (SUSY Calculating Yield Net) is a tool for testing supersymmetric models against LHC data. It uses neural network regression for a fast evaluation of the profile likelihood ratio. Two neural network approaches have been developed: one network has been trained using the parameters of the 11-dimensional phenomenological Minimal Supersymmetric Standard Model (pMSSM-11) as an input and evaluates the corresponding profile likelihood ratio within milliseconds. It can thus be used in global pMSSM-11 fits without time penalty. In the second approach, the neural network has been trained using model-independent signature-related objects, such as energies and particle multiplicities, which were estimated from the parameters of a given new physics model.
Modelling of word usage frequency dynamics using artificial neural network
Maslennikova, Yu S.; Bochkarev, V. V.; Voloskov, D. S.
2014-03-01
In this paper the method for modelling of word usage frequency time series is proposed. An artificial feedforward neural network was used to predict word usage frequencies. The neural network was trained using the maximum likelihood criterion. The Google Books Ngram corpus was used for the analysis. This database provides a large amount of data on frequency of specific word forms for 7 languages. Statistical modelling of word usage frequency time series allows finding optimal fitting and filtering algorithm for subsequent lexicographic analysis and verification of frequency trend models.
Sheikhtaheri, Abbas; Sadoughi, Farahnaz; Hashemi Dehaghi, Zahra
2014-09-01
Complicacy of clinical decisions justifies utilization of information systems such as artificial intelligence (e.g. expert systems and neural networks) to achieve better decisions, however, application of these systems in the medical domain faces some challenges. We aimed at to review the applications of these systems in the medical domain and discuss about such challenges. Following a brief introduction of expert systems and neural networks by representing few examples, the challenges of these systems in the medical domain are discussed. We found that the applications of expert systems and artificial neural networks have been increased in the medical domain. These systems have shown many advantages such as utilization of experts' knowledge, gaining rare knowledge, more time for assessment of the decision, more consistent decisions, and shorter decision-making process. In spite of all these advantages, there are challenges ahead of developing and using such systems including maintenance, required experts, inputting patients' data into the system, problems for knowledge acquisition, problems in modeling medical knowledge, evaluation and validation of system performance, wrong recommendations and responsibility, limited domains of such systems and necessity of integrating such systems into the routine work flows. We concluded that expert systems and neural networks can be successfully used in medicine; however, there are many concerns and questions to be answered through future studies and discussions.
Broccard, Frédéric D.; Joshi, Siddharth; Wang, Jun; Cauwenberghs, Gert
2017-08-01
Objective. Computation in nervous systems operates with different computational primitives, and on different hardware, than traditional digital computation and is thus subjected to different constraints from its digital counterpart regarding the use of physical resources such as time, space and energy. In an effort to better understand neural computation on a physical medium with similar spatiotemporal and energetic constraints, the field of neuromorphic engineering aims to design and implement electronic systems that emulate in very large-scale integration (VLSI) hardware the organization and functions of neural systems at multiple levels of biological organization, from individual neurons up to large circuits and networks. Mixed analog/digital neuromorphic VLSI systems are compact, consume little power and operate in real time independently of the size and complexity of the model. Approach. This article highlights the current efforts to interface neuromorphic systems with neural systems at multiple levels of biological organization, from the synaptic to the system level, and discusses the prospects for future biohybrid systems with neuromorphic circuits of greater complexity. Main results. Single silicon neurons have been interfaced successfully with invertebrate and vertebrate neural networks. This approach allowed the investigation of neural properties that are inaccessible with traditional techniques while providing a realistic biological context not achievable with traditional numerical modeling methods. At the network level, populations of neurons are envisioned to communicate bidirectionally with neuromorphic processors of hundreds or thousands of silicon neurons. Recent work on brain-machine interfaces suggests that this is feasible with current neuromorphic technology. Significance. Biohybrid interfaces between biological neurons and VLSI neuromorphic systems of varying complexity have started to emerge in the literature. Primarily intended as a
An Adaptive Neural Mechanism with a Lizard Ear Model for Binaural Acoustic Tracking
DEFF Research Database (Denmark)
Shaikh, Danish; Manoonpong, Poramate
2016-01-01
Acoustic tracking of a moving sound source is relevant in many domains including robotic phonotaxis and human-robot interaction. Typical approaches rely on processing time-difference-of-arrival cues obtained via multi-microphone arrays with Kalman or particle filters, or other computationally...... expensive algorithms. We present a novel bioinspired solution to acoustic tracking that uses only two microphones. The system is based on a neural mechanism coupled with a model of the peripheral auditory system of lizards. The peripheral auditory model provides sound direction information which the neural...
Adaptive Control of Nonlinear Discrete-Time Systems by Using OS-ELM Neural Networks
Directory of Open Access Journals (Sweden)
Xiao-Li Li
2014-01-01
Full Text Available As a kind of novel feedforward neural network with single hidden layer, ELM (extreme learning machine neural networks are studied for the identification and control of nonlinear dynamic systems. The property of simple structure and fast convergence of ELM can be shown clearly. In this paper, we are interested in adaptive control of nonlinear dynamic plants by using OS-ELM (online sequential extreme learning machine neural networks. Based on data scope division, the problem that training process of ELM neural network is sensitive to the initial training data is also solved. According to the output range of the controlled plant, the data corresponding to this range will be used to initialize ELM. Furthermore, due to the drawback of conventional adaptive control, when the OS-ELM neural network is used for adaptive control of the system with jumping parameters, the topological structure of the neural network can be adjusted dynamically by using multiple model switching strategy, and an MMAC (multiple model adaptive control will be used to improve the control performance. Simulation results are included to complement the theoretical results.
Modular Neural Networks and Type-2 Fuzzy Systems for Pattern Recognition
Melin, Patricia
2012-01-01
This book describes hybrid intelligent systems using type-2 fuzzy logic and modular neural networks for pattern recognition applications. Hybrid intelligent systems combine several intelligent computing paradigms, including fuzzy logic, neural networks, and bio-inspired optimization algorithms, which can be used to produce powerful pattern recognition systems. Type-2 fuzzy logic is an extension of traditional type-1 fuzzy logic that enables managing higher levels of uncertainty in complex real world problems, which are of particular importance in the area of pattern recognition. The book is organized in three main parts, each containing a group of chapters built around a similar subject. The first part consists of chapters with the main theme of theory and design algorithms, which are basically chapters that propose new models and concepts, which are the basis for achieving intelligent pattern recognition. The second part contains chapters with the main theme of using type-2 fuzzy models and modular neural ne...
Neural network based optimal control of HVAC&R systems
Ning, Min
Heating, Ventilation, Air-Conditioning and Refrigeration (HVAC&R) systems have wide applications in providing a desired indoor environment for different types of buildings. It is well acknowledged that 30%-40% of the total energy generated is consumed by buildings and HVAC&R systems alone account for more than 50% of the building energy consumption. Low operational efficiency especially under partial load conditions and poor control are part of reasons for such high energy consumption. To improve energy efficiency, HVAC&R systems should be properly operated to maintain a comfortable and healthy indoor environment under dynamic ambient and indoor conditions with the least energy consumption. This research focuses on the optimal operation of HVAC&R systems. The optimization problem is formulated and solved to find the optimal set points for the chilled water supply temperature, discharge air temperature and AHU (air handling unit) fan static pressure such that the indoor environment is maintained with the least chiller and fan energy consumption. To achieve this objective, a dynamic system model is developed first to simulate the system behavior under different control schemes and operating conditions. The system model is modular in structure, which includes a water-cooled vapor compression chiller model and a two-zone VAV system model. A fuzzy-set based extended transformation approach is then applied to investigate the uncertainties of this model caused by uncertain parameters and the sensitivities of the control inputs with respect to the interested model outputs. A multi-layer feed forward neural network is constructed and trained in unsupervised mode to minimize the cost function which is comprised of overall energy cost and penalty cost when one or more constraints are violated. After training, the network is implemented as a supervisory controller to compute the optimal settings for the system. In order to implement the optimal set points predicted by the
Robust Quasi-LPV Control Based on Neural State Space Models
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon; Trangbæk, Klaus
2002-01-01
In this paper we derive a synthesis result for robust LPV output feedback controllers for nonlinear systems modelled by neural state space models. This result is achieved by writing the neural state space model on a linear fractional transformation form in a non-conservative way, separating...... that there is some uncertainty on the identified nonlinearities. The control law is therefore made robust to noise perturbations. After formulating the controller synthesis as a set of LMIs with added constraints, some implementation issues are addressed and a simulation example is presented....
Data Driven Broiler Weight Forecasting using Dynamic Neural Network Models
DEFF Research Database (Denmark)
Johansen, Simon Vestergaard; Bendtsen, Jan Dimon; Riisgaard-Jensen, Martin
2017-01-01
In this article, the dynamic influence of environmental broiler house conditions and broiler growth is investigated. Dynamic neural network forecasting models have been trained on farm-scale broiler batch production data from 12 batches from the same house. The model forecasts future broiler weight...
An artificial neural network based fast radiative transfer model for ...
Indian Academy of Sciences (India)
the present study, a fast radiative transfer model using neural networks is proposed to simulate radiances corresponding to the wavenumbers of ... in construction, purpose and design and already in use are used. The fast RT model is able to ... porates measurements from various instruments in comparison with other ...
Discriminative training of self-structuring hidden control neural models
DEFF Research Database (Denmark)
Sørensen, Helge Bjarup Dissing; Hartmann, Uwe; Hunnerup, Preben
1995-01-01
This paper presents a new training algorithm for self-structuring hidden control neural (SHC) models. The SHC models were trained non-discriminatively for speech recognition applications. Better recognition performance can generally be achieved, if discriminative training is applied instead. Thus...
Artificial Neural Networks for Modeling Knowing and Learning in Science.
Roth, Wolff-Michael
2000-01-01
Advocates artificial neural networks as models for cognition and development. Provides an example of how such models work in the context of a well-known Piagetian developmental task and school science activity: balance beam problems. (Contains 59 references.) (Author/WRM)
Hu, Scott B; Wong, Deborah J L; Correa, Aditi; Li, Ning; Deng, Jane C
2016-01-01
Clinical deterioration (ICU transfer and cardiac arrest) occurs during approximately 5-10% of hospital admissions. Existing prediction models have a high false positive rate, leading to multiple false alarms and alarm fatigue. We used routine vital signs and laboratory values obtained from the electronic medical record (EMR) along with a machine learning algorithm called a neural network to develop a prediction model that would increase the predictive accuracy and decrease false alarm rates. Retrospective cohort study. The hematologic malignancy unit in an academic medical center in the United States. Adult patients admitted to the hematologic malignancy unit from 2009 to 2010. None. Vital signs and laboratory values were obtained from the electronic medical record system and then used as predictors (features). A neural network was used to build a model to predict clinical deterioration events (ICU transfer and cardiac arrest). The performance of the neural network model was compared to the VitalPac Early Warning Score (ViEWS). Five hundred sixty five consecutive total admissions were available with 43 admissions resulting in clinical deterioration. Using simulation, the neural network outperformed the ViEWS model with a positive predictive value of 82% compared to 24%, respectively. We developed and tested a neural network-based prediction model for clinical deterioration in patients hospitalized in the hematologic malignancy unit. Our neural network model outperformed an existing model, substantially increasing the positive predictive value, allowing the clinician to be confident in the alarm raised. This system can be readily implemented in a real-time fashion in existing EMR systems.
Neural signal sampling via the low power wireless pico system.
Cieslewski, Grzegorz; Cheney, David; Gugel, Karl; Sanchez, Justin C; Principe, Jose C
2006-01-01
This paper presents a powerful new low power wireless system for sampling multiple channels of neural activity based on Texas Instruments MSP430 microprocessors and Nordic Semiconductor's ultra low power high bandwidth RF transmitters and receivers. The system's development process, component selection, features and test methodology are presented.
Neural expert decision support system for stroke diagnosis
Kupershtein, Leonid M.; Martyniuk, Tatiana B.; Krencin, Myhail D.; Kozhemiako, Andriy V.; Bezsmertnyi, Yurii; Bezsmertna, Halyna; Kolimoldayev, Maksat; Smolarz, Andrzej; Weryńska-Bieniasz, RóŻa; Uvaysova, Svetlana
2017-08-01
In the work the hybrid expert system for stroke diagnosis was presented. The base of expert system consists of neural network and production rules. This program can quickly and accurately set to the patient preliminary and final diagnoses, get examination and treatment plans, print data of patient, analyze statistics data and perform parameterized search for patients.
Using artificial neural network approach for modelling rainfall–runoff ...
Indian Academy of Sciences (India)
Home; Journals; Journal of Earth System Science; Volume 122; Issue 2. Using artificial neural network approach for ... In Taiwan, owing to the nonuniform temporal and spatial distribution of rainfall and high mountains all over the country, hydrologic systems are very complex. Therefore, preventing and controlling flood ...
Reject mechanisms for massively parallel neural network character recognition systems
Garris, Michael D.; Wilson, Charles L.
1992-12-01
Two reject mechanisms are compared using a massively parallel character recognition system implemented at NIST. The recognition system was designed to study the feasibility of automatically recognizing hand-printed text in a loosely constrained environment. The first method is a simple scalar threshold on the output activation of the winning neurode from the character classifier network. The second method uses an additional neural network trained on all outputs from the character classifier network to accept or reject assigned classifications. The neural network rejection method was expected to perform with greater accuracy than the scalar threshold method, but this was not supported by the test results presented. The scalar threshold method, even though arbitrary, is shown to be a viable reject mechanism for use with neural network character classifiers. Upon studying the performance of the neural network rejection method, analyses show that the two neural networks, the character classifier network and the rejection network, perform very similarly. This can be explained by the strong non-linear function of the character classifier network which effectively removes most of the correlation between character accuracy and all activations other than the winning activation. This suggests that any effective rejection network must receive information from the system which has not been filtered through the non-linear classifier.
[Robustness analysis of adaptive neural network model based on spike timing-dependent plasticity].
Chen, Yunzhi; Xu, Guizhi; Zhou, Qian; Guo, Miaomiao; Guo, Lei; Wan, Xiaowei
2015-02-01
To explore the self-organization robustness of the biological neural network, and thus to provide new ideas and methods for the electromagnetic bionic protection, we studied both the information transmission mechanism of neural network and spike timing-dependent plasticity (STDP) mechanism, and then investigated the relationship between synaptic plastic and adaptive characteristic of biology. Then a feedforward neural network with the Izhikevich model and the STDP mechanism was constructed, and the adaptive robust capacity of the network was analyzed. Simulation results showed that the neural network based on STDP mechanism had good rubustness capacity, and this characteristics is closely related to the STDP mechanisms. Based on this simulation work, the cell circuit with neurons and synaptic circuit which can simulate the information processing mechanisms of biological nervous system will be further built, then the electronic circuits with adaptive robustness will be designed based on the cell circuit.
Estimation of Effectivty Connectivity via Data-Driven Neural Modeling
Directory of Open Access Journals (Sweden)
Dean Robert Freestone
2014-11-01
Full Text Available This research introduces a new method for functional brain imaging via a process of model inversion. By estimating parameters of a computational model, we are able to track effective connectivity and mean membrane potential dynamics that cannot be directly measured using electrophysiological measurements alone. The ability to track the hidden aspects of neurophysiology will have a profound impact on the way we understand and treat epilepsy. For example, under the assumption the model captures the key features of the cortical circuits of interest, the framework will provide insights into seizure initiation and termination on a patient-specific basis. It will enable investigation into the effect a particular drug has on specific neural populations and connectivity structures using minimally invasive measurements. The method is based on approximating brain networks using an interconnected neural population model. The neural population model is based on a neural mass model that describes the functional activity of the brain, capturing the mesoscopic biophysics and anatomical structure. The model is made subject-specific by estimating the strength of intra-cortical connections within a region and inter-cortical connections between regions using a novel Kalman filtering method. We demonstrate through simulation how the framework can be used the track the mechanisms involved in seizure initiation and termination.
Adaptive Synchronization of Memristor-based Chaotic Neural Systems
Directory of Open Access Journals (Sweden)
Xiaofang Hu
2014-11-01
Full Text Available Chaotic neural networks consisting of a great number of chaotic neurons are able to reproduce the rich dynamics observed in biological nervous systems. In recent years, the memristor has attracted much interest in the efficient implementation of artificial synapses and neurons. This work addresses adaptive synchronization of a class of memristor-based neural chaotic systems using a novel adaptive backstepping approach. A systematic design procedure is presented. Simulation results have demonstrated the effectiveness of the proposed adaptive synchronization method and its potential in practical application of memristive chaotic oscillators in secure communication.
Backpropagation Neural Network Modeling for Fault Location in Transmission Line 150 kV
Directory of Open Access Journals (Sweden)
Azriyenni Narwan
2014-03-01
Full Text Available In this topic research was provided about the backpropagation neural network to detect fault location in transmission line 150 kV between substation to substation. The distance relay is one of the good protective device and safety devices that often used on transmission line 150 kV. The disturbances in power system are used distance relay protection equipment in the transmission line. However, it needs more increasing large load and network systems are increasing complex. The protection system use the digital control, in order to avoid the error calculation of the distance relay impedance settings and spent time will be more efficient. Then backpropagation neural network is a computational model that uses the training process that can be used to solve the problem of work limitations of distance protection relays. The backpropagation neural network does not have limitations cause of the impedance range setting. If the output gives the wrong result, so the correct of the weights can be minimized and also the response of galat, the backpropagation neural network is expected to be closer to the correct value. In the end, backpropagation neural network modeling is expected to detect the fault location and identify operational output current circuit breaker was tripped it. The tests are performance with interconnected system 150 kV of Riau Region.
A dynamical systems view of motor preparation: Implications for neural prosthetic system design
Shenoy, Krishna V.; Kaufman, Matthew T.; Sahani, Maneesh; Churchland, Mark M.
2013-01-01
Neural prosthetic systems aim to help disabled patients suffering from a range of neurological injuries and disease by using neural activity from the brain to directly control assistive devices. This approach in effect bypasses the dysfunctional neural circuitry, such as an injured spinal cord. To do so, neural prostheses depend critically on a scientific understanding of the neural activity that drives them. We review here several recent studies aimed at understanding the neural processes in premotor cortex that precede arm movements and lead to the initiation of movement. These studies were motivated by hypotheses and predictions conceived of within a dynamical systems perspective. This perspective concentrates on describing the neural state using as few degrees of freedom as possible and on inferring the rules that govern the motion of that neural state. Although quite general, this perspective has led to a number of specific predictions that have been addressed experimentally. It is hoped that the resulting picture of the dynamical role of preparatory and movement-related neural activity will be particularly helpful to the development of neural prostheses, which can themselves be viewed as dynamical systems under the control of the larger dynamical system to which they are attached. PMID:21763517
On the nature, modeling, and neural bases of social ties.
van Winden, Frans; Stallen, Mirre; Ridderinkhof, K Richard
2008-01-01
This chapter addresses the nature, formalization, and neural bases of (affective) social ties and discusses the relevance of ties for health economics. A social tie is defined as an affective weight attached by an individual to the well-being of another individual ('utility interdependence'). Ties can be positive or negative, and symmetric or asymmetric between individuals. Characteristic of a social tie, as conceived of here, is that it develops over time under the influence of interaction, in contrast with a trait like altruism. Moreover, a tie is not related to strategic behavior such as reputation formation but seen as generated by affective responses. A formalization is presented together with some supportive evidence from behavioral experiments. This is followed by a discussion of related psychological constructs and the presentation of suggestive existing neural findings. To help prepare the grounds for a model-based neural analysis some speculations on the neural networks involved are provided, together with suggestions for future research. Social ties are not only found to be important from an economic viewpoint, it is also shown that they can be modeled and related to neural substrates. By providing an overview of the economic research on social ties and connecting it with the broader behavioral and neuroeconomics literature, the chapter may contribute to the development of a neuroeconomics of social ties.
Combining BMI stimulation and mathematical modeling for acute stroke recovery and neural repair
Directory of Open Access Journals (Sweden)
Sara L Gonzalez Andino
2011-07-01
Full Text Available Rehabilitation is a neural plasticity-exploiting approach that forces undamaged neural circuits to undertake the functionality of other circuits damaged by stroke. It aims to partial restoration of the neural functions by circuit remodeling rather than by the regeneration of damaged circuits. The core hypothesis of the present paper is that - in stroke - Brain Machine Interfaces can be designed to target neural repair instead of rehabilitation. To support this hypothesis we first review existing evidence on the role of endogenous or externally applied electric fields on all processes involved in CNS repair. We then describe our own results to illustrate the neuroprotective and neuroregenerative effects of BMI- electrical stimulation on sensory deprivation-related degenerative processes of the CNS. Finally, we discuss three of the crucial issues involved in the design of neural repair-oriented BMIs: when to stimulate, where to stimulate and - the particularly important but unsolved issue of - how to stimulate. We argue that optimal parameters for the electrical stimulation can be determined from studying and modeling the dynamics of the electric fields that naturally emerge at the central and peripheral nervous system during spontaneous healing in both, experimental animals and human patients. We conclude that a closed-loop BMI that defines the optimal stimulation parameters from a priori developed experimental models of the dynamics of spontaneous repair and the on-line monitoring of neural activity might place BMIs as an alternative or complement to stem-cell transplantation or pharmacological approaches, intensively pursued nowadays.
Directory of Open Access Journals (Sweden)
Xiaohu Li
2013-01-01
Full Text Available Being difficult to attain the precise mathematical models, traditional control methods such as proportional integral (PI and proportional integral differentiation (PID cannot meet the demands for real time and robustness when applied in some nonlinear systems. The neural network controller is a good replacement to overcome these shortcomings. However, the performance of neural network controller is directly determined by neural network model. In this paper, a new neural network model is constructed with a structure topology between the regular and random connection modes based on complex network, which simulates the brain neural network as far as possible, to design a better neural network controller. Then, a new controller is designed under small-world neural network model and is investigated in both linear and nonlinear systems control. The simulation results show that the new controller basing on small-world network model can improve the control precision by 30% in the case of system with random disturbance. Besides the good performance of the new controller in tracking square wave signals, which is demonstrated by the experiment results of direct drive electro-hydraulic actuation position control system, it works well on anti-interference performance.
Directory of Open Access Journals (Sweden)
Laila Khalilzadeh Ganjali-khani
2013-01-01
Full Text Available One of the most effective strategies for steam generator efficiency enhancement is to improve the control system. For such an improvement, it is essential to have an accurate model for the steam generator of power plant. In this paper, an industrial steam generator is considered as a nonlinear multivariable system for identification. An important step in nonlinear system identification is the development of a nonlinear model. In recent years, artificial neural networks have been successfully used for identification of nonlinear systems in many researches. Wavelet neural networks (WNNs also are used as a powerful tool for nonlinear system identification. In this paper we present a time delay neural network model and a WNN model in order to identify an industrial steam generator. Simulation results show the effectiveness of the proposed models in the system identification and demonstrate that the WNN model is more precise to estimate the plant outputs.
Modeling brain resonance phenomena using a neural mass model.
Directory of Open Access Journals (Sweden)
Andreas Spiegler
2011-12-01
Full Text Available Stimulation with rhythmic light flicker (photic driving plays an important role in the diagnosis of schizophrenia, mood disorder, migraine, and epilepsy. In particular, the adjustment of spontaneous brain rhythms to the stimulus frequency (entrainment is used to assess the functional flexibility of the brain. We aim to gain deeper understanding of the mechanisms underlying this technique and to predict the effects of stimulus frequency and intensity. For this purpose, a modified Jansen and Rit neural mass model (NMM of a cortical circuit is used. This mean field model has been designed to strike a balance between mathematical simplicity and biological plausibility. We reproduced the entrainment phenomenon observed in EEG during a photic driving experiment. More generally, we demonstrate that such a single area model can already yield very complex dynamics, including chaos, for biologically plausible parameter ranges. We chart the entire parameter space by means of characteristic Lyapunov spectra and Kaplan-Yorke dimension as well as time series and power spectra. Rhythmic and chaotic brain states were found virtually next to each other, such that small parameter changes can give rise to switching from one to another. Strikingly, this characteristic pattern of unpredictability generated by the model was matched to the experimental data with reasonable accuracy. These findings confirm that the NMM is a useful model of brain dynamics during photic driving. In this context, it can be used to study the mechanisms of, for example, perception and epileptic seizure generation. In particular, it enabled us to make predictions regarding the stimulus amplitude in further experiments for improving the entrainment effect.
Honey characterization using computer vision system and artificial neural networks.
Shafiee, Sahameh; Minaei, Saeid; Moghaddam-Charkari, Nasrollah; Barzegar, Mohsen
2014-09-15
This paper reports the development of a computer vision system (CVS) for non-destructive characterization of honey based on colour and its correlated chemical attributes including ash content (AC), antioxidant activity (AA), and total phenolic content (TPC). Artificial neural network (ANN) models were applied to transform RGB values of images to CIE L*a*b* colourimetric measurements and to predict AC, TPC and AA from colour features of images. The developed ANN models were able to convert RGB values to CIE L*a*b* colourimetric parameters with low generalization error of 1.01±0.99. In addition, the developed models for prediction of AC, TPC and AA showed high performance based on colour parameters of honey images, as the R(2) values for prediction were 0.99, 0.98, and 0.87, for AC, AA and TPC, respectively. The experimental results show the effectiveness and possibility of applying CVS for non-destructive honey characterization by the industry. Copyright © 2014 Elsevier Ltd. All rights reserved.
Abbaspour, Alireza; Aboutalebi, Payam; Yen, Kang K; Sargolzaei, Arman
2017-03-01
A new online detection strategy is developed to detect faults in sensors and actuators of unmanned aerial vehicle (UAV) systems. In this design, the weighting parameters of the Neural Network (NN) are updated by using the Extended Kalman Filter (EKF). Online adaptation of these weighting parameters helps to detect abrupt, intermittent, and incipient faults accurately. We apply the proposed fault detection system to a nonlinear dynamic model of the WVU YF-22 unmanned aircraft for its evaluation. The simulation results show that the new method has better performance in comparison with conventional recurrent neural network-based fault detection strategies. Copyright © 2016 ISA. Published by Elsevier Ltd. All rights reserved.
Modeling the behavioral substrates of associate learning and memory - Adaptive neural models
Lee, Chuen-Chien
1991-01-01
Three adaptive single-neuron models based on neural analogies of behavior modification episodes are proposed, which attempt to bridge the gap between psychology and neurophysiology. The proposed models capture the predictive nature of Pavlovian conditioning, which is essential to the theory of adaptive/learning systems. The models learn to anticipate the occurrence of a conditioned response before the presence of a reinforcing stimulus when training is complete. Furthermore, each model can find the most nonredundant and earliest predictor of reinforcement. The behavior of the models accounts for several aspects of basic animal learning phenomena in Pavlovian conditioning beyond previous related models. Computer simulations show how well the models fit empirical data from various animal learning paradigms.
Modeling of methane emissions using artificial neural network approach
Directory of Open Access Journals (Sweden)
Stamenković Lidija J.
2015-01-01
Full Text Available The aim of this study was to develop a model for forecasting CH4 emissions at the national level, using Artificial Neural Networks (ANN with broadly available sustainability, economical and industrial indicators as their inputs. ANN modeling was performed using two different types of architecture; a Backpropagation Neural Network (BPNN and a General Regression Neural Network (GRNN. A conventional multiple linear regression (MLR model was also developed in order to compare model performance and assess which model provides the best results. ANN and MLR models were developed and tested using the same annual data for 20 European countries. The ANN model demonstrated very good performance, significantly better than the MLR model. It was shown that a forecast of CH4 emissions at the national level using the ANN model can be made successfully and accurately for a future period of up to two years, thereby opening the possibility to apply such a modeling technique which can be used to support the implementation of sustainable development strategies and environmental management policies. [Projekat Ministarstva nauke Republike Srbije, br. 172007
Model-Following Controller Based on Neural Network for Variable Displacement Pump
Chu, Ming-Hui; Kang, Yuan; Chang, Yih-Fong; Liu, Yuan-Liang; Chang, Chuan-Wei
The variable displacement axial piston pump (VDAPP) is inherently nonlinear, time variant and subjected to load disturbance. The controls of flow and pressure of VDAPP are achieved by changing the swashplate angle. The swashplate actuators are controlled by an electro-hydraulic proportional valve (EHPV). It is reasonable for swashplate angle of a VDAPP to employ neural network based on adaptive control. In this study, the nonlinear model of the VDAPP with a three-way electro-hydraulic proportional valve is proposed, and a neural network model-following controller is designed to control the swashplate swivel angle. The time response for the swashplate angle is analyzed by simulation and experiment, and a favorable model-following characteristic is achieved. The proposed neural controller can conduct nonlinear control in VDAPP, enhance adaptability and robustness, and improve the performance of the control system.
Models of Acetylcholine and Dopamine Signals Differentially Improve Neural Representations
Holca-Lamarre, Raphaël; Lücke, Jörg; Obermayer, Klaus
2017-01-01
Biological and artificial neural networks (ANNs) represent input signals as patterns of neural activity. In biology, neuromodulators can trigger important reorganizations of these neural representations. For instance, pairing a stimulus with the release of either acetylcholine (ACh) or dopamine (DA) evokes long lasting increases in the responses of neurons to the paired stimulus. The functional roles of ACh and DA in rearranging representations remain largely unknown. Here, we address this question using a Hebbian-learning neural network model. Our aim is both to gain a functional understanding of ACh and DA transmission in shaping biological representations and to explore neuromodulator-inspired learning rules for ANNs. We model the effects of ACh and DA on synaptic plasticity and confirm that stimuli coinciding with greater neuromodulator activation are over represented in the network. We then simulate the physiological release schedules of ACh and DA. We measure the impact of neuromodulator release on the network's representation and on its performance on a classification task. We find that ACh and DA trigger distinct changes in neural representations that both improve performance. The putative ACh signal redistributes neural preferences so that more neurons encode stimulus classes that are challenging for the network. The putative DA signal adapts synaptic weights so that they better match the classes of the task at hand. Our model thus offers a functional explanation for the effects of ACh and DA on cortical representations. Additionally, our learning algorithm yields performances comparable to those of state-of-the-art optimisation methods in multi-layer perceptrons while requiring weaker supervision signals and interacting with synaptically-local weight updates. PMID:28690509
Aplication of artificial neural network model in aviation specialist training
Directory of Open Access Journals (Sweden)
Висиль Миколайович Казак
2016-02-01
Full Text Available This paper reviews the application of artificial neural network (ANN model in aviation specialist training. The ANN model is based on the dependence of residual knowledge of subjects of study on their individual abilities. The residual knowledge is the skills acquired by the subject before he is going for an occupation. The presented ANN model gives the possibility to predict the level of professional training of the specialists with high accuracy
Petkov, Nikolay
1995-01-01
A preprocessor based on a computational model of simple cells in the mammalian primary visual cortex is combined with a self-organising artificial neural network classifier. After learning with a sequence of input images, the output units of the system turn out to correspond to classes of input
Using fuzzy logic to integrate neural networks and knowledge-based systems
Yen, John
1991-01-01
Outlined here is a novel hybrid architecture that uses fuzzy logic to integrate neural networks and knowledge-based systems. The author's approach offers important synergistic benefits to neural nets, approximate reasoning, and symbolic processing. Fuzzy inference rules extend symbolic systems with approximate reasoning capabilities, which are used for integrating and interpreting the outputs of neural networks. The symbolic system captures meta-level information about neural networks and defines its interaction with neural networks through a set of control tasks. Fuzzy action rules provide a robust mechanism for recognizing the situations in which neural networks require certain control actions. The neural nets, on the other hand, offer flexible classification and adaptive learning capabilities, which are crucial for dynamic and noisy environments. By combining neural nets and symbolic systems at their system levels through the use of fuzzy logic, the author's approach alleviates current difficulties in reconciling differences between low-level data processing mechanisms of neural nets and artificial intelligence systems.
CITY TRANSPORT SYSTEM ECOLOGICAL STATE FORECASTING WITH THE USE OF NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Andrey Lyamzin
2017-11-01
Full Text Available Purpose: The purpose of this work is to develop an effective model for city transport system ecological state assessment using neural networks general concept. Methods: The proposed model is based on two neural networks work, taking into account the traffic density effect and the transit capacity level on urban areas. Results: Based on the synthesis of the fuzzy sets theory and neural networks basic principles, the city transport system ecological state assessing model is developed. The graphical representation of the model is given. A forecast reliability high degree is provided even at low learning rates and high dynamics of changing statistical data in the city transit traffic conditions. Conclusions: The use of fuzzy neural networks makes it possible to state a complete correspondence between fuzzy inference procedure mathematical representation and the urban transport system structure. The proposed model allows to formulate well-defined environmental guidelines when making decisions in the transit traffic field, taking into account the interests of enterprises, transport and the urban population, with the subsequent distribution of traffic flows in time and geographical space of the city industrial areas.
Classical Conditioning with Pulsed Integrated Neural Networks: Circuits and System
DEFF Research Database (Denmark)
Lehmann, Torsten
1998-01-01
In this paper we investigate on-chip learning for pulsed, integrated neural networks. We discuss the implementational problems the technology imposes on learning systems and we find that abiologically inspired approach using simple circuit structures is most likely to bring success. We develop a ...... chip to solve simple classical conditioning tasks, thus verifying the design methodologies put forward in the paper....
Neural network based system for script identification in Indian ...
Indian Academy of Sciences (India)
R. Narasimhan (Krishtel eMaging) 1461 1996 Oct 15 13:05:22
environments. The system developed includes a feature extractor and a modular neural network. The feature extractor consists of two stages. In the first stage ... environments is script/language identification (Muthusamy et al 1994; Hochberg et al 1997). ... In order to take advantage of the learning and generalization abilities ...
A breathing circuit alarm system based on neural networks.
Orr, J A; Westenskow, D R
1994-03-01
The objectives of our study were (1) to implement intelligent respiratory alarms with a neural network; and (2) to increase alarm specificity and decrease false-alarm rates compared with current alarms. We trained a neural network to recognize 13 faults in an anesthesia breathing circuit. The system extracted 30 breath-to-breath features from the airway CO2, flow, and pressure signals. We created training data for the network by introducing 13 faults repeatedly in 5 dogs (616 total faults). We used the data to train the neural network using the backward error propagation algorithm. In animals, the trained network reported the alarms correctly for 95.0% of the faults when tested during controlled ventilation, and for 86.9% of the faults during spontaneous breathing. When tested in the operating room, the system found and correctly reported 54 of 57 faults that occurred during 43.6 hr of use. The alarm system produced a total of 74 false alarms during 43.6 hr of monitoring. Neural networks may be useful in creating intelligent anesthesia alarm systems.
THE USE OF NEURAL NETWORK TECHNOLOGY TO MODEL SWIMMING PERFORMANCE
Directory of Open Access Journals (Sweden)
António José Silva
2007-03-01
Full Text Available The aims of the present study were: to identify the factors which are able to explain the performance in the 200 meters individual medley and 400 meters front crawl events in young swimmers, to model the performance in those events using non-linear mathematic methods through artificial neural networks (multi-layer perceptrons and to assess the neural network models precision to predict the performance. A sample of 138 young swimmers (65 males and 73 females of national level was submitted to a test battery comprising four different domains: kinanthropometric evaluation, dry land functional evaluation (strength and flexibility, swimming functional evaluation (hydrodynamics, hydrostatic and bioenergetics characteristics and swimming technique evaluation. To establish a profile of the young swimmer non-linear combinations between preponderant variables for each gender and swim performance in the 200 meters medley and 400 meters font crawl events were developed. For this purpose a feed forward neural network was used (Multilayer Perceptron with three neurons in a single hidden layer. The prognosis precision of the model (error lower than 0.8% between true and estimated performances is supported by recent evidence. Therefore, we consider that the neural network tool can be a good approach in the resolution of complex problems such as performance modeling and the talent identification in swimming and, possibly, in a wide variety of sports
A Constructive Neural-Network Approach to Modeling Psychological Development
Shultz, Thomas R.
2012-01-01
This article reviews a particular computational modeling approach to the study of psychological development--that of constructive neural networks. This approach is applied to a variety of developmental domains and issues, including Piagetian tasks, shift learning, language acquisition, number comparison, habituation of visual attention, concept…
Introducing Artificial Neural Networks through a Spreadsheet Model
Rienzo, Thomas F.; Athappilly, Kuriakose K.
2012-01-01
Business students taking data mining classes are often introduced to artificial neural networks (ANN) through point and click navigation exercises in application software. Even if correct outcomes are obtained, students frequently do not obtain a thorough understanding of ANN processes. This spreadsheet model was created to illuminate the roles of…
Bilingual Lexical Interactions in an Unsupervised Neural Network Model
Zhao, Xiaowei; Li, Ping
2010-01-01
In this paper we present an unsupervised neural network model of bilingual lexical development and interaction. We focus on how the representational structures of the bilingual lexicons can emerge, develop, and interact with each other as a function of the learning history. The results show that: (1) distinct representations for the two lexicons…
An artificial neural network based fast radiative transfer model for ...
Indian Academy of Sciences (India)
In the present study, a fast radiative transfer model using neural networks is proposed to simulate radiances corresponding to the wavenumbers of INSAT-3D. Realistic atmospheric temperature and humidity profiles have been used for training the network. Spectral response functions of GOES-13, a satellite similar in ...
Pragmatic Bootstrapping: A Neural Network Model of Vocabulary Acquisition
Caza, Gregory A.; Knott, Alistair
2012-01-01
The social-pragmatic theory of language acquisition proposes that children only become efficient at learning the meanings of words once they acquire the ability to understand the intentions of other agents, in particular the intention to communicate (Akhtar & Tomasello, 2000). In this paper we present a neural network model of word learning which…
Particle swarm optimization of a neural network model in a ...
Indian Academy of Sciences (India)
sets of cutting conditions and noting the root mean square (RMS) value of spindle motor current as well as ... A multi- objective optimization of hard turning using neural network modelling and swarm intelligence ... being used in this study), and these activated values in turn become the starting signals for the next adjacent ...
A Neural Network Model for Dynamics Simulation | Bholoa ...
African Journals Online (AJOL)
University of Mauritius Research Journal. Journal Home · ABOUT · Advanced Search · Current Issue · Archives · Journal Home > Vol 15, No 1 (2009) >. Log in or Register to get access to full text downloads. Username, Password, Remember me, or Register. A Neural Network Model for Dynamics Simulation. Ajeevsing ...
Improved neural network modeling of inverse lens distortion
CSIR Research Space (South Africa)
De Villiers, JP
2011-04-01
Full Text Available Inverse lens distortion modelling allows one to find the pixel in a distorted image which corresponds to a known point in object space, such as may be produced by a RADAR. This paper extends recent work using neural networks as a compromise between...
A model of interval timing by neural integration
Simen, Patrick; Balci, Fuat; deSouza, Laura; Cohen, Jonathan D.; Holmes, Philip
2011-01-01
We show that simple assumptions about neural processing lead to a model of interval timing as a temporal integration process, in which a noisy firing-rate representation of time rises linearly on average toward a response threshold over the course of an interval. Our assumptions include: that neural spike trains are approximately independent Poisson processes; that correlations among them can be largely cancelled by balancing excitation and inhibition; that neural populations can act as integrators; and that the objective of timed behavior is maximal accuracy and minimal variance. The model accounts for a variety of physiological and behavioral findings in rodents, monkeys and humans, including ramping firing rates between the onset of reward-predicting cues and the receipt of delayed rewards, and universally scale-invariant response time distributions in interval timing tasks. It furthermore makes specific, well-supported predictions about the skewness of these distributions, a feature of timing data that is usually ignored. The model also incorporates a rapid (potentially one-shot) duration-learning procedure. Human behavioral data support the learning rule’s predictions regarding learning speed in sequences of timed responses. These results suggest that simple, integration-based models should play as prominent a role in interval timing theory as they do in theories of perceptual decision making, and that a common neural mechanism may underlie both types of behavior. PMID:21697374
Manikumari, N.; Murugappan, A.; Vinodhini, G.
2017-07-01
Time series forecasting has gained remarkable interest of researchers in the last few decades. Neural networks based time series forecasting have been employed in various application areas. Reference Evapotranspiration (ETO) is one of the most important components of the hydrologic cycle and its precise assessment is vital in water balance and crop yield estimation, water resources system design and management. This work aimed at achieving accurate time series forecast of ETO using a combination of neural network approaches. This work was carried out using data collected in the command area of VEERANAM Tank during the period 2004 – 2014 in India. In this work, the Neural Network (NN) models were combined by ensemble learning in order to improve the accuracy for forecasting Daily ETO (for the year 2015). Bagged Neural Network (Bagged-NN) and Boosted Neural Network (Boosted-NN) ensemble learning were employed. It has been proved that Bagged-NN and Boosted-NN ensemble models are better than individual NN models in terms of accuracy. Among the ensemble models, Boosted-NN reduces the forecasting errors compared to Bagged-NN and individual NNs. Regression co-efficient, Mean Absolute Deviation, Mean Absolute Percentage error and Root Mean Square Error also ascertain that Boosted-NN lead to improved ETO forecasting performance.
Luo, Junhui; Wu, Chao; Liu, Xianlin; Mi, Decai; Zeng, Fuquan; Zeng, Yongjun
2018-01-01
At present, the prediction of soft foundation settlement mostly use the exponential curve and hyperbola deferred approximation method, and the correlation between the results is poor. However, the application of neural network in this area has some limitations, and none of the models used in the existing cases adopted the TS fuzzy neural network of which calculation combines the characteristics of fuzzy system and neural network to realize the mutual compatibility methods. At the same time, the developed and optimized calculation program is convenient for engineering designers. Taking the prediction and analysis of soft foundation settlement of gully soft soil in granite area of Guangxi Guihe road as an example, the fuzzy neural network model is established and verified to explore the applicability. The TS fuzzy neural network is used to construct the prediction model of settlement and deformation, and the corresponding time response function is established to calculate and analyze the settlement of soft foundation. The results show that the prediction of short-term settlement of the model is accurate and the final settlement prediction result has certain engineering reference value.
Comparison of ARIMA and Artificial Neural Networks Models for Stock Price Prediction
Directory of Open Access Journals (Sweden)
Ayodele Ariyo Adebiyi
2014-01-01
Full Text Available This paper examines the forecasting performance of ARIMA and artificial neural networks model with published stock data obtained from New York Stock Exchange. The empirical results obtained reveal the superiority of neural networks model over ARIMA model. The findings further resolve and clarify contradictory opinions reported in literature over the superiority of neural networks and ARIMA model and vice versa.
Directory of Open Access Journals (Sweden)
Yongcheng Li
Full Text Available Neural networks are considered the origin of intelligence in organisms. In this paper, a new design of an intelligent system merging biological intelligence with artificial intelligence was created. It was based on a neural controller bidirectionally connected to an actual mobile robot to implement a novel vehicle. Two types of experimental preparations were utilized as the neural controller including 'random' and '4Q' (cultured neurons artificially divided into four interconnected parts neural network. Compared to the random cultures, the '4Q' cultures presented absolutely different activities, and the robot controlled by the '4Q' network presented better capabilities in search tasks. Our results showed that neural cultures could be successfully employed to control an artificial agent; the robot performed better and better with the stimulus because of the short-term plasticity. A new framework is provided to investigate the bidirectional biological-artificial interface and develop new strategies for a future intelligent system using these simplified model systems.
Li, Yongcheng; Sun, Rong; Zhang, Bin; Wang, Yuechao; Li, Hongyi
2015-01-01
Neural networks are considered the origin of intelligence in organisms. In this paper, a new design of an intelligent system merging biological intelligence with artificial intelligence was created. It was based on a neural controller bidirectionally connected to an actual mobile robot to implement a novel vehicle. Two types of experimental preparations were utilized as the neural controller including 'random' and '4Q' (cultured neurons artificially divided into four interconnected parts) neural network. Compared to the random cultures, the '4Q' cultures presented absolutely different activities, and the robot controlled by the '4Q' network presented better capabilities in search tasks. Our results showed that neural cultures could be successfully employed to control an artificial agent; the robot performed better and better with the stimulus because of the short-term plasticity. A new framework is provided to investigate the bidirectional biological-artificial interface and develop new strategies for a future intelligent system using these simplified model systems.
HIV lipodystrophy case definition using artificial neural network modelling
DEFF Research Database (Denmark)
Ioannidis, John P A; Trikalinos, Thomas A; Law, Matthew
2003-01-01
OBJECTIVE: A case definition of HIV lipodystrophy has recently been developed from a combination of clinical, metabolic and imaging/body composition variables using logistic regression methods. We aimed to evaluate whether artificial neural networks could improve the diagnostic accuracy. METHODS......: The database of the case-control Lipodystrophy Case Definition Study was split into 504 subjects (265 with and 239 without lipodystrophy) used for training and 284 independent subjects (152 with and 132 without lipodystrophy) used for validation. Back-propagation neural networks with one or two middle layers...... were trained and validated. Results were compared against logistic regression models using the same information. RESULTS: Neural networks using clinical variables only (41 items) achieved consistently superior performance than logistic regression in terms of specificity, overall accuracy and area under...
Neural network versus classical time series forecasting models
Nor, Maria Elena; Safuan, Hamizah Mohd; Shab, Noorzehan Fazahiyah Md; Asrul, Mohd; Abdullah, Affendi; Mohamad, Nurul Asmaa Izzati; Lee, Muhammad Hisyam
2017-05-01
Artificial neural network (ANN) has advantage in time series forecasting as it has potential to solve complex forecasting problems. This is because ANN is data driven approach which able to be trained to map past values of a time series. In this study the forecast performance between neural network and classical time series forecasting method namely seasonal autoregressive integrated moving average models was being compared by utilizing gold price data. Moreover, the effect of different data preprocessing on the forecast performance of neural network being examined. The forecast accuracy was evaluated using mean absolute deviation, root mean square error and mean absolute percentage error. It was found that ANN produced the most accurate forecast when Box-Cox transformation was used as data preprocessing.
Statistical modelling of neural networks in {gamma}-spectrometry applications
Energy Technology Data Exchange (ETDEWEB)
Vigneron, V.; Martinez, J.M. [CEA Centre d`Etudes de Saclay, 91 - Gif-sur-Yvette (France). Dept. de Mecanique et de Technologie; Morel, J.; Lepy, M.C. [CEA Centre d`Etudes de Saclay, 91 - Gif-sur-Yvette (France). Dept. des Applications et de la Metrologie des Rayonnements Ionisants
1995-12-31
Layered Neural Networks, which are a class of models based on neural computation, are applied to the measurement of uranium enrichment, i.e. the isotope ratio {sup 235} U/({sup 235} U + {sup 236} U + {sup 238} U). The usual method consider a limited number of {Gamma}-ray and X-ray peaks, and require previously calibrated instrumentation for each sample. But, in practice, the source-detector ensemble geometry conditions are critically different, thus a means of improving the above convention methods is to reduce the region of interest: this is possible by focusing on the K{sub {alpha}} X region where the three elementary components are present. Real data are used to study the performance of neural networks. Training is done with a Maximum Likelihood method to measure uranium {sup 235} U and {sup 238} U quantities in infinitely thick samples. (authors). 18 refs., 6 figs., 3 tabs.
A continuous-time neural model for sequential action.
Kachergis, George; Wyatte, Dean; O'Reilly, Randall C; de Kleijn, Roy; Hommel, Bernhard
2014-11-05
Action selection, planning and execution are continuous processes that evolve over time, responding to perceptual feedback as well as evolving top-down constraints. Existing models of routine sequential action (e.g. coffee- or pancake-making) generally fall into one of two classes: hierarchical models that include hand-built task representations, or heterarchical models that must learn to represent hierarchy via temporal context, but thus far lack goal-orientedness. We present a biologically motivated model of the latter class that, because it is situated in the Leabra neural architecture, affords an opportunity to include both unsupervised and goal-directed learning mechanisms. Moreover, we embed this neurocomputational model in the theoretical framework of the theory of event coding (TEC), which posits that actions and perceptions share a common representation with bidirectional associations between the two. Thus, in this view, not only does perception select actions (along with task context), but actions are also used to generate perceptions (i.e. intended effects). We propose a neural model that implements TEC to carry out sequential action control in hierarchically structured tasks such as coffee-making. Unlike traditional feedforward discrete-time neural network models, which use static percepts to generate static outputs, our biological model accepts continuous-time inputs and likewise generates non-stationary outputs, making short-timescale dynamic predictions. © 2014 The Author(s) Published by the Royal Society. All rights reserved.
A neural model of decision making
Larsen, Torben
2008-01-01
Background: A descriptive neuroeconomic model is aimed for relativity of the concept of economic man to empirical science.Method: A 4-level client-server-integrator model integrating the brain models of McLean and Luria is the general framework for the model of empirical findings.Results: Decision making relies on integration across brain levels of emotional intelligence (LU) and logico-matematico intelligence (RIA), respectively. The integrated decision making formula approaching zero by bot...
DEFF Research Database (Denmark)
Dasgupta, Sakyasingha; Goldschmidt, Dennis; Wörgötter, Florentin
2015-01-01
Walking animals, like stick insects, cockroaches or ants, demonstrate a fascinating range of locomotive abilities and complex behaviors. The locomotive behaviors can consist of a variety of walking patterns along with adaptation that allow the animals to deal with changes in environmental...... conditions, like uneven terrains, gaps, obstacles etc. Biological study has revealed that such complex behaviors are a result of a combination of biomechanics and neural mechanism thus representing the true nature of embodied interactions. While the biomechanics helps maintain flexibility and sustain...... a variety of movements, the neural mechanisms generate movements while making appropriate predictions crucial for achieving adaptation. Such predictions or planning ahead can be achieved by way of internal models that are grounded in the overall behavior of the animal. Inspired by these findings, we present...
Frequency-difference-dependent stochastic resonance in neural systems
Guo, Daqing; Perc, Matjaž; Zhang, Yangsong; Xu, Peng; Yao, Dezhong
2017-08-01
Biological neurons receive multiple noisy oscillatory signals, and their dynamical response to the superposition of these signals is of fundamental importance for information processing in the brain. Here we study the response of neural systems to the weak envelope modulation signal, which is superimposed by two periodic signals with different frequencies. We show that stochastic resonance occurs at the beat frequency in neural systems at the single-neuron as well as the population level. The performance of this frequency-difference-dependent stochastic resonance is influenced by both the beat frequency and the two forcing frequencies. Compared to a single neuron, a population of neurons is more efficient in detecting the information carried by the weak envelope modulation signal at the beat frequency. Furthermore, an appropriate fine-tuning of the excitation-inhibition balance can further optimize the response of a neural ensemble to the superimposed signal. Our results thus introduce and provide insights into the generation and modulation mechanism of the frequency-difference-dependent stochastic resonance in neural systems.
An integrative neural model of social perception, action observation, and theory of mind.
Yang, Daniel Y-J; Rosenblau, Gabriela; Keifer, Cara; Pelphrey, Kevin A
2015-04-01
In the field of social neuroscience, major branches of research have been instrumental in describing independent components of typical and aberrant social information processing, but the field as a whole lacks a comprehensive model that integrates different branches. We review existing research related to the neural basis of three key neural systems underlying social information processing: social perception, action observation, and theory of mind. We propose an integrative model that unites these three processes and highlights the posterior superior temporal sulcus (pSTS), which plays a central role in all three systems. Furthermore, we integrate these neural systems with the dual system account of implicit and explicit social information processing. Large-scale meta-analyses based on Neurosynth confirmed that the pSTS is at the intersection of the three neural systems. Resting-state functional connectivity analysis with 1000 subjects confirmed that the pSTS is connected to all other regions in these systems. The findings presented in this review are specifically relevant for psychiatric research especially disorders characterized by social deficits such as autism spectrum disorder. Copyright © 2015 Elsevier Ltd. All rights reserved.
An integrative neural model of social perception, action observation, and theory of mind
Yang, Daniel Y.-J.; Rosenblau, Gabriela; Keifer, Cara; Pelphrey, Kevin A.
2016-01-01
In the field of social neuroscience, major branches of research have been instrumental in describing independent components of typical and aberrant social information processing, but the field as a whole lacks a comprehensive model that integrates different branches. We review existing research related to the neural basis of three key neural systems underlying social information processing: social perception, action observation, and theory of mind. We propose an integrative model that unites these three processes and highlights the posterior superior temporal sulcus (pSTS), which plays a central role in all three systems. Furthermore, we integrate these neural systems with the dual system account of implicit and explicit social information processing. Large-scale meta-analyses based on Neurosynth confirmed that the pSTS is at the intersection of the three neural systems. Resting-state functional connectivity analysis with 1000 subjects confirmed that the pSTS is connected to all other regions in these systems. The findings presented in this review are specifically relevant for psychiatric research especially disorders characterized by social deficits such as autism spectrum disorder. PMID:25660957
Building footprint extraction from digital surface models using neural networks
Davydova, Ksenia; Cui, Shiyong; Reinartz, Peter
2016-10-01
Two-dimensional building footprints are a basis for many applications: from cartography to three-dimensional building models generation. Although, many methodologies have been proposed for building footprint extraction, this topic remains an open research area. Neural networks are able to model the complex relationships between the multivariate input vector and the target vector. Based on these abilities we propose a methodology using neural networks and Markov Random Fields (MRF) for automatic building footprint extraction from normalized Digital Surface Model (nDSM) and satellite images within urban areas. The proposed approach has mainly two steps. In the first step, the unary terms are learned for the MRF energy function by a four-layer neural network. The neural network is learned on a large set of patches consisting of both nDSM and Normalized Difference Vegetation Index (NDVI). Then prediction is performed to calculate the unary terms that are used in the MRF. In the second step, the energy function is minimized using a maxflow algorithm, which leads to a binary building mask. The building extraction results are compared with available ground truth. The comparison illustrates the efficiency of the proposed algorithm which can extract approximately 80% of buildings from nDSM with high accuracy.
Neural computations underlying arbitration between model-based and model-free learning
Lee, Sang Wan; Shimojo, Shinsuke; O’Doherty, John P.
2014-01-01
SUMMARY There is accumulating neural evidence to support the existence of two distinct systems for guiding action-selection in the brain, a deliberative “model-based” and a reflexive “model-free” system. However, little is known about how the brain determines which of these systems controls behavior at one moment in time. We provide evidence for an arbitration mechanism that allocates the degree of control over behavior by model-based and model-free systems as a function of the reliability of their respective predictions. We show that inferior lateral prefrontal and frontopolar cortex encode both reliability signals and the output of a comparison between those signals, implicating these regions in the arbitration process. Moreover, connectivity between these regions and model-free valuation areas is negatively modulated by the degree of model-based control in the arbitrator, suggesting that arbitration may work through modulation of the model-free valuation system when the arbitrator deems that the model-based system should drive behavior. PMID:24507199
Analytic Modeling of Neural Tissue: I. A Spherical Bidomain.
Schwartz, Benjamin L; Chauhan, Munish; Sadleir, Rosalind J
2016-12-01
Presented here is a model of neural tissue in a conductive medium stimulated by externally injected currents. The tissue is described as a conductively isotropic bidomain, i.e. comprised of intra and extracellular regions that occupy the same space, as well as the membrane that divides them, and the injection currents are described as a pair of source and sink points. The problem is solved in three spatial dimensions and defined in spherical coordinates [Formula: see text]. The system of coupled partial differential equations is solved by recasting the problem to be in terms of the membrane and a monodomain, interpreted as a weighted average of the intra and extracellular domains. The membrane and monodomain are defined by the scalar Helmholtz and Laplace equations, respectively, which are both separable in spherical coordinates. Product solutions are thus assumed and given through certain transcendental functions. From these electrical potentials, analytic expressions for current density are derived and from those fields the magnetic flux density is calculated. Numerical examples are considered wherein the interstitial conductivity is varied, as well as the limiting case of the problem simplifying to two dimensions due to azimuthal independence. Finally, future modeling work is discussed.
Modeling of surface dust concentrations using neural networks and kriging
Buevich, Alexander G.; Medvedev, Alexander N.; Sergeev, Alexander P.; Tarasov, Dmitry A.; Shichkin, Andrey V.; Sergeeva, Marina V.; Atanasova, T. B.
2016-12-01
Creating models which are able to accurately predict the distribution of pollutants based on a limited set of input data is an important task in environmental studies. In the paper two neural approaches: (multilayer perceptron (MLP)) and generalized regression neural network (GRNN)), and two geostatistical approaches: (kriging and cokriging), are using for modeling and forecasting of dust concentrations in snow cover. The area of study is under the influence of dust emissions from a copper quarry and a several industrial companies. The comparison of two mentioned approaches is conducted. Three indices are used as the indicators of the models accuracy: the mean absolute error (MAE), root mean square error (RMSE) and relative root mean square error (RRMSE). Models based on artificial neural networks (ANN) have shown better accuracy. When considering all indices, the most precision model was the GRNN, which uses as input parameters for modeling the coordinates of sampling points and the distance to the probable emissions source. The results of work confirm that trained ANN may be more suitable tool for modeling of dust concentrations in snow cover.
Multiple Linear Regression Model Based on Neural Network and Its Application in the MBR Simulation
Directory of Open Access Journals (Sweden)
Chunqing Li
2012-01-01
Full Text Available The computer simulation of the membrane bioreactor MBR has become the research focus of the MBR simulation. In order to compensate for the defects, for example, long test period, high cost, invisible equipment seal, and so forth, on the basis of conducting in-depth study of the mathematical model of the MBR, combining with neural network theory, this paper proposed a three-dimensional simulation system for MBR wastewater treatment, with fast speed, high efficiency, and good visualization. The system is researched and developed with the hybrid programming of VC++ programming language and OpenGL, with a multifactor linear regression model of affecting MBR membrane fluxes based on neural network, applying modeling method of integer instead of float and quad tree recursion. The experiments show that the three-dimensional simulation system, using the above models and methods, has the inspiration and reference for the future research and application of the MBR simulation technology.
Recursive Bayesian recurrent neural networks for time-series modeling.
Mirikitani, Derrick T; Nikolaev, Nikolay
2010-02-01
This paper develops a probabilistic approach to recursive second-order training of recurrent neural networks (RNNs) for improved time-series modeling. A general recursive Bayesian Levenberg-Marquardt algorithm is derived to sequentially update the weights and the covariance (Hessian) matrix. The main strengths of the approach are a principled handling of the regularization hyperparameters that leads to better generalization, and stable numerical performance. The framework involves the adaptation of a noise hyperparameter and local weight prior hyperparameters, which represent the noise in the data and the uncertainties in the model parameters. Experimental investigations using artificial and real-world data sets show that RNNs equipped with the proposed approach outperform standard real-time recurrent learning and extended Kalman training algorithms for recurrent networks, as well as other contemporary nonlinear neural models, on time-series modeling.
Synthesis of recurrent neural networks for dynamical system simulation.
Trischler, Adam P; D'Eleuterio, Gabriele M T
2016-08-01
We review several of the most widely used techniques for training recurrent neural networks to approximate dynamical systems, then describe a novel algorithm for this task. The algorithm is based on an earlier theoretical result that guarantees the quality of the network approximation. We show that a feedforward neural network can be trained on the vector-field representation of a given dynamical system using backpropagation, then recast it as a recurrent network that replicates the original system's dynamics. After detailing this algorithm and its relation to earlier approaches, we present numerical examples that demonstrate its capabilities. One of the distinguishing features of our approach is that both the original dynamical systems and the recurrent networks that simulate them operate in continuous time. Copyright © 2016 Elsevier Ltd. All rights reserved.
Design and Implementation of Behavior Recognition System Based on Convolutional Neural Network
Directory of Open Access Journals (Sweden)
Yu Bo
2017-01-01
Full Text Available We build a set of human behavior recognition system based on the convolution neural network constructed for the specific human behavior in public places. Firstly, video of human behavior data set will be segmented into images, then we process the images by the method of background subtraction to extract moving foreground characters of body. Secondly, the training data sets are trained into the designed convolution neural network, and the depth learning network is constructed by stochastic gradient descent. Finally, the various behaviors of samples are classified and identified with the obtained network model, and the recognition results are compared with the current mainstream methods. The result show that the convolution neural network can study human behavior model automatically and identify human’s behaviors without any manually annotated trainings.
RBF Neural Network of Sliding Mode Control for Time-Varying 2-DOF Parallel Manipulator System
Directory of Open Access Journals (Sweden)
Haizhong Chen
2013-01-01
Full Text Available This paper presents a radial basis function (RBF neural network control scheme for manipulators with actuator nonlinearities. The control scheme consists of a time-varying sliding mode control (TVSMC and an RBF neural network compensator. Since the actuator nonlinearities are usually included in the manipulator driving motor, a compensator using RBF network is proposed to estimate the actuator nonlinearities and their upper boundaries. Subsequently, an RBF neural network controller that requires neither the evaluation of off-line dynamical model nor the time-consuming training process is given. In addition, Barbalat Lemma is introduced to help prove the stability of the closed control system. Considering the SMC controller and the RBF network compensator as the whole control scheme, the closed-loop system is proved to be uniformly ultimately bounded. The whole scheme provides a general procedure to control the manipulators with actuator nonlinearities. Simulation results verify the effectiveness of the designed scheme and the theoretical discussion.
D-FNN Based Modeling and BP Neural Network Decoupling Control of PVC Stripping Process
Directory of Open Access Journals (Sweden)
Shu-zhi Gao
2014-01-01
Full Text Available PVC stripping process is a kind of complicated industrial process with characteristics of highly nonlinear and time varying. Aiming at the problem of establishing the accurate mathematics model due to the multivariable coupling and big time delay, the dynamic fuzzy neural network (D-FNN is adopted to establish the PVC stripping process model based on the actual process operation datum. Then, the PVC stripping process is decoupled by the distributed neural network decoupling module to obtain two single-input-single-output (SISO subsystems (slurry flow to top tower temperature and steam flow to bottom tower temperature. Finally, the PID controller based on BP neural networks is used to control the decoupled PVC stripper system. Simulation results show the effectiveness of the proposed integrated intelligent control method.
A scale-free neural network for modelling neurogenesis
Perotti, Juan I.; Tamarit, Francisco A.; Cannas, Sergio A.
2006-11-01
In this work we introduce a neural network model for associative memory based on a diluted Hopfield model, which grows through a neurogenesis algorithm that guarantees that the final network is a small-world and scale-free one. We also analyze the storage capacity of the network and prove that its performance is larger than that measured in a randomly dilute network with the same connectivity.
PEM Fuel Cell Modelling Using Artificial Neural Networks
Doumbia, Mamadou Lamine
2016-01-01
Fuel cells are electrochemical devices that convert the chemical energy of a reaction directly into dc electrical energy. Proton Exchange Membrane (PEM) fuel cell is a suitable alternative for both electrical transportation and stationary applications. In this article, an Artificial Neural Network (ANN) modelling approach of a PEM fuel cell is developed. This model describes the behaviour of PEM fuel cell voltage under both steady-state and transient conditions. Moreover, the prediction of th...
A neural click model for web search
Borisov, A.; Markov, I.; de Rijke, M.; Serdyukov, P.
2016-01-01
Understanding user browsing behavior in web search is key to improving web search effectiveness. Many click models have been proposed to explain or predict user clicks on search engine results. They are based on the probabilistic graphical model (PGM) framework, in which user behavior is represented
Robust Fault Detection of Wind Energy Conversion Systems Based on Dynamic Neural Networks
Directory of Open Access Journals (Sweden)
Nasser Talebi
2014-01-01
Full Text Available Occurrence of faults in wind energy conversion systems (WECSs is inevitable. In order to detect the occurred faults at the appropriate time, avoid heavy economic losses, ensure safe system operation, prevent damage to adjacent relevant systems, and facilitate timely repair of failed components; a fault detection system (FDS is required. Recurrent neural networks (RNNs have gained a noticeable position in FDSs and they have been widely used for modeling of complex dynamical systems. One method for designing an FDS is to prepare a dynamic neural model emulating the normal system behavior. By comparing the outputs of the real system and neural model, incidence of the faults can be identified. In this paper, by utilizing a comprehensive dynamic model which contains both mechanical and electrical components of the WECS, an FDS is suggested using dynamic RNNs. The presented FDS detects faults of the generator's angular velocity sensor, pitch angle sensors, and pitch actuators. Robustness of the FDS is achieved by employing an adaptive threshold. Simulation results show that the proposed scheme is capable to detect the faults shortly and it has very low false and missed alarms rate.
Robust fault detection of wind energy conversion systems based on dynamic neural networks.
Talebi, Nasser; Sadrnia, Mohammad Ali; Darabi, Ahmad
2014-01-01
Occurrence of faults in wind energy conversion systems (WECSs) is inevitable. In order to detect the occurred faults at the appropriate time, avoid heavy economic losses, ensure safe system operation, prevent damage to adjacent relevant systems, and facilitate timely repair of failed components; a fault detection system (FDS) is required. Recurrent neural networks (RNNs) have gained a noticeable position in FDSs and they have been widely used for modeling of complex dynamical systems. One method for designing an FDS is to prepare a dynamic neural model emulating the normal system behavior. By comparing the outputs of the real system and neural model, incidence of the faults can be identified. In this paper, by utilizing a comprehensive dynamic model which contains both mechanical and electrical components of the WECS, an FDS is suggested using dynamic RNNs. The presented FDS detects faults of the generator's angular velocity sensor, pitch angle sensors, and pitch actuators. Robustness of the FDS is achieved by employing an adaptive threshold. Simulation results show that the proposed scheme is capable to detect the faults shortly and it has very low false and missed alarms rate.
Empirical Modeling of the Plasmasphere Dynamics Using Neural Networks
Zhelavskaya, Irina S.; Shprits, Yuri Y.; Spasojević, Maria
2017-11-01
We present the PINE (Plasma density in the Inner magnetosphere Neural network-based Empirical) model - a new empirical model for reconstructing the global dynamics of the cold plasma density distribution based only on solar wind data and geomagnetic indices. Utilizing the density database obtained using the NURD (Neural-network-based Upper hybrid Resonance Determination) algorithm for the period of 1 October 2012 to 1 July 2016, in conjunction with solar wind data and geomagnetic indices, we develop a neural network model that is capable of globally reconstructing the dynamics of the cold plasma density distribution for 2≤L≤6 and all local times. We validate and test the model by measuring its performance on independent data sets withheld from the training set and by comparing the model-predicted global evolution with global images of He+ distribution in the Earth's plasmasphere from the IMAGE Extreme UltraViolet (EUV) instrument. We identify the parameters that best quantify the plasmasphere dynamics by training and comparing multiple neural networks with different combinations of input parameters (geomagnetic indices, solar wind data, and different durations of their time history). The optimal model is based on the 96 h time history of Kp, AE, SYM-H, and F10.7 indices. The model successfully reproduces erosion of the plasmasphere on the nightside and plume formation and evolution. We demonstrate results of both local and global plasma density reconstruction. This study illustrates how global dynamics can be reconstructed from local in situ observations by using machine learning techniques.
Hoppensteadt, F C; Izhikevich, E M
1996-08-01
We study weakly connected networks of neural oscillators near multiple Andronov-Hopf bifurcation points. We analyze relationships between synaptic organizations (anatomy) of the networks and their dynamical properties (function). Our principal assumptions are: (1) Each neural oscillator comprises two populations of neurons; excitatory and inhibitory ones; (2) activity of each population of neurons is described by a scalar (one-dimensional) variable; (3) each neural oscillator is near a nondegenerate supercritical Andronov-Hopf bifurcation point; (4) the synaptic connections between the neural oscillators are weak. All neural networks satisfying these hypotheses are governed by the same dynamical system, which we call the canonical model. Studying the canonical model shows that: (1) A neural oscillator can communicate only with those oscillators which have roughly the same natural frequency. That is, synaptic connections between a pair of oscillators having different natural frequencies are functionally insignificant. (2) Two neural oscillators having the same natural frequencies might not communicate if the connections between them are from among a class of pathological synaptic configurations. In both cases the anatomical presence of synaptic connections between neural oscillators does not necessarily guarantee that the connections are functionally significant. (3) There can be substantial phase differences (time delays) between the neural oscillators, which result from the synaptic organization of the network, not from the transmission delays. Using the canonical model we can illustrate self-ignition and autonomous quiescence (oscillator death) phenomena. That is, a network of passive elements can exhibit active properties and vice versa. We also study how Dale's principle affects dynamics of the networks, in particular, the phase differences that the network can reproduce. We present a complete classification of all possible synaptic organizations from this
A neural model of decision making
DEFF Research Database (Denmark)
Larsen, Torben
2008-01-01
a range of 4-7 Hz) [Sauseng et al, 2006]. See, elaborated description at L4. Thalamo-cortico integration The characteristic resting pattern of the brain is α-waves in the 8-12 Hz/s band which indicates an autogenic cortical reset originated in Thalamus (α%) [Hanslmayr et al, 2007]. The dynamics......Background: A descriptive neuroeconomic model is aimed for relativity of the concept of economic man to empirical science. Method: A 4-level client-server-integrator model integrating the brain models of McLean and Luria is the general framework for the model of empirical findings. Results......: Decision making relies on integration across brain levels of emotional intelligence (LU) and logico-matematico intelligence (RIA), respectively. The integrated decision making formula approaching zero by bottom-up emotional and frontoparietal-downward logico-matematico learning is: CONC := LU...
A neural network model of attention-modulated neurodynamics.
Gu, Yuqiao; Liljenström, Hans
2007-12-01
Visual attention appears to modulate cortical neurodynamics and synchronization through various cholinergic mechanisms. In order to study these mechanisms, we have developed a neural network model of visual cortex area V4, based on psychophysical, anatomical and physiological data. With this model, we want to link selective visual information processing to neural circuits within V4, bottom-up sensory input pathways, top-down attention input pathways, and to cholinergic modulation from the prefrontal lobe. We investigate cellular and network mechanisms underlying some recent analytical results from visual attention experimental data. Our model can reproduce the experimental findings that attention to a stimulus causes increased gamma-frequency synchronization in the superficial layers. Computer simulations and STA power analysis also demonstrate different effects of the different cholinergic attention modulation action mechanisms.
Hand Posture Prediction Using Neural Networks within a Biomechanical Model
Directory of Open Access Journals (Sweden)
Marta C. Mora
2012-10-01
Full Text Available This paper proposes the use of artificial neural networks (ANNs in the framework of a biomechanical hand model for grasping. ANNs enhance the model capabilities as they substitute estimated data for the experimental inputs required by the grasping algorithm used. These inputs are the tentative grasping posture and the most open posture during grasping. As a consequence, more realistic grasping postures are predicted by the grasping algorithm, along with the contact information required by the dynamic biomechanical model (contact points and normals. Several neural network architectures are tested and compared in terms of prediction errors, leading to encouraging results. The performance of the overall proposal is also shown through simulation, where a grasping experiment is replicated and compared to the real grasping data collected by a data glove device.
Modeling fMRI signals can provide insights into neural processing in the cerebral cortex
Sharifian, Fariba; Heikkinen, Hanna; Vigário, Ricardo
2015-01-01
Every stimulus or task activates multiple areas in the mammalian cortex. These distributed activations can be measured with functional magnetic resonance imaging (fMRI), which has the best spatial resolution among the noninvasive brain imaging methods. Unfortunately, the relationship between the fMRI activations and distributed cortical processing has remained unclear, both because the coupling between neural and fMRI activations has remained poorly understood and because fMRI voxels are too large to directly sense the local neural events. To get an idea of the local processing given the macroscopic data, we need models to simulate the neural activity and to provide output that can be compared with fMRI data. Such models can describe neural mechanisms as mathematical functions between input and output in a specific system, with little correspondence to physiological mechanisms. Alternatively, models can be biomimetic, including biological details with straightforward correspondence to experimental data. After careful balancing between complexity, computational efficiency, and realism, a biomimetic simulation should be able to provide insight into how biological structures or functions contribute to actual data processing as well as to promote theory-driven neuroscience experiments. This review analyzes the requirements for validating system-level computational models with fMRI. In particular, we study mesoscopic biomimetic models, which include a limited set of details from real-life networks and enable system-level simulations of neural mass action. In addition, we discuss how recent developments in neurophysiology and biophysics may significantly advance the modelling of fMRI signals. PMID:25972586
Regional Computation of TEC Using a Neural Network Model
Leandro, R. F.; Santos, M. C.
2004-05-01
One of the main sources of errors of GPS measurements is the ionosphere refraction. As a dispersive medium, the ionosphere allow its influence to be computed by using dual frequency receivers. In the case of single frequency receivers it is necessary to use models that tell us how big the ionospheric refraction is. The GPS broadcast message carries parameters of this model, namely Klobuchar model. Dual frequency receivers allow to estimate the influence of ionosphere in the GPS signal by the computation of TEC (Total Electron Content) values, that have a direct relationship with the magnitude of the delay caused by the ionosphere. One alternative is to create a regional model based on a network of dual frequency receivers. In this case, the regional behaviour of ionosphere is modelled in a way that it is possible to estimate the TEC values into or near this region. This regional model can be based on polynomials, for example. In this work we will present a Neural Network-based model to the regional computation of TEC. The advantage of using a Neural Network is that it is not necessary to have a great knowledge on the behaviour of the modelled surface due to the adaptation capability of neural networks training process, that is an iterative adjust of the synaptic weights in function of residuals, using the training parameters. Therefore, the previous knowledge of the modelled phenomena is important to define what kind of and how many parameters are needed to train the neural network so that reasonable results are obtained from the estimations. We have used data from the GPS tracking network in Brazil, and we have tested the accuracy of the new model to all locations where there is a station, accessing the efficiency of the model everywhere. TEC values were computed for each station of the network. After that the training parameters data set for the test station was formed, with the TEC values of all others (all stations, except the test one). The Neural Network was
Fuzzified Data Based Neural Network Modeling for Health Assessment of Multistorey Shear Buildings
Directory of Open Access Journals (Sweden)
Deepti Moyi Sahoo
2013-01-01
Full Text Available The present study intends to propose identification methodologies for multistorey shear buildings using the powerful technique of Artificial Neural Network (ANN models which can handle fuzzified data. Identification with crisp data is known, and also neural network method has already been used by various researchers for this case. Here, the input and output data may be in fuzzified form. This is because in general we may not get the corresponding input and output values exactly (in crisp form, but we have only the uncertain information of the data. This uncertain data is assumed in terms of fuzzy number, and the corresponding problem of system identification is investigated.
DEFF Research Database (Denmark)
Kock, Anders Bredahl; Teräsvirta, Timo
2016-01-01
When forecasting with neural network models one faces several problems, all of which influence the accuracy of the forecasts. First, neural networks are often hard to estimate due to their highly nonlinear structure. To alleviate the problem, White (2006) presented a solution (QuickNet...
Artificial Neural Network-Based System for PET Volume Segmentation
Directory of Open Access Journals (Sweden)
Mhd Saeed Sharif
2010-01-01
Full Text Available Tumour detection, classification, and quantification in positron emission tomography (PET imaging at early stage of disease are important issues for clinical diagnosis, assessment of response to treatment, and radiotherapy planning. Many techniques have been proposed for segmenting medical imaging data; however, some of the approaches have poor performance, large inaccuracy, and require substantial computation time for analysing large medical volumes. Artificial intelligence (AI approaches can provide improved accuracy and save decent amount of time. Artificial neural networks (ANNs, as one of the best AI techniques, have the capability to classify and quantify precisely lesions and model the clinical evaluation for a specific problem. This paper presents a novel application of ANNs in the wavelet domain for PET volume segmentation. ANN performance evaluation using different training algorithms in both spatial and wavelet domains with a different number of neurons in the hidden layer is also presented. The best number of neurons in the hidden layer is determined according to the experimental results, which is also stated Levenberg-Marquardt backpropagation training algorithm as the best training approach for the proposed application. The proposed intelligent system results are compared with those obtained using conventional techniques including thresholding and clustering based approaches. Experimental and Monte Carlo simulated PET phantom data sets and clinical PET volumes of nonsmall cell lung cancer patients were utilised to validate the proposed algorithm which has demonstrated promising results.
Human Inspired Self-developmental Model of Neural Network (HIM): Introducing Content/Form Computing
Krajíček, Jiří
This paper presents cross-disciplinary research between medical/psychological evidence on human abilities and informatics needs to update current models in computer science to support alternative methods for computation and communication. In [10] we have already proposed hypothesis introducing concept of human information model (HIM) as cooperative system. Here we continue on HIM design in detail. In our design, first we introduce Content/Form computing system which is new principle of present methods in evolutionary computing (genetic algorithms, genetic programming). Then we apply this system on HIM (type of artificial neural network) model as basic network self-developmental paradigm. Main inspiration of our natural/human design comes from well known concept of artificial neural networks, medical/psychological evidence and Sheldrake theory of "Nature as Alive" [22].
Modified Neural Network for Dynamic Control and Operation of a Hybrid Generation Systems
Directory of Open Access Journals (Sweden)
Cong-Hui Huang
2014-12-01
Full Text Available This paper presents modified neural network for dynamic control and operation of a hybrid generation systems. PV and wind power are the primary power sources of the system to take full advantages of renewable energy, and the diesel-engine is used as a backup system. The simulation model of the hybrid system was developed using MATLAB Simulink. To achieve a fast and stable response for the real power control, the intelligent controller consists of a Radial Basis Function Network (RBFN and an modified Elman Neural Network (ENN for maximum power point tracking (MPPT. The pitch angle of wind turbine is controlled by ENN, and the PV system uses RBFN, where the output signal is used to control the DC I DC boost converters to achieve the MPPT. And the results show the hybrid generation system can effectively extract the maximum power from the PV and wind energy sources.
Genetic manipulation of specific neural circuits by use of a viral vector system.
Kobayashi, Kenta; Kato, Shigeki; Kobayashi, Kazuto
2017-01-05
To understand the mechanisms underlying higher brain functions, we need to analyze the roles of specific neuronal pathways or cell types forming the complex neural networks. In the neuroscience field, the transgenic approach has provided a useful gene engineering tool for experimental studies of neural functions. The conventional transgenic technique requires the appropriate promoter regions that drive a neuronal type-specific gene expression, but the promoter sequences specifically functioning in each neuronal type are limited. Previously, we developed novel types of lentiviral vectors showing high efficiency of retrograde gene transfer in the central nervous system, termed highly efficient retrograde gene transfer (HiRet) vector and neuron-specific retrograde gene transfer (NeuRet) vector. The HiRet and NeuRet vectors enable genetical manipulation of specific neural pathways in diverse model animals in combination with conditional cell targeting, synaptic transmission silencing, and gene expression systems. These newly developed vectors provide powerful experimental strategies to investigate, more precisely, the machineries exerting various neural functions. In this review, we give an outline of the HiRet and NeuRet vectors and describe recent representative applications of these viral vectors for studies on neural circuits.
Energy Technology Data Exchange (ETDEWEB)
Chu, W.C.; Chen, B.K.; Mo, P.C. [Tatung Inst. of Tech., Taipei (Taiwan, Province of China)
1995-12-31
For energy conservation and improvement of power system operation efficiency, how to reduce the transmission system losses becomes an important topic of grave concern. To understand the cause, and to evaluate the amount, of the losses are the prior steps to diminish them. To simplify the evaluation procedure without losing too much accuracy, this paper adopts the artificial neural network, which is a model free network, to analyze the transmission system losses. As the artificial neural network with time decayed weight has the capability of learning, memorizing, and forgetting, it is more suitable for a power system with gradually changing characteristics. By using this artificial neural network, the estimation of transmission system losses will be more precise. In this paper, comparison will be made between the results of artificial neural network analysis and polynomial loss equations analysis.
Command Filtered Adaptive Fuzzy Neural Network Backstepping Control for Marine Power System
Directory of Open Access Journals (Sweden)
Xin Zhang
2014-01-01
Full Text Available In order to retrain chaotic oscillation of marine power system which is excited by periodic electromagnetism perturbation, a novel command-filtered adaptive fuzzy neural network backstepping control method is designed. First, the mathematical model of marine power system is established based on the two parallel nonlinear model. Then, main results of command-filtered adaptive fuzzy neural network backstepping control law are given. And the Lyapunov stability theory is applied to prove that the system can remain closed-loop asymptotically stable with this controller. Finally, simulation results indicate that the designed controller can suppress chaotic oscillation with fast convergence speed that makes the system return to the equilibrium point quickly; meanwhile, the parameter which induces chaotic oscillation can also be discriminated.
Nasertdinova, A. D.; Bochkarev, V. V.
2017-11-01
Deep neural networks with a large number of parameters are a powerful tool for solving problems of pattern recognition, prediction and classification. Nevertheless, overfitting remains a serious problem in the use of such networks. A method of solving the problem of overfitting is proposed in this article. This method is based on reducing the number of independent parameters of a neural network model using the principal component analysis, and can be implemented using existing libraries of neural computing. The algorithm was tested on the problem of recognition of handwritten symbols from the MNIST database, as well as on the task of predicting time series (rows of the average monthly number of sunspots and series of the Lorentz system were used). It is shown that the application of the principal component analysis enables reducing the number of parameters of the neural network model when the results are good. The average error rate for the recognition of handwritten figures from the MNIST database was 1.12% (which is comparable to the results obtained using the "Deep training" methods), while the number of parameters of the neural network can be reduced to 130 times.
A linear model for characterization of synchronization frequencies of neural networks.
Lv, Peili; Hu, Xintao; Lv, Jinglei; Han, Junwei; Guo, Lei; Liu, Tianming
2014-02-01
The synchronization frequency of neural networks and its dynamics have important roles in deciphering the working mechanisms of the brain. It has been widely recognized that the properties of functional network synchronization and its dynamics are jointly determined by network topology, network connection strength, i.e., the connection strength of different edges in the network, and external input signals, among other factors. However, mathematical and computational characterization of the relationships between network synchronization frequency and these three important factors are still lacking. This paper presents a novel computational simulation framework to quantitatively characterize the relationships between neural network synchronization frequency and network attributes and input signals. Specifically, we constructed a series of neural networks including simulated small-world networks, real functional working memory network derived from functional magnetic resonance imaging, and real large-scale structural brain networks derived from diffusion tensor imaging, and performed synchronization simulations on these networks via the Izhikevich neuron spiking model. Our experiments demonstrate that both of the network synchronization strength and synchronization frequency change according to the combination of input signal frequency and network self-synchronization frequency. In particular, our extensive experiments show that the network synchronization frequency can be represented via a linear combination of the network self-synchronization frequency and the input signal frequency. This finding could be attributed to an intrinsically-preserved principle in different types of neural systems, offering novel insights into the working mechanism of neural systems.
STOCHASTIC MODELLING BASED MONTHLY RAINFALL PREDICTION USING SEASONAL ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
S.M. Karthik
2017-01-01
Full Text Available India is an agrarian society where 13.7% of GDP and 50% of workforce are involved with agriculture. Rainfall plays a vital role in irrigating the land and replenishing the rivers and underground water sources. Therefore the study of rainfall is vital to the economic development and wellbeing of the nation. Accurate prediction of rainfall leads to better agricultural planning, flood prevention and control. The seasonal artificial neural networks can predict monthly rainfall by exploiting the cyclical nature of the weather system. It is dependent on historical time series data and therefore independent of changes in the fundamental models of climate known collectively as manmade climate change. This paper presents the seasonal artificial neural networks applied on the prediction of monthly rainfall. The amounts of rainfall in the twelve months of a year are fed to the neural networks to predict the next twelve months. The gradient descent method is used for training the neural networks. Four performance measures viz. MSE, RMSE, MAD and MAPE are used to assess the system. Experimental results indicate that monthly rainfall patterns can be predicted accurately by seasonal neural networks.
A Neural Computational Model of Incentive Salience
Zhang, Jun; Berridge, Kent C.; Tindell, Amy J.; Smith, Kyle S.; Aldridge, J. Wayne
2009-01-01
Incentive salience is a motivational property with ‘magnet-like’ qualities. When attributed to reward-predicting stimuli (cues), incentive salience triggers a pulse of ‘wanting’ and an individual is pulled toward the cues and reward. A key computational question is how incentive salience is generated during a cue re-encounter, which combines both learning and the state of limbic brain mechanisms. Learning processes, such as temporal-difference models, provide one way for stimuli to acquire cached predictive values of rewards. However, empirical data show that subsequent incentive values are also modulated on the fly by dynamic fluctuation in physiological states, altering cached values in ways requiring additional motivation mechanisms. Dynamic modulation of incentive salience for a Pavlovian conditioned stimulus (CS or cue) occurs during certain states, without necessarily requiring (re)learning about the cue. In some cases, dynamic modulation of cue value occurs during states that are quite novel, never having been experienced before, and even prior to experience of the associated unconditioned reward in the new state. Such cases can include novel drug-induced mesolimbic activation and addictive incentive-sensitization, as well as natural appetite states such as salt appetite. Dynamic enhancement specifically raises the incentive salience of an appropriate CS, without necessarily changing that of other CSs. Here we suggest a new computational model that modulates incentive salience by integrating changing physiological states with prior learning. We support the model with behavioral and neurobiological data from empirical tests that demonstrate dynamic elevations in cue-triggered motivation (involving natural salt appetite, and drug-induced intoxication and sensitization). Our data call for a dynamic model of incentive salience, such as presented here. Computational models can adequately capture fluctuations in cue-triggered ‘wanting’ only by
Neural-Fuzzy model Based Steel Pipeline Multiple Cracks Classification
Elwalwal, Hatem Mostafa; Mahzan, Shahruddin Bin Hj.; Abdalla, Ahmed N.
2017-10-01
While pipes are cheaper than other means of transportation, this cost saving comes with a major price: pipes are subject to cracks, corrosion etc., which in turn can cause leakage and environmental damage. In this paper, Neural-Fuzzy model for multiple cracks classification based on Lamb Guide Wave. Simulation results for 42 sample were collected using ANSYS software. The current research object to carry on the numerical simulation and experimental study, aiming at finding an effective way to detection and the localization of cracks and holes defects in the main body of pipeline. Considering the damage form of multiple cracks and holes which may exist in pipeline, to determine the respective position in the steel pipe. In addition, the technique used in this research a guided lamb wave based structural health monitoring method whereas piezoelectric transducers will use as exciting and receiving sensors by Pitch-Catch method. Implementation of simple learning mechanism has been developed specially for the ANN for fuzzy the system represented.
Neural Mechanisms and Information Processing in Recognition Systems
Directory of Open Access Journals (Sweden)
Mamiko Ozaki
2014-10-01
Full Text Available Nestmate recognition is a hallmark of social insects. It is based on the match/mismatch of an identity signal carried by members of the society with that of the perceiving individual. While the behavioral response, amicable or aggressive, is very clear, the neural systems underlying recognition are not fully understood. Here we contrast two alternative hypotheses for the neural mechanisms that are responsible for the perception and information processing in recognition. We focus on recognition via chemical signals, as the common modality in social insects. The first, classical, hypothesis states that upon perception of recognition cues by the sensory system the information is passed as is to the antennal lobes and to higher brain centers where the information is deciphered and compared to a neural template. Match or mismatch information is then transferred to some behavior-generating centers where the appropriate response is elicited. An alternative hypothesis, that of “pre-filter mechanism”, posits that the decision as to whether to pass on the information to the central nervous system takes place in the peripheral sensory system. We suggest that, through sensory adaptation, only alien signals are passed on to the brain, specifically to an “aggressive-behavior-switching center”, where the response is generated if the signal is above a certain threshold.
A Pruning Neural Network Model in Credit Classification Analysis
Directory of Open Access Journals (Sweden)
Yajiao Tang
2018-01-01
Full Text Available Nowadays, credit classification models are widely applied because they can help financial decision-makers to handle credit classification issues. Among them, artificial neural networks (ANNs have been widely accepted as the convincing methods in the credit industry. In this paper, we propose a pruning neural network (PNN and apply it to solve credit classification problem by adopting the well-known Australian and Japanese credit datasets. The model is inspired by synaptic nonlinearity of a dendritic tree in a biological neural model. And it is trained by an error back-propagation algorithm. The model is capable of realizing a neuronal pruning function by removing the superfluous synapses and useless dendrites and forms a tidy dendritic morphology at the end of learning. Furthermore, we utilize logic circuits (LCs to simulate the dendritic structures successfully which makes PNN be implemented on the hardware effectively. The statistical results of our experiments have verified that PNN obtains superior performance in comparison with other classical algorithms in terms of accuracy and computational efficiency.
A neural model of retrospective attention in visual working memory.
Bays, Paul M; Taylor, Robert
2018-02-01
An informative cue that directs attention to one of several items in working memory improves subsequent recall of that item. Here we examine the mechanism of this retro-cue effect using a model of short-term memory based on neural population coding. Our model describes recalled feature values as the output of an optimal decoding of spikes generated by a tuned population of neurons. This neural model provides a better account of human recall data than an influential model that assumes errors can be described as a mixture of normally distributed noise and random guesses. The retro-cue benefit is revealed to be consistent with a higher firing rate of the population encoding the cued versus uncued items, with no difference in tuning specificity. Additionally, a retro-cued item is less likely to be swapped with another item in memory, an effect that can also be explained by greater activity of the underlying population. These results provide a parsimonious account of the effects of retrospective attention on recall and demonstrate a principled method for investigating neural representations with behavioral tasks. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.
Learning Efficiency of Consciousness System for Robot Using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Osama Shoubaky
2014-12-01
Full Text Available This paper presents learning efficiency of a consciousness system for robot using artificial neural network. The proposed conscious system consists of reason system, feeling system and association system. The three systems are modeled using Module of Nerves for Advanced Dynamics (ModNAD. Artificial neural network of the type of supervised learning with the back propagation is used to train the ModNAD. The reason system imitates behaviour and represents self-condition and other-condition. The feeling system represents sensation and emotion. The association system represents behaviour of self and determines whether self is comfortable or not. A robot is asked to perform cognition and tasks using the consciousness system. Learning converges to about 0.01 within about 900 orders for imitation, pain, solitude and the association modules. It converges to about 0.01 within about 400 orders for the comfort and discomfort modules. It can be concluded that learning in the ModNAD completed after a relatively small number of times because the learning efficiency of the ModNAD artificial neural network is good. The results also show that each ModNAD has a function to imitate and cognize emotion. The consciousness system presented in this paper may be considered as a fundamental step for developing a robot having consciousness and feelings similar to humans.
A Neural Network Model for Prediction of Sound Quality
DEFF Research Database (Denmark)
Nielsen,, Lars Bramsløw
An artificial neural network structure has been specified, implemented and optimized for the purpose of predicting the perceived sound quality for normal-hearing and hearing-impaired subjects. The network was implemented by means of commercially available software and optimized to predict results...... error on the test set. The overall concept proved functional, but further testing with data obtained from a new rating experiment is necessary to better assess the utility of this measure. The weights in the trained neural networks were analyzed to qualitatively interpret the relation between...... obtained in subjective sound quality rating experiments based on input data from an auditory model. Various types of input data and data representations from the auditory model were used as input data for the chosen network structure, which was a three-layer perceptron. This network was trained by means...
The Vite Model: A Neural Command Circuit for Generating Arm and Articulator Trajectories,
1988-03-01
associative map, looking at an object can activate a TPC of the hand-arm system, as Piaget (1963) noted. Then a VITE circuit can translate this latter TPC...two ways: by comparing trajectories of the neural circuit’s output stage with actual arm trajectories, and by checking for the existence of the...in precentral motor cortex could be analysed as an in vivo analogue of model DV stage neurons. Additional physiological support for the VITE model
Role of SDF1/CXCR4 Interaction in Experimental Hemiplegic Models with Neural Cell Transplantation
Directory of Open Access Journals (Sweden)
Noboru Suzuki
2012-02-01
Full Text Available Much attention has been focused on neural cell transplantation because of its promising clinical applications. We have reported that embryonic stem (ES cell derived neural stem/progenitor cell transplantation significantly improved motor functions in a hemiplegic mouse model. It is important to understand the molecular mechanisms governing neural regeneration of the damaged motor cortex after the transplantation. Recent investigations disclosed that chemokines participated in the regulation of migration and maturation of neural cell grafts. In this review, we summarize the involvement of inflammatory chemokines including stromal cell derived factor 1 (SDF1 in neural regeneration after ES cell derived neural stem/progenitor cell transplantation in mouse stroke models.
Directory of Open Access Journals (Sweden)
J. C. Ochoa-Rivera
2002-01-01
Full Text Available A model for multivariate streamflow generation is presented, based on a multilayer feedforward neural network. The structure of the model results from two components, the neural network (NN deterministic component and a random component which is assumed to be normally distributed. It is from this second component that the model achieves the ability to incorporate effectively the uncertainty associated with hydrological processes, making it valuable as a practical tool for synthetic generation of streamflow series. The NN topology and the corresponding analytical explicit formulation of the model are described in detail. The model is calibrated with a series of monthly inflows to two reservoir sites located in the Tagus River basin (Spain, while validation is performed through estimation of a set of statistics that is relevant for water resources systems planning and management. Among others, drought and storage statistics are computed and compared for both the synthetic and historical series. The performance of the NN-based model was compared to that of a standard autoregressive AR(2 model. Results show that NN represents a promising modelling alternative for simulation purposes, with interesting potential in the context of water resources systems management and optimisation. Keywords: neural networks, perceptron multilayer, error backpropagation, hydrological scenario generation, multivariate time-series..
A model for the neural control of pineal periodicity
de Oliveira Cruz, Frederico Alan; Soares, Marilia Amavel Gomes; Cortez, Celia Martins
2016-12-01
The aim of this work was verify if a computational model associating the synchronization dynamics of coupling oscillators to a set of synaptic transmission equations would be able to simulate the control of pineal by a complex neural pathway that connects the retina to this gland. Results from the simulations showed that the frequency and temporal firing patterns were in the range of values found in literature.
Kriegeskorte, Nikolaus
2015-11-24
Recent advances in neural network modeling have enabled major strides in computer vision and other artificial intelligence applications. Human-level visual recognition abilities are coming within reach of artificial systems. Artificial neural networks are inspired by the brain, and their computations could be implemented in biological neurons. Convolutional feedforward networks, which now dominate computer vision, take further inspiration from the architecture of the primate visual hierarchy. However, the current models are designed with engineering goals, not to model brain computations. Nevertheless, initial studies comparing internal representations between these models and primate brains find surprisingly similar representational spaces. With human-level performance no longer out of reach, we are entering an exciting new era, in which we will be able to build biologically faithful feedforward and recurrent computational models of how biological brains perform high-level feats of intelligence, including vision.
Risk prediction model: Statistical and artificial neural network approach
Paiman, Nuur Azreen; Hariri, Azian; Masood, Ibrahim
2017-04-01
Prediction models are increasingly gaining popularity and had been used in numerous areas of studies to complement and fulfilled clinical reasoning and decision making nowadays. The adoption of such models assist physician's decision making, individual's behavior, and consequently improve individual outcomes and the cost-effectiveness of care. The objective of this paper is to reviewed articles related to risk prediction model in order to understand the suitable approach, development and the validation process of risk prediction model. A qualitative review of the aims, methods and significant main outcomes of the nineteen published articles that developed risk prediction models from numerous fields were done. This paper also reviewed on how researchers develop and validate the risk prediction models based on statistical and artificial neural network approach. From the review done, some methodological recommendation in developing and validating the prediction model were highlighted. According to studies that had been done, artificial neural network approached in developing the prediction model were more accurate compared to statistical approach. However currently, only limited published literature discussed on which approach is more accurate for risk prediction model development.
A dynamic neural field model of temporal order judgments.
Hecht, Lauren N; Spencer, John P; Vecera, Shaun P
2015-12-01
Temporal ordering of events is biased, or influenced, by perceptual organization-figure-ground organization-and by spatial attention. For example, within a region assigned figural status or at an attended location, onset events are processed earlier (Lester, Hecht, & Vecera, 2009; Shore, Spence, & Klein, 2001), and offset events are processed for longer durations (Hecht & Vecera, 2011; Rolke, Ulrich, & Bausenhart, 2006). Here, we present an extension of a dynamic field model of change detection (Johnson, Spencer, Luck, & Schöner, 2009; Johnson, Spencer, & Schöner, 2009) that accounts for both the onset and offset performance for figural and attended regions. The model posits that neural populations processing the figure are more active, resulting in a peak of activation that quickly builds toward a detection threshold when the onset of a target is presented. This same enhanced activation for some neural populations is maintained when a present target is removed, creating delays in the perception of the target's offset. We discuss the broader implications of this model, including insights regarding how neural activation can be generated in response to the disappearance of information. (c) 2015 APA, all rights reserved).
Directory of Open Access Journals (Sweden)
Bahita Mohamed
2011-01-01
Full Text Available In this work, we introduce an adaptive neural network controller for a class of nonlinear systems. The approach uses two Radial Basis Functions, RBF networks. The first RBF network is used to approximate the ideal control law which cannot be implemented since the dynamics of the system are unknown. The second RBF network is used for on-line estimating the control gain which is a nonlinear and unknown function of the states. The updating laws for the combined estimator and controller are derived through Lyapunov analysis. Asymptotic stability is established with the tracking errors converging to a neighborhood of the origin. Finally, the proposed method is applied to control and stabilize the inverted pendulum system.
Prediction horizon effects on stochastic modelling hints for neural networks
Energy Technology Data Exchange (ETDEWEB)
Drossu, R.; Obradovic, Z. [Washington State Univ., Pullman, WA (United States)
1995-12-31
The objective of this paper is to investigate the relationship between stochastic models and neural network (NN) approaches to time series modelling. Experiments on a complex real life prediction problem (entertainment video traffic) indicate that prior knowledge can be obtained through stochastic analysis both with respect to an appropriate NN architecture as well as to an appropriate sampling rate, in the case of a prediction horizon larger than one. An improvement of the obtained NN predictor is also proposed through a bias removal post-processing, resulting in much better performance than the best stochastic model.
Guo, Yong-Feng; Xi, Bei; Wei, Fang; Tan, Jian-Guo
2017-12-01
In this paper, the phenomenon of stochastic resonance in FitzHugh-Nagumo (FHN) neural system driven by correlated non-Gaussian noise and Gaussian white noise is investigated. First, the analytical expression of the stationary probability distribution is derived by using the path integral approach and the unified colored noise approximation. Then, we obtain the expression of signal-to-noise ratio (SNR) by applying the theory of two-state model. The results show that the phenomena of stochastic resonance and multiple stochastic resonance appear in FHN neural system under different values of parameters. The effects of the multiplicative noise intensity D and the additive noise intensity Q on the SNR are entirely different. In addition, the discharge behavior of FHN neural system is restrained when the value of Q is smaller. But, it is conducive to enhance signal response of FHN neural system when the values of Q and D are relatively larger.
DEFF Research Database (Denmark)
Kock, Anders Bredahl; Teräsvirta, Timo
In this paper we consider the forecasting performance of a well-defined class of flexible models, the so-called single hidden-layer feedforward neural network models. A major aim of our study is to find out whether they, due to their flexibility, are as useful tools in economic forecasting as some...... previous studies have indicated. When forecasting with neural network models one faces several problems, all of which influence the accuracy of the forecasts. First, neural networks are often hard to estimate due to their highly nonlinear structure. In fact, their parameters are not even globally...... on the linearisation idea: the Marginal Bridge Estimator and Autometrics. Second, one must decide whether forecasting should be carried out recursively or directly. Comparisons of these two methodss exist for linear models and here these comparisons are extended to neural networks. Finally, a nonlinear model...
Validating neural-network refinements of nuclear mass models
Utama, R.; Piekarewicz, J.
2018-01-01
Background: Nuclear astrophysics centers on the role of nuclear physics in the cosmos. In particular, nuclear masses at the limits of stability are critical in the development of stellar structure and the origin of the elements. Purpose: We aim to test and validate the predictions of recently refined nuclear mass models against the newly published AME2016 compilation. Methods: The basic paradigm underlining the recently refined nuclear mass models is based on existing state-of-the-art models that are subsequently refined through the training of an artificial neural network. Bayesian inference is used to determine the parameters of the neural network so that statistical uncertainties are provided for all model predictions. Results: We observe a significant improvement in the Bayesian neural network (BNN) predictions relative to the corresponding "bare" models when compared to the nearly 50 new masses reported in the AME2016 compilation. Further, AME2016 estimates for the handful of impactful isotopes in the determination of r -process abundances are found to be in fairly good agreement with our theoretical predictions. Indeed, the BNN-improved Duflo-Zuker model predicts a root-mean-square deviation relative to experiment of σrms≃400 keV. Conclusions: Given the excellent performance of the BNN refinement in confronting the recently published AME2016 compilation, we are confident of its critical role in our quest for mass models of the highest quality. Moreover, as uncertainty quantification is at the core of the BNN approach, the improved mass models are in a unique position to identify those nuclei that will have the strongest impact in resolving some of the outstanding questions in nuclear astrophysics.
Directory of Open Access Journals (Sweden)
Manjunath Patel Gowdru Chandrashekarappa
2014-01-01
Full Text Available The present research work is focussed to develop an intelligent system to establish the input-output relationship utilizing forward and reverse mappings of artificial neural networks. Forward mapping aims at predicting the density and secondary dendrite arm spacing (SDAS from the known set of squeeze cast process parameters such as time delay, pressure duration, squeezes pressure, pouring temperature, and die temperature. An attempt is also made to meet the industrial requirements of developing the reverse model to predict the recommended squeeze cast parameters for the desired density and SDAS. Two different neural network based approaches have been proposed to carry out the said task, namely, back propagation neural network (BPNN and genetic algorithm neural network (GA-NN. The batch mode of training is employed for both supervised learning networks and requires huge training data. The requirement of huge training data is generated artificially at random using regression equation derived through real experiments carried out earlier by the same authors. The performances of BPNN and GA-NN models are compared among themselves with those of regression for ten test cases. The results show that both models are capable of making better predictions and the models can be effectively used in shop floor in selection of most influential parameters for the desired outputs.
Genetic optimization of neural network and fuzzy logic for oil bubble point pressure modeling
Energy Technology Data Exchange (ETDEWEB)
Afshar, Mohammad [Islamic Azad University, Kharg (Iran, Islamic Republic of); Gholami, Amin [Petroleum University of Technology, Abadan (Iran, Islamic Republic of); Asoodeh, Mojtaba [Islamic Azad University, Birjand (Iran, Islamic Republic of)
2014-03-15
Bubble point pressure is a critical pressure-volume-temperature (PVT) property of reservoir fluid, which plays an important role in almost all tasks involved in reservoir and production engineering. We developed two sophisticated models to estimate bubble point pressure from gas specific gravity, oil gravity, solution gas oil ratio, and reservoir temperature. Neural network and adaptive neuro-fuzzy inference system are powerful tools for extracting the underlying dependency of a set of input/output data. However, the mentioned tools are in danger of sticking in local minima. The present study went further by optimizing fuzzy logic and neural network models using the genetic algorithm in charge of eliminating the risk of being exposed to local minima. This strategy is capable of significantly improving the accuracy of both neural network and fuzzy logic models. The proposed methodology was successfully applied to a dataset of 153 PVT data points. Results showed that the genetic algorithm can serve the neural network and neuro-fuzzy models from local minima trapping, which might occur through back-propagation algorithm.
Modeling and Optimization Technique of a Chilled Water AHU Using Artificial Neural Network Methods
Talib, Rand Issa
Heating, ventilation, and air conditioning (HVAC) systems are widely used in buildings to provide occupants with conditioned air and acceptable indoor air quality. The chilled water system is one Heating, ventilation, and air conditioning systems are widely used in buildings to provide occupants with conditioned air and acceptable indoor air quality. The design of these systems constitutes a large impact on the energy usage and operating cost of buildings they serve. The ability to accurately predict the performance of these systems is integral to designing more energy efficient and sustainable building systems. In this thesis the modeling of a chilled water air handling units using Artificial Neural Networks model is proposed. The Artificial neural network model was built using four inputs (1) Chilled water temperature (CHWT), (2) Chilled water valve position (CWVLV), (3) Mixed air temperature (MAT), and (4) Supply air flow (SAF). The output of the model is to predict supply air temperature. Moreover, another model was constructed to predict the fan power as a function of the fan air flow and fan speed. The data that were collected from a real building in a span of three months were processed. The ANN model was trained using the measured data and different model structure were then tested with various time delay, feedback time, and number of neurons to determine the best structure. In addition, an optimization method is developed to automate the process of finding the best model structure that can produce the best accurate prediction against the actual data. The Coefficient of variances which was used to determine the error value was recorded to be as low as 1.22 for the best model structure. The obtained results validate the Artificial neural network model created as an accurate tool for predicting the performance of a chilled water air handling unit.
Directory of Open Access Journals (Sweden)
Jilin Zhang
2017-01-01
Full Text Available With the development of the mobile systems, we gain a lot of benefits and convenience by leveraging mobile devices; at the same time, the information gathered by smartphones, such as location and environment, is also valuable for business to provide more intelligent services for customers. More and more machine learning methods have been used in the field of mobile information systems to study user behavior and classify usage patterns, especially convolutional neural network. With the increasing of model training parameters and data scale, the traditional single machine training method cannot meet the requirements of time complexity in practical application scenarios. The current training framework often uses simple data parallel or model parallel method to speed up the training process, which is why heterogeneous computing resources have not been fully utilized. To solve these problems, our paper proposes a delay synchronization convolutional neural network parallel strategy, which leverages the heterogeneous system. The strategy is based on both synchronous parallel and asynchronous parallel approaches; the model training process can reduce the dependence on the heterogeneous architecture in the premise of ensuring the model convergence, so the convolution neural network framework is more adaptive to different heterogeneous system environments. The experimental results show that the proposed delay synchronization strategy can achieve at least three times the speedup compared to the traditional data parallelism.
Directory of Open Access Journals (Sweden)
C. K. Kwong
2013-01-01
Full Text Available Affective design is an important aspect of product development to achieve a competitive edge in the marketplace. A neural-fuzzy network approach has been attempted recently to model customer satisfaction for affective design and it has been proved to be an effective one to deal with the fuzziness and non-linearity of the modeling as well as generate explicit customer satisfaction models. However, such an approach to modeling customer satisfaction has two limitations. First, it is not suitable for the modeling problems which involve a large number of inputs. Second, it cannot adapt to new data sets, given that its structure is fixed once it has been developed. In this paper, a modified dynamic evolving neural-fuzzy approach is proposed to address the above mentioned limitations. A case study on the affective design of mobile phones was conducted to illustrate the effectiveness of the proposed methodology. Validation tests were conducted and the test results indicated that: (1 the conventional Adaptive Neuro-Fuzzy Inference System (ANFIS failed to run due to a large number of inputs; (2 the proposed dynamic neural-fuzzy model outperforms the subtractive clustering-based ANFIS model and fuzzy c-means clustering-based ANFIS model in terms of their modeling accuracy and computational effort.
A neural joint model for entity and relation extraction from biomedical text.
Li, Fei; Zhang, Meishan; Fu, Guohong; Ji, Donghong
2017-03-31
Extracting biomedical entities and their relations from text has important applications on biomedical research. Previous work primarily utilized feature-based pipeline models to process this task. Many efforts need to be made on feature engineering when feature-based models are employed. Moreover, pipeline models may suffer error propagation and are not able to utilize the interactions between subtasks. Therefore, we propose a neural joint model to extract biomedical entities as well as their relations simultaneously, and it can alleviate the problems above. Our model was evaluated on two tasks, i.e., the task of extracting adverse drug events between drug and disease entities, and the task of extracting resident relations between bacteria and location entities. Compared with the state-of-the-art systems in these tasks, our model improved the F1 scores of the first task by 5.1% in entity recognition and 8.0% in relation extraction, and that of the second task by 9.2% in relation extraction. The proposed model achieves competitive performances with less work on feature engineering. We demonstrate that the model based on neural networks is effective for biomedical entity and relation extraction. In addition, parameter sharing is an alternative method for neural models to jointly process this task. Our work can facilitate the research on biomedical text mining.
Kwong, C K; Fung, K Y; Jiang, Huimin; Chan, K Y; Siu, Kin Wai Michael
2013-01-01
Affective design is an important aspect of product development to achieve a competitive edge in the marketplace. A neural-fuzzy network approach has been attempted recently to model customer satisfaction for affective design and it has been proved to be an effective one to deal with the fuzziness and non-linearity of the modeling as well as generate explicit customer satisfaction models. However, such an approach to modeling customer satisfaction has two limitations. First, it is not suitable for the modeling problems which involve a large number of inputs. Second, it cannot adapt to new data sets, given that its structure is fixed once it has been developed. In this paper, a modified dynamic evolving neural-fuzzy approach is proposed to address the above mentioned limitations. A case study on the affective design of mobile phones was conducted to illustrate the effectiveness of the proposed methodology. Validation tests were conducted and the test results indicated that: (1) the conventional Adaptive Neuro-Fuzzy Inference System (ANFIS) failed to run due to a large number of inputs; (2) the proposed dynamic neural-fuzzy model outperforms the subtractive clustering-based ANFIS model and fuzzy c-means clustering-based ANFIS model in terms of their modeling accuracy and computational effort.
An avian model for the reversal of neurobehavioral teratogenicity with neural stem cells.
Dotan, Sharon; Pinkas, Adi; Slotkin, Theodore A; Yanai, Joseph
2010-01-01
A fast and simple model which uses lower animals on the evolutionary scale is beneficial for developing procedures for the reversal of neurobehavioral teratogenicity with neural stem cells. Here, we established a procedure for the derivation of chick neural stem cells, establishing embryonic day (E) 10 as optimal for progression to neuronal phenotypes. Cells were obtained from the embryonic cerebral hemispheres and incubated for 5-7 days in enriched medium containing epidermal growth factor (EGF) and basic fibroblast growth factor (FGF2) according to a procedure originally developed for mice. A small percentage of the cells survived, proliferated and formed nestin-positive neurospheres. After removal of the growth factors to allow differentiation (5 days), 74% of the cells differentiated into all major lineages of the nervous system, including neurons (Beta III tubulin-positive, 54% of the total number of differentiated cells), astrocytes (GFAP-positive, 26%), and oligodendrocytes (O4-positive, 20%). These findings demonstrate that the cells were indeed neural stem cells. Next, the cells were transplanted in two allograft chick models; (1) direct cerebral transplantation to 24-h-old chicks, followed by post-transplantation cell tracking at 24 h, 6 days and 14 days, and (2) intravenous transplantation to chick embryos on E13, followed by cell tracking on E19. With both methods, transplanted cells were found in the brain. The chick embryo provides a convenient, precisely-timed and unlimited supply of neural progenitors for therapy by transplantation, as well as constituting a fast and simple model in which to evaluate the ability of neural stem cell transplantation to repair neural damage, steps that are critical for progress toward therapeutic applications. Copyright 2010 Elsevier Inc. All rights reserved.
Psychological Processing in Chronic Pain: A Neural Systems Approach
Simons, Laura; Elman, Igor; Borsook, David
2014-01-01
Our understanding of chronic pain involves complex brain circuits that include sensory, emotional, cognitive and interoceptive processing. The feed-forward interactions between physical (e.g., trauma) and emotional pain and the consequences of altered psychological status on the expression of pain have made the evaluation and treatment of chronic pain a challenge in the clinic. By understanding the neural circuits involved in psychological processes, a mechanistic approach to the implementation of psychology-based treatments may be better understood. In this review we evaluate some of the principle processes that may be altered as a consequence of chronic pain in the context of localized and integrated neural networks. These changes are ongoing, vary in their magnitude, and their hierarchical manifestations, and may be temporally and sequentially altered by treatments, and all contribute to an overall pain phenotype. Furthermore, we link altered psychological processes to specific evidence-based treatments to put forth a model of pain neuroscience psychology. PMID:24374383
Wang, Sheng-Jun; Ouyang, Guang; Guang, Jing; Zhang, Mingsha; Wong, K. Y. Michael; Zhou, Changsong
2016-01-01
Self-organized critical states (SOCs) and stochastic oscillations (SOs) are simultaneously observed in neural systems, which appears to be theoretically contradictory since SOCs are characterized by scale-free avalanche sizes but oscillations indicate typical scales. Here, we show that SOs can emerge in SOCs of small size systems due to temporal correlation between large avalanches at the finite-size cutoff, resulting from the accumulation-release process in SOCs. In contrast, the critical branching process without accumulation-release dynamics cannot exhibit oscillations. The reconciliation of SOCs and SOs is demonstrated both in the sandpile model and robustly in biologically plausible neuronal networks. The oscillations can be suppressed if external inputs eliminate the prominent slow accumulation process, providing a potential explanation of the widely studied Berger effect or event-related desynchronization in neural response. The features of neural oscillations and suppression are confirmed during task processing in monkey eye-movement experiments. Our results suggest that finite-size, columnar neural circuits may play an important role in generating neural oscillations around the critical states, potentially enabling functional advantages of both SOCs and oscillations for sensitive response to transient stimuli.
Predictive and Neural Predictive Control of Uncertain Systems
Kelkar, Atul G.
2000-01-01
Accomplishments and future work are:(1) Stability analysis: the work completed includes characterization of stability of receding horizon-based MPC in the setting of LQ paradigm. The current work-in-progress includes analyzing local as well as global stability of the closed-loop system under various nonlinearities; for example, actuator nonlinearities; sensor nonlinearities, and other plant nonlinearities. Actuator nonlinearities include three major types of nonlineaxities: saturation, dead-zone, and (0, 00) sector. (2) Robustness analysis: It is shown that receding horizon parameters such as input and output horizon lengths have direct effect on the robustness of the system. (3) Code development: A matlab code has been developed which can simulate various MPC formulations. The current effort is to generalize the code to include ability to handle all plant types and all MPC types. (4) Improved predictor: It is shown that MPC design using better predictors that can minimize prediction errors. It is shown analytically and numerically that Smith predictor can provide closed-loop stability under GPC operation for plants with dead times where standard optimal predictor fails. (5) Neural network predictors: When neural network is used as predictor it can be shown that neural network predicts the plant output within some finite error bound under certain conditions. Our preliminary study shows that with proper choice of update laws and network architectures such bound can be obtained. However, much work needs to be done to obtain a similar result in general case.
Neural model for learning-to-learn of novel task sets in the motor domain.
Pitti, Alexandre; Braud, Raphaël; Mahé, Sylvain; Quoy, Mathias; Gaussier, Philippe
2013-01-01
During development, infants learn to differentiate their motor behaviors relative to various contexts by exploring and identifying the correct structures of causes and effects that they can perform; these structures of actions are called task sets or internal models. The ability to detect the structure of new actions, to learn them and to select on the fly the proper one given the current task set is one great leap in infants cognition. This behavior is an important component of the child's ability of learning-to-learn, a mechanism akin to the one of intrinsic motivation that is argued to drive cognitive development. Accordingly, we propose to model a dual system based on (1) the learning of new task sets and on (2) their evaluation relative to their uncertainty and prediction error. The architecture is designed as a two-level-based neural system for context-dependent behavior (the first system) and task exploration and exploitation (the second system). In our model, the task sets are learned separately by reinforcement learning in the first network after their evaluation and selection in the second one. We perform two different experimental setups to show the sensorimotor mapping and switching between tasks, a first one in a neural simulation for modeling cognitive tasks and a second one with an arm-robot for motor task learning and switching. We show that the interplay of several intrinsic mechanisms drive the rapid formation of the neural populations with respect to novel task sets.
Intelligent systems II complete approximation by neural network operators
Anastassiou, George A
2016-01-01
This monograph is the continuation and completion of the monograph, “Intelligent Systems: Approximation by Artificial Neural Networks” written by the same author and published 2011 by Springer. The book you hold in hand presents the complete recent and original work of the author in approximation by neural networks. Chapters are written in a self-contained style and can be read independently. Advanced courses and seminars can be taught out of this brief book. All necessary background and motivations are given per chapter. A related list of references is given also per chapter. The book’s results are expected to find applications in many areas of applied mathematics, computer science and engineering. As such this monograph is suitable for researchers, graduate students, and seminars of the above subjects, also for all science and engineering libraries. .
Neural network connectivity and response latency modelled by stochastic processes
DEFF Research Database (Denmark)
Tamborrino, Massimiliano
is connected to thousands of other neurons. The rst question is: how to model neural networks through stochastic processes? A multivariate Ornstein-Uhlenbeck process, obtained as a diffusion approximation of a jump process, is the proposed answer. Obviously, dependencies between neurons imply dependencies......Stochastic processes and their rst passage times have been widely used to describe the membrane potential dynamics of single neurons and to reproduce neuronal spikes, respectively.However, cerebral cortex in human brains is estimated to contain 10-20 billions of neurons and each of them...... between their spike times. Therefore, the second question is: how to detect neural network connectivity from simultaneously recorded spike trains? Answering this question corresponds to investigate the joint distribution of sequences of rst passage times. A non-parametric method based on copulas...
Neural network connectivity and response latency modelled by stochastic processes
DEFF Research Database (Denmark)
Tamborrino, Massimiliano
is connected to thousands of other neurons. The rst question is: how to model neural networks through stochastic processes? A multivariate Ornstein-Uhlenbeck process, obtained as a diffusion approximation of a jump process, is the proposed answer. Obviously, dependencies between neurons imply dependencies...... between their spike times. Therefore, the second question is: how to detect neural network connectivity from simultaneously recorded spike trains? Answering this question corresponds to investigate the joint distribution of sequences of rst passage times. A non-parametric method based on copulas...... generation of pikes. When a stimulus is applied to the network, the spontaneous rings may prevail and hamper detection of the effects of the stimulus. Therefore, the spontaneous rings cannot be ignored and the response latency has to be detected on top of a background signal. Everything becomes more dicult...
Silicon synaptic transistor for hardware-based spiking neural network and neuromorphic system
Kim, Hyungjin; Hwang, Sungmin; Park, Jungjin; Park, Byung-Gook
2017-10-01
Brain-inspired neuromorphic systems have attracted much attention as new computing paradigms for power-efficient computation. Here, we report a silicon synaptic transistor with two electrically independent gates to realize a hardware-based neural network system without any switching components. The spike-timing dependent plasticity characteristics of the synaptic devices are measured and analyzed. With the help of the device model based on the measured data, the pattern recognition capability of the hardware-based spiking neural network systems is demonstrated using the modified national institute of standards and technology handwritten dataset. By comparing systems with and without inhibitory synapse part, it is confirmed that the inhibitory synapse part is an essential element in obtaining effective and high pattern classification capability.
Directory of Open Access Journals (Sweden)
Mohammad Taghi Ameli
2012-01-01
Full Text Available Transmission Network Expansion Planning (TNEP is a basic part of power network planning that determines where, when and how many new transmission lines should be added to the network. So, the TNEP is an optimization problem in which the expansion purposes are optimized. Artificial Intelligence (AI tools such as Genetic Algorithm (GA, Simulated Annealing (SA, Tabu Search (TS and Artificial Neural Networks (ANNs are methods used for solving the TNEP problem. Today, by using the hybridization models of AI tools, we can solve the TNEP problem for large-scale systems, which shows the effectiveness of utilizing such models. In this paper, a new approach to the hybridization model of Probabilistic Neural Networks (PNNs and Harmony Search Algorithm (HSA was used to solve the TNEP problem. Finally, by considering the uncertain role of the load based on a scenario technique, this proposed model was tested on the Garver’s 6-bus network.
[Research on UKF control of epileptic-form spikes in neural mass models].
Liu, Xian; Ma, Baiwang; Ji, June; Li, Xiaoli
2013-12-01
Neural mass models are able to produce epileptic electroencephalogram (EEG) signals in different stages of seizures. The models play important roles in studying the mechanism analysis and control of epileptic seizures. In this study, the closed-loop feedback control was used to suppress the epileptic-form spikes in the neural mass models. It was expected to provide certain theory basis for the choice of stimulus position and parameter in the clinical treatment. With the influence of measurement noise taken into account, an unscented Kalman filter (UKF) was added to the feedback loop to estimate the system state and an UKF controller was constructed via the estimated state. The control action was imposed on the hyper-excitable population and all populations respectively in simulations. It was shown that both UKF control schemes suppressed the epileptic-form spikes in the model. However, the control energy needed in the latter scheme was less than that needed in the former one.
Analysis of Neural-BOLD Coupling through Four Models of the Neural Metabolic Demand
Directory of Open Access Journals (Sweden)
Christopher W Tyler
2015-12-01
Full Text Available The coupling of the neuronal energetics to the blood-oxygen-level-dependent (BOLD response is still incompletely understood. To address this issue, we compared the fits of four plausible models of neurometabolic coupling dynamics to available data for simultaneous recordings of the local field potential (LFP and the local BOLD response recorded from monkey primary visual cortex over a wide range of stimulus durations. The four models of the metabolic demand driving the BOLD response were: direct coupling with the overall LFP; rectified coupling to the LFP; coupling with a slow adaptive component of the implied neural population response; and coupling with the non-adaptive intracellular input signal defined by the stimulus time course. Taking all stimulus durations into account, the results imply that the BOLD response is most closely coupled with metabolic demand derived from the intracellular input waveform, without significant influence from the adaptive transients and nonlinearities exhibited by the LFP waveform.
Vaz, A. G R; Elsinga, B.|info:eu-repo/dai/nl/372629601; van Sark, W. G J H M|info:eu-repo/dai/nl/074628526; Brito, M. C.
2016-01-01
In order to perform predictions of a photovoltaic (PV) system power production, a neural network architecture system using the Nonlinear Autoregressive with eXogenous inputs (NARX) model is implemented using not only local meteorological data but also measurements of neighbouring PV systems as
[A telemetery system for neural signal acquiring and processing].
Wang, Min; Song, Yongji; Suen, Jiantao; Zhao, Yiliang; Jia, Aibin; Zhu, Jianping
2011-02-01
Recording and extracting characteristic brain signals in freely moving animals is the basic and significant requirement in the study of brain-computer interface (BCI). To record animal's behaving and extract characteristic brain signals simultaneously could help understand the complex behavior of neural ensembles. Here, a system was established to record and analyse extracellular discharge in freely moving rats for the study of BCI. It comprised microelectrode and micro-driver assembly, analog front end (AFE), programmer system on chip (PSoC), wireless communication and the LabVIEW used as the platform for the graphic user interface.
Development of Ensemble Neural Network Convection Parameterizations for Climate Models
Energy Technology Data Exchange (ETDEWEB)
Fox-Rabinovitz, M. S.; Krasnopolsky, V. M.
2012-05-02
The novel neural network (NN) approach has been formulated and used for development of a NN ensemble stochastic convection parametrization for climate models. This fast parametrization is built based on data from Cloud Resolving Model (CRM) simulations initialized with and forced by TOGA-COARE data. The SAM (System for Atmospheric Modeling), developed by D. Randall, M. Khairoutdinov, and their collaborators, has been used for CRM simulations. The observational data are also used for validation of model simulations. The SAM-simulated data have been averaged and projected onto the GCM space of atmospheric states to implicitly define a stochastic convection parametrization. This parametrization is emulated using an ensemble of NNs. An ensemble of NNs with different NN parameters has been trained and tested. The inherent uncertainty of the stochastic convection parametrization derived in such a way is estimated. Due to these inherent uncertainties, NN ensemble is used to constitute a stochastic NN convection parametrization. The developed NN convection parametrization have been validated in a diagnostic CAM (CAM-NN) run vs. the control CAM run. Actually, CAM inputs have been used, at every time step of the control/original CAM integration, for parallel calculations of the NN convection parametrization (CAM-NN) to produce its outputs as a diagnostic byproduct. Total precipitation (P) and cloudiness (CLD) time series, diurnal cycles, and P and CLD distributions for the large Tropical Pacific Ocean for the parallel CAM-NN and CAM runs show similarity and consistency with the NCEP reanalysis. The P and CLD distributions for the tropical area for the parallel runs have been analyzed first for the TOGA-COARE boreal winter season (November 1992 through February 1993) and then for the winter seasons of the follow-up parallel decadal simulations. The obtained results are encouraging and practically meaningful. They show the validity of the NN approach. This constitutes an
Passivation and control of partially known SISO nonlinear systems via dynamic neural networks
Directory of Open Access Journals (Sweden)
Reyes-Reyes J.
2000-01-01
Full Text Available In this paper, an adaptive technique is suggested to provide the passivity property for a class of partially known SISO nonlinear systems. A simple Dynamic Neural Network (DNN, containing only two neurons and without any hidden-layers, is used to identify the unknown nonlinear system. By means of a Lyapunov-like analysis the new learning law for this DNN, guarantying both successful identification and passivation effects, is derived. Based on this adaptive DNN model, an adaptive feedback controller, serving for wide class of nonlinear systems with an a priori incomplete model description, is designed. Two typical examples illustrate the effectiveness of the suggested approach.
Neural network modeling of a dolphin's sonar discrimination capabilities
DEFF Research Database (Denmark)
Andersen, Lars Nonboe; René Rasmussen, A; Au, WWL
1994-01-01
The capability of an echo-locating dolphin to discriminate differences in the wall thickness of cylinders was previously modeled by a counterpropagation neural network using only spectral information of the echoes [W. W. L. Au, J. Acoust. Soc. Am. 95, 2728–2735 (1994)]. In this study, both time...... and frequency information were used to model the dolphin discrimination capabilities. Echoes from the same cylinders were digitized using a broadband simulated dolphin sonar signal with the transducer mounted on the dolphin's pen. The echoes were filtered by a bank of continuous constant-Q digital filters...
Design of a neurally plausible model of fear learning
Directory of Open Access Journals (Sweden)
Franklin B. Krasne
2011-07-01
Full Text Available A neurally oriented conceptual and computational model of fear conditioning ("Fraidy Rat" or FRAT has been constructed that accounts for many aspects of delay and context conditioning. Conditioning and extinction are the result of neuromodulation-controlled LTP at synapses of thalamic, cortical, and hippocampal afferents on principal cells and inhibitory interneurons of lateral and basal amygdala. The phenomena accounted for by the model (and simulated by the computational version include conditioning, secondary reinforcement, blocking, the immediate shock deficit, extinction, renewal, and a range of empirically valid effects of pre- and post-training ablation or inactivation of hippocampus or amygdala nuclei.
Berenji, Hamid R.
1992-01-01
Fuzzy logic and neural networks provide new methods for designing control systems. Fuzzy logic controllers do not require a complete analytical model of a dynamic system and can provide knowledge-based heuristic controllers for ill-defined and complex systems. Neural networks can be used for learning control. In this chapter, we discuss hybrid methods using fuzzy logic and neural networks which can start with an approximate control knowledge base and refine it through reinforcement learning.
Neural Energy Supply-Consumption Properties Based on Hodgkin-Huxley Model
Directory of Open Access Journals (Sweden)
Yihong Wang
2017-01-01
Full Text Available Electrical activity is the foundation of the neural system. Coding theories that describe neural electrical activity by the roles of action potential timing or frequency have been thoroughly studied. However, an alternative method to study coding questions is the energy method, which is more global and economical. In this study, we clearly defined and calculated neural energy supply and consumption based on the Hodgkin-Huxley model, during firing action potentials and subthreshold activities using ion-counting and power-integral model. Furthermore, we analyzed energy properties of each ion channel and found that, under the two circumstances, power synchronization of ion channels and energy utilization ratio have significant differences. This is particularly true of the energy utilization ratio, which can rise to above 100% during subthreshold activity, revealing an overdraft property of energy use. These findings demonstrate the distinct status of the energy properties during neuronal firings and subthreshold activities. Meanwhile, after introducing a synapse energy model, this research can be generalized to energy calculation of a neural network. This is potentially important for understanding the relationship between dynamical network activities and cognitive behaviors.
Chen, Chang Hao; Pun, Sio Hang; Mak, Peng Un; Vai, Mang I; Klug, Achim; Lei, Tim C
2014-01-01
Glass micropipettes are widely used to record neural activity from single neurons or clusters of neurons extracellularly in live animals. However, to date, there has been no comprehensive study of noise in extracellular recordings with glass micropipettes. The purpose of this work was to assess various noise sources that affect extracellular recordings and to create model systems in which novel micropipette neural amplifier designs can be tested. An equivalent circuit of the glass micropipette and the noise model of this circuit, which accurately describe the various noise sources involved in extracellular recordings, have been developed. Measurement schemes using dead brain tissue as well as extracellular recordings from neurons in the inferior colliculus, an auditory brain nucleus of an anesthetized gerbil, were used to characterize noise performance and amplification efficacy of the proposed micropipette neural amplifier. According to our model, the major noise sources which influence the signal to noise ratio are the intrinsic noise of the neural amplifier and the thermal noise from distributed pipette resistance. These two types of noise were calculated and measured and were shown to be the dominating sources of background noise for in vivo experiments.
Directory of Open Access Journals (Sweden)
Chang Hao Chen
2014-01-01
Full Text Available Glass micropipettes are widely used to record neural activity from single neurons or clusters of neurons extracellularly in live animals. However, to date, there has been no comprehensive study of noise in extracellular recordings with glass micropipettes. The purpose of this work was to assess various noise sources that affect extracellular recordings and to create model systems in which novel micropipette neural amplifier designs can be tested. An equivalent circuit of the glass micropipette and the noise model of this circuit, which accurately describe the various noise sources involved in extracellular recordings, have been developed. Measurement schemes using dead brain tissue as well as extracellular recordings from neurons in the inferior colliculus, an auditory brain nucleus of an anesthetized gerbil, were used to characterize noise performance and amplification efficacy of the proposed micropipette neural amplifier. According to our model, the major noise sources which influence the signal to noise ratio are the intrinsic noise of the neural amplifier and the thermal noise from distributed pipette resistance. These two types of noise were calculated and measured and were shown to be the dominating sources of background noise for in vivo experiments.
Neural Energy Supply-Consumption Properties Based on Hodgkin-Huxley Model.
Wang, Yihong; Wang, Rubin; Xu, Xuying
2017-01-01
Electrical activity is the foundation of the neural system. Coding theories that describe neural electrical activity by the roles of action potential timing or frequency have been thoroughly studied. However, an alternative method to study coding questions is the energy method, which is more global and economical. In this study, we clearly defined and calculated neural energy supply and consumption based on the Hodgkin-Huxley model, during firing action potentials and subthreshold activities using ion-counting and power-integral model. Furthermore, we analyzed energy properties of each ion channel and found that, under the two circumstances, power synchronization of ion channels and energy utilization ratio have significant differences. This is particularly true of the energy utilization ratio, which can rise to above 100% during subthreshold activity, revealing an overdraft property of energy use. These findings demonstrate the distinct status of the energy properties during neuronal firings and subthreshold activities. Meanwhile, after introducing a synapse energy model, this research can be generalized to energy calculation of a neural network. This is potentially important for understanding the relationship between dynamical network activities and cognitive behaviors.
Predicting the parameters of energy installations with laser ignition: Neural network models
Directory of Open Access Journals (Sweden)
Alexey A. Pastukhov
2015-06-01
Full Text Available This article considers the possibility of using artificial neural networks for predicting the parameters of the model energy installation with laser ignition. The main stages of creating a prognostic model based on an artificial neural network have been presented. Input data were analyzed by principal component method. The synthesized neural network was designed to predict the parameter value of the model in question. The artificial neural network was trained by a back-propagation algorithm. The efficiency of the artificial neural networks and their applicability to predicting parameter values of various rocket engine elements were demonstrated.
Liu, Jinkun
2013-01-01
Radial Basis Function (RBF) Neural Network Control for Mechanical Systems is motivated by the need for systematic design approaches to stable adaptive control system design using neural network approximation-based techniques. The main objectives of the book are to introduce the concrete design methods and MATLAB simulation of stable adaptive RBF neural control strategies. In this book, a broad range of implementable neural network control design methods for mechanical systems are presented, such as robot manipulators, inverted pendulums, single link flexible joint robots, motors, etc. Advanced neural network controller design methods and their stability analysis are explored. The book provides readers with the fundamentals of neural network control system design. This book is intended for the researchers in the fields of neural adaptive control, mechanical systems, Matlab simulation, engineering design, robotics and automation. Jinkun Liu is a professor at Beijing University of Aeronautics and Astronauti...
Neural Network Target Identification System for False Alarm Reduction
Ye, David; Edens, Weston; Lu, Thomas T.; Chao, Tien-Hsin
2009-01-01
A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feed forward back propagation neural network (NN) is then trained to classify each feature vector and remove false positives. This paper discusses the test of the system performance and parameter optimizations process which adapts the system to various targets and datasets. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar image dataset.
Dynamical systems, attractors, and neural circuits [version 1; referees: 3 approved
Directory of Open Access Journals (Sweden)
Paul Miller
2016-05-01
Full Text Available Biology is the study of dynamical systems. Yet most of us working in biology have limited pedagogical training in the theory of dynamical systems, an unfortunate historical fact that can be remedied for future generations of life scientists. In my particular field of systems neuroscience, neural circuits are rife with nonlinearities at all levels of description, rendering simple methodologies and our own intuition unreliable. Therefore, our ideas are likely to be wrong unless informed by good models. These models should be based on the mathematical theories of dynamical systems since functioning neurons are dynamic—they change their membrane potential and firing rates with time. Thus, selecting the appropriate type of dynamical system upon which to base a model is an important first step in the modeling process. This step all too easily goes awry, in part because there are many frameworks to choose from, in part because the sparsely sampled data can be consistent with a variety of dynamical processes, and in part because each modeler has a preferred modeling approach that is difficult to move away from. This brief review summarizes some of the main dynamical paradigms that can arise in neural circuits, with comments on what they can achieve computationally and what signatures might reveal their presence within empirical data. I provide examples of different dynamical systems using simple circuits of two or three cells, emphasizing that any one connectivity pattern is compatible with multiple, diverse functions.
Directory of Open Access Journals (Sweden)
Lars Buesing
2011-11-01
Full Text Available The organization of computations in networks of spiking neurons in the brain is still largely unknown, in particular in view of the inherently stochastic features of their firing activity and the experimentally observed trial-to-trial variability of neural systems in the brain. In principle there exists a powerful computational framework for stochastic computations, probabilistic inference by sampling, which can explain a large number of macroscopic experimental data in neuroscience and cognitive science. But it has turned out to be surprisingly difficult to create a link between these abstract models for stochastic computations and more detailed models of the dynamics of networks of spiking neurons. Here we create such a link and show that under some conditions the stochastic firing activity of networks of spiking neurons can be interpreted as probabilistic inference via Markov chain Monte Carlo (MCMC sampling. Since common methods for MCMC sampling in distributed systems, such as Gibbs sampling, are inconsistent with the dynamics of spiking neurons, we introduce a different approach based on non-reversible Markov chains that is able to reflect inherent temporal processes of spiking neuronal activity through a suitable choice of random variables. We propose a neural network model and show by a rigorous theoretical analysis that its neural activity implements MCMC sampling of a given distribution, both for the case of discrete and continuous time. This provides a step towards closing the gap between abstract functional models of cortical computation and more detailed models of networks of spiking neurons.
Buesing, Lars; Bill, Johannes; Nessler, Bernhard; Maass, Wolfgang
2011-11-01
The organization of computations in networks of spiking neurons in the brain is still largely unknown, in particular in view of the inherently stochastic features of their firing activity and the experimentally observed trial-to-trial variability of neural systems in the brain. In principle there exists a powerful computational framework for stochastic computations, probabilistic inference by sampling, which can explain a large number of macroscopic experimental data in neuroscience and cognitive science. But it has turned out to be surprisingly difficult to create a link between these abstract models for stochastic computations and more detailed models of the dynamics of networks of spiking neurons. Here we create such a link and show that under some conditions the stochastic firing activity of networks of spiking neurons can be interpreted as probabilistic inference via Markov chain Monte Carlo (MCMC) sampling. Since common methods for MCMC sampling in distributed systems, such as Gibbs sampling, are inconsistent with the dynamics of spiking neurons, we introduce a different approach based on non-reversible Markov chains that is able to reflect inherent temporal processes of spiking neuronal activity through a suitable choice of random variables. We propose a neural network model and show by a rigorous theoretical analysis that its neural activity implements MCMC sampling of a given distribution, both for the case of discrete and continuous time. This provides a step towards closing the gap between abstract functional models of cortical computation and more detailed models of networks of spiking neurons.
FPGA implementation of a biological neural network based on the Hodgkin-Huxley neuron model.
Yaghini Bonabi, Safa; Asgharian, Hassan; Safari, Saeed; Nili Ahmadabadi, Majid
2014-01-01
A set of techniques for efficient implementation of Hodgkin-Huxley-based (H-H) model of a neural network on FPGA (Field Programmable Gate Array) is presented. The central implementation challenge is H-H model complexity that puts limits on the network size and on the execution speed. However, basics of the original model cannot be compromised when effect of synaptic specifications on the network behavior is the subject of study. To solve the problem, we used computational techniques such as CORDIC (Coordinate Rotation Digital Computer) algorithm and step-by-step integration in the implementation of arithmetic circuits. In addition, we employed different techniques such as sharing resources to preserve the details of model as well as increasing the network size in addition to keeping the network execution speed close to real time while having high precision. Implementation of a two mini-columns network with 120/30 excitatory/inhibitory neurons is provided to investigate the characteristic of our method in practice. The implementation techniques provide an opportunity to construct large FPGA-based network models to investigate the effect of different neurophysiological mechanisms, like voltage-gated channels and synaptic activities, on the behavior of a neural network in an appropriate execution time. Additional to inherent properties of FPGA, like parallelism and re-configurability, our approach makes the FPGA-based system a proper candidate for study on neural control of cognitive robots and systems as well.
Hybrid neural network model for the design of beam subjected to ...
Indian Academy of Sciences (India)
This paper demonstrates the applicability of Artiﬁcial Neural Networks (ANN) and Genetic Algorithms (GA) for the design of beams subjected to moment and shear. A hybrid neural network model which combines the features of feed forward neural networks and genetic algorithms has been developed for the design of beam ...
Genetic Algorithm Optimization of Artificial Neural Networks for Hydrological Modelling
Abrahart, R. J.
2004-05-01
This paper will consider the case for genetic algorithm optimization in the development of an artificial neural network model. It will provide a methodological evaluation of reported investigations with respect to hydrological forecasting and prediction. The intention in such operations is to develop a superior modelling solution that will be: \\begin{itemize} more accurate in terms of output precision and model estimation skill; more tractable in terms of personal requirements and end-user control; and/or more robust in terms of conceptual and mechanical power with respect to adverse conditions. The genetic algorithm optimization toolbox could be used to perform a number of specific roles or purposes and it is the harmonious and supportive relationship between neural networks and genetic algorithms that will be highlighted and assessed. There are several neural network mechanisms and procedures that could be enhanced and potential benefits are possible at different stages in the design and construction of an operational hydrological model e.g. division of inputs; identification of structure; initialization of connection weights; calibration of connection weights; breeding operations between successful models; and output fusion associated with the development of ensemble solutions. Each set of opportunities will be discussed and evaluated. Two strategic questions will also be considered: [i] should optimization be conducted as a set of small individual procedures or as one large holistic operation; [ii] what specific function or set of weighted vectors should be optimized in a complex software product e.g. timings, volumes, or quintessential hydrological attributes related to the 'problem situation' - that might require the development flood forecasting, drought estimation, or record infilling applications. The paper will conclude with a consideration of hydrological forecasting solutions developed on the combined methodologies of co-operative co-evolution and
Continuous Online Sequence Learning with an Unsupervised Neural Network Model.
Cui, Yuwei; Ahmad, Subutar; Hawkins, Jeff
2016-09-14
The ability to recognize and predict temporal sequences of sensory inputs is vital for survival in natural environments. Based on many known properties of cortical neurons, hierarchical temporal memory (HTM) sequence memory recently has been proposed as a theoretical framework for sequence learning in the cortex. In this letter, we analyze properties of HTM sequence memory and apply it to sequence learning and prediction problems with streaming data. We show the model is able to continuously learn a large number of variableorder temporal sequences using an unsupervised Hebbian-like learning rule. The sparse temporal codes formed by the model can robustly handle branching temporal sequences by maintaining multiple predictions until there is sufficient disambiguating evidence. We compare the HTM sequence memory with other sequence learning algorithms, including statistical methods: autoregressive integrated moving average; feedforward neural networks-time delay neural network and online sequential extreme learning machine; and recurrent neural networks-long short-term memory and echo-state networks on sequence prediction problems with both artificial and real-world data. The HTM model achieves comparable accuracy to other state-of-the-art algorithms. The model also exhibits properties that are critical for sequence learning, including continuous online learning, the ability to handle multiple predictions and branching sequences with high-order statistics, robustness to sensor noise and fault tolerance, and good performance without task-specific hyperparameter tuning. Therefore, the HTM sequence memory not only advances our understanding of how the brain may solve the sequence learning problem but is also applicable to real-world sequence learning problems from continuous data streams.
A neural network model of ventriloquism effect and aftereffect.
Directory of Open Access Journals (Sweden)
Elisa Magosso
Full Text Available Presenting simultaneous but spatially discrepant visual and auditory stimuli induces a perceptual translocation of the sound towards the visual input, the ventriloquism effect. General explanation is that vision tends to dominate over audition because of its higher spatial reliability. The underlying neural mechanisms remain unclear. We address this question via a biologically inspired neural network. The model contains two layers of unimodal visual and auditory neurons, with visual neurons having higher spatial resolution than auditory ones. Neurons within each layer communicate via lateral intra-layer synapses; neurons across layers are connected via inter-layer connections. The network accounts for the ventriloquism effect, ascribing it to a positive feedback between the visual and auditory neurons, triggered by residual auditory activity at the position of the visual stimulus. Main results are: i the less localized stimulus is strongly biased toward the most localized stimulus and not vice versa; ii amount of the ventriloquism effect changes with visual-auditory spatial disparity; iii ventriloquism is a robust behavior of the network with respect to parameter value changes. Moreover, the model implements Hebbian rules for potentiation and depression of lateral synapses, to explain ventriloquism aftereffect (that is, the enduring sound shift after exposure to spatially disparate audio-visual stimuli. By adaptively changing the weights of lateral synapses during cross-modal stimulation, the model produces post-adaptive shifts of auditory localization that agree with in-vivo observations. The model demonstrates that two unimodal layers reciprocally interconnected may explain ventriloquism effect and aftereffect, even without the presence of any convergent multimodal area. The proposed study may provide advancement in understanding neural architecture and mechanisms at the basis of visual-auditory integration in the spatial realm.
Control Strategy Based on Wavelet Transform and Neural Network for Hybrid Power System
Directory of Open Access Journals (Sweden)
Y. D. Song
2013-01-01
Full Text Available This paper deals with an energy management of a hybrid power generation system. The proposed control strategy for the energy management is based on the combination of wavelet transform and neural network arithmetic. The hybrid system in this paper consists of an emulated wind turbine generator, PV panels, DC and AC loads, lithium ion battery, and super capacitor, which are all connected on a DC bus with unified DC voltage. The control strategy is responsible for compensating the difference between the generated power from the wind and solar generators and the demanded power by the loads. Wavelet transform decomposes the power difference into smoothed component and fast fluctuated component. In consideration of battery protection, the neural network is introduced to calculate the reference power of battery. Super capacitor (SC is controlled to regulate the DC bus voltage. The model of the hybrid system is developed in detail under Matlab/Simulink software environment.
Robust MPC for a non-linear system - a neural network approach
Luzar, Marcel; Witczak, Marcin
2014-12-01
The aim of the paper is to design a robust actuator fault-tolerant control for a non-linear discrete-time system. Considered system is described by the Linear Parameter-Varying (LPV) model obtained with recurrent neural network. The proposed solution starts with a discretetime quasi-LPV system identification using artificial neural network. Subsequently, the robust controller is proposed, which does not take into account actuator saturation level and deals with the previously estimated faults. To check if the compensation problem is feasible, the robust invariant set is employed, which takes into account actuator saturation level. When the current state does not belong to the set, then a predictive control is performed in order to make such set larger. This makes it possible to increase the domain of attraction, which makes the proposed methodology an efficient solution for the fault-tolerant control. The last part of the paper presents an experimental results regarding wind turbines.
İstif, İlyas
2005-11-01
This paper studies a servo-valve controlled hydraulic cylinder system which is mostly used in industrial applications such as robotics, computer numerical control (CNC) machines and transportations. The system model consists of combination of two models: The first model involves nonlinear flow equations of the servo-valve, which are widely available in the literature. The second model employed in the system is a tailored asymmetric cylinder model. A fourth order nonlinear system model is then obtained by combining these two models. Two different neural network control algorithms are applied to the system. The first algorithm is "Neural Network Predictive Control (NNPC)," which employs identified neural network model to predict the future output of the system. The second algorithm is "Nonlinear Autoregressive Moving Average (NARMA-L2)" control, which transforms nonlinear system dynamics into linear system dynamics by eliminating the nonlinearities. On the simulation, NNPC and NARMA-L2 control are applied to the system model by using Matlab's Simulik simulation package and position control of the system is realized. A discussion regarding the advantages and disadvantages of the two control algorithms are also provided in the paper.
The ctenophore genome and the evolutionary origins of neural systems.
Moroz, Leonid L; Kocot, Kevin M; Citarella, Mathew R; Dosung, Sohn; Norekian, Tigran P; Povolotskaya, Inna S; Grigorenko, Anastasia P; Dailey, Christopher; Berezikov, Eugene; Buckley, Katherine M; Ptitsyn, Andrey; Reshetov, Denis; Mukherjee, Krishanu; Moroz, Tatiana P; Bobkova, Yelena; Yu, Fahong; Kapitonov, Vladimir V; Jurka, Jerzy; Bobkov, Yuri V; Swore, Joshua J; Girardo, David O; Fodor, Alexander; Gusev, Fedor; Sanford, Rachel; Bruders, Rebecca; Kittler, Ellen; Mills, Claudia E; Rast, Jonathan P; Derelle, Romain; Solovyev, Victor V; Kondrashov, Fyodor A; Swalla, Billie J; Sweedler, Jonathan V; Rogaev, Evgeny I; Halanych, Kenneth M; Kohn, Andrea B
2014-06-05
The origins of neural systems remain unresolved. In contrast to other basal metazoans, ctenophores (comb jellies) have both complex nervous and mesoderm-derived muscular systems. These holoplanktonic predators also have sophisticated ciliated locomotion, behaviour and distinct development. Here we present the draft genome of Pleurobrachia bachei, Pacific sea gooseberry, together with ten other ctenophore transcriptomes, and show that they are remarkably distinct from other animal genomes in their content of neurogenic, immune and developmental genes. Our integrative analyses place Ctenophora as the earliest lineage within Metazoa. This hypothesis is supported by comparative analysis of multiple gene families, including the apparent absence of HOX genes, canonical microRNA machinery, and reduced immune complement in ctenophores. Although two distinct nervous systems are well recognized in ctenophores, many bilaterian neuron-specific genes and genes of 'classical' neurotransmitter pathways either are absent or, if present, are not expressed in neurons. Our metabolomic and physiological data are consistent with the hypothesis that ctenophore neural systems, and possibly muscle specification, evolved independently from those in other animals.
Landslide susceptibility analysis using an artificial neural network model
Mansor, Shattri; Pradhan, Biswajeet; Daud, Mohamed; Jamaludin, Normalina; Khuzaimah, Zailani
2007-10-01
This paper deals with landslide susceptibility analysis using an artificial neural network model for Cameron Highland, Malaysia. Landslide locations were identified in the study area from interpretation of aerial photographs and field surveys. Topographical/geological data and satellite images were collected and processed using GIS and image processing tools. There are ten landslide inducing parameters which are considered for the landslide hazards. These parameters are topographic slope, aspect, curvature and distance from drainage, all derived from the topographic database; geology and distance from lineament, derived from the geologic database; landuse from Landsat satellite images; soil from the soil database; precipitation amount, derived from the rainfall database; and the vegetation index value from SPOT satellite images. Landslide hazard was analyzed using landslide occurrence factors employing the logistic regression model. The results of the analysis were verified using the landslide location data and compared with logistic regression model. The accuracy of hazard map observed was 85.73%. The qualitative landslide susceptibility analysis was carried out using an artificial neural network model by doing map overlay analysis in GIS environment. This information could be used to estimate the risk to population, property and existing infrastructure like transportation network.
Buch, A. M.; Narain, A.; Pandey, P. C.
1994-01-01
The simulation of runoff from a Himalayan Glacier basin using an Artificial Neural Network (ANN) is presented. The performance of the ANN model is found to be superior to the Energy Balance Model and the Multiple Regression model. The RMS Error is used as the figure of merit for judging the performance of the three models, and the RMS Error for the ANN model is the latest of the three models. The ANN is faster in learning and exhibits excellent system generalization characteristics.
Directory of Open Access Journals (Sweden)
Veronica Chan
2017-03-01
Full Text Available This paper presents the application of a neural network rule extraction algorithm, called the piece-wise linear artificial neural network or PWL-ANN algorithm, on a carbon capture process system dataset. The objective of the application is to enhance understanding of the intricate relationships among the key process parameters. The algorithm extracts rules in the form of multiple linear regression equations by approximating the sigmoid activation functions of the hidden neurons in an artificial neural network (ANN. The PWL-ANN algorithm overcomes the weaknesses of the statistical regression approach, in which accuracies of the generated predictive models are often not satisfactory, and the opaqueness of the ANN models. The results show that the generated PWL-ANN models have accuracies that are as high as the originally trained ANN models of the four datasets of the carbon capture process system. An analysis of the extracted rules and the magnitude of the coefficients in the equations revealed that the three most significant parameters of the CO2 production rate are the steam flow rate through reboiler, reboiler pressure, and the CO2 concentration in the flue gas.
Directory of Open Access Journals (Sweden)
Mifeng Ren
2014-01-01
Full Text Available This paper considers the neural network controller design problem for variable pitch wind energy conversion systems (WECS with non-Gaussian wind speed disturbances in the stochastic distribution control framework. The approach here is used to directly model the unknown control law based on a fixed neural network (the number of layers and nodes in a neural network is fixed without the need to construct a separate model for the WECS. In order to characterize the randomness of the WECS, a generalized minimum entropy criterion is established to train connection weights of the neural network. For the train purpose, both kernel density estimation method and sliding window technique are adopted to estimate the PDF of tracking error and entropies. Due to the unknown process dynamics, the gradient of the objective function in a gradient-descent-type algorithm is estimated using an incremental perturbation method. The proposed approach is illustrated on a simulated WECS with non-Gaussian wind speed.
Investigation of neural-net based control strategies for improved power system dynamic performance
Energy Technology Data Exchange (ETDEWEB)
Sobajic, D.J. [Electric Power Research Institute, Palo Alto, CA (United States)
1995-12-31
The ability to accurately predict the behavior of a dynamic system is of essential importance in monitoring and control of complex processes. In this regard recent advances in neural-net base system identification represent a significant step toward development and design of a new generation of control tools for increased system performance and reliability. The enabling functionality is the one of accurate representation of a model of a nonlinear and nonstationary dynamic system. This functionality provides valuable new opportunities including: (1) The ability to predict future system behavior on the basis of actual system observations, (2) On-line evaluation and display of system performance and design of early warning systems, and (3) Controller optimization for improved system performance. In this presentation, we discuss the issues involved in definition and design of learning control systems and their impact on power system control. Several numerical examples are provided for illustrative purpose.
Energy Technology Data Exchange (ETDEWEB)
Karri, Vishy; Ho, Tien [School of Engineering, University of Tasmania, GPO Box 252-65, Hobart, Tasmania 7001 (Australia); Madsen, Ole [Department of Production, Aalborg University, Fibigerstraede 16, DK-9220 Aalborg (Denmark)
2008-06-15
Hydrogen is increasingly investigated as an alternative fuel to petroleum products in running internal combustion engines and as powering remote area power systems using generators. The safety issues related to hydrogen gas are further exasperated by expensive instrumentation required to measure the percentage of explosive limits, flow rates and production pressure. This paper investigates the use of model based virtual sensors (rather than expensive physical sensors) in connection with hydrogen production with a Hogen 20 electrolyzer system. The virtual sensors are used to predict relevant hydrogen safety parameters, such as the percentage of lower explosive limit, hydrogen pressure and hydrogen flow rate as a function of different input conditions of power supplied (voltage and current), the feed of de-ionized water and Hogen 20 electrolyzer system parameters. The virtual sensors are developed by means of the application of various Artificial Intelligent techniques. To train and appraise the neural network models as virtual sensors, the Hogen 20 electrolyzer is instrumented with necessary sensors to gather experimental data which together with MATLAB neural networks toolbox and tailor made adaptive neuro-fuzzy inference systems (ANFIS) were used as predictive tools to estimate hydrogen safety parameters. It was shown that using the neural networks hydrogen safety parameters were predicted to less than 3% of percentage average root mean square error. The most accurate prediction was achieved by using ANFIS. (author)
Directory of Open Access Journals (Sweden)
Yang Liu
2017-01-01
Full Text Available Transient stability assessment is playing a vital role in modern power systems. For this purpose, machine learning techniques have been widely employed to find critical conditions and recognize transient behaviors based on massive data analysis. However, an ever increasing volume of data generated from power systems poses a number of challenges to traditional machine learning techniques, which are computationally intensive running on standalone computers. This paper presents a MapReduce based high performance neural network to enable fast stability assessment of power systems. Hadoop, which is an open-source implementation of the MapReduce model, is first employed to parallelize the neural network. The parallel neural network is further enhanced with HaLoop to reduce the computation overhead incurred in the iteration process of the neural network. In addition, ensemble techniques are employed to accommodate the accuracy loss of the parallelized neural network in classification. The parallelized neural network is evaluated with both the IEEE 68-node system and a real power system from the aspects of computation speedup and stability assessment.
Fault Tolerant Neural Network for ECG Signal Classification Systems
Directory of Open Access Journals (Sweden)
MERAH, M.
2011-08-01
Full Text Available The aim of this paper is to apply a new robust hardware Artificial Neural Network (ANN for ECG classification systems. This ANN includes a penalization criterion which makes the performances in terms of robustness. Specifically, in this method, the ANN weights are normalized using the auto-prune method. Simulations performed on the MIT ? BIH ECG signals, have shown that significant robustness improvements are obtained regarding potential hardware artificial neuron failures. Moreover, we show that the proposed design achieves better generalization performances, compared to the standard back-propagation algorithm.
Computational modeling of neural activities for statistical inference
Kolossa, Antonio
2016-01-01
This authored monograph supplies empirical evidence for the Bayesian brain hypothesis by modeling event-related potentials (ERP) of the human electroencephalogram (EEG) during successive trials in cognitive tasks. The employed observer models are useful to compute probability distributions over observable events and hidden states, depending on which are present in the respective tasks. Bayesian model selection is then used to choose the model which best explains the ERP amplitude fluctuations. Thus, this book constitutes a decisive step towards a better understanding of the neural coding and computing of probabilities following Bayesian rules. The target audience primarily comprises research experts in the field of computational neurosciences, but the book may also be beneficial for graduate students who want to specialize in this field. .
Separate neural systems value immediate and delayed monetary rewards.
McClure, Samuel M; Laibson, David I; Loewenstein, George; Cohen, Jonathan D
2004-10-15
When humans are offered the choice between rewards available at different points in time, the relative values of the options are discounted according to their expected delays until delivery. Using functional magnetic resonance imaging, we examined the neural correlates of time discounting while subjects made a series of choices between monetary reward options that varied by delay to delivery. We demonstrate that two separate systems are involved in such decisions. Parts of the limbic system associated with the midbrain dopamine system, including paralimbic cortex, are preferentially activated by decisions involving immediately available rewards. In contrast, regions of the lateral prefrontal cortex and posterior parietal cortex are engaged uniformly by intertemporal choices irrespective of delay. Furthermore, the relative engagement of the two systems is directly associated with subjects' choices, with greater relative fronto-parietal activity when subjects choose longer term options.
Examination of neural systems sub-serving facebook "addiction".
Turel, Ofir; He, Qinghua; Xue, Gui; Xiao, Lin; Bechara, Antoine
2014-12-01
Because addictive behaviors typically result from violated homeostasis of the impulsive (amygdala-striatal) and inhibitory (prefrontal cortex) brain systems, this study examined whether these systems sub-serve a specific case of technology-related addiction, namely Facebook "addiction." Using a go/no-go paradigm in functional MRI settings, the study examined how these brain systems in 20 Facebook users (M age = 20.3 yr., SD = 1.3, range = 18-23) who completed a Facebook addiction questionnaire, responded to Facebook and less potent (traffic sign) stimuli. The findings indicated that at least at the examined levels of addiction-like symptoms, technology-related "addictions" share some neural features with substance and gambling addictions, but more importantly they also differ from such addictions in their brain etiology and possibly pathogenesis, as related to abnormal functioning of the inhibitory-control brain system.
Assimilation of neural network soil moisture in land surface models
Rodriguez-Fernandez, Nemesio; de Rosnay, Patricia; Albergel, Clement; Aires, Filipe; Prigent, Catherine; Kerr, Yann; Richaume, Philippe; Muñoz-Sabater, Joaquin; Drusch, Matthias
2017-04-01
In this study a set of land surface data assimilation (DA) experiments making use of satellite derived soil moisture (SM) are presented. These experiments have two objectives: (1) to test the information content of satellite remote sensing of soil moisture for numerical weather prediction (NWP) models, and (2) to test a simplified assimilation of these data through the use of a Neural Network (NN) retrieval. Advanced Scatterometer (ASCAT) and Soil Moisture and Ocean Salinity (SMOS) data were used. The SMOS soil moisture dataset was obtained specifically for this project training a NN using SMOS brightness temperatures as input and using as reference for the training European Centre for Medium-Range Weather Forecasts (ECMWF) H-TESSEL SM fields. In this way, the SMOS NN SM dataset has a similar climatology to that of the model and it does not present a global bias with respect to the model. The DA experiments are computed using a surface-only Land Data Assimilation System (so-LDAS) based on the HTESSEL land surface model. This system is very computationally efficient and allows to perform long surface assimilation experiments (one whole year, 2012). SMOS NN SM DA experiments are compared to ASCAT SM DA experiments. In both cases, experiments with and without 2 m air temperature and relative humidity DA are discussed using different observation errors for the ASCAT and SMOS datasets. Seasonal, geographical and soil-depth-related differences between the results of those experiments are presented and discussed. The different SM analysed fields are evaluated against a large number of in situ measurements of SM. On average, the SM analysis gives in general similar results to the model open loop with no assimilation even if significant differences can be seen for specific sites with in situ measurements. The sensitivity to observation errors to the SM dataset slightly differs depending on the networks of in situ measurements, however it is relatively low for the tests
Nonlinear System Identification Using Neural Networks Trained with Natural Gradient Descent
Directory of Open Access Journals (Sweden)
Ibnkahla Mohamed
2003-01-01
Full Text Available We use natural gradient (NG learning neural networks (NNs for modeling and identifying nonlinear systems with memory. The nonlinear system is comprised of a discrete-time linear filter followed by a zero-memory nonlinearity . The NN model is composed of a linear adaptive filter followed by a two-layer memoryless nonlinear NN. A Kalman filter-based technique and a search-and-converge method have been employed for the NG algorithm. It is shown that the NG descent learning significantly outperforms the ordinary gradient descent and the Levenberg-Marquardt (LM procedure in terms of convergence speed and mean squared error (MSE performance.
Neural systems supporting and affecting economically relevant behavior
Directory of Open Access Journals (Sweden)
Braeutigam S
2012-05-01
Full Text Available Sven BraeutigamOxford Centre for Human Brain Activity, University of Oxford, Oxford, United KingdomAbstract: For about a hundred years, theorists and traders alike have tried to unravel and understand the mechanisms and hidden rules underlying and perhaps determining economically relevant behavior. This review focuses on recent developments in neuroeconomics, where the emphasis is placed on two directions of research: first, research exploiting common experiences of urban inhabitants in industrialized societies to provide experimental paradigms with a broader real-life content; second, research based on behavioral genetics, which provides an additional dimension for experimental control and manipulation. In addition, possible limitations of state-of-the-art neuroeconomics research are addressed. It is argued that observations of neuronal systems involved in economic behavior converge to some extent across the technologies and paradigms used. Conceptually, the data available as of today raise the possibility that neuroeconomic research might provide evidence at the neuronal level for the existence of multiple systems of thought and for the importance of conflict. Methodologically, Bayesian approaches in particular may play an important role in identifying mechanisms and establishing causality between patterns of neural activity and economic behavior.Keywords: neuroeconomics, behavioral genetics, decision-making, consumer behavior, neural system
Faa-Jeng Lin; Kuang-Chin Lu; Hsuan-Yu Lee
2014-01-01
This study presents a new active and reactive power control scheme for a single-stage three-phase grid-connected photovoltaic (PV) system during grid faults. The presented PV system utilizes a single-stage three-phase current-controlled voltage-source inverter to achieve the maximum power point tracking (MPPT) control of the PV panel with the function of low voltage ride through (LVRT). Moreover, a formula based on positive sequence voltage for evaluating the percentage of voltage sag is deri...
Modelling electric trains energy consumption using Neural Networks
Energy Technology Data Exchange (ETDEWEB)
Martinez Fernandez, P.; Garcia Roman, C.; Insa Franco, R.
2016-07-01
Nowadays there is an evident concern regarding the efficiency and sustainability of the transport sector due to both the threat of climate change and the current financial crisis. This concern explains the growth of railways over the last years as they present an inherent efficiency compared to other transport means. However, in order to further expand their role, it is necessary to optimise their energy consumption so as to increase their competitiveness. Improving railways energy efficiency requires both reliable data and modelling tools that will allow the study of different variables and alternatives. With this need in mind, this paper presents the development of consumption models based on neural networks that calculate the energy consumption of electric trains. These networks have been trained based on an extensive set of consumption data measured in line 1 of the Valencia Metro Network. Once trained, the neural networks provide a reliable estimation of the vehicles consumption along a specific route when fed with input data such as train speed, acceleration or track longitudinal slope. These networks represent a useful modelling tool that may allow a deeper study of railway lines in terms of energy expenditure with the objective of reducing the costs and environmental impact associated to railways. (Author)
Chaotic Simulated Annealing by A Neural Network Model with Transient Chaos
Chen, L; Chen, Luonan; Aihara, Kazuyuki
1997-01-01
We propose a neural network model with transient chaos, or a transiently chaotic neural network (TCNN) as an approximation method for combinatorial optimization problem, by introducing transiently chaotic dynamics into neural networks. Unlike conventional neural networks only with point attractors, the proposed neural network has richer and more flexible dynamics, so that it can be expected to have higher ability of searching for globally optimal or near-optimal solutions. A significant property of this model is that the chaotic neurodynamics is temporarily generated for searching and self-organizing, and eventually vanishes with autonomous decreasing of a bifurcation parameter corresponding to the "temperature" in usual annealing process. Therefore, the neural network gradually approaches, through the transient chaos, to dynamical structure similar to such conventional models as the Hopfield neural network which converges to a stable equilibrium point. Since the optimization process of the transiently chaoti...
Energy Technology Data Exchange (ETDEWEB)
Assadi, Mohsen; Fast, Magnus [Lund Inst. of Technology (Sweden). Dept. of Energy Sciences
2006-12-15
The project aim is to model the hybrid plant at Vaesthamnsverket in Helsingborg using artificial neural networks (ANN). The definition of a hybrid plant is that it uses more than one fuel, in this case a natural gas fuelled gas turbine with heat recovery steam generator (HRSG) and a biomass fuelled steam boiler with steam turbine. The models in the present project are based on operational data from the plant in contrary to previous projects where synthetic (simulated) data has been used in a large extent. The gas turbine represents the subsystem that has received most attention in previous projects, which will also be the case for the present project although models of the HRSG, steam boiler and steam turbine are created since the whole plant is of interest. The completed ANN sub modules are connected in a network, which can be used for e.g. offline simulation and real-time condition monitoring of the plant. A product, including all sub modules, is created in shape of a user-friendly interface in an MS Excel environment. This user interface can be used for continuous monitoring, training personnel and in planning of the operation. The target group is the plant owners and the original equipment manufacturers (OEM). The plant owners interest lies in receiving a product that can assist them when operating the plant, for instance supply them with information about the grade of degradation. The OEMs main interest lies in investigating the possibilities of delivering ANNs, based on synthetic data, along with their new gas turbines. Vaesthamnsverket have contributed with operational data from the plant as well as support in plant related questions. Siemens have contributed with expert knowledge about their gas turbine, the SGT800. The received data has been examined and filtered before used for training ANN models. The models have been evaluated with independent data. The results are very promising with ANN models showing high prediction accuracy. All subsystems can be
Artificial Neural Network versus Linear Models Forecasting Doha Stock Market
Yousif, Adil; Elfaki, Faiz
2017-12-01
The purpose of this study is to determine the instability of Doha stock market and develop forecasting models. Linear time series models are used and compared with a nonlinear Artificial Neural Network (ANN) namely Multilayer Perceptron (MLP) Technique. It aims to establish the best useful model based on daily and monthly data which are collected from Qatar exchange for the period starting from January 2007 to January 2015. Proposed models are for the general index of Qatar stock exchange and also for the usages in other several sectors. With the help of these models, Doha stock market index and other various sectors were predicted. The study was conducted by using various time series techniques to study and analyze data trend in producing appropriate results. After applying several models, such as: Quadratic trend model, double exponential smoothing model, and ARIMA, it was concluded that ARIMA (2,2) was the most suitable linear model for the daily general index. However, ANN model was found to be more accurate than time series models.
Dynamic model of a PEM electrolyser based on artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Chavez-Ramirez, A.U.; Munoz-Guerrero, R.; Sanchez-Huerta, V.; Ramirez-Arredondo, Juan M.; Ornelas, R.; Arriaga, L.G.; Siracusano, S.; Brunaccini, G.; Napoli, G.; Antonucci, V.; Arico, A.S.
2011-01-15
Hydrogen production by electrolysis is emerging as a promising way to meet future fuel demand, and developing models capable of simulating the operation of electrolysis devices is indispensable to efficiently design power generation systems, reduce manufacturing costs and save resources. The nonlinear nature of the Artificial Neural Network (ANN) plays a key role in developing models predicting the performance of complex systems. The behaviour of a Polymer Electrolyte Membrane (PEM) Electrolyser of three cell stack was modelled successfully using a Multilayer Perceptron Network (MLP). This dynamic model was trained to learn the internal relationships of this electrolysis device and predict its behaviour without physical equations. Electric current supply and operation temperature were used as input vector able to predict each cell voltage behaviour. An accuracy (< 2%) was reached after comparing the single cell performance of the real electrolyser versus the ANN based model. This predictive model can be used as a virtual device into a more complex energy system.
A wireless transmission neural interface system for unconstrained non-human primates
Fernandez-Leon, Jose A.; Parajuli, Arun; Franklin, Robert; Sorenson, Michael; Felleman, Daniel J.; Hansen, Bryan J.; Hu, Ming; Dragoi, Valentin
2015-10-01
Objective. Studying the brain in large animal models in a restrained laboratory rig severely limits our capacity to examine brain circuits in experimental and clinical applications. Approach. To overcome these limitations, we developed a high-fidelity 96-channel wireless system to record extracellular spikes and local field potentials from the neocortex. A removable, external case of the wireless device is attached to a titanium pedestal placed in the animal skull. Broadband neural signals are amplified, multiplexed, and continuously transmitted as TCP/IP data at a sustained rate of 24 Mbps. A Xilinx Spartan 6 FPGA assembles the digital signals into serial data frames for transmission at 20 kHz though an 802.11n wireless data link on a frequency-shift key-modulated signal at 5.7-5.8 GHz to a receiver up to 10 m away. The system is powered by two CR123A, 3 V batteries for 2 h of operation. Main results. We implanted a multi-electrode array in visual area V4 of one anesthetized monkey (Macaca fascicularis) and in the dorsolateral prefrontal cortex (dlPFC) of a freely moving monkey (Macaca mulatta). The implanted recording arrays were electrically stable and delivered broadband neural data over a year of testing. For the first time, we compared dlPFC neuronal responses to the same set of stimuli (food reward) in restrained and freely moving conditions. Although we did not find differences in neuronal responses as a function of reward type in the restrained and unrestrained conditions, there were significant differences in correlated activity. This demonstrates that measuring neural responses in freely moving animals can capture phenomena that are absent in the traditional head-fixed paradigm. Significance. We implemented a wireless neural interface for multi-electrode recordings in freely moving non-human primates, which can potentially move systems neuroscience to a new direction by allowing one to record neural signals while animals interact with their environment.
Applications of Wavelet Neural Network Model to Building Settlement Prediction: A Case Study
Directory of Open Access Journals (Sweden)
Qulin TAN
2014-04-01
Full Text Available Deformation monitoring is a significant work for engineering safety, which is performed throughout the entire process of engineering design, construction and operation. Based on the theoretic analysis of wavelet and neural network, we applied the improved BP neural network model, auxiliary wavelet neural network model and embedded wavelet neural network model to the settlement prediction in one practical engineering monitoring project with MATLAB software programming. The cumulative and the interval settlement was predicted and compared with measured data. The overall performances of the three models were analyzed and compared. The results show that the accuracies of two kinds of wavelet neural network models are roughly the same, which prediction errors of monitoring points are less than 1mm, obviously superior to the single BP neural network model.
neural network based model o work based model of an industrial oil
African Journals Online (AJOL)
eobe
ropagation Algorithm (trainlm). The data; shows that data; shows that the simulated model the simulated model t outputs t outputs, with regression val with regression val with regression value of d to control the neural network model. , PID controller. ing processes. An additional node with ut (usually 1) is often added to the.
Optimizing the De-Noise Neural Network Model for GPS Time-Series Monitoring of Structures
Directory of Open Access Journals (Sweden)
Mosbeh R. Kaloop
2015-09-01
Full Text Available The Global Positioning System (GPS is recently used widely in structures and other applications. Notwithstanding, the GPS accuracy still suffers from the errors afflicting the measurements, particularly the short-period displacement of structural components. Previously, the multi filter method is utilized to remove the displacement errors. This paper aims at using a novel application for the neural network prediction models to improve the GPS monitoring time series data. Four prediction models for the learning algorithms are applied and used with neural network solutions: back-propagation, Cascade-forward back-propagation, adaptive filter and extended Kalman filter, to estimate which model can be recommended. The noise simulation and bridge’s short-period GPS of the monitoring displacement component of one Hz sampling frequency are used to validate the four models and the previous method. The results show that the Adaptive neural networks filter is suggested for de-noising the observations, specifically for the GPS displacement components of structures. Also, this model is expected to have significant influence on the design of structures in the low frequency responses and measurements’ contents.
Institute of Scientific and Technical Information of China (English)
ZHOU Li-Ming; CHEN Tian-Lun
2004-01-01
Based on the standard self-organizing map neural network model and an integrate-and-tire mechanism, we investigate the effect of the nonlinear interactive function on the self-organized criticality in our model. Based on these we also investigate the effect of the refractoryperiod on the self-organized criticality of the system.
Hierarchical Neural Regression Models for Customer Churn Prediction
Directory of Open Access Journals (Sweden)
Golshan Mohammadi
2013-01-01
Full Text Available As customers are the main assets of each industry, customer churn prediction is becoming a major task for companies to remain in competition with competitors. In the literature, the better applicability and efficiency of hierarchical data mining techniques has been reported. This paper considers three hierarchical models by combining four different data mining techniques for churn prediction, which are backpropagation artificial neural networks (ANN, self-organizing maps (SOM, alpha-cut fuzzy c-means (α-FCM, and Cox proportional hazards regression model. The hierarchical models are ANN + ANN + Cox, SOM + ANN + Cox, and α-FCM + ANN + Cox. In particular, the first component of the models aims to cluster data in two churner and nonchurner groups and also filter out unrepresentative data or outliers. Then, the clustered data as the outputs are used to assign customers to churner and nonchurner groups by the second technique. Finally, the correctly classified data are used to create Cox proportional hazards model. To evaluate the performance of the hierarchical models, an Iranian mobile dataset is considered. The experimental results show that the hierarchical models outperform the single Cox regression baseline model in terms of prediction accuracy, Types I and II errors, RMSE, and MAD metrics. In addition, the α-FCM + ANN + Cox model significantly performs better than the two other hierarchical models.
Neural network approximation of nonlinearity in laser nano-metrology system based on TLMI
Olyaee, Saeed; Hamedi, Samaneh
2011-02-01
In this paper, an approach based on neural network (NN) for nonlinearity modeling in a nano-metrology system using three-longitudinal-mode laser heterodyne interferometer (TLMI) for length and displacement measurements is presented. We model nonlinearity errors that arise from elliptically and non-orthogonally polarized laser beams, rotational error in the alignment of laser head with respect to the polarizing beam splitter, rotational error in the alignment of the mixing polarizer, and unequal transmission coefficients in the polarizing beam splitter. Here we use a neural network algorithm based on the multi-layer perceptron (MLP) network. The simulation results show that multi-layer feed forward perceptron network is successfully applicable to real noisy interferometer signals.
An effective convolutional neural network model for Chinese sentiment analysis
Zhang, Yu; Chen, Mengdong; Liu, Lianzhong; Wang, Yadong
2017-06-01
Nowadays microblog is getting more and more popular. People are increasingly accustomed to expressing their opinions on Twitter, Facebook and Sina Weibo. Sentiment analysis of microblog has received significant attention, both in academia and in industry. So far, Chinese microblog exploration still needs lots of further work. In recent years CNN has also been used to deal with NLP tasks, and already achieved good results. However, these methods ignore the effective use of a large number of existing sentimental resources. For this purpose, we propose a Lexicon-based Sentiment Convolutional Neural Networks (LSCNN) model focus on Weibo's sentiment analysis, which combines two CNNs, trained individually base on sentiment features and word embedding, at the fully connected hidden layer. The experimental results show that our model outperforms the CNN model only with word embedding features on microblog sentiment analysis task.
Based on Artificial Neural Network to Realize K-Parameter Analysis of Vehicle Air Spring System
Hung, San-Shan; Hsu, Chia-Ning; Hwang, Chang-Chou; Chen, Wen-Jan
2017-10-01
In recent years, because of the air-spring control technique is more mature, that air- spring suspension systems already can be used to replace the classical vehicle suspension system. Depend on internal pressure variation of the air-spring, thestiffnessand the damping factor can be adjusted. Because of air-spring has highly nonlinear characteristic, therefore it isn’t easy to construct the classical controller to control the air-spring effectively. The paper based on Artificial Neural Network to propose a feasible control strategy. By using offline way for the neural network design and learning to the air-spring in different initial pressures and different loads, offline method through, predict air-spring stiffness parameter to establish a model. Finally, through adjusting air-spring internal pressure to change the K-parameter of the air-spring, realize the well dynamic control performance of air-spring suspension.
Directory of Open Access Journals (Sweden)
Dawei Han
2012-02-01
Full Text Available The application of ANNs (Artifi cial Neural Networks has been studied by many researchers in modelling rainfall runoff processes. However, the work so far has been focused on the rainfall data from traditional raingauges. Weather radar is a modern technology which could provide high resolution rainfall in time and space. In this study, a comparison in rainfall runoff modelling between the raingauge and weather radar has been carried out. The data were collected from Brue catchment in Southwest of England, with 49 raingauges covering 136 km2 and two C-band weather radars. This raingauge network is extremely dense (for research purposes and does not represent the usual raingauge density in operational flood forecasting systems. The ANN models were set up with both lumped and spatial rainfall input. The results showed that raingauge data outperformed radar data in all the events tested, regardless of the lumped and spatial input. La aplicación de Redes Neuronales Artificiales (RNA en el modelado de lluvia-flujo ha sido estudiada ampliamente. Sin embargo, hasta ahora se han utilizado datos provenientes de pluviómetros tradicionales. Los radares meteorológicos son una tecnología moderna que puede proveer datos de lluvia de alta resolución en tiempo y espacio. Este es un trabajo de comparación en el modelado lluvia-flujo entre pluviómetros y radares meteorológicos. Los datos provienen de la cuenca del río Brue en el suroeste de Inglaterra, con 49 pluviómetros cubriendo 136 km2 y dos radares meteorológicos en la banda C. Esta red de pluviómetros es extremadamente densa (para investigación y no representa la densidad usual en sistemas de predicción de inundaciones. Los modelos de RNA fueron implementados con datos de entrada de lluvia tanto espaciados como no distribuidos. Los resultados muestran que los datos de los pluviómetros fueron mejores que los datos de los radares en todos los eventos probados.
Zhou, Wanmeng; Wang, Hua; Tang, Guojin; Guo, Shuai
2016-09-01
The time-consuming experimental method for handling qualities assessment cannot meet the increasing fast design requirements for the manned space flight. As a tool for the aircraft handling qualities research, the model-predictive-control structured inverse simulation (MPC-IS) has potential applications in the aerospace field to guide the astronauts' operations and evaluate the handling qualities more effectively. Therefore, this paper establishes MPC-IS for the manual-controlled rendezvous and docking (RVD) and proposes a novel artificial neural network inverse simulation system (ANN-IS) to further decrease the computational cost. The novel system was obtained by replacing the inverse model of MPC-IS with the artificial neural network. The optimal neural network was trained by the genetic Levenberg-Marquardt algorithm, and finally determined by the Levenberg-Marquardt algorithm. In order to validate MPC-IS and ANN-IS, the manual-controlled RVD experiments on the simulator were carried out. The comparisons between simulation results and experimental data demonstrated the validity of two systems and the high computational efficiency of ANN-IS.
Tlelo-Cuautle, Esteban; de la Fraga, Luis Gerardo
2016-01-01
This book offers readers a clear guide to implementing engineering applications with FPGAs, from the mathematical description to the hardware synthesis, including discussion of VHDL programming and co-simulation issues. Coverage includes FPGA realizations such as: chaos generators that are described from their mathematical models; artificial neural networks (ANNs) to predict chaotic time series, for which a discussion of different ANN topologies is included, with different learning techniques and activation functions; random number generators (RNGs) that are realized using different chaos generators, and discussions of their maximum Lyapunov exponent values and entropies. Finally, optimized chaotic oscillators are synchronized and realized to implement a secure communication system that processes black and white and grey-scale images. In each application, readers will find VHDL programming guidelines and computer arithmetic issues, along with co-simulation examples with Active-HDL and Simulink. Readers will b...
[Assessment model of townlet eco-environmental quality based on BP-artificial neural network].
Li, Li; Zhang, Hai-tao
2008-12-01
Aiming at the problems in the townlet eco-environmental quality assessment in China, a comprehensive assessment model of townlet ecological environmental quality based on BP-artificial neural network was set up, which contained 20 cryptic layer nodes and 3 layers. The rank classification criterion of eco-environmental quality's assessment indicator system were chosen as the training sample of the model, the 10% of training sample as well as the middle and critical values were regarded as examining sample, and the monitoring values of assessment region were treated as test sample. Choosing the Dushan Town in Ezhou City as an example, the training and prediction were made by using MATLAB software. The results showed that BP-artificial neural network was not only feasible and dependable, but also couldprovide acceptable results in accord with the regional realistic eco-environmental feature.
Models of Hopfield-type quaternion neural networks and their energy functions.
Yoshida, Mitsuo; Kuroe, Yasuaki; Mori, Takehiro
2005-01-01
Recently models of neural networks that can directly deal with complex numbers, complex-valued neural networks, have been proposed and several studies on their abilities of information processing have been done. Furthermore models of neural networks that can deal with quaternion numbers, which is the extension of complex numbers, have also been proposed. However they are all multilayer quaternion neural networks. This paper proposes models of fully connected recurrent quaternion neural networks, Hopfield-type quaternion neural networks. Since quaternion numbers are non-commutative on multiplication, some different models can be considered. We investigate dynamics of these proposed models from the point of view of the existence of an energy function and derive their conditions for existence.
Using neural networks and Dyna algorithm for integrated planning, reacting and learning in systems
Lima, Pedro; Beard, Randal
1992-01-01
The traditional AI answer to the decision making problem for a robot is planning. However, planning is usually CPU-time consuming, depending on the availability and accuracy of a world model. The Dyna system generally described in earlier work, uses trial and error to learn a world model which is simultaneously used to plan reactions resulting in optimal action sequences. It is an attempt to integrate planning, reactive, and learning systems. The architecture of Dyna is presented. The different blocks are described. There are three main components of the system. The first is the world model used by the robot for internal world representation. The input of the world model is the current state and the action taken in the current state. The output is the corresponding reward and resulting state. The second module in the system is the policy. The policy observes the current state and outputs the action to be executed by the robot. At the beginning of program execution, the policy is stochastic and through learning progressively becomes deterministic. The policy decides upon an action according to the output of an evaluation function, which is the third module of the system. The evaluation function takes the following as input: the current state of the system, the action taken in that state, the resulting state, and a reward generated by the world which is proportional to the current distance from the goal state. Originally, the work proposed was as follows: (1) to implement a simple 2-D world where a 'robot' is navigating around obstacles, to learn the path to a goal, by using lookup tables; (2) to substitute the world model and Q estimate function Q by neural networks; and (3) to apply the algorithm to a more complex world where the use of a neural network would be fully justified. In this paper, the system design and achieved results will be described. First we implement the world model with a neural network and leave Q implemented as a look up table. Next, we use a
National Aeronautics and Space Administration — The proposed innovation will utilize self learning neural network technology to determine the structure of osteoporosis, immune system disease, and excess radiation...
Energy Technology Data Exchange (ETDEWEB)
Oliveira, Douglas Nunes de; Bourguignon, Lucas Gabriel Garcia; Tolentino, Evandro, E-mail: tolentino@timoteo.cefetmg.br [Centro Federal de Educacao Tecnologica de Minas Gerais (CEFET-MG), Timoteo, MG (Brazil); Costa, Rodrigo Moyses, E-mail: rodrigo@moyses.com.br [Universidade de Itauna, Itauna, MG (Brazil); Tello, Cledola Cassia Oliveira de, E-mail: tellocc@cdtn.br [Centro de Desenvolvimento da Tecnologia Nucelar (CDTN/CNEN-MG), Belo Horizonte, MG (Brazil)
2015-07-01
A concrete is durable if it has accomplished the desired service life in the environment in which it is exposed. The durability of concrete materials can be limited as a result of adverse performance of its cement-paste matrix or aggregate constituents under either chemical or physical attack. Among other aggressive chemical exposures, the sulphate attack is an important concern. Water, soils and gases, which contain sulphate, represent a potential threat to the durability of concrete structures. Sulphate attack in concrete leads to the conversion of the hydration products of cement to ettringite, gypsum, and other phases, and also it leads to the destabilization of the primary strength generating calcium silicate hydrate (C-S-H) gel. The formation of ettringite and gypsum is common in cementitious systems exposed to most types of sulphate solutions. The present work presents the application of the neural networks for estimating deterioration of various concrete mixtures due to exposure to sulphate solutions. A neural networks model was constructed, trained and tested using the available database. In general, artificial neural networks could be successfully used in function approximation problems in order to approach the data generation function. Once data generation function is known, artificial neural network structure is tested using data not presented to the network during training. This paper is intent to provide the technical requirements related to the production of a durable concrete to be used in the structures of the Brazilian near-surface repository of radioactive wastes. (author)
Agatonovic-Kustrin, S; Beresford, R
2000-06-01
Artificial neural networks (ANNs) are biologically inspired computer programs designed to simulate the way in which the human brain processes information. ANNs gather their knowledge by detecting the patterns and relationships in data and learn (or are trained) through experience, not from programming. An ANN is formed from hundreds of single units, artificial neurons or processing elements (PE), connected with coefficients (weights), which constitute the neural structure and are organised in layers. The power of neural computations comes from connecting neurons in a network. Each PE has weighted inputs, transfer function and one output. The behavior of a neural network is determined by the transfer functions of its neurons, by the learning rule, and by the architecture itself. The weights are the adjustable parameters and, in that sense, a neural network is a parameterized system. The weighed sum of the inputs constitutes the activation of the neuron. The activation signal is passed through transfer function to produce a single output of the neuron. Transfer function introduces non-linearity to the network. During training, the inter-unit connections are optimized until the error in predictions is minimized and the network reaches the specified level of accuracy. Once the network is trained and tested it can be given new input information to predict the output. Many types of neural networks have been designed already and new ones are invented every week but all can be described by the transfer functions of their neurons, by the learning rule, and by the connection formula. ANN represents a promising modeling technique, especially for data sets having non-linear relationships which are frequently encountered in pharmaceutical processes. In terms of model specification, artificial neural networks require no knowledge of the data source but, since they often contain many weights that must be estimated, they require large training sets. In addition, ANNs can combine
Lee, Jong Jae; Lee, Jong Won; Yi, Jin Hak; Yun, Chung Bang; Jung, Hie Young
2005-02-01
Structural health monitoring has become an important research topic in conjunction with damage assessment and safety evaluation of structures. The use of system identification approaches for damage detection has been expanded in recent years owing to the advancements in signal analysis and information processing techniques. Soft computing techniques such as neural networks and genetic algorithm have been utilized increasingly for this end due to their excellent pattern recognition capability. In this study, a neural networks-based damage detection method using the modal properties is presented, which can effectively consider the modelling errors in the baseline finite element model from which the training patterns are to be generated. The differences or the ratios of the mode shape components between before and after damage are used as the input to the neural networks in this method, since they are found to be less sensitive to the modelling errors than the mode shapes themselves. Two numerical example analyses on a simple beam and a multi-girder bridge are presented to demonstrate the effectiveness of the proposed method. Results of laboratory test on a simply supported bridge model and field test on a bridge with multiple girders confirm the applicability of the present method.
Exergy diagnosis of coal fired CHP plant with application of neural and regression modelling
Directory of Open Access Journals (Sweden)
Stanek Wojciech
2012-01-01
Full Text Available Mathematical models of the processes, that proceed in energetic machines and devices, in many cases are very complicated. In such cases, the exact analytical models should be equipped with the auxiliary empirical models that describe those parameters which are difficult to model in a theoretical way. Regression or neural models identified basing on measurements are rather simple and are characterized by relatively short computation time. For this reason they can be effectively applied for simulation and optimization of steering and regulation processes, as well as, for control and thermal diagnosis of operation (eq. power plants or CHP plants. In the paper regression and neural models of thermal processes developed for systems of operation control of thermal plants are presented. Theoretical-empirical model of processes proceeding in coal fired CHP plant have been applied. Simulative calculations basing on these models have been carried out. Results of simulative calculations have been used for the exergetic evaluation of considered power plant. The diagnosis procedure let to investigate the formation of exergy costs in interconnected components of the system of CHP, as well as, investigate the influence of defects in operation of components on exergy losses and on the exergetic cost in other components. [Acknowledgment. The paper has been prepared within the RECENT project (REsearch Center for Energy and New Technologies supported by 7th Framework Programme, Theme 4, Capacities.
Identification of non-linear models of neural activity in bold fmri
DEFF Research Database (Denmark)
Jacobsen, Daniel Jakup; Madsen, Kristoffer Hougaard; Hansen, Lars Kai
2006-01-01
Non-linear hemodynamic models express the BOLD signal as a nonlinear, parametric functional of the temporal sequence of local neural activity. Several models have been proposed for this neural activity. We identify one such parametric model by estimating the distribution of its parameters. These ...
Low-cost wireless neural recording system and software.
Gregory, Jeffrey A; Borna, Amir; Roy, Sabyasachi; Wang, Xiaoqin; Lewandowski, Brian; Schmidt, Marc; Najafi, Khalil
2009-01-01
We describe a flexible wireless neural recording system, which is comprised of a 15-channel analog FM transmitter, digital receiver and custom user interface software for data acquisition. The analog front-end is constructed from commercial off the shelf (COTS) components and weighs 6.3g (including batteries) and is capable of transmitting over 24 hours up to a range over 3m with a 25microV(rms) in-vivo noise floor. The Software Defined Radio (SDR) and the acquisition software provide a data acquisition platform with real time data display and can be customized based on the specifications of various experiments. The described system was characterized with in-vitro and in-vivo experiments and the results are presented.
A direct-to-drive neural data acquisition system
Directory of Open Access Journals (Sweden)
Justin P Kinney
2015-09-01
Full Text Available Driven by the increasing channel count of neural probes, there is much effort being directed to creating increasingly scalable electrophysiology data acquisition systems. However, all such systems still rely on personal computers for data storage, and thus are limited by the bandwidth and cost of the computers, especially as the scale of recording increases. Here we present a novel architecture in which a digital processor receives data from an analog-to-digital converter, and writes that data directly to hard drives, without the need for a personal computer to serve as an intermediary in the data acquisition process. This minimalist architecture may support exceptionally high data throughput, without incurring costs to support unnecessary hardware and overhead associated with personal computers, thus facilitating scaling of electrophysiological recording in the future.
Artificial neural network modeling of plasmonic transmission lines.
Andrawis, Robert R; Swillam, Mohamed A; El-Gamal, Mohamed A; Soliman, Ezzeldin A
2016-04-01
In this paper, new models based on an artificial neural network (ANN) are developed to predict the propagation characteristics of plasmonic nanostrip and coupled nanostrips transmission lines. The trained ANNs are capable of providing the required propagation characteristics with good accuracy and almost instantaneously. The nonlinear mapping performed by the trained ANNs is written as closed-form expressions, which facilitate the direct use of the results obtained in this research. The propagation characteristics of the investigated transmission lines include the effective refractive index and the characteristic impedance. The time needed to simulate 1000 different versions of the transmission line structure is about 48 h, using a full-wave electromagnetic solver compared to 3 s using the developed ANN model.
Distributed neural system for emotional intelligence revealed by lesion mapping.
Barbey, Aron K; Colom, Roberto; Grafman, Jordan
2014-03-01
Cognitive neuroscience has made considerable progress in understanding the neural architecture of human intelligence, identifying a broadly distributed network of frontal and parietal regions that support goal-directed, intelligent behavior. However, the contributions of this network to social and emotional aspects of intellectual function remain to be well characterized. Here we investigated the neural basis of emotional intelligence in 152 patients with focal brain injuries using voxel-based lesion-symptom mapping. Latent variable modeling was applied to obtain measures of emotional intelligence, general intelligence and personality from the Mayer, Salovey, Caruso Emotional Intelligence Test (MSCEIT), the Wechsler Adult Intelligence Scale and the Neuroticism-Extroversion-Openness Inventory, respectively. Regression analyses revealed that latent scores for measures of general intelligence and personality reliably predicted latent scores for emotional intelligence. Lesion mapping results further indicated that these convergent processes depend on a shared network of frontal, temporal and parietal brain regions. The results support an integrative framework for understanding the architecture of executive, social and emotional processes and make specific recommendations for the interpretation and application of the MSCEIT to the study of emotional intelligence in health and disease.
Distributed neural system for emotional intelligence revealed by lesion mapping
Colom, Roberto; Grafman, Jordan
2014-01-01
Cognitive neuroscience has made considerable progress in understanding the neural architecture of human intelligence, identifying a broadly distributed network of frontal and parietal regions that support goal-directed, intelligent behavior. However, the contributions of this network to social and emotional aspects of intellectual function remain to be well characterized. Here we investigated the neural basis of emotional intelligence in 152 patients with focal brain injuries using voxel-based lesion-symptom mapping. Latent variable modeling was applied to obtain measures of emotional intelligence, general intelligence and personality from the Mayer, Salovey, Caruso Emotional Intelligence Test (MSCEIT), the Wechsler Adult Intelligence Scale and the Neuroticism-Extroversion-Openness Inventory, respectively. Regression analyses revealed that latent scores for measures of general intelligence and personality reliably predicted latent scores for emotional intelligence. Lesion mapping results further indicated that these convergent processes depend on a shared network of frontal, temporal and parietal brain regions. The results support an integrative framework for understanding the architecture of executive, social and emotional processes and make specific recommendations for the interpretation and application of the MSCEIT to the study of emotional intelligence in health and disease. PMID:23171618
Anomaly Detection for Resilient Control Systems Using Fuzzy-Neural Data Fusion Engine
Energy Technology Data Exchange (ETDEWEB)
Ondrej Linda; Milos Manic; Timothy R. McJunkin
2011-08-01
Resilient control systems in critical infrastructures require increased cyber-security and state-awareness. One of the necessary conditions for achieving the desired high level of resiliency is timely reporting and understanding of the status and behavioral trends of the control system. This paper describes the design and development of a neural-network based data-fusion system for increased state-awareness of resilient control systems. The proposed system consists of a dedicated data-fusion engine for each component of the control system. Each data-fusion engine implements three-layered alarm system consisting of: (1) conventional threshold-based alarms, (2) anomalous behavior detector using self-organizing maps, and (3) prediction error based alarms using neural network based signal forecasting. The proposed system was integrated with a model of the Idaho National Laboratory Hytest facility, which is a testing facility for hybrid energy systems. Experimental results demonstrate that the implemented data fusion system provides timely plant performance monitoring and cyber-state reporting.
A low-order model of biological neural networks.
Lo, James Ting-Ho
2011-10-01
A biologically plausible low-order model (LOM) of biological neural networks is proposed. LOM is a recurrent hierarchical network of models of dendritic nodes and trees; spiking and nonspiking neurons; unsupervised, supervised covariance and accumulative learning mechanisms; feedback connections; and a scheme for maximal generalization. These component models are motivated and necessitated by making LOM learn and retrieve easily without differentiation, optimization, or iteration, and cluster, detect, and recognize multiple and hierarchical corrupted, distorted, and occluded temporal and spatial patterns. Four models of dendritic nodes are given that are all described as a hyperbolic polynomial that acts like an exclusive-OR logic gate when the model dendritic nodes input two binary digits. A model dendritic encoder that is a network of model dendritic nodes encodes its inputs such that the resultant codes have an orthogonality property. Such codes are stored in synapses by unsupervised covariance learning, supervised covariance learning, or unsupervised accumulative learning, depending on the type of postsynaptic neuron. A masking matrix for a dendritic tree, whose upper part comprises model dendritic encoders, enables maximal generalization on corrupted, distorted, and occluded data. It is a mathematical organization and idealization of dendritic trees with overlapped and nested input vectors. A model nonspiking neuron transmits inhibitory graded signals to modulate its neighboring model spiking neurons. Model spiking neurons evaluate the subjective probability distribution (SPD) of the labels of the inputs to model dendritic encoders and generate spike trains with such SPDs as firing rates. Feedback connections from the same or higher layers with different numbers of unit-delay devices reflect different signal traveling times, enabling LOM to fully utilize temporally and spatially associated information. Biological plausibility of the component models is
Zaki, Jamil; Hennigan, Kelly; Weber, Jochen; Ochsner, Kevin N.
2010-01-01
Cognitive control mechanisms allow individuals to behave adaptively in the face of complex and sometimes conflicting information. While the neural bases of these control mechanisms have been examined in many contexts, almost no attention has been paid to their role in resolving conflicts between competing social cues, which is surprising, given that cognitive conflicts are part of many social interactions. Evidence about the neural processing of social information suggests that two systems—the mirror neuron system (MNS) and mental state attribution system (MSAS)—are specialized for processing nonverbal and contextual social cues, respectively. This could support a model of social cognitive conflict resolution in which competition between social cues would recruit domain-general cognitive control mechanisms, which in turn would bias processing towards the MNS or MSAS. Such biasing could also alter social behaviors, such as inferences made about the internal states of others. We tested this model by scanning participants using fMRI while they drew inferences about social targets' emotional states based on congruent or incongruent nonverbal and contextual social cues. Conflicts between social cues recruited the anterior cingulate and lateral prefrontal cortex, brain areas associated with domain-general control processes. This activation was accompanied by biasing of neural activity towards areas in the MNS or MSAS, which tracked, respectively, with perceivers' behavioral reliance on nonverbal or contextual cues when drawing inferences about targets' emotions. Together, these data provide evidence about both domain general and domain specific mechanisms involved in resolving social cognitive conflicts. PMID:20573895
A model of traffic signs recognition with convolutional neural network
Hu, Haihe; Li, Yujian; Zhang, Ting; Huo, Yi; Kuang, Wenqing
2016-10-01
In real traffic scenes, the quality of captured images are generally low due to some factors such as lighting conditions, and occlusion on. All of these factors are challengeable for automated recognition algorithms of traffic signs. Deep learning has provided a new way to solve this kind of problems recently. The deep network can automatically learn features from a large number of data samples and obtain an excellent recognition performance. We therefore approach this task of recognition of traffic signs as a general vision problem, with few assumptions related to road signs. We propose a model of Convolutional Neural Network (CNN) and apply the model to the task of traffic signs recognition. The proposed model adopts deep CNN as the supervised learning model, directly takes the collected traffic signs image as the input, alternates the convolutional layer and subsampling layer, and automatically extracts the features for the recognition of the traffic signs images. The proposed model includes an input layer, three convolutional layers, three subsampling layers, a fully-connected layer, and an output layer. To validate the proposed model, the experiments are implemented using the public dataset of China competition of fuzzy image processing. Experimental results show that the proposed model produces a recognition accuracy of 99.01 % on the training dataset, and yield a record of 92% on the preliminary contest within the fourth best.