Neural neworks in a management information systems

Directory of Open Access Journals (Sweden)

Jana Weinlichová

2009-01-01

Full Text Available For having retrospection for all over the data which are used, analyzed, evaluated and for a future incident predictions are used Management Information Systems and Business Intelligence. In case of not to be able to apply standard methods of data processing there can be with benefit applied an Artificial Intelligence. In this article will be referred to proofed abilities of Neural Networks. The Neural Networks is supported by many software products related to provide effective solution of manager issues. Those products are given as primary support for manager issues solving. We were tried to find reciprocally between products using Neural Networks and between Management Information Systems for finding a real possibility of applying Neural Networks as a direct part of Management Information Systems (MIS. In the article are presented possibilities to apply Neural Networks on different types of tasks in MIS.

Collaborative Recurrent Neural Networks forDynamic Recommender Systems

Science.gov (United States)

2016-11-22

JMLR: Workshop and Conference Proceedings 63:366–381, 2016 ACML 2016 Collaborative Recurrent Neural Networks for Dynamic Recommender Systems Young...an unprece- dented scale. Although such activity logs are abundantly available, most approaches to recommender systems are based on the rating...Recurrent Neural Network, Recommender System , Neural Language Model, Collaborative Filtering 1. Introduction As ever larger parts of the population

Nonlinear signal processing using neural networks: Prediction and system modelling

Energy Technology Data Exchange (ETDEWEB)

Lapedes, A.; Farber, R.

1987-06-01

The backpropagation learning algorithm for neural networks is developed into a formalism for nonlinear signal processing. We illustrate the method by selecting two common topics in signal processing, prediction and system modelling, and show that nonlinear applications can be handled extremely well by using neural networks. The formalism is a natural, nonlinear extension of the linear Least Mean Squares algorithm commonly used in adaptive signal processing. Simulations are presented that document the additional performance achieved by using nonlinear neural networks. First, we demonstrate that the formalism may be used to predict points in a highly chaotic time series with orders of magnitude increase in accuracy over conventional methods including the Linear Predictive Method and the Gabor-Volterra-Weiner Polynomial Method. Deterministic chaos is thought to be involved in many physical situations including the onset of turbulence in fluids, chemical reactions and plasma physics. Secondly, we demonstrate the use of the formalism in nonlinear system modelling by providing a graphic example in which it is clear that the neural network has accurately modelled the nonlinear transfer function. It is interesting to note that the formalism provides explicit, analytic, global, approximations to the nonlinear maps underlying the various time series. Furthermore, the neural net seems to be extremely parsimonious in its requirements for data points from the time series. We show that the neural net is able to perform well because it globally approximates the relevant maps by performing a kind of generalized mode decomposition of the maps. 24 refs., 13 figs.

Spiking Neural P Systems with Communication on Request.

Science.gov (United States)

Pan, Linqiang; Păun, Gheorghe; Zhang, Gexiang; Neri, Ferrante

2017-12-01

Spiking Neural [Formula: see text] Systems are Neural System models characterized by the fact that each neuron mimics a biological cell and the communication between neurons is based on spikes. In the Spiking Neural [Formula: see text] systems investigated so far, the application of evolution rules depends on the contents of a neuron (checked by means of a regular expression). In these [Formula: see text] systems, a specified number of spikes are consumed and a specified number of spikes are produced, and then sent to each of the neurons linked by a synapse to the evolving neuron. [Formula: see text]In the present work, a novel communication strategy among neurons of Spiking Neural [Formula: see text] Systems is proposed. In the resulting models, called Spiking Neural [Formula: see text] Systems with Communication on Request, the spikes are requested from neighboring neurons, depending on the contents of the neuron (still checked by means of a regular expression). Unlike the traditional Spiking Neural [Formula: see text] systems, no spikes are consumed or created: the spikes are only moved along synapses and replicated (when two or more neurons request the contents of the same neuron). [Formula: see text]The Spiking Neural [Formula: see text] Systems with Communication on Request are proved to be computationally universal, that is, equivalent with Turing machines as long as two types of spikes are used. Following this work, further research questions are listed to be open problems.

Neural systems analysis of decision making during goal-directed navigation.

Science.gov (United States)

Penner, Marsha R; Mizumori, Sheri J Y

2012-01-01

The ability to make adaptive decisions during goal-directed navigation is a fundamental and highly evolved behavior that requires continual coordination of perceptions, learning and memory processes, and the planning of behaviors. Here, a neurobiological account for such coordination is provided by integrating current literatures on spatial context analysis and decision-making. This integration includes discussions of our current understanding of the role of the hippocampal system in experience-dependent navigation, how hippocampal information comes to impact midbrain and striatal decision making systems, and finally the role of the striatum in the implementation of behaviors based on recent decisions. These discussions extend across cellular to neural systems levels of analysis. Not only are key findings described, but also fundamental organizing principles within and across neural systems, as well as between neural systems functions and behavior, are emphasized. It is suggested that studying decision making during goal-directed navigation is a powerful model for studying interactive brain systems and their mediation of complex behaviors. Copyright © 2011. Published by Elsevier Ltd.

The LILARTI neural network system

Energy Technology Data Exchange (ETDEWEB)

Allen, J.D. Jr.; Schell, F.M.; Dodd, C.V.

1992-10-01

The material of this Technical Memorandum is intended to provide the reader with conceptual and technical background information on the LILARTI neural network system of detail sufficient to confer an understanding of the LILARTI method as it is presently allied and to facilitate application of the method to problems beyond the scope of this document. Of particular importance in this regard are the descriptive sections and the Appendices which include operating instructions, partial listings of program output and data files, and network construction information.

Genetic learning in rule-based and neural systems

Science.gov (United States)

Smith, Robert E.

1993-01-01

The design of neural networks and fuzzy systems can involve complex, nonlinear, and ill-conditioned optimization problems. Often, traditional optimization schemes are inadequate or inapplicable for such tasks. Genetic Algorithms (GA's) are a class of optimization procedures whose mechanics are based on those of natural genetics. Mathematical arguments show how GAs bring substantial computational leverage to search problems, without requiring the mathematical characteristics often necessary for traditional optimization schemes (e.g., modality, continuity, availability of derivative information, etc.). GA's have proven effective in a variety of search tasks that arise in neural networks and fuzzy systems. This presentation begins by introducing the mechanism and theoretical underpinnings of GA's. GA's are then related to a class of rule-based machine learning systems called learning classifier systems (LCS's). An LCS implements a low-level production-system that uses a GA as its primary rule discovery mechanism. This presentation illustrates how, despite its rule-based framework, an LCS can be thought of as a competitive neural network. Neural network simulator code for an LCS is presented. In this context, the GA is doing more than optimizing and objective function. It is searching for an ecology of hidden nodes with limited connectivity. The GA attempts to evolve this ecology such that effective neural network performance results. The GA is particularly well adapted to this task, given its naturally-inspired basis. The LCS/neural network analogy extends itself to other, more traditional neural networks. Conclusions to the presentation discuss the implications of using GA's in ecological search problems that arise in neural and fuzzy systems.

PWR system simulation and parameter estimation with neural networks

Energy Technology Data Exchange (ETDEWEB)

Akkurt, Hatice; Colak, Uener E-mail: uc@nuke.hacettepe.edu.tr

2002-11-01

A detailed nonlinear model for a typical PWR system has been considered for the development of simulation software. Each component in the system has been represented by appropriate differential equations. The SCILAB software was used for solving nonlinear equations to simulate steady-state and transient operational conditions. Overall system has been constructed by connecting individual components to each other. The validity of models for individual components and overall system has been verified. The system response against given transients have been analyzed. A neural network has been utilized to estimate system parameters during transients. Different transients have been imposed in training and prediction stages with neural networks. Reactor power and system reactivity during the transient event have been predicted by the neural network. Results show that neural networks estimations are in good agreement with the calculated response of the reactor system. The maximum errors are within {+-}0.254% for power and between -0.146 and 0.353% for reactivity prediction cases. Steam generator parameters, pressure and water level, are also successfully predicted by the neural network employed in this study. The noise imposed on the input parameters of the neural network deteriorates the power estimation capability whereas the reactivity estimation capability is not significantly affected.

PWR system simulation and parameter estimation with neural networks

International Nuclear Information System (INIS)

Akkurt, Hatice; Colak, Uener

2002-01-01

A detailed nonlinear model for a typical PWR system has been considered for the development of simulation software. Each component in the system has been represented by appropriate differential equations. The SCILAB software was used for solving nonlinear equations to simulate steady-state and transient operational conditions. Overall system has been constructed by connecting individual components to each other. The validity of models for individual components and overall system has been verified. The system response against given transients have been analyzed. A neural network has been utilized to estimate system parameters during transients. Different transients have been imposed in training and prediction stages with neural networks. Reactor power and system reactivity during the transient event have been predicted by the neural network. Results show that neural networks estimations are in good agreement with the calculated response of the reactor system. The maximum errors are within ±0.254% for power and between -0.146 and 0.353% for reactivity prediction cases. Steam generator parameters, pressure and water level, are also successfully predicted by the neural network employed in this study. The noise imposed on the input parameters of the neural network deteriorates the power estimation capability whereas the reactivity estimation capability is not significantly affected

Neural signal processing and closed-loop control algorithm design for an implanted neural recording and stimulation system.

Science.gov (United States)

Hamilton, Lei; McConley, Marc; Angermueller, Kai; Goldberg, David; Corba, Massimiliano; Kim, Louis; Moran, James; Parks, Philip D; Sang Chin; Widge, Alik S; Dougherty, Darin D; Eskandar, Emad N

2015-08-01

A fully autonomous intracranial device is built to continually record neural activities in different parts of the brain, process these sampled signals, decode features that correlate to behaviors and neuropsychiatric states, and use these features to deliver brain stimulation in a closed-loop fashion. In this paper, we describe the sampling and stimulation aspects of such a device. We first describe the signal processing algorithms of two unsupervised spike sorting methods. Next, we describe the LFP time-frequency analysis and feature derivation from the two spike sorting methods. Spike sorting includes a novel approach to constructing a dictionary learning algorithm in a Compressed Sensing (CS) framework. We present a joint prediction scheme to determine the class of neural spikes in the dictionary learning framework; and, the second approach is a modified OSort algorithm which is implemented in a distributed system optimized for power efficiency. Furthermore, sorted spikes and time-frequency analysis of LFP signals can be used to generate derived features (including cross-frequency coupling, spike-field coupling). We then show how these derived features can be used in the design and development of novel decode and closed-loop control algorithms that are optimized to apply deep brain stimulation based on a patient's neuropsychiatric state. For the control algorithm, we define the state vector as representative of a patient's impulsivity, avoidance, inhibition, etc. Controller parameters are optimized to apply stimulation based on the state vector's current state as well as its historical values. The overall algorithm and software design for our implantable neural recording and stimulation system uses an innovative, adaptable, and reprogrammable architecture that enables advancement of the state-of-the-art in closed-loop neural control while also meeting the challenges of system power constraints and concurrent development with ongoing scientific research designed

The role of neural networks in nuclear power plant safety systems

International Nuclear Information System (INIS)

Boger, Z.

1993-01-01

Neural networks (NN) techniques have been applied in recent years to many systems by researchers in the nuclear power industry, mainly for modeling and sensor validation. Recent results are reviewed, including new directions in applications to control systems, safety analysis, and ''virtual'' instruments. As new fast learning algorithms become available, large systems may be learned effectively, even with few training examples. The nuclear industry hesitates to include NN in safety related systems, but it seems that the obstacles could be overcome with the demonstration of successful applications, even from other industries. Coupling of full-scale reactor simulators, as fault database generators, with neural networks learning should be explored. The integration of Expert System technology with NN should improve the Validation and Verification tasks, and also help overcome psychological barriers. It may prove that the potential of NN to help operators, compared with the existing and proposed alternatives, outweigh the risks. (author). 58 refs, 2 figs

Diagnostic Neural Network Systems for the Electronic Circuits

International Nuclear Information System (INIS)

Mohamed, A.H.

2014-01-01

Neural Networks is one of the most important artificial intelligent approaches for solving the diagnostic processes. This research concerns with uses the neural networks for diagnosis of the electronic circuits. Modern electronic systems contain both the analog and digital circuits. But, diagnosis of the analog circuits suffers from great complexity due to their nonlinearity. To overcome this problem, the proposed system introduces a diagnostic system that uses the neural network to diagnose both the digital and analog circuits. So, it can face the new requirements for the modern electronic systems. A fault dictionary method was implemented in the system. Experimental results are presented on three electronic systems. They are: artificial kidney, wireless network and personal computer systems. The proposed system has improved the performance of the diagnostic systems when applied for these practical cases

Intelligent neural network and fuzzy logic control of industrial and power systems

Science.gov (United States)

Kuljaca, Ognjen

The main role played by neural network and fuzzy logic intelligent control algorithms today is to identify and compensate unknown nonlinear system dynamics. There are a number of methods developed, but often the stability analysis of neural network and fuzzy control systems was not provided. This work will meet those problems for the several algorithms. Some more complicated control algorithms included backstepping and adaptive critics will be designed. Nonlinear fuzzy control with nonadaptive fuzzy controllers is also analyzed. An experimental method for determining describing function of SISO fuzzy controller is given. The adaptive neural network tracking controller for an autonomous underwater vehicle is analyzed. A novel stability proof is provided. The implementation of the backstepping neural network controller for the coupled motor drives is described. Analysis and synthesis of adaptive critic neural network control is also provided in the work. Novel tuning laws for the system with action generating neural network and adaptive fuzzy critic are given. Stability proofs are derived for all those control methods. It is shown how these control algorithms and approaches can be used in practical engineering control. Stability proofs are given. Adaptive fuzzy logic control is analyzed. Simulation study is conducted to analyze the behavior of the adaptive fuzzy system on the different environment changes. A novel stability proof for adaptive fuzzy logic systems is given. Also, adaptive elastic fuzzy logic control architecture is described and analyzed. A novel membership function is used for elastic fuzzy logic system. The stability proof is proffered. Adaptive elastic fuzzy logic control is compared with the adaptive nonelastic fuzzy logic control. The work described in this dissertation serves as foundation on which analysis of particular representative industrial systems will be conducted. Also, it gives a good starting point for analysis of learning abilities of

Neural network-based model reference adaptive control system.

Science.gov (United States)

Patino, H D; Liu, D

2000-01-01

In this paper, an approach to model reference adaptive control based on neural networks is proposed and analyzed for a class of first-order continuous-time nonlinear dynamical systems. The controller structure can employ either a radial basis function network or a feedforward neural network to compensate adaptively the nonlinearities in the plant. A stable controller-parameter adjustment mechanism, which is determined using the Lyapunov theory, is constructed using a sigma-modification-type updating law. The evaluation of control error in terms of the neural network learning error is performed. That is, the control error converges asymptotically to a neighborhood of zero, whose size is evaluated and depends on the approximation error of the neural network. In the design and analysis of neural network-based control systems, it is important to take into account the neural network learning error and its influence on the control error of the plant. Simulation results showing the feasibility and performance of the proposed approach are given.

Modular Neural Networks and Type-2 Fuzzy Systems for Pattern Recognition

CERN Document Server

Melin, Patricia

2012-01-01

This book describes hybrid intelligent systems using type-2 fuzzy logic and modular neural networks for pattern recognition applications. Hybrid intelligent systems combine several intelligent computing paradigms, including fuzzy logic, neural networks, and bio-inspired optimization algorithms, which can be used to produce powerful pattern recognition systems. Type-2 fuzzy logic is an extension of traditional type-1 fuzzy logic that enables managing higher levels of uncertainty in complex real world problems, which are of particular importance in the area of pattern recognition. The book is organized in three main parts, each containing a group of chapters built around a similar subject. The first part consists of chapters with the main theme of theory and design algorithms, which are basically chapters that propose new models and concepts, which are the basis for achieving intelligent pattern recognition. The second part contains chapters with the main theme of using type-2 fuzzy models and modular neural ne...

Adaptive Control of Nonlinear Discrete-Time Systems by Using OS-ELM Neural Networks

Directory of Open Access Journals (Sweden)

Xiao-Li Li

2014-01-01

Full Text Available As a kind of novel feedforward neural network with single hidden layer, ELM (extreme learning machine neural networks are studied for the identification and control of nonlinear dynamic systems. The property of simple structure and fast convergence of ELM can be shown clearly. In this paper, we are interested in adaptive control of nonlinear dynamic plants by using OS-ELM (online sequential extreme learning machine neural networks. Based on data scope division, the problem that training process of ELM neural network is sensitive to the initial training data is also solved. According to the output range of the controlled plant, the data corresponding to this range will be used to initialize ELM. Furthermore, due to the drawback of conventional adaptive control, when the OS-ELM neural network is used for adaptive control of the system with jumping parameters, the topological structure of the neural network can be adjusted dynamically by using multiple model switching strategy, and an MMAC (multiple model adaptive control will be used to improve the control performance. Simulation results are included to complement the theoretical results.

On the Universality and Non-Universality of Spiking Neural P Systems With Rules on Synapses.

Science.gov (United States)

Song, Tao; Xu, Jinbang; Pan, Linqiang

2015-12-01

Spiking neural P systems with rules on synapses are a new variant of spiking neural P systems. In the systems, the neuron contains only spikes, while the spiking/forgetting rules are moved on the synapses. It was obtained that such system with 30 neurons (using extended spiking rules) or with 39 neurons (using standard spiking rules) is Turing universal. In this work, this number is improved to 6. Specifically, we construct a Turing universal spiking neural P system with rules on synapses having 6 neurons, which can generate any set of Turing computable natural numbers. As well, it is obtained that spiking neural P system with rules on synapses having less than two neurons are not Turing universal: i) such systems having one neuron can characterize the family of finite sets of natural numbers; ii) the family of sets of numbers generated by the systems having two neurons is included in the family of semi-linear sets of natural numbers.

Real-time cerebellar neuroprosthetic system based on a spiking neural network model of motor learning.

Science.gov (United States)

Xu, Tao; Xiao, Na; Zhai, Xiaolong; Kwan Chan, Pak; Tin, Chung

2018-02-01

Damage to the brain, as a result of various medical conditions, impacts the everyday life of patients and there is still no complete cure to neurological disorders. Neuroprostheses that can functionally replace the damaged neural circuit have recently emerged as a possible solution to these problems. Here we describe the development of a real-time cerebellar neuroprosthetic system to substitute neural function in cerebellar circuitry for learning delay eyeblink conditioning (DEC). The system was empowered by a biologically realistic spiking neural network (SNN) model of the cerebellar neural circuit, which considers the neuronal population and anatomical connectivity of the network. The model simulated synaptic plasticity critical for learning DEC. This SNN model was carefully implemented on a field programmable gate array (FPGA) platform for real-time simulation. This hardware system was interfaced in in vivo experiments with anesthetized rats and it used neural spikes recorded online from the animal to learn and trigger conditioned eyeblink in the animal during training. This rat-FPGA hybrid system was able to process neuronal spikes in real-time with an embedded cerebellum model of ~10 000 neurons and reproduce learning of DEC with different inter-stimulus intervals. Our results validated that the system performance is physiologically relevant at both the neural (firing pattern) and behavioral (eyeblink pattern) levels. This integrated system provides the sufficient computation power for mimicking the cerebellar circuit in real-time. The system interacts with the biological system naturally at the spike level and can be generalized for including other neural components (neuron types and plasticity) and neural functions for potential neuroprosthetic applications.

Bio-inspired spiking neural network for nonlinear systems control.

Science.gov (United States)

Pérez, Javier; Cabrera, Juan A; Castillo, Juan J; Velasco, Juan M

2018-08-01

Spiking neural networks (SNN) are the third generation of artificial neural networks. SNN are the closest approximation to biological neural networks. SNNs make use of temporal spike trains to command inputs and outputs, allowing a faster and more complex computation. As demonstrated by biological organisms, they are a potentially good approach to designing controllers for highly nonlinear dynamic systems in which the performance of controllers developed by conventional techniques is not satisfactory or difficult to implement. SNN-based controllers exploit their ability for online learning and self-adaptation to evolve when transferred from simulations to the real world. SNN's inherent binary and temporary way of information codification facilitates their hardware implementation compared to analog neurons. Biological neural networks often require a lower number of neurons compared to other controllers based on artificial neural networks. In this work, these neuronal systems are imitated to perform the control of non-linear dynamic systems. For this purpose, a control structure based on spiking neural networks has been designed. Particular attention has been paid to optimizing the structure and size of the neural network. The proposed structure is able to control dynamic systems with a reduced number of neurons and connections. A supervised learning process using evolutionary algorithms has been carried out to perform controller training. The efficiency of the proposed network has been verified in two examples of dynamic systems control. Simulations show that the proposed control based on SNN exhibits superior performance compared to other approaches based on Neural Networks and SNNs. Copyright © 2018 Elsevier Ltd. All rights reserved.

Application of neural networks in CRM systems

Directory of Open Access Journals (Sweden)

Bojanowska Agnieszka

2017-01-01

Full Text Available The central aim of this study is to investigate how to apply artificial neural networks in Customer Relationship Management (CRM. The paper presents several business applications of neural networks in software systems designed to aid CRM, e.g. in deciding on the profitability of building a relationship with a given customer. Furthermore, a framework for a neural-network based CRM software tool is developed. Building beneficial relationships with customers is generating considerable interest among various businesses, and is often mentioned as one of the crucial objectives of enterprises, next to their key aim: to bring satisfactory profit. There is a growing tendency among businesses to invest in CRM systems, which together with an organisational culture of a company aid managing customer relationships. It is the sheer amount of gathered data as well as the need for constant updating and analysis of this breadth of information that may imply the suitability of neural networks for the application in question. Neural networks exhibit considerably higher computational capabilities than sequential calculations because the solution to a problem is obtained without the need for developing a special algorithm. In the majority of presented CRM applications neural networks constitute and are presented as a managerial decision-taking optimisation tool.

Neural Network for Optimization of Existing Control Systems

DEFF Research Database (Denmark)

Madsen, Per Printz

1995-01-01

The purpose of this paper is to develop methods to use Neural Network based Controllers (NNC) as an optimization tool for existing control systems.......The purpose of this paper is to develop methods to use Neural Network based Controllers (NNC) as an optimization tool for existing control systems....

System-Level Design of a 64-Channel Low Power Neural Spike Recording Sensor.

Science.gov (United States)

Delgado-Restituto, Manuel; Rodriguez-Perez, Alberto; Darie, Angela; Soto-Sanchez, Cristina; Fernandez-Jover, Eduardo; Rodriguez-Vazquez, Angel

2017-04-01

This paper reports an integrated 64-channel neural spike recording sensor, together with all the circuitry to process and configure the channels, process the neural data, transmit via a wireless link the information and receive the required instructions. Neural signals are acquired, filtered, digitized and compressed in the channels. Additionally, each channel implements an auto-calibration algorithm which individually configures the transfer characteristics of the recording site. The system has two transmission modes; in one case the information captured by the channels is sent as uncompressed raw data; in the other, feature vectors extracted from the detected neural spikes are released. Data streams coming from the channels are serialized by the embedded digital processor. Experimental results, including in vivo measurements, show that the power consumption of the complete system is lower than 330 μW.

Short-term synaptic plasticity and heterogeneity in neural systems

Science.gov (United States)

Mejias, J. F.; Kappen, H. J.; Longtin, A.; Torres, J. J.

2013-01-01

We review some recent results on neural dynamics and information processing which arise when considering several biophysical factors of interest, in particular, short-term synaptic plasticity and neural heterogeneity. The inclusion of short-term synaptic plasticity leads to enhanced long-term memory capacities, a higher robustness of memory to noise, and irregularity in the duration of the so-called up cortical states. On the other hand, considering some level of neural heterogeneity in neuron models allows neural systems to optimize information transmission in rate coding and temporal coding, two strategies commonly used by neurons to codify information in many brain areas. In all these studies, analytical approximations can be made to explain the underlying dynamics of these neural systems.

Representation of neural networks as Lotka-Volterra systems

International Nuclear Information System (INIS)

Moreau, Yves; Vandewalle, Joos; Louies, Stephane; Brenig, Leon

1999-01-01

We study changes of coordinates that allow the representation of the ordinary differential equations describing continuous-time recurrent neural networks into differential equations describing predator-prey models--also called Lotka-Volterra systems. We transform the equations for the neural network first into quasi-monomial form, where we express the vector field of the dynamical system as a linear combination of products of powers of the variables. In practice, this transformation is possible only if the activation function is the hyperbolic tangent or the logistic sigmoied. From this quasi-monomial form, we can directly transform the system further into Lotka-Volterra equations. The resulting Lotka-Volterra system is of higher dimension than the original system, but the behavior of its first variables is equivalent to the behavior of the original neural network

Real-time cerebellar neuroprosthetic system based on a spiking neural network model of motor learning

Science.gov (United States)

Xu, Tao; Xiao, Na; Zhai, Xiaolong; Chan, Pak Kwan; Tin, Chung

2018-02-01

Objective. Damage to the brain, as a result of various medical conditions, impacts the everyday life of patients and there is still no complete cure to neurological disorders. Neuroprostheses that can functionally replace the damaged neural circuit have recently emerged as a possible solution to these problems. Here we describe the development of a real-time cerebellar neuroprosthetic system to substitute neural function in cerebellar circuitry for learning delay eyeblink conditioning (DEC). Approach. The system was empowered by a biologically realistic spiking neural network (SNN) model of the cerebellar neural circuit, which considers the neuronal population and anatomical connectivity of the network. The model simulated synaptic plasticity critical for learning DEC. This SNN model was carefully implemented on a field programmable gate array (FPGA) platform for real-time simulation. This hardware system was interfaced in in vivo experiments with anesthetized rats and it used neural spikes recorded online from the animal to learn and trigger conditioned eyeblink in the animal during training. Main results. This rat-FPGA hybrid system was able to process neuronal spikes in real-time with an embedded cerebellum model of ~10 000 neurons and reproduce learning of DEC with different inter-stimulus intervals. Our results validated that the system performance is physiologically relevant at both the neural (firing pattern) and behavioral (eyeblink pattern) levels. Significance. This integrated system provides the sufficient computation power for mimicking the cerebellar circuit in real-time. The system interacts with the biological system naturally at the spike level and can be generalized for including other neural components (neuron types and plasticity) and neural functions for potential neuroprosthetic applications.

Spiking neural P systems with multiple channels.

Science.gov (United States)

Peng, Hong; Yang, Jinyu; Wang, Jun; Wang, Tao; Sun, Zhang; Song, Xiaoxiao; Luo, Xiaohui; Huang, Xiangnian

2017-11-01

Spiking neural P systems (SNP systems, in short) are a class of distributed parallel computing systems inspired from the neurophysiological behavior of biological spiking neurons. In this paper, we investigate a new variant of SNP systems in which each neuron has one or more synaptic channels, called spiking neural P systems with multiple channels (SNP-MC systems, in short). The spiking rules with channel label are introduced to handle the firing mechanism of neurons, where the channel labels indicate synaptic channels of transmitting the generated spikes. The computation power of SNP-MC systems is investigated. Specifically, we prove that SNP-MC systems are Turing universal as both number generating and number accepting devices. Copyright © 2017 Elsevier Ltd. All rights reserved.

A Neural Networks Based Operation Guidance System for Procedure Presentation and Validation

International Nuclear Information System (INIS)

Seung, Kun Mo; Lee, Seung Jun; Seong, Poong Hyun

2006-01-01

In this paper, a neural network based operator support system is proposed to reduce operator's errors in abnormal situations in nuclear power plants (NPPs). There are many complicated situations, in which regular and suitable operations should be done by operators accordingly. In order to regulate and validate operators' operations, it is necessary to develop an operator support system which includes computer based procedures with the functions for operation validation. Many computerized procedures systems (CPS) have been recently developed. Focusing on the human machine interface (HMI) design and procedures' computerization, most of CPSs used various methodologies to enhance system's convenience, reliability and accessibility. Other than only showing procedures, the proposed system integrates a simple CPS and an operation validation system (OVS) by using artificial neural network (ANN) for operational permission and quantitative evaluation

Integrating Artificial Immune, Neural and Endrocine Systems in Autonomous Sailing Robots

Science.gov (United States)

2010-09-24

system - Development of an adaptive hormone system capable of changing operation and control of the neural network depending on changing enviromental ...and control of the neural network depending on changing enviromental conditions • First basic design of the MOOP and a simple neural-endocrine based

Frequency-difference-dependent stochastic resonance in neural systems

Science.gov (United States)

Guo, Daqing; Perc, Matjaž; Zhang, Yangsong; Xu, Peng; Yao, Dezhong

2017-08-01

Biological neurons receive multiple noisy oscillatory signals, and their dynamical response to the superposition of these signals is of fundamental importance for information processing in the brain. Here we study the response of neural systems to the weak envelope modulation signal, which is superimposed by two periodic signals with different frequencies. We show that stochastic resonance occurs at the beat frequency in neural systems at the single-neuron as well as the population level. The performance of this frequency-difference-dependent stochastic resonance is influenced by both the beat frequency and the two forcing frequencies. Compared to a single neuron, a population of neurons is more efficient in detecting the information carried by the weak envelope modulation signal at the beat frequency. Furthermore, an appropriate fine-tuning of the excitation-inhibition balance can further optimize the response of a neural ensemble to the superimposed signal. Our results thus introduce and provide insights into the generation and modulation mechanism of the frequency-difference-dependent stochastic resonance in neural systems.

Application of hierarchical dissociated neural network in closed-loop hybrid system integrating biological and mechanical intelligence.

Directory of Open Access Journals (Sweden)

Yongcheng Li

Full Text Available Neural networks are considered the origin of intelligence in organisms. In this paper, a new design of an intelligent system merging biological intelligence with artificial intelligence was created. It was based on a neural controller bidirectionally connected to an actual mobile robot to implement a novel vehicle. Two types of experimental preparations were utilized as the neural controller including 'random' and '4Q' (cultured neurons artificially divided into four interconnected parts neural network. Compared to the random cultures, the '4Q' cultures presented absolutely different activities, and the robot controlled by the '4Q' network presented better capabilities in search tasks. Our results showed that neural cultures could be successfully employed to control an artificial agent; the robot performed better and better with the stimulus because of the short-term plasticity. A new framework is provided to investigate the bidirectional biological-artificial interface and develop new strategies for a future intelligent system using these simplified model systems.

Application of Hierarchical Dissociated Neural Network in Closed-Loop Hybrid System Integrating Biological and Mechanical Intelligence

Science.gov (United States)

Zhang, Bin; Wang, Yuechao; Li, Hongyi

2015-01-01

Neural networks are considered the origin of intelligence in organisms. In this paper, a new design of an intelligent system merging biological intelligence with artificial intelligence was created. It was based on a neural controller bidirectionally connected to an actual mobile robot to implement a novel vehicle. Two types of experimental preparations were utilized as the neural controller including ‘random’ and ‘4Q’ (cultured neurons artificially divided into four interconnected parts) neural network. Compared to the random cultures, the ‘4Q’ cultures presented absolutely different activities, and the robot controlled by the ‘4Q’ network presented better capabilities in search tasks. Our results showed that neural cultures could be successfully employed to control an artificial agent; the robot performed better and better with the stimulus because of the short-term plasticity. A new framework is provided to investigate the bidirectional biological-artificial interface and develop new strategies for a future intelligent system using these simplified model systems. PMID:25992579

Application of hierarchical dissociated neural network in closed-loop hybrid system integrating biological and mechanical intelligence.

Science.gov (United States)

Li, Yongcheng; Sun, Rong; Zhang, Bin; Wang, Yuechao; Li, Hongyi

2015-01-01

Neural networks are considered the origin of intelligence in organisms. In this paper, a new design of an intelligent system merging biological intelligence with artificial intelligence was created. It was based on a neural controller bidirectionally connected to an actual mobile robot to implement a novel vehicle. Two types of experimental preparations were utilized as the neural controller including 'random' and '4Q' (cultured neurons artificially divided into four interconnected parts) neural network. Compared to the random cultures, the '4Q' cultures presented absolutely different activities, and the robot controlled by the '4Q' network presented better capabilities in search tasks. Our results showed that neural cultures could be successfully employed to control an artificial agent; the robot performed better and better with the stimulus because of the short-term plasticity. A new framework is provided to investigate the bidirectional biological-artificial interface and develop new strategies for a future intelligent system using these simplified model systems.

Microfluidic systems for stem cell-based neural tissue engineering.

Science.gov (United States)

Karimi, Mahdi; Bahrami, Sajad; Mirshekari, Hamed; Basri, Seyed Masoud Moosavi; Nik, Amirala Bakhshian; Aref, Amir R; Akbari, Mohsen; Hamblin, Michael R

2016-07-05

Neural tissue engineering aims at developing novel approaches for the treatment of diseases of the nervous system, by providing a permissive environment for the growth and differentiation of neural cells. Three-dimensional (3D) cell culture systems provide a closer biomimetic environment, and promote better cell differentiation and improved cell function, than could be achieved by conventional two-dimensional (2D) culture systems. With the recent advances in the discovery and introduction of different types of stem cells for tissue engineering, microfluidic platforms have provided an improved microenvironment for the 3D-culture of stem cells. Microfluidic systems can provide more precise control over the spatiotemporal distribution of chemical and physical cues at the cellular level compared to traditional systems. Various microsystems have been designed and fabricated for the purpose of neural tissue engineering. Enhanced neural migration and differentiation, and monitoring of these processes, as well as understanding the behavior of stem cells and their microenvironment have been obtained through application of different microfluidic-based stem cell culture and tissue engineering techniques. As the technology advances it may be possible to construct a "brain-on-a-chip". In this review, we describe the basics of stem cells and tissue engineering as well as microfluidics-based tissue engineering approaches. We review recent testing of various microfluidic approaches for stem cell-based neural tissue engineering.

Evaluating neural networks and artificial intelligence systems

Science.gov (United States)

Alberts, David S.

1994-02-01

Systems have no intrinsic value in and of themselves, but rather derive value from the contributions they make to the missions, decisions, and tasks they are intended to support. The estimation of the cost-effectiveness of systems is a prerequisite for rational planning, budgeting, and investment documents. Neural network and expert system applications, although similar in their incorporation of a significant amount of decision-making capability, differ from each other in ways that affect the manner in which they can be evaluated. Both these types of systems are, by definition, evolutionary systems, which also impacts their evaluation. This paper discusses key aspects of neural network and expert system applications and their impact on the evaluation process. A practical approach or methodology for evaluating a certain class of expert systems that are particularly difficult to measure using traditional evaluation approaches is presented.

Olfactory systems and neural circuits that modulate predator odor fear

Directory of Open Access Journals (Sweden)

Lorey K. Takahashi

2014-03-01

Full Text Available When prey animals detect the odor of a predator a constellation of fear-related autonomic, endocrine, and behavioral responses rapidly occur to facilitate survival. How olfactory sensory systems process predator odor and channel that information to specific brain circuits is a fundamental issue that is not clearly understood. However, research in the last 15 years has begun to identify some of the essential features of the sensory detection systems and brain structures that underlie predator odor fear. For instance, the main (MOS and accessory olfactory systems (AOS detect predator odors and different types of predator odors are sensed by specific receptors located in either the MOS or AOS. However, complex predator chemosignals may be processed by both the MOS and AOS, which complicate our understanding of the specific neural circuits connected directly and indirectly from the MOS and AOS to activate the physiological and behavioral components of unconditioned and conditioned fear. Studies indicate that brain structures including the dorsal periaqueductal gray, paraventricular nucleus of the hypothalamus, and the medial amygdala appear to be broadly involved in predator odor induced autonomic activity and hypothalamic-pituitary-adrenal stress hormone secretion. The medial amygdala also plays a key role in predator odor unconditioned fear behavior and retrieval of contextual fear memory associated with prior predator odor experiences. Other neural structures including the bed nucleus of the stria terminalis and the ventral hippocampus appear prominently involve in predator odor fear behavior. The basolateral amygdala, medial hypothalamic nuclei, and medial prefrontal cortex are also activated by some but not all predator odors. Future research that characterizes how distinct predator odors are uniquely processed in olfactory systems and neural circuits will provide significant insights into the differences of how diverse predator odors activate

Olfactory systems and neural circuits that modulate predator odor fear

Science.gov (United States)

Takahashi, Lorey K.

2014-01-01

When prey animals detect the odor of a predator a constellation of fear-related autonomic, endocrine, and behavioral responses rapidly occur to facilitate survival. How olfactory sensory systems process predator odor and channel that information to specific brain circuits is a fundamental issue that is not clearly understood. However, research in the last 15 years has begun to identify some of the essential features of the sensory detection systems and brain structures that underlie predator odor fear. For instance, the main (MOS) and accessory olfactory systems (AOS) detect predator odors and different types of predator odors are sensed by specific receptors located in either the MOS or AOS. However, complex predator chemosignals may be processed by both the MOS and AOS, which complicate our understanding of the specific neural circuits connected directly and indirectly from the MOS and AOS to activate the physiological and behavioral components of unconditioned and conditioned fear. Studies indicate that brain structures including the dorsal periaqueductal gray (DPAG), paraventricular nucleus (PVN) of the hypothalamus, and the medial amygdala (MeA) appear to be broadly involved in predator odor induced autonomic activity and hypothalamic-pituitary-adrenal (HPA) stress hormone secretion. The MeA also plays a key role in predator odor unconditioned fear behavior and retrieval of contextual fear memory associated with prior predator odor experiences. Other neural structures including the bed nucleus of the stria terminalis and the ventral hippocampus (VHC) appear prominently involved in predator odor fear behavior. The basolateral amygdala (BLA), medial hypothalamic nuclei, and medial prefrontal cortex (mPFC) are also activated by some but not all predator odors. Future research that characterizes how distinct predator odors are uniquely processed in olfactory systems and neural circuits will provide significant insights into the differences of how diverse predator

Three-dimensional hydrogel cell culture systems for modeling neural tissue

Science.gov (United States)

Frampton, John

Two-dimensional (2-D) neural cell culture systems have served as physiological models for understanding the cellular and molecular events that underlie responses to physical and chemical stimuli, control sensory and motor function, and lead to the development of neurological diseases. However, the development of three-dimensional (3-D) cell culture systems will be essential for the advancement of experimental research in a variety of fields including tissue engineering, chemical transport and delivery, cell growth, and cell-cell communication. In 3-D cell culture, cells are provided with an environment similar to tissue, in which they are surrounded on all sides by other cells, structural molecules and adhesion ligands. Cells grown in 3-D culture systems display morphologies and functions more similar to those observed in vivo, and can be cultured in such a way as to recapitulate the structural organization and biological properties of tissue. This thesis describes a hydrogel-based culture system, capable of supporting the growth and function of several neural cell types in 3-D. Alginate hydrogels were characterized in terms of their biomechanical and biochemical properties and were functionalized by covalent attachment of whole proteins and peptide epitopes. Methods were developed for rapid cross-linking of alginate hydrogels, thus permitting the incorporation of cells into 3-D scaffolds without adversely affecting cell viability or function. A variety of neural cell types were tested including astrocytes, microglia, and neurons. Cells remained viable and functional for longer than two weeks in culture and displayed process outgrowth in 3-D. Cell constructs were created that varied in cell density, type and organization, providing experimental flexibility for studying cell interactions and behavior. In one set of experiments, 3-D glial-endothelial cell co-cultures were used to model blood-brain barrier (BBB) structure and function. This co-culture system was

Hybrid energy system evaluation in water supply system energy production: neural network approach

Energy Technology Data Exchange (ETDEWEB)

Goncalves, Fabio V.; Ramos, Helena M. [Civil Engineering Department, Instituto Superior Tecnico, Technical University of Lisbon, Av. Rovisco Pais, 1049-001, Lisbon (Portugal); Reis, Luisa Fernanda R. [Universidade de Sao Paulo, EESC/USP, Departamento de Hidraulica e Saneamento., Avenida do Trabalhador Saocarlense, 400, Sao Carlos-SP (Brazil)

2010-07-01

Water supply systems are large consumers of energy and the use of hybrid systems for green energy production is this new proposal. This work presents a computational model based on neural networks to determine the best configuration of a hybrid system to generate energy in water supply systems. In this study the energy sources to make this hybrid system can be the national power grid, micro-hydro and wind turbines. The artificial neural network is composed of six layers, trained to use data generated by a model of hybrid configuration and an economic simulator - CES. The reason for the development of an advanced model of forecasting based on neural networks is to allow rapid simulation and proper interaction with hydraulic and power model simulator - HPS. The results show that this computational model is useful as advanced decision support system in the design of configurations of hybrid power systems applied to water supply systems, improving the solutions in the development of its global energy efficiency.

Semi-empirical neural network models of controlled dynamical systems

Directory of Open Access Journals (Sweden)

Mihail V. Egorchev

2017-12-01

Full Text Available A simulation approach is discussed for maneuverable aircraft motion as nonlinear controlled dynamical system under multiple and diverse uncertainties including knowledge imperfection concerning simulated plant and its environment exposure. The suggested approach is based on a merging of theoretical knowledge for the plant with training tools of artificial neural network field. The efficiency of this approach is demonstrated using the example of motion modeling and the identification of the aerodynamic characteristics of a maneuverable aircraft. A semi-empirical recurrent neural network based model learning algorithm is proposed for multi-step ahead prediction problem. This algorithm sequentially states and solves numerical optimization subproblems of increasing complexity, using each solution as initial guess for subsequent subproblem. We also consider a procedure for representative training set acquisition that utilizes multisine control signals.

Decoupling control of vehicle chassis system based on neural network inverse system

Science.gov (United States)

Wang, Chunyan; Zhao, Wanzhong; Luan, Zhongkai; Gao, Qi; Deng, Ke

2018-06-01

Steering and suspension are two important subsystems affecting the handling stability and riding comfort of the chassis system. In order to avoid the interference and coupling of the control channels between active front steering (AFS) and active suspension subsystems (ASS), this paper presents a composite decoupling control method, which consists of a neural network inverse system and a robust controller. The neural network inverse system is composed of a static neural network with several integrators and state feedback of the original chassis system to approach the inverse system of the nonlinear systems. The existence of the inverse system for the chassis system is proved by the reversibility derivation of Interactor algorithm. The robust controller is based on the internal model control (IMC), which is designed to improve the robustness and anti-interference of the decoupled system by adding a pre-compensation controller to the pseudo linear system. The results of the simulation and vehicle test show that the proposed decoupling controller has excellent decoupling performance, which can transform the multivariable system into a number of single input and single output systems, and eliminate the mutual influence and interference. Furthermore, it has satisfactory tracking capability and robust performance, which can improve the comprehensive performance of the chassis system.

An Implantable Wireless Neural Interface System for Simultaneous Recording and Stimulation of Peripheral Nerve with a Single Cuff Electrode.

Science.gov (United States)

Shon, Ahnsei; Chu, Jun-Uk; Jung, Jiuk; Kim, Hyungmin; Youn, Inchan

2017-12-21

Recently, implantable devices have become widely used in neural prostheses because they eliminate endemic drawbacks of conventional percutaneous neural interface systems. However, there are still several issues to be considered: low-efficiency wireless power transmission; wireless data communication over restricted operating distance with high power consumption; and limited functionality, working either as a neural signal recorder or as a stimulator. To overcome these issues, we suggest a novel implantable wireless neural interface system for simultaneous neural signal recording and stimulation using a single cuff electrode. By using widely available commercial off-the-shelf (COTS) components, an easily reconfigurable implantable wireless neural interface system was implemented into one compact module. The implantable device includes a wireless power consortium (WPC)-compliant power transmission circuit, a medical implant communication service (MICS)-band-based radio link and a cuff-electrode path controller for simultaneous neural signal recording and stimulation. During in vivo experiments with rabbit models, the implantable device successfully recorded and stimulated the tibial and peroneal nerves while communicating with the external device. The proposed system can be modified for various implantable medical devices, especially such as closed-loop control based implantable neural prostheses requiring neural signal recording and stimulation at the same time.

An Implantable Wireless Neural Interface System for Simultaneous Recording and Stimulation of Peripheral Nerve with a Single Cuff Electrode

Directory of Open Access Journals (Sweden)

Ahnsei Shon

2017-12-01

Full Text Available Recently, implantable devices have become widely used in neural prostheses because they eliminate endemic drawbacks of conventional percutaneous neural interface systems. However, there are still several issues to be considered: low-efficiency wireless power transmission; wireless data communication over restricted operating distance with high power consumption; and limited functionality, working either as a neural signal recorder or as a stimulator. To overcome these issues, we suggest a novel implantable wireless neural interface system for simultaneous neural signal recording and stimulation using a single cuff electrode. By using widely available commercial off-the-shelf (COTS components, an easily reconfigurable implantable wireless neural interface system was implemented into one compact module. The implantable device includes a wireless power consortium (WPC-compliant power transmission circuit, a medical implant communication service (MICS-band-based radio link and a cuff-electrode path controller for simultaneous neural signal recording and stimulation. During in vivo experiments with rabbit models, the implantable device successfully recorded and stimulated the tibial and peroneal nerves while communicating with the external device. The proposed system can be modified for various implantable medical devices, especially such as closed-loop control based implantable neural prostheses requiring neural signal recording and stimulation at the same time.

Identification of Complex Dynamical Systems with Neural Networks (2/2)

CERN Multimedia

CERN. Geneva

2016-01-01

The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...

Identification of Complex Dynamical Systems with Neural Networks (1/2)

CERN Multimedia

CERN. Geneva

2016-01-01

The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...

Fault diagnosis for temperature, flow rate and pressure sensors in VAV systems using wavelet neural network

Energy Technology Data Exchange (ETDEWEB)

Du, Zhimin; Jin, Xinqiao; Yang, Yunyu [School of Mechanical Engineering, Shanghai Jiao Tong University, 800, Dongchuan Road, Shanghai (China)

2009-09-15

Wavelet neural network, the integration of wavelet analysis and neural network, is presented to diagnose the faults of sensors including temperature, flow rate and pressure in variable air volume (VAV) systems to ensure well capacity of energy conservation. Wavelet analysis is used to process the original data collected from the building automation first. With three-level wavelet decomposition, the series of characteristic information representing various operation conditions of the system are obtained. In addition, neural network is developed to diagnose the source of the fault. To improve the diagnosis efficiency, three data groups based on several physical models or balances are classified and constructed. Using the data decomposed by three-level wavelet, the neural network can be well trained and series of convergent networks are obtained. Finally, the new measurements to diagnose are similarly processed by wavelet. And the well-trained convergent neural networks are used to identify the operation condition and isolate the source of the fault. (author)

Neural computing thermal comfort index for HVAC systems

International Nuclear Information System (INIS)

Atthajariyakul, S.; Leephakpreeda, T.

2005-01-01

The primary purpose of a heating, ventilating and air conditioning (HVAC) system within a building is to make occupants comfortable. Without real time determination of human thermal comfort, it is not feasible for the HVAC system to yield controlled conditions of the air for human comfort all the time. This paper presents a practical approach to determine human thermal comfort quantitatively via neural computing. The neural network model allows real time determination of the thermal comfort index, where it is not practical to compute the conventional predicted mean vote (PMV) index itself in real time. The feed forward neural network model is proposed as an explicit function of the relation of the PMV index to accessible variables, i.e. the air temperature, wet bulb temperature, globe temperature, air velocity, clothing insulation and human activity. An experiment in an air conditioned office room was done to demonstrate the effectiveness of the proposed methodology. The results show good agreement between the thermal comfort index calculated from the neural network model in real time and those calculated from the conventional PMV model

Neural-network-directed alignment of optical systems using the laser-beam spatial filter as an example

Science.gov (United States)

Decker, Arthur J.; Krasowski, Michael J.; Weiland, Kenneth E.

1993-01-01

This report describes an effort at NASA Lewis Research Center to use artificial neural networks to automate the alignment and control of optical measurement systems. Specifically, it addresses the use of commercially available neural network software and hardware to direct alignments of the common laser-beam-smoothing spatial filter. The report presents a general approach for designing alignment records and combining these into training sets to teach optical alignment functions to neural networks and discusses the use of these training sets to train several types of neural networks. Neural network configurations used include the adaptive resonance network, the back-propagation-trained network, and the counter-propagation network. This work shows that neural networks can be used to produce robust sequencers. These sequencers can learn by example to execute the step-by-step procedures of optical alignment and also can learn adaptively to correct for environmentally induced misalignment. The long-range objective is to use neural networks to automate the alignment and operation of optical measurement systems in remote, harsh, or dangerous aerospace environments. This work also shows that when neural networks are trained by a human operator, training sets should be recorded, training should be executed, and testing should be done in a manner that does not depend on intellectual judgments of the human operator.

NNSYSID and NNCTRL Tools for system identification and control with neural networks

DEFF Research Database (Denmark)

Nørgaard, Magnus; Ravn, Ole; Poulsen, Niels Kjølstad

2001-01-01

choose among several designs such as direct inverse control, internal model control, nonlinear feedforward, feedback linearisation, optimal control, gain scheduling based on instantaneous linearisation of neural network models and nonlinear model predictive control. This article gives an overview......Two toolsets for use with MATLAB have been developed: the neural network based system identification toolbox (NNSYSID) and the neural network based control system design toolkit (NNCTRL). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains...... a number of nonlinear model structures based on neural networks, effective training algorithms and tools for model validation and model structure selection. The NNCTRL toolkit is an add-on to NNSYSID and provides tools for design and simulation of control systems based on neural networks. The user can...

NNSYSID and NNCTRL Tools for system identification and control with neural networks

DEFF Research Database (Denmark)

Nørgaard, Magnus; Ravn, Ole; Poulsen, Niels Kjølstad

2001-01-01

a number of nonlinear model structures based on neural networks, effective training algorithms and tools for model validation and model structure selection. The NNCTRL toolkit is an add-on to NNSYSID and provides tools for design and simulation of control systems based on neural networks. The user can...... choose among several designs such as direct inverse control, internal model control, nonlinear feedforward, feedback linearisation, optimal control, gain scheduling based on instantaneous linearisation of neural network models and nonlinear model predictive control. This article gives an overview......Two toolsets for use with MATLAB have been developed: the neural network based system identification toolbox (NNSYSID) and the neural network based control system design toolkit (NNCTRL). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains...

A New Controller to Enhance PV System Performance Based on Neural Network

Directory of Open Access Journals (Sweden)

Roshdy A AbdelRassoul

2017-06-01

Full Text Available In recent years, a radical increase of photovoltaic (PV power generators installation took place because of increased efficiency of solar cells, as well as the growth of manufacturing technology of solar panels. This paper shows the operation and modeling of photovoltaic systems, particularly designing neural controller to control the system. Neural controller is optimized using particle swarm optimization (PSO   leads to getting the best performance of the designed PV system. Using neural network the maximum overshoot and rise time obtained become 0.00001% and 0.1798 seconds, respectively also this paper introduce a comparison between some kind of controller for PV system.In recent years, a radical increase of photovoltaic (PV power generators installation took place because of increased efficiency of solar cells, as well as the growth of manufacturing technology of solar panels. This paper shows the operation and modeling of photovoltaic systems, particularly designing neural controller to control the system. Neural controller is optimized using particle swarm optimization (PSO   leads to getting the best performance of the designed PV system. Using neural network the maximum overshoot and rise time obtained become 0.00001% and 0.1798 seconds, respectively also this paper introduce a comparison between some kind of controller for PV system.

Computational neural network regression model for Host based Intrusion Detection System

Directory of Open Access Journals (Sweden)

Sunil Kumar Gautam

2016-09-01

Full Text Available The current scenario of information gathering and storing in secure system is a challenging task due to increasing cyber-attacks. There exists computational neural network techniques designed for intrusion detection system, which provide security to single machine and entire network's machine. In this paper, we have used two types of computational neural network models, namely, Generalized Regression Neural Network (GRNN model and Multilayer Perceptron Neural Network (MPNN model for Host based Intrusion Detection System using log files that are generated by a single personal computer. The simulation results show correctly classified percentage of normal and abnormal (intrusion class using confusion matrix. On the basis of results and discussion, we found that the Host based Intrusion Systems Model (HISM significantly improved the detection accuracy while retaining minimum false alarm rate.

Adaptive neural network/expert system that learns fault diagnosis for different structures

Science.gov (United States)

Simon, Solomon H.

1992-08-01

Corporations need better real-time monitoring and control systems to improve productivity by watching quality and increasing production flexibility. The innovative technology to achieve this goal is evolving in the form artificial intelligence and neural networks applied to sensor processing, fusion, and interpretation. By using these advanced Al techniques, we can leverage existing systems and add value to conventional techniques. Neural networks and knowledge-based expert systems can be combined into intelligent sensor systems which provide real-time monitoring, control, evaluation, and fault diagnosis for production systems. Neural network-based intelligent sensor systems are more reliable because they can provide continuous, non-destructive monitoring and inspection. Use of neural networks can result in sensor fusion and the ability to model highly, non-linear systems. Improved models can provide a foundation for more accurate performance parameters and predictions. We discuss a research software/hardware prototype which integrates neural networks, expert systems, and sensor technologies and which can adapt across a variety of structures to perform fault diagnosis. The flexibility and adaptability of the prototype in learning two structures is presented. Potential applications are discussed.

Neural Computations in a Dynamical System with Multiple Time Scales.

Science.gov (United States)

Mi, Yuanyuan; Lin, Xiaohan; Wu, Si

2016-01-01

Neural systems display rich short-term dynamics at various levels, e.g., spike-frequency adaptation (SFA) at the single-neuron level, and short-term facilitation (STF) and depression (STD) at the synapse level. These dynamical features typically cover a broad range of time scales and exhibit large diversity in different brain regions. It remains unclear what is the computational benefit for the brain to have such variability in short-term dynamics. In this study, we propose that the brain can exploit such dynamical features to implement multiple seemingly contradictory computations in a single neural circuit. To demonstrate this idea, we use continuous attractor neural network (CANN) as a working model and include STF, SFA and STD with increasing time constants in its dynamics. Three computational tasks are considered, which are persistent activity, adaptation, and anticipative tracking. These tasks require conflicting neural mechanisms, and hence cannot be implemented by a single dynamical feature or any combination with similar time constants. However, with properly coordinated STF, SFA and STD, we show that the network is able to implement the three computational tasks concurrently. We hope this study will shed light on the understanding of how the brain orchestrates its rich dynamics at various levels to realize diverse cognitive functions.

Neural neworks in a management information systems

OpenAIRE

Jana Weinlichová; Michael Štencl

2009-01-01

For having retrospection for all over the data which are used, analyzed, evaluated and for a future incident predictions are used Management Information Systems and Business Intelligence. In case of not to be able to apply standard methods of data processing there can be with benefit applied an Artificial Intelligence. In this article will be referred to proofed abilities of Neural Networks. The Neural Networks is supported by many software products related to provide effective solution of ma...

Sex differences of gray matter morphology in cortico-limbic-striatal neural system in major depressive disorder.

Science.gov (United States)

Kong, Lingtao; Chen, Kaiyuan; Womer, Fay; Jiang, Wenyan; Luo, Xingguang; Driesen, Naomi; Liu, Jie; Blumberg, Hilary; Tang, Yanqing; Xu, Ke; Wang, Fei

2013-06-01

Sex differences are observed in both epidemiological and clinical aspects of major depressive disorder (MDD). The cortico-limbic-striatal neural system, including the prefrontal cortex, amygdala, hippocampus, and striatum, have shown sexually dimorphic morphological features and have been implicated in the dysfunctional regulation of mood and emotion in MDD. In this study, we utilized a whole-brain, voxel-based approach to examine sex differences in the regional distribution of gray matter (GM) morphological abnormalities in medication-naïve participants with MDD. Participants included 29 medication-naïve individuals with MDD (16 females and 13 males) and 33 healthy controls (HC) (17 females and 16 males). Gray matter morphology of the cortico-limbic-striatal neural system was examined using voxel-based morphometry analyzes of high-resolution structural magnetic resonance imaging scans. The main effect of diagnosis and interaction effect of diagnosis by sex on GM morphology were statistically significant (p sex-related patterns of abnormalities within the cortico-limbic-strial neural system, such as predominant prefrontal-limbic abnormalities in MDD females vs. predominant prefrontal-striatal abnormalities in MDD males, suggest differences in neural circuitry that may mediate sex differences in the clinical presentation of MDD and potential targets for sex-differentiated treatment of the disorder. Copyright © 2013 Elsevier Ltd. All rights reserved.

Developing and using expert systems and neural networks in medicine: a review on benefits and challenges.

Science.gov (United States)

Sheikhtaheri, Abbas; Sadoughi, Farahnaz; Hashemi Dehaghi, Zahra

2014-09-01

Complicacy of clinical decisions justifies utilization of information systems such as artificial intelligence (e.g. expert systems and neural networks) to achieve better decisions, however, application of these systems in the medical domain faces some challenges. We aimed at to review the applications of these systems in the medical domain and discuss about such challenges. Following a brief introduction of expert systems and neural networks by representing few examples, the challenges of these systems in the medical domain are discussed. We found that the applications of expert systems and artificial neural networks have been increased in the medical domain. These systems have shown many advantages such as utilization of experts' knowledge, gaining rare knowledge, more time for assessment of the decision, more consistent decisions, and shorter decision-making process. In spite of all these advantages, there are challenges ahead of developing and using such systems including maintenance, required experts, inputting patients' data into the system, problems for knowledge acquisition, problems in modeling medical knowledge, evaluation and validation of system performance, wrong recommendations and responsibility, limited domains of such systems and necessity of integrating such systems into the routine work flows. We concluded that expert systems and neural networks can be successfully used in medicine; however, there are many concerns and questions to be answered through future studies and discussions.

Vein matching using artificial neural network in vein authentication systems

Science.gov (United States)

Noori Hoshyar, Azadeh; Sulaiman, Riza

2011-10-01

Personal identification technology as security systems is developing rapidly. Traditional authentication modes like key; password; card are not safe enough because they could be stolen or easily forgotten. Biometric as developed technology has been applied to a wide range of systems. According to different researchers, vein biometric is a good candidate among other biometric traits such as fingerprint, hand geometry, voice, DNA and etc for authentication systems. Vein authentication systems can be designed by different methodologies. All the methodologies consist of matching stage which is too important for final verification of the system. Neural Network is an effective methodology for matching and recognizing individuals in authentication systems. Therefore, this paper explains and implements the Neural Network methodology for finger vein authentication system. Neural Network is trained in Matlab to match the vein features of authentication system. The Network simulation shows the quality of matching as 95% which is a good performance for authentication system matching.

Adaptive Synchronization of Memristor-based Chaotic Neural Systems

Directory of Open Access Journals (Sweden)

Xiaofang Hu

2014-11-01

Full Text Available Chaotic neural networks consisting of a great number of chaotic neurons are able to reproduce the rich dynamics observed in biological nervous systems. In recent years, the memristor has attracted much interest in the efficient implementation of artificial synapses and neurons. This work addresses adaptive synchronization of a class of memristor-based neural chaotic systems using a novel adaptive backstepping approach. A systematic design procedure is presented. Simulation results have demonstrated the effectiveness of the proposed adaptive synchronization method and its potential in practical application of memristive chaotic oscillators in secure communication.

Radial basis function neural network for power system load-flow

International Nuclear Information System (INIS)

Karami, A.; Mohammadi, M.S.

2008-01-01

This paper presents a method for solving the load-flow problem of the electric power systems using radial basis function (RBF) neural network with a fast hybrid training method. The main idea is that some operating conditions (values) are needed to solve the set of non-linear algebraic equations of load-flow by employing an iterative numerical technique. Therefore, we may view the outputs of a load-flow program as functions of the operating conditions. Indeed, we are faced with a function approximation problem and this can be done by an RBF neural network. The proposed approach has been successfully applied to the 10-machine and 39-bus New England test system. In addition, this method has been compared with that of a multi-layer perceptron (MLP) neural network model. The simulation results show that the RBF neural network is a simpler method to implement and requires less training time to converge than the MLP neural network. (author)

An Artificial Neural Network Controller for Intelligent Transportation Systems Applications

Science.gov (United States)

1996-01-01

An Autonomous Intelligent Cruise Control (AICC) has been designed using a feedforward artificial neural network, as an example for utilizing artificial neural networks for nonlinear control problems arising in intelligent transportation systems appli...

High speed digital interfacing for a neural data acquisition system

Directory of Open Access Journals (Sweden)

Bahr Andreas

2016-09-01

Full Text Available Diseases like schizophrenia and genetic epilepsy are supposed to be caused by disorders in the early development of the brain. For the further investigation of these relationships a custom designed application specific integrated circuit (ASIC was developed that is optimized for the recording from neonatal mice [Bahr A, Abu-Saleh L, Schroeder D, Krautschneider W. 16 Channel Neural Recording Integrated Circuit with SPI Interface and Error Correction Coding. Proc. 9th BIOSTEC 2016. Biodevices: Rome, Italy, 2016; 1: 263; Bahr A, Abu-Saleh L, Schroeder D, Krautschneider W. Development of a neural recording mixed signal integrated circuit for biomedical signal acquisition. Biomed Eng Biomed Tech Abstracts 2015; 60(S1: 298–299; Bahr A, Abu-Saleh L, Schroeder D, Krautschneider WH. 16 Channel Neural Recording Mixed Signal ASIC. CDNLive EMEA 2015 Conference Proceedings, 2015.]. To enable the live display of the neural signals a multichannel neural data acquisition system with live display functionality is presented. It implements a high speed data transmission from the ASIC to a computer with a live display functionality. The system has been successfully implemented and was used in a neural recording of a head-fixed mouse.

Parameter estimation in space systems using recurrent neural networks

Science.gov (United States)

Parlos, Alexander G.; Atiya, Amir F.; Sunkel, John W.

1991-01-01

The identification of time-varying parameters encountered in space systems is addressed, using artificial neural systems. A hybrid feedforward/feedback neural network, namely a recurrent multilayer perception, is used as the model structure in the nonlinear system identification. The feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of temporal variations in the system nonlinearities. The standard back-propagation-learning algorithm is modified and it is used for both the off-line and on-line supervised training of the proposed hybrid network. The performance of recurrent multilayer perceptron networks in identifying parameters of nonlinear dynamic systems is investigated by estimating the mass properties of a representative large spacecraft. The changes in the spacecraft inertia are predicted using a trained neural network, during two configurations corresponding to the early and late stages of the spacecraft on-orbit assembly sequence. The proposed on-line mass properties estimation capability offers encouraging results, though, further research is warranted for training and testing the predictive capabilities of these networks beyond nominal spacecraft operations.

Signal Processing and Neural Network Simulator

Science.gov (United States)

Tebbe, Dennis L.; Billhartz, Thomas J.; Doner, John R.; Kraft, Timothy T.

1995-04-01

The signal processing and neural network simulator (SPANNS) is a digital signal processing simulator with the capability to invoke neural networks into signal processing chains. This is a generic tool which will greatly facilitate the design and simulation of systems with embedded neural networks. The SPANNS is based on the Signal Processing WorkSystemTM (SPWTM), a commercial-off-the-shelf signal processing simulator. SPW provides a block diagram approach to constructing signal processing simulations. Neural network paradigms implemented in the SPANNS include Backpropagation, Kohonen Feature Map, Outstar, Fully Recurrent, Adaptive Resonance Theory 1, 2, & 3, and Brain State in a Box. The SPANNS was developed by integrating SAIC's Industrial Strength Neural Networks (ISNN) Software into SPW.

Fault diagnosis system of electromagnetic valve using neural network filter

International Nuclear Information System (INIS)

Hayashi, Shoji; Odaka, Tomohiro; Kuroiwa, Jousuke; Ogura, Hisakazu

2008-01-01

This paper is concerned with the gas leakage fault detection of electromagnetic valve using a neural network filter. In modern plants, the ability to detect and identify gas leakage faults is becoming increasingly important. The main difficulty in detecting gas leakage faults by sound signals lies in the fact that the practical plants are usually very noisy. To solve this difficulty, a neural network filter is used to eliminate background noise and raise the signal noise ratio of the sound signal. The background noise is assumed as a dynamic system, and an accurate mathematical model of the dynamic system can be established using a neural network filter. The predicted error between predicted values and practical ones constitutes the output of the filter. If the predicted error is zero, then there is no leakage. If the predicted error is greater than a certain value, then there is a leakage fault. Through application to practical pneumatic systems, it is verified that the neural network filter was effective in gas leakage detection. (author)

Recycling signals in the neural crest

OpenAIRE

Taneyhill, Lisa A.; Bronner-Fraser, Marianne E.

2006-01-01

Vertebrate neural crest cells are multipotent and differentiate into structures that include cartilage and the bones of the face, as well as much of the peripheral nervous system. Understanding how different model vertebrates utilize signaling pathways reiteratively during various stages of neural crest formation and differentiation lends insight into human disorders associated with the neural crest.

Recycling signals in the neural crest.

Science.gov (United States)

Taneyhill, Lisa A; Bronner-Fraser, Marianne

2005-01-01

Vertebrate neural crest cells are multipotent and differentiate into structures that include cartilage and the bones of the face, as well as much of the peripheral nervous system. Understanding how different model vertebrates utilize signaling pathways reiteratively during various stages of neural crest formation and differentiation lends insight into human disorders associated with the neural crest.

Development of an accident diagnosis system using a dynamic neural network for nuclear power plants

International Nuclear Information System (INIS)

Lee, Seung Jun; Kim, Jong Hyun; Seong, Poong Hyun

2004-01-01

In this work, an accident diagnosis system using the dynamic neural network is developed. In order to help the plant operators to quickly identify the problem, perform diagnosis and initiate recovery actions ensuring the safety of the plant, many operator support system and accident diagnosis systems have been developed. Neural networks have been recognized as a good method to implement an accident diagnosis system. However, conventional accident diagnosis systems that used neural networks did not consider a time factor sufficiently. If the neural network could be trained according to time, it is possible to perform more efficient and detailed accidents analysis. Therefore, this work suggests a dynamic neural network which has different features from existing dynamic neural networks. And a simple accident diagnosis system is implemented in order to validate the dynamic neural network. After training of the prototype, several accident diagnoses were performed. The results show that the prototype can detect the accidents correctly with good performances

Three neural network based sensor systems for environmental monitoring

International Nuclear Information System (INIS)

Keller, P.E.; Kouzes, R.T.; Kangas, L.J.

1994-05-01

Compact, portable systems capable of quickly identifying contaminants in the field are of great importance when monitoring the environment. One of the missions of the Pacific Northwest Laboratory is to examine and develop new technologies for environmental restoration and waste management at the Hanford Site. In this paper, three prototype sensing systems are discussed. These prototypes are composed of sensing elements, data acquisition system, computer, and neural network implemented in software, and are capable of automatically identifying contaminants. The first system employs an array of tin-oxide gas sensors and is used to identify chemical vapors. The second system employs an array of optical sensors and is used to identify the composition of chemical dyes in liquids. The third system contains a portable gamma-ray spectrometer and is used to identify radioactive isotopes. In these systems, the neural network is used to identify the composition of the sensed contaminant. With a neural network, the intense computation takes place during the training process. Once the network is trained, operation consists of propagating the data through the network. Since the computation involved during operation consists of vector-matrix multiplication and application of look-up tables unknown samples can be rapidly identified in the field

Neural Computations in a Dynamical System with Multiple Time Scales

Directory of Open Access Journals (Sweden)

Yuanyuan Mi

2016-09-01

Full Text Available Neural systems display rich short-term dynamics at various levels, e.g., spike-frequencyadaptation (SFA at single neurons, and short-term facilitation (STF and depression (STDat neuronal synapses. These dynamical features typically covers a broad range of time scalesand exhibit large diversity in different brain regions. It remains unclear what the computationalbenefit for the brain to have such variability in short-term dynamics is. In this study, we proposethat the brain can exploit such dynamical features to implement multiple seemingly contradictorycomputations in a single neural circuit. To demonstrate this idea, we use continuous attractorneural network (CANN as a working model and include STF, SFA and STD with increasing timeconstants in their dynamics. Three computational tasks are considered, which are persistent activity,adaptation, and anticipative tracking. These tasks require conflicting neural mechanisms, andhence cannot be implemented by a single dynamical feature or any combination with similar timeconstants. However, with properly coordinated STF, SFA and STD, we show that the network isable to implement the three computational tasks concurrently. We hope this study will shed lighton the understanding of how the brain orchestrates its rich dynamics at various levels to realizediverse cognitive functions.

Fundamentals of computational intelligence neural networks, fuzzy systems, and evolutionary computation

CERN Document Server

Keller, James M; Fogel, David B

2016-01-01

This book covers the three fundamental topics that form the basis of computational intelligence: neural networks, fuzzy systems, and evolutionary computation. The text focuses on inspiration, design, theory, and practical aspects of implementing procedures to solve real-world problems. While other books in the three fields that comprise computational intelligence are written by specialists in one discipline, this book is co-written by current former Editor-in-Chief of IEEE Transactions on Neural Networks and Learning Systems, a former Editor-in-Chief of IEEE Transactions on Fuzzy Systems, and the founding Editor-in-Chief of IEEE Transactions on Evolutionary Computation. The coverage across the three topics is both uniform and consistent in style and notation. Discusses single-layer and multilayer neural networks, radial-basi function networks, and recurrent neural networks Covers fuzzy set theory, fuzzy relations, fuzzy logic interference, fuzzy clustering and classification, fuzzy measures and fuzz...

Radial basis function (RBF) neural network control for mechanical systems design, analysis and Matlab simulation

CERN Document Server

Liu, Jinkun

2013-01-01

Radial Basis Function (RBF) Neural Network Control for Mechanical Systems is motivated by the need for systematic design approaches to stable adaptive control system design using neural network approximation-based techniques. The main objectives of the book are to introduce the concrete design methods and MATLAB simulation of stable adaptive RBF neural control strategies. In this book, a broad range of implementable neural network control design methods for mechanical systems are presented, such as robot manipulators, inverted pendulums, single link flexible joint robots, motors, etc. Advanced neural network controller design methods and their stability analysis are explored. The book provides readers with the fundamentals of neural network control system design.   This book is intended for the researchers in the fields of neural adaptive control, mechanical systems, Matlab simulation, engineering design, robotics and automation. Jinkun Liu is a professor at Beijing University of Aeronautics and Astronauti...

Neuromorphic neural interfaces: from neurophysiological inspiration to biohybrid coupling with nervous systems

Science.gov (United States)

Broccard, Frédéric D.; Joshi, Siddharth; Wang, Jun; Cauwenberghs, Gert

2017-08-01

Objective. Computation in nervous systems operates with different computational primitives, and on different hardware, than traditional digital computation and is thus subjected to different constraints from its digital counterpart regarding the use of physical resources such as time, space and energy. In an effort to better understand neural computation on a physical medium with similar spatiotemporal and energetic constraints, the field of neuromorphic engineering aims to design and implement electronic systems that emulate in very large-scale integration (VLSI) hardware the organization and functions of neural systems at multiple levels of biological organization, from individual neurons up to large circuits and networks. Mixed analog/digital neuromorphic VLSI systems are compact, consume little power and operate in real time independently of the size and complexity of the model. Approach. This article highlights the current efforts to interface neuromorphic systems with neural systems at multiple levels of biological organization, from the synaptic to the system level, and discusses the prospects for future biohybrid systems with neuromorphic circuits of greater complexity. Main results. Single silicon neurons have been interfaced successfully with invertebrate and vertebrate neural networks. This approach allowed the investigation of neural properties that are inaccessible with traditional techniques while providing a realistic biological context not achievable with traditional numerical modeling methods. At the network level, populations of neurons are envisioned to communicate bidirectionally with neuromorphic processors of hundreds or thousands of silicon neurons. Recent work on brain-machine interfaces suggests that this is feasible with current neuromorphic technology. Significance. Biohybrid interfaces between biological neurons and VLSI neuromorphic systems of varying complexity have started to emerge in the literature. Primarily intended as a

IMPLEMENTATION OF NEURAL - CRYPTOGRAPHIC SYSTEM USING FPGA

Directory of Open Access Journals (Sweden)

KARAM M. Z. OTHMAN

2011-08-01

Full Text Available Modern cryptography techniques are virtually unbreakable. As the Internet and other forms of electronic communication become more prevalent, electronic security is becoming increasingly important. Cryptography is used to protect e-mail messages, credit card information, and corporate data. The design of the cryptography system is a conventional cryptography that uses one key for encryption and decryption process. The chosen cryptography algorithm is stream cipher algorithm that encrypt one bit at a time. The central problem in the stream-cipher cryptography is the difficulty of generating a long unpredictable sequence of binary signals from short and random key. Pseudo random number generators (PRNG have been widely used to construct this key sequence. The pseudo random number generator was designed using the Artificial Neural Networks (ANN. The Artificial Neural Networks (ANN providing the required nonlinearity properties that increases the randomness statistical properties of the pseudo random generator. The learning algorithm of this neural network is backpropagation learning algorithm. The learning process was done by software program in Matlab (software implementation to get the efficient weights. Then, the learned neural network was implemented using field programmable gate array (FPGA.

PERFORMANCE COMPARISON FOR INTRUSION DETECTION SYSTEM USING NEURAL NETWORK WITH KDD DATASET

Directory of Open Access Journals (Sweden)

S. Devaraju

2014-04-01

Full Text Available Intrusion Detection Systems are challenging task for finding the user as normal user or attack user in any organizational information systems or IT Industry. The Intrusion Detection System is an effective method to deal with the kinds of problem in networks. Different classifiers are used to detect the different kinds of attacks in networks. In this paper, the performance of intrusion detection is compared with various neural network classifiers. In the proposed research the four types of classifiers used are Feed Forward Neural Network (FFNN, Generalized Regression Neural Network (GRNN, Probabilistic Neural Network (PNN and Radial Basis Neural Network (RBNN. The performance of the full featured KDD Cup 1999 dataset is compared with that of the reduced featured KDD Cup 1999 dataset. The MATLAB software is used to train and test the dataset and the efficiency and False Alarm Rate is measured. It is proved that the reduced dataset is performing better than the full featured dataset.

Automated implementation of rule-based expert systems with neural networks for time-critical applications

Science.gov (United States)

Ramamoorthy, P. A.; Huang, Song; Govind, Girish

1991-01-01

In fault diagnosis, control and real-time monitoring, both timing and accuracy are critical for operators or machines to reach proper solutions or appropriate actions. Expert systems are becoming more popular in the manufacturing community for dealing with such problems. In recent years, neural networks have revived and their applications have spread to many areas of science and engineering. A method of using neural networks to implement rule-based expert systems for time-critical applications is discussed here. This method can convert a given rule-based system into a neural network with fixed weights and thresholds. The rules governing the translation are presented along with some examples. We also present the results of automated machine implementation of such networks from the given rule-base. This significantly simplifies the translation process to neural network expert systems from conventional rule-based systems. Results comparing the performance of the proposed approach based on neural networks vs. the classical approach are given. The possibility of very large scale integration (VLSI) realization of such neural network expert systems is also discussed.

Integrated evolutionary computation neural network quality controller for automated systems

Energy Technology Data Exchange (ETDEWEB)

Patro, S.; Kolarik, W.J. [Texas Tech Univ., Lubbock, TX (United States). Dept. of Industrial Engineering

1999-06-01

With increasing competition in the global market, more and more stringent quality standards and specifications are being demands at lower costs. Manufacturing applications of computing power are becoming more common. The application of neural networks to identification and control of dynamic processes has been discussed. The limitations of using neural networks for control purposes has been pointed out and a different technique, evolutionary computation, has been discussed. The results of identifying and controlling an unstable, dynamic process using evolutionary computation methods has been presented. A framework for an integrated system, using both neural networks and evolutionary computation, has been proposed to identify the process and then control the product quality, in a dynamic, multivariable system, in real-time.

Neural-net based unstable machine identification using individual energy functions. [Transient disturbances in power systems

Energy Technology Data Exchange (ETDEWEB)

Djukanovic, M [Institut Nikola Tesla, Belgrade (Yugoslavia); Sobajic, D J; Pao, Yohhan [Case Western Reserve Univ., Cleveland, OH (United States)

1991-10-01

The identification of the mode of instability plays an essential role in generating principal energy boundary hypersurfaces. We present a new method for unstable machine identification based on the use of supervised learning neural-net technology, and the adaptive pattern recognition concept. It is shown that using individual energy functions as pattern features, appropriately trained neural-nets can retrieve the reliable characterization of the transient process including critical clearing time parameter, mode of instability and energy margins. Generalization capabilities of the neural-net processing allow for these assessments to be made independently of load levels. The results obtained from computer simulations are presented using the New England power system, as an example. (author).

The application of expert systems and neural networks to gas turbine prognostics and diagnostics

Energy Technology Data Exchange (ETDEWEB)

DePold, H.R.; Gass, F.D.

1999-10-01

Condition monitoring of engine gas generators plays an essential role in airline fleet management. Adaptive diagnostic systems are becoming available that interpret measured data, furnish diagnosis of problems, provide a prognosis of engine health for planning purposes, and rank engines for scheduled maintenance. More than four hundred operations worldwide currently use versions of the first or second generation diagnostic tools. Development of a third generation system is underway which will provide additional system enhancements and combine the functions of the existing tools. Proposed enhancements include the use of artificial intelligence to automate, improve the quality of the analysis, provide timely alerts, and the use of an Internet link for collaboration. One objective of these enhancements is to have the intelligent system do more of the analysis and decision making, while continuing to support the depth of analysis currently available at experienced operations. This paper presents recent developments in technology and strategies in engine condition monitoring including: (1) application of statistical analysis and artificial neural network filters to improve data quality, (2) neural networks for trend change detection, and classification to diagnose performance change, and (3) expert systems to diagnose, provide alerts and to rank maintenance action recommendations.

Fault Tolerant Neural Network for ECG Signal Classification Systems

Directory of Open Access Journals (Sweden)

MERAH, M.

2011-08-01

Full Text Available The aim of this paper is to apply a new robust hardware Artificial Neural Network (ANN for ECG classification systems. This ANN includes a penalization criterion which makes the performances in terms of robustness. Specifically, in this method, the ANN weights are normalized using the auto-prune method. Simulations performed on the MIT ? BIH ECG signals, have shown that significant robustness improvements are obtained regarding potential hardware artificial neuron failures. Moreover, we show that the proposed design achieves better generalization performances, compared to the standard back-propagation algorithm.

Neural Mechanisms and Information Processing in Recognition Systems

Directory of Open Access Journals (Sweden)

Mamiko Ozaki

2014-10-01

Full Text Available Nestmate recognition is a hallmark of social insects. It is based on the match/mismatch of an identity signal carried by members of the society with that of the perceiving individual. While the behavioral response, amicable or aggressive, is very clear, the neural systems underlying recognition are not fully understood. Here we contrast two alternative hypotheses for the neural mechanisms that are responsible for the perception and information processing in recognition. We focus on recognition via chemical signals, as the common modality in social insects. The first, classical, hypothesis states that upon perception of recognition cues by the sensory system the information is passed as is to the antennal lobes and to higher brain centers where the information is deciphered and compared to a neural template. Match or mismatch information is then transferred to some behavior-generating centers where the appropriate response is elicited. An alternative hypothesis, that of “pre-filter mechanism”, posits that the decision as to whether to pass on the information to the central nervous system takes place in the peripheral sensory system. We suggest that, through sensory adaptation, only alien signals are passed on to the brain, specifically to an “aggressive-behavior-switching center”, where the response is generated if the signal is above a certain threshold.

Neural networks for feedback feedforward nonlinear control systems.

Science.gov (United States)

Parisini, T; Zoppoli, R

1994-01-01

This paper deals with the problem of designing feedback feedforward control strategies to drive the state of a dynamic system (in general, nonlinear) so as to track any desired trajectory joining the points of given compact sets, while minimizing a certain cost function (in general, nonquadratic). Due to the generality of the problem, conventional methods are difficult to apply. Thus, an approximate solution is sought by constraining control strategies to take on the structure of multilayer feedforward neural networks. After discussing the approximation properties of neural control strategies, a particular neural architecture is presented, which is based on what has been called the "linear-structure preserving principle". The original functional problem is then reduced to a nonlinear programming one, and backpropagation is applied to derive the optimal values of the synaptic weights. Recursive equations to compute the gradient components are presented, which generalize the classical adjoint system equations of N-stage optimal control theory. Simulation results related to nonlinear nonquadratic problems show the effectiveness of the proposed method.

Dynamical systems, attractors, and neural circuits.

Science.gov (United States)

Miller, Paul

2016-01-01

Biology is the study of dynamical systems. Yet most of us working in biology have limited pedagogical training in the theory of dynamical systems, an unfortunate historical fact that can be remedied for future generations of life scientists. In my particular field of systems neuroscience, neural circuits are rife with nonlinearities at all levels of description, rendering simple methodologies and our own intuition unreliable. Therefore, our ideas are likely to be wrong unless informed by good models. These models should be based on the mathematical theories of dynamical systems since functioning neurons are dynamic-they change their membrane potential and firing rates with time. Thus, selecting the appropriate type of dynamical system upon which to base a model is an important first step in the modeling process. This step all too easily goes awry, in part because there are many frameworks to choose from, in part because the sparsely sampled data can be consistent with a variety of dynamical processes, and in part because each modeler has a preferred modeling approach that is difficult to move away from. This brief review summarizes some of the main dynamical paradigms that can arise in neural circuits, with comments on what they can achieve computationally and what signatures might reveal their presence within empirical data. I provide examples of different dynamical systems using simple circuits of two or three cells, emphasizing that any one connectivity pattern is compatible with multiple, diverse functions.

System Identification, Prediction, Simulation and Control with Neural Networks

DEFF Research Database (Denmark)

Sørensen, O.

1997-01-01

a Gauss-Newton search direction is applied. 3) Amongst numerous model types, often met in control applications, only the Non-linear ARMAX (NARMAX) model, representing input/output description, is examined. A simulated example confirms that a neural network has the potential to perform excellent System......The intention of this paper is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...... study of the networks themselves. With this end in view the following restrictions have been made: 1) Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. 2) Amongst numerous training algorithms, only the Recursive Prediction Error Method using...

Advanced methodology for generation expansion planning including interconnected systems

Energy Technology Data Exchange (ETDEWEB)

Zhao, M; Yokoyama, R; Yasuda, K [Tokyo Metropolitan Univ. (Japan); Sasaki, H [Hiroshima Univ. (Japan); Ogimoto, K [Electric Power Development Co. Ltd., Tokyo (Japan)

1994-12-31

This paper reviews advanced methodology for generation expansion planning including interconnected systems developed in Japan, putting focus on flexibility and efficiency in a practical application. First, criteria for evaluating flexibility of generation planning considering uncertainties are introduced. Secondly, the flexible generation mix problem is formulated as a multi-objective optimization with more than two objective functions. The multi-objective optimization problem is then transformed into a single objective problem by using the weighting method, to obtain the Pareto optimal solution, and solved by a dynamics programming technique. Thirdly, a new approach for electric generation expansion planning of interconnected systems is presented, based on the Benders Decomposition technique. That is, large scale generation problem constituted by the general economic load dispatch problem, and several sub problems which are composed of smaller scale isolated system generation expansion plans. Finally, the generation expansion plan solved by an artificial neural network is presented. In conclusion, the advantages and disadvantages of this method from the viewpoint of flexibility and applicability to practical generation expansion planning are presented. (author) 29 refs., 10 figs., 4 tabs.

Container-code recognition system based on computer vision and deep neural networks

Science.gov (United States)

Liu, Yi; Li, Tianjian; Jiang, Li; Liang, Xiaoyao

2018-04-01

Automatic container-code recognition system becomes a crucial requirement for ship transportation industry in recent years. In this paper, an automatic container-code recognition system based on computer vision and deep neural networks is proposed. The system consists of two modules, detection module and recognition module. The detection module applies both algorithms based on computer vision and neural networks, and generates a better detection result through combination to avoid the drawbacks of the two methods. The combined detection results are also collected for online training of the neural networks. The recognition module exploits both character segmentation and end-to-end recognition, and outputs the recognition result which passes the verification. When the recognition module generates false recognition, the result will be corrected and collected for online training of the end-to-end recognition sub-module. By combining several algorithms, the system is able to deal with more situations, and the online training mechanism can improve the performance of the neural networks at runtime. The proposed system is able to achieve 93% of overall recognition accuracy.

Temporal neural networks and transient analysis of complex engineering systems

Science.gov (United States)

Uluyol, Onder

A theory is introduced for a multi-layered Local Output Gamma Feedback (LOGF) neural network within the paradigm of Locally-Recurrent Globally-Feedforward neural networks. It is developed for the identification, prediction, and control tasks of spatio-temporal systems and allows for the presentation of different time scales through incorporation of a gamma memory. It is initially applied to the tasks of sunspot and Mackey-Glass series prediction as benchmarks, then it is extended to the task of power level control of a nuclear reactor at different fuel cycle conditions. The developed LOGF neuron model can also be viewed as a Transformed Input and State (TIS) Gamma memory for neural network architectures for temporal processing. The novel LOGF neuron model extends the static neuron model by incorporating into it a short-term memory structure in the form of a digital gamma filter. A feedforward neural network made up of LOGF neurons can thus be used to model dynamic systems. A learning algorithm based upon the Backpropagation-Through-Time (BTT) approach is derived. It is applicable for training a general L-layer LOGF neural network. The spatial and temporal weights and parameters of the network are iteratively optimized for a given problem using the derived learning algorithm.

Optical neural network system for pose determination of spinning satellites

Science.gov (United States)

Lee, Andrew; Casasent, David

1990-01-01

An optical neural network architecture and algorithm based on a Hopfield optimization network are presented for multitarget tracking. This tracker utilizes a neuron for every possible target track, and a quadratic energy function of neural activities which is minimized using gradient descent neural evolution. The neural net tracker is demonstrated as part of a system for determining position and orientation (pose) of spinning satellites with respect to a robotic spacecraft. The input to the system is time sequence video from a single camera. Novelty detection and filtering are utilized to locate and segment novel regions from the input images. The neural net multitarget tracker determines the correspondences (or tracks) of the novel regions as a function of time, and hence the paths of object (satellite) parts. The path traced out by a given part or region is approximately elliptical in image space, and the position, shape and orientation of the ellipse are functions of the satellite geometry and its pose. Having a geometric model of the satellite, and the elliptical path of a part in image space, the three-dimensional pose of the satellite is determined. Digital simulation results using this algorithm are presented for various satellite poses and lighting conditions.

Backstepping fuzzy-neural-network control design for hybrid maglev transportation system.

Science.gov (United States)

Wai, Rong-Jong; Yao, Jing-Xiang; Lee, Jeng-Dao

2015-02-01

This paper focuses on the design of a backstepping fuzzy-neural-network control (BFNNC) for the online levitated balancing and propulsive positioning of a hybrid magnetic levitation (maglev) transportation system. The dynamic model of the hybrid maglev transportation system including levitated hybrid electromagnets to reduce the suspension power loss and the friction force during linear movement and a propulsive linear induction motor based on the concepts of mechanical geometry and motion dynamics is first constructed. The ultimate goal is to design an online fuzzy neural network (FNN) control methodology to cope with the problem of the complicated control transformation and the chattering control effort in backstepping control (BSC) design, and to directly ensure the stability of the controlled system without the requirement of strict constraints, detailed system information, and auxiliary compensated controllers despite the existence of uncertainties. In the proposed BFNNC scheme, an FNN control is utilized to be the major control role by imitating the BSC strategy, and adaptation laws for network parameters are derived in the sense of projection algorithm and Lyapunov stability theorem to ensure the network convergence as well as stable control performance. The effectiveness of the proposed control strategy for the hybrid maglev transportation system is verified by experimental results, and the superiority of the BFNNC scheme is indicated in comparison with the BSC strategy and the backstepping particle-swarm-optimization control system in previous research.

Neural network based expert system for fault diagnosis of particle accelerators

International Nuclear Information System (INIS)

Dewidar, M.M.

1997-01-01

Particle accelerators are generators that produce beams of charged particles, acquiring different energies, depending on the accelerator type. The MGC-20 cyclotron is a cyclic particle accelerator used for accelerating protons, deuterons, alpha particles, and helium-3 to different energies. Its applications include isotope production, nuclear reaction, and mass spectroscopy studies. It is a complicated machine, it consists of five main parts, the ion source, the deflector, the beam transport system, the concentric and harmonic coils, and the radio frequency system. The diagnosis of this device is a very complex task. it depends on the conditions of 27 indicators of the control panel of the device. The accurate diagnosis can lead to a high system reliability and save maintenance costs. so an expert system for the cyclotron fault diagnosis is necessary to be built. In this thesis , a hybrid expert system was developed for the fault diagnosis of the MGC-20 cyclotron. Two intelligent techniques, multilayer feed forward back propagation neural network and the rule based expert system, are integrated as a pre-processor loosely coupled model to build the proposed hybrid expert system. The architecture of the developed hybrid expert system consists of two levels. The first level is two feed forward back propagation neural networks, used for isolating the faulty part of the cyclotron. The second level is the rule based expert system, used for troubleshooting the faults inside the isolated faulty part. 4-6 tabs., 4-5 figs., 36 refs

Neural mechanisms of selective attention in the somatosensory system.

Science.gov (United States)

Gomez-Ramirez, Manuel; Hysaj, Kristjana; Niebur, Ernst

2016-09-01

Selective attention allows organisms to extract behaviorally relevant information while ignoring distracting stimuli that compete for the limited resources of their central nervous systems. Attention is highly flexible, and it can be harnessed to select information based on sensory modality, within-modality feature(s), spatial location, object identity, and/or temporal properties. In this review, we discuss the body of work devoted to understanding mechanisms of selective attention in the somatosensory system. In particular, we describe the effects of attention on tactile behavior and corresponding neural activity in somatosensory cortex. Our focus is on neural mechanisms that select tactile stimuli based on their location on the body (somatotopic-based attention) or their sensory feature (feature-based attention). We highlight parallels between selection mechanisms in touch and other sensory systems and discuss several putative neural coding schemes employed by cortical populations to signal the behavioral relevance of sensory inputs. Specifically, we contrast the advantages and disadvantages of using a gain vs. spike-spike correlation code for representing attended sensory stimuli. We favor a neural network model of tactile attention that is composed of frontal, parietal, and subcortical areas that controls somatosensory cells encoding the relevant stimulus features to enable preferential processing throughout the somatosensory hierarchy. Our review is based on data from noninvasive electrophysiological and imaging data in humans as well as single-unit recordings in nonhuman primates. Copyright © 2016 the American Physiological Society.

Synthesis of recurrent neural networks for dynamical system simulation.

Science.gov (United States)

Trischler, Adam P; D'Eleuterio, Gabriele M T

2016-08-01

We review several of the most widely used techniques for training recurrent neural networks to approximate dynamical systems, then describe a novel algorithm for this task. The algorithm is based on an earlier theoretical result that guarantees the quality of the network approximation. We show that a feedforward neural network can be trained on the vector-field representation of a given dynamical system using backpropagation, then recast it as a recurrent network that replicates the original system's dynamics. After detailing this algorithm and its relation to earlier approaches, we present numerical examples that demonstrate its capabilities. One of the distinguishing features of our approach is that both the original dynamical systems and the recurrent networks that simulate them operate in continuous time. Copyright © 2016 Elsevier Ltd. All rights reserved.

A modular neural network scheme applied to fault diagnosis in electric power systems.

Science.gov (United States)

Flores, Agustín; Quiles, Eduardo; García, Emilio; Morant, Francisco; Correcher, Antonio

2014-01-01

This work proposes a new method for fault diagnosis in electric power systems based on neural modules. With this method the diagnosis is performed by assigning a neural module for each type of component comprising the electric power system, whether it is a transmission line, bus or transformer. The neural modules for buses and transformers comprise two diagnostic levels which take into consideration the logic states of switches and relays, both internal and back-up, with the exception of the neural module for transmission lines which also has a third diagnostic level which takes into account the oscillograms of fault voltages and currents as well as the frequency spectrums of these oscillograms, in order to verify if the transmission line had in fact been subjected to a fault. One important advantage of the diagnostic system proposed is that its implementation does not require the use of a network configurator for the system; it does not depend on the size of the power network nor does it require retraining of the neural modules if the power network increases in size, making its application possible to only one component, a specific area, or the whole context of the power system.

The neural system of metacognition accompanying decision-making in the prefrontal cortex

Science.gov (United States)

Qiu, Lirong; Su, Jie; Ni, Yinmei; Bai, Yang; Zhang, Xuesong; Li, Xiaoli

2018-01-01

Decision-making is usually accompanied by metacognition, through which a decision maker monitors uncertainty regarding a decision and may then consequently revise the decision. These metacognitive processes can occur prior to or in the absence of feedback. However, the neural mechanisms of metacognition remain controversial. One theory proposes an independent neural system for metacognition in the prefrontal cortex (PFC); the other, that metacognitive processes coincide and overlap with the systems used for the decision-making process per se. In this study, we devised a novel “decision–redecision” paradigm to investigate the neural metacognitive processes involved in redecision as compared to the initial decision-making process. The participants underwent a perceptual decision-making task and a rule-based decision-making task during functional magnetic resonance imaging (fMRI). We found that the anterior PFC, including the dorsal anterior cingulate cortex (dACC) and lateral frontopolar cortex (lFPC), were more extensively activated after the initial decision. The dACC activity in redecision positively scaled with decision uncertainty and correlated with individual metacognitive uncertainty monitoring abilities—commonly occurring in both tasks—indicating that the dACC was specifically involved in decision uncertainty monitoring. In contrast, the lFPC activity seen in redecision processing was scaled with decision uncertainty reduction and correlated with individual accuracy changes—positively in the rule-based decision-making task and negatively in the perceptual decision-making task. Our results show that the lFPC was specifically involved in metacognitive control of decision adjustment and was subject to different control demands of the tasks. Therefore, our findings support that a separate neural system in the PFC is essentially involved in metacognition and further, that functions of the PFC in metacognition are dissociable. PMID:29684004

Neural systems language: a formal modeling language for the systematic description, unambiguous communication, and automated digital curation of neural connectivity.

Science.gov (United States)

Brown, Ramsay A; Swanson, Larry W

2013-09-01

Systematic description and the unambiguous communication of findings and models remain among the unresolved fundamental challenges in systems neuroscience. No common descriptive frameworks exist to describe systematically the connective architecture of the nervous system, even at the grossest level of observation. Furthermore, the accelerating volume of novel data generated on neural connectivity outpaces the rate at which this data is curated into neuroinformatics databases to synthesize digitally systems-level insights from disjointed reports and observations. To help address these challenges, we propose the Neural Systems Language (NSyL). NSyL is a modeling language to be used by investigators to encode and communicate systematically reports of neural connectivity from neuroanatomy and brain imaging. NSyL engenders systematic description and communication of connectivity irrespective of the animal taxon described, experimental or observational technique implemented, or nomenclature referenced. As a language, NSyL is internally consistent, concise, and comprehensible to both humans and computers. NSyL is a promising development for systematizing the representation of neural architecture, effectively managing the increasing volume of data on neural connectivity and streamlining systems neuroscience research. Here we present similar precedent systems, how NSyL extends existing frameworks, and the reasoning behind NSyL's development. We explore NSyL's potential for balancing robustness and consistency in representation by encoding previously reported assertions of connectivity from the literature as examples. Finally, we propose and discuss the implications of a framework for how NSyL will be digitally implemented in the future to streamline curation of experimental results and bridge the gaps among anatomists, imagers, and neuroinformatics databases. Copyright © 2013 Wiley Periodicals, Inc.

A biologically inspired neural model for visual and proprioceptive integration including sensory training.

Science.gov (United States)

Saidi, Maryam; Towhidkhah, Farzad; Gharibzadeh, Shahriar; Lari, Abdolaziz Azizi

2013-12-01

Humans perceive the surrounding world by integration of information through different sensory modalities. Earlier models of multisensory integration rely mainly on traditional Bayesian and causal Bayesian inferences for single causal (source) and two causal (for two senses such as visual and auditory systems), respectively. In this paper a new recurrent neural model is presented for integration of visual and proprioceptive information. This model is based on population coding which is able to mimic multisensory integration of neural centers in the human brain. The simulation results agree with those achieved by casual Bayesian inference. The model can also simulate the sensory training process of visual and proprioceptive information in human. Training process in multisensory integration is a point with less attention in the literature before. The effect of proprioceptive training on multisensory perception was investigated through a set of experiments in our previous study. The current study, evaluates the effect of both modalities, i.e., visual and proprioceptive training and compares them with each other through a set of new experiments. In these experiments, the subject was asked to move his/her hand in a circle and estimate its position. The experiments were performed on eight subjects with proprioception training and eight subjects with visual training. Results of the experiments show three important points: (1) visual learning rate is significantly more than that of proprioception; (2) means of visual and proprioceptive errors are decreased by training but statistical analysis shows that this decrement is significant for proprioceptive error and non-significant for visual error, and (3) visual errors in training phase even in the beginning of it, is much less than errors of the main test stage because in the main test, the subject has to focus on two senses. The results of the experiments in this paper is in agreement with the results of the neural model

Vehicle Signal Analysis Using Artificial Neural Networks for a Bridge Weigh-in-Motion System

Directory of Open Access Journals (Sweden)

Min-Seok Park

2009-10-01

Full Text Available This paper describes the procedures for development of signal analysis algorithms using artificial neural networks for Bridge Weigh-in-Motion (B-WIM systems. Through the analysis procedure, the extraction of information concerning heavy traffic vehicles such as weight, speed, and number of axles from the time domain strain data of the B-WIM system was attempted. As one of the several possible pattern recognition techniques, an Artificial Neural Network (ANN was employed since it could effectively include dynamic effects and bridge-vehicle interactions. A number of vehicle traveling experiments with sufficient load cases were executed on two different types of bridges, a simply supported pre-stressed concrete girder bridge and a cable-stayed bridge. Different types of WIM systems such as high-speed WIM or low-speed WIM were also utilized during the experiments for cross-checking and to validate the performance of the developed algorithms.

Vehicle Signal Analysis Using Artificial Neural Networks for a Bridge Weigh-in-Motion System.

Science.gov (United States)

Kim, Sungkon; Lee, Jungwhee; Park, Min-Seok; Jo, Byung-Wan

2009-01-01

This paper describes the procedures for development of signal analysis algorithms using artificial neural networks for Bridge Weigh-in-Motion (B-WIM) systems. Through the analysis procedure, the extraction of information concerning heavy traffic vehicles such as weight, speed, and number of axles from the time domain strain data of the B-WIM system was attempted. As one of the several possible pattern recognition techniques, an Artificial Neural Network (ANN) was employed since it could effectively include dynamic effects and bridge-vehicle interactions. A number of vehicle traveling experiments with sufficient load cases were executed on two different types of bridges, a simply supported pre-stressed concrete girder bridge and a cable-stayed bridge. Different types of WIM systems such as high-speed WIM or low-speed WIM were also utilized during the experiments for cross-checking and to validate the performance of the developed algorithms.

Neural Networks for Modeling and Control of Particle Accelerators

CERN Document Server

Edelen, A.L.; Chase, B.E.; Edstrom, D.; Milton, S.V.; Stabile, P.

2016-01-01

We describe some of the challenges of particle accelerator control, highlight recent advances in neural network techniques, discuss some promising avenues for incorporating neural networks into particle accelerator control systems, and describe a neural network-based control system that is being developed for resonance control of an RF electron gun at the Fermilab Accelerator Science and Technology (FAST) facility, including initial experimental results from a benchmark controller.

Design of a Closed-Loop, Bidirectional Brain Machine Interface System With Energy Efficient Neural Feature Extraction and PID Control.

Science.gov (United States)

Liu, Xilin; Zhang, Milin; Richardson, Andrew G; Lucas, Timothy H; Van der Spiegel, Jan

2017-08-01

This paper presents a bidirectional brain machine interface (BMI) microsystem designed for closed-loop neuroscience research, especially experiments in freely behaving animals. The system-on-chip (SoC) consists of 16-channel neural recording front-ends, neural feature extraction units, 16-channel programmable neural stimulator back-ends, in-channel programmable closed-loop controllers, global analog-digital converters (ADC), and peripheral circuits. The proposed neural feature extraction units includes 1) an ultra low-power neural energy extraction unit enabling a 64-step natural logarithmic domain frequency tuning, and 2) a current-mode action potential (AP) detection unit with time-amplitude window discriminator. A programmable proportional-integral-derivative (PID) controller has been integrated in each channel enabling a various of closed-loop operations. The implemented ADCs include a 10-bit voltage-mode successive approximation register (SAR) ADC for the digitization of the neural feature outputs and/or local field potential (LFP) outputs, and an 8-bit current-mode SAR ADC for the digitization of the action potential outputs. The multi-mode stimulator can be programmed to perform monopolar or bipolar, symmetrical or asymmetrical charge balanced stimulation with a maximum current of 4 mA in an arbitrary channel configuration. The chip has been fabricated in 0.18 μ m CMOS technology, occupying a silicon area of 3.7 mm 2 . The chip dissipates 56 μW/ch on average. General purpose low-power microcontroller with Bluetooth module are integrated in the system to provide wireless link and SoC configuration. Methods, circuit techniques and system topology proposed in this work can be used in a wide range of relevant neurophysiology research, especially closed-loop BMI experiments.

Efficient decoding with steady-state Kalman filter in neural interface systems.

Science.gov (United States)

Malik, Wasim Q; Truccolo, Wilson; Brown, Emery N; Hochberg, Leigh R

2011-02-01

The Kalman filter is commonly used in neural interface systems to decode neural activity and estimate the desired movement kinematics. We analyze a low-complexity Kalman filter implementation in which the filter gain is approximated by its steady-state form, computed offline before real-time decoding commences. We evaluate its performance using human motor cortical spike train data obtained from an intracortical recording array as part of an ongoing pilot clinical trial. We demonstrate that the standard Kalman filter gain converges to within 95% of the steady-state filter gain in 1.5±0.5 s (mean ±s.d.). The difference in the intended movement velocity decoded by the two filters vanishes within 5 s, with a correlation coefficient of 0.99 between the two decoded velocities over the session length. We also find that the steady-state Kalman filter reduces the computational load (algorithm execution time) for decoding the firing rates of 25±3 single units by a factor of 7.0±0.9. We expect that the gain in computational efficiency will be much higher in systems with larger neural ensembles. The steady-state filter can thus provide substantial runtime efficiency at little cost in terms of estimation accuracy. This far more efficient neural decoding approach will facilitate the practical implementation of future large-dimensional, multisignal neural interface systems.

A web-based system for neural network based classification in temporomandibular joint osteoarthritis.

Science.gov (United States)

de Dumast, Priscille; Mirabel, Clément; Cevidanes, Lucia; Ruellas, Antonio; Yatabe, Marilia; Ioshida, Marcos; Ribera, Nina Tubau; Michoud, Loic; Gomes, Liliane; Huang, Chao; Zhu, Hongtu; Muniz, Luciana; Shoukri, Brandon; Paniagua, Beatriz; Styner, Martin; Pieper, Steve; Budin, Francois; Vimort, Jean-Baptiste; Pascal, Laura; Prieto, Juan Carlos

2018-07-01

The purpose of this study is to describe the methodological innovations of a web-based system for storage, integration and computation of biomedical data, using a training imaging dataset to remotely compute a deep neural network classifier of temporomandibular joint osteoarthritis (TMJOA). This study imaging dataset consisted of three-dimensional (3D) surface meshes of mandibular condyles constructed from cone beam computed tomography (CBCT) scans. The training dataset consisted of 259 condyles, 105 from control subjects and 154 from patients with diagnosis of TMJ OA. For the image analysis classification, 34 right and left condyles from 17 patients (39.9 ± 11.7 years), who experienced signs and symptoms of the disease for less than 5 years, were included as the testing dataset. For the integrative statistical model of clinical, biological and imaging markers, the sample consisted of the same 17 test OA subjects and 17 age and sex matched control subjects (39.4 ± 15.4 years), who did not show any sign or symptom of OA. For these 34 subjects, a standardized clinical questionnaire, blood and saliva samples were also collected. The technological methodologies in this study include a deep neural network classifier of 3D condylar morphology (ShapeVariationAnalyzer, SVA), and a flexible web-based system for data storage, computation and integration (DSCI) of high dimensional imaging, clinical, and biological data. The DSCI system trained and tested the neural network, indicating 5 stages of structural degenerative changes in condylar morphology in the TMJ with 91% close agreement between the clinician consensus and the SVA classifier. The DSCI remotely ran with a novel application of a statistical analysis, the Multivariate Functional Shape Data Analysis, that computed high dimensional correlations between shape 3D coordinates, clinical pain levels and levels of biological markers, and then graphically displayed the computation results. The findings of this

A Fully Integrated Wireless Compressed Sensing Neural Signal Acquisition System for Chronic Recording and Brain Machine Interface.

Science.gov (United States)

Liu, Xilin; Zhang, Milin; Xiong, Tao; Richardson, Andrew G; Lucas, Timothy H; Chin, Peter S; Etienne-Cummings, Ralph; Tran, Trac D; Van der Spiegel, Jan

2016-07-18

Reliable, multi-channel neural recording is critical to the neuroscience research and clinical treatment. However, most hardware development of fully integrated, multi-channel wireless neural recorders to-date, is still in the proof-of-concept stage. To be ready for practical use, the trade-offs between performance, power consumption, device size, robustness, and compatibility need to be carefully taken into account. This paper presents an optimized wireless compressed sensing neural signal recording system. The system takes advantages of both custom integrated circuits and universal compatible wireless solutions. The proposed system includes an implantable wireless system-on-chip (SoC) and an external wireless relay. The SoC integrates 16-channel low-noise neural amplifiers, programmable filters and gain stages, a SAR ADC, a real-time compressed sensing module, and a near field wireless power and data transmission link. The external relay integrates a 32 bit low-power microcontroller with Bluetooth 4.0 wireless module, a programming interface, and an inductive charging unit. The SoC achieves high signal recording quality with minimized power consumption, while reducing the risk of infection from through-skin connectors. The external relay maximizes the compatibility and programmability. The proposed compressed sensing module is highly configurable, featuring a SNDR of 9.78 dB with a compression ratio of 8×. The SoC has been fabricated in a 180 nm standard CMOS technology, occupying 2.1 mm × 0.6 mm silicon area. A pre-implantable system has been assembled to demonstrate the proposed paradigm. The developed system has been successfully used for long-term wireless neural recording in freely behaving rhesus monkey.

Distributed Adaptive Neural Control for Stochastic Nonlinear Multiagent Systems.

Science.gov (United States)

Wang, Fang; Chen, Bing; Lin, Chong; Li, Xuehua

2016-11-14

In this paper, a consensus tracking problem of nonlinear multiagent systems is investigated under a directed communication topology. All the followers are modeled by stochastic nonlinear systems in nonstrict feedback form, where nonlinearities and stochastic disturbance terms are totally unknown. Based on the structural characteristic of neural networks (in Lemma 4), a novel distributed adaptive neural control scheme is put forward. The raised control method not only effectively handles unknown nonlinearities in nonstrict feedback systems, but also copes with the interactions among agents and coupling terms. Based on the stochastic Lyapunov functional method, it is indicated that all the signals of the closed-loop system are bounded in probability and all followers' outputs are convergent to a neighborhood of the output of leader. At last, the efficiency of the control method is testified by a numerical example.

Learning in Artificial Neural Systems

Science.gov (United States)

Matheus, Christopher J.; Hohensee, William E.

1987-01-01

This paper presents an overview and analysis of learning in Artificial Neural Systems (ANS's). It begins with a general introduction to neural networks and connectionist approaches to information processing. The basis for learning in ANS's is then described, and compared with classical Machine learning. While similar in some ways, ANS learning deviates from tradition in its dependence on the modification of individual weights to bring about changes in a knowledge representation distributed across connections in a network. This unique form of learning is analyzed from two aspects: the selection of an appropriate network architecture for representing the problem, and the choice of a suitable learning rule capable of reproducing the desired function within the given network. The various network architectures are classified, and then identified with explicit restrictions on the types of functions they are capable of representing. The learning rules, i.e., algorithms that specify how the network weights are modified, are similarly taxonomized, and where possible, the limitations inherent to specific classes of rules are outlined.

Neutron spectrometry and dosimetry by means of Bonner spheres system and artificial neural networks applying robust design of artificial neural networks

Energy Technology Data Exchange (ETDEWEB)

Martinez B, M.R.; Ortiz R, J.M.; Vega C, H.R. [UAZ, Av. Ramon Lopez Velarde No. 801, 98000 Zacatecas (Mexico)

2006-07-01

An Artificial Neural Network has been designed, trained and tested to unfold neutron spectra and simultaneously to calculate equivalent doses. A set of 187 neutron spectra compiled by the International Atomic Energy Agency and 13 equivalent doses were used in the artificial neural network designed, trained and tested. In order to design the neural network was used the robust design of artificial neural networks methodology, which assures that the quality of the neural networks takes into account from the design stage. Unless previous works, here, for first time a group of neural networks were designed and trained to unfold 187 neutron spectra and at the same time to calculate 13 equivalent doses, starting from the count rates coming from the Bonner spheres system by using a systematic and experimental strategy. (Author)

Neutron spectrometry and dosimetry by means of Bonner spheres system and artificial neural networks applying robust design of artificial neural networks

International Nuclear Information System (INIS)

Martinez B, M.R.; Ortiz R, J.M.; Vega C, H.R.

2006-01-01

An Artificial Neural Network has been designed, trained and tested to unfold neutron spectra and simultaneously to calculate equivalent doses. A set of 187 neutron spectra compiled by the International Atomic Energy Agency and 13 equivalent doses were used in the artificial neural network designed, trained and tested. In order to design the neural network was used the robust design of artificial neural networks methodology, which assures that the quality of the neural networks takes into account from the design stage. Unless previous works, here, for first time a group of neural networks were designed and trained to unfold 187 neutron spectra and at the same time to calculate 13 equivalent doses, starting from the count rates coming from the Bonner spheres system by using a systematic and experimental strategy. (Author)

Compact holographic optical neural network system for real-time pattern recognition

Science.gov (United States)

Lu, Taiwei; Mintzer, David T.; Kostrzewski, Andrew A.; Lin, Freddie S.

1996-08-01

One of the important characteristics of artificial neural networks is their capability for massive interconnection and parallel processing. Recently, specialized electronic neural network processors and VLSI neural chips have been introduced in the commercial market. The number of parallel channels they can handle is limited because of the limited parallel interconnections that can be implemented with 1D electronic wires. High-resolution pattern recognition problems can require a large number of neurons for parallel processing of an image. This paper describes a holographic optical neural network (HONN) that is based on high- resolution volume holographic materials and is capable of performing massive 3D parallel interconnection of tens of thousands of neurons. A HONN with more than 16,000 neurons packaged in an attache case has been developed. Rotation- shift-scale-invariant pattern recognition operations have been demonstrated with this system. System parameters such as the signal-to-noise ratio, dynamic range, and processing speed are discussed.

Neural network training by Kalman filtering in process system monitoring

International Nuclear Information System (INIS)

Ciftcioglu, Oe.

1996-03-01

Kalman filtering approach for neural network training is described. Its extended form is used as an adaptive filter in a nonlinear environment of the form a feedforward neural network. Kalman filtering approach generally provides fast training as well as avoiding excessive learning which results in enhanced generalization capability. The network is used in a process monitoring application where the inputs are measurement signals. Since the measurement errors are also modelled in Kalman filter the approach yields accurate training with the implication of accurate neural network model representing the input and output relationships in the application. As the process of concern is a dynamic system, the input source of information to neural network is time dependent so that the training algorithm presents an adaptive form for real-time operation for the monitoring task. (orig.)

A Modular Neural Network Scheme Applied to Fault Diagnosis in Electric Power Systems

Directory of Open Access Journals (Sweden)

Agustín Flores

2014-01-01

Full Text Available This work proposes a new method for fault diagnosis in electric power systems based on neural modules. With this method the diagnosis is performed by assigning a neural module for each type of component comprising the electric power system, whether it is a transmission line, bus or transformer. The neural modules for buses and transformers comprise two diagnostic levels which take into consideration the logic states of switches and relays, both internal and back-up, with the exception of the neural module for transmission lines which also has a third diagnostic level which takes into account the oscillograms of fault voltages and currents as well as the frequency spectrums of these oscillograms, in order to verify if the transmission line had in fact been subjected to a fault. One important advantage of the diagnostic system proposed is that its implementation does not require the use of a network configurator for the system; it does not depend on the size of the power network nor does it require retraining of the neural modules if the power network increases in size, making its application possible to only one component, a specific area, or the whole context of the power system.

Decentralized neural control application to robotics

CERN Document Server

Garcia-Hernandez, Ramon; Sanchez, Edgar N; Alanis, Alma y; Ruz-Hernandez, Jose A

2017-01-01

This book provides a decentralized approach for the identification and control of robotics systems. It also presents recent research in decentralized neural control and includes applications to robotics. Decentralized control is free from difficulties due to complexity in design, debugging, data gathering and storage requirements, making it preferable for interconnected systems. Furthermore, as opposed to the centralized approach, it can be implemented with parallel processors. This approach deals with four decentralized control schemes, which are able to identify the robot dynamics. The training of each neural network is performed on-line using an extended Kalman filter (EKF). The first indirect decentralized control scheme applies the discrete-time block control approach, to formulate a nonlinear sliding manifold. The second direct decentralized neural control scheme is based on the backstepping technique, approximated by a high order neural network. The third control scheme applies a decentralized neural i...

Adaptive Neural Control for a Class of Outputs Time-Delay Nonlinear Systems

Directory of Open Access Journals (Sweden)

Ruliang Wang

2012-01-01

Full Text Available This paper considers an adaptive neural control for a class of outputs time-delay nonlinear systems with perturbed or no. Based on RBF neural networks, the radius basis function (RBF neural networks is employed to estimate the unknown continuous functions. The proposed control guarantees that all closed-loop signals remain bounded. The simulation results demonstrate the effectiveness of the proposed control scheme.

Diagnosis of mechanical pumping system using neural networks and system parameters analysis

International Nuclear Information System (INIS)

Tsai, Tai Ming; Wang, Wei Hui

2009-01-01

Normally, a mechanical pumping system is equipped to monitor some of the important input and output signals which are set to the prescribed values. This paper addressed dealing with these signals to establish the database of input- output relation by using a number of neural network models through learning algorithms. These signals encompass normal and abnormal running conditions. The abnormal running conditions were artificially generated. Meanwhile, for the purpose of setting up an on-line diagnosis network, the learning speed and accuracy of three kinds of networks, viz., the backpropagation (BPN), radial basis function (RBF) and adaptive linear (ADALINE) neural networks have been compared and assessed. The assessment criteria of the networks are compared with the correlation result matrix in terms of the neuron vectors. Both BPN and RBF are judged by the maximum vector based on the post-regression analysis, and the ADALINE is judged by the minimum vector based on the least mean square error analysis. By ignoring the neural network training time, it has been shown that if the mechanical diagnosis system is tackled off-line, the RBF method is suggested. However, for on-line diagnosis, the BPN method is recommended

Diagnosis of mechanical pumping system using neural networks and system parameters analysis

Energy Technology Data Exchange (ETDEWEB)

Tsai, Tai Ming; Wang, Wei Hui [National Taiwan Ocean University, Keelung (China)

2009-01-15

Normally, a mechanical pumping system is equipped to monitor some of the important input and output signals which are set to the prescribed values. This paper addressed dealing with these signals to establish the database of input- output relation by using a number of neural network models through learning algorithms. These signals encompass normal and abnormal running conditions. The abnormal running conditions were artificially generated. Meanwhile, for the purpose of setting up an on-line diagnosis network, the learning speed and accuracy of three kinds of networks, viz., the backpropagation (BPN), radial basis function (RBF) and adaptive linear (ADALINE) neural networks have been compared and assessed. The assessment criteria of the networks are compared with the correlation result matrix in terms of the neuron vectors. Both BPN and RBF are judged by the maximum vector based on the post-regression analysis, and the ADALINE is judged by the minimum vector based on the least mean square error analysis. By ignoring the neural network training time, it has been shown that if the mechanical diagnosis system is tackled off-line, the RBF method is suggested. However, for on-line diagnosis, the BPN method is recommended

Neural Networks and Micromechanics

Science.gov (United States)

Kussul, Ernst; Baidyk, Tatiana; Wunsch, Donald C.

The title of the book, "Neural Networks and Micromechanics," seems artificial. However, the scientific and technological developments in recent decades demonstrate a very close connection between the two different areas of neural networks and micromechanics. The purpose of this book is to demonstrate this connection. Some artificial intelligence (AI) methods, including neural networks, could be used to improve automation system performance in manufacturing processes. However, the implementation of these AI methods within industry is rather slow because of the high cost of conducting experiments using conventional manufacturing and AI systems. To lower the cost, we have developed special micromechanical equipment that is similar to conventional mechanical equipment but of much smaller size and therefore of lower cost. This equipment could be used to evaluate different AI methods in an easy and inexpensive way. The proved methods could be transferred to industry through appropriate scaling. In this book, we describe the prototypes of low cost microequipment for manufacturing processes and the implementation of some AI methods to increase precision, such as computer vision systems based on neural networks for microdevice assembly and genetic algorithms for microequipment characterization and the increase of microequipment precision.

Neural Network Target Identification System for False Alarm Reduction

Science.gov (United States)

Ye, David; Edens, Weston; Lu, Thomas T.; Chao, Tien-Hsin

2009-01-01

A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feed forward back propagation neural network (NN) is then trained to classify each feature vector and remove false positives. This paper discusses the test of the system performance and parameter optimizations process which adapts the system to various targets and datasets. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar image dataset.

A battery-free multichannel digital neural/EMG telemetry system for flying insects.

Science.gov (United States)

Thomas, Stewart J; Harrison, Reid R; Leonardo, Anthony; Reynolds, Matthew S

2012-10-01

This paper presents a digital neural/EMG telemetry system small enough and lightweight enough to permit recording from insects in flight. It has a measured flight package mass of only 38 mg. This system includes a single-chip telemetry integrated circuit (IC) employing RF power harvesting for battery-free operation, with communication via modulated backscatter in the UHF (902-928 MHz) band. An on-chip 11-bit ADC digitizes 10 neural channels with a sampling rate of 26.1 kSps and 4 EMG channels at 1.63 kSps, and telemeters this data wirelessly to a base station. The companion base station transceiver includes an RF transmitter of +36 dBm (4 W) output power to wirelessly power the telemetry IC, and a digital receiver with a sensitivity of -70 dBm for 10⁻⁵ BER at 5.0 Mbps to receive the data stream from the telemetry IC. The telemetry chip was fabricated in a commercial 0.35 μ m 4M1P (4 metal, 1 poly) CMOS process. The die measures 2.36 × 1.88 mm, is 250 μm thick, and is wire bonded into a flex circuit assembly measuring 4.6 × 6.8 mm.

Neural network expert system for X-ray analysis of welded joints

Science.gov (United States)

Kozlov, V. V.; Lapik, N. V.; Popova, N. V.

2018-03-01

The use of intelligent technologies for the automated analysis of product quality is one of the main trends in modern machine building. At the same time, rapid development in various spheres of human activity is experienced by methods associated with the use of artificial neural networks, as the basis for building automated intelligent diagnostic systems. Technologies of machine vision allow one to effectively detect the presence of certain regularities in the analyzed designation, including defects of welded joints according to radiography data.

Real-time camera-based face detection using a modified LAMSTAR neural network system

Science.gov (United States)

Girado, Javier I.; Sandin, Daniel J.; DeFanti, Thomas A.; Wolf, Laura K.

2003-03-01

This paper describes a cost-effective, real-time (640x480 at 30Hz) upright frontal face detector as part of an ongoing project to develop a video-based, tetherless 3D head position and orientation tracking system. The work is specifically targeted for auto-stereoscopic displays and projection-based virtual reality systems. The proposed face detector is based on a modified LAMSTAR neural network system. At the input stage, after achieving image normalization and equalization, a sub-window analyzes facial features using a neural network. The sub-window is segmented, and each part is fed to a neural network layer consisting of a Kohonen Self-Organizing Map (SOM). The output of the SOM neural networks are interconnected and related by correlation-links, and can hence determine the presence of a face with enough redundancy to provide a high detection rate. To avoid tracking multiple faces simultaneously, the system is initially trained to track only the face centered in a box superimposed on the display. The system is also rotationally and size invariant to a certain degree.

neural control system

International Nuclear Information System (INIS)

Elshazly, A.A.E.

2002-01-01

Automatic power stabilization control is the desired objective for any reactor operation , especially, nuclear power plants. A major problem in this area is inevitable gap between a real plant ant the theory of conventional analysis and the synthesis of linear time invariant systems. in particular, the trajectory tracking control of a nonlinear plant is a class of problems in which the classical linear transfer function methods break down because no transfer function can represent the system over the entire operating region . there is a considerable amount of research on the model-inverse approach using feedback linearization technique. however, this method requires a prices plant model to implement the exact linearizing feedback, for nuclear reactor systems, this approach is not an easy task because of the uncertainty in the plant parameters and un-measurable state variables . therefore, artificial neural network (ANN) is used either in self-tuning control or in improving the conventional rule-based exper system.the main objective of this thesis is to suggest an ANN, based self-learning controller structure . this method is capable of on-line reinforcement learning and control for a nuclear reactor with a totally unknown dynamics model. previously, researches are based on back- propagation algorithm . back -propagation (BP), fast back -propagation (FBP), and levenberg-marquardt (LM), algorithms are discussed and compared for reinforcement learning. it is found that, LM algorithm is quite superior

Direct process estimation from tomographic data using artificial neural systems

Science.gov (United States)

Mohamad-Saleh, Junita; Hoyle, Brian S.; Podd, Frank J.; Spink, D. M.

2001-07-01

The paper deals with the goal of component fraction estimation in multicomponent flows, a critical measurement in many processes. Electrical capacitance tomography (ECT) is a well-researched sensing technique for this task, due to its low-cost, non-intrusion, and fast response. However, typical systems, which include practicable real-time reconstruction algorithms, give inaccurate results, and existing approaches to direct component fraction measurement are flow-regime dependent. In the investigation described, an artificial neural network approach is used to directly estimate the component fractions in gas-oil, gas-water, and gas-oil-water flows from ECT measurements. A 2D finite- element electric field model of a 12-electrode ECT sensor is used to simulate ECT measurements of various flow conditions. The raw measurements are reduced to a mutually independent set using principal components analysis and used with their corresponding component fractions to train multilayer feed-forward neural networks (MLFFNNs). The trained MLFFNNs are tested with patterns consisting of unlearned ECT simulated and plant measurements. Results included in the paper have a mean absolute error of less than 1% for the estimation of various multicomponent fractions of the permittivity distribution. They are also shown to give improved component fraction estimation compared to a well known direct ECT method.

Stochastic Oscillation in Self-Organized Critical States of Small Systems: Sensitive Resting State in Neural Systems.

Science.gov (United States)

Wang, Sheng-Jun; Ouyang, Guang; Guang, Jing; Zhang, Mingsha; Wong, K Y Michael; Zhou, Changsong

2016-01-08

Self-organized critical states (SOCs) and stochastic oscillations (SOs) are simultaneously observed in neural systems, which appears to be theoretically contradictory since SOCs are characterized by scale-free avalanche sizes but oscillations indicate typical scales. Here, we show that SOs can emerge in SOCs of small size systems due to temporal correlation between large avalanches at the finite-size cutoff, resulting from the accumulation-release process in SOCs. In contrast, the critical branching process without accumulation-release dynamics cannot exhibit oscillations. The reconciliation of SOCs and SOs is demonstrated both in the sandpile model and robustly in biologically plausible neuronal networks. The oscillations can be suppressed if external inputs eliminate the prominent slow accumulation process, providing a potential explanation of the widely studied Berger effect or event-related desynchronization in neural response. The features of neural oscillations and suppression are confirmed during task processing in monkey eye-movement experiments. Our results suggest that finite-size, columnar neural circuits may play an important role in generating neural oscillations around the critical states, potentially enabling functional advantages of both SOCs and oscillations for sensitive response to transient stimuli.

A Fault Diagnosis Approach for the Hydraulic System by Artificial Neural Networks

OpenAIRE

Xiangyu He; Shanghong He

2014-01-01

Based on artificial neural networks, a fault diagnosis approach for the hydraulic system was proposed in this paper. Normal state samples were used as the training data to develop a dynamic general regression neural network (DGRNN) model. The trained DGRNN model then served as the fault determinant to diagnose test faults and the work condition of the hydraulic system was identified. Several typical faults of the hydraulic system were used to verify the fault diagnosis approach. Experiment re...

Neural System Prediction and Identification Challenge

Directory of Open Access Journals (Sweden)

Ioannis eVlachos

2013-12-01

Full Text Available Can we infer the function of a biological neural network (BNN if we know the connectivity and activity of all its constituent neurons? This question is at the core of neuroscience and, accordingly, various methods have been developed to record the activity and connectivity of as many neurons as possible. Surprisingly, there is no theoretical or computational demonstration that neuronal activity and connectivity are indeed sufficient to infer the function of a BNN. Therefore, we pose the Neural Systems Identification and Prediction Challenge (nuSPIC. We provide the connectivity and activity of all neurons and invite participants (i to infer the functions implemented (hard-wired in spiking neural networks (SNNs by stimulating and recording the activity of neurons and, (ii to implement predefined mathematical/biological functions using SNNs. The nuSPICs can be accessed via a web-interface to the NEST simulator and the user is not required to know any specific programming language. Furthermore, the nuSPICs can be used as a teaching tool. Finally, nuSPICs use the crowd-sourcing model to address scientific issues. With this computational approach we aim to identify which functions can be inferred by systematic recordings of neuronal activity and connectivity. In addition, nuSPICs will help the design and application of new experimental paradigms based on the structure of the SNN and the presumed function which is to be discovered.

Neural system prediction and identification challenge.

Science.gov (United States)

Vlachos, Ioannis; Zaytsev, Yury V; Spreizer, Sebastian; Aertsen, Ad; Kumar, Arvind

2013-01-01

Can we infer the function of a biological neural network (BNN) if we know the connectivity and activity of all its constituent neurons?This question is at the core of neuroscience and, accordingly, various methods have been developed to record the activity and connectivity of as many neurons as possible. Surprisingly, there is no theoretical or computational demonstration that neuronal activity and connectivity are indeed sufficient to infer the function of a BNN. Therefore, we pose the Neural Systems Identification and Prediction Challenge (nuSPIC). We provide the connectivity and activity of all neurons and invite participants (1) to infer the functions implemented (hard-wired) in spiking neural networks (SNNs) by stimulating and recording the activity of neurons and, (2) to implement predefined mathematical/biological functions using SNNs. The nuSPICs can be accessed via a web-interface to the NEST simulator and the user is not required to know any specific programming language. Furthermore, the nuSPICs can be used as a teaching tool. Finally, nuSPICs use the crowd-sourcing model to address scientific issues. With this computational approach we aim to identify which functions can be inferred by systematic recordings of neuronal activity and connectivity. In addition, nuSPICs will help the design and application of new experimental paradigms based on the structure of the SNN and the presumed function which is to be discovered.

Neural networks for combined control of capacitor banks and voltage regulators in distribution systems

Energy Technology Data Exchange (ETDEWEB)

Gu, Z.; Rizy, D.T.

1996-02-01

A neural network for controlling shunt capacitor banks and feeder voltage regulators in electric distribution systems is presented. The objective of the neural controller is to minimize total I{sup 2}R losses and maintain all bus voltages within standard limits. The performance of the neural network for different input selections and training data is discussed and compared. Two different input selections are tried, one using the previous control states of the capacitors and regulator along with measured line flows and voltage which is equivalent to having feedback and the other with measured line flows and voltage without previous control settings. The results indicate that the neural net controller with feedback can outperform the one without. Also, proper selection of a training data set that adequately covers the operating space of the distribution system is important for achieving satisfactory performance with the neural controller. The neural controller is tested on a radially configured distribution system with 30 buses, 5 switchable capacitor banks an d one nine tap line regulator to demonstrate the performance characteristics associated with these principles. Monte Carlo simulations show that a carefully designed and relatively compact neural network with a small but carefully developed training set can perform quite well under slight and extreme variation of loading conditions.

A 3D human neural cell culture system for modeling Alzheimer’s disease

Science.gov (United States)

Kim, Young Hye; Choi, Se Hoon; D’Avanzo, Carla; Hebisch, Matthias; Sliwinski, Christopher; Bylykbashi, Enjana; Washicosky, Kevin J.; Klee, Justin B.; Brüstle, Oliver; Tanzi, Rudolph E.; Kim, Doo Yeon

2015-01-01

Stem cell technologies have facilitated the development of human cellular disease models that can be used to study pathogenesis and test therapeutic candidates. These models hold promise for complex neurological diseases such as Alzheimer’s disease (AD) because existing animal models have been unable to fully recapitulate all aspects of pathology. We recently reported the characterization of a novel three-dimensional (3D) culture system that exhibits key events in AD pathogenesis, including extracellular aggregation of β-amyloid and accumulation of hyperphosphorylated tau. Here we provide instructions for the generation and analysis of 3D human neural cell cultures, including the production of genetically modified human neural progenitor cells (hNPCs) with familial AD mutations, the differentiation of the hNPCs in a 3D matrix, and the analysis of AD pathogenesis. The 3D culture generation takes 1–2 days. The aggregation of β-amyloid is observed after 6-weeks of differentiation followed by robust tau pathology after 10–14 weeks. PMID:26068894

Neural Crossroads in the Hematopoietic Stem Cell Niche.

Science.gov (United States)

Agarwala, Sobhika; Tamplin, Owen J

2018-05-29

The hematopoietic stem cell (HSC) niche supports steady-state hematopoiesis and responds to changing needs during stress and disease. The nervous system is an important regulator of the niche, and its influence is established early in development when stem cells are specified. Most research has focused on direct innervation of the niche, however recent findings show there are different modes of neural control, including globally by the central nervous system (CNS) and hormone release, locally by neural crest-derived mesenchymal stem cells, and intrinsically by hematopoietic cells that express neural receptors and neurotransmitters. Dysregulation between neural and hematopoietic systems can contribute to disease, however new therapeutic opportunities may be found among neuroregulator drugs repurposed to support hematopoiesis. Copyright © 2018 Elsevier Ltd. All rights reserved.

Coupling Strength and System Size Induce Firing Activity of Globally Coupled Neural Network

International Nuclear Information System (INIS)

Wei Duqu; Luo Xiaoshu; Zou Yanli

2008-01-01

We investigate how firing activity of globally coupled neural network depends on the coupling strength C and system size N. Network elements are described by space-clamped FitzHugh-Nagumo (SCFHN) neurons with the values of parameters at which no firing activity occurs. It is found that for a given appropriate coupling strength, there is an intermediate range of system size where the firing activity of globally coupled SCFHN neural network is induced and enhanced. On the other hand, for a given intermediate system size level, there exists an optimal value of coupling strength such that the intensity of firing activity reaches its maximum. These phenomena imply that the coupling strength and system size play a vital role in firing activity of neural network

Statistical Physics of Neural Systems with Nonadditive Dendritic Coupling

Directory of Open Access Journals (Sweden)

David Breuer

2014-03-01

Full Text Available How neurons process their inputs crucially determines the dynamics of biological and artificial neural networks. In such neural and neural-like systems, synaptic input is typically considered to be merely transmitted linearly or sublinearly by the dendritic compartments. Yet, single-neuron experiments report pronounced supralinear dendritic summation of sufficiently synchronous and spatially close-by inputs. Here, we provide a statistical physics approach to study the impact of such nonadditive dendritic processing on single-neuron responses and the performance of associative-memory tasks in artificial neural networks. First, we compute the effect of random input to a neuron incorporating nonlinear dendrites. This approach is independent of the details of the neuronal dynamics. Second, we use those results to study the impact of dendritic nonlinearities on the network dynamics in a paradigmatic model for associative memory, both numerically and analytically. We find that dendritic nonlinearities maintain network convergence and increase the robustness of memory performance against noise. Interestingly, an intermediate number of dendritic branches is optimal for memory functionality.

Permutation invariant polynomial neural network approach to fitting potential energy surfaces. II. Four-atom systems

Energy Technology Data Exchange (ETDEWEB)

Li, Jun; Jiang, Bin; Guo, Hua, E-mail: hguo@unm.edu [Department of Chemistry and Chemical Biology, University of New Mexico, Albuquerque, New Mexico 87131 (United States)

2013-11-28

A rigorous, general, and simple method to fit global and permutation invariant potential energy surfaces (PESs) using neural networks (NNs) is discussed. This so-called permutation invariant polynomial neural network (PIP-NN) method imposes permutation symmetry by using in its input a set of symmetry functions based on PIPs. For systems with more than three atoms, it is shown that the number of symmetry functions in the input vector needs to be larger than the number of internal coordinates in order to include both the primary and secondary invariant polynomials. This PIP-NN method is successfully demonstrated in three atom-triatomic reactive systems, resulting in full-dimensional global PESs with average errors on the order of meV. These PESs are used in full-dimensional quantum dynamical calculations.

Adaptive neural networks control for camera stabilization with active suspension system

Directory of Open Access Journals (Sweden)

Feng Zhao

2015-08-01

Full Text Available The camera always suffers from image instability on the moving vehicle due to unintentional vibrations caused by road roughness. This article presents an adaptive neural network approach mixed with linear quadratic regulator control for a quarter-car active suspension system to stabilize the image captured area of the camera. An active suspension system provides extra force through the actuator which allows it to suppress vertical vibration of sprung mass. First, to deal with the road disturbance and the system uncertainties, radial basis function neural network is proposed to construct the map between the state error and the compensation component, which can correct the optimal state-feedback control law. The weights matrix of radial basis function neural network is adaptively tuned online. Then, the closed-loop stability and asymptotic convergence performance is guaranteed by Lyapunov analysis. Finally, the simulation results demonstrate that the proposed controller effectively suppresses the vibration of the camera and enhances the stabilization of the entire camera, where different excitations are considered to validate the system performance.

Neural systems for preparatory control of imitation.

Science.gov (United States)

Cross, Katy A; Iacoboni, Marco

2014-01-01

Humans have an automatic tendency to imitate others. Previous studies on how we control these tendencies have focused on reactive mechanisms, where inhibition of imitation is implemented after seeing an action. This work suggests that reactive control of imitation draws on at least partially specialized mechanisms. Here, we examine preparatory imitation control, where advance information allows control processes to be employed before an action is observed. Drawing on dual route models from the spatial compatibility literature, we compare control processes using biological and non-biological stimuli to determine whether preparatory imitation control recruits specialized neural systems that are similar to those observed in reactive imitation control. Results indicate that preparatory control involves anterior prefrontal, dorsolateral prefrontal, posterior parietal and early visual cortices regardless of whether automatic responses are evoked by biological (imitative) or non-biological stimuli. These results indicate both that preparatory control of imitation uses general mechanisms, and that preparatory control of imitation draws on different neural systems from reactive imitation control. Based on the regions involved, we hypothesize that preparatory control is implemented through top-down attentional biasing of visual processing.

A neural network approach to the study of dynamics and structure of molecular systems

International Nuclear Information System (INIS)

Getino, C.; Sumpter, B.G.; Noid, D.W.

1994-01-01

Neural networks are used to study intramolecular energy flow in molecular systems (tetratomics to macromolecules), developing new techniques for efficient analysis of data obtained from molecular-dynamics and quantum mechanics calculations. Neural networks can map phase space points to intramolecular vibrational energies along a classical trajectory (example of complicated coordinate transformation), producing reasonably accurate values for any region of the multidimensional phase space of a tetratomic molecule. Neural network energy flow predictions are found to significantly enhance the molecular-dynamics method to longer time-scales and extensive averaging of trajectories for macromolecular systems. Pattern recognition abilities of neural networks can be used to discern phase space features. Neural networks can also expand model calculations by interpolation of costly quantum mechanical ab initio data, used to develop semiempirical potential energy functions

Optimizing Markovian modeling of chaotic systems with recurrent neural networks

International Nuclear Information System (INIS)

Cechin, Adelmo L.; Pechmann, Denise R.; Oliveira, Luiz P.L. de

2008-01-01

In this paper, we propose a methodology for optimizing the modeling of an one-dimensional chaotic time series with a Markov Chain. The model is extracted from a recurrent neural network trained for the attractor reconstructed from the data set. Each state of the obtained Markov Chain is a region of the reconstructed state space where the dynamics is approximated by a specific piecewise linear map, obtained from the network. The Markov Chain represents the dynamics of the time series in its statistical essence. An application to a time series resulted from Lorenz system is included

Evolutionary Computation and Its Applications in Neural and Fuzzy Systems

Directory of Open Access Journals (Sweden)

Biaobiao Zhang

2011-01-01

Full Text Available Neural networks and fuzzy systems are two soft-computing paradigms for system modelling. Adapting a neural or fuzzy system requires to solve two optimization problems: structural optimization and parametric optimization. Structural optimization is a discrete optimization problem which is very hard to solve using conventional optimization techniques. Parametric optimization can be solved using conventional optimization techniques, but the solution may be easily trapped at a bad local optimum. Evolutionary computation is a general-purpose stochastic global optimization approach under the universally accepted neo-Darwinian paradigm, which is a combination of the classical Darwinian evolutionary theory, the selectionism of Weismann, and the genetics of Mendel. Evolutionary algorithms are a major approach to adaptation and optimization. In this paper, we first introduce evolutionary algorithms with emphasis on genetic algorithms and evolutionary strategies. Other evolutionary algorithms such as genetic programming, evolutionary programming, particle swarm optimization, immune algorithm, and ant colony optimization are also described. Some topics pertaining to evolutionary algorithms are also discussed, and a comparison between evolutionary algorithms and simulated annealing is made. Finally, the application of EAs to the learning of neural networks as well as to the structural and parametric adaptations of fuzzy systems is also detailed.

Color Image Encryption Algorithm Based on TD-ERCS System and Wavelet Neural Network

Directory of Open Access Journals (Sweden)

Kun Zhang

2015-01-01

Full Text Available In order to solve the security problem of transmission image across public networks, a new image encryption algorithm based on TD-ERCS system and wavelet neural network is proposed in this paper. According to the permutation process and the binary XOR operation from the chaotic series by producing TD-ERCS system and wavelet neural network, it can achieve image encryption. This encryption algorithm is a reversible algorithm, and it can achieve original image in the rule inverse process of encryption algorithm. Finally, through computer simulation, the experiment results show that the new chaotic encryption algorithm based on TD-ERCS system and wavelet neural network is valid and has higher security.

Global neural dynamic surface tracking control of strict-feedback systems with application to hypersonic flight vehicle.

Science.gov (United States)

Xu, Bin; Yang, Chenguang; Pan, Yongping

2015-10-01

This paper studies both indirect and direct global neural control of strict-feedback systems in the presence of unknown dynamics, using the dynamic surface control (DSC) technique in a novel manner. A new switching mechanism is designed to combine an adaptive neural controller in the neural approximation domain, together with the robust controller that pulls the transient states back into the neural approximation domain from the outside. In comparison with the conventional control techniques, which could only achieve semiglobally uniformly ultimately bounded stability, the proposed control scheme guarantees all the signals in the closed-loop system are globally uniformly ultimately bounded, such that the conventional constraints on initial conditions of the neural control system can be relaxed. The simulation studies of hypersonic flight vehicle (HFV) are performed to demonstrate the effectiveness of the proposed global neural DSC design.

ANT Advanced Neural Tool

Energy Technology Data Exchange (ETDEWEB)

Labrador, I.; Carrasco, R.; Martinez, L.

1996-07-01

This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs.

ANT Advanced Neural Tool

International Nuclear Information System (INIS)

Labrador, I.; Carrasco, R.; Martinez, L.

1996-01-01

This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs

Biological neural networks as model systems for designing future parallel processing computers

Science.gov (United States)

Ross, Muriel D.

1991-01-01

One of the more interesting debates of the present day centers on whether human intelligence can be simulated by computer. The author works under the premise that neurons individually are not smart at all. Rather, they are physical units which are impinged upon continuously by other matter that influences the direction of voltage shifts across the units membranes. It is only the action of a great many neurons, billions in the case of the human nervous system, that intelligent behavior emerges. What is required to understand even the simplest neural system is painstaking analysis, bit by bit, of the architecture and the physiological functioning of its various parts. The biological neural network studied, the vestibular utricular and saccular maculas of the inner ear, are among the most simple of the mammalian neural networks to understand and model. While there is still a long way to go to understand even this most simple neural network in sufficient detail for extrapolation to computers and robots, a start was made. Moreover, the insights obtained and the technologies developed help advance the understanding of the more complex neural networks that underlie human intelligence.

Robust adaptive fuzzy neural tracking control for a class of unknown ...

Indian Academy of Sciences (India)

In this paper, an adaptive fuzzy neural controller (AFNC) for a class of unknown chaotic systems is proposed. The proposed AFNC is comprised of a fuzzy neural controller and a robust controller. The fuzzy neural controller including a fuzzy neural network identifier (FNNI) is the principal controller. The FNNI is used for ...

International Conference on Artificial Neural Networks (ICANN)

CERN Document Server

Mladenov, Valeri; Kasabov, Nikola; Artificial Neural Networks : Methods and Applications in Bio-/Neuroinformatics

2015-01-01

The book reports on the latest theories on artificial neural networks, with a special emphasis on bio-neuroinformatics methods. It includes twenty-three papers selected from among the best contributions on bio-neuroinformatics-related issues, which were presented at the International Conference on Artificial Neural Networks, held in Sofia, Bulgaria, on September 10-13, 2013 (ICANN 2013). The book covers a broad range of topics concerning the theory and applications of artificial neural networks, including recurrent neural networks, super-Turing computation and reservoir computing, double-layer vector perceptrons, nonnegative matrix factorization, bio-inspired models of cell communities, Gestalt laws, embodied theory of language understanding, saccadic gaze shifts and memory formation, and new training algorithms for Deep Boltzmann Machines, as well as dynamic neural networks and kernel machines. It also reports on new approaches to reinforcement learning, optimal control of discrete time-delay systems, new al...

Identification of complex systems by artificial neural networks. Applications to mechanical frictions

International Nuclear Information System (INIS)

Dominguez, Manuel

1998-01-01

In the frame of complex systems modelization, we describe in this report the contribution of neural networks to mechanical friction modelization. This thesis is divided in three parts, each one corresponding to every stage of the realized work. The first part takes stock of the properties of neural networks by replacing them in the statistic frame of learning theory (particularly: non-linear and non-parametric regression models) and by showing the existing links with other more 'classic' techniques from automatics. We show then how identification models can be integrated in the neural networks description as a larger nonlinear model class. A methodology of neural networks use have been developed. We focused on validation techniques using correlation functions for non-linear systems, and on the use of regularization methods. The second part deals with the problematic of friction in mechanical systems. Particularly, we present the main current identified physical phenomena, which are integrated in advanced friction modelization. Characterization of these phenomena allows us to state a priori knowledge to be used in the identification stage. We expose some of the most well-known friction models: Dahl's model, Reset Integrator and Canuda's dynamical model, which are then used in simulation studies. The last part links the former one by illustrating a real-world application: an electric jack from SFIM-Industries, used in the Very Large Telescope (VLT) control scheme. This part begins with physical system presentation. The results are compared with more 'classic' methods. We finish using neural networks compensation scheme in closed-loop control. (author) [fr

Application of neural networks to connectional expert system for identification of transients in nuclear power plants

International Nuclear Information System (INIS)

Cheon, Se Woo; Kim, Wan Joo; Chang, Soon Heung; Roh, Myung Sub

1991-01-01

The Back-propagation Neural Network (BPN) algorithm is applied to connectionist expert system for the identification of BWR transients. Several powerful features of neural network-based expert systems over traditional rule-based expert systems are described. The general mapping capability of the neural networks enables to identify transients easily. A number of case studies were performed with emphasis on the applicability of the neural networks to the diagnostic domain. It is revealed that the BPN algorithm can identify transients properly, even when incomplete or untrained symptoms are given. It is also shown that multiple transients are easily identified

The ctenophore genome and the evolutionary origins of neural systems

NARCIS (Netherlands)

Moroz, Leonid L.; Kocot, Kevin M.; Citarella, Mathew R.; Dosung, Sohn; Norekian, Tigran P.; Povolotskaya, Inna S.; Grigorenko, Anastasia P.; Dailey, Christopher; Berezikov, Eugene; Buckley, Katherine M.; Ptitsyn, Andrey; Reshetov, Denis; Mukherjee, Krishanu; Moroz, Tatiana P.; Bobkova, Yelena; Yu, Fahong; Kapitonov, Vladimir V.; Jurka, Jerzy; Bobkov, Yuri V.; Swore, Joshua J.; Girardo, David O.; Fodor, Alexander; Gusev, Fedor; Sanford, Rachel; Bruders, Rebecca; Kittler, Ellen; Mills, Claudia E.; Rast, Jonathan P.; Derelle, Romain; Solovyev, Victor V.; Kondrashov, Fyodor A.; Swalla, Billie J.; Sweedler, Jonathan V.; Rogaev, Evgeny I.; Halanych, Kenneth M.; Kohn, Andrea B.

2014-01-01

The origins of neural systems remain unresolved. In contrast to other basal metazoans, ctenophores (comb jellies) have both complex nervous and mesoderm-derived muscular systems. These holoplanktonic predators also have sophisticated ciliated locomotion, behaviour and distinct development. Here we

Complex-Valued Neural Networks

CERN Document Server

Hirose, Akira

2012-01-01

This book is the second enlarged and revised edition of the first successful monograph on complex-valued neural networks (CVNNs) published in 2006, which lends itself to graduate and undergraduate courses in electrical engineering, informatics, control engineering, mechanics, robotics, bioengineering, and other relevant fields. In the second edition the recent trends in CVNNs research are included, resulting in e.g. almost a doubled number of references. The parametron invented in 1954 is also referred to with discussion on analogy and disparity. Also various additional arguments on the advantages of the complex-valued neural networks enhancing the difference to real-valued neural networks are given in various sections. The book is useful for those beginning their studies, for instance, in adaptive signal processing for highly functional sensing and imaging, control in unknown and changing environment, robotics inspired by human neural systems, and brain-like information processing, as well as interdisciplina...

Differences between otolith- and semicircular canal-activated neural circuitry in the vestibular system.

Science.gov (United States)

Uchino, Yoshio; Kushiro, Keisuke

2011-12-01

In the last two decades, we have focused on establishing a reliable technique for focal stimulation of vestibular receptors to evaluate neural connectivity. Here, we summarize the vestibular-related neuronal circuits for the vestibulo-ocular reflex, vestibulocollic reflex, and vestibulospinal reflex arcs. The focal stimulating technique also uncovered some hidden neural mechanisms. In the otolith system, we identified two hidden neural mechanisms that enhance otolith receptor sensitivity. The first is commissural inhibition, which boosts sensitivity by incorporating inputs from bilateral otolith receptors, the existence of which was in contradiction to the classical understanding of the otolith system but was observed in the utricular system. The second mechanism, cross-striolar inhibition, intensifies the sensitivity of inputs from both sides of receptive cells across the striola in a single otolith sensor. This was an entirely novel finding and is typically observed in the saccular system. We discuss the possible functional meaning of commissural and cross-striolar inhibition. Finally, our focal stimulating technique was applied to elucidate the different constructions of axonal projections from each vestibular receptor to the spinal cord. We also discuss the possible function of the unique neural connectivity observed in each vestibular receptor system. Copyright © 2011 Elsevier Ireland Ltd and the Japan Neuroscience Society. All rights reserved.

A novel neural-wavelet approach for process diagnostics and complex system modeling

Science.gov (United States)

Gao, Rong

Neural networks have been effective in several engineering applications because of their learning abilities and robustness. However certain shortcomings, such as slow convergence and local minima, are always associated with neural networks, especially neural networks applied to highly nonlinear and non-stationary problems. These problems can be effectively alleviated by integrating a new powerful tool, wavelets, into conventional neural networks. The multi-resolution analysis and feature localization capabilities of the wavelet transform offer neural networks new possibilities for learning. A neural wavelet network approach developed in this thesis enjoys fast convergence rate with little possibility to be caught at a local minimum. It combines the localization properties of wavelets with the learning abilities of neural networks. Two different testbeds are used for testing the efficiency of the new approach. The first is magnetic flowmeter-based process diagnostics: here we extend previous work, which has demonstrated that wavelet groups contain process information, to more general process diagnostics. A loop at Applied Intelligent Systems Lab (AISL) is used for collecting and analyzing data through the neural-wavelet approach. The research is important for thermal-hydraulic processes in nuclear and other engineering fields. The neural-wavelet approach developed is also tested with data from the electric power grid. More specifically, the neural-wavelet approach is used for performing short-term and mid-term prediction of power load demand. In addition, the feasibility of determining the type of load using the proposed neural wavelet approach is also examined. The notion of cross scale product has been developed as an expedient yet reliable discriminator of loads. Theoretical issues involved in the integration of wavelets and neural networks are discussed and future work outlined.

Robust adaptive controller design for a class of uncertain nonlinear systems using online T-S fuzzy-neural modeling approach.

Science.gov (United States)

Chien, Yi-Hsing; Wang, Wei-Yen; Leu, Yih-Guang; Lee, Tsu-Tian

2011-04-01

This paper proposes a novel method of online modeling and control via the Takagi-Sugeno (T-S) fuzzy-neural model for a class of uncertain nonlinear systems with some kinds of outputs. Although studies about adaptive T-S fuzzy-neural controllers have been made on some nonaffine nonlinear systems, little is known about the more complicated uncertain nonlinear systems. Because the nonlinear functions of the systems are uncertain, traditional T-S fuzzy control methods can model and control them only with great difficulty, if at all. Instead of modeling these uncertain functions directly, we propose that a T-S fuzzy-neural model approximates a so-called virtual linearized system (VLS) of the system, which includes modeling errors and external disturbances. We also propose an online identification algorithm for the VLS and put significant emphasis on robust tracking controller design using an adaptive scheme for the uncertain systems. Moreover, the stability of the closed-loop systems is proven by using strictly positive real Lyapunov theory. The proposed overall scheme guarantees that the outputs of the closed-loop systems asymptotically track the desired output trajectories. To illustrate the effectiveness and applicability of the proposed method, simulation results are given in this paper.

Podocalyxin Is a Novel Polysialylated Neural Adhesion Protein with Multiple Roles in Neural Development and Synapse Formation

Science.gov (United States)

Vitureira, Nathalia; Andrés, Rosa; Pérez-Martínez, Esther; Martínez, Albert; Bribián, Ana; Blasi, Juan; Chelliah, Shierley; López-Doménech, Guillermo; De Castro, Fernando; Burgaya, Ferran; McNagny, Kelly; Soriano, Eduardo

2010-01-01

Neural development and plasticity are regulated by neural adhesion proteins, including the polysialylated form of NCAM (PSA-NCAM). Podocalyxin (PC) is a renal PSA-containing protein that has been reported to function as an anti-adhesin in kidney podocytes. Here we show that PC is widely expressed in neurons during neural development. Neural PC interacts with the ERM protein family, and with NHERF1/2 and RhoA/G. Experiments in vitro and phenotypic analyses of podxl-deficient mice indicate that PC is involved in neurite growth, branching and axonal fasciculation, and that PC loss-of-function reduces the number of synapses in the CNS and in the neuromuscular system. We also show that whereas some of the brain PC functions require PSA, others depend on PC per se. Our results show that PC, the second highly sialylated neural adhesion protein, plays multiple roles in neural development. PMID:20706633

Shades of grey; Assessing the contribution of the magno- and parvocellular systems to neural processing of the retinal input in the human visual system from the influence of neural population size and its discharge activity on the VEP.

Science.gov (United States)

Marcar, Valentine L; Baselgia, Silvana; Lüthi-Eisenegger, Barbara; Jäncke, Lutz

2018-03-01

Retinal input processing in the human visual system involves a phasic and tonic neural response. We investigated the role of the magno- and parvocellular systems by comparing the influence of the active neural population size and its discharge activity on the amplitude and latency of four VEP components. We recorded the scalp electric potential of 20 human volunteers viewing a series of dartboard images presented as a pattern reversing and pattern on-/offset stimulus. These patterns were designed to vary both neural population size coding the temporal- and spatial luminance contrast property and the discharge activity of the population involved in a systematic manner. When the VEP amplitude reflected the size of the neural population coding the temporal luminance contrast property of the image, the influence of luminance contrast followed the contrast response function of the parvocellular system. When the VEP amplitude reflected the size of the neural population responding to the spatial luminance contrast property the image, the influence of luminance contrast followed the contrast response function of the magnocellular system. The latencies of the VEP components examined exhibited the same behavior across our stimulus series. This investigation demonstrates the complex interplay of the magno- and parvocellular systems on the neural response as captured by the VEP. It also demonstrates a linear relationship between stimulus property, neural response, and the VEP and reveals the importance of feedback projections in modulating the ongoing neural response. In doing so, it corroborates the conclusions of our previous study.

Identification and adaptive neural network control of a DC motor system with dead-zone characteristics.

Science.gov (United States)

Peng, Jinzhu; Dubay, Rickey

2011-10-01

In this paper, an adaptive control approach based on the neural networks is presented to control a DC motor system with dead-zone characteristics (DZC), where two neural networks are proposed to formulate the traditional identification and control approaches. First, a Wiener-type neural network (WNN) is proposed to identify the motor DZC, which formulates the Wiener model with a linear dynamic block in cascade with a nonlinear static gain. Second, a feedforward neural network is proposed to formulate the traditional PID controller, termed as PID-type neural network (PIDNN), which is then used to control and compensate for the DZC. In this way, the DC motor system with DZC is identified by the WNN identifier, which provides model information to the PIDNN controller in order to make it adaptive. Back-propagation algorithms are used to train both neural networks. Also, stability and convergence analysis are conducted using the Lyapunov theorem. Finally, experiments on the DC motor system demonstrated accurate identification and good compensation for dead-zone with improved control performance over the conventional PID control. Copyright © 2011 ISA. Published by Elsevier Ltd. All rights reserved.

Neural Network Based Intrusion Detection System for Critical Infrastructures

Energy Technology Data Exchange (ETDEWEB)

Todd Vollmer; Ondrej Linda; Milos Manic

2009-07-01

Resiliency and security in control systems such as SCADA and Nuclear plant’s in today’s world of hackers and malware are a relevant concern. Computer systems used within critical infrastructures to control physical functions are not immune to the threat of cyber attacks and may be potentially vulnerable. Tailoring an intrusion detection system to the specifics of critical infrastructures can significantly improve the security of such systems. The IDS-NNM – Intrusion Detection System using Neural Network based Modeling, is presented in this paper. The main contributions of this work are: 1) the use and analyses of real network data (data recorded from an existing critical infrastructure); 2) the development of a specific window based feature extraction technique; 3) the construction of training dataset using randomly generated intrusion vectors; 4) the use of a combination of two neural network learning algorithms – the Error-Back Propagation and Levenberg-Marquardt, for normal behavior modeling. The presented algorithm was evaluated on previously unseen network data. The IDS-NNM algorithm proved to be capable of capturing all intrusion attempts presented in the network communication while not generating any false alerts.

A novel prosodic-information synthesizer based on recurrent fuzzy neural network for the Chinese TTS system.

Science.gov (United States)

Lin, Chin-Teng; Wu, Rui-Cheng; Chang, Jyh-Yeong; Liang, Sheng-Fu

2004-02-01

In this paper, a new technique for the Chinese text-to-speech (TTS) system is proposed. Our major effort focuses on the prosodic information generation. New methodologies for constructing fuzzy rules in a prosodic model simulating human's pronouncing rules are developed. The proposed Recurrent Fuzzy Neural Network (RFNN) is a multilayer recurrent neural network (RNN) which integrates a Self-cOnstructing Neural Fuzzy Inference Network (SONFIN) into a recurrent connectionist structure. The RFNN can be functionally divided into two parts. The first part adopts the SONFIN as a prosodic model to explore the relationship between high-level linguistic features and prosodic information based on fuzzy inference rules. As compared to conventional neural networks, the SONFIN can always construct itself with an economic network size in high learning speed. The second part employs a five-layer network to generate all prosodic parameters by directly using the prosodic fuzzy rules inferred from the first part as well as other important features of syllables. The TTS system combined with the proposed method can behave not only sandhi rules but also the other prosodic phenomena existing in the traditional TTS systems. Moreover, the proposed scheme can even find out some new rules about prosodic phrase structure. The performance of the proposed RFNN-based prosodic model is verified by imbedding it into a Chinese TTS system with a Chinese monosyllable database based on the time-domain pitch synchronous overlap add (TD-PSOLA) method. Our experimental results show that the proposed RFNN can generate proper prosodic parameters including pitch means, pitch shapes, maximum energy levels, syllable duration, and pause duration. Some synthetic sounds are online available for demonstration.

Compensating for Channel Fading in DS-CDMA Communication Systems Employing ICA Neural Network Detectors

Directory of Open Access Journals (Sweden)

David Overbye

2005-06-01

Full Text Available In this paper we examine the impact of channel fading on the bit error rate of a DS-CDMA communication system. The system employs detectors that incorporate neural networks effecting methods of independent component analysis (ICA, subspace estimation of channel noise, and Hopfield type neural networks. The Rayleigh fading channel model is used. When employed in a Rayleigh fading environment, the ICA neural network detectors that give superior performance in a flat fading channel did not retain this superior performance. We then present a new method of compensating for channel fading based on the incorporation of priors in the ICA neural network learning algorithms. When the ICA neural network detectors were compensated using the incorporation of priors, they give significantly better performance than the traditional detectors and the uncompensated ICA detectors. Keywords: CDMA, Multi-user Detection, Rayleigh Fading, Multipath Detection, Independent Component Analysis, Prior Probability Hebbian Learning, Natural Gradient

Learning from neural control.

Science.gov (United States)

Wang, Cong; Hill, David J

2006-01-01

One of the amazing successes of biological systems is their ability to "learn by doing" and so adapt to their environment. In this paper, first, a deterministic learning mechanism is presented, by which an appropriately designed adaptive neural controller is capable of learning closed-loop system dynamics during tracking control to a periodic reference orbit. Among various neural network (NN) architectures, the localized radial basis function (RBF) network is employed. A property of persistence of excitation (PE) for RBF networks is established, and a partial PE condition of closed-loop signals, i.e., the PE condition of a regression subvector constructed out of the RBFs along a periodic state trajectory, is proven to be satisfied. Accurate NN approximation for closed-loop system dynamics is achieved in a local region along the periodic state trajectory, and a learning ability is implemented during a closed-loop feedback control process. Second, based on the deterministic learning mechanism, a neural learning control scheme is proposed which can effectively recall and reuse the learned knowledge to achieve closed-loop stability and improved control performance. The significance of this paper is that the presented deterministic learning mechanism and the neural learning control scheme provide elementary components toward the development of a biologically-plausible learning and control methodology. Simulation studies are included to demonstrate the effectiveness of the approach.

Predictive Control of Hydronic Floor Heating Systems using Neural Networks and Genetic Algorithms

DEFF Research Database (Denmark)

Vinther, Kasper; Green, Torben; Østergaard, Søren

2017-01-01

This paper presents the use a neural network and a micro genetic algorithm to optimize future set-points in existing hydronic floor heating systems for improved energy efficiency. The neural network can be trained to predict the impact of changes in set-points on future room temperatures. Additio...... space is not guaranteed. Evaluation of the performance of multiple neural networks is performed, using different levels of information, and optimization results are presented on a detailed house simulation model....

Analysis of the DWPF glass pouring system using neural networks

International Nuclear Information System (INIS)

Calloway, T.B. Jr.; Jantzen, C.M.

1997-01-01

Neural networks were used to determine the sensitivity of 39 selected Melter/Melter Off Gas and Melter Feed System process parameters as related to the Defense Waste Processing Facility (DWPF) Melter Pour Spout Pressure during the overall analysis and resolution of the DWPF glass production and pouring issues. Two different commercial neural network software packages were used for this analysis. Models were developed and used to determine the critical parameters which accurately describe the DWPF Pour Spout Pressure. The model created using a low-end software package has a root mean square error of ± 0.35 inwc ( 2 = 0.77) with respect to the plant data used to validate and test the model. The model created using a high-end software package has a R 2 = 0.97 with respect to the plant data used to validate and test the model. The models developed for this application identified the key process parameters which contribute to the control of the DWPF Melter Pour Spout pressure during glass pouring operations. The relative contribution and ranking of the selected parameters was determined using the modeling software. Neural network computing software was determined to be a cost-effective software tool for process engineers performing troubleshooting and system performance monitoring activities. In remote high-level waste processing environments, neural network software is especially useful as a replacement for sensors which have failed and are costly to replace. The software can be used to accurately model critical remotely installed plant instrumentation. When the instrumentation fails, the software can be used to provide a soft sensor to replace the actual sensor, thereby decreasing the overall operating cost. Additionally, neural network software tools require very little training and are especially useful in mining or selecting critical variables from the vast amounts of data collected from process computers

Neural networks and applications tutorial

Science.gov (United States)

Guyon, I.

1991-09-01

The importance of neural networks has grown dramatically during this decade. While only a few years ago they were primarily of academic interest, now dozens of companies and many universities are investigating the potential use of these systems and products are beginning to appear. The idea of building a machine whose architecture is inspired by that of the brain has roots which go far back in history. Nowadays, technological advances of computers and the availability of custom integrated circuits, permit simulations of hundreds or even thousands of neurons. In conjunction, the growing interest in learning machines, non-linear dynamics and parallel computation spurred renewed attention in artificial neural networks. Many tentative applications have been proposed, including decision systems (associative memories, classifiers, data compressors and optimizers), or parametric models for signal processing purposes (system identification, automatic control, noise canceling, etc.). While they do not always outperform standard methods, neural network approaches are already used in some real world applications for pattern recognition and signal processing tasks. The tutorial is divided into six lectures, that where presented at the Third Graduate Summer Course on Computational Physics (September 3-7, 1990) on Parallel Architectures and Applications, organized by the European Physical Society: (1) Introduction: machine learning and biological computation. (2) Adaptive artificial neurons (perceptron, ADALINE, sigmoid units, etc.): learning rules and implementations. (3) Neural network systems: architectures, learning algorithms. (4) Applications: pattern recognition, signal processing, etc. (5) Elements of learning theory: how to build networks which generalize. (6) A case study: a neural network for on-line recognition of handwritten alphanumeric characters.

DEVELOPMENT OF A COMPUTER SYSTEM FOR IDENTITY AUTHENTICATION USING ARTIFICIAL NEURAL NETWORKS

Directory of Open Access Journals (Sweden)

Timur Kartbayev

2017-03-01

Full Text Available The aim of the study is to increase the effectiveness of automated face recognition to authenticate identity, considering features of change of the face parameters over time. The improvement of the recognition accuracy, as well as consideration of the features of temporal changes in a human face can be based on the methodology of artificial neural networks. Hybrid neural networks, combining the advantages of classical neural networks and fuzzy logic systems, allow using the network learnability along with the explanation of the findings. The structural scheme of intelligent system for identification based on artificial neural networks is proposed in this work. It realizes the principles of digital information processing and identity recognition taking into account the forecast of key characteristics’ changes over time (e.g., due to aging. The structural scheme has a three-tier architecture and implements preliminary processing, recognition and identification of images obtained as a result of monitoring. On the basis of expert knowledge, the fuzzy base of products is designed. It allows assessing possible changes in key characteristics, used to authenticate identity based on the image. To take this possibility into consideration, a neuro-fuzzy network of ANFIS type was used, which implements the algorithm of Tagaki-Sugeno. The conducted experiments showed high efficiency of the developed neural network and a low value of learning errors, which allows recommending this approach for practical implementation. Application of the developed system of fuzzy production rules that allow predicting changes in individuals over time, will improve the recognition accuracy, reduce the number of authentication failures and improve the efficiency of information processing and decision-making in applications, such as authentication of bank customers, users of mobile applications, or in video monitoring systems of sensitive sites.

Sliding mode synchronization controller design with neural network for uncertain chaotic systems

Energy Technology Data Exchange (ETDEWEB)

Mou Chen [College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016 (China)], E-mail: chenmou@nuaa.edu.cn; Jiang Changsheng; Bin Jiang; Wu Qingxian [College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016 (China)

2009-02-28

A sliding mode synchronization controller is presented with RBF neural network for two chaotic systems in this paper. The compound disturbance of the synchronization error system consists of nonlinear uncertainties and exterior disturbances of chaotic systems. Based on RBF neural networks, a compound disturbance observer is proposed and the update law of parameters is given to monitor the compound disturbance. The synchronization controller is given based on the output of the compound disturbance observer. The designed controller can make the synchronization error convergent to zero and overcome the disruption of the uncertainty and the exterior disturbance of the system. Finally, an example is given to demonstrate the availability of the proposed synchronization control method.

Neural mechanisms of social dominance

Science.gov (United States)

Watanabe, Noriya; Yamamoto, Miyuki

2015-01-01

In a group setting, individuals' perceptions of their own level of dominance or of the dominance level of others, and the ability to adequately control their behavior based on these perceptions are crucial for living within a social environment. Recent advances in neural imaging and molecular technology have enabled researchers to investigate the neural substrates that support the perception of social dominance and the formation of a social hierarchy in humans. At the systems' level, recent studies showed that dominance perception is represented in broad brain regions which include the amygdala, hippocampus, striatum, and various cortical networks such as the prefrontal, and parietal cortices. Additionally, neurotransmitter systems such as the dopaminergic and serotonergic systems, modulate and are modulated by the formation of the social hierarchy in a group. While these monoamine systems have a wide distribution and multiple functions, it was recently found that the Neuropeptide B/W contributes to the perception of dominance and is present in neurons that have a limited projection primarily to the amygdala. The present review discusses the specific roles of these neural regions and neurotransmitter systems in the perception of dominance and in hierarchy formation. PMID:26136644

ISC feedforward control of gasoline engine. Adaptive system using neural network; Jidoshayo gasoline engine no ISC feedforward seigyo. Neural network wo mochiita tekioka

Energy Technology Data Exchange (ETDEWEB)

Kinugawa, N; Morita, S; Takiyama, T [Osaka City University, Osaka (Japan)

1997-10-01

For fuel economy and a good driver`s feeling, it is necessary for idle-speed to keep at a constant low speed. But keeping low speed has danger of engine stall when the engine torque is disturbed by the alternator, and so on. In this paper, adaptive feedforward idle-speed control system against electrical loads was investigated. This system was based on the reversed tansfer functions of the object system, and a neural network was used to adapt this system for aging. Then, this neural network was also used for creating feedforward table map. Good experimental results were obtained. 2 refs., 11 figs.

Computational modeling of neural plasticity for self-organization of neural networks.

Science.gov (United States)

Chrol-Cannon, Joseph; Jin, Yaochu

2014-11-01

Self-organization in biological nervous systems during the lifetime is known to largely occur through a process of plasticity that is dependent upon the spike-timing activity in connected neurons. In the field of computational neuroscience, much effort has been dedicated to building up computational models of neural plasticity to replicate experimental data. Most recently, increasing attention has been paid to understanding the role of neural plasticity in functional and structural neural self-organization, as well as its influence on the learning performance of neural networks for accomplishing machine learning tasks such as classification and regression. Although many ideas and hypothesis have been suggested, the relationship between the structure, dynamics and learning performance of neural networks remains elusive. The purpose of this article is to review the most important computational models for neural plasticity and discuss various ideas about neural plasticity's role. Finally, we suggest a few promising research directions, in particular those along the line that combines findings in computational neuroscience and systems biology, and their synergetic roles in understanding learning, memory and cognition, thereby bridging the gap between computational neuroscience, systems biology and computational intelligence. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Development of the disable software reporting system on the basis of the neural network

Science.gov (United States)

Gavrylenko, S.; Babenko, O.; Ignatova, E.

2018-04-01

The PE structure of malicious and secure software is analyzed, features are highlighted, binary sign vectors are obtained and used as inputs for training the neural network. A software model for detecting malware based on the ART-1 neural network was developed, optimal similarity coefficients were found, and testing was performed. The obtained research results showed the possibility of using the developed system of identifying malicious software in computer systems protection systems

Dynamic artificial neural networks with affective systems.

Directory of Open Access Journals (Sweden)

Catherine D Schuman

Full Text Available Artificial neural networks (ANNs are processors that are trained to perform particular tasks. We couple a computational ANN with a simulated affective system in order to explore the interaction between the two. In particular, we design a simple affective system that adjusts the threshold values in the neurons of our ANN. The aim of this paper is to demonstrate that this simple affective system can control the firing rate of the ensemble of neurons in the ANN, as well as to explore the coupling between the affective system and the processes of long term potentiation (LTP and long term depression (LTD, and the effect of the parameters of the affective system on its performance. We apply our networks with affective systems to a simple pole balancing example and briefly discuss the effect of affective systems on network performance.

Insights into neural crest development from studies of avian embryos

OpenAIRE

Gandhi, Shashank; Bronner, Marianne E.

2018-01-01

The neural crest is a multipotent and highly migratory cell type that contributes to many of the defining features of vertebrates, including the skeleton of the head and most of the peripheral nervous system. 150 years after the discovery of the neural crest, avian embryos remain one of the most important model organisms for studying neural crest development. In this review, we describe aspects of neural crest induction, migration and axial level differences, highlighting what is known about ...

Robust fault detection of wind energy conversion systems based on dynamic neural networks.

Science.gov (United States)

Talebi, Nasser; Sadrnia, Mohammad Ali; Darabi, Ahmad

2014-01-01

Occurrence of faults in wind energy conversion systems (WECSs) is inevitable. In order to detect the occurred faults at the appropriate time, avoid heavy economic losses, ensure safe system operation, prevent damage to adjacent relevant systems, and facilitate timely repair of failed components; a fault detection system (FDS) is required. Recurrent neural networks (RNNs) have gained a noticeable position in FDSs and they have been widely used for modeling of complex dynamical systems. One method for designing an FDS is to prepare a dynamic neural model emulating the normal system behavior. By comparing the outputs of the real system and neural model, incidence of the faults can be identified. In this paper, by utilizing a comprehensive dynamic model which contains both mechanical and electrical components of the WECS, an FDS is suggested using dynamic RNNs. The presented FDS detects faults of the generator's angular velocity sensor, pitch angle sensors, and pitch actuators. Robustness of the FDS is achieved by employing an adaptive threshold. Simulation results show that the proposed scheme is capable to detect the faults shortly and it has very low false and missed alarms rate.

Travel Time Estimation Using Freeway Point Detector Data Based on Evolving Fuzzy Neural Inference System.

Directory of Open Access Journals (Sweden)

Jinjun Tang

Full Text Available Travel time is an important measurement used to evaluate the extent of congestion within road networks. This paper presents a new method to estimate the travel time based on an evolving fuzzy neural inference system. The input variables in the system are traffic flow data (volume, occupancy, and speed collected from loop detectors located at points both upstream and downstream of a given link, and the output variable is the link travel time. A first order Takagi-Sugeno fuzzy rule set is used to complete the inference. For training the evolving fuzzy neural network (EFNN, two learning processes are proposed: (1 a K-means method is employed to partition input samples into different clusters, and a Gaussian fuzzy membership function is designed for each cluster to measure the membership degree of samples to the cluster centers. As the number of input samples increases, the cluster centers are modified and membership functions are also updated; (2 a weighted recursive least squares estimator is used to optimize the parameters of the linear functions in the Takagi-Sugeno type fuzzy rules. Testing datasets consisting of actual and simulated data are used to test the proposed method. Three common criteria including mean absolute error (MAE, root mean square error (RMSE, and mean absolute relative error (MARE are utilized to evaluate the estimation performance. Estimation results demonstrate the accuracy and effectiveness of the EFNN method through comparison with existing methods including: multiple linear regression (MLR, instantaneous model (IM, linear model (LM, neural network (NN, and cumulative plots (CP.

Travel Time Estimation Using Freeway Point Detector Data Based on Evolving Fuzzy Neural Inference System.

Science.gov (United States)

Tang, Jinjun; Zou, Yajie; Ash, John; Zhang, Shen; Liu, Fang; Wang, Yinhai

2016-01-01

Travel time is an important measurement used to evaluate the extent of congestion within road networks. This paper presents a new method to estimate the travel time based on an evolving fuzzy neural inference system. The input variables in the system are traffic flow data (volume, occupancy, and speed) collected from loop detectors located at points both upstream and downstream of a given link, and the output variable is the link travel time. A first order Takagi-Sugeno fuzzy rule set is used to complete the inference. For training the evolving fuzzy neural network (EFNN), two learning processes are proposed: (1) a K-means method is employed to partition input samples into different clusters, and a Gaussian fuzzy membership function is designed for each cluster to measure the membership degree of samples to the cluster centers. As the number of input samples increases, the cluster centers are modified and membership functions are also updated; (2) a weighted recursive least squares estimator is used to optimize the parameters of the linear functions in the Takagi-Sugeno type fuzzy rules. Testing datasets consisting of actual and simulated data are used to test the proposed method. Three common criteria including mean absolute error (MAE), root mean square error (RMSE), and mean absolute relative error (MARE) are utilized to evaluate the estimation performance. Estimation results demonstrate the accuracy and effectiveness of the EFNN method through comparison with existing methods including: multiple linear regression (MLR), instantaneous model (IM), linear model (LM), neural network (NN), and cumulative plots (CP).

Dynamics of a neural system with a multiscale architecture

Science.gov (United States)

Breakspear, Michael; Stam, Cornelis J

2005-01-01

The architecture of the brain is characterized by a modular organization repeated across a hierarchy of spatial scales—neurons, minicolumns, cortical columns, functional brain regions, and so on. It is important to consider that the processes governing neural dynamics at any given scale are not only determined by the behaviour of other neural structures at that scale, but also by the emergent behaviour of smaller scales, and the constraining influence of activity at larger scales. In this paper, we introduce a theoretical framework for neural systems in which the dynamics are nested within a multiscale architecture. In essence, the dynamics at each scale are determined by a coupled ensemble of nonlinear oscillators, which embody the principle scale-specific neurobiological processes. The dynamics at larger scales are ‘slaved’ to the emergent behaviour of smaller scales through a coupling function that depends on a multiscale wavelet decomposition. The approach is first explicated mathematically. Numerical examples are then given to illustrate phenomena such as between-scale bifurcations, and how synchronization in small-scale structures influences the dynamics in larger structures in an intuitive manner that cannot be captured by existing modelling approaches. A framework for relating the dynamical behaviour of the system to measured observables is presented and further extensions to capture wave phenomena and mode coupling are suggested. PMID:16087448

Lithofacies identification using multiple adaptive resonance theory neural networks and group decision expert system

Science.gov (United States)

Chang, H.-C.; Kopaska-Merkel, D. C.; Chen, H.-C.; Rocky, Durrans S.

2000-01-01

Lithofacies identification supplies qualitative information about rocks. Lithofacies represent rock textures and are important components of hydrocarbon reservoir description. Traditional techniques of lithofacies identification from core data are costly and different geologists may provide different interpretations. In this paper, we present a low-cost intelligent system consisting of three adaptive resonance theory neural networks and a rule-based expert system to consistently and objectively identify lithofacies from well-log data. The input data are altered into different forms representing different perspectives of observation of lithofacies. Each form of input is processed by a different adaptive resonance theory neural network. Among these three adaptive resonance theory neural networks, one neural network processes the raw continuous data, another processes categorial data, and the third processes fuzzy-set data. Outputs from these three networks are then combined by the expert system using fuzzy inference to determine to which facies the input data should be assigned. Rules are prioritized to emphasize the importance of firing order. This new approach combines the learning ability of neural networks, the adaptability of fuzzy logic, and the expertise of geologists to infer facies of the rocks. This approach is applied to the Appleton Field, an oil field located in Escambia County, Alabama. The hybrid intelligence system predicts lithofacies identity from log data with 87.6% accuracy. This prediction is more accurate than those of single adaptive resonance theory networks, 79.3%, 68.0% and 66.0%, using raw, fuzzy-set, and categorical data, respectively, and by an error-backpropagation neural network, 57.3%. (C) 2000 Published by Elsevier Science Ltd. All rights reserved.

Application of neural networks to software quality modeling of a very large telecommunications system.

Science.gov (United States)

Khoshgoftaar, T M; Allen, E B; Hudepohl, J P; Aud, S J

1997-01-01

Society relies on telecommunications to such an extent that telecommunications software must have high reliability. Enhanced measurement for early risk assessment of latent defects (EMERALD) is a joint project of Nortel and Bell Canada for improving the reliability of telecommunications software products. This paper reports a case study of neural-network modeling techniques developed for the EMERALD system. The resulting neural network is currently in the prototype testing phase at Nortel. Neural-network models can be used to identify fault-prone modules for extra attention early in development, and thus reduce the risk of operational problems with those modules. We modeled a subset of modules representing over seven million lines of code from a very large telecommunications software system. The set consisted of those modules reused with changes from the previous release. The dependent variable was membership in the class of fault-prone modules. The independent variables were principal components of nine measures of software design attributes. We compared the neural-network model with a nonparametric discriminant model and found the neural-network model had better predictive accuracy.

Hybrid information privacy system: integration of chaotic neural network and RSA coding

Science.gov (United States)

Hsu, Ming-Kai; Willey, Jeff; Lee, Ting N.; Szu, Harold H.

2005-03-01

Electronic mails are adopted worldwide; most are easily hacked by hackers. In this paper, we purposed a free, fast and convenient hybrid privacy system to protect email communication. The privacy system is implemented by combining private security RSA algorithm with specific chaos neural network encryption process. The receiver can decrypt received email as long as it can reproduce the specified chaos neural network series, so called spatial-temporal keys. The chaotic typing and initial seed value of chaos neural network series, encrypted by the RSA algorithm, can reproduce spatial-temporal keys. The encrypted chaotic typing and initial seed value are hidden in watermark mixed nonlinearly with message media, wrapped with convolution error correction codes for wireless 3rd generation cellular phones. The message media can be an arbitrary image. The pattern noise has to be considered during transmission and it could affect/change the spatial-temporal keys. Since any change/modification on chaotic typing or initial seed value of chaos neural network series is not acceptable, the RSA codec system must be robust and fault-tolerant via wireless channel. The robust and fault-tolerant properties of chaos neural networks (CNN) were proved by a field theory of Associative Memory by Szu in 1997. The 1-D chaos generating nodes from the logistic map having arbitrarily negative slope a = p/q generating the N-shaped sigmoid was given first by Szu in 1992. In this paper, we simulated the robust and fault-tolerance properties of CNN under additive noise and pattern noise. We also implement a private version of RSA coding and chaos encryption process on messages.

Neural systems supporting and affecting economically relevant behavior

Directory of Open Access Journals (Sweden)

Braeutigam S

2012-05-01

Full Text Available Sven BraeutigamOxford Centre for Human Brain Activity, University of Oxford, Oxford, United KingdomAbstract: For about a hundred years, theorists and traders alike have tried to unravel and understand the mechanisms and hidden rules underlying and perhaps determining economically relevant behavior. This review focuses on recent developments in neuroeconomics, where the emphasis is placed on two directions of research: first, research exploiting common experiences of urban inhabitants in industrialized societies to provide experimental paradigms with a broader real-life content; second, research based on behavioral genetics, which provides an additional dimension for experimental control and manipulation. In addition, possible limitations of state-of-the-art neuroeconomics research are addressed. It is argued that observations of neuronal systems involved in economic behavior converge to some extent across the technologies and paradigms used. Conceptually, the data available as of today raise the possibility that neuroeconomic research might provide evidence at the neuronal level for the existence of multiple systems of thought and for the importance of conflict. Methodologically, Bayesian approaches in particular may play an important role in identifying mechanisms and establishing causality between patterns of neural activity and economic behavior.Keywords: neuroeconomics, behavioral genetics, decision-making, consumer behavior, neural system

Artificial frame filling using adaptive neural fuzzy inference system for particle image velocimetry dataset

Science.gov (United States)

Akdemir, Bayram; Doǧan, Sercan; Aksoy, Muharrem H.; Canli, Eyüp; Özgören, Muammer

2015-03-01

Liquid behaviors are very important for many areas especially for Mechanical Engineering. Fast camera is a way to observe and search the liquid behaviors. Camera traces the dust or colored markers travelling in the liquid and takes many pictures in a second as possible as. Every image has large data structure due to resolution. For fast liquid velocity, there is not easy to evaluate or make a fluent frame after the taken images. Artificial intelligence has much popularity in science to solve the nonlinear problems. Adaptive neural fuzzy inference system is a common artificial intelligence in literature. Any particle velocity in a liquid has two dimension speed and its derivatives. Adaptive Neural Fuzzy Inference System has been used to create an artificial frame between previous and post frames as offline. Adaptive neural fuzzy inference system uses velocities and vorticities to create a crossing point vector between previous and post points. In this study, Adaptive Neural Fuzzy Inference System has been used to fill virtual frames among the real frames in order to improve image continuity. So this evaluation makes the images much understandable at chaotic or vorticity points. After executed adaptive neural fuzzy inference system, the image dataset increase two times and has a sequence as virtual and real, respectively. The obtained success is evaluated using R2 testing and mean squared error. R2 testing has a statistical importance about similarity and 0.82, 0.81, 0.85 and 0.8 were obtained for velocities and derivatives, respectively.

An Improved Recurrent Neural Network for Complex-Valued Systems of Linear Equation and Its Application to Robotic Motion Tracking.

Science.gov (United States)

Ding, Lei; Xiao, Lin; Liao, Bolin; Lu, Rongbo; Peng, Hua

2017-01-01

To obtain the online solution of complex-valued systems of linear equation in complex domain with higher precision and higher convergence rate, a new neural network based on Zhang neural network (ZNN) is investigated in this paper. First, this new neural network for complex-valued systems of linear equation in complex domain is proposed and theoretically proved to be convergent within finite time. Then, the illustrative results show that the new neural network model has the higher precision and the higher convergence rate, as compared with the gradient neural network (GNN) model and the ZNN model. Finally, the application for controlling the robot using the proposed method for the complex-valued systems of linear equation is realized, and the simulation results verify the effectiveness and superiorness of the new neural network for the complex-valued systems of linear equation.

Command Filtered Adaptive Fuzzy Neural Network Backstepping Control for Marine Power System

Directory of Open Access Journals (Sweden)

Xin Zhang

2014-01-01

Full Text Available In order to retrain chaotic oscillation of marine power system which is excited by periodic electromagnetism perturbation, a novel command-filtered adaptive fuzzy neural network backstepping control method is designed. First, the mathematical model of marine power system is established based on the two parallel nonlinear model. Then, main results of command-filtered adaptive fuzzy neural network backstepping control law are given. And the Lyapunov stability theory is applied to prove that the system can remain closed-loop asymptotically stable with this controller. Finally, simulation results indicate that the designed controller can suppress chaotic oscillation with fast convergence speed that makes the system return to the equilibrium point quickly; meanwhile, the parameter which induces chaotic oscillation can also be discriminated.

Silicon synaptic transistor for hardware-based spiking neural network and neuromorphic system

Science.gov (United States)

Kim, Hyungjin; Hwang, Sungmin; Park, Jungjin; Park, Byung-Gook

2017-10-01

Brain-inspired neuromorphic systems have attracted much attention as new computing paradigms for power-efficient computation. Here, we report a silicon synaptic transistor with two electrically independent gates to realize a hardware-based neural network system without any switching components. The spike-timing dependent plasticity characteristics of the synaptic devices are measured and analyzed. With the help of the device model based on the measured data, the pattern recognition capability of the hardware-based spiking neural network systems is demonstrated using the modified national institute of standards and technology handwritten dataset. By comparing systems with and without inhibitory synapse part, it is confirmed that the inhibitory synapse part is an essential element in obtaining effective and high pattern classification capability.

A neural network method for solving a system of linear variational inequalities

International Nuclear Information System (INIS)

Lan Hengyou; Cui Yishun

2009-01-01

In this paper, we transmute the solution for a new system of linear variational inequalities to an equilibrium point of neural networks, and by using analytic technique, some sufficient conditions are presented. Further, the estimation of the exponential convergence rates of the neural networks is investigated. The new and useful results obtained in this paper generalize and improve the corresponding results of recent works.

Synaptic inputs compete during rapid formation of the calyx of Held: a new model system for neural development.

Science.gov (United States)

Holcomb, Paul S; Hoffpauir, Brian K; Hoyson, Mitchell C; Jackson, Dakota R; Deerinck, Thomas J; Marrs, Glenn S; Dehoff, Marlin; Wu, Jonathan; Ellisman, Mark H; Spirou, George A

2013-08-07

Hallmark features of neural circuit development include early exuberant innervation followed by competition and pruning to mature innervation topography. Several neural systems, including the neuromuscular junction and climbing fiber innervation of Purkinje cells, are models to study neural development in part because they establish a recognizable endpoint of monoinnervation of their targets and because the presynaptic terminals are large and easily monitored. We demonstrate here that calyx of Held (CH) innervation of its target, which forms a key element of auditory brainstem binaural circuitry, exhibits all of these characteristics. To investigate CH development, we made the first application of serial block-face scanning electron microscopy to neural development with fine temporal resolution and thereby accomplished the first time series for 3D ultrastructural analysis of neural circuit formation. This approach revealed a growth spurt of added apposed surface area (ASA)>200 μm2/d centered on a single age at postnatal day 3 in mice and an initial rapid phase of growth and competition that resolved to monoinnervation in two-thirds of cells within 3 d. This rapid growth occurred in parallel with an increase in action potential threshold, which may mediate selection of the strongest input as the winning competitor. ASAs of competing inputs were segregated on the cell body surface. These data suggest mechanisms to select "winning" inputs by regional reinforcement of postsynaptic membrane to mediate size and strength of competing synaptic inputs.

Pax7 lineage contributions to the mammalian neural crest.

Directory of Open Access Journals (Sweden)

Barbara Murdoch

Full Text Available Neural crest cells are vertebrate-specific multipotent cells that contribute to a variety of tissues including the peripheral nervous system, melanocytes, and craniofacial bones and cartilage. Abnormal development of the neural crest is associated with several human maladies including cleft/lip palate, aggressive cancers such as melanoma and neuroblastoma, and rare syndromes, like Waardenburg syndrome, a complex disorder involving hearing loss and pigment defects. We previously identified the transcription factor Pax7 as an early marker, and required component for neural crest development in chick embryos. In mammals, Pax7 is also thought to play a role in neural crest development, yet the precise contribution of Pax7 progenitors to the neural crest lineage has not been determined.Here we use Cre/loxP technology in double transgenic mice to fate map the Pax7 lineage in neural crest derivates. We find that Pax7 descendants contribute to multiple tissues including the cranial, cardiac and trunk neural crest, which in the cranial cartilage form a distinct regional pattern. The Pax7 lineage, like the Pax3 lineage, is additionally detected in some non-neural crest tissues, including a subset of the epithelial cells in specific organs.These results demonstrate a previously unappreciated widespread distribution of Pax7 descendants within and beyond the neural crest. They shed light regarding the regionally distinct phenotypes observed in Pax3 and Pax7 mutants, and provide a unique perspective into the potential roles of Pax7 during disease and development.

Diagonal recurrent neural network based adaptive control of nonlinear dynamical systems using lyapunov stability criterion.

Science.gov (United States)

Kumar, Rajesh; Srivastava, Smriti; Gupta, J R P

2017-03-01

In this paper adaptive control of nonlinear dynamical systems using diagonal recurrent neural network (DRNN) is proposed. The structure of DRNN is a modification of fully connected recurrent neural network (FCRNN). Presence of self-recurrent neurons in the hidden layer of DRNN gives it an ability to capture the dynamic behaviour of the nonlinear plant under consideration (to be controlled). To ensure stability, update rules are developed using lyapunov stability criterion. These rules are then used for adjusting the various parameters of DRNN. The responses of plants obtained with DRNN are compared with those obtained when multi-layer feed forward neural network (MLFFNN) is used as a controller. Also, in example 4, FCRNN is also investigated and compared with DRNN and MLFFNN. Robustness of the proposed control scheme is also tested against parameter variations and disturbance signals. Four simulation examples including one-link robotic manipulator and inverted pendulum are considered on which the proposed controller is applied. The results so obtained show the superiority of DRNN over MLFFNN as a controller. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

Neural mechanisms of social dominance

Directory of Open Access Journals (Sweden)

Noriya eWatanabe

2015-06-01

Full Text Available In a group setting, individuals’ perceptions of their own level of dominance or of the dominance level of others, and the ability to adequately control their behavior based on these perceptions are crucial for living within a social environment. Recent advances in neural imaging and molecular technology have enabled researchers to investigate the neural substrates that support the perception of social dominance and the formation of a social hierarchy in humans. At the systems’ level, recent studies showed that dominance perception is represented in broad brain regions which include the amygdala, hippocampus, striatum, and various cortical networks such as the prefrontal, and parietal cortices. Additionally, neurotransmitter systems such as the dopaminergic and serotonergic systems, modulate and are modulated by the formation of the social hierarchy in a group. While these monoamine systems have a wide distribution and multiple functions, it was recently found that the Neuropeptide B/W contributes to the perception of dominance and is present in neurons that have a limited projection primarily to the amygdala. The present review discusses the specific roles of these neural regions and neurotransmitter systems in the perception of dominance and in hierarchy formation.

Anomaly Detection for Resilient Control Systems Using Fuzzy-Neural Data Fusion Engine

Energy Technology Data Exchange (ETDEWEB)

Ondrej Linda; Milos Manic; Timothy R. McJunkin

2011-08-01

Resilient control systems in critical infrastructures require increased cyber-security and state-awareness. One of the necessary conditions for achieving the desired high level of resiliency is timely reporting and understanding of the status and behavioral trends of the control system. This paper describes the design and development of a neural-network based data-fusion system for increased state-awareness of resilient control systems. The proposed system consists of a dedicated data-fusion engine for each component of the control system. Each data-fusion engine implements three-layered alarm system consisting of: (1) conventional threshold-based alarms, (2) anomalous behavior detector using self-organizing maps, and (3) prediction error based alarms using neural network based signal forecasting. The proposed system was integrated with a model of the Idaho National Laboratory Hytest facility, which is a testing facility for hybrid energy systems. Experimental results demonstrate that the implemented data fusion system provides timely plant performance monitoring and cyber-state reporting.

Selected Flight Test Results for Online Learning Neural Network-Based Flight Control System

Science.gov (United States)

Williams-Hayes, Peggy S.

2004-01-01

The NASA F-15 Intelligent Flight Control System project team developed a series of flight control concepts designed to demonstrate neural network-based adaptive controller benefits, with the objective to develop and flight-test control systems using neural network technology to optimize aircraft performance under nominal conditions and stabilize the aircraft under failure conditions. This report presents flight-test results for an adaptive controller using stability and control derivative values from an online learning neural network. A dynamic cell structure neural network is used in conjunction with a real-time parameter identification algorithm to estimate aerodynamic stability and control derivative increments to baseline aerodynamic derivatives in flight. This open-loop flight test set was performed in preparation for a future phase in which the learning neural network and parameter identification algorithm output would provide the flight controller with aerodynamic stability and control derivative updates in near real time. Two flight maneuvers are analyzed - pitch frequency sweep and automated flight-test maneuver designed to optimally excite the parameter identification algorithm in all axes. Frequency responses generated from flight data are compared to those obtained from nonlinear simulation runs. Flight data examination shows that addition of flight-identified aerodynamic derivative increments into the simulation improved aircraft pitch handling qualities.

Implementation of neural network based non-linear predictive

DEFF Research Database (Denmark)

Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole

1998-01-01

The paper describes a control method for non-linear systems based on generalized predictive control. Generalized predictive control (GPC) was developed to control linear systems including open loop unstable and non-minimum phase systems, but has also been proposed extended for the control of non......-linear systems. GPC is model-based and in this paper we propose the use of a neural network for the modeling of the system. Based on the neural network model a controller with extended control horizon is developed and the implementation issues are discussed, with particular emphasis on an efficient Quasi......-Newton optimization algorithm. The performance is demonstrated on a pneumatic servo system....

An artificial neural network for modeling reliability, availability and maintainability of a repairable system

International Nuclear Information System (INIS)

Rajpal, P.S.; Shishodia, K.S.; Sekhon, G.S.

2006-01-01

The paper explores the application of artificial neural networks to model the behaviour of a complex, repairable system. A composite measure of reliability, availability and maintainability parameters has been proposed for measuring the system performance. The artificial neural network has been trained using past data of a helicopter transportation facility. It is used to simulate behaviour of the facility under various constraints. The insights obtained from results of simulation are useful in formulating strategies for optimal operation of the system

Neural network application to aircraft control system design

Science.gov (United States)

Troudet, Terry; Garg, Sanjay; Merrill, Walter C.

1991-01-01

The feasibility of using artificial neural network as control systems for modern, complex aerospace vehicles is investigated via an example aircraft control design study. The problem considered is that of designing a controller for an integrated airframe/propulsion longitudinal dynamics model of a modern fighter aircraft to provide independent control of pitch rate and airspeed responses to pilot command inputs. An explicit model following controller using H infinity control design techniques is first designed to gain insight into the control problem as well as to provide a baseline for evaluation of the neurocontroller. Using the model of the desired dynamics as a command generator, a multilayer feedforward neural network is trained to control the vehicle model within the physical limitations of the actuator dynamics. This is achieved by minimizing an objective function which is a weighted sum of tracking errors and control input commands and rates. To gain insight in the neurocontrol, linearized representations of the nonlinear neurocontroller are analyzed along a commanded trajectory. Linear robustness analysis tools are then applied to the linearized neurocontroller models and to the baseline H infinity based controller. Future areas of research identified to enhance the practical applicability of neural networks to flight control design.

Neural network application to aircraft control system design

Science.gov (United States)

Troudet, Terry; Garg, Sanjay; Merrill, Walter C.

1991-01-01

The feasibility of using artificial neural networks as control systems for modern, complex aerospace vehicles is investigated via an example aircraft control design study. The problem considered is that of designing a controller for an integrated airframe/propulsion longitudinal dynamics model of a modern fighter aircraft to provide independent control of pitch rate and airspeed responses to pilot command inputs. An explicit model following controller using H infinity control design techniques is first designed to gain insight into the control problem as well as to provide a baseline for evaluation of the neurocontroller. Using the model of the desired dynamics as a command generator, a multilayer feedforward neural network is trained to control the vehicle model within the physical limitations of the actuator dynamics. This is achieved by minimizing an objective function which is a weighted sum of tracking errors and control input commands and rates. To gain insight in the neurocontrol, linearized representations of the nonlinear neurocontroller are analyzed along a commanded trajectory. Linear robustness analysis tools are then applied to the linearized neurocontroller models and to the baseline H infinity based controller. Future areas of research are identified to enhance the practical applicability of neural networks to flight control design.

Neural networks

International Nuclear Information System (INIS)

Denby, Bruce; Lindsey, Clark; Lyons, Louis

1992-01-01

The 1980s saw a tremendous renewal of interest in 'neural' information processing systems, or 'artificial neural networks', among computer scientists and computational biologists studying cognition. Since then, the growth of interest in neural networks in high energy physics, fueled by the need for new information processing technologies for the next generation of high energy proton colliders, can only be described as explosive

Engineering applications of fpgas chaotic systems, artificial neural networks, random number generators, and secure communication systems

CERN Document Server

Tlelo-Cuautle, Esteban; de la Fraga, Luis Gerardo

2016-01-01

This book offers readers a clear guide to implementing engineering applications with FPGAs, from the mathematical description to the hardware synthesis, including discussion of VHDL programming and co-simulation issues. Coverage includes FPGA realizations such as: chaos generators that are described from their mathematical models; artificial neural networks (ANNs) to predict chaotic time series, for which a discussion of different ANN topologies is included, with different learning techniques and activation functions; random number generators (RNGs) that are realized using different chaos generators, and discussions of their maximum Lyapunov exponent values and entropies. Finally, optimized chaotic oscillators are synchronized and realized to implement a secure communication system that processes black and white and grey-scale images. In each application, readers will find VHDL programming guidelines and computer arithmetic issues, along with co-simulation examples with Active-HDL and Simulink. Readers will b...

Neural response during the activation of the attachment system in patients with borderline personality disorder: An fMRI study

Directory of Open Access Journals (Sweden)

Anna Buchheim

2016-08-01

Full Text Available Individuals with borderline personality disorder (BPD are characterized by emotional instability, impaired emotion regulation and unresolved attachment patterns associated with abusive childhood experiences. We investigated the neural response during the activation of the attachment system in BPD patients compared to healthy controls using functional magnetic resonance imaging. Eleven female patients with BPD without posttraumatic stress disorder and seventeen healthy female controls matched for age and education were telling stories in the scanner in response to the Adult Attachment Projective Picture System, an eight-picture set assessment of adult attachment. The picture set includes theoretically-derived attachment scenes, such as separation, death, threat and potential abuse. The picture presentation order is designed to gradually increase the activation of the attachment system. Each picture stimulus was presented for two minutes. Analyses examine group differences in attachment classifications and neural activation patterns over the course of the task. Unresolved attachment was associated with increasing amygdala activation over the course of the attachment task in patients as well as controls. Unresolved controls, but not patients, showed activation in the right dorsolateral prefrontal cortex and the rostral cingulate zone. We interpret this as a neural signature of BPD patients’ inability to exert top-down control under conditions of attachment distress. These findings point to possible neural mechanisms for underlying affective dysregulation in BPD in the context of attachment trauma and fear.

Neural networks: Application to medical imaging

Science.gov (United States)

Clarke, Laurence P.

1994-01-01

The research mission is the development of computer assisted diagnostic (CAD) methods for improved diagnosis of medical images including digital x-ray sensors and tomographic imaging modalities. The CAD algorithms include advanced methods for adaptive nonlinear filters for image noise suppression, hybrid wavelet methods for feature segmentation and enhancement, and high convergence neural networks for feature detection and VLSI implementation of neural networks for real time analysis. Other missions include (1) implementation of CAD methods on hospital based picture archiving computer systems (PACS) and information networks for central and remote diagnosis and (2) collaboration with defense and medical industry, NASA, and federal laboratories in the area of dual use technology conversion from defense or aerospace to medicine.

A wireless transmission neural interface system for unconstrained non-human primates.

Science.gov (United States)

Fernandez-Leon, Jose A; Parajuli, Arun; Franklin, Robert; Sorenson, Michael; Felleman, Daniel J; Hansen, Bryan J; Hu, Ming; Dragoi, Valentin

2015-10-01

Studying the brain in large animal models in a restrained laboratory rig severely limits our capacity to examine brain circuits in experimental and clinical applications. To overcome these limitations, we developed a high-fidelity 96-channel wireless system to record extracellular spikes and local field potentials from the neocortex. A removable, external case of the wireless device is attached to a titanium pedestal placed in the animal skull. Broadband neural signals are amplified, multiplexed, and continuously transmitted as TCP/IP data at a sustained rate of 24 Mbps. A Xilinx Spartan 6 FPGA assembles the digital signals into serial data frames for transmission at 20 kHz though an 802.11n wireless data link on a frequency-shift key-modulated signal at 5.7-5.8 GHz to a receiver up to 10 m away. The system is powered by two CR123A, 3 V batteries for 2 h of operation. We implanted a multi-electrode array in visual area V4 of one anesthetized monkey (Macaca fascicularis) and in the dorsolateral prefrontal cortex (dlPFC) of a freely moving monkey (Macaca mulatta). The implanted recording arrays were electrically stable and delivered broadband neural data over a year of testing. For the first time, we compared dlPFC neuronal responses to the same set of stimuli (food reward) in restrained and freely moving conditions. Although we did not find differences in neuronal responses as a function of reward type in the restrained and unrestrained conditions, there were significant differences in correlated activity. This demonstrates that measuring neural responses in freely moving animals can capture phenomena that are absent in the traditional head-fixed paradigm. We implemented a wireless neural interface for multi-electrode recordings in freely moving non-human primates, which can potentially move systems neuroscience to a new direction by allowing one to record neural signals while animals interact with their environment.

A wireless transmission neural interface system for unconstrained non-human primates

Science.gov (United States)

Fernandez-Leon, Jose A.; Parajuli, Arun; Franklin, Robert; Sorenson, Michael; Felleman, Daniel J.; Hansen, Bryan J.; Hu, Ming; Dragoi, Valentin

2015-10-01

Objective. Studying the brain in large animal models in a restrained laboratory rig severely limits our capacity to examine brain circuits in experimental and clinical applications. Approach. To overcome these limitations, we developed a high-fidelity 96-channel wireless system to record extracellular spikes and local field potentials from the neocortex. A removable, external case of the wireless device is attached to a titanium pedestal placed in the animal skull. Broadband neural signals are amplified, multiplexed, and continuously transmitted as TCP/IP data at a sustained rate of 24 Mbps. A Xilinx Spartan 6 FPGA assembles the digital signals into serial data frames for transmission at 20 kHz though an 802.11n wireless data link on a frequency-shift key-modulated signal at 5.7-5.8 GHz to a receiver up to 10 m away. The system is powered by two CR123A, 3 V batteries for 2 h of operation. Main results. We implanted a multi-electrode array in visual area V4 of one anesthetized monkey (Macaca fascicularis) and in the dorsolateral prefrontal cortex (dlPFC) of a freely moving monkey (Macaca mulatta). The implanted recording arrays were electrically stable and delivered broadband neural data over a year of testing. For the first time, we compared dlPFC neuronal responses to the same set of stimuli (food reward) in restrained and freely moving conditions. Although we did not find differences in neuronal responses as a function of reward type in the restrained and unrestrained conditions, there were significant differences in correlated activity. This demonstrates that measuring neural responses in freely moving animals can capture phenomena that are absent in the traditional head-fixed paradigm. Significance. We implemented a wireless neural interface for multi-electrode recordings in freely moving non-human primates, which can potentially move systems neuroscience to a new direction by allowing one to record neural signals while animals interact with their environment.

A fully implantable rodent neural stimulator

Science.gov (United States)

Perry, D. W. J.; Grayden, D. B.; Shepherd, R. K.; Fallon, J. B.

2012-02-01

The ability to electrically stimulate neural and other excitable tissues in behaving experimental animals is invaluable for both the development of neural prostheses and basic neurological research. We developed a fully implantable neural stimulator that is able to deliver two channels of intra-cochlear electrical stimulation in the rat. It is powered via a novel omni-directional inductive link and includes an on-board microcontroller with integrated radio link, programmable current sources and switching circuitry to generate charge-balanced biphasic stimulation. We tested the implant in vivo and were able to elicit both neural and behavioural responses. The implants continued to function for up to five months in vivo. While targeted to cochlear stimulation, with appropriate electrode arrays the stimulator is well suited to stimulating other neurons within the peripheral or central nervous systems. Moreover, it includes significant on-board data acquisition and processing capabilities, which could potentially make it a useful platform for telemetry applications, where there is a need to chronically monitor physiological variables in unrestrained animals.

Efficient Embedded Decoding of Neural Network Language Models in a Machine Translation System.

Science.gov (United States)

Zamora-Martinez, Francisco; Castro-Bleda, Maria Jose

2018-02-22

Neural Network Language Models (NNLMs) are a successful approach to Natural Language Processing tasks, such as Machine Translation. We introduce in this work a Statistical Machine Translation (SMT) system which fully integrates NNLMs in the decoding stage, breaking the traditional approach based on [Formula: see text]-best list rescoring. The neural net models (both language models (LMs) and translation models) are fully coupled in the decoding stage, allowing to more strongly influence the translation quality. Computational issues were solved by using a novel idea based on memorization and smoothing of the softmax constants to avoid their computation, which introduces a trade-off between LM quality and computational cost. These ideas were studied in a machine translation task with different combinations of neural networks used both as translation models and as target LMs, comparing phrase-based and [Formula: see text]-gram-based systems, showing that the integrated approach seems more promising for [Formula: see text]-gram-based systems, even with nonfull-quality NNLMs.

Neural feedback linearization adaptive control for affine nonlinear systems based on neural network estimator

Directory of Open Access Journals (Sweden)

Bahita Mohamed

2011-01-01

Full Text Available In this work, we introduce an adaptive neural network controller for a class of nonlinear systems. The approach uses two Radial Basis Functions, RBF networks. The first RBF network is used to approximate the ideal control law which cannot be implemented since the dynamics of the system are unknown. The second RBF network is used for on-line estimating the control gain which is a nonlinear and unknown function of the states. The updating laws for the combined estimator and controller are derived through Lyapunov analysis. Asymptotic stability is established with the tracking errors converging to a neighborhood of the origin. Finally, the proposed method is applied to control and stabilize the inverted pendulum system.

Neural net based determination of generator-shedding requirements in electric power systems

Energy Technology Data Exchange (ETDEWEB)

Djukanovic, M [Electrical Engineering Inst. ' Nikola Tesla' , Belgrade (Yugoslavia); Sobajic, D J; Pao, Y -H [Case Western Reserve Univ., Cleveland, OH (United States). Dept. of Electrical Engineering and Applied Physics Case Western Reserve Univ., Cleveland, OH (United States). Dept. of Computer Engineering and Science AI WARE Inc., Cleveland, OH (United States)

1992-09-01

This paper presents an application of artificial neural networks (ANN) in support of a decision-making process by power system operators directed towards the fast stabilisation of multi-machine systems. The proposed approach considers generator shedding as the most effective discrete supplementary control for improving the dynamic performance of faulted power systems and preventing instabilities. The sensitivity of the transient energy function (TEF) with respect to changes in the amount of dropped generation is used during the training phase of ANNs to assess the critical amount of generator shedding required to prevent the loss of synchronism. The learning capabilities of neural nets are used to establish complex mappings between fault information and the amount of generation to be shed, suggesting it as the control signal to the power system operator. (author)

Towards an Irritable Bowel Syndrome Control System Based on Artificial Neural Networks

Science.gov (United States)

Podolski, Ina; Rettberg, Achim

To solve health problems with medical applications that use complex algorithms is a trend nowadays. It could also be a chance to help patients with critical problems caused from nerve irritations to overcome them and provide a better living situation. In this paper a system for monitoring and controlling the nerves from the intestine is described on a theoretical basis. The presented system could be applied to the irritable bowel syndrome. For control a neural network is used. The advantages for using a neural network for the control of irritable bowel syndrome are the adaptation and learning. These two aspects are important because the syndrome behavior varies from patient to patient and have also concerning the time a lot of variations with respect to each patient. The developed neural network is implemented and can be simulated. Therefore, it can be shown how the network monitor and control the nerves for individual input parameters.

Neural network based system for script identification in Indian ...

Indian Academy of Sciences (India)

2016-08-26

Aug 26, 2016 ... The paper describes a neural network-based script identification system which can be used in the machine reading of documents written in English, Hindi and Kannada language scripts. Script identification is a basic requirement in automation of document processing, in multi-script, multi-lingual ...

Neural Based Orthogonal Data Fitting The EXIN Neural Networks

CERN Document Server

Cirrincione, Giansalvo

2008-01-01

Written by three leaders in the field of neural based algorithms, Neural Based Orthogonal Data Fitting proposes several neural networks, all endowed with a complete theory which not only explains their behavior, but also compares them with the existing neural and traditional algorithms. The algorithms are studied from different points of view, including: as a differential geometry problem, as a dynamic problem, as a stochastic problem, and as a numerical problem. All algorithms have also been analyzed on real time problems (large dimensional data matrices) and have shown accurate solutions. Wh

A neurally inspired musical instrument classification system based upon the sound onset.

Science.gov (United States)

Newton, Michael J; Smith, Leslie S

2012-06-01

Physiological evidence suggests that sound onset detection in the auditory system may be performed by specialized neurons as early as the cochlear nucleus. Psychoacoustic evidence shows that the sound onset can be important for the recognition of musical sounds. Here the sound onset is used in isolation to form tone descriptors for a musical instrument classification task. The task involves 2085 isolated musical tones from the McGill dataset across five instrument categories. A neurally inspired tone descriptor is created using a model of the auditory system's response to sound onset. A gammatone filterbank and spiking onset detectors, built from dynamic synapses and leaky integrate-and-fire neurons, create parallel spike trains that emphasize the sound onset. These are coded as a descriptor called the onset fingerprint. Classification uses a time-domain neural network, the echo state network. Reference strategies, based upon mel-frequency cepstral coefficients, evaluated either over the whole tone or only during the sound onset, provide context to the method. Classification success rates for the neurally-inspired method are around 75%. The cepstral methods perform between 73% and 76%. Further testing with tones from the Iowa MIS collection shows that the neurally inspired method is considerably more robust when tested with data from an unrelated dataset.

Neural Networks for Modeling and Control of Particle Accelerators

Science.gov (United States)

Edelen, A. L.; Biedron, S. G.; Chase, B. E.; Edstrom, D.; Milton, S. V.; Stabile, P.

2016-04-01

Particle accelerators are host to myriad nonlinear and complex physical phenomena. They often involve a multitude of interacting systems, are subject to tight performance demands, and should be able to run for extended periods of time with minimal interruptions. Often times, traditional control techniques cannot fully meet these requirements. One promising avenue is to introduce machine learning and sophisticated control techniques inspired by artificial intelligence, particularly in light of recent theoretical and practical advances in these fields. Within machine learning and artificial intelligence, neural networks are particularly well-suited to modeling, control, and diagnostic analysis of complex, nonlinear, and time-varying systems, as well as systems with large parameter spaces. Consequently, the use of neural network-based modeling and control techniques could be of significant benefit to particle accelerators. For the same reasons, particle accelerators are also ideal test-beds for these techniques. Many early attempts to apply neural networks to particle accelerators yielded mixed results due to the relative immaturity of the technology for such tasks. The purpose of this paper is to re-introduce neural networks to the particle accelerator community and report on some work in neural network control that is being conducted as part of a dedicated collaboration between Fermilab and Colorado State University (CSU). We describe some of the challenges of particle accelerator control, highlight recent advances in neural network techniques, discuss some promising avenues for incorporating neural networks into particle accelerator control systems, and describe a neural network-based control system that is being developed for resonance control of an RF electron gun at the Fermilab Accelerator Science and Technology (FAST) facility, including initial experimental results from a benchmark controller.

The nuclear fuel rod character recognition system based on neural network technique

International Nuclear Information System (INIS)

Kim, Woong-Ki; Park, Soon-Yong; Lee, Yong-Bum; Kim, Seung-Ho; Lee, Jong-Min; Chien, Sung-Il.

1994-01-01

The nuclear fuel rods should be discriminated and managed systematically by numeric characters which are printed at the end part of each rod in the process of producing fuel assembly. The characters are used to examine manufacturing process of the fuel rods in the inspection process of irradiated fuel rod. Therefore automatic character recognition is one of the most important technologies to establish automatic manufacturing process of fuel assembly. In the developed character recognition system, mesh feature set extracted from each character written in the fuel rod is employed to train a neural network based on back-propagation algorithm as a classifier for character recognition system. Performance evaluation has been achieved on a test set which is not included in a training character set. (author)

Stellar Image Interpretation System using Artificial Neural Networks: Unipolar Function Case

Directory of Open Access Journals (Sweden)

F. I. Younis

2001-01-01

Full Text Available An artificial neural network based system for interpreting astronomical images has been developed. The system is based on feed-forward Artificial Neural Networks (ANNs with error back-propagation learning. Knowledge about images of stars, cosmic ray events and noise found in images is used to prepare two sets of input patterns to train and test our approach. The system has been developed and implemented to scan astronomical digital images in order to segregate stellar images from other entities. It has been coded in C language for users of personal computers. An astronomical image of a star cluster from other objects is undertaken as a test case. The obtained results are found to be in very good agreement with those derived from the DAOPHOTII package, which is widely used in the astronomical community. It is proved that our system is simpler, much faster and more reliable. Moreover, no prior knowledge, or initial data from the frame to be analysed is required.

Neural control systems for alternatively fuelled vehicles and natural gas fuel injection for DACIA NOVA

Energy Technology Data Exchange (ETDEWEB)

Sulatisky, M. [Saskatchewan Research Council, Saskatoon, SK (Canada); Ghelesel, A. [BC Gas International, Vancouver, BC (Canada)

1999-07-01

The elements of natural gas vehicle conversion technology are described as background to a discussion of the development of bi-fuel injection system for the Rumanian-manufactured DACIA-NOVA automobile. The bi-fuel injection system mirrors the fueling system installed by the original equipment manufacturer; it can also be easily installed on Ford, General Motors and DaimlerChrysler vehicles as well as on most imports.To meet emission standards after 2000, it is envisaged to install on the DACIA NOVA a neural control system (NCS) and a completely adaptive linear control system (ACLS). Details of natural gas vehicles development and the development of NCS and ACLS are discussed, including short-term and long-term objectives.

Optimization of workflow scheduling in Utility Management System with hierarchical neural network

Directory of Open Access Journals (Sweden)

Srdjan Vukmirovic

2011-08-01

Full Text Available Grid computing could be the future computing paradigm for enterprise applications, one of its benefits being that it can be used for executing large scale applications. Utility Management Systems execute very large numbers of workflows with very high resource requirements. This paper proposes architecture for a new scheduling mechanism that dynamically executes a scheduling algorithm using feedback about the current status Grid nodes. Two Artificial Neural Networks were created in order to solve the scheduling problem. A case study is created for the Meter Data Management system with measurements from the Smart Metering system for the city of Novi Sad, Serbia. Performance tests show that significant improvement of overall execution time can be achieved by Hierarchical Artificial Neural Networks.

Neural systems and hormones mediating attraction to infant and child faces

Directory of Open Access Journals (Sweden)

Lizhu eLuo

2015-07-01

Full Text Available We find infant faces highly attractive as a result of specific features which Konrad Lorenz termed Kindchenschema or baby schema, and this is considered to be an important adaptive trait for promoting protective and caregiving behaviors in adults, thereby increasing the chances of infant survival. This review first examines the behavioral support for this effect and physical and behavioral factors which can influence it. It next reviews the increasing number of neuroimaging and electrophysiological studies investigating the neural circuitry underlying this baby schema effect in both parents and non-parents of both sexes. Next it considers potential hormonal contributions to the baby schema effect in both sexes and then neural effects associated with reduced responses to infant cues in post-partum depression, anxiety and drug taking. Overall the findings reviewed reveal a very extensive neural circuitry involved in our perception of cutenessin infant faces with enhanced activation compared to adult faces being found in brain regions involved in face perception, attention, emotion, empathy, memory, reward and attachment, theory of mind and also control of motor responses.Both mothers and fathers also show evidence for enhanced responses in these same neural systems when viewing their own as opposed to another child. Furthermore, responses to infant cues in many of these neural systems are reduced in mothers with post-partum depression or anxiety or have taken addictive drugs throughout pregnancy. In general reproductively active women tend to rate infant faces as cuter than men, which may reflect both heightened attention to relevant cues and a stronger activation in their brain reward circuitry. Perception of infant cuteness may also be influenced by reproductive hormones with the hypothalamic neuropeptide oxytocin being most strongly associated to date with increased attention andattractionto infant cues in both sexes.

Normalization as a canonical neural computation

Science.gov (United States)

Carandini, Matteo; Heeger, David J.

2012-01-01

There is increasing evidence that the brain relies on a set of canonical neural computations, repeating them across brain regions and modalities to apply similar operations to different problems. A promising candidate for such a computation is normalization, in which the responses of neurons are divided by a common factor that typically includes the summed activity of a pool of neurons. Normalization was developed to explain responses in the primary visual cortex and is now thought to operate throughout the visual system, and in many other sensory modalities and brain regions. Normalization may underlie operations such as the representation of odours, the modulatory effects of visual attention, the encoding of value and the integration of multisensory information. Its presence in such a diversity of neural systems in multiple species, from invertebrates to mammals, suggests that it serves as a canonical neural computation. PMID:22108672

Neural Stem Cells: Implications for the Conventional Radiotherapy of Central Nervous System Malignancies

International Nuclear Information System (INIS)

Barani, Igor J.; Benedict, Stanley H.; Lin, Peck-Sun

2007-01-01

Advances in basic neuroscience related to neural stem cells and their malignant counterparts are challenging traditional models of central nervous system tumorigenesis and intrinsic brain repair. Neurogenesis persists into adulthood predominantly in two neurogenic centers: subventricular zone and subgranular zone. Subventricular zone is situated adjacent to lateral ventricles and subgranular zone is confined to the dentate gyrus of the hippocampus. Neural stem cells not only self-renew and differentiate along multiple lineages in these regions, but also contribute to intrinsic brain plasticity and repair. Ionizing radiation can depopulate these exquisitely sensitive regions directly or impair in situ neurogenesis by indirect, dose-dependent and inflammation-mediated mechanisms, even at doses <2 Gy. This review discusses the fundamental neural stem cell concepts within the framework of cumulative clinical experience with the treatment of central nervous system malignancies using conventional radiotherapy

Neural networks for tracking of unknown SISO discrete-time nonlinear dynamic systems.

Science.gov (United States)

Aftab, Muhammad Saleheen; Shafiq, Muhammad

2015-11-01

This article presents a Lyapunov function based neural network tracking (LNT) strategy for single-input, single-output (SISO) discrete-time nonlinear dynamic systems. The proposed LNT architecture is composed of two feedforward neural networks operating as controller and estimator. A Lyapunov function based back propagation learning algorithm is used for online adjustment of the controller and estimator parameters. The controller and estimator error convergence and closed-loop system stability analysis is performed by Lyapunov stability theory. Moreover, two simulation examples and one real-time experiment are investigated as case studies. The achieved results successfully validate the controller performance. Copyright © 2015 ISA. Published by Elsevier Ltd. All rights reserved.

Neural systems supporting linguistic structure, linguistic experience, and symbolic communication in sign language and gesture.

Science.gov (United States)

Newman, Aaron J; Supalla, Ted; Fernandez, Nina; Newport, Elissa L; Bavelier, Daphne

2015-09-15

Sign languages used by deaf communities around the world possess the same structural and organizational properties as spoken languages: In particular, they are richly expressive and also tightly grammatically constrained. They therefore offer the opportunity to investigate the extent to which the neural organization for language is modality independent, as well as to identify ways in which modality influences this organization. The fact that sign languages share the visual-manual modality with a nonlinguistic symbolic communicative system-gesture-further allows us to investigate where the boundaries lie between language and symbolic communication more generally. In the present study, we had three goals: to investigate the neural processing of linguistic structure in American Sign Language (using verbs of motion classifier constructions, which may lie at the boundary between language and gesture); to determine whether we could dissociate the brain systems involved in deriving meaning from symbolic communication (including both language and gesture) from those specifically engaged by linguistically structured content (sign language); and to assess whether sign language experience influences the neural systems used for understanding nonlinguistic gesture. The results demonstrated that even sign language constructions that appear on the surface to be similar to gesture are processed within the left-lateralized frontal-temporal network used for spoken languages-supporting claims that these constructions are linguistically structured. Moreover, although nonsigners engage regions involved in human action perception to process communicative, symbolic gestures, signers instead engage parts of the language-processing network-demonstrating an influence of experience on the perception of nonlinguistic stimuli.

Consensus-based distributed cooperative learning from closed-loop neural control systems.

Science.gov (United States)

Chen, Weisheng; Hua, Shaoyong; Zhang, Huaguang

2015-02-01

In this paper, the neural tracking problem is addressed for a group of uncertain nonlinear systems where the system structures are identical but the reference signals are different. This paper focuses on studying the learning capability of neural networks (NNs) during the control process. First, we propose a novel control scheme called distributed cooperative learning (DCL) control scheme, by establishing the communication topology among adaptive laws of NN weights to share their learned knowledge online. It is further proved that if the communication topology is undirected and connected, all estimated weights of NNs can converge to small neighborhoods around their optimal values over a domain consisting of the union of all state orbits. Second, as a corollary it is shown that the conclusion on the deterministic learning still holds in the decentralized adaptive neural control scheme where, however, the estimated weights of NNs just converge to small neighborhoods of the optimal values along their own state orbits. Thus, the learned controllers obtained by DCL scheme have the better generalization capability than ones obtained by decentralized learning method. A simulation example is provided to verify the effectiveness and advantages of the control schemes proposed in this paper.

A novel three-dimensional system to study interactions between endothelial cells and neural cells of the developing central nervous system

Directory of Open Access Journals (Sweden)

Milner Richard

2007-01-01

Full Text Available Abstract Background During angiogenesis in the developing central nervous system (CNS, endothelial cells (EC detach from blood vessels growing on the brain surface, and migrate into the expanding brain parenchyma. Brain angiogenesis is regulated by growth factors and extracellular matrix (ECM proteins secreted by cells of the developing CNS. In addition, recent evidence suggests that EC play an important role in establishing the neural stem cell (NSC niche. Therefore, two-way communication between EC and neural cells is of fundamental importance in the developing CNS. To study the interactions between brain EC and neural cells of the developing CNS, a novel three-dimensional (3-D murine co-culture system was developed. Fluorescent-labelled brain EC were seeded onto neurospheres; floating cellular aggregates that contain NSC/neural precursor cells (NPC and smaller numbers of differentiated cells. Using this system, brain EC attachment, survival and migration into neurospheres was evaluated and the role of integrins in mediating the early adhesive events addressed. Results Brain EC attached, survived and migrated deep into neurospheres over a 5-day period. Neurospheres express the ECM proteins fibronectin and laminin, and brain EC adhesion to neurospheres was inhibited by RGD peptides and antibodies specific for the β1, but not the α6 integrin subunit. Conclusion A novel 3-D co-culture system for analysing the interactions between EC and neural cells of the developing CNS is presented. This system could be used to investigate the reciprocal influence of EC and NSC/NPC; to examine how NSC/NPC influence cerebral angiogenesis, and conversely, to examine how EC regulate the maintenance and differentiation of NSC/NPC. Using this system it is demonstrated that EC attachment to neurospheres is mediated by the fibronectin receptor, α5β1 integrin.

Neural network regulation driven by autonomous neural firings

Science.gov (United States)

Cho, Myoung Won

2016-07-01

Biological neurons naturally fire spontaneously due to the existence of a noisy current. Such autonomous firings may provide a driving force for network formation because synaptic connections can be modified due to neural firings. Here, we study the effect of autonomous firings on network formation. For the temporally asymmetric Hebbian learning, bidirectional connections lose their balance easily and become unidirectional ones. Defining the difference between reciprocal connections as new variables, we could express the learning dynamics as if Ising model spins interact with each other in magnetism. We present a theoretical method to estimate the interaction between the new variables in a neural system. We apply the method to some network systems and find some tendencies of autonomous neural network regulation.

A CMOS IC–based multisite measuring system for stimulation and recording in neural preparations in vitro

Directory of Open Access Journals (Sweden)

Takashi eTateno

2014-10-01

Full Text Available In this report, we describe the system integration of a complementary metal oxide semiconductor (CMOS integrated circuit (IC chip, capable of both stimulation and recording of neurons or neural tissues, to investigate electrical signal propagation within cellular networks in vitro. The overall system consisted of three major subunits: a 5.0 mm × 5.0 mm CMOS IC chip, a reconfigurable logic device (field-programmable gate array, FPGA, and a PC. To test the system, microelectrode arrays (MEAs were used to extracellularly measure the activity of cultured rat cortical neurons and mouse cortical slices. The MEA had 64 bidirectional (stimulation and recording electrodes. In addition, the CMOS IC chip was equipped with dedicated analog filters, amplification stages, and a stimulation buffer. Signals from the electrodes were sampled at 15.6 kHz with 16-bit resolution. The measured input-referred circuitry noise was 10.1 μV root mean square (10 Hz to 100 kHz, which allowed reliable detection of neural signals ranging from several millivolts down to approximately 33 μVpp. Experiments were performed involving the stimulation of neurons with several spatiotemporal patterns and the recording of the triggered activity. An advantage over current MEAs, as demonstrated by our experiments, includes the ability to stimulate (voltage stimulation, 5-bit resolution spatiotemporal patterns in arbitrary subsets of electrodes. Furthermore, the fast stimulation reset mechanism allowed us to record neuronal signals from a stimulating electrode around 3 ms after stimulation. We demonstrate that the system can be directly applied to, for example, auditory neural prostheses in conjunction with an acoustic sensor and a sound processing system.

Neural multigrid for gauge theories and other disordered systems

International Nuclear Information System (INIS)

Baeker, M.; Kalkreuter, T.; Mack, G.; Speh, M.

1992-09-01

We present evidence that multigrid works for wave equations in disordered systems, e.g. in the presence of gauge fields, no matter how strong the disorder, but one needs to introduce a 'neural computations' point of view into large scale simulations: First, the system must learn how to do the simulations efficiently, then do the simulation (fast). The method can also be used to provide smooth interpolation kernels which are needed in multigrid Monte Carlo updates. (orig.)

Neural network control of a parallel hybrid-electric propulsion system for a small unmanned aerial vehicle

Science.gov (United States)

Harmon, Frederick G.

2005-11-01

Parallel hybrid-electric propulsion systems would be beneficial for small unmanned aerial vehicles (UAVs) used for military, homeland security, and disaster-monitoring missions. The benefits, due to the hybrid and electric-only modes, include increased time-on-station and greater range as compared to electric-powered UAVs and stealth modes not available with gasoline-powered UAVs. This dissertation contributes to the research fields of small unmanned aerial vehicles, hybrid-electric propulsion system control, and intelligent control. A conceptual design of a small UAV with a parallel hybrid-electric propulsion system is provided. The UAV is intended for intelligence, surveillance, and reconnaissance (ISR) missions. A conceptual design reveals the trade-offs that must be considered to take advantage of the hybrid-electric propulsion system. The resulting hybrid-electric propulsion system is a two-point design that includes an engine primarily sized for cruise speed and an electric motor and battery pack that are primarily sized for a slower endurance speed. The electric motor provides additional power for take-off, climbing, and acceleration and also serves as a generator during charge-sustaining operation or regeneration. The intelligent control of the hybrid-electric propulsion system is based on an instantaneous optimization algorithm that generates a hyper-plane from the nonlinear efficiency maps for the internal combustion engine, electric motor, and lithium-ion battery pack. The hyper-plane incorporates charge-depletion and charge-sustaining strategies. The optimization algorithm is flexible and allows the operator/user to assign relative importance between the use of gasoline, electricity, and recharging depending on the intended mission. A MATLAB/Simulink model was developed to test the control algorithms. The Cerebellar Model Arithmetic Computer (CMAC) associative memory neural network is applied to the control of the UAVs parallel hybrid

Adaptive Backstepping-Based Neural Tracking Control for MIMO Nonlinear Switched Systems Subject to Input Delays.

Science.gov (United States)

Niu, Ben; Li, Lu

2018-06-01

This brief proposes a new neural-network (NN)-based adaptive output tracking control scheme for a class of disturbed multiple-input multiple-output uncertain nonlinear switched systems with input delays. By combining the universal approximation ability of radial basis function NNs and adaptive backstepping recursive design with an improved multiple Lyapunov function (MLF) scheme, a novel adaptive neural output tracking controller design method is presented for the switched system. The feature of the developed design is that different coordinate transformations are adopted to overcome the conservativeness caused by adopting a common coordinate transformation for all subsystems. It is shown that all the variables of the resulting closed-loop system are semiglobally uniformly ultimately bounded under a class of switching signals in the presence of MLF and that the system output can follow the desired reference signal. To demonstrate the practicability of the obtained result, an adaptive neural output tracking controller is designed for a mass-spring-damper system.

Monitoring nuclear reactor systems using neural networks and fuzzy logic

International Nuclear Information System (INIS)

Ikonomopoulos, A.; Tsoukalas, L.H.; Uhrig, R.E.; Mullens, J.A.

1992-01-01

A new approach is presented that demonstrates the potential of trained artificial neural networks (ANNs) as generators of membership functions for the purpose of monitoring nuclear reactor systems. ANN's provide a complex-to-simple mapping of reactor parameters in a process analogous to that of measurement. Through such virtual measurements the value of parameters with operational significance, e.g., control-valve-disk-position, valve-line-up-or performance can be determined. In the methodology presented the output of virtual measuring device is a set of membership functions which independently represent different states of the system. Utilizing a fuzzy logic representation offers the advantage of describing the state of the system in a condensed form, developed through linguistic descriptions and convenient for application in monitoring, diagnostics and generally control algorithms. The developed methodology is applied to the problem of measuring the disk position of the secondary flow control is clearly demonstrated as well as a method for selecting the actual output. The results suggest that it is possible to construct virtual measuring devices through artificial neural networks mapping dynamic time series to a set of membership functions and thus enhance the capability of monitoring systems

Implementation of neural network based non-linear predictive control

DEFF Research Database (Denmark)

Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole

1999-01-01

This paper describes a control method for non-linear systems based on generalized predictive control. Generalized predictive control (GPC) was developed to control linear systems, including open-loop unstable and non-minimum phase systems, but has also been proposed to be extended for the control...... of non-linear systems. GPC is model based and in this paper we propose the use of a neural network for the modeling of the system. Based on the neural network model, a controller with extended control horizon is developed and the implementation issues are discussed, with particular emphasis...... on an efficient quasi-Newton algorithm. The performance is demonstrated on a pneumatic servo system....

A comparison of neural tube defects identified by two independent routine recording systems for congenital malformations in Northern Ireland.

Science.gov (United States)

Nevin, N C; McDonald, J R; Walby, A L

1978-12-01

The efficiency of two systems for recording congenital malformations has been compared; one system, the Registrar General's Congenital Malformation Notification, is based on registering all malformed infants, and the other, the Child Health System, records all births. In Northern Ireland for three years [1974--1976], using multiple sources of ascertainment, a total of 686 infants with neural tube defects was identified among 79 783 live and stillbirths. The incidence for all neural tube defects in 8 60 per 1 000 births. The Registrar General's Congenital Malformation Notification System identified 83.6% whereas the Child Health System identified only 63.3% of all neural tube defects. Both systems together identified 86.2% of all neural tube defects. The two systems are suitable for monitoring of malformations and the addition of information from the Genetic Counselling Clinics would enhance the data for epidemiological studies.

Machine Learning Topological Invariants with Neural Networks

Science.gov (United States)

Zhang, Pengfei; Shen, Huitao; Zhai, Hui

2018-02-01

In this Letter we supervisedly train neural networks to distinguish different topological phases in the context of topological band insulators. After training with Hamiltonians of one-dimensional insulators with chiral symmetry, the neural network can predict their topological winding numbers with nearly 100% accuracy, even for Hamiltonians with larger winding numbers that are not included in the training data. These results show a remarkable success that the neural network can capture the global and nonlinear topological features of quantum phases from local inputs. By opening up the neural network, we confirm that the network does learn the discrete version of the winding number formula. We also make a couple of remarks regarding the role of the symmetry and the opposite effect of regularization techniques when applying machine learning to physical systems.

Creative-Dynamics Approach To Neural Intelligence

Science.gov (United States)

Zak, Michail A.

1992-01-01

Paper discusses approach to mathematical modeling of artificial neural networks exhibiting complicated behaviors reminiscent of creativity and intelligence of biological neural networks. Neural network treated as non-Lipschitzian dynamical system - as described in "Non-Lipschitzian Dynamics For Modeling Neural Networks" (NPO-17814). System serves as tool for modeling of temporal-pattern memories and recognition of complicated spatial patterns.

Adaptive fuzzy-neural-network control for maglev transportation system.

Science.gov (United States)

Wai, Rong-Jong; Lee, Jeng-Dao

2008-01-01

A magnetic-levitation (maglev) transportation system including levitation and propulsion control is a subject of considerable scientific interest because of highly nonlinear and unstable behaviors. In this paper, the dynamic model of a maglev transportation system including levitated electromagnets and a propulsive linear induction motor (LIM) based on the concepts of mechanical geometry and motion dynamics is developed first. Then, a model-based sliding-mode control (SMC) strategy is introduced. In order to alleviate chattering phenomena caused by the inappropriate selection of uncertainty bound, a simple bound estimation algorithm is embedded in the SMC strategy to form an adaptive sliding-mode control (ASMC) scheme. However, this estimation algorithm is always a positive value so that tracking errors introduced by any uncertainty will cause the estimated bound increase even to infinity with time. Therefore, it further designs an adaptive fuzzy-neural-network control (AFNNC) scheme by imitating the SMC strategy for the maglev transportation system. In the model-free AFNNC, online learning algorithms are designed to cope with the problem of chattering phenomena caused by the sign action in SMC design, and to ensure the stability of the controlled system without the requirement of auxiliary compensated controllers despite the existence of uncertainties. The outputs of the AFNNC scheme can be directly supplied to the electromagnets and LIM without complicated control transformations for relaxing strict constrains in conventional model-based control methodologies. The effectiveness of the proposed control schemes for the maglev transportation system is verified by numerical simulations, and the superiority of the AFNNC scheme is indicated in comparison with the SMC and ASMC strategies.

A neural network approach to the study of internal energy flow in molecular systems

International Nuclear Information System (INIS)

Sumpter, B.G.; Getino, C.; Noid, D.W.

1992-01-01

Neural networks are used to develop a new technique for efficient analysis of data obtained from molecular-dynamics calculations and is applied to the study of mode energy flow in molecular systems. The methodology is based on teaching an appropriate neural network the relationship between phase-space points along a classical trajectory and mode energies for stretch, bend, and torsion vibrations. Results are discussed for reactive and nonreactive classical trajectories of hydrogen peroxide (H 2 O 2 ) on a semiempirical potential-energy surface. The neural-network approach is shown to produce reasonably accurate values for the mode energies, with average errors between 1% and 12%, and is applicable to any region within the 24-dimensional phase space of H 2 O 2 . In addition, the generic knowledge learned by the neural network allows calculations to be made for other molecular systems. Results are discussed for a series of tetratomic molecules: H 2 X 2 , X=C, N, O, Si, S, or Se, and preliminary results are given for energy flow predictions in macromolecules

Development of Novel Gas Brand Anti-Piracy System based on BP Neural Networks

Energy Technology Data Exchange (ETDEWEB)

Wang, L [School of Aeronautics and Astronautics, Tongji University, Shanghai (China); Zhang, Y Y [Chinese-German School of Postgraduate Studies, Tongji University (China); Ding, L [Chinese-German School of Postgraduate Studies, Tongji University (China)

2006-10-15

The Wireless-net Close-loop gas brand anti-piracy system introduced in this paper is a new type of brand piracy technical product based on BP neural network. It is composed by gas brand piracy label possessing gas exhalation resource, ARM embedded gas-detector, GPRS wireless module and data base of merchandise information. First, the system obtains the information on the special label through gas sensor array ,then the attained signals are transferred into ARM Embedded board and identified by artificial neural network, and finally turns back the outcome of data collection and identification to the manufactures with the help of GPRS module.

Development of Novel Gas Brand Anti-Piracy System based on BP Neural Networks

Science.gov (United States)

Wang, L.; Zhang, Y. Y.; Ding, L.

2006-10-01

The Wireless-net Close-loop gas brand anti-piracy system introduced in this paper is a new type of brand piracy technical product based on BP neural network. It is composed by gas brand piracy label possessing gas exhalation resource, ARM embedded gas-detector, GPRS wireless module and data base of merchandise information. First, the system obtains the information on the special label through gas sensor array ,then the attained signals are transferred into ARM Embedded board and identified by artificial neural network, and finally turns back the outcome of data collection and identification to the manufactures with the help of GPRS module.

Development of Novel Gas Brand Anti-Piracy System based on BP Neural Networks

International Nuclear Information System (INIS)

Wang, L; Zhang, Y Y; Ding, L

2006-01-01

The Wireless-net Close-loop gas brand anti-piracy system introduced in this paper is a new type of brand piracy technical product based on BP neural network. It is composed by gas brand piracy label possessing gas exhalation resource, ARM embedded gas-detector, GPRS wireless module and data base of merchandise information. First, the system obtains the information on the special label through gas sensor array ,then the attained signals are transferred into ARM Embedded board and identified by artificial neural network, and finally turns back the outcome of data collection and identification to the manufactures with the help of GPRS module

Introduction to neural networks with electric power applications

International Nuclear Information System (INIS)

Wildberger, A.M.; Hickok, K.A.

1990-01-01

This is an introduction to the general field of neural networks with emphasis on prospects for their application in the power industry. It is intended to provide enough background information for its audience to begin to follow technical developments in neural networks and to recognize those which might impact on electric power engineering. Beginning with a brief discussion of natural and artificial neurons, the characteristics of neural networks in general and how they learn, neural networks are compared with other modeling tools such as simulation and expert systems in order to provide guidance in selecting appropriate applications. In the power industry, possible applications include plant control, dispatching, and maintenance scheduling. In particular, neural networks are currently being investigated for enhancements to the Thermal Performance Advisor (TPA) which General Physics Corporation (GP) has developed to improve the efficiency of electric power generation

A Gamma Memory Neural Network for System Identification

Science.gov (United States)

Motter, Mark A.; Principe, Jose C.

1992-01-01

A gamma neural network topology is investigated for a system identification application. A discrete gamma memory structure is used in the input layer, providing delayed values of both the control inputs and the network output to the input layer. The discrete gamma memory structure implements a tapped dispersive delay line, with the amount of dispersion regulated by a single, adaptable parameter. The network is trained using static back propagation, but captures significant features of the system dynamics. The system dynamics identified with the network are the Mach number dynamics of the 16 Foot Transonic Tunnel at NASA Langley Research Center, Hampton, Virginia. The training data spans an operating range of Mach numbers from 0.4 to 1.3.

Learning and adaptation: neural and behavioural mechanisms behind behaviour change

Science.gov (United States)

Lowe, Robert; Sandamirskaya, Yulia

2018-01-01

This special issue presents perspectives on learning and adaptation as they apply to a number of cognitive phenomena including pupil dilation in humans and attention in robots, natural language acquisition and production in embodied agents (robots), human-robot game play and social interaction, neural-dynamic modelling of active perception and neural-dynamic modelling of infant development in the Piagetian A-not-B task. The aim of the special issue, through its contributions, is to highlight some of the critical neural-dynamic and behavioural aspects of learning as it grounds adaptive responses in robotic- and neural-dynamic systems.

On-line identification of hybrid systems using an adaptive growing and pruning RBF neural network

DEFF Research Database (Denmark)

Alizadeh, Tohid

2008-01-01

This paper introduces an adaptive growing and pruning radial basis function (GAP-RBF) neural network for on-line identification of hybrid systems. The main idea is to identify a global nonlinear model that can predict the continuous outputs of hybrid systems. In the proposed approach, GAP......-RBF neural network uses a modified unscented kalman filter (UKF) with forgetting factor scheme as the required on-line learning algorithm. The effectiveness of the resulting identification approach is tested and evaluated on a simulated benchmark hybrid system....

Autonomous Navigation Apparatus With Neural Network for a Mobile Vehicle

Science.gov (United States)

Quraishi, Naveed (Inventor)

1996-01-01

An autonomous navigation system for a mobile vehicle arranged to move within an environment includes a plurality of sensors arranged on the vehicle and at least one neural network including an input layer coupled to the sensors, a hidden layer coupled to the input layer, and an output layer coupled to the hidden layer. The neural network produces output signals representing respective positions of the vehicle, such as the X coordinate, the Y coordinate, and the angular orientation of the vehicle. A plurality of patch locations within the environment are used to train the neural networks to produce the correct outputs in response to the distances sensed.

Surface Casting Defects Inspection Using Vision System and Neural Network Techniques

Directory of Open Access Journals (Sweden)

Świłło S.J.

2013-12-01

Full Text Available The paper presents a vision based approach and neural network techniques in surface defects inspection and categorization. Depending on part design and processing techniques, castings may develop surface discontinuities such as cracks and pores that greatly influence the material’s properties Since the human visual inspection for the surface is slow and expensive, a computer vision system is an alternative solution for the online inspection. The authors present the developed vision system uses an advanced image processing algorithm based on modified Laplacian of Gaussian edge detection method and advanced lighting system. The defect inspection algorithm consists of several parameters that allow the user to specify the sensitivity level at which he can accept the defects in the casting. In addition to the developed image processing algorithm and vision system apparatus, an advanced learning process has been developed, based on neural network techniques. Finally, as an example three groups of defects were investigated demonstrates automatic selection and categorization of the measured defects, such as blowholes, shrinkage porosity and shrinkage cavity.

The lamprey: a jawless vertebrate model system for examining origin of the neural crest and other vertebrate traits.

Science.gov (United States)

Green, Stephen A; Bronner, Marianne E

2014-01-01

Lampreys are a group of jawless fishes that serve as an important point of comparison for studies of vertebrate evolution. Lampreys and hagfishes are agnathan fishes, the cyclostomes, which sit at a crucial phylogenetic position as the only living sister group of the jawed vertebrates. Comparisons between cyclostomes and jawed vertebrates can help identify shared derived (i.e. synapomorphic) traits that might have been inherited from ancestral early vertebrates, if unlikely to have arisen convergently by chance. One example of a uniquely vertebrate trait is the neural crest, an embryonic tissue that produces many cell types crucial to vertebrate features, such as the craniofacial skeleton, pigmentation of the skin, and much of the peripheral nervous system (Gans and Northcutt, 1983). Invertebrate chordates arguably lack unambiguous neural crest homologs, yet have cells with some similarities, making comparisons with lampreys and jawed vertebrates essential for inferring characteristics of development in early vertebrates, and how they may have evolved from nonvertebrate chordates. Here we review recent research on cyclostome neural crest development, including research on lamprey gene regulatory networks and differentiated neural crest fates. Copyright © 2014 International Society of Differentiation. Published by Elsevier B.V. All rights reserved.

Memristor-based neural networks

International Nuclear Information System (INIS)

Thomas, Andy

2013-01-01

The synapse is a crucial element in biological neural networks, but a simple electronic equivalent has been absent. This complicates the development of hardware that imitates biological architectures in the nervous system. Now, the recent progress in the experimental realization of memristive devices has renewed interest in artificial neural networks. The resistance of a memristive system depends on its past states and exactly this functionality can be used to mimic the synaptic connections in a (human) brain. After a short introduction to memristors, we present and explain the relevant mechanisms in a biological neural network, such as long-term potentiation and spike time-dependent plasticity, and determine the minimal requirements for an artificial neural network. We review the implementations of these processes using basic electric circuits and more complex mechanisms that either imitate biological systems or could act as a model system for them. (topical review)

Design and Implementation of Behavior Recognition System Based on Convolutional Neural Network

Directory of Open Access Journals (Sweden)

Yu Bo

2017-01-01

Full Text Available We build a set of human behavior recognition system based on the convolution neural network constructed for the specific human behavior in public places. Firstly, video of human behavior data set will be segmented into images, then we process the images by the method of background subtraction to extract moving foreground characters of body. Secondly, the training data sets are trained into the designed convolution neural network, and the depth learning network is constructed by stochastic gradient descent. Finally, the various behaviors of samples are classified and identified with the obtained network model, and the recognition results are compared with the current mainstream methods. The result show that the convolution neural network can study human behavior model automatically and identify human’s behaviors without any manually annotated trainings.

CloudScan - A Configuration-Free Invoice Analysis System Using Recurrent Neural Networks

DEFF Research Database (Denmark)

Palm, Rasmus Berg; Winther, Ole; Laws, Florian

2017-01-01

We present CloudScan; an invoice analysis system that requires zero configuration or upfront annotation. In contrast to previous work, CloudScan does not rely on templates of invoice layout, instead it learns a single global model of invoices that naturally generalizes to unseen invoice layouts....... The model is trained using data automatically extracted from end-user provided feedback. This automatic training data extraction removes the requirement for users to annotate the data precisely. We describe a recurrent neural network model that can capture long range context and compare it to a baseline...... logistic regression model corresponding to the current CloudScan production system. We train and evaluate the system on 8 important fields using a dataset of 326,471 invoices. The recurrent neural network and baseline model achieve 0.891 and 0.887 average F1 scores respectively on seen invoice layouts...

Neural networks and their potential application in nuclear power plants

International Nuclear Information System (INIS)

Uhrig, R.E.

1991-01-01

A neural network is a data processing system consisting of a number of simple, highly interconnected processing elements in an architecture inspired by the structure of the cerebral cortex portion of the brain. Hence, neural networks are often capable of doing things which humans or animals do well but which conventional computers often do poorly. Neural networks have emerged in the past few years as an area of unusual opportunity for research, development and application to a variety of real world problems. Indeed, neural networks exhibit characteristics and capabilities not provided by any other technology. Examples include reading Japanese Kanji characters and human handwriting, reading a typewritten manuscript aloud, compensating for alignment errors in robots, interpreting very noise signals (e.g., electroencephalograms), modeling complex systems that cannot be modeled mathematically, and predicting whether proposed loans will be good or fail. This paper presents a brief tutorial on neural networks and describes research on the potential applications to nuclear power plants

Theory of Neural Information Processing Systems

International Nuclear Information System (INIS)

Galla, Tobias

2006-01-01

It is difficult not to be amazed by the ability of the human brain to process, to structure and to memorize information. Even by the toughest standards the behaviour of this network of about 10 11 neurons qualifies as complex, and both the scientific community and the public take great interest in the growing field of neuroscience. The scientific endeavour to learn more about the function of the brain as an information processing system is here a truly interdisciplinary one, with important contributions from biology, computer science, physics, engineering and mathematics as the authors quite rightly point out in the introduction of their book. The role of the theoretical disciplines here is to provide mathematical models of information processing systems and the tools to study them. These models and tools are at the centre of the material covered in the book by Coolen, Kuehn and Sollich. The book is divided into five parts, providing basic introductory material on neural network models as well as the details of advanced techniques to study them. A mathematical appendix complements the main text. The range of topics is extremely broad, still the presentation is concise and the book well arranged. To stress the breadth of the book let me just mention a few keywords here: the material ranges from the basics of perceptrons and recurrent network architectures to more advanced aspects such as Bayesian learning and support vector machines; Shannon's theory of information and the definition of entropy are discussed, and a chapter on Amari's information geometry is not missing either. Finally the statistical mechanics chapters cover Gardner theory and the replica analysis of the Hopfield model, not without being preceded by a brief introduction of the basic concepts of equilibrium statistical physics. The book also contains a part on effective theories of the macroscopic dynamics of neural networks. Many dynamical aspects of neural networks are usually hard to find in the

Fuzzy wavelet plus a quantum neural network as a design base for power system stability enhancement.

Science.gov (United States)

Ganjefar, Soheil; Tofighi, Morteza; Karami, Hamidreza

2015-11-01

In this study, we introduce an indirect adaptive fuzzy wavelet neural controller (IAFWNC) as a power system stabilizer to damp inter-area modes of oscillations in a multi-machine power system. Quantum computing is an efficient method for improving the computational efficiency of neural networks, so we developed an identifier based on a quantum neural network (QNN) to train the IAFWNC in the proposed scheme. All of the controller parameters are tuned online based on the Lyapunov stability theory to guarantee the closed-loop stability. A two-machine, two-area power system equipped with a static synchronous series compensator as a series flexible ac transmission system was used to demonstrate the effectiveness of the proposed controller. The simulation and experimental results demonstrated that the proposed IAFWNC scheme can achieve favorable control performance. Copyright © 2015 Elsevier Ltd. All rights reserved.

Multi-dimensional design window search system using neural networks in reactor core design

International Nuclear Information System (INIS)

Kugo, Teruhiko; Nakagawa, Masayuki

2000-02-01

In the reactor core design, many parametric survey calculations should be carried out to decide an optimal set of basic design parameter values. They consume a large amount of computation time and labor in the conventional way. To support directly design work, we investigate a procedure to search efficiently a design window, which is defined as feasible design parameter ranges satisfying design criteria and requirements, in a multi-dimensional space composed of several basic design parameters. We apply the present method to the neutronics and thermal hydraulics fields and develop the multi-dimensional design window search system using it. The principle of the present method is to construct the multilayer neural network to simulate quickly a response of an analysis code through a training process, and to reduce computation time using the neural network without parametric study using analysis codes. The system works on an engineering workstation (EWS) with efficient man-machine interface for pre- and post-processing. This report describes the principle of the present method, the structure of the system, the guidance of the usages of the system, the guideline for the efficient training of neural networks, the instructions of the input data for analysis calculation and so on. (author)

Artificial neural network controller for automatic ship berthing using head-up coordinate system

Directory of Open Access Journals (Sweden)

Nam-Kyun Im

2018-05-01

Full Text Available The Artificial Neural Network (ANN model has been known as one of the most effective theories for automatic ship berthing, as it has learning ability and mimics the actions of the human brain when performing the stages of ship berthing. However, existing ANN controllers can only bring a ship into a berth in a certain port, where the inputs of the ANN are the same as those of the teaching data. This means that those ANN controllers must be retrained when the ship arrives to a new port, which is time-consuming and costly. In this research, by using the head-up coordinate system, which includes the relative bearing and distance from the ship to the berth, a novel ANN controller is proposed to automatically control the ship into the berth in different ports without retraining the ANN structure. Numerical simulations were performed to verify the effectiveness of the proposed controller. First, teaching data were created in the original port to train the neural network; then, the controller was tested for automatic berthing in other ports, where the initial conditions of the inputs in the head-up coordinate system were similar to those of the teaching data in the original port. The results showed that the proposed controller has good performance for ship berthing in ports. Keywords: Automatic ship berthing, ANN controller, Head-up coordinate system, Low speed, Relative bearing

A Drone Remote Sensing for Virtual Reality Simulation System for Forest Fires: Semantic Neural Network Approach

Science.gov (United States)

Narasimha Rao, Gudikandhula; Jagadeeswara Rao, Peddada; Duvvuru, Rajesh

2016-09-01

Wild fires have significant impact on atmosphere and lives. The demand of predicting exact fire area in forest may help fire management team by using drone as a robot. These are flexible, inexpensive and elevated-motion remote sensing systems that use drones as platforms are important for substantial data gaps and supplementing the capabilities of manned aircraft and satellite remote sensing systems. In addition, powerful computational tools are essential for predicting certain burned area in the duration of a forest fire. The reason of this study is to built up a smart system based on semantic neural networking for the forecast of burned areas. The usage of virtual reality simulator is used to support the instruction process of fire fighters and all users for saving of surrounded wild lives by using a naive method Semantic Neural Network System (SNNS). Semantics are valuable initially to have a enhanced representation of the burned area prediction and better alteration of simulation situation to the users. In meticulous, consequences obtained with geometric semantic neural networking is extensively superior to other methods. This learning suggests that deeper investigation of neural networking in the field of forest fires prediction could be productive.

Neural network based photovoltaic electrical forecasting in south Algeria

International Nuclear Information System (INIS)

Hamid Oudjana, S.; Hellal, A.; Hadj Mahammed, I

2014-01-01

Photovoltaic electrical forecasting is significance for the optimal operation and power predication of grid-connected photovoltaic (PV) plants, and it is important task in renewable energy electrical system planning and operating. This paper explores the application of neural networks (NN) to study the design of photovoltaic electrical forecasting systems for one week ahead using weather databases include the global irradiance, and temperature of Ghardaia city (south of Algeria) for one year of 2013 using a data acquisition system. Simulations were run and the results are discussed showing that neural networks Technique is capable to decrease the photovoltaic electrical forecasting error. (author)

Robustness of a Neural Network Model for Power Peak Factor Estimation in Protection Systems

International Nuclear Information System (INIS)

Souza, Rose Mary G.P.; Moreira, Joao M.L.

2006-01-01

This work presents results of robustness verification of artificial neural network correlations that improve the real time prediction of the power peak factor for reactor protection systems. The input variables considered in the correlation are those available in the reactor protection systems, namely, the axial power differences obtained from measured ex-core detectors, and the position of control rods. The correlations, based on radial basis function (RBF) and multilayer perceptron (MLP) neural networks, estimate the power peak factor, without faulty signals, with average errors between 0.13%, 0.19% and 0.15%, and maximum relative error of 2.35%. The robustness verification was performed for three different neural network correlations. The results show that they are robust against signal degradation, producing results with faulty signals with a maximum error of 6.90%. The average error associated to faulty signals for the MLP network is about half of that of the RBF network, and the maximum error is about 1% smaller. These results demonstrate that MLP neural network correlation is more robust than the RBF neural network correlation. The results also show that the input variables present redundant information. The axial power difference signals compensate the faulty signal for the position of a given control rod, and improves the results by about 10%. The results show that the errors in the power peak factor estimation by these neural network correlations, even in faulty conditions, are smaller than the current PWR schemes which may have uncertainties as high as 8%. Considering the maximum relative error of 2.35%, these neural network correlations would allow decreasing the power peak factor safety margin by about 5%. Such a reduction could be used for operating the reactor with a higher power level or with more flexibility. The neural network correlation has to meet requirements of high integrity software that performs safety grade actions. It is shown that the

Coding of level of ambiguity within neural systems mediating choice.

Science.gov (United States)

Lopez-Paniagua, Dan; Seger, Carol A

2013-01-01

Data from previous neuroimaging studies exploring neural activity associated with uncertainty suggest varying levels of activation associated with changing degrees of uncertainty in neural regions that mediate choice behavior. The present study used a novel task that parametrically controlled the amount of information hidden from the subject; levels of uncertainty ranged from full ambiguity (no information about probability of winning) through multiple levels of partial ambiguity, to a condition of risk only (zero ambiguity with full knowledge of the probability of winning). A parametric analysis compared a linear model in which weighting increased as a function of level of ambiguity, and an inverted-U quadratic models in which partial ambiguity conditions were weighted most heavily. Overall we found that risk and all levels of ambiguity recruited a common "fronto-parietal-striatal" network including regions within the dorsolateral prefrontal cortex, intraparietal sulcus, and dorsal striatum. Activation was greatest across these regions and additional anterior and superior prefrontal regions for the quadratic function which most heavily weighs trials with partial ambiguity. These results suggest that the neural regions involved in decision processes do not merely track the absolute degree ambiguity or type of uncertainty (risk vs. ambiguity). Instead, recruitment of prefrontal regions may result from greater degree of difficulty in conditions of partial ambiguity: when information regarding reward probabilities important for decision making is hidden or not easily obtained the subject must engage in a search for tractable information. Additionally, this study identified regions of activity related to the valuation of potential gains associated with stimuli or options (including the orbitofrontal and medial prefrontal cortices and dorsal striatum) and related to winning (including orbitofrontal cortex and ventral striatum).

Development of a hybrid system of artificial neural networks and ...

African Journals Online (AJOL)

Development of a hybrid system of artificial neural networks and artificial bee colony algorithm for prediction and modeling of customer choice in the market. ... attempted to present a new method for the modeling and prediction of customer choice in the market using the combination of artificial intelligence and data mining.

Integrated Markov-neural reliability computation method: A case for multiple automated guided vehicle system

International Nuclear Information System (INIS)

Fazlollahtabar, Hamed; Saidi-Mehrabad, Mohammad; Balakrishnan, Jaydeep

2015-01-01

This paper proposes an integrated Markovian and back propagation neural network approaches to compute reliability of a system. While states of failure occurrences are significant elements for accurate reliability computation, Markovian based reliability assessment method is designed. Due to drawbacks shown by Markovian model for steady state reliability computations and neural network for initial training pattern, integration being called Markov-neural is developed and evaluated. To show efficiency of the proposed approach comparative analyses are performed. Also, for managerial implication purpose an application case for multiple automated guided vehicles (AGVs) in manufacturing networks is conducted. - Highlights: • Integrated Markovian and back propagation neural network approach to compute reliability. • Markovian based reliability assessment method. • Managerial implication is shown in an application case for multiple automated guided vehicles (AGVs) in manufacturing networks

An Inductively-Powered Wireless Neural Recording System with a Charge Sampling Analog Front-End.

Science.gov (United States)

Lee, Seung Bae; Lee, Byunghun; Kiani, Mehdi; Mahmoudi, Babak; Gross, Robert; Ghovanloo, Maysam

2016-01-15

An inductively-powered wireless integrated neural recording system (WINeR-7) is presented for wireless and battery less neural recording from freely-behaving animal subjects inside a wirelessly-powered standard homecage. The WINeR-7 system employs a novel wide-swing dual slope charge sampling (DSCS) analog front-end (AFE) architecture, which performs amplification, filtering, sampling, and analog-to-time conversion (ATC) with minimal interference and small amount of power. The output of the DSCS-AFE produces a pseudo-digital pulse width modulated (PWM) signal. A circular shift register (CSR) time division multiplexes (TDM) the PWM pulses to create a TDM-PWM signal, which is fed into an on-chip 915 MHz transmitter (Tx). The AFE and Tx are supplied at 1.8 V and 4.2 V, respectively, by a power management block, which includes a high efficiency active rectifier and automatic resonance tuning (ART), operating at 13.56 MHz. The 8-ch system-on-a-chip (SoC) was fabricated in a 0.35-μm CMOS process, occupying 5.0 × 2.5 mm 2 and consumed 51.4 mW. For each channel, the sampling rate is 21.48 kHz and the power consumption is 19.3 μW. In vivo experiments were conducted on freely behaving rats in an energized homecage by continuously delivering 51.4 mW to the WINeR-7 system in a closed-loop fashion and recording local field potentials (LFP).

Implantable neurotechnologies: bidirectional neural interfaces--applications and VLSI circuit implementations.

Science.gov (United States)

Greenwald, Elliot; Masters, Matthew R; Thakor, Nitish V

2016-01-01

A bidirectional neural interface is a device that transfers information into and out of the nervous system. This class of devices has potential to improve treatment and therapy in several patient populations. Progress in very large-scale integration has advanced the design of complex integrated circuits. System-on-chip devices are capable of recording neural electrical activity and altering natural activity with electrical stimulation. Often, these devices include wireless powering and telemetry functions. This review presents the state of the art of bidirectional circuits as applied to neuroprosthetic, neurorepair, and neurotherapeutic systems.

ARTIFICIAL NEURAL NETWORKS BASED GEARS MATERIAL SELECTION HYBRID INTELLIGENT SYSTEM

Institute of Scientific and Technical Information of China (English)

X.C. Li; W.X. Zhu; G. Chen; D.S. Mei; J. Zhang; K.M. Chen

2003-01-01

An artificial neural networks(ANNs) based gear material selection hybrid intelligent system is established by analyzing the individual advantages and weakness of expert system (ES) and ANNs and the applications in material select of them. The system mainly consists of tow parts: ES and ANNs. By being trained with much data samples,the back propagation (BP) ANN gets the knowledge of gear materials selection, and is able to inference according to user input. The system realizes the complementing of ANNs and ES. Using this system, engineers without materials selection experience can conveniently deal with gear materials selection.

A Sliding Mode Control-based on a RBF Neural Network for Deburring Industry Robotic Systems

OpenAIRE

Tao, Yong; Zheng, Jiaqi; Lin, Yuanchang

2016-01-01

A sliding mode control method based on radial basis function (RBF) neural network is proposed for the deburring of industry robotic systems. First, a dynamic model for deburring the robot system is established. Then, a conventional SMC scheme is introduced for the joint position tracking of robot manipulators. The RBF neural network based sliding mode control (RBFNN-SMC) has the ability to learn uncertain control actions. In the RBFNN-SMC scheme, the adaptive tuning algorithms for network par...

A low-cost multichannel wireless neural stimulation system for freely roaming animals

Science.gov (United States)

Alam, Monzurul; Chen, Xi; Fernandez, Eduardo

2013-12-01

Objectives. Electrical stimulation of nerve tissue and recording of neural activity are the basis of many therapies and neural prostheses. Conventional stimulation systems have a number of practical limitations, especially in experiments involving freely roaming subjects. Our main objective was to develop a modular, versatile and inexpensive multichannel wireless system able to overcome some of these constraints. Approach. We have designed and implemented a new multichannel wireless neural stimulator based on commercial components. The system is small (2 cm × 4 cm × 0.5 cm) and light in weight (9 g) which allows it to be easily carried in a small backpack. To test and validate the performance and reliability of the whole system we conducted several bench tests and in vivo experiments. Main results. The performance and accuracy of the stimulator were comparable to commercial threaded systems. Stimulation sequences can be constructed on-the-fly with 251 selectable current levels (from 0 to 250 µA) with 1 µA step resolution. The pulse widths and intervals can be as long as 65 ms in 2 µs time resolution. The system covers approximately 10 m of transmission range in a regular laboratory environment and 100 m in free space (line of sight). Furthermore it provides great flexibility for experiments since it allows full control of the stimulator and the stimulation parameters in real time. When there is no stimulation, the device automatically goes into low-power sleep mode to preserve battery power. Significance. We introduce the design of a powerful multichannel wireless stimulator assembled from commercial components. Key features of the system are their reliability, robustness and small size. The system has a flexible design that can be modified straightforwardly to tailor it to any specific experimental need. Furthermore it can be effortlessly adapted for use with any kind of multielectrode arrays.

Neural engineering from advanced biomaterials to 3D fabrication techniques

CERN Document Server

Kaplan, David

2016-01-01

This book covers the principles of advanced 3D fabrication techniques, stem cells and biomaterials for neural engineering. Renowned contributors cover topics such as neural tissue regeneration, peripheral and central nervous system repair, brain-machine interfaces and in vitro nervous system modeling. Within these areas, focus remains on exciting and emerging technologies such as highly developed neuroprostheses and the communication channels between the brain and prostheses, enabling technologies that are beneficial for development of therapeutic interventions, advanced fabrication techniques such as 3D bioprinting, photolithography, microfluidics, and subtractive fabrication, and the engineering of implantable neural grafts. There is a strong focus on stem cells and 3D bioprinting technologies throughout the book, including working with embryonic, fetal, neonatal, and adult stem cells and a variety of sophisticated 3D bioprinting methods for neural engineering applications. There is also a strong focus on b...

Hybrid case-neural network (CNN) diagnostic system

International Nuclear Information System (INIS)

Mohamed, A.H.

2010-01-01

recently, the mobile health care has a great attention for the researcher and people all over the world. Case based reasoning (CBR) systems have proved their performance as world wide web (WWW) medical diagnostic systems. They were preferred rather than different reasoning approaches due to their high performance and results' explanation. But, their operations require a complex knowledge acquisition and management processes. On the other hand, it is found that, artificial neural network (ANN) has a great acceptance as a classifier methodology using a little amount of knowledge. But, ANN lacks of an explanation capability .The present research introduces a new web-based hybrid diagnostic system that can use the ANN inside the CBR , cycle.It can provide higher performance for the web diagnostic systems. Besides, the proposed system can be used as a web diagnostic system. It can be applied for diagnosis different types of systems in several domains. It has been applied in diagnosis of the cancer diseases that has a great spreading in recent years as a case of study . However, the suggested system has proved its acceptance in the manner.

The use of neural networks in the D0 data acquisition system

International Nuclear Information System (INIS)

Cutts, D.; Hoftun, J.S.; Sornborger, A.; Astur, R.V.; Johnson, C.R.; Zeller, R.T.

1989-01-01

We discuss the possible application of algorithms derived from neural networks to the D0 experiment. The D0 data acquisition system is based on a large farm of MicroVAXes, each independently performing real-time event filtering. A new generation of multiport memories in each MicroVAX node will enable special function processors to have direct access to event data. We describe an exploratory study of back propagation neural networks, such as might be configured in the nodes, for more efficient event filtering. 9 refs., 3 figs., 1 tab

A Novel Robot System Integrating Biological and Mechanical Intelligence Based on Dissociated Neural Network-Controlled Closed-Loop Environment.

Science.gov (United States)

Li, Yongcheng; Sun, Rong; Wang, Yuechao; Li, Hongyi; Zheng, Xiongfei

2016-01-01

We propose the architecture of a novel robot system merging biological and artificial intelligence based on a neural controller connected to an external agent. We initially built a framework that connected the dissociated neural network to a mobile robot system to implement a realistic vehicle. The mobile robot system characterized by a camera and two-wheeled robot was designed to execute the target-searching task. We modified a software architecture and developed a home-made stimulation generator to build a bi-directional connection between the biological and the artificial components via simple binomial coding/decoding schemes. In this paper, we utilized a specific hierarchical dissociated neural network for the first time as the neural controller. Based on our work, neural cultures were successfully employed to control an artificial agent resulting in high performance. Surprisingly, under the tetanus stimulus training, the robot performed better and better with the increasement of training cycle because of the short-term plasticity of neural network (a kind of reinforced learning). Comparing to the work previously reported, we adopted an effective experimental proposal (i.e. increasing the training cycle) to make sure of the occurrence of the short-term plasticity, and preliminarily demonstrated that the improvement of the robot's performance could be caused independently by the plasticity development of dissociated neural network. This new framework may provide some possible solutions for the learning abilities of intelligent robots by the engineering application of the plasticity processing of neural networks, also for the development of theoretical inspiration for the next generation neuro-prostheses on the basis of the bi-directional exchange of information within the hierarchical neural networks.

A Novel Robot System Integrating Biological and Mechanical Intelligence Based on Dissociated Neural Network-Controlled Closed-Loop Environment.

Directory of Open Access Journals (Sweden)

Yongcheng Li

Full Text Available We propose the architecture of a novel robot system merging biological and artificial intelligence based on a neural controller connected to an external agent. We initially built a framework that connected the dissociated neural network to a mobile robot system to implement a realistic vehicle. The mobile robot system characterized by a camera and two-wheeled robot was designed to execute the target-searching task. We modified a software architecture and developed a home-made stimulation generator to build a bi-directional connection between the biological and the artificial components via simple binomial coding/decoding schemes. In this paper, we utilized a specific hierarchical dissociated neural network for the first time as the neural controller. Based on our work, neural cultures were successfully employed to control an artificial agent resulting in high performance. Surprisingly, under the tetanus stimulus training, the robot performed better and better with the increasement of training cycle because of the short-term plasticity of neural network (a kind of reinforced learning. Comparing to the work previously reported, we adopted an effective experimental proposal (i.e. increasing the training cycle to make sure of the occurrence of the short-term plasticity, and preliminarily demonstrated that the improvement of the robot's performance could be caused independently by the plasticity development of dissociated neural network. This new framework may provide some possible solutions for the learning abilities of intelligent robots by the engineering application of the plasticity processing of neural networks, also for the development of theoretical inspiration for the next generation neuro-prostheses on the basis of the bi-directional exchange of information within the hierarchical neural networks.

Fault detection and classification in electrical power transmission system using artificial neural network.

Science.gov (United States)

Jamil, Majid; Sharma, Sanjeev Kumar; Singh, Rajveer

2015-01-01

This paper focuses on the detection and classification of the faults on electrical power transmission line using artificial neural networks. The three phase currents and voltages of one end are taken as inputs in the proposed scheme. The feed forward neural network along with back propagation algorithm has been employed for detection and classification of the fault for analysis of each of the three phases involved in the process. A detailed analysis with varying number of hidden layers has been performed to validate the choice of the neural network. The simulation results concluded that the present method based on the neural network is efficient in detecting and classifying the faults on transmission lines with satisfactory performances. The different faults are simulated with different parameters to check the versatility of the method. The proposed method can be extended to the Distribution network of the Power System. The various simulations and analysis of signals is done in the MATLAB(®) environment.

Neural electrical activity and neural network growth.

Science.gov (United States)

Gafarov, F M

2018-05-01

The development of central and peripheral neural system depends in part on the emergence of the correct functional connectivity in its input and output pathways. Now it is generally accepted that molecular factors guide neurons to establish a primary scaffold that undergoes activity-dependent refinement for building a fully functional circuit. However, a number of experimental results obtained recently shows that the neuronal electrical activity plays an important role in the establishing of initial interneuronal connections. Nevertheless, these processes are rather difficult to study experimentally, due to the absence of theoretical description and quantitative parameters for estimation of the neuronal activity influence on growth in neural networks. In this work we propose a general framework for a theoretical description of the activity-dependent neural network growth. The theoretical description incorporates a closed-loop growth model in which the neural activity can affect neurite outgrowth, which in turn can affect neural activity. We carried out the detailed quantitative analysis of spatiotemporal activity patterns and studied the relationship between individual cells and the network as a whole to explore the relationship between developing connectivity and activity patterns. The model, developed in this work will allow us to develop new experimental techniques for studying and quantifying the influence of the neuronal activity on growth processes in neural networks and may lead to a novel techniques for constructing large-scale neural networks by self-organization. Copyright © 2018 Elsevier Ltd. All rights reserved.

Adaptive Neural Tracking Control for Discrete-Time Switched Nonlinear Systems with Dead Zone Inputs

Directory of Open Access Journals (Sweden)

Jidong Wang

2017-01-01

Full Text Available In this paper, the adaptive neural controllers of subsystems are proposed for a class of discrete-time switched nonlinear systems with dead zone inputs under arbitrary switching signals. Due to the complicated framework of the discrete-time switched nonlinear systems and the existence of the dead zone, it brings about difficulties for controlling such a class of systems. In addition, the radial basis function neural networks are employed to approximate the unknown terms of each subsystem. Switched update laws are designed while the parameter estimation is invariable until its corresponding subsystem is active. Then, the closed-loop system is stable and all the signals are bounded. Finally, to illustrate the effectiveness of the proposed method, an example is employed.

Neural systems for control

National Research Council Canada - National Science Library

Omidvar, Omid; Elliott, David L

1997-01-01

... is reprinted with permission from A. Barto, "Reinforcement Learning," Handbook of Brain Theory and Neural Networks, M.A. Arbib, ed.. The MIT Press, Cambridge, MA, pp. 804-809, 1995. Chapter 4, Figures 4-5 and 7-9 and Tables 2-5, are reprinted with permission, from S. Cho, "Map Formation in Proprioceptive Cortex," International Jour...

Study on algorithm of process neural network for soft sensing in sewage disposal system

Science.gov (United States)

Liu, Zaiwen; Xue, Hong; Wang, Xiaoyi; Yang, Bin; Lu, Siying

2006-11-01

A new method of soft sensing based on process neural network (PNN) for sewage disposal system is represented in the paper. PNN is an extension of traditional neural network, in which the inputs and outputs are time-variation. An aggregation operator is introduced to process neuron, and it makes the neuron network has the ability to deal with the information of space-time two dimensions at the same time, so the data processing enginery of biological neuron is imitated better than traditional neuron. Process neural network with the structure of three layers in which hidden layer is process neuron and input and output are common neurons for soft sensing is discussed. The intelligent soft sensing based on PNN may be used to fulfill measurement of the effluent BOD (Biochemical Oxygen Demand) from sewage disposal system, and a good training result of soft sensing was obtained by the method.

The equilibrium of neural firing: A mathematical theory

Energy Technology Data Exchange (ETDEWEB)

Lan, Sizhong, E-mail: lsz@fuyunresearch.org [Fuyun Research, Beijing, 100055 (China)

2014-12-15

Inspired by statistical thermodynamics, we presume that neuron system has equilibrium condition with respect to neural firing. We show that, even with dynamically changeable neural connections, it is inevitable for neural firing to evolve to equilibrium. To study the dynamics between neural firing and neural connections, we propose an extended communication system where noisy channel has the tendency towards fixed point, implying that neural connections are always attracted into fixed points such that equilibrium can be reached. The extended communication system and its mathematics could be useful back in thermodynamics.

A review of organic and inorganic biomaterials for neural interfaces.

Science.gov (United States)

Fattahi, Pouria; Yang, Guang; Kim, Gloria; Abidian, Mohammad Reza

2014-03-26

Recent advances in nanotechnology have generated wide interest in applying nanomaterials for neural prostheses. An ideal neural interface should create seamless integration into the nervous system and performs reliably for long periods of time. As a result, many nanoscale materials not originally developed for neural interfaces become attractive candidates to detect neural signals and stimulate neurons. In this comprehensive review, an overview of state-of-the-art microelectrode technologies provided fi rst, with focus on the material properties of these microdevices. The advancements in electro active nanomaterials are then reviewed, including conducting polymers, carbon nanotubes, graphene, silicon nanowires, and hybrid organic-inorganic nanomaterials, for neural recording, stimulation, and growth. Finally, technical and scientific challenges are discussed regarding biocompatibility, mechanical mismatch, and electrical properties faced by these nanomaterials for the development of long-lasting functional neural interfaces.

Bifurcation and chaos in neural excitable system

International Nuclear Information System (INIS)

Jing Zhujun; Yang Jianping; Feng Wei

2006-01-01

In this paper, we investigate the dynamical behaviors of neural excitable system without periodic external current (proposed by Chialvo [Generic excitable dynamics on a two-dimensional map. Chaos, Solitons and Fractals 1995;5(3-4):461-79] and with periodic external current as system's parameters vary. The existence and stability of three fixed points, bifurcation of fixed points, the conditions of existences of fold bifurcation, flip bifurcation and Hopf bifurcation are derived by using bifurcation theory and center manifold theorem. The chaotic existence in the sense of Marotto's definition of chaos is proved. We then give the numerical simulated results (using bifurcation diagrams, computations of Maximum Lyapunov exponent and phase portraits), which not only show the consistence with the analytic results but also display new and interesting dynamical behaviors, including the complete period-doubling and inverse period-doubling bifurcation, symmetry period-doubling bifurcations of period-3 orbit, simultaneous occurrence of two different routes (invariant cycle and period-doubling bifurcations) to chaos for a given bifurcation parameter, sudden disappearance of chaos at one critical point, a great abundance of period windows (period 2 to 10, 12, 19, 20 orbits, and so on) in transient chaotic regions with interior crises, strange chaotic attractors and strange non-chaotic attractor. In particular, the parameter k plays a important role in the system, which can leave the chaotic behavior or the quasi-periodic behavior to period-1 orbit as k varies, and it can be considered as an control strategy of chaos by adjusting the parameter k. Combining the existing results in [Generic excitable dynamics on a two-dimensional map. Chaos, Solitons and Fractals 1995;5(3-4):461-79] with the new results reported in this paper, a more complete description of the system is now obtained

Firing patterns transition and desynchronization induced by time delay in neural networks

Science.gov (United States)

Huang, Shoufang; Zhang, Jiqian; Wang, Maosheng; Hu, Chin-Kun

2018-06-01

We used the Hindmarsh-Rose (HR) model (Hindmarsh and Rose, 1984) to study the effect of time delay on the transition of firing behaviors and desynchronization in neural networks. As time delay is increased, neural networks exhibit diversity of firing behaviors, including regular spiking or bursting and firing patterns transitions (FPTs). Meanwhile, the desynchronization of firing and unstable bursting with decreasing amplitude in neural system, are also increasingly enhanced with the increase of time delay. Furthermore, we also studied the effect of coupling strength and network randomness on these phenomena. Our results imply that time delays can induce transition and desynchronization of firing behaviors in neural networks. These findings provide new insight into the role of time delay in the firing activities of neural networks, and can help to better understand the firing phenomena in complex systems of neural networks. A possible mechanism in brain that can cause the increase of time delay is discussed.

A Wavelet Neural Network Optimal Control Model for Traffic-Flow Prediction in Intelligent Transport Systems

Science.gov (United States)

Huang, Darong; Bai, Xing-Rong

Based on wavelet transform and neural network theory, a traffic-flow prediction model, which was used in optimal control of Intelligent Traffic system, is constructed. First of all, we have extracted the scale coefficient and wavelet coefficient from the online measured raw data of traffic flow via wavelet transform; Secondly, an Artificial Neural Network model of Traffic-flow Prediction was constructed and trained using the coefficient sequences as inputs and raw data as outputs; Simultaneous, we have designed the running principium of the optimal control system of traffic-flow Forecasting model, the network topological structure and the data transmitted model; Finally, a simulated example has shown that the technique is effectively and exactly. The theoretical results indicated that the wavelet neural network prediction model and algorithms have a broad prospect for practical application.

Examination of neural systems sub-serving facebook "addiction".

Science.gov (United States)

Turel, Ofir; He, Qinghua; Xue, Gui; Xiao, Lin; Bechara, Antoine

2014-12-01

Because addictive behaviors typically result from violated homeostasis of the impulsive (amygdala-striatal) and inhibitory (prefrontal cortex) brain systems, this study examined whether these systems sub-serve a specific case of technology-related addiction, namely Facebook "addiction." Using a go/no-go paradigm in functional MRI settings, the study examined how these brain systems in 20 Facebook users (M age = 20.3 yr., SD = 1.3, range = 18-23) who completed a Facebook addiction questionnaire, responded to Facebook and less potent (traffic sign) stimuli. The findings indicated that at least at the examined levels of addiction-like symptoms, technology-related "addictions" share some neural features with substance and gambling addictions, but more importantly they also differ from such addictions in their brain etiology and possibly pathogenesis, as related to abnormal functioning of the inhibitory-control brain system.

Neural Networks: Implementations and Applications

OpenAIRE

Vonk, E.; Veelenturf, L.P.J.; Jain, L.C.

1996-01-01

Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas

Estimating the behavior of RC beams strengthened with NSM system using artificial neural networks

Directory of Open Access Journals (Sweden)

Seyed Rohollah Hosseini Vaez

2017-12-01

Full Text Available In the last decade, conventional materials such as steel and concrete are being replaced by fiber reinforced polymer (FRP materials for the strengthening of concrete structures. Among the strengthening techniques based on Fiber Reinforced Polymer composites, the use of near-surface mounted (NSM FRP rods is emerging as a promising technology for increasing flexural and shear strength of deficient concrete, masonry and timber members. An artificial neural network is an information processing tool that is inspired by the way biological nervous systems (such as the brain process the information. The key element of this tool is the novel structure of the information processing system. In engineering applications, a neural network can be a vector mapper which maps an input vector to an output one. In the present study, a new approach is developed to predict the behavior of strengthened concrete beam using a large number of experimental data by applying artificial neural networks. Having parameters used as input nodes in ANN modeling such as elastic modulus of the FRP reinforcement, the ratio of the steel longitudinal reinforcement, dimensions of the beam section, the ratio of the NSM-FRP reinforcement and characteristics of concrete, the output node was the flexural strength of beams. The idealized neural network was employed to generate empirical charts and equations to be used in design. The aim of this study is to investigate the behavior of strengthened RC beam using artificial neural networks.

Neural Population Dynamics during Reaching Are Better Explained by a Dynamical System than Representational Tuning.

Science.gov (United States)

Michaels, Jonathan A; Dann, Benjamin; Scherberger, Hansjörg

2016-11-01

Recent models of movement generation in motor cortex have sought to explain neural activity not as a function of movement parameters, known as representational models, but as a dynamical system acting at the level of the population. Despite evidence supporting this framework, the evaluation of representational models and their integration with dynamical systems is incomplete in the literature. Using a representational velocity-tuning based simulation of center-out reaching, we show that incorporating variable latency offsets between neural activity and kinematics is sufficient to generate rotational dynamics at the level of neural populations, a phenomenon observed in motor cortex. However, we developed a covariance-matched permutation test (CMPT) that reassigns neural data between task conditions independently for each neuron while maintaining overall neuron-to-neuron relationships, revealing that rotations based on the representational model did not uniquely depend on the underlying condition structure. In contrast, rotations based on either a dynamical model or motor cortex data depend on this relationship, providing evidence that the dynamical model more readily explains motor cortex activity. Importantly, implementing a recurrent neural network we demonstrate that both representational tuning properties and rotational dynamics emerge, providing evidence that a dynamical system can reproduce previous findings of representational tuning. Finally, using motor cortex data in combination with the CMPT, we show that results based on small numbers of neurons or conditions should be interpreted cautiously, potentially informing future experimental design. Together, our findings reinforce the view that representational models lack the explanatory power to describe complex aspects of single neuron and population level activity.

Psychological Processing in Chronic Pain: A Neural Systems Approach

OpenAIRE

Simons, Laura; Elman, Igor; Borsook, David

2013-01-01

Our understanding of chronic pain involves complex brain circuits that include sensory, emotional, cognitive and interoceptive processing. The feed-forward interactions between physical (e.g., trauma) and emotional pain and the consequences of altered psychological status on the expression of pain have made the evaluation and treatment of chronic pain a challenge in the clinic. By understanding the neural circuits involved in psychological processes, a mechanistic approach to the implementati...

Monitoring nuclear reactor systems using neural networks and fuzzy logic

International Nuclear Information System (INIS)

Ikonomopoulos, A.; Tsoukalas, L.H.; Uhrig, R.E.; Mullens, J.A.

1991-01-01

A new approach is presented that demonstrates the potential of trained artificial neural networks (ANNs) as generators of membership functions for the purpose of monitoring nuclear reactor systems. ANN's provide a complex-to-simple mapping of reactor parameters in a process analogous to that of measurement. Through such ''virtual measurements'' the value of parameters with operational significance, e.g., control-valve-disk-position, valve-line-up or performance can be determined. In the methodology presented the output of a virtual measuring device is a set of membership functions which independently represent different states of the system. Utilizing a fuzzy logic representation offers the advantage of describing the state of the system in a condensed form, developed through linguistic descriptions and convenient for application in monitoring, diagnostics and generally control algorithms. The developed methodology is applied to the problem of measuring the disk position of the secondary flow control valve of an experimental reactor using data obtained during a start-up. The enhanced noise tolerance of the methodology is clearly demonstrated as well as a method for selecting the actual output. The results suggest that it is possible to construct virtual measuring devices through artificial neural networks mapping dynamic time series to a set of membership functions and thus enhance the capability of monitoring systems. 8 refs., 11 figs., 1 tab

New Solutions to the Firing Squad Synchronization Problems for Neural and Hyperdag P Systems

Directory of Open Access Journals (Sweden)

Michael J. Dinneen

2009-11-01

Full Text Available We propose two uniform solutions to an open question: the Firing Squad Synchronization Problem (FSSP, for hyperdag and symmetric neural P systems, with anonymous cells. Our solutions take e_c+5 and 6e_c+7 steps, respectively, where e_c is the eccentricity of the commander cell of the dag or digraph underlying these P systems. The first and fast solution is based on a novel proposal, which dynamically extends P systems with mobile channels. The second solution is substantially longer, but is solely based on classical rules and static channels. In contrast to the previous solutions, which work for tree-based P systems, our solutions synchronize to any subset of the underlying digraph; and do not require membrane polarizations or conditional rules, but require states, as typically used in hyperdag and neural P systems.

Combining neural networks and signed particles to simulate quantum systems more efficiently

Science.gov (United States)

Sellier, Jean Michel

2018-04-01

Recently a new formulation of quantum mechanics has been suggested which describes systems by means of ensembles of classical particles provided with a sign. This novel approach mainly consists of two steps: the computation of the Wigner kernel, a multi-dimensional function describing the effects of the potential over the system, and the field-less evolution of the particles which eventually create new signed particles in the process. Although this method has proved to be extremely advantageous in terms of computational resources - as a matter of fact it is able to simulate in a time-dependent fashion many-body systems on relatively small machines - the Wigner kernel can represent the bottleneck of simulations of certain systems. Moreover, storing the kernel can be another issue as the amount of memory needed is cursed by the dimensionality of the system. In this work, we introduce a new technique which drastically reduces the computation time and memory requirement to simulate time-dependent quantum systems which is based on the use of an appropriately tailored neural network combined with the signed particle formalism. In particular, the suggested neural network is able to compute efficiently and reliably the Wigner kernel without any training as its entire set of weights and biases is specified by analytical formulas. As a consequence, the amount of memory for quantum simulations radically drops since the kernel does not need to be stored anymore as it is now computed by the neural network itself, only on the cells of the (discretized) phase-space which are occupied by particles. As its is clearly shown in the final part of this paper, not only this novel approach drastically reduces the computational time, it also remains accurate. The author believes this work opens the way towards effective design of quantum devices, with incredible practical implications.

Neurophysiology and neural engineering: a review.

Science.gov (United States)

Prochazka, Arthur

2017-08-01

Neurophysiology is the branch of physiology concerned with understanding the function of neural systems. Neural engineering (also known as neuroengineering) is a discipline within biomedical engineering that uses engineering techniques to understand, repair, replace, enhance, or otherwise exploit the properties and functions of neural systems. In most cases neural engineering involves the development of an interface between electronic devices and living neural tissue. This review describes the origins of neural engineering, the explosive development of methods and devices commencing in the late 1950s, and the present-day devices that have resulted. The barriers to interfacing electronic devices with living neural tissues are many and varied, and consequently there have been numerous stops and starts along the way. Representative examples are discussed. None of this could have happened without a basic understanding of the relevant neurophysiology. I also consider examples of how neural engineering is repaying the debt to basic neurophysiology with new knowledge and insight. Copyright © 2017 the American Physiological Society.

Adaptive Neural Output-Feedback Control for a Class of Nonlower Triangular Nonlinear Systems With Unmodeled Dynamics.

Science.gov (United States)

Wang, Huanqing; Liu, Peter Xiaoping; Li, Shuai; Wang, Ding

2017-08-29

This paper presents the development of an adaptive neural controller for a class of nonlinear systems with unmodeled dynamics and immeasurable states. An observer is designed to estimate system states. The structure consistency of virtual control signals and the variable partition technique are combined to overcome the difficulties appearing in a nonlower triangular form. An adaptive neural output-feedback controller is developed based on the backstepping technique and the universal approximation property of the radial basis function (RBF) neural networks. By using the Lyapunov stability analysis, the semiglobally and uniformly ultimate boundedness of all signals within the closed-loop system is guaranteed. The simulation results show that the controlled system converges quickly, and all the signals are bounded. This paper is novel at least in the two aspects: 1) an output-feedback control strategy is developed for a class of nonlower triangular nonlinear systems with unmodeled dynamics and 2) the nonlinear disturbances and their bounds are the functions of all states, which is in a more general form than existing results.

Viewing pictures of a romantic partner reduces experimental pain: involvement of neural reward systems.

Science.gov (United States)

Younger, Jarred; Aron, Arthur; Parke, Sara; Chatterjee, Neil; Mackey, Sean

2010-10-13

The early stages of a new romantic relationship are characterized by intense feelings of euphoria, well-being, and preoccupation with the romantic partner. Neuroimaging research has linked those feelings to activation of reward systems in the human brain. The results of those studies may be relevant to pain management in humans, as basic animal research has shown that pharmacologic activation of reward systems can substantially reduce pain. Indeed, viewing pictures of a romantic partner was recently demonstrated to reduce experimental thermal pain. We hypothesized that pain relief evoked by viewing pictures of a romantic partner would be associated with neural activations in reward-processing centers. In this functional magnetic resonance imaging (fMRI) study, we examined fifteen individuals in the first nine months of a new, romantic relationship. Participants completed three tasks under periods of moderate and high thermal pain: 1) viewing pictures of their romantic partner, 2) viewing pictures of an equally attractive and familiar acquaintance, and 3) a word-association distraction task previously demonstrated to reduce pain. The partner and distraction tasks both significantly reduced self-reported pain, although only the partner task was associated with activation of reward systems. Greater analgesia while viewing pictures of a romantic partner was associated with increased activity in several reward-processing regions, including the caudate head, nucleus accumbens, lateral orbitofrontal cortex, amygdala, and dorsolateral prefrontal cortex--regions not associated with distraction-induced analgesia. The results suggest that the activation of neural reward systems via non-pharmacologic means can reduce the experience of pain.

Predicting physical time series using dynamic ridge polynomial neural networks.

Directory of Open Access Journals (Sweden)

Dhiya Al-Jumeily

Full Text Available Forecasting naturally occurring phenomena is a common problem in many domains of science, and this has been addressed and investigated by many scientists. The importance of time series prediction stems from the fact that it has wide range of applications, including control systems, engineering processes, environmental systems and economics. From the knowledge of some aspects of the previous behaviour of the system, the aim of the prediction process is to determine or predict its future behaviour. In this paper, we consider a novel application of a higher order polynomial neural network architecture called Dynamic Ridge Polynomial Neural Network that combines the properties of higher order and recurrent neural networks for the prediction of physical time series. In this study, four types of signals have been used, which are; The Lorenz attractor, mean value of the AE index, sunspot number, and heat wave temperature. The simulation results showed good improvements in terms of the signal to noise ratio in comparison to a number of higher order and feedforward neural networks in comparison to the benchmarked techniques.

Precision position control of servo systems using adaptive back-stepping and recurrent fuzzy neural networks

International Nuclear Information System (INIS)

Kim, Han Me; Kim, Jong Shik; Han, Seong Ik

2009-01-01

To improve position tracking performance of servo systems, a position tracking control using adaptive back-stepping control(ABSC) scheme and recurrent fuzzy neural networks(RFNN) is proposed. An adaptive rule of the ABSC based on system dynamics and dynamic friction model is also suggested to compensate nonlinear dynamic friction characteristics. However, it is difficult to reduce the position tracking error of servo systems by using only the ABSC scheme because of the system uncertainties which cannot be exactly identified during the modeling of servo systems. Therefore, in order to overcome system uncertainties and then to improve position tracking performance of servo systems, the RFNN technique is additionally applied to the servo system. The feasibility of the proposed control scheme for a servo system is validated through experiments. Experimental results show that the servo system with ABS controller based on the dual friction observer and RFNN including the reconstruction error estimator can achieve desired tracking performance and robustness

Context-Dependent Neural Modulations in the Perception of Duration.

Science.gov (United States)

Murai, Yuki; Yotsumoto, Yuko

2016-01-01

Recent neuroimaging studies have revealed that distinct brain networks are recruited in the perception of sub- and supra-second timescales, whereas psychophysical studies have suggested that there are common or continuous mechanisms for perceiving these two durations. The present study aimed to elucidate the neural implementation of such continuity by examining the neural correlates of peri-second timing. We measured neural activity during a duration reproduction task using functional magnetic resonance imaging. Our results replicate the findings of previous studies in showing that separate neural networks are recruited for sub-versus supra-second time perception: motor systems including the motor cortex and the supplementary motor area for sub-second perception, and the frontal, parietal, and auditory cortical areas for supra-second perception. We further found that the peri-second perception activated both the sub- and supra-second networks, and that the timing system that processed duration perception in previous trials was more involved in subsequent peri-second processing. These results indicate that the sub- and supra-second timing systems overlap at around 1 s, and cooperate to optimally encode duration based on the hysteresis of previous trials.

Identification of chaotic systems by neural network with hybrid learning algorithm

International Nuclear Information System (INIS)

Pan, S.-T.; Lai, C.-C.

2008-01-01

Based on the genetic algorithm (GA) and steepest descent method (SDM), this paper proposes a hybrid algorithm for the learning of neural networks to identify chaotic systems. The systems in question are the logistic map and the Duffing equation. Different identification schemes are used to identify both the logistic map and the Duffing equation, respectively. Simulation results show that our hybrid algorithm is more efficient than that of other methods

On control of Hopf bifurcation in time-delayed neural network system

International Nuclear Information System (INIS)

Zhou Shangbo; Liao Xiaofeng; Yu Juebang; Wong Kwokwo

2005-01-01

The control of Hopf bifurcations in neural network systems is studied in this Letter. The asymptotic stability theorem and the relevant corollary for linearized nonlinear dynamical systems are proven. In particular, a novel method for analyzing the local stability of a dynamical system with time-delay is suggested. For the time-delayed system consisting of one or two neurons, a washout filter based control model is proposed and analyzed. By employing the stability theorems derived, we investigate the stability of a control system and state the relevant theorems for choosing the parameters of the stabilized control system

Sejarah, Penerapan, dan Analisis Resiko dari Neural Network: Sebuah Tinjauan Pustaka

Directory of Open Access Journals (Sweden)

Cristina Cristina

2018-05-01

Full Text Available A neural network is a form of artificial intelligence that has the ability to learn, grow, and adapt in a dynamic environment. Neural network began since 1890 because a great American psychologist named William James created the book "Principles of Psycology". James was the first one publish a number of facts related to the structure and function of the brain. The history of neural network development is divided into 4 epochs, the Camelot era, the Depression, the Renaissance, and the Neoconnectiosm era. Neural networks used today are not 100 percent accurate. However, neural networks are still used because of better performance than alternative computing models. The use of neural network consists of pattern recognition, signal analysis, robotics, and expert systems. For risk analysis of the neural network, it is first performed using hazards and operability studies (HAZOPS. Determining the neural network requirements in a good way will help in determining its contribution to system hazards and validating the control or mitigation of any hazards. After completion of the first stage at HAZOPS and the second stage determines the requirements, the next stage is designing. Neural network underwent repeated design-train-test development. At the design stage, the hazard analysis should consider the design aspects of the development, which include neural network architecture, size, intended use, and so on. It will be continued at the implementation stage, test phase, installation and inspection phase, operation phase, and ends at the maintenance stage.

A New Neural Network Approach to Short Term Load Forecasting of Electrical Power Systems

Directory of Open Access Journals (Sweden)

Farshid Keynia

2011-03-01

Full Text Available Short-term load forecast (STLF is an important operational function in both regulated power systems and deregulated open electricity markets. However, STLF is not easy to handle due to the nonlinear and random-like behaviors of system loads, weather conditions, and social and economic environment variations. Despite the research work performed in the area, more accurate and robust STLF methods are still needed due to the importance and complexity of STLF. In this paper, a new neural network approach for STLF is proposed. The proposed neural network has a novel learning algorithm based on a new modified harmony search technique. This learning algorithm can widely search the solution space in various directions, and it can also avoid the overfitting problem, trapping in local minima and dead bands. Based on this learning algorithm, the suggested neural network can efficiently extract the input/output mapping function of the forecast process leading to high STLF accuracy. The proposed approach is tested on two practical power systems and the results obtained are compared with the results of several other recently published STLF methods. These comparisons confirm the validity of the developed approach.

Neural Control and Adaptive Neural Forward Models for Insect-like, Energy-Efficient, and Adaptable Locomotion of Walking Machines

Directory of Open Access Journals (Sweden)

Poramate eManoonpong

2013-02-01

Full Text Available Living creatures, like walking animals, have found fascinating solutions for the problem of locomotion control. Their movements show the impression of elegance including versatile, energy-efficient, and adaptable locomotion. During the last few decades, roboticists have tried to imitate such natural properties with artificial legged locomotion systems by using different approaches including machine learning algorithms, classical engineering control techniques, and biologically-inspired control mechanisms. However, their levels of performance are still far from the natural ones. By contrast, animal locomotion mechanisms seem to largely depend not only on central mechanisms (central pattern generators, CPGs and sensory feedback (afferent-based control but also on internal forward models (efference copies. They are used to a different degree in different animals. Generally, CPGs organize basic rhythmic motions which are shaped by sensory feedback while internal models are used for sensory prediction and state estimations. According to this concept, we present here adaptive neural locomotion control consisting of a CPG mechanism with neuromodulation and local leg control mechanisms based on sensory feedback and adaptive neural forward models with efference copies. This neural closed-loop controller enables a walking machine to perform a multitude of different walking patterns including insect-like leg movements and gaits as well as energy-efficient locomotion. In addition, the forward models allow the machine to autonomously adapt its locomotion to deal with a change of terrain, losing of ground contact during stance phase, stepping on or hitting an obstacle during swing phase, leg damage, and even to promote cockroach-like climbing behavior. Thus, the results presented here show that the employed embodied neural closed-loop system can be a powerful way for developing robust and adaptable machines.

Development and Flight Testing of a Neural Network Based Flight Control System on the NF-15B Aircraft

Science.gov (United States)

Bomben, Craig R.; Smolka, James W.; Bosworth, John T.; Silliams-Hayes, Peggy S.; Burken, John J.; Larson, Richard R.; Buschbacher, Mark J.; Maliska, Heather A.

2006-01-01

The Intelligent Flight Control System (IFCS) project at the NASA Dryden Flight Research Center, Edwards AFB, CA, has been investigating the use of neural network based adaptive control on a unique NF-15B test aircraft. The IFCS neural network is a software processor that stores measured aircraft response information to dynamically alter flight control gains. In 2006, the neural network was engaged and allowed to learn in real time to dynamically alter the aircraft handling qualities characteristics in the presence of actual aerodynamic failure conditions injected into the aircraft through the flight control system. The use of neural network and similar adaptive technologies in the design of highly fault and damage tolerant flight control systems shows promise in making future aircraft far more survivable than current technology allows. This paper will present the results of the IFCS flight test program conducted at the NASA Dryden Flight Research Center in 2006, with emphasis on challenges encountered and lessons learned.

PID Neural Network Based Speed Control of Asynchronous Motor Using Programmable Logic Controller

Directory of Open Access Journals (Sweden)

MARABA, V. A.

2011-11-01

Full Text Available This paper deals with the structure and characteristics of PID Neural Network controller for single input and single output systems. PID Neural Network is a new kind of controller that includes the advantages of artificial neural networks and classic PID controller. Functioning of this controller is based on the update of controller parameters according to the value extracted from system output pursuant to the rules of back propagation algorithm used in artificial neural networks. Parameters obtained from the application of PID Neural Network training algorithm on the speed model of the asynchronous motor exhibiting second order linear behavior were used in the real time speed control of the motor. Programmable logic controller (PLC was used as real time controller. The real time control results show that reference speed successfully maintained under various load conditions.

The Effects of Low-Dose Bisphenol A and Bisphenol F on Neural Differentiation of a Fetal Brain-Derived Neural Progenitor Cell Line.

Science.gov (United States)

Fujiwara, Yuki; Miyazaki, Wataru; Koibuchi, Noriyuki; Katoh, Takahiko

2018-01-01

Environmental chemicals are known to disrupt the endocrine system in humans and to have adverse effects on several organs including the developing brain. Recent studies indicate that exposure to environmental chemicals during gestation can interfere with neuronal differentiation, subsequently affecting normal brain development in newborns. Xenoestrogen, bisphenol A (BPA), which is widely used in plastic products, is one such chemical. Adverse effects of exposure to BPA during pre- and postnatal periods include the disruption of brain function. However, the effect of BPA on neural differentiation remains unclear. In this study, we explored the effects of BPA or bisphenol F (BPF), an alternative compound for BPA, on neural differentiation using ReNcell, a human fetus-derived neural progenitor cell line. Maintenance in growth factor-free medium initiated the differentiation of ReNcell to neuronal cells including neurons, astrocytes, and oligodendrocytes. We exposed the cells to BPA or BPF for 3 days from the period of initiation and performed real-time PCR for neural markers such as β III-tubulin and glial fibrillary acidic protein (GFAP), and Olig2. The β III-tubulin mRNA level decreased in response to BPA, but not BPF, exposure. We also observed that the number of β III-tubulin-positive cells in the BPA-exposed group was less than that of the control group. On the other hand, there were no changes in the MAP2 mRNA level. These results indicate that BPA disrupts neural differentiation in human-derived neural progenitor cells, potentially disrupting brain development.

The Effects of Low-Dose Bisphenol A and Bisphenol F on Neural Differentiation of a Fetal Brain-Derived Neural Progenitor Cell Line

Directory of Open Access Journals (Sweden)

Yuki Fujiwara

2018-02-01

Full Text Available Environmental chemicals are known to disrupt the endocrine system in humans and to have adverse effects on several organs including the developing brain. Recent studies indicate that exposure to environmental chemicals during gestation can interfere with neuronal differentiation, subsequently affecting normal brain development in newborns. Xenoestrogen, bisphenol A (BPA, which is widely used in plastic products, is one such chemical. Adverse effects of exposure to BPA during pre- and postnatal periods include the disruption of brain function. However, the effect of BPA on neural differentiation remains unclear. In this study, we explored the effects of BPA or bisphenol F (BPF, an alternative compound for BPA, on neural differentiation using ReNcell, a human fetus-derived neural progenitor cell line. Maintenance in growth factor-free medium initiated the differentiation of ReNcell to neuronal cells including neurons, astrocytes, and oligodendrocytes. We exposed the cells to BPA or BPF for 3 days from the period of initiation and performed real-time PCR for neural markers such as β III-tubulin and glial fibrillary acidic protein (GFAP, and Olig2. The β III-tubulin mRNA level decreased in response to BPA, but not BPF, exposure. We also observed that the number of β III-tubulin-positive cells in the BPA-exposed group was less than that of the control group. On the other hand, there were no changes in the MAP2 mRNA level. These results indicate that BPA disrupts neural differentiation in human-derived neural progenitor cells, potentially disrupting brain development.

Classical Conditioning with Pulsed Integrated Neural Networks: Circuits and System

DEFF Research Database (Denmark)

Lehmann, Torsten

1998-01-01

In this paper we investigate on-chip learning for pulsed, integrated neural networks. We discuss the implementational problems the technology imposes on learning systems and we find that abiologically inspired approach using simple circuit structures is most likely to bring success. We develop a ...... chip to solve simple classical conditioning tasks, thus verifying the design methodologies put forward in the paper....

Neural-network hybrid control for antilock braking systems.

Science.gov (United States)

Lin, Chih-Min; Hsu, C F

2003-01-01

The antilock braking systems are designed to maximize wheel traction by preventing the wheels from locking during braking, while also maintaining adequate vehicle steerability; however, the performance is often degraded under harsh road conditions. In this paper, a hybrid control system with a recurrent neural network (RNN) observer is developed for antilock braking systems. This hybrid control system is comprised of an ideal controller and a compensation controller. The ideal controller, containing an RNN uncertainty observer, is the principal controller; and the compensation controller is a compensator for the difference between the system uncertainty and the estimated uncertainty. Since for dynamic response the RNN has capabilities superior to the feedforward NN, it is utilized for the uncertainty observer. The Taylor linearization technique is employed to increase the learning ability of the RNN. In addition, the on-line parameter adaptation laws are derived based on a Lyapunov function, so the stability of the system can be guaranteed. Simulations are performed to demonstrate the effectiveness of the proposed NN hybrid control system for antilock braking control under various road conditions.

Child Maltreatment and Neural Systems Underlying Emotion Regulation.

Science.gov (United States)

McLaughlin, Katie A; Peverill, Matthew; Gold, Andrea L; Alves, Sonia; Sheridan, Margaret A

2015-09-01

The strong associations between child maltreatment and psychopathology have generated interest in identifying neurodevelopmental processes that are disrupted following maltreatment. Previous research has focused largely on neural response to negative facial emotion. We determined whether child maltreatment was associated with neural responses during passive viewing of negative and positive emotional stimuli and effortful attempts to regulate emotional responses. A total of 42 adolescents aged 13 to 19 years, half with exposure to physical and/or sexual abuse, participated. Blood oxygen level-dependent (BOLD) response was measured during passive viewing of negative and positive emotional stimuli and attempts to modulate emotional responses using cognitive reappraisal. Maltreated adolescents exhibited heightened response in multiple nodes of the salience network, including amygdala, putamen, and anterior insula, to negative relative to neutral stimuli. During attempts to decrease responses to negative stimuli relative to passive viewing, maltreatment was associated with greater recruitment of superior frontal gyrus, dorsal anterior cingulate cortex, and frontal pole; adolescents with and without maltreatment down-regulated amygdala response to a similar degree. No associations were observed between maltreatment and neural response to positive emotional stimuli during passive viewing or effortful regulation. Child maltreatment heightens the salience of negative emotional stimuli. Although maltreated adolescents modulate amygdala responses to negative cues to a degree similar to that of non-maltreated youths, they use regions involved in effortful control to a greater degree to do so, potentially because greater effort is required to modulate heightened amygdala responses. These findings are promising, given the centrality of cognitive restructuring in trauma-focused treatments for children. Copyright © 2015 American Academy of Child and Adolescent Psychiatry

Neural networks and their potential application to nuclear power plants

International Nuclear Information System (INIS)

Uhrig, R.E.

1991-01-01

A network of artificial neurons, usually called an artificial neural network is a data processing system consisting of a number of highly interconnected processing elements in an architecture inspired by the structure of the cerebral cortex portion of the brain. Hence, neural networks are often capable of doing things which humans or animals do well but which conventional computers often do poorly. Neural networks exhibit characteristics and capabilities not provided by any other technology. Neural networks may be designed so as to classify an input pattern as one of several predefined types or to create, as needed, categories or classes of system states which can be interpreted by a human operator. Neural networks have the ability to recognize patterns, even when the information comprising these patterns is noisy, sparse, or incomplete. Thus, systems of artificial neural networks show great promise for use in environments in which robust, fault-tolerant pattern recognition is necessary in a real-time mode, and in which the incoming data may be distorted or noisy. The application of neural networks, a rapidly evolving technology used extensively in defense applications, alone or in conjunction with other advanced technologies, to some of the problems of operating nuclear power plants has the potential to enhance the safety, reliability and operability of nuclear power plants. The potential applications of neural networking include, but are not limited to diagnosing specific abnormal conditions, identification of nonlinear dynamics and transients, detection of the change of mode of operation, control of temperature and pressure during start-up, signal validation, plant-wide monitoring using autoassociative neural networks, monitoring of check valves, modeling of the plant thermodynamics, emulation of core reload calculations, analysis of temporal sequences in NRC's ''licensee event reports,'' and monitoring of plant parameters

Inductive differentiation of two neural lineages reconstituted in a microculture system from Xenopus early gastrula cells.

Science.gov (United States)

Mitani, S; Okamoto, H

1991-05-01

Neural induction of ectoderm cells has been reconstituted and examined in a microculture system derived from dissociated early gastrula cells of Xenopus laevis. We have used monoclonal antibodies as specific markers to monitor cellular differentiation from three distinct ectoderm lineages in culture (N1 for CNS neurons from neural tube, Me1 for melanophores from neural crest and E3 for skin epidermal cells from epidermal lineages). CNS neurons and melanophores differentiate when deep layer cells of the ventral ectoderm (VE, prospective epidermis region; 150 cells/culture) and an appropriate region of the marginal zone (MZ, prospective mesoderm region; 5-150 cells/culture) are co-cultured, but not in cultures of either cell type on their own; VE cells cultured alone yield epidermal cells as we have previously reported. The extent of inductive neural differentiation in the co-culture system strongly depends on the origin and number of MZ cells initially added to culture wells. The potency to induce CNS neurons is highest for dorsal MZ cells and sharply decreases as more ventrally located cells are used. The same dorsoventral distribution of potency is seen in the ability of MZ cells to inhibit epidermal differentiation. In contrast, the ability of MZ cells to induce melanophores shows the reverse polarity, ventral to dorsal. These data indicate that separate developmental mechanisms are used for the induction of neural tube and neural crest lineages. Co-differentiation of CNS neurons or melanophores with epidermal cells can be obtained in a single well of co-cultures of VE cells (150) and a wide range of numbers of MZ cells (5 to 100). Further, reproducible differentiation of both neural lineages requires intimate association between cells from the two gastrula regions; virtually no differentiation is obtained when cells from the VE and MZ are separated in a culture well. These results indicate that the inducing signals from MZ cells for both neural tube and neural

Ultra low-power integrated circuit design for wireless neural interfaces

CERN Document Server

Holleman, Jeremy; Otis, Brian

2014-01-01

Presenting results from real prototype systems, this volume provides an overview of ultra low-power integrated circuits and systems for neural signal processing and wireless communication. Topics include analog, radio, and signal processing theory and design for ultra low-power circuits.

Neural mirroring and social interaction: Motor system involvement during action observation relates to early peer cooperation.

Science.gov (United States)

Endedijk, H M; Meyer, M; Bekkering, H; Cillessen, A H N; Hunnius, S

2017-04-01

Whether we hand over objects to someone, play a team sport, or make music together, social interaction often involves interpersonal action coordination, both during instances of cooperation and entrainment. Neural mirroring is thought to play a crucial role in processing other's actions and is therefore considered important for social interaction. Still, to date, it is unknown whether interindividual differences in neural mirroring play a role in interpersonal coordination during different instances of social interaction. A relation between neural mirroring and interpersonal coordination has particularly relevant implications for early childhood, since successful early interaction with peers is predictive of a more favorable social development. We examined the relation between neural mirroring and children's interpersonal coordination during peer interaction using EEG and longitudinal behavioral data. Results showed that 4-year-old children with higher levels of motor system involvement during action observation (as indicated by lower beta-power) were more successful in early peer cooperation. This is the first evidence for a relation between motor system involvement during action observation and interpersonal coordination during other instances of social interaction. The findings suggest that interindividual differences in neural mirroring are related to interpersonal coordination and thus successful social interaction. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Combined expert system/neural networks method for process fault diagnosis

Science.gov (United States)

Reifman, Jaques; Wei, Thomas Y. C.

1995-01-01

A two-level hierarchical approach for process fault diagnosis is an operating system employs a function-oriented approach at a first level and a component characteristic-oriented approach at a second level, where the decision-making procedure is structured in order of decreasing intelligence with increasing precision. At the first level, the diagnostic method is general and has knowledge of the overall process including a wide variety of plant transients and the functional behavior of the process components. An expert system classifies malfunctions by function to narrow the diagnostic focus to a particular set of possible faulty components that could be responsible for the detected functional misbehavior of the operating system. At the second level, the diagnostic method limits its scope to component malfunctions, using more detailed knowledge of component characteristics. Trained artificial neural networks are used to further narrow the diagnosis and to uniquely identify the faulty component by classifying the abnormal condition data as a failure of one of the hypothesized components through component characteristics. Once an anomaly is detected, the hierarchical structure is used to successively narrow the diagnostic focus from a function misbehavior, i.e., a function oriented approach, until the fault can be determined, i.e., a component characteristic-oriented approach.

Combined expert system/neural networks method for process fault diagnosis

Science.gov (United States)

Reifman, J.; Wei, T.Y.C.

1995-08-15

A two-level hierarchical approach for process fault diagnosis of an operating system employs a function-oriented approach at a first level and a component characteristic-oriented approach at a second level, where the decision-making procedure is structured in order of decreasing intelligence with increasing precision. At the first level, the diagnostic method is general and has knowledge of the overall process including a wide variety of plant transients and the functional behavior of the process components. An expert system classifies malfunctions by function to narrow the diagnostic focus to a particular set of possible faulty components that could be responsible for the detected functional misbehavior of the operating system. At the second level, the diagnostic method limits its scope to component malfunctions, using more detailed knowledge of component characteristics. Trained artificial neural networks are used to further narrow the diagnosis and to uniquely identify the faulty component by classifying the abnormal condition data as a failure of one of the hypothesized components through component characteristics. Once an anomaly is detected, the hierarchical structure is used to successively narrow the diagnostic focus from a function misbehavior, i.e., a function oriented approach, until the fault can be determined, i.e., a component characteristic-oriented approach. 9 figs.

Adaptive Sliding Mode Control of MEMS Gyroscope Based on Neural Network Approximation

Directory of Open Access Journals (Sweden)

Yuzheng Yang

2014-01-01

Full Text Available An adaptive sliding controller using radial basis function (RBF network to approximate the unknown system dynamics microelectromechanical systems (MEMS gyroscope sensor is proposed. Neural controller is proposed to approximate the unknown system model and sliding controller is employed to eliminate the approximation error and attenuate the model uncertainties and external disturbances. Online neural network (NN weight tuning algorithms, including correction terms, are designed based on Lyapunov stability theory, which can guarantee bounded tracking errors as well as bounded NN weights. The tracking error bound can be made arbitrarily small by increasing a certain feedback gain. Numerical simulation for a MEMS angular velocity sensor is investigated to verify the effectiveness of the proposed adaptive neural control scheme and demonstrate the satisfactory tracking performance and robustness.

A Red-Light Running Prevention System Based on Artificial Neural Network and Vehicle Trajectory Data

Directory of Open Access Journals (Sweden)

Pengfei Li

2014-01-01

Full Text Available The high frequency of red-light running and complex driving behaviors at the yellow onset at intersections cannot be explained solely by the dilemma zone and vehicle kinematics. In this paper, the author presented a red-light running prevention system which was based on artificial neural networks (ANNs to approximate the complex driver behaviors during yellow and all-red clearance and serve as the basis of an innovative red-light running prevention system. The artificial neural network and vehicle trajectory are applied to identify the potential red-light runners. The ANN training time was also acceptable and its predicting accurate rate was over 80%. Lastly, a prototype red-light running prevention system with the trained ANN model was described. This new system can be directly retrofitted into the existing traffic signal systems.

A red-light running prevention system based on artificial neural network and vehicle trajectory data.

Science.gov (United States)

Li, Pengfei; Li, Yan; Guo, Xiucheng

2014-01-01

The high frequency of red-light running and complex driving behaviors at the yellow onset at intersections cannot be explained solely by the dilemma zone and vehicle kinematics. In this paper, the author presented a red-light running prevention system which was based on artificial neural networks (ANNs) to approximate the complex driver behaviors during yellow and all-red clearance and serve as the basis of an innovative red-light running prevention system. The artificial neural network and vehicle trajectory are applied to identify the potential red-light runners. The ANN training time was also acceptable and its predicting accurate rate was over 80%. Lastly, a prototype red-light running prevention system with the trained ANN model was described. This new system can be directly retrofitted into the existing traffic signal systems.

A Red-Light Running Prevention System Based on Artificial Neural Network and Vehicle Trajectory Data

Science.gov (United States)

Li, Pengfei; Li, Yan; Guo, Xiucheng

2014-01-01

The high frequency of red-light running and complex driving behaviors at the yellow onset at intersections cannot be explained solely by the dilemma zone and vehicle kinematics. In this paper, the author presented a red-light running prevention system which was based on artificial neural networks (ANNs) to approximate the complex driver behaviors during yellow and all-red clearance and serve as the basis of an innovative red-light running prevention system. The artificial neural network and vehicle trajectory are applied to identify the potential red-light runners. The ANN training time was also acceptable and its predicting accurate rate was over 80%. Lastly, a prototype red-light running prevention system with the trained ANN model was described. This new system can be directly retrofitted into the existing traffic signal systems. PMID:25435870

Neural codes of seeing architectural styles.

Science.gov (United States)

Choo, Heeyoung; Nasar, Jack L; Nikrahei, Bardia; Walther, Dirk B

2017-01-10

Images of iconic buildings, such as the CN Tower, instantly transport us to specific places, such as Toronto. Despite the substantial impact of architectural design on people's visual experience of built environments, we know little about its neural representation in the human brain. In the present study, we have found patterns of neural activity associated with specific architectural styles in several high-level visual brain regions, but not in primary visual cortex (V1). This finding suggests that the neural correlates of the visual perception of architectural styles stem from style-specific complex visual structure beyond the simple features computed in V1. Surprisingly, the network of brain regions representing architectural styles included the fusiform face area (FFA) in addition to several scene-selective regions. Hierarchical clustering of error patterns further revealed that the FFA participated to a much larger extent in the neural encoding of architectural styles than entry-level scene categories. We conclude that the FFA is involved in fine-grained neural encoding of scenes at a subordinate-level, in our case, architectural styles of buildings. This study for the first time shows how the human visual system encodes visual aspects of architecture, one of the predominant and longest-lasting artefacts of human culture.

Decentralized adaptive neural control for high-order interconnected stochastic nonlinear time-delay systems with unknown system dynamics.

Science.gov (United States)

Si, Wenjie; Dong, Xunde; Yang, Feifei

2018-03-01

This paper is concerned with the problem of decentralized adaptive backstepping state-feedback control for uncertain high-order large-scale stochastic nonlinear time-delay systems. For the control design of high-order large-scale nonlinear systems, only one adaptive parameter is constructed to overcome the over-parameterization, and neural networks are employed to cope with the difficulties raised by completely unknown system dynamics and stochastic disturbances. And then, the appropriate Lyapunov-Krasovskii functional and the property of hyperbolic tangent functions are used to deal with the unknown unmatched time-delay interactions of high-order large-scale systems for the first time. At last, on the basis of Lyapunov stability theory, the decentralized adaptive neural controller was developed, and it decreases the number of learning parameters. The actual controller can be designed so as to ensure that all the signals in the closed-loop system are semi-globally uniformly ultimately bounded (SGUUB) and the tracking error converges in the small neighborhood of zero. The simulation example is used to further show the validity of the design method. Copyright © 2018 Elsevier Ltd. All rights reserved.

Conserved gene regulatory module specifies lateral neural borders across bilaterians.

Science.gov (United States)

Li, Yongbin; Zhao, Di; Horie, Takeo; Chen, Geng; Bao, Hongcun; Chen, Siyu; Liu, Weihong; Horie, Ryoko; Liang, Tao; Dong, Biyu; Feng, Qianqian; Tao, Qinghua; Liu, Xiao

2017-08-01

The lateral neural plate border (NPB), the neural part of the vertebrate neural border, is composed of central nervous system (CNS) progenitors and peripheral nervous system (PNS) progenitors. In invertebrates, PNS progenitors are also juxtaposed to the lateral boundary of the CNS. Whether there are conserved molecular mechanisms determining vertebrate and invertebrate lateral neural borders remains unclear. Using single-cell-resolution gene-expression profiling and genetic analysis, we present evidence that orthologs of the NPB specification module specify the invertebrate lateral neural border, which is composed of CNS and PNS progenitors. First, like in vertebrates, the conserved neuroectoderm lateral border specifier Msx/vab-15 specifies lateral neuroblasts in Caenorhabditis elegans Second, orthologs of the vertebrate NPB specification module ( Msx/vab-15 , Pax3/7/pax-3 , and Zic/ref-2 ) are significantly enriched in worm lateral neuroblasts. In addition, like in other bilaterians, the expression domain of Msx/vab-15 is more lateral than those of Pax3/7/pax-3 and Zic/ref- 2 in C. elegans Third, we show that Msx/vab-15 regulates the development of mechanosensory neurons derived from lateral neural progenitors in multiple invertebrate species, including C. elegans , Drosophila melanogaster , and Ciona intestinalis We also identify a novel lateral neural border specifier, ZNF703/tlp-1 , which functions synergistically with Msx/vab- 15 in both C. elegans and Xenopus laevis These data suggest a common origin of the molecular mechanism specifying lateral neural borders across bilaterians.

Neural Network Modeling of the Lithium/Thionyl Chloride Battery System

Energy Technology Data Exchange (ETDEWEB)

Ingersoll, D.; Jungst, R.G.; O' Gorman, C.C.; Paez, T.L.

1998-10-29

Battery systems have traditionally relied on extensive build and test procedures for product realization. Analytical models have been developed to diminish this reliance, but have only been partially successful in consistently predicting the performance of battery systems. The complex set of interacting physical and chemical processes within battery systems has made the development of analytical models a significant challenge. Advanced simulation tools are needed to more accurately model battery systems which will reduce the time and cost required for product realization. Sandia has initiated an advanced model-based design strategy to battery systems, beginning with the performance of lithiumhhionyl chloride cells. As an alternative approach, we have begun development of cell performance modeling using non-phenomenological models for battery systems based on artificial neural networks (ANNs). ANNs are inductive models for simulating input/output mappings with certain advantages over phenomenological models, particularly for complex systems. Among these advantages is the ability to avoid making measurements of hard to determine physical parameters or having to understand cell processes sufficiently to write mathematical functions describing their behavior. For example, ANN models are also being studied for simulating complex physical processes within the Li/SOC12 cell, such as the time and temperature dependence of the anode interracial resistance. ANNs have been shown to provide a very robust and computationally efficient simulation tool for predicting voltage and capacity output for Li/SOC12 cells under a variety of operating conditions. The ANN modeling approach should be applicable to a wide variety of battery chemistries, including rechargeable systems.

UNMANNED AIR VEHICLE STABILIZATION BASED ON NEURAL NETWORK REGULATOR

Directory of Open Access Journals (Sweden)

S. S. Andropov

2016-09-01

Full Text Available A problem of stabilizing for the multirotor unmanned aerial vehicle in an environment with external disturbances is researched. A classic proportional-integral-derivative controller is analyzed, its flaws are outlined: inability to respond to changing of external conditions and the need for manual adjustment of coefficients. The paper presents an adaptive adjustment method for coefficients of the proportional-integral-derivative controller based on neural networks. A neural network structure, its input and output data are described. Neural networks with three layers are used to create an adaptive stabilization system for the multirotor unmanned aerial vehicle. Training of the networks is done with the back propagation method. Each neural network produces regulator coefficients for each angle of stabilization as its output. A method for network training is explained. Several graphs of transition process on different stages of learning, including processes with external disturbances, are presented. It is shown that the system meets stabilization requirements with sufficient number of iterations. Described adjustment method for coefficients can be used in remote control of unmanned aerial vehicles, operating in the changing environment.

Study on application of adaptive fuzzy control and neural network in the automatic leveling system

Science.gov (United States)

Xu, Xiping; Zhao, Zizhao; Lan, Weiyong; Sha, Lei; Qian, Cheng

2015-04-01

This paper discusses the adaptive fuzzy control and neural network BP algorithm in large flat automatic leveling control system application. The purpose is to develop a measurement system with a flat quick leveling, Make the installation on the leveling system of measurement with tablet, to be able to achieve a level in precision measurement work quickly, improve the efficiency of the precision measurement. This paper focuses on the automatic leveling system analysis based on fuzzy controller, Use of the method of combining fuzzy controller and BP neural network, using BP algorithm improve the experience rules .Construct an adaptive fuzzy control system. Meanwhile the learning rate of the BP algorithm has also been run-rate adjusted to accelerate convergence. The simulation results show that the proposed control method can effectively improve the leveling precision of automatic leveling system and shorten the time of leveling.

A training rule which guarantees finite-region stability for a class of closed-loop neural-network control systems.

Science.gov (United States)

Kuntanapreeda, S; Fullmer, R R

1996-01-01

A training method for a class of neural network controllers is presented which guarantees closed-loop system stability. The controllers are assumed to be nonlinear, feedforward, sampled-data, full-state regulators implemented as single hidden-layer neural networks. The controlled systems must be locally hermitian and observable. Stability of the closed-loop system is demonstrated by determining a Lyapunov function, which can be used to identify a finite stability region about the regulator point.

Rotation-invariant neural pattern recognition system with application to coin recognition.

Science.gov (United States)

Fukumi, M; Omatu, S; Takeda, F; Kosaka, T

1992-01-01

In pattern recognition, it is often necessary to deal with problems to classify a transformed pattern. A neural pattern recognition system which is insensitive to rotation of input pattern by various degrees is proposed. The system consists of a fixed invariance network with many slabs and a trainable multilayered network. The system was used in a rotation-invariant coin recognition problem to distinguish between a 500 yen coin and a 500 won coin. The results show that the approach works well for variable rotation pattern recognition.

Realization of a neural algorithm by means of front-propagation in a thyristor-based hybrid system

CERN Document Server

Niedernostheide, F J; Freyd, O; Bode, M; Gorbatyuk, A V

2003-01-01

Propagating fronts are generic structures in a bistable diffusion-driven system and can be used to realize neural algorithms, as e.g., the Kohonen or the neural-gas algorithm. We present an analog-digital hybrid system based on a thyristor-like structure with several gate terminals. This structure represents the continuous part in which a propagating front, separating a region of high current density from a region of low current density, is used to control the learning process of the neural algorithm. With a system containing five neurons and five gates in a quasi one-dimensional arrangement it is demonstrated that an efficient parallel operating learning process can be realized by using the winner-take-all principle and the front propagation, i.e. exploiting the intrinsic dynamics of the semiconductor device. Finally, numerical and analytical investigations of the dependency of the front velocity and its width on the load current have been performed since these are essential parameters for improving the netw...

Realization of a neural algorithm by means of front-propagation in a thyristor-based hybrid system

International Nuclear Information System (INIS)

Niedernostheide, F.-J.; Schulze, H.-J.; Freyd, O.; Bode, M.; Gorbatyuk, A.V.

2003-01-01

Propagating fronts are generic structures in a bistable diffusion-driven system and can be used to realize neural algorithms, as e.g., the Kohonen or the neural-gas algorithm. We present an analog-digital hybrid system based on a thyristor-like structure with several gate terminals. This structure represents the continuous part in which a propagating front, separating a region of high current density from a region of low current density, is used to control the learning process of the neural algorithm. With a system containing five neurons and five gates in a quasi one-dimensional arrangement it is demonstrated that an efficient parallel operating learning process can be realized by using the winner-take-all principle and the front propagation, i.e. exploiting the intrinsic dynamics of the semiconductor device. Finally, numerical and analytical investigations of the dependency of the front velocity and its width on the load current have been performed since these are essential parameters for improving the network performance

Symptom based diagnostic system using artificial neural networks

International Nuclear Information System (INIS)

Santosh; Vinod, Gopika; Saraf, R.K.

2003-01-01

Nuclear power plant experiences a number of transients during its operations. In case of such an undesired plant condition generally known as an initiating event, the operator has to carry out diagnostic and corrective actions. The operator's response may be too late to mitigate or minimize the negative consequences in such scenarios. The objective of this work is to develop an operator support system based on artificial neural networks that will assist the operator to identify the initiating events at the earliest stages of their developments. A symptom based diagnostic system has been developed to investigate the initiating events. Neutral networks are utilized for carrying out the event identification by continuously monitoring process parameters. Whenever an event is detected, the system will display the necessary operator actions along with the initiating event. The system will also show the graphical trend of process parameters that are relevant to the event. This paper describes the features of the software that is used to monitor the reactor. (author)

Neural Fuzzy Inference System-Based Weather Prediction Model and Its Precipitation Predicting Experiment

Directory of Open Access Journals (Sweden)

Jing Lu

2014-11-01

Full Text Available We propose a weather prediction model in this article based on neural network and fuzzy inference system (NFIS-WPM, and then apply it to predict daily fuzzy precipitation given meteorological premises for testing. The model consists of two parts: the first part is the “fuzzy rule-based neural network”, which simulates sequential relations among fuzzy sets using artificial neural network; and the second part is the “neural fuzzy inference system”, which is based on the first part, but could learn new fuzzy rules from the previous ones according to the algorithm we proposed. NFIS-WPM (High Pro and NFIS-WPM (Ave are improved versions of this model. It is well known that the need for accurate weather prediction is apparent when considering the benefits. However, the excessive pursuit of accuracy in weather prediction makes some of the “accurate” prediction results meaningless and the numerical prediction model is often complex and time-consuming. By adapting this novel model to a precipitation prediction problem, we make the predicted outcomes of precipitation more accurate and the prediction methods simpler than by using the complex numerical forecasting model that would occupy large computation resources, be time-consuming and which has a low predictive accuracy rate. Accordingly, we achieve more accurate predictive precipitation results than by using traditional artificial neural networks that have low predictive accuracy.

Automated radial basis function neural network based image classification system for diabetic retinopathy detection in retinal images

Science.gov (United States)

Anitha, J.; Vijila, C. Kezi Selva; Hemanth, D. Jude

2010-02-01

Diabetic retinopathy (DR) is a chronic eye disease for which early detection is highly essential to avoid any fatal results. Image processing of retinal images emerge as a feasible tool for this early diagnosis. Digital image processing techniques involve image classification which is a significant technique to detect the abnormality in the eye. Various automated classification systems have been developed in the recent years but most of them lack high classification accuracy. Artificial neural networks are the widely preferred artificial intelligence technique since it yields superior results in terms of classification accuracy. In this work, Radial Basis function (RBF) neural network based bi-level classification system is proposed to differentiate abnormal DR Images and normal retinal images. The results are analyzed in terms of classification accuracy, sensitivity and specificity. A comparative analysis is performed with the results of the probabilistic classifier namely Bayesian classifier to show the superior nature of neural classifier. Experimental results show promising results for the neural classifier in terms of the performance measures.

A neural network controller for hydronic heating systems of solar buildings.

Science.gov (United States)

Argiriou, Athanassios A; Bellas-Velidis, Ioannis; Kummert, Michaël; André, Philippe

2004-04-01

An artificial neural network (ANN)-based controller for hydronic heating plants of buildings is presented. The controller has forecasting capabilities: it includes a meteorological module, forecasting the ambient temperature and solar irradiance, an indoor temperature predictor module, a supply temperature predictor module and an optimizing module for the water supply temperature. All ANN modules are based on the Feed Forward Back Propagation (FFBP) model. The operation of the controller has been tested experimentally, on a real-scale office building during real operating conditions. The operation results were compared to those of a conventional controller. The performance was also assessed via numerical simulation. The detailed thermal simulation tool for solar systems and buildings TRNSYS was used. Both experimental and numerical results showed that the expected percentage of energy savings with respect to a conventional controller is of about 15% under North European weather conditions.

A new evolutionary system for evolving artificial neural networks.

Science.gov (United States)

Yao, X; Liu, Y

1997-01-01

This paper presents a new evolutionary system, i.e., EPNet, for evolving artificial neural networks (ANNs). The evolutionary algorithm used in EPNet is based on Fogel's evolutionary programming (EP). Unlike most previous studies on evolving ANN's, this paper puts its emphasis on evolving ANN's behaviors. Five mutation operators proposed in EPNet reflect such an emphasis on evolving behaviors. Close behavioral links between parents and their offspring are maintained by various mutations, such as partial training and node splitting. EPNet evolves ANN's architectures and connection weights (including biases) simultaneously in order to reduce the noise in fitness evaluation. The parsimony of evolved ANN's is encouraged by preferring node/connection deletion to addition. EPNet has been tested on a number of benchmark problems in machine learning and ANNs, such as the parity problem, the medical diagnosis problems, the Australian credit card assessment problem, and the Mackey-Glass time series prediction problem. The experimental results show that EPNet can produce very compact ANNs with good generalization ability in comparison with other algorithms.

Establishing neural crest identity: a gene regulatory recipe

Science.gov (United States)

Simões-Costa, Marcos; Bronner, Marianne E.

2015-01-01

The neural crest is a stem/progenitor cell population that contributes to a wide variety of derivatives, including sensory and autonomic ganglia, cartilage and bone of the face and pigment cells of the skin. Unique to vertebrate embryos, it has served as an excellent model system for the study of cell behavior and identity owing to its multipotency, motility and ability to form a broad array of cell types. Neural crest development is thought to be controlled by a suite of transcriptional and epigenetic inputs arranged hierarchically in a gene regulatory network. Here, we examine neural crest development from a gene regulatory perspective and discuss how the underlying genetic circuitry results in the features that define this unique cell population. PMID:25564621

Neural mechanism of facilitation system during physical fatigue.

Directory of Open Access Journals (Sweden)

Masaaki Tanaka

Full Text Available An enhanced facilitation system caused by motivational input plays an important role in supporting performance during physical fatigue. We tried to clarify the neural mechanisms of the facilitation system during physical fatigue using magnetoencephalography (MEG and a classical conditioning technique. Twelve right-handed volunteers participated in this study. Participants underwent MEG recording during the imagery of maximum grips of the right hand guided by metronome sounds for 10 min. Thereafter, fatigue-inducing maximum handgrip trials were performed for 10 min; the metronome sounds were started 5 min after the beginning of the handgrip trials. The metronome sounds were used as conditioned stimuli and maximum handgrip trials as unconditioned stimuli. The next day, they were randomly assigned to two groups in a single-blinded, two-crossover fashion to undergo two types of MEG recordings, that is, for the control and motivation sessions, during the imagery of maximum grips of the right hand guided by metronome sounds for 10 min. The alpha-band event-related desynchronizations (ERDs of the motivation session relative to the control session within the time windows of 500 to 700 and 800 to 900 ms after the onset of handgrip cue sounds were identified in the sensorimotor areas. In addition, the alpha-band ERD within the time window of 400 to 500 ms was identified in the right dorsolateral prefrontal cortex (Brodmann's area 46. The ERD level in the right dorsolateral prefrontal cortex was positively associated with that in the sensorimotor areas within the time window of 500 to 700 ms. These results suggest that the right dorsolateral prefrontal cortex is involved in the neural substrates of the facilitation system and activates the sensorimotor areas during physical fatigue.

Reconstruction of neutron spectra using neural networks starting from the Bonner spheres spectrometric system

International Nuclear Information System (INIS)

Ortiz R, J.M.; Martinez B, M.R.; Arteaga A, T.; Vega C, H.R.; Hernandez D, V.M.; Manzanares A, E.

2005-01-01

The artificial neural networks (RN) have been used successfully to solve a wide variety of problems. However to determine an appropriate set of values of the structural parameters and of learning of these, it continues being even a difficult task. Contrary to previous works, here a set of neural networks is designed to reconstruct neutron spectra starting from the counting rates coming from the detectors of the Bonner spheres system, using a systematic and experimental strategy for the robust design of multilayer neural networks of the feed forward type of inverse propagation. The robust design is formulated as a design problem of Taguchi parameters. It was selected a set of 53 neutron spectra, compiled by the International Atomic Energy Agency, the counting rates were calculated that would take place in a Bonner spheres system, the set was arranged according to the wave form of those spectra. With these data and applying the Taguchi methodology to determine the best parameters of the network topology, it was trained and it proved the same one with the spectra. (Author)

Neural Control and Adaptive Neural Forward Models for Insect-like, Energy-Efficient, and Adaptable Locomotion of Walking Machines

DEFF Research Database (Denmark)

Manoonpong, Poramate; Parlitz, Ulrich; Wörgötter, Florentin

2013-01-01

such natural properties with artificial legged locomotion systems by using different approaches including machine learning algorithms, classical engineering control techniques, and biologically-inspired control mechanisms. However, their levels of performance are still far from the natural ones. By contrast...... on sensory feedback and adaptive neural forward models with efference copies. This neural closed-loop controller enables a walking machine to perform a multitude of different walking patterns including insect-like leg movements and gaits as well as energy-efficient locomotion. In addition, the forward models...... allow the machine to autonomously adapt its locomotion to deal with a change of terrain, losing of ground contact during stance phase, stepping on or hitting an obstacle during swing phase, leg damage, and even to promote cockroach-like climbing behavior. Thus, the results presented here show...

Adaptive Neural-Sliding Mode Control of Active Suspension System for Camera Stabilization

Directory of Open Access Journals (Sweden)

Feng Zhao

2015-01-01

Full Text Available The camera always suffers from image instability on the moving vehicle due to the unintentional vibrations caused by road roughness. This paper presents a novel adaptive neural network based on sliding mode control strategy to stabilize the image captured area of the camera. The purpose is to suppress vertical displacement of sprung mass with the application of active suspension system. Since the active suspension system has nonlinear and time varying characteristics, adaptive neural network (ANN is proposed to make the controller robustness against systematic uncertainties, which release the model-based requirement of the sliding model control, and the weighting matrix is adjusted online according to Lyapunov function. The control system consists of two loops. The outer loop is a position controller designed with sliding mode strategy, while the PID controller in the inner loop is to track the desired force. The closed loop stability and asymptotic convergence performance can be guaranteed on the basis of the Lyapunov stability theory. Finally, the simulation results show that the employed controller effectively suppresses the vibration of the camera and enhances the stabilization of the entire camera, where different excitations are considered to validate the system performance.

A novel joint-processing adaptive nonlinear equalizer using a modular recurrent neural network for chaotic communication systems.

Science.gov (United States)

Zhao, Haiquan; Zeng, Xiangping; Zhang, Jiashu; Liu, Yangguang; Wang, Xiaomin; Li, Tianrui

2011-01-01

To eliminate nonlinear channel distortion in chaotic communication systems, a novel joint-processing adaptive nonlinear equalizer based on a pipelined recurrent neural network (JPRNN) is proposed, using a modified real-time recurrent learning (RTRL) algorithm. Furthermore, an adaptive amplitude RTRL algorithm is adopted to overcome the deteriorating effect introduced by the nesting process. Computer simulations illustrate that the proposed equalizer outperforms the pipelined recurrent neural network (PRNN) and recurrent neural network (RNN) equalizers. Copyright © 2010 Elsevier Ltd. All rights reserved.

A neural learning classifier system with self-adaptive constructivism for mobile robot control.

Science.gov (United States)

Hurst, Jacob; Bull, Larry

2006-01-01

For artificial entities to achieve true autonomy and display complex lifelike behavior, they will need to exploit appropriate adaptable learning algorithms. In this context adaptability implies flexibility guided by the environment at any given time and an open-ended ability to learn appropriate behaviors. This article examines the use of constructivism-inspired mechanisms within a neural learning classifier system architecture that exploits parameter self-adaptation as an approach to realize such behavior. The system uses a rule structure in which each rule is represented by an artificial neural network. It is shown that appropriate internal rule complexity emerges during learning at a rate controlled by the learner and that the structure indicates underlying features of the task. Results are presented in simulated mazes before moving to a mobile robot platform.

A neural flow estimator

DEFF Research Database (Denmark)

Jørgensen, Ivan Harald Holger; Bogason, Gudmundur; Bruun, Erik

1995-01-01

This paper proposes a new way to estimate the flow in a micromechanical flow channel. A neural network is used to estimate the delay of random temperature fluctuations induced in a fluid. The design and implementation of a hardware efficient neural flow estimator is described. The system...... is implemented using switched-current technique and is capable of estimating flow in the μl/s range. The neural estimator is built around a multiplierless neural network, containing 96 synaptic weights which are updated using the LMS1-algorithm. An experimental chip has been designed that operates at 5 V...

Neural Network Models of Simple Mechanical Systems Illustrating the Feasibility of Accelerated Life Testing

Science.gov (United States)

Fusaro, Robert L.; Jones, Steven P.; Jansen, Ralph

1996-01-01

A complete evaluation of the tribological characteristics of a given material/mechanical system is a time-consuming operation since the friction and wear process is extremely systems sensitive. As a result, experimental designs (i.e., Latin Square, Taguchi) have been implemented in an attempt to not only reduce the total number of experimental combinations needed to fully characterize a material/mechanical system, but also to acquire life data for a system without having to perform an actual life test. Unfortunately, these experimental designs still require a great deal of experimental testing and the output does not always produce meaningful information. In order to further reduce the amount of experimental testing required, this study employs a computer neural network model to investigate different material/mechanical systems. The work focuses on the modeling of the wear behavior, while showing the feasibility of using neural networks to predict life data. The model is capable of defining which input variables will influence the tribological behavior of the particular material/mechanical system being studied based on the specifications of the overall system.

Artificial neural network decision support systems for new product development project selection

NARCIS (Netherlands)

Thieme, R.J.; Song, Michael; Calantone, R.J.

2000-01-01

The authors extend and develop an artificial neural network decision support system and demonstrate how it can guide managers when they make complex new product development decisions. The authors use data from 612 projects to compare this new method with traditional methods for predicting various

Indirect adaptive fuzzy wavelet neural network with self- recurrent consequent part for AC servo system.

Science.gov (United States)

Hou, Runmin; Wang, Li; Gao, Qiang; Hou, Yuanglong; Wang, Chao

2017-09-01

This paper proposes a novel indirect adaptive fuzzy wavelet neural network (IAFWNN) to control the nonlinearity, wide variations in loads, time-variation and uncertain disturbance of the ac servo system. In the proposed approach, the self-recurrent wavelet neural network (SRWNN) is employed to construct an adaptive self-recurrent consequent part for each fuzzy rule of TSK fuzzy model. For the IAFWNN controller, the online learning algorithm is based on back propagation (BP) algorithm. Moreover, an improved particle swarm optimization (IPSO) is used to adapt the learning rate. The aid of an adaptive SRWNN identifier offers the real-time gradient information to the adaptive fuzzy wavelet neural controller to overcome the impact of parameter variations, load disturbances and other uncertainties effectively, and has a good dynamic. The asymptotical stability of the system is guaranteed by using the Lyapunov method. The result of the simulation and the prototype test prove that the proposed are effective and suitable. Copyright © 2017. Published by Elsevier Ltd.

An artificial neural network system to identify alleles in reference electropherograms.

Science.gov (United States)

Taylor, Duncan; Harrison, Ash; Powers, David

2017-09-01

Electropherograms are produced in great numbers in forensic DNA laboratories as part of everyday criminal casework. Before the results of these electropherograms can be used they must be scrutinised by analysts to determine what the identified data tells them about the underlying DNA sequences and what is purely an artefact of the DNA profiling process. This process of interpreting the electropherograms can be time consuming and is prone to subjective differences between analysts. Recently it was demonstrated that artificial neural networks could be used to classify information within an electropherogram as allelic (i.e. representative of a DNA fragment present in the DNA extract) or as one of several different categories of artefactual fluorescence that arise as a result of generating an electropherogram. We extend that work here to demonstrate a series of algorithms and artificial neural networks that can be used to identify peaks on an electropherogram and classify them. We demonstrate the functioning of the system on several profiles and compare the results to a leading commercial DNA profile reading system. Copyright © 2017 Elsevier B.V. All rights reserved.

The Neural Border: Induction, Specification and Maturation of the territory that generates Neural Crest cells.

Science.gov (United States)

Pla, Patrick; Monsoro-Burq, Anne H

2018-05-28

The neural crest is induced at the edge between the neural plate and the nonneural ectoderm, in an area called the neural (plate) border, during gastrulation and neurulation. In recent years, many studies have explored how this domain is patterned, and how the neural crest is induced within this territory, that also participates to the prospective dorsal neural tube, the dorsalmost nonneural ectoderm, as well as placode derivatives in the anterior area. This review highlights the tissue interactions, the cell-cell signaling and the molecular mechanisms involved in this dynamic spatiotemporal patterning, resulting in the induction of the premigratory neural crest. Collectively, these studies allow building a complex neural border and early neural crest gene regulatory network, mostly composed by transcriptional regulations but also, more recently, including novel signaling interactions. Copyright © 2018. Published by Elsevier Inc.

Control Strategy Based on Wavelet Transform and Neural Network for Hybrid Power System

Directory of Open Access Journals (Sweden)

Y. D. Song

2013-01-01

Full Text Available This paper deals with an energy management of a hybrid power generation system. The proposed control strategy for the energy management is based on the combination of wavelet transform and neural network arithmetic. The hybrid system in this paper consists of an emulated wind turbine generator, PV panels, DC and AC loads, lithium ion battery, and super capacitor, which are all connected on a DC bus with unified DC voltage. The control strategy is responsible for compensating the difference between the generated power from the wind and solar generators and the demanded power by the loads. Wavelet transform decomposes the power difference into smoothed component and fast fluctuated component. In consideration of battery protection, the neural network is introduced to calculate the reference power of battery. Super capacitor (SC is controlled to regulate the DC bus voltage. The model of the hybrid system is developed in detail under Matlab/Simulink software environment.

An electronic system for simulation of neural networks with a micro-second real time constraint

International Nuclear Information System (INIS)

Chorti, Arsenia; Granado, Bertrand; Denby, Bruce; Garda, Patrick

2001-01-01

Neural networks implemented in hardware can perform pattern recognition very quickly, and as such have been used to advantage in the triggering systems of certain high energy physics experiments. Typically, time constants of the order of a few microseconds are required. In this paper, we present a new system. MAHARADJA, for evaluating MLP and RBF neural network paradigms in real time. The system is tested on a possible ATLAS muon triggering application suggested by the Tel Aviv ATLAS group, consisting of a 4-8-8-4 MLP which must be evaluated in 10 microseconds. The inputs to the net are dx/dz, x(z=0), dy/dz, and y(z=0), whereas the outputs give pt, tan(phi), sin(theta), and q, the charge. With a 10 MHz clock, MAHARADJA calculates the result in 6.8 microseconds; at 20 MHz, which is readily attainable, this would be reduced to only 3.4 microseconds. The system can also handle RBF networks with 3 different distance metrics (Euclidean, Manhattan and Mahalanobis), and can simulate any MLP of 10 hidden layers or less. The electronic implementation is with FPGA's, which can be optimized for a specific neural network because the number of processing elements can be modified

The Principle of the Micro-Electronic Neural Bridge and a Prototype System Design.

Science.gov (United States)

Huang, Zong-Hao; Wang, Zhi-Gong; Lu, Xiao-Ying; Li, Wen-Yuan; Zhou, Yu-Xuan; Shen, Xiao-Yan; Zhao, Xin-Tai

2016-01-01

The micro-electronic neural bridge (MENB) aims to rebuild lost motor function of paralyzed humans by routing movement-related signals from the brain, around the damage part in the spinal cord, to the external effectors. This study focused on the prototype system design of the MENB, including the principle of the MENB, the neural signal detecting circuit and the functional electrical stimulation (FES) circuit design, and the spike detecting and sorting algorithm. In this study, we developed a novel improved amplitude threshold spike detecting method based on variable forward difference threshold for both training and bridging phase. The discrete wavelet transform (DWT), a new level feature coefficient selection method based on Lilliefors test, and the k-means clustering method based on Mahalanobis distance were used for spike sorting. A real-time online spike detecting and sorting algorithm based on DWT and Euclidean distance was also implemented for the bridging phase. Tested by the data sets available at Caltech, in the training phase, the average sensitivity, specificity, and clustering accuracies are 99.43%, 97.83%, and 95.45%, respectively. Validated by the three-fold cross-validation method, the average sensitivity, specificity, and classification accuracy are 99.43%, 97.70%, and 96.46%, respectively.

Stability Analysis of Neural Networks-Based System Identification

Directory of Open Access Journals (Sweden)

Talel Korkobi

2008-01-01

Full Text Available This paper treats some problems related to nonlinear systems identification. A stability analysis neural network model for identifying nonlinear dynamic systems is presented. A constrained adaptive stable backpropagation updating law is presented and used in the proposed identification approach. The proposed backpropagation training algorithm is modified to obtain an adaptive learning rate guarantying convergence stability. The proposed learning rule is the backpropagation algorithm under the condition that the learning rate belongs to a specified range defining the stability domain. Satisfying such condition, unstable phenomena during the learning process are avoided. A Lyapunov analysis leads to the computation of the expression of a convenient adaptive learning rate verifying the convergence stability criteria. Finally, the elaborated training algorithm is applied in several simulations. The results confirm the effectiveness of the CSBP algorithm.

Deep convolutional neural network based antenna selection in multiple-input multiple-output system

Science.gov (United States)

Cai, Jiaxin; Li, Yan; Hu, Ying

2018-03-01

Antenna selection of wireless communication system has attracted increasing attention due to the challenge of keeping a balance between communication performance and computational complexity in large-scale Multiple-Input MultipleOutput antenna systems. Recently, deep learning based methods have achieved promising performance for large-scale data processing and analysis in many application fields. This paper is the first attempt to introduce the deep learning technique into the field of Multiple-Input Multiple-Output antenna selection in wireless communications. First, the label of attenuation coefficients channel matrix is generated by minimizing the key performance indicator of training antenna systems. Then, a deep convolutional neural network that explicitly exploits the massive latent cues of attenuation coefficients is learned on the training antenna systems. Finally, we use the adopted deep convolutional neural network to classify the channel matrix labels of test antennas and select the optimal antenna subset. Simulation experimental results demonstrate that our method can achieve better performance than the state-of-the-art baselines for data-driven based wireless antenna selection.

Drug release control and system understanding of sucrose esters matrix tablets by artificial neural networks.

Science.gov (United States)

Chansanroj, Krisanin; Petrović, Jelena; Ibrić, Svetlana; Betz, Gabriele

2011-10-09

Artificial neural networks (ANNs) were applied for system understanding and prediction of drug release properties from direct compacted matrix tablets using sucrose esters (SEs) as matrix-forming agents for controlled release of a highly water soluble drug, metoprolol tartrate. Complexity of the system was presented through the effects of SE concentration and tablet porosity at various hydrophilic-lipophilic balance (HLB) values of SEs ranging from 0 to 16. Both effects contributed to release behaviors especially in the system containing hydrophilic SEs where swelling phenomena occurred. A self-organizing map neural network (SOM) was applied for visualizing interrelation among the variables and multilayer perceptron neural networks (MLPs) were employed to generalize the system and predict the drug release properties based on HLB value and concentration of SEs and tablet properties, i.e., tablet porosity, volume and tensile strength. Accurate prediction was obtained after systematically optimizing network performance based on learning algorithm of MLP. Drug release was mainly attributed to the effects of SEs, tablet volume and tensile strength in multi-dimensional interrelation whereas tablet porosity gave a small impact. Ability of system generalization and accurate prediction of the drug release properties proves the validity of SOM and MLPs for the formulation modeling of direct compacted matrix tablets containing controlled release agents of different material properties. Copyright © 2011 Elsevier B.V. All rights reserved.

Switched-Observer-Based Adaptive Neural Control of MIMO Switched Nonlinear Systems With Unknown Control Gains.

Science.gov (United States)

Long, Lijun; Zhao, Jun

2017-07-01

In this paper, the problem of adaptive neural output-feedback control is addressed for a class of multi-input multioutput (MIMO) switched uncertain nonlinear systems with unknown control gains. Neural networks (NNs) are used to approximate unknown nonlinear functions. In order to avoid the conservativeness caused by adoption of a common observer for all subsystems, an MIMO NN switched observer is designed to estimate unmeasurable states. A new switched observer-based adaptive neural control technique for the problem studied is then provided by exploiting the classical average dwell time (ADT) method and the backstepping method and the Nussbaum gain technique. It effectively handles the obstacle about the coexistence of multiple Nussbaum-type function terms, and improves the classical ADT method, since the exponential decline property of Lyapunov functions for individual subsystems is no longer satisfied. It is shown that the technique proposed is able to guarantee semiglobal uniformly ultimately boundedness of all the signals in the closed-loop system under a class of switching signals with ADT, and the tracking errors converge to a small neighborhood of the origin. The effectiveness of the approach proposed is illustrated by its application to a two inverted pendulum system.

Hybrid neural intelligent system to predict business failure in small-to-medium-size enterprises.

Science.gov (United States)

Borrajo, M Lourdes; Baruque, Bruno; Corchado, Emilio; Bajo, Javier; Corchado, Juan M

2011-08-01

During the last years there has been a growing need of developing innovative tools that can help small to medium sized enterprises to predict business failure as well as financial crisis. In this study we present a novel hybrid intelligent system aimed at monitoring the modus operandi of the companies and predicting possible failures. This system is implemented by means of a neural-based multi-agent system that models the different actors of the companies as agents. The core of the multi-agent system is a type of agent that incorporates a case-based reasoning system and automates the business control process and failure prediction. The stages of the case-based reasoning system are implemented by means of web services: the retrieval stage uses an innovative weighted voting summarization of self-organizing maps ensembles-based method and the reuse stage is implemented by means of a radial basis function neural network. An initial prototype was developed and the results obtained related to small and medium enterprises in a real scenario are presented.

A neural network based artificial vision system for licence plate recognition.

Science.gov (United States)

Draghici, S

1997-02-01

This paper presents a neural network based artificial vision system able to analyze the image of a car given by a camera, locate the registration plate and recognize the registration number of the car. The paper describes in detail various practical problems encountered in implementing this particular application and the solutions used to solve them. The main features of the system presented are: controlled stability-plasticity behavior, controlled reliability threshold, both off-line and on-line learning, self assessment of the output reliability and high reliability based on high level multiple feedback. The system has been designed using a modular approach. Sub-modules can be upgraded and/or substituted independently, thus making the system potentially suitable in a large variety of vision applications. The OCR engine was designed as an interchangeable plug-in module. This allows the user to choose an OCR engine which is suited to the particular application and to upgrade it easily in the future. At present, there are several versions of this OCR engine. One of them is based on a fully connected feedforward artificial neural network with sigmoidal activation functions. This network can be trained with various training algorithms such as error backpropagation. An alternative OCR engine is based on the constraint based decomposition (CBD) training architecture. The system has showed the following performances (on average) on real-world data: successful plate location and segmentation about 99%, successful character recognition about 98% and successful recognition of complete registration plates about 80%.

Phonological memory in sign language relies on the visuomotor neural system outside the left hemisphere language network.

Science.gov (United States)

Kanazawa, Yuji; Nakamura, Kimihiro; Ishii, Toru; Aso, Toshihiko; Yamazaki, Hiroshi; Omori, Koichi

2017-01-01

Sign language is an essential medium for everyday social interaction for deaf people and plays a critical role in verbal learning. In particular, language development in those people should heavily rely on the verbal short-term memory (STM) via sign language. Most previous studies compared neural activations during signed language processing in deaf signers and those during spoken language processing in hearing speakers. For sign language users, it thus remains unclear how visuospatial inputs are converted into the verbal STM operating in the left-hemisphere language network. Using functional magnetic resonance imaging, the present study investigated neural activation while bilinguals of spoken and signed language were engaged in a sequence memory span task. On each trial, participants viewed a nonsense syllable sequence presented either as written letters or as fingerspelling (4-7 syllables in length) and then held the syllable sequence for 12 s. Behavioral analysis revealed that participants relied on phonological memory while holding verbal information regardless of the type of input modality. At the neural level, this maintenance stage broadly activated the left-hemisphere language network, including the inferior frontal gyrus, supplementary motor area, superior temporal gyrus and inferior parietal lobule, for both letter and fingerspelling conditions. Interestingly, while most participants reported that they relied on phonological memory during maintenance, direct comparisons between letters and fingers revealed strikingly different patterns of neural activation during the same period. Namely, the effortful maintenance of fingerspelling inputs relative to letter inputs activated the left superior parietal lobule and dorsal premotor area, i.e., brain regions known to play a role in visuomotor analysis of hand/arm movements. These findings suggest that the dorsal visuomotor neural system subserves verbal learning via sign language by relaying gestural inputs to

Artificial Neural Network for Location Estimation in Wireless Communication Systems

Directory of Open Access Journals (Sweden)

Chien-Sheng Chen

2012-03-01

Full Text Available In a wireless communication system, wireless location is the technique used to estimate the location of a mobile station (MS. To enhance the accuracy of MS location prediction, we propose a novel algorithm that utilizes time of arrival (TOA measurements and the angle of arrival (AOA information to locate MS when three base stations (BSs are available. Artificial neural networks (ANN are widely used techniques in various areas to overcome the problem of exclusive and nonlinear relationships. When the MS is heard by only three BSs, the proposed algorithm utilizes the intersections of three TOA circles (and the AOA line, based on various neural networks, to estimate the MS location in non-line-of-sight (NLOS environments. Simulations were conducted to evaluate the performance of the algorithm for different NLOS error distributions. The numerical analysis and simulation results show that the proposed algorithms can obtain more precise location estimation under different NLOS environments.

Artificial neural network for location estimation in wireless communication systems.

Science.gov (United States)

Chen, Chien-Sheng

2012-01-01

In a wireless communication system, wireless location is the technique used to estimate the location of a mobile station (MS). To enhance the accuracy of MS location prediction, we propose a novel algorithm that utilizes time of arrival (TOA) measurements and the angle of arrival (AOA) information to locate MS when three base stations (BSs) are available. Artificial neural networks (ANN) are widely used techniques in various areas to overcome the problem of exclusive and nonlinear relationships. When the MS is heard by only three BSs, the proposed algorithm utilizes the intersections of three TOA circles (and the AOA line), based on various neural networks, to estimate the MS location in non-line-of-sight (NLOS) environments. Simulations were conducted to evaluate the performance of the algorithm for different NLOS error distributions. The numerical analysis and simulation results show that the proposed algorithms can obtain more precise location estimation under different NLOS environments.

Mitochondrial metabolism in early neural fate and its relevance for neuronal disease modeling.

Science.gov (United States)

Lorenz, Carmen; Prigione, Alessandro

2017-12-01

Modulation of energy metabolism is emerging as a key aspect associated with cell fate transition. The establishment of a correct metabolic program is particularly relevant for neural cells given their high bioenergetic requirements. Accordingly, diseases of the nervous system commonly involve mitochondrial impairment. Recent studies in animals and in neural derivatives of human pluripotent stem cells (PSCs) highlighted the importance of mitochondrial metabolism for neural fate decisions in health and disease. The mitochondria-based metabolic program of early neurogenesis suggests that PSC-derived neural stem cells (NSCs) may be used for modeling neurological disorders. Understanding how metabolic programming is orchestrated during neural commitment may provide important information for the development of therapies against conditions affecting neural functions, including aging and mitochondrial disorders. Copyright © 2017. Published by Elsevier Ltd.

Neural plasticity of development and learning.

Science.gov (United States)

Galván, Adriana

2010-06-01

Development and learning are powerful agents of change across the lifespan that induce robust structural and functional plasticity in neural systems. An unresolved question in developmental cognitive neuroscience is whether development and learning share the same neural mechanisms associated with experience-related neural plasticity. In this article, I outline the conceptual and practical challenges of this question, review insights gleaned from adult studies, and describe recent strides toward examining this topic across development using neuroimaging methods. I suggest that development and learning are not two completely separate constructs and instead, that they exist on a continuum. While progressive and regressive changes are central to both, the behavioral consequences associated with these changes are closely tied to the existing neural architecture of maturity of the system. Eventually, a deeper, more mechanistic understanding of neural plasticity will shed light on behavioral changes across development and, more broadly, about the underlying neural basis of cognition. (c) 2010 Wiley-Liss, Inc.

NEURAL NETWORK SYSTEM FOR DIAGNOSTICS OF AVIATION DESIGNATION PRODUCTS

Directory of Open Access Journals (Sweden)

В. Єременко

2011-02-01

Full Text Available In the article for solving the classification problem of the technical state of the  object, proposed to use a hybrid neural network with a Kohonen layer and multilayer perceptron. The information-measuring system can be used for standardless diagnostics, cluster analysis and to classify the products which made from composite materials. The advantage of this architecture is flexibility, high performance, ability to use different methods for collecting diagnostic information about unit under test, high reliability of information processing

Chemical analysis of multicomponent aqueous solutions using a system of nonselective sensor and artificial neural networks

International Nuclear Information System (INIS)

Vlasov, Yu.G.; Legin, A.V.; Rudnitskaya, A.M.; Amiko, A.D.; Natale, K.D.

1997-01-01

With the aim of creating a multisensor system for determining heavy-metal cations (Cu 2+ , Pb 2+ , Cd 2+ , and Zn 2+ ) and inorganic anions (Cl - , F - , and SO 4 2- ), measurements in mixed solutions were carried out with the use of an array of sensors based on chalcogenide glass electrodes, and the possibility of using various methods of mathematical processing of the resulting intricate signals was studied. Three methods of data processing were used: multilinear regression, partial least squares, and artificial neural networks. It was found that the multisensor system proposed were suitable for determining all of the analytes with an accuracy of 1-10%. Because the responses of sensors in solutions of complex composition deviated from linearity, the lowest determination errors were obtained with the use of an artificial neural network. As to the method of data securing (nonselective response of a sensor array) and processing (artificial neural network), the multisensor system developed may be considered a prototype of a device of the electronic tongue type

Neural systems of second language reading are shaped by native language.

Science.gov (United States)

Tan, Li Hai; Spinks, John A; Feng, Ching-Mei; Siok, Wai Ting; Perfetti, Charles A; Xiong, Jinhu; Fox, Peter T; Gao, Jia-Hong

2003-03-01

Reading in a second language (L2) is a complex task that entails an interaction between L2 and the native language (L1). To study the underlying mechanisms, we used functional magnetic resonance imaging (fMRI) to visualize Chinese-English bilinguals' brain activity in phonological processing of logographic Chinese and alphabetic English, two written languages with a sharp contrast in phonology and orthography. In Experiment 1, we found that phonological processing of Chinese characters recruits a neural system involving left middle frontal and posterior parietal gyri, cortical regions that are known to contribute to spatial information representation, spatial working memory, and coordination of cognitive resources as a central executive system. We assume that the peak activation of this system is relevant to the unique feature of Chinese that a logographic character has a square configuration that maps onto a monosyllabic unit of speech. Equally important, when our bilingual subjects performed a phonological task on English words, this neural system was most active, whereas brain areas mediating English monolinguals' fine-grained phonemic analysis, as demonstrated by Experiment 2, were only weakly activated. This suggests that our bilingual subjects were applying their L1 system to L2 reading and that the lack of letter-to-sound conversion rules in Chinese led Chinese readers to being less capable of processing English by recourse to an analytic reading system on which English monolinguals rely. Our brain imaging findings lend strongest support to the idea that language experience tunes the cortex. Copyright 2003 Wiley-Liss, Inc.

Neural Network Based Model of an Industrial Oil-Fired Boiler System ...

African Journals Online (AJOL)

A two-layer feed-forward neural network with Hyperbolic tangent sigmoid ... The neural network model when subjected to test, using the validation input data; ... Proportional Integral Derivative (PID) Controller is used to control the neural ...

Phase transitions in vector quantization and neural gas

NARCIS (Netherlands)

Witoelar, Aree; Biehl, Michael

The statistical physics of off-learning is applied to winner-takes-all (WTA) and rank-based vector quantization (VQ), including the neural gas (NG). The analysis is based on the limit of high training temperatures and the annealed approximation. The typical learning behavior is evaluated for systems

Minimally-Invasive Neural Interface for Distributed Wireless Electrocorticogram Recording Systems.

Science.gov (United States)

Chang, Sun-Il; Park, Sung-Yun; Yoon, Euisik

2018-01-17

This paper presents a minimally-invasive neural interface for distributed wireless electrocorticogram (ECoG) recording systems. The proposed interface equips all necessary components for ECoG recording, such as the high performance front-end integrated circuits, a fabricated flexible microelectrode array, and wireless communication inside a miniaturized custom-made platform. The multiple units of the interface systems can be deployed to cover a broad range of the target brain region and transmit signals via a built-in intra-skin communication (ISCOM) module. The core integrated circuit (IC) consists of 16-channel, low-power push-pull double-gated preamplifiers, in-channel successive approximation register analog-to-digital converters (SAR ADC) with a single-clocked bootstrapping switch and a time-delayed control unit, an ISCOM module for wireless data transfer through the skin instead of a power-hungry RF wireless transmitter, and a monolithic voltage/current reference generator to support the aforementioned analog and mixed-signal circuit blocks. The IC was fabricated using 250 nm CMOS processes in an area of 3.2 × 0.9 mm² and achieved the low-power operation of 2.5 µW per channel. Input-referred noise was measured as 5.62 µV rms for 10 Hz to 10 kHz and ENOB of 7.21 at 31.25 kS/s. The implemented system successfully recorded multi-channel neural activities in vivo from a primate and demonstrated modular expandability using the ISCOM with power consumption of 160 µW.

Adaptive model predictive process control using neural networks

Science.gov (United States)

Buescher, K.L.; Baum, C.C.; Jones, R.D.

1997-08-19

A control system for controlling the output of at least one plant process output parameter is implemented by adaptive model predictive control using a neural network. An improved method and apparatus provides for sampling plant output and control input at a first sampling rate to provide control inputs at the fast rate. The MPC system is, however, provided with a network state vector that is constructed at a second, slower rate so that the input control values used by the MPC system are averaged over a gapped time period. Another improvement is a provision for on-line training that may include difference training, curvature training, and basis center adjustment to maintain the weights and basis centers of the neural in an updated state that can follow changes in the plant operation apart from initial off-line training data. 46 figs.

Speaker diarization system using HXLPS and deep neural network

Directory of Open Access Journals (Sweden)

V. Subba Ramaiah

2018-03-01

Full Text Available In general, speaker diarization is defined as the process of segmenting the input speech signal and grouped the homogenous regions with regard to the speaker identity. The main idea behind this system is that it is able to discriminate the speaker signal by assigning the label of the each speaker signal. Due to rapid growth of broadcasting and meeting, the speaker diarization is burdensome to enhance the readability of the speech transcription. In order to solve this issue, Holoentropy with the eXtended Linear Prediction using autocorrelation Snapshot (HXLPS and deep neural network (DNN is proposed for the speaker diarization system. The HXLPS extraction method is newly developed by incorporating the Holoentropy with the XLPS. Once we attain the features, the speech and non-speech signals are detected by the Voice Activity Detection (VAD method. Then, i-vector representation of every segmented signal is obtained using Universal Background Model (UBM model. Consequently, DNN is utilized to assign the label for the speaker signal which is then clustered according to the speaker label. The performance is analysed using the evaluation metrics, such as tracking distance, false alarm rate and diarization error rate. The outcome of the proposed method ensures the better diarization performance by achieving the lower DER of 1.36% based on lambda value and DER of 2.23% depends on the frame length. Keywords: Speaker diarization, HXLPS feature extraction, Voice activity detection, Deep neural network, Speaker clustering, Diarization Error Rate (DER

SYNAPTIC DEPRESSION IN DEEP NEURAL NETWORKS FOR SPEECH PROCESSING.

Science.gov (United States)

Zhang, Wenhao; Li, Hanyu; Yang, Minda; Mesgarani, Nima

2016-03-01

A characteristic property of biological neurons is their ability to dynamically change the synaptic efficacy in response to variable input conditions. This mechanism, known as synaptic depression, significantly contributes to the formation of normalized representation of speech features. Synaptic depression also contributes to the robust performance of biological systems. In this paper, we describe how synaptic depression can be modeled and incorporated into deep neural network architectures to improve their generalization ability. We observed that when synaptic depression is added to the hidden layers of a neural network, it reduces the effect of changing background activity in the node activations. In addition, we show that when synaptic depression is included in a deep neural network trained for phoneme classification, the performance of the network improves under noisy conditions not included in the training phase. Our results suggest that more complete neuron models may further reduce the gap between the biological performance and artificial computing, resulting in networks that better generalize to novel signal conditions.

Neural substrates of decision-making.

Science.gov (United States)

Broche-Pérez, Y; Herrera Jiménez, L F; Omar-Martínez, E

2016-06-01

Decision-making is the process of selecting a course of action from among 2 or more alternatives by considering the potential outcomes of selecting each option and estimating its consequences in the short, medium and long term. The prefrontal cortex (PFC) has traditionally been considered the key neural structure in decision-making process. However, new studies support the hypothesis that describes a complex neural network including both cortical and subcortical structures. The aim of this review is to summarise evidence on the anatomical structures underlying the decision-making process, considering new findings that support the existence of a complex neural network that gives rise to this complex neuropsychological process. Current evidence shows that the cortical structures involved in decision-making include the orbitofrontal cortex (OFC), anterior cingulate cortex (ACC), and dorsolateral prefrontal cortex (DLPFC). This process is assisted by subcortical structures including the amygdala, thalamus, and cerebellum. Findings to date show that both cortical and subcortical brain regions contribute to the decision-making process. The neural basis of decision-making is a complex neural network of cortico-cortical and cortico-subcortical connections which includes subareas of the PFC, limbic structures, and the cerebellum. Copyright © 2014 Sociedad Española de Neurología. Published by Elsevier España, S.L.U. All rights reserved.

Comparative Study of Neural Network Frameworks for the Next Generation of Adaptive Optics Systems.

Science.gov (United States)

González-Gutiérrez, Carlos; Santos, Jesús Daniel; Martínez-Zarzuela, Mario; Basden, Alistair G; Osborn, James; Díaz-Pernas, Francisco Javier; De Cos Juez, Francisco Javier

2017-06-02

Many of the next generation of adaptive optics systems on large and extremely large telescopes require tomographic techniques in order to correct for atmospheric turbulence over a large field of view. Multi-object adaptive optics is one such technique. In this paper, different implementations of a tomographic reconstructor based on a machine learning architecture named "CARMEN" are presented. Basic concepts of adaptive optics are introduced first, with a short explanation of three different control systems used on real telescopes and the sensors utilised. The operation of the reconstructor, along with the three neural network frameworks used, and the developed CUDA code are detailed. Changes to the size of the reconstructor influence the training and execution time of the neural network. The native CUDA code turns out to be the best choice for all the systems, although some of the other frameworks offer good performance under certain circumstances.

Systemic Injection of Neural Stem/progenitor Cells in Mice With Chronic EAE

OpenAIRE

Donegà, Matteo; Giusto, Elena; Cossetti, Chiara; Schaeffer, Julia; Pluchino, Stefano

2014-01-01

Neural stem/precursor cells (NPCs) are a promising stem cell source for transplantation approaches aiming at brain repair or restoration in regenerative neurology. This directive has arisen from the extensive evidence that brain repair is achieved after focal or systemic NPC transplantation in several pre clinical models of neurological diseases.

Neural Network Based Finite-Time Stabilization for Discrete-Time Markov Jump Nonlinear Systems with Time Delays

Directory of Open Access Journals (Sweden)

Fei Chen

2013-01-01

Full Text Available This paper deals with the finite-time stabilization problem for discrete-time Markov jump nonlinear systems with time delays and norm-bounded exogenous disturbance. The nonlinearities in different jump modes are parameterized by neural networks. Subsequently, a linear difference inclusion state space representation for a class of neural networks is established. Based on this, sufficient conditions are derived in terms of linear matrix inequalities to guarantee stochastic finite-time boundedness and stochastic finite-time stabilization of the closed-loop system. A numerical example is illustrated to verify the efficiency of the proposed technique.

Implantable Neural Interfaces for Sharks

Science.gov (United States)

2007-05-01

technology for recording and stimulating from the auditory and olfactory sensory nervous systems of the awake, swimming nurse shark , G. cirratum (Figures...overlay of the central nervous system of the nurse shark on a horizontal MR image. Implantable Neural Interfaces for Sharks ...Neural Interfaces for Characterizing Population Responses to Odorants and Electrical Stimuli in the Nurse Shark , Ginglymostoma cirratum.” AChemS Abs

Neural network tracking and extension of positive tracking periods

Science.gov (United States)

Hanan, Jay C.; Chao, Tien-Hsin; Moreels, Pierre

2004-04-01

Feature detectors have been considered for the role of supplying additional information to a neural network tracker. The feature detector focuses on areas of the image with significant information. Basically, if a picture says a thousand words, the feature detectors are looking for the key phrases (keypoints). These keypoints are rotationally invariant and may be matched across frames. Application of these advanced feature detectors to the neural network tracking system at JPL has promising potential. As part of an ongoing program, an advanced feature detector was tested for augmentation of a neural network based tracker. The advance feature detector extended tracking periods in test sequences including aircraft tracking, rover tracking, and simulated Martian landing. Future directions of research are also discussed.

Toward a distributed free-floating wireless implantable neural recording system.

Science.gov (United States)

Pyungwoo Yeon; Xingyuan Tong; Byunghun Lee; Mirbozorgi, Abdollah; Ash, Bruce; Eckhardt, Helmut; Ghovanloo, Maysam

2016-08-01

To understand the complex correlations between neural networks across different regions in the brain and their functions at high spatiotemporal resolution, a tool is needed for obtaining long-term single unit activity (SUA) across the entire brain area. The concept and preliminary design of a distributed free-floating wireless implantable neural recording (FF-WINeR) system are presented, which can enabling SUA acquisition by dispersedly implanting tens to hundreds of untethered 1 mm3 neural recording probes, floating with the brain and operating wirelessly across the cortical surface. For powering FF-WINeR probes, a 3-coil link with an intermediate high-Q resonator provides a minimum S21 of -22.22 dB (in the body medium) and -21.23 dB (in air) at 2.8 cm coil separation, which translates to 0.76%/759 μW and 0.6%/604 μW of power transfer efficiency (PTE) / power delivered to a 9 kΩ load (PDL), in body and air, respectively. A mock-up FF-WINeR is implemented to explore microassembly method of the 1×1 mm2 micromachined silicon die with a bonding wire-wound coil and a tungsten micro-wire electrode. Circuit design methods to fit the active circuitry in only 0.96 mm2 of die area in a 130 nm standard CMOS process, and satisfy the strict power and performance requirements (in simulations) are discussed.

Salmonella infections modelling in Mississippi using neural network and geographical information system (GIS).

Science.gov (United States)

Akil, Luma; Ahmad, H Anwar

2016-03-03

Mississippi (MS) is one of the southern states with high rates of foodborne infections. The objectives of this paper are to determine the extent of Salmonella and Escherichia coli infections in MS, and determine the Salmonella infections correlation with socioeconomic status using geographical information system (GIS) and neural network models. In this study, the relevant updated data of foodborne illness for southern states, from 2002 to 2011, were collected and used in the GIS and neural networks models. Data were collected from the Centers for Disease Control and Prevention (CDC), MS state Department of Health and the other states department of health. The correlation between low socioeconomic status and Salmonella infections were determined using models created by several software packages, including SAS, ArcGIS @RISK and NeuroShell. Results of this study showed a significant increase in Salmonella outbreaks in MS during the study period, with highest rates in 2011 (47.84 ± 24.41 cases/100,000; pGIS maps of Salmonella outbreaks in MS in 2010 and 2011 showed the districts with higher rates of Salmonella. Regression analysis and neural network models showed a moderate correlation between cases of Salmonella infections and low socioeconomic factors. Poverty was shown to have a negative correlation with Salmonella outbreaks (R(2)=0.152, p<0.05). Geographic location besides socioeconomic status may contribute to the high rates of Salmonella outbreaks in MS. Understanding the geographical and economic relationship with infectious diseases will help to determine effective methods to reduce outbreaks within low socioeconomic status communities. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Phase transitions in glassy systems via convolutional neural networks

Science.gov (United States)

Fang, Chao

Machine learning is a powerful approach commonplace in industry to tackle large data sets. Most recently, it has found its way into condensed matter physics, allowing for the first time the study of, e.g., topological phase transitions and strongly-correlated electron systems. The study of spin glasses is plagued by finite-size effects due to the long thermalization times needed. Here we use convolutional neural networks in an attempt to detect a phase transition in three-dimensional Ising spin glasses. Our results are compared to traditional approaches.

Neural Parallel Engine: A toolbox for massively parallel neural signal processing.

Science.gov (United States)

Tam, Wing-Kin; Yang, Zhi

2018-05-01

Large-scale neural recordings provide detailed information on neuronal activities and can help elicit the underlying neural mechanisms of the brain. However, the computational burden is also formidable when we try to process the huge data stream generated by such recordings. In this study, we report the development of Neural Parallel Engine (NPE), a toolbox for massively parallel neural signal processing on graphical processing units (GPUs). It offers a selection of the most commonly used routines in neural signal processing such as spike detection and spike sorting, including advanced algorithms such as exponential-component-power-component (EC-PC) spike detection and binary pursuit spike sorting. We also propose a new method for detecting peaks in parallel through a parallel compact operation. Our toolbox is able to offer a 5× to 110× speedup compared with its CPU counterparts depending on the algorithms. A user-friendly MATLAB interface is provided to allow easy integration of the toolbox into existing workflows. Previous efforts on GPU neural signal processing only focus on a few rudimentary algorithms, are not well-optimized and often do not provide a user-friendly programming interface to fit into existing workflows. There is a strong need for a comprehensive toolbox for massively parallel neural signal processing. A new toolbox for massively parallel neural signal processing has been created. It can offer significant speedup in processing signals from large-scale recordings up to thousands of channels. Copyright © 2018 Elsevier B.V. All rights reserved.

A Parallel Strategy for Convolutional Neural Network Based on Heterogeneous Cluster for Mobile Information System

Directory of Open Access Journals (Sweden)

Jilin Zhang

2017-01-01

Full Text Available With the development of the mobile systems, we gain a lot of benefits and convenience by leveraging mobile devices; at the same time, the information gathered by smartphones, such as location and environment, is also valuable for business to provide more intelligent services for customers. More and more machine learning methods have been used in the field of mobile information systems to study user behavior and classify usage patterns, especially convolutional neural network. With the increasing of model training parameters and data scale, the traditional single machine training method cannot meet the requirements of time complexity in practical application scenarios. The current training framework often uses simple data parallel or model parallel method to speed up the training process, which is why heterogeneous computing resources have not been fully utilized. To solve these problems, our paper proposes a delay synchronization convolutional neural network parallel strategy, which leverages the heterogeneous system. The strategy is based on both synchronous parallel and asynchronous parallel approaches; the model training process can reduce the dependence on the heterogeneous architecture in the premise of ensuring the model convergence, so the convolution neural network framework is more adaptive to different heterogeneous system environments. The experimental results show that the proposed delay synchronization strategy can achieve at least three times the speedup compared to the traditional data parallelism.

Artificial neural networks and neuro-fuzzy inference systems as virtual sensors for hydrogen safety prediction

Energy Technology Data Exchange (ETDEWEB)

Karri, Vishy; Ho, Tien [School of Engineering, University of Tasmania, GPO Box 252-65, Hobart, Tasmania 7001 (Australia); Madsen, Ole [Department of Production, Aalborg University, Fibigerstraede 16, DK-9220 Aalborg (Denmark)

2008-06-15

Hydrogen is increasingly investigated as an alternative fuel to petroleum products in running internal combustion engines and as powering remote area power systems using generators. The safety issues related to hydrogen gas are further exasperated by expensive instrumentation required to measure the percentage of explosive limits, flow rates and production pressure. This paper investigates the use of model based virtual sensors (rather than expensive physical sensors) in connection with hydrogen production with a Hogen 20 electrolyzer system. The virtual sensors are used to predict relevant hydrogen safety parameters, such as the percentage of lower explosive limit, hydrogen pressure and hydrogen flow rate as a function of different input conditions of power supplied (voltage and current), the feed of de-ionized water and Hogen 20 electrolyzer system parameters. The virtual sensors are developed by means of the application of various Artificial Intelligent techniques. To train and appraise the neural network models as virtual sensors, the Hogen 20 electrolyzer is instrumented with necessary sensors to gather experimental data which together with MATLAB neural networks toolbox and tailor made adaptive neuro-fuzzy inference systems (ANFIS) were used as predictive tools to estimate hydrogen safety parameters. It was shown that using the neural networks hydrogen safety parameters were predicted to less than 3% of percentage average root mean square error. The most accurate prediction was achieved by using ANFIS. (author)

Evaluation of the Application of Artificial Neural Networks and Adaptive Neuro-Fuzzy Inference Systems for Rainfall-Runoff Modelling in Zayandeh_rood Dam Basin

Directory of Open Access Journals (Sweden)

Mohammad Taghi Dastorani

2012-01-01

Full Text Available During recent few decades, due to the importance of the availability of water, and therefore the necesity of predicting run off resulted from rain fall there has been an increase in developing and implementation of new suitable method for prediction of run off using precipitation data. One of these approaches that have been developed in several areas of sciences including water related fields, is soft computing techniques such as artificial neural networks and fuzzy logic systems. This research was designed to evaluate the applicability of artificial neural network and adaptive neuro –fuzzy inference system to model rainfall-runoff process in Zayandeh_rood dam basin. It must be mentioned that, data have been analysed using Wingamma software, to select appropriate type and number of training input data before they can be used in the models. Then, it has been tried to evaluated applicability of artificial neural networks and neuro-fuzzy techniques to predict runoff generated from daily rainfall. Finally, the accuracy of the results produced by these methods has been compared using statistical criterion. Results taken from this research show that artificial neural networks and neuro-fuzzy technique presented different outputs in different conditions in terms of type and number of inputs variables, but both method have been able to produce acceptable results when suitable input variables and network structures are used.

Comparable mechanisms for action and language: Neural systems behind intentions, goals and means

NARCIS (Netherlands)

Schie, H.T. van; Toni, I.; Bekkering, H.

2006-01-01

In this position paper we explore correspondence between neural systems for language and action starting from recent electrophysiological findings on the roles of posterior and frontal areas in goal-directed grasping actions. The paper compares the perceptual and motor organization for action and

Stability of a neural predictive controller scheme on a neural model

DEFF Research Database (Denmark)

Luther, Jim Benjamin; Sørensen, Paul Haase

2009-01-01

In previous works presenting various forms of neural-network-based predictive controllers, the main emphasis has been on the implementation aspects, i.e. the development of a robust optimization algorithm for the controller, which will be able to perform in real time. However, the stability issue....... The resulting controller is tested on a nonlinear pneumatic servo system.......In previous works presenting various forms of neural-network-based predictive controllers, the main emphasis has been on the implementation aspects, i.e. the development of a robust optimization algorithm for the controller, which will be able to perform in real time. However, the stability issue...... has not been addressed specifically for these controllers. On the other hand a number of results concerning the stability of receding horizon controllers on a nonlinear system exist. In this paper we present a proof of stability for a predictive controller controlling a neural network model...

Fixed-time stabilization of impulsive Cohen-Grossberg BAM neural networks.

Science.gov (United States)

Li, Hongfei; Li, Chuandong; Huang, Tingwen; Zhang, Wanli

2018-02-01

This article is concerned with the fixed-time stabilization for impulsive Cohen-Grossberg BAM neural networks via two different controllers. By using a novel constructive approach based on some comparison techniques for differential inequalities, an improvement theorem of fixed-time stability for impulsive dynamical systems is established. In addition, based on the fixed-time stability theorem of impulsive dynamical systems, two different control protocols are designed to ensure the fixed-time stabilization of impulsive Cohen-Grossberg BAM neural networks, which include and extend the earlier works. Finally, two simulations examples are provided to illustrate the validity of the proposed theoretical results. Copyright © 2017 Elsevier Ltd. All rights reserved.

UAV Trajectory Modeling Using Neural Networks

Science.gov (United States)

Xue, Min

2017-01-01

Large amount of small Unmanned Aerial Vehicles (sUAVs) are projected to operate in the near future. Potential sUAV applications include, but not limited to, search and rescue, inspection and surveillance, aerial photography and video, precision agriculture, and parcel delivery. sUAVs are expected to operate in the uncontrolled Class G airspace, which is at or below 500 feet above ground level (AGL), where many static and dynamic constraints exist, such as ground properties and terrains, restricted areas, various winds, manned helicopters, and conflict avoidance among sUAVs. How to enable safe, efficient, and massive sUAV operations at the low altitude airspace remains a great challenge. NASA's Unmanned aircraft system Traffic Management (UTM) research initiative works on establishing infrastructure and developing policies, requirement, and rules to enable safe and efficient sUAVs' operations. To achieve this goal, it is important to gain insights of future UTM traffic operations through simulations, where the accurate trajectory model plays an extremely important role. On the other hand, like what happens in current aviation development, trajectory modeling should also serve as the foundation for any advanced concepts and tools in UTM. Accurate models of sUAV dynamics and control systems are very important considering the requirement of the meter level precision in UTM operations. The vehicle dynamics are relatively easy to derive and model, however, vehicle control systems remain unknown as they are usually kept by manufactures as a part of intellectual properties. That brings challenges to trajectory modeling for sUAVs. How to model the vehicle's trajectories with unknown control system? This work proposes to use a neural network to model a vehicle's trajectory. The neural network is first trained to learn the vehicle's responses at numerous conditions. Once being fully trained, given current vehicle states, winds, and desired future trajectory, the neural

Controlling selective stimulations below a spinal cord hemisection using brain recordings with a neural interface system approach

Science.gov (United States)

Panetsos, Fivos; Sanchez-Jimenez, Abel; Torets, Carlos; Largo, Carla; Micera, Silvestro

2011-08-01

In this work we address the use of realtime cortical recordings for the generation of coherent, reliable and robust motor activity in spinal-lesioned animals through selective intraspinal microstimulation (ISMS). The spinal cord of adult rats was hemisectioned and groups of multielectrodes were implanted in both the central nervous system (CNS) and the spinal cord below the lesion level to establish a neural system interface (NSI). To test the reliability of this new NSI connection, highly repeatable neural responses recorded from the CNS were used as a pattern generator of an open-loop control strategy for selective ISMS of the spinal motoneurons. Our experimental procedure avoided the spontaneous non-controlled and non-repeatable neural activity that could have generated spurious ISMS and the consequent undesired muscle contractions. Combinations of complex CNS patterns generated precisely coordinated, reliable and robust motor actions.

Dynamics of neural cryptography.

Science.gov (United States)

Ruttor, Andreas; Kinzel, Wolfgang; Kanter, Ido

2007-05-01

Synchronization of neural networks has been used for public channel protocols in cryptography. In the case of tree parity machines the dynamics of both bidirectional synchronization and unidirectional learning is driven by attractive and repulsive stochastic forces. Thus it can be described well by a random walk model for the overlap between participating neural networks. For that purpose transition probabilities and scaling laws for the step sizes are derived analytically. Both these calculations as well as numerical simulations show that bidirectional interaction leads to full synchronization on average. In contrast, successful learning is only possible by means of fluctuations. Consequently, synchronization is much faster than learning, which is essential for the security of the neural key-exchange protocol. However, this qualitative difference between bidirectional and unidirectional interaction vanishes if tree parity machines with more than three hidden units are used, so that those neural networks are not suitable for neural cryptography. In addition, the effective number of keys which can be generated by the neural key-exchange protocol is calculated using the entropy of the weight distribution. As this quantity increases exponentially with the system size, brute-force attacks on neural cryptography can easily be made unfeasible.

Dynamics of neural cryptography

International Nuclear Information System (INIS)

Ruttor, Andreas; Kinzel, Wolfgang; Kanter, Ido

2007-01-01

Synchronization of neural networks has been used for public channel protocols in cryptography. In the case of tree parity machines the dynamics of both bidirectional synchronization and unidirectional learning is driven by attractive and repulsive stochastic forces. Thus it can be described well by a random walk model for the overlap between participating neural networks. For that purpose transition probabilities and scaling laws for the step sizes are derived analytically. Both these calculations as well as numerical simulations show that bidirectional interaction leads to full synchronization on average. In contrast, successful learning is only possible by means of fluctuations. Consequently, synchronization is much faster than learning, which is essential for the security of the neural key-exchange protocol. However, this qualitative difference between bidirectional and unidirectional interaction vanishes if tree parity machines with more than three hidden units are used, so that those neural networks are not suitable for neural cryptography. In addition, the effective number of keys which can be generated by the neural key-exchange protocol is calculated using the entropy of the weight distribution. As this quantity increases exponentially with the system size, brute-force attacks on neural cryptography can easily be made unfeasible