Modulated error diffusion CGHs for neural nets

Science.gov (United States)

Vermeulen, Pieter J. E.; Casasent, David P.

1990-05-01

New modulated error diffusion CGHs (computer generated holograms) for optical computing are considered. Specific attention is given to their use in optical matrix-vector, associative processor, neural net and optical interconnection architectures. We consider lensless CGH systems (many CGHs use an external Fourier transform (FT) lens), the Fresnel sampling requirements, the effects of finite CGH apertures (sample and hold inputs), dot size correction (for laser recorders), and new applications for this novel encoding method (that devotes attention to quantization noise effects).

Squeeze-SegNet: a new fast deep convolutional neural network for semantic segmentation

Science.gov (United States)

Nanfack, Geraldin; Elhassouny, Azeddine; Oulad Haj Thami, Rachid

2018-04-01

The recent researches in Deep Convolutional Neural Network have focused their attention on improving accuracy that provide significant advances. However, if they were limited to classification tasks, nowadays with contributions from Scientific Communities who are embarking in this field, they have become very useful in higher level tasks such as object detection and pixel-wise semantic segmentation. Thus, brilliant ideas in the field of semantic segmentation with deep learning have completed the state of the art of accuracy, however this architectures become very difficult to apply in embedded systems as is the case for autonomous driving. We present a new Deep fully Convolutional Neural Network for pixel-wise semantic segmentation which we call Squeeze-SegNet. The architecture is based on Encoder-Decoder style. We use a SqueezeNet-like encoder and a decoder formed by our proposed squeeze-decoder module and upsample layer using downsample indices like in SegNet and we add a deconvolution layer to provide final multi-channel feature map. On datasets like Camvid or City-states, our net gets SegNet-level accuracy with less than 10 times fewer parameters than SegNet.

MEMBRAIN NEURAL NETWORK FOR VISUAL PATTERN RECOGNITION

Directory of Open Access Journals (Sweden)

Artur Popko

2013-06-01

Full Text Available Recognition of visual patterns is one of significant applications of Artificial Neural Networks, which partially emulate human thinking in the domain of artificial intelligence. In the paper, a simplified neural approach to recognition of visual patterns is portrayed and discussed. This paper is dedicated for investigators in visual patterns recognition, Artificial Neural Networking and related disciplines. The document describes also MemBrain application environment as a powerful and easy to use neural networks’ editor and simulator supporting ANN.

HANPP Collection: Global Patterns in Net Primary Productivity (NPP)

Data.gov (United States)

National Aeronautics and Space Administration — The Global Patterns in Net Primary Productivity (NPP) portion of the Human Appropriation of Net Primary Productivity (HANPP) Collection maps the net amount of solar...

Deep neural nets as a method for quantitative structure-activity relationships.

Science.gov (United States)

Ma, Junshui; Sheridan, Robert P; Liaw, Andy; Dahl, George E; Svetnik, Vladimir

2015-02-23

Neural networks were widely used for quantitative structure-activity relationships (QSAR) in the 1990s. Because of various practical issues (e.g., slow on large problems, difficult to train, prone to overfitting, etc.), they were superseded by more robust methods like support vector machine (SVM) and random forest (RF), which arose in the early 2000s. The last 10 years has witnessed a revival of neural networks in the machine learning community thanks to new methods for preventing overfitting, more efficient training algorithms, and advancements in computer hardware. In particular, deep neural nets (DNNs), i.e. neural nets with more than one hidden layer, have found great successes in many applications, such as computer vision and natural language processing. Here we show that DNNs can routinely make better prospective predictions than RF on a set of large diverse QSAR data sets that are taken from Merck's drug discovery effort. The number of adjustable parameters needed for DNNs is fairly large, but our results show that it is not necessary to optimize them for individual data sets, and a single set of recommended parameters can achieve better performance than RF for most of the data sets we studied. The usefulness of the parameters is demonstrated on additional data sets not used in the calibration. Although training DNNs is still computationally intensive, using graphical processing units (GPUs) can make this issue manageable.

Vector control of wind turbine on the basis of the fuzzy selective neural net*

Science.gov (United States)

Engel, E. A.; Kovalev, I. V.; Engel, N. E.

2016-04-01

An article describes vector control of wind turbine based on fuzzy selective neural net. Based on the wind turbine system’s state, the fuzzy selective neural net tracks an maximum power point under random perturbations. Numerical simulations are accomplished to clarify the applicability and advantages of the proposed vector wind turbine’s control on the basis of the fuzzy selective neuronet. The simulation results show that the proposed intelligent control of wind turbine achieves real-time control speed and competitive performance, as compared to a classical control model with PID controllers based on traditional maximum torque control strategy.

Face recognition: Eigenface, elastic matching, and neural nets

International Nuclear Information System (INIS)

Zhang, J.; Lades, M.

1997-01-01

This paper is a comparative study of three recently proposed algorithms for face recognition: eigenface, autoassociation and classification neural nets, and elastic matching. After these algorithms were analyzed under a common statistical decision framework, they were evaluated experimentally on four individual data bases, each with a moderate subject size, and a combined data base with more than a hundred different subjects. Analysis and experimental results indicate that the eigenface algorithm, which is essentially a minimum distance classifier, works well when lighting variation is small. Its performance deteriorates significantly as lighting variation increases. The elastic matching algorithm, on the other hand, is insensitive to lighting, face position, and expression variations and therefore is more versatile. The performance of the autoassociation and classification nets is upper bounded by that of the eigenface but is more difficult to implement in practice

tf_unet: Generic convolutional neural network U-Net implementation in Tensorflow

Science.gov (United States)

Akeret, Joel; Chang, Chihway; Lucchi, Aurelien; Refregier, Alexandre

2016-11-01

tf_unet mitigates radio frequency interference (RFI) signals in radio data using a special type of Convolutional Neural Network, the U-Net, that enables the classification of clean signal and RFI signatures in 2D time-ordered data acquired from a radio telescope. The code is not tied to a specific segmentation and can be used, for example, to detect radio frequency interference (RFI) in radio astronomy or galaxies and stars in widefield imaging data. This U-Net implementation can outperform classical RFI mitigation algorithms.

A new neural net approach to robot 3D perception and visuo-motor coordination

Science.gov (United States)

Lee, Sukhan

1992-01-01

A novel neural network approach to robot hand-eye coordination is presented. The approach provides a true sense of visual error servoing, redundant arm configuration control for collision avoidance, and invariant visuo-motor learning under gazing control. A 3-D perception network is introduced to represent the robot internal 3-D metric space in which visual error servoing and arm configuration control are performed. The arm kinematic network performs the bidirectional association between 3-D space arm configurations and joint angles, and enforces the legitimate arm configurations. The arm kinematic net is structured by a radial-based competitive and cooperative network with hierarchical self-organizing learning. The main goal of the present work is to demonstrate that the neural net representation of the robot 3-D perception net serves as an important intermediate functional block connecting robot eyes and arms.

NIRFaceNet: A Convolutional Neural Network for Near-Infrared Face Identification

Directory of Open Access Journals (Sweden)

Min Peng

2016-10-01

Full Text Available Near-infrared (NIR face recognition has attracted increasing attention because of its advantage of illumination invariance. However, traditional face recognition methods based on NIR are designed for and tested in cooperative-user applications. In this paper, we present a convolutional neural network (CNN for NIR face recognition (specifically face identification in non-cooperative-user applications. The proposed NIRFaceNet is modified from GoogLeNet, but has a more compact structure designed specifically for the Chinese Academy of Sciences Institute of Automation (CASIA NIR database and can achieve higher identification rates with less training time and less processing time. The experimental results demonstrate that NIRFaceNet has an overall advantage compared to other methods in the NIR face recognition domain when image blur and noise are present. The performance suggests that the proposed NIRFaceNet method may be more suitable for non-cooperative-user applications.

HANPP Collection: Global Patterns in Net Primary Productivity (NPP)

Data.gov (United States)

National Aeronautics and Space Administration — The Global Patterns in Net Primary Productivity (NPP) portion of the HANPP Collection maps the net amount of solar energy converted to plant organic matter through...

Neural-net based coordinated stabilizing control for the exciter and governor loops of low head hydropower plants

Energy Technology Data Exchange (ETDEWEB)

Djukanovic, M.; Novicevic, M.; Dobrijevic, D.; Babic, B. [Electrical Engineering Inst. Nikola Tesla, Belgrade (Yugoslavia); Sobajic, D.J. [Electric Power Research Inst., Palo Alto, CA (United States); Pao, Y.H. [Case Western Reserve Univ., Cleveland, OH (United States)]|[AI WARE, Inc., Cleveland, OH (United States)

1995-12-01

This paper presents a design technique of a new adaptive optimal controller of the low head hydropower plant using artificial neural networks (ANN). The adaptive controller is to operate in real time to improve the generating unit transients through the exciter input, the guide vane position and the runner blade position. The new design procedure is based on self-organization and the predictive estimation capabilities of neural-nets implemented through the cluster-wise segmented associative memory scheme. The developed neural-net based controller (NNC) whose control signals are adjusted using the on-line measurements, can offer better damping effects for generator oscillations over a wide range of operating conditions than conventional controllers. Digital simulations of hydropower plant equipped with low head Kaplan turbine are performed and the comparisons of conventional excitation-governor control, state-space optimal control and neural-net based control are presented. Results obtained on the non-linear mathematical model demonstrate that the effects of the NNC closely agree with those obtained using the state-space multivariable discrete-time optimal controllers.

Neural net prediction of tokamak plasma disruptions

International Nuclear Information System (INIS)

Hernandez, J.V.; Lin, Z.; Horton, W.; McCool, S.C.

1994-10-01

The computation based on neural net algorithms in predicting minor and major disruptions in TEXT tokamak discharges has been performed. Future values of the fluctuating magnetic signal are predicted based on L past values of the magnetic fluctuation signal, measured by a single Mirnov coil. The time step used (= 0.04ms) corresponds to the experimental data sampling rate. Two kinds of approaches are adopted for the task, the contiguous future prediction and the multi-timescale prediction. Results are shown for comparison. Both networks are trained through the back-propagation algorithm with inertial terms. The degree of this success indicates that the magnetic fluctuations associated with tokamak disruptions may be characterized by a relatively low-dimensional dynamical system

Unfolding code for neutron spectrometry based on neural nets technology

International Nuclear Information System (INIS)

Ortiz R, J. M.; Vega C, H. R.

2012-10-01

The most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. The drawbacks associated with traditional unfolding procedures have motivated the need of complementary approaches. Novel methods based on Artificial Neural Networks have been widely investigated. In this work, a neutron spectrum unfolding code based on neural nets technology is presented. This unfolding code called Neutron Spectrometry and Dosimetry by means of Artificial Neural Networks was designed in a graphical interface under LabVIEW programming environment. The core of the code is an embedded neural network architecture, previously optimized by the R obust Design of Artificial Neural Networks Methodology . The main features of the code are: is easy to use, friendly and intuitive to the user. This code was designed for a Bonner Sphere System based on a 6 Lil(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. The main feature of the code is that as entrance data, only seven rate counts measurement with a Bonner spheres spectrometer are required for simultaneously unfold the 60 energy bins of the neutron spectrum and to calculate 15 dosimetric quantities, for radiation protection porpoises. This code generates a full report in html format with all relevant information. (Author)

Neural net generated seismic facies map and attribute facies map

International Nuclear Information System (INIS)

Addy, S.K.; Neri, P.

1998-01-01

The usefulness of 'seismic facies maps' in the analysis of an Upper Wilcox channel system in a 3-D survey shot by CGG in 1995 in Lavaca county in south Texas was discussed. A neural net-generated seismic facies map is a quick hydrocarbon exploration tool that can be applied regionally as well as on a prospect scale. The new technology is used to classify a constant interval parallel to a horizon in a 3-D seismic volume based on the shape of the wiggle traces using a neural network technology. The tool makes it possible to interpret sedimentary features of a petroleum deposit. The same technology can be used in regional mapping by making 'attribute facies maps' in which various forms of amplitude attributes, phase attributes or frequency attributes can be used

Assessment of the expected construction company’s net profit using neural network and multiple regression models

Directory of Open Access Journals (Sweden)

H.H. Mohamad

2013-09-01

This research aims to develop a mathematical model for assessing the expected net profit of any construction company. To achieve the research objective, four steps were performed. First, the main factors affecting firms’ net profit were identified. Second, pertinent data regarding the net profit factors were collected. Third, two different net profit models were developed using the Multiple Regression (MR and the Neural Network (NN techniques. The validity of the proposed models was also investigated. Finally, the results of both MR and NN models were compared to investigate the predictive capabilities of the two models.

Competition and Cooperation in Neural Nets : U.S.-Japan Joint Seminar

CERN Document Server

Arbib, Michael

1982-01-01

The human brain, wi th its hundred billion or more neurons, is both one of the most complex systems known to man and one of the most important. The last decade has seen an explosion of experimental research on the brain, but little theory of neural networks beyond the study of electrical properties of membranes and small neural circuits. Nonetheless, a number of workers in Japan, the United States and elsewhere have begun to contribute to a theory which provides techniques of mathematical analysis and computer simulation to explore properties of neural systems containing immense numbers of neurons. Recently, it has been gradually recognized that rather independent studies of the dynamics of pattern recognition, pattern format::ion, motor control, self-organization, etc. , in neural systems do in fact make use of common methods. We find that a "competition and cooperation" type of interaction plays a fundamental role in parallel information processing in the brain. The present volume brings together 23 papers ...

Real-time applications of neural nets

International Nuclear Information System (INIS)

Spencer, J.E.

1989-05-01

Producing, accelerating and colliding very high power, low emittance beams for long periods is a formidable problem in real-time control. As energy has grown exponentially in time so has the complexity of the machines and their control systems. Similar growth rates have occurred in many areas, e.g., improved integrated circuits have been paid for with comparable increases in complexity. However, in this case, reliability, capability and cost have improved due to reduced size, high production and increased integration which allow various kinds of feedback. In contrast, most large complex systems (LCS) are perceived to lack such possibilities because only one copy is made. Neural nets, as a metaphor for LCS, suggest ways to circumvent such limitations. It is argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems. While complimentary to AI, they mesh nicely with characteristics desired for real-time systems. Such issues are considered, examples given and possibilities discussed. 21 refs., 6 figs

Real-time applications of neural nets

International Nuclear Information System (INIS)

Spencer, J.E.

1989-01-01

Producing, accelerating and colliding very high power, low emittance beams for long periods is a formidable problem in real-time control. As energy has grown exponentially in time so has the complexity of the machines and their control systems. Similar growth rates have occurred in many areas e.g. improved integrated circuits have been paid for with comparable increases in complexity. However, in this case, reliability, capability and cost have improved due to reduced size, high production and increased integration which allow various kinds of feedback. In contrast, most large complex systems (LCS) are perceived to lack such possibilities because only one copy is made. Neural nets, as a metaphor for LCS, suggest ways to circumvent such limitations. It is argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems. While complimentary to AI, they mesh nicely with characteristics desired for real-time systems. In this paper, such issues are considered, examples given and possibilities discussed

Real-time applications of neural nets

Energy Technology Data Exchange (ETDEWEB)

Spencer, J.E.

1989-05-01

Producing, accelerating and colliding very high power, low emittance beams for long periods is a formidable problem in real-time control. As energy has grown exponentially in time so has the complexity of the machines and their control systems. Similar growth rates have occurred in many areas, e.g., improved integrated circuits have been paid for with comparable increases in complexity. However, in this case, reliability, capability and cost have improved due to reduced size, high production and increased integration which allow various kinds of feedback. In contrast, most large complex systems (LCS) are perceived to lack such possibilities because only one copy is made. Neural nets, as a metaphor for LCS, suggest ways to circumvent such limitations. It is argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems. While complimentary to AI, they mesh nicely with characteristics desired for real-time systems. Such issues are considered, examples given and possibilities discussed. 21 refs., 6 figs.

LiteNet: Lightweight Neural Network for Detecting Arrhythmias at Resource-Constrained Mobile Devices

Directory of Open Access Journals (Sweden)

Ziyang He

2018-04-01

Full Text Available By running applications and services closer to the user, edge processing provides many advantages, such as short response time and reduced network traffic. Deep-learning based algorithms provide significantly better performances than traditional algorithms in many fields but demand more resources, such as higher computational power and more memory. Hence, designing deep learning algorithms that are more suitable for resource-constrained mobile devices is vital. In this paper, we build a lightweight neural network, termed LiteNet which uses a deep learning algorithm design to diagnose arrhythmias, as an example to show how we design deep learning schemes for resource-constrained mobile devices. Compare to other deep learning models with an equivalent accuracy, LiteNet has several advantages. It requires less memory, incurs lower computational cost, and is more feasible for deployment on resource-constrained mobile devices. It can be trained faster than other neural network algorithms and requires less communication across different processing units during distributed training. It uses filters of heterogeneous size in a convolutional layer, which contributes to the generation of various feature maps. The algorithm was tested using the MIT-BIH electrocardiogram (ECG arrhythmia database; the results showed that LiteNet outperforms comparable schemes in diagnosing arrhythmias, and in its feasibility for use at the mobile devices.

LiteNet: Lightweight Neural Network for Detecting Arrhythmias at Resource-Constrained Mobile Devices.

Science.gov (United States)

He, Ziyang; Zhang, Xiaoqing; Cao, Yangjie; Liu, Zhi; Zhang, Bo; Wang, Xiaoyan

2018-04-17

By running applications and services closer to the user, edge processing provides many advantages, such as short response time and reduced network traffic. Deep-learning based algorithms provide significantly better performances than traditional algorithms in many fields but demand more resources, such as higher computational power and more memory. Hence, designing deep learning algorithms that are more suitable for resource-constrained mobile devices is vital. In this paper, we build a lightweight neural network, termed LiteNet which uses a deep learning algorithm design to diagnose arrhythmias, as an example to show how we design deep learning schemes for resource-constrained mobile devices. Compare to other deep learning models with an equivalent accuracy, LiteNet has several advantages. It requires less memory, incurs lower computational cost, and is more feasible for deployment on resource-constrained mobile devices. It can be trained faster than other neural network algorithms and requires less communication across different processing units during distributed training. It uses filters of heterogeneous size in a convolutional layer, which contributes to the generation of various feature maps. The algorithm was tested using the MIT-BIH electrocardiogram (ECG) arrhythmia database; the results showed that LiteNet outperforms comparable schemes in diagnosing arrhythmias, and in its feasibility for use at the mobile devices.

Unfolding code for neutron spectrometry based on neural nets technology

Energy Technology Data Exchange (ETDEWEB)

Ortiz R, J. M.; Vega C, H. R., E-mail: morvymm@yahoo.com.mx [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica, Apdo. Postal 336, 98000 Zacatecas (Mexico)

2012-10-15

The most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. The drawbacks associated with traditional unfolding procedures have motivated the need of complementary approaches. Novel methods based on Artificial Neural Networks have been widely investigated. In this work, a neutron spectrum unfolding code based on neural nets technology is presented. This unfolding code called Neutron Spectrometry and Dosimetry by means of Artificial Neural Networks was designed in a graphical interface under LabVIEW programming environment. The core of the code is an embedded neural network architecture, previously optimized by the {sup R}obust Design of Artificial Neural Networks Methodology{sup .} The main features of the code are: is easy to use, friendly and intuitive to the user. This code was designed for a Bonner Sphere System based on a {sup 6}Lil(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. The main feature of the code is that as entrance data, only seven rate counts measurement with a Bonner spheres spectrometer are required for simultaneously unfold the 60 energy bins of the neutron spectrum and to calculate 15 dosimetric quantities, for radiation protection porpoises. This code generates a full report in html format with all relevant information. (Author)

TreeNetViz: revealing patterns of networks over tree structures.

Science.gov (United States)

Gou, Liang; Zhang, Xiaolong Luke

2011-12-01

Network data often contain important attributes from various dimensions such as social affiliations and areas of expertise in a social network. If such attributes exhibit a tree structure, visualizing a compound graph consisting of tree and network structures becomes complicated. How to visually reveal patterns of a network over a tree has not been fully studied. In this paper, we propose a compound graph model, TreeNet, to support visualization and analysis of a network at multiple levels of aggregation over a tree. We also present a visualization design, TreeNetViz, to offer the multiscale and cross-scale exploration and interaction of a TreeNet graph. TreeNetViz uses a Radial, Space-Filling (RSF) visualization to represent the tree structure, a circle layout with novel optimization to show aggregated networks derived from TreeNet, and an edge bundling technique to reduce visual complexity. Our circular layout algorithm reduces both total edge-crossings and edge length and also considers hierarchical structure constraints and edge weight in a TreeNet graph. These experiments illustrate that the algorithm can reduce visual cluttering in TreeNet graphs. Our case study also shows that TreeNetViz has the potential to support the analysis of a compound graph by revealing multiscale and cross-scale network patterns. © 2011 IEEE

LOGIC WITH EXCEPTION ON THE ALGEBRA OF FOURIER-DUAL OPERATIONS: NEURAL NET MECHANISM OF COGNITIVE DISSONANCE REDUCING

Directory of Open Access Journals (Sweden)

A. V. Pavlov

2014-01-01

Full Text Available A mechanism of cognitive dissonance reducing is demonstrated with approach for non-monotonic fuzzy-valued logics by Fourier-holography technique implementation developing. Cognitive dissonance occurs under perceiving of new information that contradicts to the existing subjective pattern of the outside world, represented by double Fourier-transform cascade with a hologram – neural layers interconnections matrix of inner information representation and logical conclusion. The hologram implements monotonic logic according to “General Modus Ponens” rule. New information is represented by a hologram of exclusion that implements interconnections of logical conclusion and exclusion for neural layers. The latter are linked by Fourier transform that determines duality of the algebra forming operations of conjunction and disjunction. Hologram of exclusion forms conclusion that is dual to the “General Modus Ponens” conclusion. It is shown, that trained for the main rule and exclusion system can be represented by two-layered neural network with separate interconnection matrixes for direct and inverse iterations. The network energy function is involved determining the cyclic dynamics character; dissipative factor causing convergence type of the dynamics is analyzed. Both “General Modus Ponens” and exclusion holograms recording conditions on the dynamics and convergence of the system are demonstrated. The system converges to a stable status, in which logical conclusion doesn’t depend on the inner information. Such kind of dynamics, leading to tolerance forming, is typical for ordinary kind of thinking, aimed at inner pattern of outside world stability. For scientific kind of thinking, aimed at adequacy of the inner pattern of the world, a mechanism is needed to stop the net relaxation; the mechanism has to be external relative to the model of logic. Computer simulation results for the learning conditions adequate to real holograms recording are

TopologyNet: Topology based deep convolutional and multi-task neural networks for biomolecular property predictions

Science.gov (United States)

2017-01-01

Although deep learning approaches have had tremendous success in image, video and audio processing, computer vision, and speech recognition, their applications to three-dimensional (3D) biomolecular structural data sets have been hindered by the geometric and biological complexity. To address this problem we introduce the element-specific persistent homology (ESPH) method. ESPH represents 3D complex geometry by one-dimensional (1D) topological invariants and retains important biological information via a multichannel image-like representation. This representation reveals hidden structure-function relationships in biomolecules. We further integrate ESPH and deep convolutional neural networks to construct a multichannel topological neural network (TopologyNet) for the predictions of protein-ligand binding affinities and protein stability changes upon mutation. To overcome the deep learning limitations from small and noisy training sets, we propose a multi-task multichannel topological convolutional neural network (MM-TCNN). We demonstrate that TopologyNet outperforms the latest methods in the prediction of protein-ligand binding affinities, mutation induced globular protein folding free energy changes, and mutation induced membrane protein folding free energy changes. Availability: weilab.math.msu.edu/TDL/ PMID:28749969

Neural Activity Patterns in the Human Brain Reflect Tactile Stickiness Perception

Science.gov (United States)

Kim, Junsuk; Yeon, Jiwon; Ryu, Jaekyun; Park, Jang-Yeon; Chung, Soon-Cheol; Kim, Sung-Phil

2017-01-01

Our previous human fMRI study found brain activations correlated with tactile stickiness perception using the uni-variate general linear model (GLM) (Yeon et al., 2017). Here, we conducted an in-depth investigation on neural correlates of sticky sensations by employing a multivoxel pattern analysis (MVPA) on the same dataset. In particular, we statistically compared multi-variate neural activities in response to the three groups of sticky stimuli: A supra-threshold group including a set of sticky stimuli that evoked vivid sticky perception; an infra-threshold group including another set of sticky stimuli that barely evoked sticky perception; and a sham group including acrylic stimuli with no physically sticky property. Searchlight MVPAs were performed to search for local activity patterns carrying neural information of stickiness perception. Similar to the uni-variate GLM results, significant multi-variate neural activity patterns were identified in postcentral gyrus, subcortical (basal ganglia and thalamus), and insula areas (insula and adjacent areas). Moreover, MVPAs revealed that activity patterns in posterior parietal cortex discriminated the perceptual intensities of stickiness, which was not present in the uni-variate analysis. Next, we applied a principal component analysis (PCA) to the voxel response patterns within identified clusters so as to find low-dimensional neural representations of stickiness intensities. Follow-up clustering analyses clearly showed separate neural grouping configurations between the Supra- and Infra-threshold groups. Interestingly, this neural categorization was in line with the perceptual grouping pattern obtained from the psychophysical data. Our findings thus suggest that different stickiness intensities would elicit distinct neural activity patterns in the human brain and may provide a neural basis for the perception and categorization of tactile stickiness. PMID:28936171

Bayesian Inference using Neural Net Likelihood Models for Protein Secondary Structure Prediction

Directory of Open Access Journals (Sweden)

Seong-Gon Kim

2011-06-01

Full Text Available Several techniques such as Neural Networks, Genetic Algorithms, Decision Trees and other statistical or heuristic methods have been used to approach the complex non-linear task of predicting Alpha-helicies, Beta-sheets and Turns of a proteins secondary structure in the past. This project introduces a new machine learning method by using an offline trained Multilayered Perceptrons (MLP as the likelihood models within a Bayesian Inference framework to predict secondary structures proteins. Varying window sizes are used to extract neighboring amino acid information and passed back and forth between the Neural Net models and the Bayesian Inference process until there is a convergence of the posterior secondary structure probability.

Neural Network for Image-to-Image Control of Optical Tweezers

Science.gov (United States)

Decker, Arthur J.; Anderson, Robert C.; Weiland, Kenneth E.; Wrbanek, Susan Y.

2004-01-01

A method is discussed for using neural networks to control optical tweezers. Neural-net outputs are combined with scaling and tiling to generate 480 by 480-pixel control patterns for a spatial light modulator (SLM). The SLM can be combined in various ways with a microscope to create movable tweezers traps with controllable profiles. The neural nets are intended to respond to scattered light from carbon and silicon carbide nanotube sensors. The nanotube sensors are to be held by the traps for manipulation and calibration. Scaling and tiling allow the 100 by 100-pixel maximum resolution of the neural-net software to be applied in stages to exploit the full 480 by 480-pixel resolution of the SLM. One of these stages is intended to create sensitive null detectors for detecting variations in the scattered light from the nanotube sensors.

Adaptive Forming of the Beam Pattern of Microstrip Antenna with the Use of an Artificial Neural Network

Directory of Open Access Journals (Sweden)

Janusz Dudczyk

2012-01-01

Full Text Available Microstrip antenna has been recently one of the most innovative fields of antenna techniques. The main advantage of such an antenna is the simplicity of its production, little weight, a narrow profile, and easiness of integration of the radiating elements with the net of generators power systems. As a result of using arrays consisting of microstrip antennas; it is possible to decrease the size and weight and also to reduce the costs of components production as well as whole application systems. This paper presents possibilities of using artificial neural networks (ANNs in the process of forming a beam from radiating complex microstrip antenna. Algorithms which base on artificial neural networks use high parallelism of actions which results in considerable acceleration of the process of forming the antenna pattern. The appropriate selection of learning constants makes it possible to get theoretically a solution which will be close to the real time. This paper presents the training neural network algorithm with the selection of optimal network structure. The analysis above was made in case of following the emission source, setting to zero the pattern of direction of expecting interference, and following emission source compared with two constant interferences. Computer simulation was made in MATLAB environment on the basis of Flex Tool, a programme which creates artificial neural networks.

Automated target recognition and tracking using an optical pattern recognition neural network

Science.gov (United States)

Chao, Tien-Hsin

1991-01-01

The on-going development of an automatic target recognition and tracking system at the Jet Propulsion Laboratory is presented. This system is an optical pattern recognition neural network (OPRNN) that is an integration of an innovative optical parallel processor and a feature extraction based neural net training algorithm. The parallel optical processor provides high speed and vast parallelism as well as full shift invariance. The neural network algorithm enables simultaneous discrimination of multiple noisy targets in spite of their scales, rotations, perspectives, and various deformations. This fully developed OPRNN system can be effectively utilized for the automated spacecraft recognition and tracking that will lead to success in the Automated Rendezvous and Capture (AR&C) of the unmanned Cargo Transfer Vehicle (CTV). One of the most powerful optical parallel processors for automatic target recognition is the multichannel correlator. With the inherent advantages of parallel processing capability and shift invariance, multiple objects can be simultaneously recognized and tracked using this multichannel correlator. This target tracking capability can be greatly enhanced by utilizing a powerful feature extraction based neural network training algorithm such as the neocognitron. The OPRNN, currently under investigation at JPL, is constructed with an optical multichannel correlator where holographic filters have been prepared using the neocognitron training algorithm. The computation speed of the neocognitron-type OPRNN is up to 10(exp 14) analog connections/sec that enabling the OPRNN to outperform its state-of-the-art electronics counterpart by at least two orders of magnitude.

Neural Net Safety Monitor Design

Science.gov (United States)

Larson, Richard R.

2007-01-01

The National Aeronautics and Space Administration (NASA) at the Dryden Flight Research Center (DFRC) has been conducting flight-test research using an F-15 aircraft (figure 1). This aircraft has been specially modified to interface a neural net (NN) controller as part of a single-string Airborne Research Test System (ARTS) computer with the existing quad-redundant flight control system (FCC) shown in figure 2. The NN commands are passed to FCC channels 2 and 4 and are cross channel data linked (CCDL) to the other computers as shown. Numerous types of fault-detection monitors exist in the FCC when the NN mode is engaged; these monitors would cause an automatic disengagement of the NN in the event of a triggering fault. Unfortunately, these monitors still may not prevent a possible NN hard-over command from coming through to the control laws. Therefore, an additional and unique safety monitor was designed for a single-string source that allows authority at maximum actuator rates but protects the pilot and structural loads against excessive g-limits in the case of a NN hard-over command input. This additional monitor resides in the FCCs and is executed before the control laws are computed. This presentation describes a floating limiter (FL) concept1 that was developed and successfully test-flown for this program (figure 3). The FL computes the rate of change of the NN commands that are input to the FCC from the ARTS. A window is created with upper and lower boundaries, which is constantly floating and trying to stay centered as the NN command rates are changing. The limiter works by only allowing the window to move at a much slower rate than those of the NN commands. Anywhere within the window, however, full rates are allowed. If a rate persists in one direction, it will eventually hit the boundary and be rate-limited to the floating limiter rate. When this happens, a persistent counter begins and after a limit is reached, a NN disengage command is generated. The

HANPP Collection: Global Patterns in Human Appropriation of Net Primary Productivity (HANPP)

Data.gov (United States)

National Aeronautics and Space Administration — The Global Patterns in Human Appropriation of Net Primary Productivity (HANPP) portion of the HANPP Collection represents a digital map of human appropriation of net...

Alteration of neural action potential patterns by axonal stimulation: the importance of stimulus location.

Science.gov (United States)

Crago, Patrick E; Makowski, Nathaniel S

2014-10-01

Stimulation of peripheral nerves is often superimposed on ongoing motor and sensory activity in the same axons, without a quantitative model of the net action potential train at the axon endpoint. We develop a model of action potential patterns elicited by superimposing constant frequency axonal stimulation on the action potentials arriving from a physiologically activated neural source. The model includes interactions due to collision block, resetting of the neural impulse generator, and the refractory period of the axon at the point of stimulation. Both the mean endpoint firing rate and the probability distribution of the action potential firing periods depend strongly on the relative firing rates of the two sources and the intersite conduction time between them. When the stimulus rate exceeds the neural rate, neural action potentials do not reach the endpoint and the rate of endpoint action potentials is the same as the stimulus rate, regardless of the intersite conduction time. However, when the stimulus rate is less than the neural rate, and the intersite conduction time is short, the two rates partially sum. Increases in stimulus rate produce non-monotonic increases in endpoint rate and continuously increasing block of neurally generated action potentials. Rate summation is reduced and more neural action potentials are blocked as the intersite conduction time increases. At long intersite conduction times, the endpoint rate simplifies to being the maximum of either the neural or the stimulus rate. This study highlights the potential of increasing the endpoint action potential rate and preserving neural information transmission by low rate stimulation with short intersite conduction times. Intersite conduction times can be decreased with proximal stimulation sites for muscles and distal stimulation sites for sensory endings. The model provides a basis for optimizing experiments and designing neuroprosthetic interventions involving motor or sensory stimulation.

Neural net based determination of generator-shedding requirements in electric power systems

Energy Technology Data Exchange (ETDEWEB)

Djukanovic, M [Electrical Engineering Inst. ' Nikola Tesla' , Belgrade (Yugoslavia); Sobajic, D J; Pao, Y -H [Case Western Reserve Univ., Cleveland, OH (United States). Dept. of Electrical Engineering and Applied Physics Case Western Reserve Univ., Cleveland, OH (United States). Dept. of Computer Engineering and Science AI WARE Inc., Cleveland, OH (United States)

1992-09-01

This paper presents an application of artificial neural networks (ANN) in support of a decision-making process by power system operators directed towards the fast stabilisation of multi-machine systems. The proposed approach considers generator shedding as the most effective discrete supplementary control for improving the dynamic performance of faulted power systems and preventing instabilities. The sensitivity of the transient energy function (TEF) with respect to changes in the amount of dropped generation is used during the training phase of ANNs to assess the critical amount of generator shedding required to prevent the loss of synchronism. The learning capabilities of neural nets are used to establish complex mappings between fault information and the amount of generation to be shed, suggesting it as the control signal to the power system operator. (author)

Pattern recognition of state variables by neural networks

International Nuclear Information System (INIS)

Faria, Eduardo Fernandes; Pereira, Claubia

1996-01-01

An artificial intelligence system based on artificial neural networks can be used to classify predefined events and emergency procedures. These systems are being used in different areas. In the nuclear reactors safety, the goal is the classification of events whose data can be processed and recognized by neural networks. In this works we present a preliminary simple system, using neural networks in the recognition of patterns the recognition of variables which define a situation. (author)

Neural-net disruption predictor in JT-60U

International Nuclear Information System (INIS)

Yoshino, R.

2003-01-01

The prediction of major disruptions caused by the density limit, the plasma current ramp-down with high internal inductance l i , the low density locked mode and the β-limit has been investigated in JT-60U. The concept of 'stability level', newly proposed in this paper to predict the occurrence of a major disruption, is calculated from nine input parameters every 2 ms by the neural network and the start of a major disruption is predicted when the stability level decreases to a certain level, the 'alarm level'. The neural network is trained in two steps. It is first trained with 12 disruptive and six non-disruptive shots (total of 8011 data points). Second, the target output data for 12 disruptive shots are modified and the network is trained again with additional data points generated by the operator. The 'neural-net disruption predictor' obtained has been tested for 300 disruptive shots (128 945 data points) and 1008 non-disruptive shots (982 800 data points) selected from nine years of operation (1991-1999) of JT-60U. Major disruptions except for those caused by the -limit have been predicted with a prediction success rate of 97-98% at 10 ms prior to the disruption and higher than 90% at 30 ms prior to the disruption while the false alarm rate is 2.1% for non-disruptive shots. This prediction performance has been confirmed for 120 disruptive shots (56 163 data points), caused by the density limit, as well as 1032 non-disruptive shots (1004 611 data points) in the last four years of operation (1999-2002) of JT-60U. A careful selection of the input parameters supplied to the network and the newly developed two-step training of the network have reduced the false alarm rate resulting in a considerable improvement of the prediction success rate. (author)

Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification

Science.gov (United States)

Anwer, Rao Muhammad; Khan, Fahad Shahbaz; van de Weijer, Joost; Molinier, Matthieu; Laaksonen, Jorma

2018-04-01

Designing discriminative powerful texture features robust to realistic imaging conditions is a challenging computer vision problem with many applications, including material recognition and analysis of satellite or aerial imagery. In the past, most texture description approaches were based on dense orderless statistical distribution of local features. However, most recent approaches to texture recognition and remote sensing scene classification are based on Convolutional Neural Networks (CNNs). The de facto practice when learning these CNN models is to use RGB patches as input with training performed on large amounts of labeled data (ImageNet). In this paper, we show that Local Binary Patterns (LBP) encoded CNN models, codenamed TEX-Nets, trained using mapped coded images with explicit LBP based texture information provide complementary information to the standard RGB deep models. Additionally, two deep architectures, namely early and late fusion, are investigated to combine the texture and color information. To the best of our knowledge, we are the first to investigate Binary Patterns encoded CNNs and different deep network fusion architectures for texture recognition and remote sensing scene classification. We perform comprehensive experiments on four texture recognition datasets and four remote sensing scene classification benchmarks: UC-Merced with 21 scene categories, WHU-RS19 with 19 scene classes, RSSCN7 with 7 categories and the recently introduced large scale aerial image dataset (AID) with 30 aerial scene types. We demonstrate that TEX-Nets provide complementary information to standard RGB deep model of the same network architecture. Our late fusion TEX-Net architecture always improves the overall performance compared to the standard RGB network on both recognition problems. Furthermore, our final combination leads to consistent improvement over the state-of-the-art for remote sensing scene classification.

Prediction of Disease Causing Non-Synonymous SNPs by the Artificial Neural Network Predictor NetDiseaseSNP

DEFF Research Database (Denmark)

Johansen, Morten Bo; Gonzalez-Izarzugaza, Jose Maria; Brunak, Søren

2013-01-01

We have developed a sequence conservation-based artificial neural network predictor called NetDiseaseSNP which classifies nsSNPs as disease-causing or neutral. Our method uses the excellent alignment generation algorithm of SIFT to identify related sequences and a combination of 31 features...

Oscillator Neural Network Retrieving Sparsely Coded Phase Patterns

Science.gov (United States)

Aoyagi, Toshio; Nomura, Masaki

1999-08-01

Little is known theoretically about the associative memory capabilities of neural networks in which information is encoded not only in the mean firing rate but also in the timing of firings. Particularly, in the case of sparsely coded patterns, it is biologically important to consider the timings of firings and to study how such consideration influences storage capacities and quality of recalled patterns. For this purpose, we propose a simple extended model of oscillator neural networks to allow for expression of a nonfiring state. Analyzing both equilibrium states and dynamical properties in recalling processes, we find that the system possesses good associative memory.

Prediction of disease causing non-synonymous SNPs by the Artificial Neural Network Predictor NetDiseaseSNP.

Directory of Open Access Journals (Sweden)

Morten Bo Johansen

Full Text Available We have developed a sequence conservation-based artificial neural network predictor called NetDiseaseSNP which classifies nsSNPs as disease-causing or neutral. Our method uses the excellent alignment generation algorithm of SIFT to identify related sequences and a combination of 31 features assessing sequence conservation and the predicted surface accessibility to produce a single score which can be used to rank nsSNPs based on their potential to cause disease. NetDiseaseSNP classifies successfully disease-causing and neutral mutations. In addition, we show that NetDiseaseSNP discriminates cancer driver and passenger mutations satisfactorily. Our method outperforms other state-of-the-art methods on several disease/neutral datasets as well as on cancer driver/passenger mutation datasets and can thus be used to pinpoint and prioritize plausible disease candidates among nsSNPs for further investigation. NetDiseaseSNP is publicly available as an online tool as well as a web service: http://www.cbs.dtu.dk/services/NetDiseaseSNP.

Vector neural net identifying many strongly distorted and correlated patterns

Science.gov (United States)

Kryzhanovsky, Boris V.; Mikaelian, Andrei L.; Fonarev, Anatoly B.

2005-01-01

We suggest an effective and simple algorithm providing a polynomial storage capacity of a network of the form M ~ N2s+1, where N is the dimension of the stored binary patterns. In this problem the value of the free parameter s is restricted by the inequalities N >> slnN >= 1. The algorithm allows us to identify a large number of highly distorted similar patterns. The negative influence of correlations of the patterns is suppressed by choosing a sufficiently large value of the parameter s. We show the efficiency of the algorithm by the example of a perceptron identifier, but it also can be used to increase the storage capacity of full connected systems of associative memory.

Patterns recognition of electric brain activity using artificial neural networks

Science.gov (United States)

Musatov, V. Yu.; Pchelintseva, S. V.; Runnova, A. E.; Hramov, A. E.

2017-04-01

An approach for the recognition of various cognitive processes in the brain activity in the perception of ambiguous images. On the basis of developed theoretical background and the experimental data, we propose a new classification of oscillating patterns in the human EEG by using an artificial neural network approach. After learning of the artificial neural network reliably identified cube recognition processes, for example, left-handed or right-oriented Necker cube with different intensity of their edges, construct an artificial neural network based on Perceptron architecture and demonstrate its effectiveness in the pattern recognition of the EEG in the experimental.

Application of artificial neural nets to Shashlik calorimetry

International Nuclear Information System (INIS)

Bonesini, M.; Paganoni, M.; Terranova, F.

1997-01-01

Artificial neural networks (ANN) are powerful tools widely used in high-energy physics to solve track finding and particle identification problems. An entirely new class of application is related to the problem of recovering the information lost during data taking or signal transmission. Good performances can be reached by ANN when the events are described by quite regular patterns. Such a method was used for the DELPHI luminosity monitor (STIC) to recover calorimeter dead channels. A comparison with more traditional techniques is also given. (orig.)

Unlearning in feed-forward multi-nets

NARCIS (Netherlands)

Spaanenburg, L; Kurkova,; Steele, NC; Neruda, R; Karny, M

2001-01-01

Multi-nets promise an improved performance over monolithic neural networks by virtue of their distributed implementation. Modular neural networks are multi-nets based on an judicious assembly of functionally different parts. This can be viewed as again a monolithic network, but with more complex

Hypothetical Pattern Recognition Design Using Multi-Layer Perceptorn Neural Network For Supervised Learning

Directory of Open Access Journals (Sweden)

Md. Abdullah-al-mamun

2015-08-01

Full Text Available Abstract Humans are capable to identifying diverse shape in the different pattern in the real world as effortless fashion due to their intelligence is grow since born with facing several learning process. Same way we can prepared an machine using human like brain called Artificial Neural Network that can be recognize different pattern from the real world object. Although the various techniques is exists to implementation the pattern recognition but recently the artificial neural network approaches have been giving the significant attention. Because the approached of artificial neural network is like a human brain that is learn from different observation and give a decision the previously learning rule. Over the 50 years research now a days pattern recognition for machine learning using artificial neural network got a significant achievement. For this reason many real world problem can be solve by modeling the pattern recognition process. The objective of this paper is to present the theoretical concept for pattern recognition design using Multi-Layer Perceptorn neural networkin the algorithm of artificial Intelligence as the best possible way of utilizing available resources to make a decision that can be a human like performance.

The EB factory project. I. A fast, neural-net-based, general purpose light curve classifier optimized for eclipsing binaries

International Nuclear Information System (INIS)

Paegert, Martin; Stassun, Keivan G.; Burger, Dan M.

2014-01-01

We describe a new neural-net-based light curve classifier and provide it with documentation as a ready-to-use tool for the community. While optimized for identification and classification of eclipsing binary stars, the classifier is general purpose, and has been developed for speed in the context of upcoming massive surveys such as the Large Synoptic Survey Telescope. A challenge for classifiers in the context of neural-net training and massive data sets is to minimize the number of parameters required to describe each light curve. We show that a simple and fast geometric representation that encodes the overall light curve shape, together with a chi-square parameter to capture higher-order morphology information results in efficient yet robust light curve classification, especially for eclipsing binaries. Testing the classifier on the ASAS light curve database, we achieve a retrieval rate of 98% and a false-positive rate of 2% for eclipsing binaries. We achieve similarly high retrieval rates for most other periodic variable-star classes, including RR Lyrae, Mira, and delta Scuti. However, the classifier currently has difficulty discriminating between different sub-classes of eclipsing binaries, and suffers a relatively low (∼60%) retrieval rate for multi-mode delta Cepheid stars. We find that it is imperative to train the classifier's neural network with exemplars that include the full range of light curve quality to which the classifier will be expected to perform; the classifier performs well on noisy light curves only when trained with noisy exemplars. The classifier source code, ancillary programs, a trained neural net, and a guide for use, are provided.

An adaptable Boolean net trainable to control a computing robot

International Nuclear Information System (INIS)

Lauria, F. E.; Prevete, R.; Milo, M.; Visco, S.

1999-01-01

We discuss a method to implement in a Boolean neural network a Hebbian rule so to obtain an adaptable universal control system. We start by presenting both the Boolean neural net and the Hebbian rule we have considered. Then we discuss, first, the problems arising when the latter is naively implemented in a Boolean neural net, second, the method consenting us to overcome them and the ensuing adaptable Boolean neural net paradigm. Next, we present the adaptable Boolean neural net as an intelligent control system, actually controlling a writing robot, and discuss how to train it in the execution of the elementary arithmetic operations on operands represented by numerals with an arbitrary number of digits

ConvNetQuake: Convolutional Neural Network for Earthquake Detection and Location

Science.gov (United States)

Denolle, M.; Perol, T.; Gharbi, M.

2017-12-01

Over the last decades, the volume of seismic data has increased exponentially, creating a need for efficient algorithms to reliably detect and locate earthquakes. Today's most elaborate methods scan through the plethora of continuous seismic records, searching for repeating seismic signals. In this work, we leverage the recent advances in artificial intelligence and present ConvNetQuake, a highly scalable convolutional neural network for probabilistic earthquake detection and location from single stations. We apply our technique to study two years of induced seismicity in Oklahoma (USA). We detect 20 times more earthquakes than previously cataloged by the Oklahoma Geological Survey. Our algorithm detection performances are at least one order of magnitude faster than other established methods.

Learning-induced pattern classification in a chaotic neural network

International Nuclear Information System (INIS)

Li, Yang; Zhu, Ping; Xie, Xiaoping; He, Guoguang; Aihara, Kazuyuki

2012-01-01

In this Letter, we propose a Hebbian learning rule with passive forgetting (HLRPF) for use in a chaotic neural network (CNN). We then define the indices based on the Euclidean distance to investigate the evolution of the weights in a simplified way. Numerical simulations demonstrate that, under suitable external stimulations, the CNN with the proposed HLRPF acts as a fuzzy-like pattern classifier that performs much better than an ordinary CNN. The results imply relationship between learning and recognition. -- Highlights: ► Proposing a Hebbian learning rule with passive forgetting (HLRPF). ► Defining indices to investigate the evolution of the weights simply. ► The chaotic neural network with HLRPF acts as a fuzzy-like pattern classifier. ► The pattern classifier ability of the network is improved much.

Modular Neural Networks and Type-2 Fuzzy Systems for Pattern Recognition

CERN Document Server

Melin, Patricia

2012-01-01

This book describes hybrid intelligent systems using type-2 fuzzy logic and modular neural networks for pattern recognition applications. Hybrid intelligent systems combine several intelligent computing paradigms, including fuzzy logic, neural networks, and bio-inspired optimization algorithms, which can be used to produce powerful pattern recognition systems. Type-2 fuzzy logic is an extension of traditional type-1 fuzzy logic that enables managing higher levels of uncertainty in complex real world problems, which are of particular importance in the area of pattern recognition. The book is organized in three main parts, each containing a group of chapters built around a similar subject. The first part consists of chapters with the main theme of theory and design algorithms, which are basically chapters that propose new models and concepts, which are the basis for achieving intelligent pattern recognition. The second part contains chapters with the main theme of using type-2 fuzzy models and modular neural ne...

An improved genetic algorithm for designing optimal temporal patterns of neural stimulation

Science.gov (United States)

Cassar, Isaac R.; Titus, Nathan D.; Grill, Warren M.

2017-12-01

Objective. Electrical neuromodulation therapies typically apply constant frequency stimulation, but non-regular temporal patterns of stimulation may be more effective and more efficient. However, the design space for temporal patterns is exceedingly large, and model-based optimization is required for pattern design. We designed and implemented a modified genetic algorithm (GA) intended for design optimal temporal patterns of electrical neuromodulation. Approach. We tested and modified standard GA methods for application to designing temporal patterns of neural stimulation. We evaluated each modification individually and all modifications collectively by comparing performance to the standard GA across three test functions and two biophysically-based models of neural stimulation. Main results. The proposed modifications of the GA significantly improved performance across the test functions and performed best when all were used collectively. The standard GA found patterns that outperformed fixed-frequency, clinically-standard patterns in biophysically-based models of neural stimulation, but the modified GA, in many fewer iterations, consistently converged to higher-scoring, non-regular patterns of stimulation. Significance. The proposed improvements to standard GA methodology reduced the number of iterations required for convergence and identified superior solutions.

Artificial neural net system for interactive tissue classification with MR imaging and image segmentation

International Nuclear Information System (INIS)

Clarke, L.P.; Silbiger, M.; Naylor, C.; Brown, K.

1990-01-01

This paper reports on the development of interactive methods for MR tissue classification that permit mathematically rigorous methods for three-dimensional image segmentation and automatic organ/tumor contouring, as required for surgical and RTP planning. The authors investigate a number of image-intensity based tissue- classification methods that make no implicit assumptions on the MR parameters and hence are not limited by image data set. Similarly, we have trained artificial neural net (ANN) systems for both supervised and unsupervised tissue classification

Pattern Recognition and Classification of Fatal Traffic Accidents in Israel A Neural Network Approach

DEFF Research Database (Denmark)

Prato, Carlo Giacomo; Gitelman, Victoria; Bekhor, Shlomo

2011-01-01

on 1,793 fatal traffic accidents occurred during the period between 2003 and 2006 and applies Kohonen and feed-forward back-propagation neural networks with the objective of extracting from the data typical patterns and relevant factors. Kohonen neural networks reveal five compelling accident patterns....... Feed-forward back-propagation neural networks indicate that sociodemographic characteristics of drivers and victims, accident location, and period of the day are extremely relevant factors. Accident patterns suggest that countermeasures are necessary for identified problems concerning mainly vulnerable...

A biologically inspired neural net for trajectory formation and obstacle avoidance.

Science.gov (United States)

Glasius, R; Komoda, A; Gielen, S C

1996-06-01

In this paper we present a biologically inspired two-layered neural network for trajectory formation and obstacle avoidance. The two topographically ordered neural maps consist of analog neurons having continuous dynamics. The first layer, the sensory map, receives sensory information and builds up an activity pattern which contains the optimal solution (i.e. shortest path without collisions) for any given set of current position, target positions and obstacle positions. Targets and obstacles are allowed to move, in which case the activity pattern in the sensory map will change accordingly. The time evolution of the neural activity in the second layer, the motor map, results in a moving cluster of activity, which can be interpreted as a population vector. Through the feedforward connections between the two layers, input of the sensory map directs the movement of the cluster along the optimal path from the current position of the cluster to the target position. The smooth trajectory is the result of the intrinsic dynamics of the network only. No supervisor is required. The output of the motor map can be used for direct control of an autonomous system in a cluttered environment or for control of the actuators of a biological limb or robot manipulator. The system is able to reach a target even in the presence of an external perturbation. Computer simulations of a point robot and a multi-joint manipulator illustrate the theory.

Three-dimensional neural net for learning visuomotor coordination of a robot arm.

Science.gov (United States)

Martinetz, T M; Ritter, H J; Schulten, K J

1990-01-01

An extension of T. Kohonen's (1982) self-organizing mapping algorithm together with an error-correction scheme based on the Widrow-Hoff learning rule is applied to develop a learning algorithm for the visuomotor coordination of a simulated robot arm. Learning occurs by a sequence of trial movements without the need for an external teacher. Using input signals from a pair of cameras, the closed robot arm system is able to reduce its positioning error to about 0.3% of the linear dimensions of its work space. This is achieved by choosing the connectivity of a three-dimensional lattice consisting of the units of the neural net.

Door and cabinet recognition using convolutional neural nets and real-time method fusion for handle detection and grasping

DEFF Research Database (Denmark)

Maurin, Adrian Llopart; Ravn, Ole; Andersen, Nils Axel

2017-01-01

In this paper we present a new method that robustly identifies doors, cabinets and their respective handles, with special emphasis on extracting useful features from handles to be then manipulated. The novelty of this system relies on the combination of a Convolutional Neural Net (CNN), as a form...

A 3D Active Learning Application for NeMO-Net, the NASA Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

Science.gov (United States)

van den Bergh, J.; Schutz, J.; Chirayath, V.; Li, A.

2017-12-01

NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Net's convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign.Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users' input against pre-classified coral imagery to gauge their accuracy and utilizes in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.

A 3D Active Learning Application for NeMO-Net, the NASA Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

Science.gov (United States)

van den Bergh, Jarrett; Schutz, Joey; Li, Alan; Chirayath, Ved

2017-01-01

NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Nets convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign. Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users input against pre-classified coral imagery to gauge their accuracy and utilize in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.

Antenna analysis using neural networks

Science.gov (United States)

Smith, William T.

1992-01-01

Conventional computing schemes have long been used to analyze problems in electromagnetics (EM). The vast majority of EM applications require computationally intensive algorithms involving numerical integration and solutions to large systems of equations. The feasibility of using neural network computing algorithms for antenna analysis is investigated. The ultimate goal is to use a trained neural network algorithm to reduce the computational demands of existing reflector surface error compensation techniques. Neural networks are computational algorithms based on neurobiological systems. Neural nets consist of massively parallel interconnected nonlinear computational elements. They are often employed in pattern recognition and image processing problems. Recently, neural network analysis has been applied in the electromagnetics area for the design of frequency selective surfaces and beam forming networks. The backpropagation training algorithm was employed to simulate classical antenna array synthesis techniques. The Woodward-Lawson (W-L) and Dolph-Chebyshev (D-C) array pattern synthesis techniques were used to train the neural network. The inputs to the network were samples of the desired synthesis pattern. The outputs are the array element excitations required to synthesize the desired pattern. Once trained, the network is used to simulate the W-L or D-C techniques. Various sector patterns and cosecant-type patterns (27 total) generated using W-L synthesis were used to train the network. Desired pattern samples were then fed to the neural network. The outputs of the network were the simulated W-L excitations. A 20 element linear array was used. There were 41 input pattern samples with 40 output excitations (20 real parts, 20 imaginary). A comparison between the simulated and actual W-L techniques is shown for a triangular-shaped pattern. Dolph-Chebyshev is a different class of synthesis technique in that D-C is used for side lobe control as opposed to pattern

22nd Italian Workshop on Neural Nets

CERN Document Server

Bassis, Simone; Esposito, Anna; Morabito, Francesco

2013-01-01

This volume collects a selection of contributions which has been presented at the 22nd Italian Workshop on Neural Networks, the yearly meeting of the Italian Society for Neural Networks (SIREN). The conference was held in Italy, Vietri sul Mare (Salerno), during May 17-19, 2012. The annual meeting of SIREN is sponsored by International Neural Network Society (INNS), European Neural Network Society (ENNS) and IEEE Computational Intelligence Society (CIS). The book – as well as the workshop-  is organized in three main components, two special sessions and a group of regular sessions featuring different aspects and point of views of artificial neural networks and natural intelligence, also including applications of present compelling interest.

Neural Global Pattern Similarity Underlies True and False Memories.

Science.gov (United States)

Ye, Zhifang; Zhu, Bi; Zhuang, Liping; Lu, Zhonglin; Chen, Chuansheng; Xue, Gui

2016-06-22

The neural processes giving rise to human memory strength signals remain poorly understood. Inspired by formal computational models that posit a central role of global matching in memory strength, we tested a novel hypothesis that the strengths of both true and false memories arise from the global similarity of an item's neural activation pattern during retrieval to that of all the studied items during encoding (i.e., the encoding-retrieval neural global pattern similarity [ER-nGPS]). We revealed multiple ER-nGPS signals that carried distinct information and contributed differentially to true and false memories: Whereas the ER-nGPS in the parietal regions reflected semantic similarity and was scaled with the recognition strengths of both true and false memories, ER-nGPS in the visual cortex contributed solely to true memory. Moreover, ER-nGPS differences between the parietal and visual cortices were correlated with frontal monitoring processes. By combining computational and neuroimaging approaches, our results advance a mechanistic understanding of memory strength in recognition. What neural processes give rise to memory strength signals, and lead to our conscious feelings of familiarity? Using fMRI, we found that the memory strength of a given item depends not only on how it was encoded during learning, but also on the similarity of its neural representation with other studied items. The global neural matching signal, mainly in the parietal lobule, could account for the memory strengths of both studied and unstudied items. Interestingly, a different global matching signal, originated from the visual cortex, could distinguish true from false memories. The findings reveal multiple neural mechanisms underlying the memory strengths of events registered in the brain. Copyright © 2016 the authors 0270-6474/16/366792-11$15.00/0.

Learning and Generalisation in Neural Networks with Local Preprocessing

OpenAIRE

Kutsia, Merab

2007-01-01

We study learning and generalisation ability of a specific two-layer feed-forward neural network and compare its properties to that of a simple perceptron. The input patterns are mapped nonlinearly onto a hidden layer, much larger than the input layer, and this mapping is either fixed or may result from an unsupervised learning process. Such preprocessing of initially uncorrelated random patterns results in the correlated patterns in the hidden layer. The hidden-to-output mapping of the net...

Optimization of control bars patterns and fuel recharges of coupled form

International Nuclear Information System (INIS)

Mejia S, D.M.; Ortiz S, J.J.

2006-01-01

In this work a system coupled for the optimization of fuel recharges and control bars patterns in boiling water reactors (BWR by its initials in English) is presented. It was used a multi state recurrent neural net like optimization technique. This type of neural net has been used in the solution of diverse problems, in particular the design of patterns of control bars and the design of the fuel recharge. However, these problems have been resolved in an independent way with different optimization techniques. The system was developed in FORTRAN 77 language, it calls OCORN (Optimization of Cycles of Operation using Neural Nets) and it solves both problems of combinatory optimization in a coupled way. OCORN begins creating a seed recharge by means of an optimization through the Haling principle. Later on a pattern of control bars for this recharge seed is proposed. Then a new fuel recharge is designed using the control bars patterns previously found. By this way an iterative process begins among the optimization of control bars patterns and the fuel recharge until a stop criteria it is completed. The stop criteria is completed when the fuel recharges and the control bars patterns don't vary in several successive iterations. The final result is an optimal fuel recharge and its respective control bars pattern. In this work the obtained results by this system for a cycle of balance of 18 months divided in 12 steps of burnt are presented. The obtained results are very encouraging, since the fuel recharge and the control bars pattern, its fulfill with the restrictions imposed in each one of the problems. (Author)

Fluctuation-Driven Neural Dynamics Reproduce Drosophila Locomotor Patterns.

Directory of Open Access Journals (Sweden)

Andrea Maesani

2015-11-01

Full Text Available The neural mechanisms determining the timing of even simple actions, such as when to walk or rest, are largely mysterious. One intriguing, but untested, hypothesis posits a role for ongoing activity fluctuations in neurons of central action selection circuits that drive animal behavior from moment to moment. To examine how fluctuating activity can contribute to action timing, we paired high-resolution measurements of freely walking Drosophila melanogaster with data-driven neural network modeling and dynamical systems analysis. We generated fluctuation-driven network models whose outputs-locomotor bouts-matched those measured from sensory-deprived Drosophila. From these models, we identified those that could also reproduce a second, unrelated dataset: the complex time-course of odor-evoked walking for genetically diverse Drosophila strains. Dynamical models that best reproduced both Drosophila basal and odor-evoked locomotor patterns exhibited specific characteristics. First, ongoing fluctuations were required. In a stochastic resonance-like manner, these fluctuations allowed neural activity to escape stable equilibria and to exceed a threshold for locomotion. Second, odor-induced shifts of equilibria in these models caused a depression in locomotor frequency following olfactory stimulation. Our models predict that activity fluctuations in action selection circuits cause behavioral output to more closely match sensory drive and may therefore enhance navigation in complex sensory environments. Together these data reveal how simple neural dynamics, when coupled with activity fluctuations, can give rise to complex patterns of animal behavior.

Hindcasting of storm waves using neural networks

Digital Repository Service at National Institute of Oceanography (India)

Rao, S.; Mandal, S.

Department NN neural network net i weighted sum of the inputs of neuron i o k network output at kth output node P total number of training pattern s i output of neuron i t k target output at kth output node 1. Introduction Severe storms occur in Bay of Bengal...), forecasting of runoff (Crespo and Mora, 1993), concrete strength (Kasperkiewicz et al., 1995). The uses of neural network in the coastal the wave conditions will change from year to year, thus a proper statistical and climatological treatment requires several...

Gait pattern recognition in cerebral palsy patients using neural network modelling

International Nuclear Information System (INIS)

Muhammad, J.; Gibbs, S.; Abboud, R.; Anand, S.

2015-01-01

Interpretation of gait data obtained from modern 3D gait analysis is a challenging and time consuming task. The aim of this study was to create neural network models which can recognise the gait patterns from pre- and post-treatment and the normal ones. Neural network is a method which works on the principle of learning from experience and then uses the obtained knowledge to predict the unknown. Methods: Twenty-eight patients with cerebral palsy were recruited as subjects whose gait was analysed in pre- and post-treatment. A group of twenty-six normal subjects also participated in this study as control group. All subjects gait was analysed using Vicon Nexus to obtain the gait parameters and kinetic and kinematic parameters of hip, knee and ankle joints in three planes of both limbs. The gait data was used as input to create neural network models. A total of approximately 300 trials were split into 70% and 30% to train and test the models, respectively. Different models were built using different parameters. The gait was categorised as three patterns, i.e., normal, pre- and post-treatments. Result: The results showed that the models using all parameters or using the joint angles and moments could predict the gait patterns with approximately 95% accuracy. Some of the models e.g., the models using joint power and moments, had lower rate in recognition of gait patterns with approximately 70-90% successful ratio. Conclusion: Neural network model can be used in clinical practice to recognise the gait pattern for cerebral palsy patients. (author)

Recurrent Neural Network For Forecasting Time Series With Long Memory Pattern

Science.gov (United States)

Walid; Alamsyah

2017-04-01

Recurrent Neural Network as one of the hybrid models are often used to predict and estimate the issues related to electricity, can be used to describe the cause of the swelling of electrical load which experienced by PLN. In this research will be developed RNN forecasting procedures at the time series with long memory patterns. Considering the application is the national electrical load which of course has a different trend with the condition of the electrical load in any country. This research produces the algorithm of time series forecasting which has long memory pattern using E-RNN after this referred to the algorithm of integrated fractional recurrent neural networks (FIRNN).The prediction results of long memory time series using models Fractional Integrated Recurrent Neural Network (FIRNN) showed that the model with the selection of data difference in the range of [-1,1] and the model of Fractional Integrated Recurrent Neural Network (FIRNN) (24,6,1) provides the smallest MSE value, which is 0.00149684.

Compact holographic optical neural network system for real-time pattern recognition

Science.gov (United States)

Lu, Taiwei; Mintzer, David T.; Kostrzewski, Andrew A.; Lin, Freddie S.

1996-08-01

One of the important characteristics of artificial neural networks is their capability for massive interconnection and parallel processing. Recently, specialized electronic neural network processors and VLSI neural chips have been introduced in the commercial market. The number of parallel channels they can handle is limited because of the limited parallel interconnections that can be implemented with 1D electronic wires. High-resolution pattern recognition problems can require a large number of neurons for parallel processing of an image. This paper describes a holographic optical neural network (HONN) that is based on high- resolution volume holographic materials and is capable of performing massive 3D parallel interconnection of tens of thousands of neurons. A HONN with more than 16,000 neurons packaged in an attache case has been developed. Rotation- shift-scale-invariant pattern recognition operations have been demonstrated with this system. System parameters such as the signal-to-noise ratio, dynamic range, and processing speed are discussed.

Enlisting Clustering and Graph-Traversal Methods for Cutting Pattern and Net Topology Design in Pneumatic Hybrids

DEFF Research Database (Denmark)

Ayres, Phil; Vestartas, Petras; Ramsgaard Thomsen, Mette

2017-01-01

Cutting patterns for architectural membranes are generally characterised by rational approaches to surface discretisation and minimisation of geometric deviation between discrete elements that comprise the membrane. In this paper, we present an alternative approach for cutting pattern generation...... to the cutting pattern generation method and the net topology generation method used to produce a constraint net for a given membrane. We test our computational design approach through an iterative cycle of digital and physical prototyping before realising an air-inflated cable restrained pneumatic structural...

Transformed Neural Pattern Reinstatement during Episodic Memory Retrieval.

Science.gov (United States)

Xiao, Xiaoqian; Dong, Qi; Gao, Jiahong; Men, Weiwei; Poldrack, Russell A; Xue, Gui

2017-03-15

Contemporary models of episodic memory posit that remembering involves the reenactment of encoding processes. Although encoding-retrieval similarity has been consistently reported and linked to memory success, the nature of neural pattern reinstatement is poorly understood. Using high-resolution fMRI on human subjects, our results obtained clear evidence for item-specific pattern reinstatement in the frontoparietal cortex, even when the encoding-retrieval pairs shared no perceptual similarity. No item-specific pattern reinstatement was found in the ventral visual cortex. Importantly, the brain regions and voxels carrying item-specific representation differed significantly between encoding and retrieval, and the item specificity for encoding-retrieval similarity was smaller than that for encoding or retrieval, suggesting different nature of representations between encoding and retrieval. Moreover, cross-region representational similarity analysis suggests that the encoded representation in the ventral visual cortex was reinstated in the frontoparietal cortex during retrieval. Together, these results suggest that, in addition to reinstatement of the originally encoded pattern in the brain regions that perform encoding processes, retrieval may also involve the reinstatement of a transformed representation of the encoded information. These results emphasize the constructive nature of memory retrieval that helps to serve important adaptive functions. SIGNIFICANCE STATEMENT Episodic memory enables humans to vividly reexperience past events, yet how this is achieved at the neural level is barely understood. A long-standing hypothesis posits that memory retrieval involves the faithful reinstatement of encoding-related activity. We tested this hypothesis by comparing the neural representations during encoding and retrieval. We found strong pattern reinstatement in the frontoparietal cortex, but not in the ventral visual cortex, that represents visual details. Critically

Pattern classification and recognition of invertebrate functional groups using self-organizing neural networks.

Science.gov (United States)

Zhang, WenJun

2007-07-01

Self-organizing neural networks can be used to mimic non-linear systems. The main objective of this study is to make pattern classification and recognition on sampling information using two self-organizing neural network models. Invertebrate functional groups sampled in the irrigated rice field were classified and recognized using one-dimensional self-organizing map and self-organizing competitive learning neural networks. Comparisons between neural network models, distance (similarity) measures, and number of neurons were conducted. The results showed that self-organizing map and self-organizing competitive learning neural network models were effective in pattern classification and recognition of sampling information. Overall the performance of one-dimensional self-organizing map neural network was better than self-organizing competitive learning neural network. The number of neurons could determine the number of classes in the classification. Different neural network models with various distance (similarity) measures yielded similar classifications. Some differences, dependent upon the specific network structure, would be found. The pattern of an unrecognized functional group was recognized with the self-organizing neural network. A relative consistent classification indicated that the following invertebrate functional groups, terrestrial blood sucker; terrestrial flyer; tourist (nonpredatory species with no known functional role other than as prey in ecosystem); gall former; collector (gather, deposit feeder); predator and parasitoid; leaf miner; idiobiont (acarine ectoparasitoid), were classified into the same group, and the following invertebrate functional groups, external plant feeder; terrestrial crawler, walker, jumper or hunter; neustonic (water surface) swimmer (semi-aquatic), were classified into another group. It was concluded that reliable conclusions could be drawn from comparisons of different neural network models that use different distance

Optical computing and neural networks; Proceedings of the Meeting, National Chiao Tung Univ., Hsinchu, Taiwan, Dec. 16, 17, 1992

Science.gov (United States)

Hsu, Ken-Yuh (Editor); Liu, Hua-Kuang (Editor)

1992-01-01

The present conference discusses optical neural networks, photorefractive nonlinear optics, optical pattern recognition, digital and analog processors, and holography and its applications. Attention is given to bifurcating optical information processing, neural structures in digital halftoning, an exemplar-based optical neural net classifier for color pattern recognition, volume storage in photorefractive disks, and microlaser-based compact optical neuroprocessors. Also treated are the optical implementation of a feature-enhanced optical interpattern-associative neural network model and its optical implementation, an optical pattern binary dual-rail logic gate module, a theoretical analysis for holographic associative memories, joint transform correlators, image addition and subtraction via the Talbot effect, and optical wavelet-matched filters. (No individual items are abstracted in this volume)

Optical computing and neural networks; Proceedings of the Meeting, National Chiao Tung Univ., Hsinchu, Taiwan, Dec. 16, 17, 1992

Science.gov (United States)

Hsu, Ken-Yuh; Liu, Hua-Kuang

The present conference discusses optical neural networks, photorefractive nonlinear optics, optical pattern recognition, digital and analog processors, and holography and its applications. Attention is given to bifurcating optical information processing, neural structures in digital halftoning, an exemplar-based optical neural net classifier for color pattern recognition, volume storage in photorefractive disks, and microlaser-based compact optical neuroprocessors. Also treated are the optical implementation of a feature-enhanced optical interpattern-associative neural network model and its optical implementation, an optical pattern binary dual-rail logic gate module, a theoretical analysis for holographic associative memories, joint transform correlators, image addition and subtraction via the Talbot effect, and optical wavelet-matched filters. (No individual items are abstracted in this volume)

USE OF MIRROR PATTERN CUTTING OF NETTING MATERIALS FOR CONSTRUCTION OF LAKE BEACH SEINES

Directory of Open Access Journals (Sweden)

A. Nazarov

2014-12-01

Full Text Available Purpose. Justification and calculation of a new methodological approach to the construction of a standard beach seine (502 / 302 х 3.75 with the use of the properties of mirror netting ensuring the saving of the netting material, reduction of weight, price and drag resistance. Methodology. The carp age group selectivity of the constructed seine was assessed within fish fauna monitoring based on the catch analysis of monitoring gill nets with mesh sizes of 30-130 mm according to generally accepted methods [9, 10]. Calculation of netting materials and ropes was carried out according to generally accepted methods [12-14]. Seine resistance was calculated according to N. T. Senin formula for different netting materials and the angles of the movement of different seine parts in water [2]. The gear reliability and data processing were carried out according to standard methods [11, 14, 15]. Findings. A variant of the construction of the maximum lightweight beach lake seines made of mirror pattern netting taking into account the properties of the mirror pattern netting material, reduction of weight, price and drag resistance has been proposed. The provided recalculation of the properties of a serial seine made of rhombic mesh for the mirror netting seine taking into account netting properties allowed: 1 reducing the seine drag resistance value by 1,4 times; 2 reducing the weight of netting materials by 16.3% compared to the prototype; 3 increasing the seine selectivity when fishing older age groups of carp in non-drainable ponds. Originality. We presented the method of the calculation and construction of lake beach seines made of mirror netting, analyzed the technological stages of the construction of mirror netting, determined main qualitative and technological parameters, which had effect on the conditions of the construction and reliability of such fishing gears. A new method of the use of an insert of the combined netting material cutting ensuring

NeMO-Net & Fluid Lensing: The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment Using Fluid Lensing Augmentation of NASA EOS Data

Science.gov (United States)

Chirayath, Ved

2018-01-01

We present preliminary results from NASA NeMO-Net, the first neural multi-modal observation and training network for global coral reef assessment. NeMO-Net is an open-source deep convolutional neural network (CNN) and interactive active learning training software in development which will assess the present and past dynamics of coral reef ecosystems. NeMO-Net exploits active learning and data fusion of mm-scale remotely sensed 3D images of coral reefs captured using fluid lensing with the NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as hyperspectral airborne remote sensing data from the ongoing NASA CORAL mission and lower-resolution satellite data to determine coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. Aquatic ecosystems, particularly coral reefs, remain quantitatively misrepresented by low-resolution remote sensing as a result of refractive distortion from ocean waves, optical attenuation, and remoteness. Machine learning classification of coral reefs using FluidCam mm-scale 3D data show that present satellite and airborne remote sensing techniques poorly characterize coral reef percent living cover, morphology type, and species breakdown at the mm, cm, and meter scales. Indeed, current global assessments of coral reef cover and morphology classification based on km-scale satellite data alone can suffer from segmentation errors greater than 40%, capable of change detection only on yearly temporal scales and decameter spatial scales, significantly hindering our understanding of patterns and processes in marine biodiversity at a time when these ecosystems are experiencing unprecedented anthropogenic pressures, ocean acidification, and sea surface temperature rise. NeMO-Net leverages our augmented machine learning algorithm that demonstrates data fusion of regional FluidCam (mm, cm-scale) airborne remote sensing with

State-of-the-art of applications of neural networks in the nuclear industry

International Nuclear Information System (INIS)

Zwingelstein, G.; Masson, M.H.

1990-01-01

Artificial neural net models have been extensively studied for many years in various laboratories to try to simulate with computer programs the human brain performances. The first applications were developed in the fields of speech and image recognition. The aims of these studies were mainly to classify rapidly patterns corrupted by noises or partly missing. Neural networks with the development of new net topologies and algorithms and parallel computing hardwares and softwares are to-day very promising for applications in many industries. In the introduction, this paper presents the anticipated benefits of the uses of neural networks for industrial applications. Then a brief overview of the main neural networks is provided. Finally a short review of neural networks applications in the nuclear industry is given. It covers domains such as: predictive maintenance for vibratory surveillance of rotating machinery, signal processing, operator guidance and eddy current inspection. In conclusion recommendations are made to use with efficiency neural networks for practical applications. In particular the need for supercomputing will be pinpointed. (author)

NetTurnP – Neural Network Prediction of Beta-turns by Use of Evolutionary Information and Predicted Protein Sequence Features

DEFF Research Database (Denmark)

Petersen, Bent; Lundegaard, Claus; Petersen, Thomas Nordahl

2010-01-01

is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino......β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method...... NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which...

Classification of data patterns using an autoassociative neural network topology

Science.gov (United States)

Dietz, W. E.; Kiech, E. L.; Ali, M.

1989-01-01

A diagnostic expert system based on neural networks is developed and applied to the real-time diagnosis of jet and rocket engines. The expert system methodologies are based on the analysis of patterns of behavior of physical mechanisms. In this approach, fault diagnosis is conceptualized as the mapping or association of patterns of sensor data to patterns representing fault conditions. The approach addresses deficiencies inherent in many feedforward neural network models and greatly reduces the number of networks necessary to identify the existence of a fault condition and estimate the duration and severity of the identified fault. The network topology used in the present implementation of the diagnostic system is described, as well as the training regimen used and the response of the system to inputs representing both previously observed and unknown fault scenarios. Noise effects on the integrity of the diagnosis are also evaluated.

Neural nets with varying topology for high energy particle recognition. Theory and applications

International Nuclear Information System (INIS)

Perrone, A.L.; Basti, G.; Messi, R.; Paoluzi, L.; Picozza, P.

1995-01-01

In this paper we propose a strategy to solve the problem of parallel compuation based on a dynamic definition of the net topology showing its effectiveness for problems of particle track recognition in high-energy physics. In this way, we can maintain the linear architecture like in the geometric perceptron, but with a partial and dynamic connectivity so to overcome the intrinsic limiations of the geometric perceptron. Namely, the computation is truly parallel because of the partial connectivity but the net topology is always the optimal one because of its dynamic redefinition on the single input pattern. For these properties, we call this new architecture dynamic perceptron

Application of a neural network for reflectance spectrum classification

Science.gov (United States)

Yang, Gefei; Gartley, Michael

2017-05-01

Traditional reflectance spectrum classification algorithms are based on comparing spectrum across the electromagnetic spectrum anywhere from the ultra-violet to the thermal infrared regions. These methods analyze reflectance on a pixel by pixel basis. Inspired by high performance that Convolution Neural Networks (CNN) have demonstrated in image classification, we applied a neural network to analyze directional reflectance pattern images. By using the bidirectional reflectance distribution function (BRDF) data, we can reformulate the 4-dimensional into 2 dimensions, namely incident direction × reflected direction × channels. Meanwhile, RIT's micro-DIRSIG model is utilized to simulate additional training samples for improving the robustness of the neural networks training. Unlike traditional classification by using hand-designed feature extraction with a trainable classifier, neural networks create several layers to learn a feature hierarchy from pixels to classifier and all layers are trained jointly. Hence, the our approach of utilizing the angular features are different to traditional methods utilizing spatial features. Although training processing typically has a large computational cost, simple classifiers work well when subsequently using neural network generated features. Currently, most popular neural networks such as VGG, GoogLeNet and AlexNet are trained based on RGB spatial image data. Our approach aims to build a directional reflectance spectrum based neural network to help us to understand from another perspective. At the end of this paper, we compare the difference among several classifiers and analyze the trade-off among neural networks parameters.

Encoding sensory and motor patterns as time-invariant trajectories in recurrent neural networks.

Science.gov (United States)

Goudar, Vishwa; Buonomano, Dean V

2018-03-14

Much of the information the brain processes and stores is temporal in nature-a spoken word or a handwritten signature, for example, is defined by how it unfolds in time. However, it remains unclear how neural circuits encode complex time-varying patterns. We show that by tuning the weights of a recurrent neural network (RNN), it can recognize and then transcribe spoken digits. The model elucidates how neural dynamics in cortical networks may resolve three fundamental challenges: first, encode multiple time-varying sensory and motor patterns as stable neural trajectories; second, generalize across relevant spatial features; third, identify the same stimuli played at different speeds-we show that this temporal invariance emerges because the recurrent dynamics generate neural trajectories with appropriately modulated angular velocities. Together our results generate testable predictions as to how recurrent networks may use different mechanisms to generalize across the relevant spatial and temporal features of complex time-varying stimuli. © 2018, Goudar et al.

Photopolymerized materials and patterning for improved performance of neural prosthetics

Science.gov (United States)

Tuft, Bradley William

correlates with the maximum feature slope. Neurite alignment is compared on unpatterned, unidirectional, and multidirectional photopolymerized micropatterns. The effect of substrate rigidity on neurite alignment to physical cues was determined by maintaining equivalent pattern microfeatures, afforded by the reaction control of photopolymerization, while concomitantly altering the composition of several copolymer platforms to tune matrix stiffness. For each platform, neurite alignment to unidirectional patterns increases with increasing substrate rigidity. Interestingly, SGN neurites respond to material stiffness cues that are orders of magnitude higher (GPa) than what is typically ascribed to neural environments (kPa). Finally, neurite behavior at bioactive borders of various adhesion modulating molecules was evaluated on micropatterned materials to determine which cues took precedence in establishing neurite directionality. At low microfeatures aspect ratios, neurites align to the pattern direction but are then caused to turn and repel from or turn and align to bioactive borders. Conversely, physical cues dominate neurite path-finding as pattern feature slope increases, i.e. aspect ratio of sloping photopolymerized features increases, causing neurites to readily cross bioactive borders. The photopolymerization method developed in this work to generate micro and nanopatterned materials serves as an additional surface engineering tool that enables investigation of cell-material interactions including directed de novo neurite growth. The results of this interdisciplinary effort contribute substantially to polymer neural regeneration technology and will lead to development of advanced biomaterials that improve neural prosthetic tissue integration and performance by spatially directing nerve growth.

Neural Sequence Generation Using Spatiotemporal Patterns of Inhibition.

Directory of Open Access Journals (Sweden)

Jonathan Cannon

2015-11-01

Full Text Available Stereotyped sequences of neural activity are thought to underlie reproducible behaviors and cognitive processes ranging from memory recall to arm movement. One of the most prominent theoretical models of neural sequence generation is the synfire chain, in which pulses of synchronized spiking activity propagate robustly along a chain of cells connected by highly redundant feedforward excitation. But recent experimental observations in the avian song production pathway during song generation have shown excitatory activity interacting strongly with the firing patterns of inhibitory neurons, suggesting a process of sequence generation more complex than feedforward excitation. Here we propose a model of sequence generation inspired by these observations in which a pulse travels along a spatially recurrent excitatory chain, passing repeatedly through zones of local feedback inhibition. In this model, synchrony and robust timing are maintained not through redundant excitatory connections, but rather through the interaction between the pulse and the spatiotemporal pattern of inhibition that it creates as it circulates the network. These results suggest that spatially and temporally structured inhibition may play a key role in sequence generation.

Neural Sequence Generation Using Spatiotemporal Patterns of Inhibition.

Science.gov (United States)

Cannon, Jonathan; Kopell, Nancy; Gardner, Timothy; Markowitz, Jeffrey

2015-11-01

Stereotyped sequences of neural activity are thought to underlie reproducible behaviors and cognitive processes ranging from memory recall to arm movement. One of the most prominent theoretical models of neural sequence generation is the synfire chain, in which pulses of synchronized spiking activity propagate robustly along a chain of cells connected by highly redundant feedforward excitation. But recent experimental observations in the avian song production pathway during song generation have shown excitatory activity interacting strongly with the firing patterns of inhibitory neurons, suggesting a process of sequence generation more complex than feedforward excitation. Here we propose a model of sequence generation inspired by these observations in which a pulse travels along a spatially recurrent excitatory chain, passing repeatedly through zones of local feedback inhibition. In this model, synchrony and robust timing are maintained not through redundant excitatory connections, but rather through the interaction between the pulse and the spatiotemporal pattern of inhibition that it creates as it circulates the network. These results suggest that spatially and temporally structured inhibition may play a key role in sequence generation.

Automatic target recognition using a feature-based optical neural network

Science.gov (United States)

Chao, Tien-Hsin

1992-01-01

An optical neural network based upon the Neocognitron paradigm (K. Fukushima et al. 1983) is introduced. A novel aspect of the architectural design is shift-invariant multichannel Fourier optical correlation within each processing layer. Multilayer processing is achieved by iteratively feeding back the output of the feature correlator to the input spatial light modulator and updating the Fourier filters. By training the neural net with characteristic features extracted from the target images, successful pattern recognition with intra-class fault tolerance and inter-class discrimination is achieved. A detailed system description is provided. Experimental demonstration of a two-layer neural network for space objects discrimination is also presented.

Theories of Person Perception Predict Patterns of Neural Activity During Mentalizing.

Science.gov (United States)

Thornton, Mark A; Mitchell, Jason P

2017-08-22

Social life requires making inferences about other people. What information do perceivers spontaneously draw upon to make such inferences? Here, we test 4 major theories of person perception, and 1 synthetic theory that combines their features, to determine whether the dimensions of such theories can serve as bases for describing patterns of neural activity during mentalizing. While undergoing functional magnetic resonance imaging, participants made social judgments about well-known public figures. Patterns of brain activity were then predicted using feature encoding models that represented target people's positions on theoretical dimensions such as warmth and competence. All 5 theories of person perception proved highly accurate at reconstructing activity patterns, indicating that each could describe the informational basis of mentalizing. Cross-validation indicated that the theories robustly generalized across both targets and participants. The synthetic theory consistently attained the best performance-approximately two-thirds of noise ceiling accuracy--indicating that, in combination, the theories considered here can account for much of the neural representation of other people. Moreover, encoding models trained on the present data could reconstruct patterns of activity associated with mental state representations in independent data, suggesting the use of a common neural code to represent others' traits and states. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Feature to prototype transition in neural networks

Science.gov (United States)

Krotov, Dmitry; Hopfield, John

Models of associative memory with higher order (higher than quadratic) interactions, and their relationship to neural networks used in deep learning are discussed. Associative memory is conventionally described by recurrent neural networks with dynamical convergence to stable points. Deep learning typically uses feedforward neural nets without dynamics. However, a simple duality relates these two different views when applied to problems of pattern classification. From the perspective of associative memory such models deserve attention because they make it possible to store a much larger number of memories, compared to the quadratic case. In the dual description, these models correspond to feedforward neural networks with one hidden layer and unusual activation functions transmitting the activities of the visible neurons to the hidden layer. These activation functions are rectified polynomials of a higher degree rather than the rectified linear functions used in deep learning. The network learns representations of the data in terms of features for rectified linear functions, but as the power in the activation function is increased there is a gradual shift to a prototype-based representation, the two extreme regimes of pattern recognition known in cognitive psychology. Simons Center for Systems Biology.

Wnt/Yes-Associated Protein Interactions During Neural Tissue Patterning of Human Induced Pluripotent Stem Cells.

Science.gov (United States)

Bejoy, Julie; Song, Liqing; Zhou, Yi; Li, Yan

2018-04-01

Human induced pluripotent stem cells (hiPSCs) have special ability to self-assemble into neural spheroids or mini-brain-like structures. During the self-assembly process, Wnt signaling plays an important role in regional patterning and establishing positional identity of hiPSC-derived neural progenitors. Recently, the role of Wnt signaling in regulating Yes-associated protein (YAP) expression (nuclear or cytoplasmic), the pivotal regulator during organ growth and tissue generation, has attracted increasing interests. However, the interactions between Wnt and YAP expression for neural lineage commitment of hiPSCs remain poorly explored. The objective of this study is to investigate the effects of Wnt signaling and YAP expression on the cellular population in three-dimensional (3D) neural spheroids derived from hiPSCs. In this study, Wnt signaling was activated using CHIR99021 for 3D neural spheroids derived from human iPSK3 cells through embryoid body formation. Our results indicate that Wnt activation induces nuclear localization of YAP and upregulates the expression of HOXB4, the marker for hindbrain/spinal cord. By contrast, the cells exhibit more rostral forebrain neural identity (expression of TBR1) without Wnt activation. Cytochalasin D was then used to induce cytoplasmic YAP and the results showed the decreased HOXB4 expression. In addition, the incorporation of microparticles in the neural spheroids was investigated for the perturbation of neural patterning. This study may indicate the bidirectional interactions of Wnt signaling and YAP expression during neural tissue patterning, which have the significance in neurological disease modeling, drug screening, and neural tissue regeneration.

Designing a Pattern Recognition Neural Network with a Reject Output and Many Sets of Weights and Biases

OpenAIRE

Dung, Le; Mizukawa, Makoto

2008-01-01

Adding the reject output to the pattern recognition neural network is an approach to help the neural network can classify almost all patterns of a training data set by using many sets of weights and biases, even if the neural network is small. With a smaller number of neurons, we can implement the neural network on a hardware-based platform more easily and also reduce the response time of it. With the reject output the neural network can produce not only right or wrong results but also reject...

Application of artificial neural networks in particle physics

International Nuclear Information System (INIS)

Kolanoski, H.

1995-04-01

The application of Artificial Neural Networks in Particle Physics is reviewed. Most common is the use of feed-forward nets for event classification and function approximation. This network type is best suited for a hardware implementation and special VLSI chips are available which are used in fast trigger processors. Also discussed are fully connected networks of the Hopfield type for pattern recognition in tracking detectors. (orig.)

Detecting tactical patterns in basketball: comparison of merge self-organising maps and dynamic controlled neural networks.

Science.gov (United States)

Kempe, Matthias; Grunz, Andreas; Memmert, Daniel

2015-01-01

The soaring amount of data, especially spatial-temporal data, recorded in recent years demands for advanced analysis methods. Neural networks derived from self-organizing maps established themselves as a useful tool to analyse static and temporal data. In this study, we applied the merge self-organising map (MSOM) to spatio-temporal data. To do so, we investigated the ability of MSOM's to analyse spatio-temporal data and compared its performance to the common dynamical controlled network (DyCoN) approach to analyse team sport position data. The position data of 10 players were recorded via the Ubisense tracking system during a basketball game. Furthermore, three different pre-selected plays were recorded for classification. Following data preparation, the different nets were trained with the data of the first half. The training success of both networks was evaluated by achieved entropy. The second half of the basketball game was presented to both nets for automatic classification. Both approaches were able to present the trained data extremely well and to detect the pre-selected plays correctly. In conclusion, MSOMs are a useful tool to analyse spatial-temporal data, especially in team sports. By their direct inclusion of different time length of tactical patterns, they open up new opportunities within team sports.

NetTurnP--neural network prediction of beta-turns by use of evolutionary information and predicted protein sequence features.

Directory of Open Access Journals (Sweden)

Bent Petersen

Full Text Available UNLABELLED: β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino acid sequence. The individual β-turn types I, I', II, II', VIII, VIa1, VIa2, VIba and IV have been predicted based on classifications by PROMOTIF, and the two-class prediction of β-turn or not is a superset comprised of all β-turn types. The performance is evaluated using a golden set of non-homologous sequences known as BT426. Our two-class prediction method achieves a performance of: MCC=0.50, Qtotal=82.1%, sensitivity=75.6%, PPV=68.8% and AUC=0.864. We have compared our performance to eleven other prediction methods that obtain Matthews correlation coefficients in the range of 0.17-0.47. For the type specific β-turn predictions, only type I and II can be predicted with reasonable Matthews correlation coefficients, where we obtain performance values of 0.36 and 0.31, respectively. CONCLUSION: The NetTurnP method has been implemented as a webserver, which is freely available at http://www.cbs.dtu.dk/services/NetTurnP/. NetTurnP is the only available webserver that allows submission of multiple sequences.

NetTurnP--neural network prediction of beta-turns by use of evolutionary information and predicted protein sequence features.

Science.gov (United States)

Petersen, Bent; Lundegaard, Claus; Petersen, Thomas Nordahl

2010-11-30

β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino acid sequence. The individual β-turn types I, I', II, II', VIII, VIa1, VIa2, VIba and IV have been predicted based on classifications by PROMOTIF, and the two-class prediction of β-turn or not is a superset comprised of all β-turn types. The performance is evaluated using a golden set of non-homologous sequences known as BT426. Our two-class prediction method achieves a performance of: MCC=0.50, Qtotal=82.1%, sensitivity=75.6%, PPV=68.8% and AUC=0.864. We have compared our performance to eleven other prediction methods that obtain Matthews correlation coefficients in the range of 0.17-0.47. For the type specific β-turn predictions, only type I and II can be predicted with reasonable Matthews correlation coefficients, where we obtain performance values of 0.36 and 0.31, respectively. The NetTurnP method has been implemented as a webserver, which is freely available at http://www.cbs.dtu.dk/services/NetTurnP/. NetTurnP is the only available webserver that allows submission of multiple sequences.

Rotation-invariant neural pattern recognition system with application to coin recognition.

Science.gov (United States)

Fukumi, M; Omatu, S; Takeda, F; Kosaka, T

1992-01-01

In pattern recognition, it is often necessary to deal with problems to classify a transformed pattern. A neural pattern recognition system which is insensitive to rotation of input pattern by various degrees is proposed. The system consists of a fixed invariance network with many slabs and a trainable multilayered network. The system was used in a rotation-invariant coin recognition problem to distinguish between a 500 yen coin and a 500 won coin. The results show that the approach works well for variable rotation pattern recognition.

Organization of Anti-Phase Synchronization Pattern in Neural Networks: What are the Key Factors?

Science.gov (United States)

Li, Dong; Zhou, Changsong

2011-01-01

Anti-phase oscillation has been widely observed in cortical neural network. Elucidating the mechanism underlying the organization of anti-phase pattern is of significance for better understanding more complicated pattern formations in brain networks. In dynamical systems theory, the organization of anti-phase oscillation pattern has usually been considered to relate to time delay in coupling. This is consistent to conduction delays in real neural networks in the brain due to finite propagation velocity of action potentials. However, other structural factors in cortical neural network, such as modular organization (connection density) and the coupling types (excitatory or inhibitory), could also play an important role. In this work, we investigate the anti-phase oscillation pattern organized on a two-module network of either neuronal cell model or neural mass model, and analyze the impact of the conduction delay times, the connection densities, and coupling types. Our results show that delay times and coupling types can play key roles in this organization. The connection densities may have an influence on the stability if an anti-phase pattern exists due to the other factors. Furthermore, we show that anti-phase synchronization of slow oscillations can be achieved with small delay times if there is interaction between slow and fast oscillations. These results are significant for further understanding more realistic spatiotemporal dynamics of cortico-cortical communications. PMID:22232576

Cross-Coupled Eye Movement Supports Neural Origin of Pattern Strabismus

Science.gov (United States)

Ghasia, Fatema F.; Shaikh, Aasef G.; Jacobs, Jonathan; Walker, Mark F.

2015-01-01

Purpose. Pattern strabismus describes vertically incomitant horizontal strabismus. Conventional theories emphasized the role of orbital etiologies, such as abnormal fundus torsion and misaligned orbital pulleys as a cause of the pattern strabismus. Experiments in animal models, however, suggested the role of abnormal cross-connections between the neural circuits. We quantitatively assessed eye movements in patients with pattern strabismus with a goal to delineate the role of neural circuits versus orbital etiologies. Methods. We measured saccadic eye movements with high-precision video-oculography in 14 subjects with pattern strabismus, 5 with comitant strabismus, and 15 healthy controls. We assessed change in eye position in the direction orthogonal to that of the desired eye movement (cross-coupled responses). We used fundus photography to quantify the fundus torsion. Results. We found cross-coupling of saccades in all patients with pattern strabismus. The cross-coupled responses were in the same direction in both eyes, but larger in the nonviewing eye. All patients had clinically apparent inferior oblique overaction with abnormal excylotorsion. There was no correlation between the amount of the fundus torsion or the grade of oblique overaction and the severity of cross-coupling. The disconjugacy in the saccade direction and amplitude in pattern strabismics did not have characteristics predicted by clinically apparent inferior oblique overaction. Conclusions. Our results validated primate models of pattern strabismus in human patients. We found no correlation between ocular torsion or oblique overaction and cross-coupling. Therefore, we could not ascribe cross-coupling exclusively to the orbital etiology. Patients with pattern strabismus could have abnormalities in the saccade generators. PMID:26024072

Estimação do volume de árvores utilizando redes neurais artificiais Estimate of tree volume using artificial neural nets

Directory of Open Access Journals (Sweden)

Eric Bastos Gorgens

2009-12-01

Full Text Available Rede neural artificial consiste em um conjunto de unidades que contêm funções matemáticas, unidas por pesos. As redes são capazes de aprender, mediante modificação dos pesos sinápticos, e generalizar o aprendizado para outros arquivos desconhecidos. O projeto de redes neurais é composto por três etapas: pré-processamento, processamento e, por fim, pós-processamento dos dados. Um dos problemas clássicos que podem ser abordados por redes é a aproximação de funções. Nesse grupo, pode-se incluir a estimação do volume de árvores. Foram utilizados quatro arquiteturas diferentes, cinco pré-processamentos e duas funções de ativação. As redes que se apresentaram estatisticamente iguais aos dados observados também foram analisadas quanto ao resíduo e à distribuição dos volumes e comparadas com a estimação de volume pelo modelo de Schumacher e Hall. As redes neurais formadas por neurônios, cuja função de ativação era exponencial, apresentaram estimativas estatisticamente iguais aos dados observados. As redes treinadas com os dados normalizados pelo método da interpolação linear e equalizados tiveram melhor desempenho na estimação.The artificial neural network consists of a set of units containing mathematical functions connected by weights. Such nets are capable of learning by means of synaptic weight modification, generalizing learning for other unknown archives. The neural network project comprises three stages: pre-processing, processing and post-processing of data. One of the classical problems approached by networks is function approximation. Tree volume estimate can be included in this group. Four different architectures, five pre-processings and two activation functions were used. The nets which were statistically similar to the observed data were also analyzed in relation to residue and volume and compared to the volume estimate provided by the Schumacher and Hall equation. The neural nets formed by

Neural network signal understanding for instrumentation

DEFF Research Database (Denmark)

Pau, L. F.; Johansen, F. S.

1990-01-01

understanding research is surveyed, and the selected implementation and its performance in terms of correct classification rates and robustness to noise are described. Formal results on neural net training time and sensitivity to weights are given. A theory for neural control using functional link nets is given...

An exploratory study of treated-bed nets in Timor-Leste: patterns of intended and alternative usage

Directory of Open Access Journals (Sweden)

Wilder-Smith Annelies

2011-07-01

Full Text Available Abstract Background The Timor-Leste Ministry of Health has recently finalized the National Malaria Control Strategy for 2010-2020. A key component of this roadmap is to provide universal national coverage with long-lasting insecticide-treated nets (LLINs in support of achieving the primary goal of reducing both morbidity and mortality from malaria by 30% in the first three years, followed by a further reduction of 20% by end of the programme cycle in 2020 1. The strategic plan calls for this target to be supported by a comprehensive information, education and communication (IEC programme; however, there is limited prior research into household and personal usage patterns to assist in the creation of targeted, effective, and socio-culturally specific behaviour change materials. Methods Nine separate focus group discussions (FGDs were carried out in Dili, Manatuto, and Covalima districts, Democratic Republic of Timor-Leste, in July 2010. These focus groups primarily explored themes of perceived malaria risk, causes of malaria, net usage patterns within families, barriers to correct and consistent usage, and the daily experience of users (both male and female in households with at least one net. Comprehensive qualitative analysis utilized open source analysis software. Results The primary determinants of net usage were a widespread perception that nets could or should only be used by pregnant women and young children, and the availability of sufficient sleeping space under a limited number of nets within households. Both nuisance biting and disease prevention were commonly cited as primary motivations for usage, while seasonality was not a significant factor. Long-term net durability and ease of hanging were seen as key attributes in net design preference. Very frequent washing cycles were common, potentially degrading net effectiveness. Finally, extensive re-purposing of nets (fishing, protecting crops was both reported and observed, and may

Probing neural cell behaviors through micro-/nano-patterned chitosan substrates

International Nuclear Information System (INIS)

Sung, Chun-Yen; Yang, Chung-Yao; Yeh, J Andrew; Chen, Wen-Shiang; Wang, Yang-Kao; Cheng, Chao-Min

2015-01-01

In this study, we describe the development of surface-modified chitosan substrates to examine topographically related Neuro-2a cell behaviors. Different functional groups can be modified on chitosan surfaces to probe Neuro-2a cell morphology. To prepare chitosan substrates with micro/nano-scaled features, we demonstrated an easy-to-handle method that combined photolithography, inductively coupled plasma reactive ion etching, Ag nanoparticle-assisted etching, and solution casting. The results show that Neuro-2a cells preferred to adhere to a flat chitosan surface rather than a nanotextured chitosan surface as evidenced by greater immobilization and differentiation, suggesting that surface topography is crucial for neural patterning. In addition, we developed chitosan substrates with different geometric patterns and flat region depth; this allowed us to re-arrange or re-pattern Neuro-2a cell colonies at desired locations. We found that a polarity-induced micropattern provided the most suitable surface pattern for promoting neural network formation on a chitosan substrate. The cellular polarity of single Neuro-2a cell spreading correlated to a diamond-like geometry and neurite outgrowth was induced from the corners toward the grooves of the structures. This study provide greater insight into neurobiology, including neurotransmitter screening, electrophysiological stimulation platforms, and biomedical engineering. (paper)

Similar patterns of neural activity predict memory function during encoding and retrieval.

Science.gov (United States)

Kragel, James E; Ezzyat, Youssef; Sperling, Michael R; Gorniak, Richard; Worrell, Gregory A; Berry, Brent M; Inman, Cory; Lin, Jui-Jui; Davis, Kathryn A; Das, Sandhitsu R; Stein, Joel M; Jobst, Barbara C; Zaghloul, Kareem A; Sheth, Sameer A; Rizzuto, Daniel S; Kahana, Michael J

2017-07-15

Neural networks that span the medial temporal lobe (MTL), prefrontal cortex, and posterior cortical regions are essential to episodic memory function in humans. Encoding and retrieval are supported by the engagement of both distinct neural pathways across the cortex and common structures within the medial temporal lobes. However, the degree to which memory performance can be determined by neural processing that is common to encoding and retrieval remains to be determined. To identify neural signatures of successful memory function, we administered a delayed free-recall task to 187 neurosurgical patients implanted with subdural or intraparenchymal depth electrodes. We developed multivariate classifiers to identify patterns of spectral power across the brain that independently predicted successful episodic encoding and retrieval. During encoding and retrieval, patterns of increased high frequency activity in prefrontal, MTL, and inferior parietal cortices, accompanied by widespread decreases in low frequency power across the brain predicted successful memory function. Using a cross-decoding approach, we demonstrate the ability to predict memory function across distinct phases of the free-recall task. Furthermore, we demonstrate that classifiers that combine information from both encoding and retrieval states can outperform task-independent models. These findings suggest that the engagement of a core memory network during either encoding or retrieval shapes the ability to remember the past, despite distinct neural interactions that facilitate encoding and retrieval. Copyright © 2017 Elsevier Inc. All rights reserved.

Methods for discriminating gas-liquid two phase flow patterns based on gray neural networks and SVM

International Nuclear Information System (INIS)

Li Jingjing; Zhou Tao; Duan Jun; Zhang Lei

2013-01-01

Background: The flow patterns of two phase flow will directly influence the heat transfer and mass transfer of the flow. Purpose: By wavelet analysis of the pressure drop experimental data, the wavelet coefficients of different frequency can be obtained. Methods: Get the wavelet energy and then train them in the model of BP neural network to distinguish the flow patterns. Introduced the implant gray neural networks model and use it for the two phase flow for the first time. At the same time, set up the method of training the pressure data and wavelet energy data in the support vector machine. Results: Through treatment of the gray layer, the result of the neural network is more accuracy. It can obviously reduce the effect of data marginalization. The accuracy of the pressure drop Lib-SVM method is 95.2%. Conclusions: The results show that these three methods can make a distinction among the different flow patterns and the Lib-SVM method gets the best result, then the gray neural networks, and at last the BP neural networks. (authors)

Firing patterns transition and desynchronization induced by time delay in neural networks

Science.gov (United States)

Huang, Shoufang; Zhang, Jiqian; Wang, Maosheng; Hu, Chin-Kun

2018-06-01

We used the Hindmarsh-Rose (HR) model (Hindmarsh and Rose, 1984) to study the effect of time delay on the transition of firing behaviors and desynchronization in neural networks. As time delay is increased, neural networks exhibit diversity of firing behaviors, including regular spiking or bursting and firing patterns transitions (FPTs). Meanwhile, the desynchronization of firing and unstable bursting with decreasing amplitude in neural system, are also increasingly enhanced with the increase of time delay. Furthermore, we also studied the effect of coupling strength and network randomness on these phenomena. Our results imply that time delays can induce transition and desynchronization of firing behaviors in neural networks. These findings provide new insight into the role of time delay in the firing activities of neural networks, and can help to better understand the firing phenomena in complex systems of neural networks. A possible mechanism in brain that can cause the increase of time delay is discussed.

Neural Pattern Similarity in the Left IFG and Fusiform Is Associated with Novel Word Learning

Directory of Open Access Journals (Sweden)

Jing Qu

2017-08-01

Full Text Available Previous studies have revealed that greater neural pattern similarity across repetitions is associated with better subsequent memory. In this study, we used an artificial language training paradigm and representational similarity analysis to examine whether neural pattern similarity across repetitions before training was associated with post-training behavioral performance. Twenty-four native Chinese speakers were trained to learn a logographic artificial language for 12 days and behavioral performance was recorded using the word naming and picture naming tasks. Participants were scanned while performing a passive viewing task before training, after 4-day training and after 12-day training. Results showed that pattern similarity in the left pars opercularis (PO and fusiform gyrus (FG before training was negatively associated with reaction time (RT in both word naming and picture naming tasks after training. These results suggest that neural pattern similarity is an effective neurofunctional predictor of novel word learning in addition to word memory.

Neural Pattern Similarity in the Left IFG and Fusiform Is Associated with Novel Word Learning

Science.gov (United States)

Qu, Jing; Qian, Liu; Chen, Chuansheng; Xue, Gui; Li, Huiling; Xie, Peng; Mei, Leilei

2017-01-01

Previous studies have revealed that greater neural pattern similarity across repetitions is associated with better subsequent memory. In this study, we used an artificial language training paradigm and representational similarity analysis to examine whether neural pattern similarity across repetitions before training was associated with post-training behavioral performance. Twenty-four native Chinese speakers were trained to learn a logographic artificial language for 12 days and behavioral performance was recorded using the word naming and picture naming tasks. Participants were scanned while performing a passive viewing task before training, after 4-day training and after 12-day training. Results showed that pattern similarity in the left pars opercularis (PO) and fusiform gyrus (FG) before training was negatively associated with reaction time (RT) in both word naming and picture naming tasks after training. These results suggest that neural pattern similarity is an effective neurofunctional predictor of novel word learning in addition to word memory. PMID:28878640

Optical implementation of a feature-based neural network with application to automatic target recognition

Science.gov (United States)

Chao, Tien-Hsin; Stoner, William W.

1993-01-01

An optical neural network based on the neocognitron paradigm is introduced. A novel aspect of the architecture design is shift-invariant multichannel Fourier optical correlation within each processing layer. Multilayer processing is achieved by feeding back the ouput of the feature correlator interatively to the input spatial light modulator and by updating the Fourier filters. By training the neural net with characteristic features extracted from the target images, successful pattern recognition with intraclass fault tolerance and interclass discrimination is achieved. A detailed system description is provided. Experimental demonstrations of a two-layer neural network for space-object discrimination is also presented.

What Neural Substrates Trigger the Adept Scientific Pattern Discovery by Biologists?

Science.gov (United States)

Lee, Jun-Ki; Kwon, Yong-Ju

2011-04-01

This study investigated the neural correlates of experts and novices during biological object pattern detection using an fMRI approach in order to reveal the neural correlates of a biologist's superior pattern discovery ability. Sixteen healthy male participants (8 biologists and 8 non-biologists) volunteered for the study. Participants were shown fifteen series of organism pictures and asked to detect patterns amid stimulus pictures. Primary findings showed significant activations in the right middle temporal gyrus and inferior parietal lobule amongst participants in the biologist (expert) group. Interestingly, the left superior temporal gyrus was activated in participants from the non-biologist (novice) group. These results suggested that superior pattern discovery ability could be related to a functional facilitation of the parieto-temporal network, which is particularly driven by the right middle temporal gyrus and inferior parietal lobule in addition to the recruitment of additional brain regions. Furthermore, the functional facilitation of the network might actually pertain to high coherent processing skills and visual working memory capacity. Hence, study results suggested that adept scientific thinking ability can be detected by neuronal substrates, which may be used as criteria for developing and evaluating a brain-based science curriculum and test instrument.

Acute stress evokes sexually dimorphic, stressor-specific patterns of neural activation across multiple limbic brain regions in adult rats.

Science.gov (United States)

Sood, Ankit; Chaudhari, Karina; Vaidya, Vidita A

2018-03-01

Stress enhances the risk for psychiatric disorders such as anxiety and depression. Stress responses vary across sex and may underlie the heightened vulnerability to psychopathology in females. Here, we examined the influence of acute immobilization stress (AIS) and a two-day short-term forced swim stress (FS) on neural activation in multiple cortical and subcortical brain regions, implicated as targets of stress and in the regulation of neuroendocrine stress responses, in male and female rats using Fos as a neural activity marker. AIS evoked a sex-dependent pattern of neural activation within the cingulate and infralimbic subdivisions of the medial prefrontal cortex (mPFC), lateral septum (LS), habenula, and hippocampal subfields. The degree of neural activation in the mPFC, LS, and habenula was higher in males. Female rats exhibited reduced Fos positive cell numbers in the dentate gyrus hippocampal subfield, an effect not observed in males. We addressed whether the sexually dimorphic neural activation pattern noted following AIS was also observed with the short-term stress of FS. In the paraventricular nucleus of the hypothalamus and the amygdala, FS similar to AIS resulted in robust increases in neural activation in both sexes. The pattern of neural activation evoked by FS was distinct across sexes, with a heightened neural activation noted in the prelimbic mPFC subdivision and hippocampal subfields in females and differed from the pattern noted with AIS. This indicates that the sex differences in neural activation patterns observed within stress-responsive brain regions are dependent on the nature of stressor experience.

Musical Audio Synthesis Using Autoencoding Neural Nets

OpenAIRE

Sarroff, Andy; Casey, Michael A.

2014-01-01

With an optimal network topology and tuning of hyperpa-\\ud rameters, artificial neural networks (ANNs) may be trained\\ud to learn a mapping from low level audio features to one\\ud or more higher-level representations. Such artificial neu-\\ud ral networks are commonly used in classification and re-\\ud gression settings to perform arbitrary tasks. In this work\\ud we suggest repurposing autoencoding neural networks as\\ud musical audio synthesizers. We offer an interactive musi-\\ud cal audio synt...

A deep convolutional neural network to analyze position averaged convergent beam electron diffraction patterns.

Science.gov (United States)

Xu, W; LeBeau, J M

2018-05-01

We establish a series of deep convolutional neural networks to automatically analyze position averaged convergent beam electron diffraction patterns. The networks first calibrate the zero-order disk size, center position, and rotation without the need for pretreating the data. With the aligned data, additional networks then measure the sample thickness and tilt. The performance of the network is explored as a function of a variety of variables including thickness, tilt, and dose. A methodology to explore the response of the neural network to various pattern features is also presented. Processing patterns at a rate of  ∼ 0.1 s/pattern, the network is shown to be orders of magnitude faster than a brute force method while maintaining accuracy. The approach is thus suitable for automatically processing big, 4D STEM data. We also discuss the generality of the method to other materials/orientations as well as a hybrid approach that combines the features of the neural network with least squares fitting for even more robust analysis. The source code is available at https://github.com/subangstrom/DeepDiffraction. Copyright © 2018 Elsevier B.V. All rights reserved.

COMMUNICATION Designing a somatosensory neural prosthesis: percepts evoked by different patterns of thalamic stimulation

Science.gov (United States)

Heming, Ethan; Sanden, Andrew; Kiss, Zelma H. T.

2010-12-01

Although major advances have been made in the development of motor prostheses, fine motor control requires intuitive somatosensory feedback. Here we explored whether a thalamic site for a somatosensory neural prosthetic could provide natural somatic sensation to humans. Different patterns of electrical stimulation (obtained from thalamic spike trains) were applied in patients undergoing deep brain stimulation surgery. Changes in pattern produced different sensations, while preserving somatotopic representation. While most percepts were reported as 'unnatural', some stimulations produced more 'natural' sensations than others. However, the additional patterns did not elicit more 'natural' percepts than high-frequency (333 Hz) electrical stimulation. These features suggest that despite some limitations, the thalamus may be a feasible site for a somatosensory neural prosthesis and different stimulation patterns may be useful in its development.

Topology and computational performance of attractor neural networks

International Nuclear Information System (INIS)

McGraw, Patrick N.; Menzinger, Michael

2003-01-01

To explore the relation between network structure and function, we studied the computational performance of Hopfield-type attractor neural nets with regular lattice, random, small-world, and scale-free topologies. The random configuration is the most efficient for storage and retrieval of patterns by the network as a whole. However, in the scale-free case retrieval errors are not distributed uniformly among the nodes. The portion of a pattern encoded by the subset of highly connected nodes is more robust and efficiently recognized than the rest of the pattern. The scale-free network thus achieves a very strong partial recognition. The implications of these findings for brain function and social dynamics are suggestive

Recognition of neural brain activity patterns correlated with complex motor activity

Science.gov (United States)

Kurkin, Semen; Musatov, Vyacheslav Yu.; Runnova, Anastasia E.; Grubov, Vadim V.; Efremova, Tatyana Yu.; Zhuravlev, Maxim O.

2018-04-01

In this paper, based on the apparatus of artificial neural networks, a technique for recognizing and classifying patterns corresponding to imaginary movements on electroencephalograms (EEGs) obtained from a group of untrained subjects was developed. The works on the selection of the optimal type, topology, training algorithms and neural network parameters were carried out from the point of view of the most accurate and fast recognition and classification of patterns on multi-channel EEGs associated with the imagination of movements. The influence of the number and choice of the analyzed channels of a multichannel EEG on the quality of recognition of imaginary movements was also studied, and optimal configurations of electrode arrangements were obtained. The effect of pre-processing of EEG signals is analyzed from the point of view of improving the accuracy of recognition of imaginary movements.

Multi-Connection Pattern Analysis: Decoding the representational content of neural communication.

Science.gov (United States)

Li, Yuanning; Richardson, Robert Mark; Ghuman, Avniel Singh

2017-11-15

The lack of multivariate methods for decoding the representational content of interregional neural communication has left it difficult to know what information is represented in distributed brain circuit interactions. Here we present Multi-Connection Pattern Analysis (MCPA), which works by learning mappings between the activity patterns of the populations as a factor of the information being processed. These maps are used to predict the activity from one neural population based on the activity from the other population. Successful MCPA-based decoding indicates the involvement of distributed computational processing and provides a framework for probing the representational structure of the interaction. Simulations demonstrate the efficacy of MCPA in realistic circumstances. In addition, we demonstrate that MCPA can be applied to different signal modalities to evaluate a variety of hypothesis associated with information coding in neural communications. We apply MCPA to fMRI and human intracranial electrophysiological data to provide a proof-of-concept of the utility of this method for decoding individual natural images and faces in functional connectivity data. We further use a MCPA-based representational similarity analysis to illustrate how MCPA may be used to test computational models of information transfer among regions of the visual processing stream. Thus, MCPA can be used to assess the information represented in the coupled activity of interacting neural circuits and probe the underlying principles of information transformation between regions. Copyright © 2017 Elsevier Inc. All rights reserved.

Antagonism between the transcription factors NANOG and OTX2 specifies rostral or caudal cell fate during neural patterning transition.

Science.gov (United States)

Su, Zhenghui; Zhang, Yanqi; Liao, Baojian; Zhong, Xiaofen; Chen, Xin; Wang, Haitao; Guo, Yiping; Shan, Yongli; Wang, Lihui; Pan, Guangjin

2018-03-23

During neurogenesis, neural patterning is a critical step during which neural progenitor cells differentiate into neurons with distinct functions. However, the molecular determinants that regulate neural patterning remain poorly understood. Here we optimized the "dual SMAD inhibition" method to specifically promote differentiation of human pluripotent stem cells (hPSCs) into forebrain and hindbrain neural progenitor cells along the rostral-caudal axis. We report that neural patterning determination occurs at the very early stage in this differentiation. Undifferentiated hPSCs expressed basal levels of the transcription factor orthodenticle homeobox 2 (OTX2) that dominantly drove hPSCs into the "default" rostral fate at the beginning of differentiation. Inhibition of glycogen synthase kinase 3β (GSK3β) through CHIR99021 application sustained transient expression of the transcription factor NANOG at early differentiation stages through Wnt signaling. Wnt signaling and NANOG antagonized OTX2 and, in the later stages of differentiation, switched the default rostral cell fate to the caudal one. Our findings have uncovered a mutual antagonism between NANOG and OTX2 underlying cell fate decisions during neural patterning, critical for the regulation of early neural development in humans. © 2018 by The American Society for Biochemistry and Molecular Biology, Inc.

ANT Advanced Neural Tool

Energy Technology Data Exchange (ETDEWEB)

Labrador, I.; Carrasco, R.; Martinez, L.

1996-07-01

This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs.

ANT Advanced Neural Tool

International Nuclear Information System (INIS)

Labrador, I.; Carrasco, R.; Martinez, L.

1996-01-01

This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs

Neural networks for aircraft control

Science.gov (United States)

Linse, Dennis

1990-01-01

Current research in Artificial Neural Networks indicates that networks offer some potential advantages in adaptation and fault tolerance. This research is directed at determining the possible applicability of neural networks to aircraft control. The first application will be to aircraft trim. Neural network node characteristics, network topology and operation, neural network learning and example histories using neighboring optimal control with a neural net are discussed.

Fast neural-net based fake track rejection in the LHCb reconstruction

CERN Document Server

De Cian, Michel; Seyfert, Paul; Stahl, Sascha

2017-01-01

A neural-network based algorithm to identify fake tracks in the LHCb pattern recognition is presented. This algorithm, called ghost probability, retains more than 99 % of well reconstructed tracks while reducing the number of fake tracks by 60 %. It is fast enough to fit into the CPU time budget of the software trigger farm and thus reduces the combinatorics of the decay reconstructions, as well as the number of tracks that need to be processed by the particle identification algorithms. As a result, it strongly contributes to the achievement of having the same reconstruction online and offline in the LHCb experiment in Run II of the LHC.

Neural patterning of human induced pluripotent stem cells in 3-D cultures for studying biomolecule-directed differential cellular responses.

Science.gov (United States)

Yan, Yuanwei; Bejoy, Julie; Xia, Junfei; Guan, Jingjiao; Zhou, Yi; Li, Yan

2016-09-15

Appropriate neural patterning of human induced pluripotent stem cells (hiPSCs) is critical to generate specific neural cells/tissues and even mini-brains that are physiologically relevant to model neurological diseases. However, the capacity of signaling factors that regulate 3-D neural tissue patterning in vitro and differential responses of the resulting neural populations to various biomolecules have not yet been fully understood. By tuning neural patterning of hiPSCs with small molecules targeting sonic hedgehog (SHH) signaling, this study generated different 3-D neuronal cultures that were mainly comprised of either cortical glutamatergic neurons or motor neurons. Abundant glutamatergic neurons were observed following the treatment with an antagonist of SHH signaling, cyclopamine, while Islet-1 and HB9-expressing motor neurons were enriched by an SHH agonist, purmorphamine. In neurons derived with different neural patterning factors, whole-cell patch clamp recordings showed similar voltage-gated Na(+)/K(+) currents, depolarization-evoked action potentials and spontaneous excitatory post-synaptic currents. Moreover, these different neuronal populations exhibited differential responses to three classes of biomolecules, including (1) matrix metalloproteinase inhibitors that affect extracellular matrix remodeling; (2) N-methyl-d-aspartate that induces general neurotoxicity; and (3) amyloid β (1-42) oligomers that cause neuronal subtype-specific neurotoxicity. This study should advance our understanding of hiPSC self-organization and neural tissue development and provide a transformative approach to establish 3-D models for neurological disease modeling and drug discovery. Appropriate neural patterning of human induced pluripotent stem cells (hiPSCs) is critical to generate specific neural cells, tissues and even mini-brains that are physiologically relevant to model neurological diseases. However, the capability of sonic hedgehog-related small molecules to tune

Study of the Gray Scale, Polychromatic, Distortion Invariant Neural Networks Using the Ipa Model.

Science.gov (United States)

Uang, Chii-Maw

Research in the optical neural network field is primarily motivated by the fact that humans recognize objects better than the conventional digital computers and the massively parallel inherent nature of optics. This research represents a continuous effort during the past several years in the exploitation of using neurocomputing for pattern recognition. Based on the interpattern association (IPA) model and Hamming net model, many new systems and applications are introduced. A gray level discrete associative memory that is based on object decomposition/composition is proposed for recognizing gray-level patterns. This technique extends the processing ability from the binary mode to gray-level mode, and thus the information capacity is increased. Two polychromatic optical neural networks using color liquid crystal television (LCTV) panels for color pattern recognition are introduced. By introducing a color encoding technique in conjunction with the interpattern associative algorithm, a color associative memory was realized. Based on the color decomposition and composition technique, a color exemplar-based Hamming net was built for color image classification. A shift-invariant neural network is presented through use of the translation invariant property of the modulus of the Fourier transformation and the hetero-associative interpattern association (IPA) memory. To extract the main features, a quadrantal sampling method is used to sampled data and then replace the training patterns. Using the concept of hetero-associative memory to recall the distorted object. A shift and rotation invariant neural network using an interpattern hetero-association (IHA) model is presented. To preserve the shift and rotation invariant properties, a set of binarized-encoded circular harmonic expansion (CHE) functions at the Fourier domain is used as the training set. We use the shift and symmetric properties of the modulus of the Fourier spectrum to avoid the problem of centering the CHE

Salient regions detection using convolutional neural networks and color volume

Science.gov (United States)

Liu, Guang-Hai; Hou, Yingkun

2018-03-01

Convolutional neural network is an important technique in machine learning, pattern recognition and image processing. In order to reduce the computational burden and extend the classical LeNet-5 model to the field of saliency detection, we propose a simple and novel computing model based on LeNet-5 network. In the proposed model, hue, saturation and intensity are utilized to extract depth cues, and then we integrate depth cues and color volume to saliency detection following the basic structure of the feature integration theory. Experimental results show that the proposed computing model outperforms some existing state-of-the-art methods on MSRA1000 and ECSSD datasets.

Optimization of patterns of control bars using neural networks

International Nuclear Information System (INIS)

Mejia S, D.M.; Ortiz S, J.J.

2005-01-01

In this work the RENOPBC system that is based on a recurrent multi state neural network, for the optimization of patterns of control bars in a cycle of balance of a boiling water reactor (BWR for their initials in English) is presented. The design of patterns of bars is based on the execution of operation thermal limits, to maintain criticizes the reactor and that the axial profile of power is adjusted to one predetermined along several steps of burnt. The patterns of control bars proposed by the system are comparable to those proposed by human experts with many hour-man of experience. These results are compared with those proposed by other techniques as genetic algorithms, colonies of ants and tabu search for the same operation cycle. As consequence it is appreciated that the proposed patterns of control bars, have bigger operation easiness that those proposed by the other techniques. (Author)

Granular neural networks, pattern recognition and bioinformatics

CERN Document Server

Pal, Sankar K; Ganivada, Avatharam

2017-01-01

This book provides a uniform framework describing how fuzzy rough granular neural network technologies can be formulated and used in building efficient pattern recognition and mining models. It also discusses the formation of granules in the notion of both fuzzy and rough sets. Judicious integration in forming fuzzy-rough information granules based on lower approximate regions enables the network to determine the exactness in class shape as well as to handle the uncertainties arising from overlapping regions, resulting in efficient and speedy learning with enhanced performance. Layered network and self-organizing analysis maps, which have a strong potential in big data, are considered as basic modules,. The book is structured according to the major phases of a pattern recognition system (e.g., classification, clustering, and feature selection) with a balanced mixture of theory, algorithm, and application. It covers the latest findings as well as directions for future research, particularly highlighting bioinf...

NetTurnP – Neural Network Prediction of Beta-turns by Use of Evolutionary Information and Predicted Protein Sequence Features

Science.gov (United States)

Petersen, Bent; Lundegaard, Claus; Petersen, Thomas Nordahl

2010-01-01

β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino acid sequence. The individual β-turn types I, I', II, II', VIII, VIa1, VIa2, VIba and IV have been predicted based on classifications by PROMOTIF, and the two-class prediction of β-turn or not is a superset comprised of all β-turn types. The performance is evaluated using a golden set of non-homologous sequences known as BT426. Our two-class prediction method achieves a performance of: MCC  = 0.50, Qtotal = 82.1%, sensitivity  = 75.6%, PPV  = 68.8% and AUC  = 0.864. We have compared our performance to eleven other prediction methods that obtain Matthews correlation coefficients in the range of 0.17 – 0.47. For the type specific β-turn predictions, only type I and II can be predicted with reasonable Matthews correlation coefficients, where we obtain performance values of 0.36 and 0.31, respectively. Conclusion The NetTurnP method has been implemented as a webserver, which is freely available at http://www.cbs.dtu.dk/services/NetTurnP/. NetTurnP is the only available webserver that allows submission of multiple sequences. PMID:21152409

Vascular pattern of the dentate gyrus is regulated by neural progenitors.

Science.gov (United States)

Pombero, Ana; Garcia-Lopez, Raquel; Estirado, Alicia; Martinez, Salvador

2018-05-01

Neurogenesis is a vital process that begins during early embryonic development and continues until adulthood, though in the latter case, it is restricted to the subventricular zone and the subgranular zone of the dentate gyrus (DG). In particular, the DG's neurogenic properties are structurally and functionally unique, which may be related to its singular vascular pattern. Neurogenesis and angiogenesis share molecular signals and act synergistically, supporting the concept of a neurogenic niche as a functional unit between neural precursors cells and their environment, in which the blood vessels play an important role. Whereas it is well known that vascular development controls neural proliferation in the embryonary and in the adult brain, by releasing neurotrophic factors; the potential influence of neural cells on vascular components during angiogenesis is largely unknown. We have demonstrated that the reduction of neural progenitors leads to a significant impairment of vascular development. Since VEGF is a potential regulator in the neurogenesis-angiogenesis crosstalk, we were interested in assessing the possible role of this molecule in the hippocampal neurovascular development. Our results showed that VEGF is the molecule involved in the regulation of vascular development by neural progenitor cells in the DG.

Schema generation in recurrent neural nets for intercepting a moving target.

Science.gov (United States)

Fleischer, Andreas G

2010-06-01

The grasping of a moving object requires the development of a motor strategy to anticipate the trajectory of the target and to compute an optimal course of interception. During the performance of perception-action cycles, a preprogrammed prototypical movement trajectory, a motor schema, may highly reduce the control load. Subjects were asked to hit a target that was moving along a circular path by means of a cursor. Randomized initial target positions and velocities were detected in the periphery of the eyes, resulting in a saccade toward the target. Even when the target disappeared, the eyes followed the target's anticipated course. The Gestalt of the trajectories was dependent on target velocity. The prediction capability of the motor schema was investigated by varying the visibility range of cursor and target. Motor schemata were determined to be of limited precision, and therefore visual feedback was continuously required to intercept the moving target. To intercept a target, the motor schema caused the hand to aim ahead and to adapt to the target trajectory. The control of cursor velocity determined the point of interception. From a modeling point of view, a neural network was developed that allowed the implementation of a motor schema interacting with feedback control in an iterative manner. The neural net of the Wilson type consists of an excitation-diffusion layer allowing the generation of a moving bubble. This activation bubble runs down an eye-centered motor schema and causes a planar arm model to move toward the target. A bubble provides local integration and straightening of the trajectory during repetitive moves. The schema adapts to task demands by learning and serves as forward controller. On the basis of these model considerations the principal problem of embedding motor schemata in generalized control strategies is discussed.

Rotation and scale change invariant point pattern relaxation matching by the Hopfield neural network

Science.gov (United States)

Sang, Nong; Zhang, Tianxu

1997-12-01

Relaxation matching is one of the most relevant methods for image matching. The original relaxation matching technique using point patterns is sensitive to rotations and scale changes. We improve the original point pattern relaxation matching technique to be invariant to rotations and scale changes. A method that makes the Hopfield neural network perform this matching process is discussed. An advantage of this is that the relaxation matching process can be performed in real time with the neural network's massively parallel capability to process information. Experimental results with large simulated images demonstrate the effectiveness and feasibility of the method to perform point patten relaxation matching invariant to rotations and scale changes and the method to perform this matching by the Hopfield neural network. In addition, we show that the method presented can be tolerant to small random error.

Larger bases and mixed analog/digital neural nets

Energy Technology Data Exchange (ETDEWEB)

Beiu, V.

1998-12-31

The paper overviews results dealing with the approximation capabilities of neural networks, and bounds on the size of threshold gate circuits. Based on an explicit numerical algorithm for Kolmogorov`s superpositions the authors show that minimum size neural networks--for implementing any Boolean function--have the identity function as the activation function. Conclusions and several comments on the required precision are ending the paper.

2D neural hardware versus 3D biological ones

Energy Technology Data Exchange (ETDEWEB)

Beiu, V.

1998-12-31

This paper will present important limitations of hardware neural nets as opposed to biological neural nets (i.e. the real ones). The author starts by discussing neural structures and their biological inspirations, while mentioning the simplifications leading to artificial neural nets. Going further, the focus will be on hardware constraints. The author will present recent results for three different alternatives of implementing neural networks: digital, threshold gate, and analog, while the area and the delay will be related to neurons' fan-in and weights' precision. Based on all of these, it will be shown why hardware implementations cannot cope with their biological inspiration with respect to their power of computation: the mapping onto silicon lacking the third dimension of biological nets. This translates into reduced fan-in, and leads to reduced precision. The main conclusion is that one is faced with the following alternatives: (1) try to cope with the limitations imposed by silicon, by speeding up the computation of the elementary silicon neurons; (2) investigate solutions which would allow one to use the third dimension, e.g. using optical interconnections.

Do neural nets learn statistical laws behind natural language?

Directory of Open Access Journals (Sweden)

Shuntaro Takahashi

Full Text Available The performance of deep learning in natural language processing has been spectacular, but the reasons for this success remain unclear because of the inherent complexity of deep learning. This paper provides empirical evidence of its effectiveness and of a limitation of neural networks for language engineering. Precisely, we demonstrate that a neural language model based on long short-term memory (LSTM effectively reproduces Zipf's law and Heaps' law, two representative statistical properties underlying natural language. We discuss the quality of reproducibility and the emergence of Zipf's law and Heaps' law as training progresses. We also point out that the neural language model has a limitation in reproducing long-range correlation, another statistical property of natural language. This understanding could provide a direction for improving the architectures of neural networks.

Regulated expression of the neural cell adhesion molecule L1 by specific patterns of neural impulses.

Science.gov (United States)

Itoh, K; Stevens, B; Schachner, M; Fields, R D

1995-11-24

Development of the mammalian nervous system is regulated by neural impulse activity, but the molecular mechanisms are not well understood. If cell recognition molecules [for example, L1 and the neural cell adhesion molecule (NCAM)] were influenced by specific patterns of impulse activity, cell-cell interactions controlling nervous system structure could be regulated by nervous system function at critical stages of development. Low-frequency electrical pulses delivered to mouse sensory neurons in culture (0.1 hertz for 5 days) down-regulated expression of L1 messenger RNA and protein (but not NCAM). Fasciculation of neurites, adhesion of neuroblastoma cells, and the number of Schwann cells on neurites was reduced after 0.1-hertz stimulation, but higher frequencies or stimulation after synaptogenesis were without effect.

Global patterns in human consumption of net primary production

Science.gov (United States)

Imhoff, Marc L.; Bounoua, Lahouari; Ricketts, Taylor; Loucks, Colby; Harriss, Robert; Lawrence, William T.

2004-06-01

The human population and its consumption profoundly affect the Earth's ecosystems. A particularly compelling measure of humanity's cumulative impact is the fraction of the planet's net primary production that we appropriate for our own use. Net primary production-the net amount of solar energy converted to plant organic matter through photosynthesis-can be measured in units of elemental carbon and represents the primary food energy source for the world's ecosystems. Human appropriation of net primary production, apart from leaving less for other species to use, alters the composition of the atmosphere, levels of biodiversity, energy flows within food webs and the provision of important ecosystem services. Here we present a global map showing the amount of net primary production required by humans and compare it to the total amount generated on the landscape. We then derive a spatial balance sheet of net primary production `supply' and `demand' for the world. We show that human appropriation of net primary production varies spatially from almost zero to many times the local primary production. These analyses reveal the uneven footprint of human consumption and related environmental impacts, indicate the degree to which human populations depend on net primary production `imports' and suggest policy options for slowing future growth of human appropriation of net primary production.

Whose Balance Sheet is this? Neural Networks for Banks' Pattern Recognition

NARCIS (Netherlands)

Leon Rincon, Carlos; Moreno, José Fernando; Cely, Jorge

2017-01-01

The balance sheet is a snapshot that portraits the financial position of a firm at a specific point of time. Under the reasonable assumption that the financial position of a firm is unique and representative, we use a basic artificial neural network pattern recognition method on Colombian banks’

Reconstruction of neutron spectra through neural networks

International Nuclear Information System (INIS)

Vega C, H.R.; Hernandez D, V.M.; Manzanares A, E.

2003-01-01

A neural network has been used to reconstruct the neutron spectra starting from the counting rates of the detectors of the Bonner sphere spectrophotometric system. A group of 56 neutron spectra was selected to calculate the counting rates that would produce in a Bonner sphere system, with these data and the spectra it was trained the neural network. To prove the performance of the net, 12 spectra were used, 6 were taken of the group used for the training, 3 were obtained of mathematical functions and those other 3 correspond to real spectra. When comparing the original spectra of those reconstructed by the net we find that our net has a poor performance when reconstructing monoenergetic spectra, this attributes it to those characteristic of the spectra used for the training of the neural network, however for the other groups of spectra the results of the net are appropriate with the prospective ones. (Author)

Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation.

Science.gov (United States)

Anderson, Andrew James; Binder, Jeffrey R; Fernandino, Leonardo; Humphries, Colin J; Conant, Lisa L; Aguilar, Mario; Wang, Xixi; Doko, Donias; Raizada, Rajeev D S

2017-09-01

We introduce an approach that predicts neural representations of word meanings contained in sentences then superposes these to predict neural representations of new sentences. A neurobiological semantic model based on sensory, motor, social, emotional, and cognitive attributes was used as a foundation to define semantic content. Previous studies have predominantly predicted neural patterns for isolated words, using models that lack neurobiological interpretation. Fourteen participants read 240 sentences describing everyday situations while undergoing fMRI. To connect sentence-level fMRI activation patterns to the word-level semantic model, we devised methods to decompose the fMRI data into individual words. Activation patterns associated with each attribute in the model were then estimated using multiple-regression. This enabled synthesis of activation patterns for trained and new words, which were subsequently averaged to predict new sentences. Region-of-interest analyses revealed that prediction accuracy was highest using voxels in the left temporal and inferior parietal cortex, although a broad range of regions returned statistically significant results, showing that semantic information is widely distributed across the brain. The results show how a neurobiologically motivated semantic model can decompose sentence-level fMRI data into activation features for component words, which can be recombined to predict activation patterns for new sentences. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Tutorial on neural network applications in high energy physics: A 1992 perspective

International Nuclear Information System (INIS)

Denby, B.

1992-04-01

Feed forward and recurrent neural networks are introduced and related to standard data analysis tools. Tips are given on applications of neural nets to various areas of high energy physics. A review of applications within high energy physics and a summary of neural net hardware status are given

Unsupervised discrimination of patterns in spiking neural networks with excitatory and inhibitory synaptic plasticity.

Science.gov (United States)

Srinivasa, Narayan; Cho, Youngkwan

2014-01-01

A spiking neural network model is described for learning to discriminate among spatial patterns in an unsupervised manner. The network anatomy consists of source neurons that are activated by external inputs, a reservoir that resembles a generic cortical layer with an excitatory-inhibitory (EI) network and a sink layer of neurons for readout. Synaptic plasticity in the form of STDP is imposed on all the excitatory and inhibitory synapses at all times. While long-term excitatory STDP enables sparse and efficient learning of the salient features in inputs, inhibitory STDP enables this learning to be stable by establishing a balance between excitatory and inhibitory currents at each neuron in the network. The synaptic weights between source and reservoir neurons form a basis set for the input patterns. The neural trajectories generated in the reservoir due to input stimulation and lateral connections between reservoir neurons can be readout by the sink layer neurons. This activity is used for adaptation of synapses between reservoir and sink layer neurons. A new measure called the discriminability index (DI) is introduced to compute if the network can discriminate between old patterns already presented in an initial training session. The DI is also used to compute if the network adapts to new patterns without losing its ability to discriminate among old patterns. The final outcome is that the network is able to correctly discriminate between all patterns-both old and new. This result holds as long as inhibitory synapses employ STDP to continuously enable current balance in the network. The results suggest a possible direction for future investigation into how spiking neural networks could address the stability-plasticity question despite having continuous synaptic plasticity.

Amphioxus and lamprey AP-2 genes: implications for neural crest evolution and migration patterns

Science.gov (United States)

Meulemans, Daniel; Bronner-Fraser, Marianne

2002-01-01

The neural crest is a uniquely vertebrate cell type present in the most basal vertebrates, but not in cephalochordates. We have studied differences in regulation of the neural crest marker AP-2 across two evolutionary transitions: invertebrate to vertebrate, and agnathan to gnathostome. Isolation and comparison of amphioxus, lamprey and axolotl AP-2 reveals its extensive expansion in the vertebrate dorsal neural tube and pharyngeal arches, implying co-option of AP-2 genes by neural crest cells early in vertebrate evolution. Expression in non-neural ectoderm is a conserved feature in amphioxus and vertebrates, suggesting an ancient role for AP-2 genes in this tissue. There is also common expression in subsets of ventrolateral neurons in the anterior neural tube, consistent with a primitive role in brain development. Comparison of AP-2 expression in axolotl and lamprey suggests an elaboration of cranial neural crest patterning in gnathostomes. However, migration of AP-2-expressing neural crest cells medial to the pharyngeal arch mesoderm appears to be a primitive feature retained in all vertebrates. Because AP-2 has essential roles in cranial neural crest differentiation and proliferation, the co-option of AP-2 by neural crest cells in the vertebrate lineage was a potentially crucial event in vertebrate evolution.

Optimization of control bars patterns and fuel recharges of coupled form; Optimizacion de patrones de barras de control y recargas de combustible de forma acoplada

Energy Technology Data Exchange (ETDEWEB)

Mejia S, D.M.; Ortiz S, J.J. [ININ, 52750 Ocoyoacac, Estado de Mexico (Mexico)]. e-mail: dulcema6715@hotmail.com

2006-07-01

In this work a system coupled for the optimization of fuel recharges and control bars patterns in boiling water reactors (BWR by its initials in English) is presented. It was used a multi state recurrent neural net like optimization technique. This type of neural net has been used in the solution of diverse problems, in particular the design of patterns of control bars and the design of the fuel recharge. However, these problems have been resolved in an independent way with different optimization techniques. The system was developed in FORTRAN 77 language, it calls OCORN (Optimization of Cycles of Operation using Neural Nets) and it solves both problems of combinatory optimization in a coupled way. OCORN begins creating a seed recharge by means of an optimization through the Haling principle. Later on a pattern of control bars for this recharge seed is proposed. Then a new fuel recharge is designed using the control bars patterns previously found. By this way an iterative process begins among the optimization of control bars patterns and the fuel recharge until a stop criteria it is completed. The stop criteria is completed when the fuel recharges and the control bars patterns don't vary in several successive iterations. The final result is an optimal fuel recharge and its respective control bars pattern. In this work the obtained results by this system for a cycle of balance of 18 months divided in 12 steps of burnt are presented. The obtained results are very encouraging, since the fuel recharge and the control bars pattern, its fulfill with the restrictions imposed in each one of the problems. (Author)

Cultured Neural Networks: Optimization of Patterned Network Adhesiveness and Characterization of their Neural Activity

Directory of Open Access Journals (Sweden)

W. L. C. Rutten

2006-01-01

Full Text Available One type of future, improved neural interface is the “cultured probe”. It is a hybrid type of neural information transducer or prosthesis, for stimulation and/or recording of neural activity. It would consist of a microelectrode array (MEA on a planar substrate, each electrode being covered and surrounded by a local circularly confined network (“island” of cultured neurons. The main purpose of the local networks is that they act as biofriendly intermediates for collateral sprouts from the in vivo system, thus allowing for an effective and selective neuron–electrode interface. As a secondary purpose, one may envisage future information processing applications of these intermediary networks. In this paper, first, progress is shown on how substrates can be chemically modified to confine developing networks, cultured from dissociated rat cortex cells, to “islands” surrounding an electrode site. Additional coating of neurophobic, polyimide-coated substrate by triblock-copolymer coating enhances neurophilic-neurophobic adhesion contrast. Secondly, results are given on neuronal activity in patterned, unconnected and connected, circular “island” networks. For connected islands, the larger the island diameter (50, 100 or 150 μm, the more spontaneous activity is seen. Also, activity may show a very high degree of synchronization between two islands. For unconnected islands, activity may start at 22 days in vitro (DIV, which is two weeks later than in unpatterned networks.

Progressively expanded neural network for automatic material identification in hyperspectral imagery

Science.gov (United States)

Paheding, Sidike

The science of hyperspectral remote sensing focuses on the exploitation of the spectral signatures of various materials to enhance capabilities including object detection, recognition, and material characterization. Hyperspectral imagery (HSI) has been extensively used for object detection and identification applications since it provides plenty of spectral information to uniquely identify materials by their reflectance spectra. HSI-based object detection algorithms can be generally classified into stochastic and deterministic approaches. Deterministic approaches are comparatively simple to apply since it is usually based on direct spectral similarity such as spectral angles or spectral correlation. In contrast, stochastic algorithms require statistical modeling and estimation for target class and non-target class. Over the decades, many single class object detection methods have been proposed in the literature, however, deterministic multiclass object detection in HSI has not been explored. In this work, we propose a deterministic multiclass object detection scheme, named class-associative spectral fringe-adjusted joint transform correlation. Human brain is capable of simultaneously processing high volumes of multi-modal data received every second of the day. In contrast, a machine sees input data simply as random binary numbers. Although machines are computationally efficient, they are inferior when comes to data abstraction and interpretation. Thus, mimicking the learning strength of human brain has been current trend in artificial intelligence. In this work, we present a biological inspired neural network, named progressively expanded neural network (PEN Net), based on nonlinear transformation of input neurons to a feature space for better pattern differentiation. In PEN Net, discrete fixed excitations are disassembled and scattered in the feature space as a nonlinear line. Each disassembled element on the line corresponds to a pattern with similar features

Optimization of the kernel functions in a probabilistic neural network analyzing the local pattern distribution.

Science.gov (United States)

Galleske, I; Castellanos, J

2002-05-01

This article proposes a procedure for the automatic determination of the elements of the covariance matrix of the gaussian kernel function of probabilistic neural networks. Two matrices, a rotation matrix and a matrix of variances, can be calculated by analyzing the local environment of each training pattern. The combination of them will form the covariance matrix of each training pattern. This automation has two advantages: First, it will free the neural network designer from indicating the complete covariance matrix, and second, it will result in a network with better generalization ability than the original model. A variation of the famous two-spiral problem and real-world examples from the UCI Machine Learning Repository will show a classification rate not only better than the original probabilistic neural network but also that this model can outperform other well-known classification techniques.

Cross-Modal Decoding of Neural Patterns Associated with Working Memory: Evidence for Attention-Based Accounts of Working Memory.

Science.gov (United States)

Majerus, Steve; Cowan, Nelson; Péters, Frédéric; Van Calster, Laurens; Phillips, Christophe; Schrouff, Jessica

2016-01-01

Recent studies suggest common neural substrates involved in verbal and visual working memory (WM), interpreted as reflecting shared attention-based, short-term retention mechanisms. We used a machine-learning approach to determine more directly the extent to which common neural patterns characterize retention in verbal WM and visual WM. Verbal WM was assessed via a standard delayed probe recognition task for letter sequences of variable length. Visual WM was assessed via a visual array WM task involving the maintenance of variable amounts of visual information in the focus of attention. We trained a classifier to distinguish neural activation patterns associated with high- and low-visual WM load and tested the ability of this classifier to predict verbal WM load (high-low) from their associated neural activation patterns, and vice versa. We observed significant between-task prediction of load effects during WM maintenance, in posterior parietal and superior frontal regions of the dorsal attention network; in contrast, between-task prediction in sensory processing cortices was restricted to the encoding stage. Furthermore, between-task prediction of load effects was strongest in those participants presenting the highest capacity for the visual WM task. This study provides novel evidence for common, attention-based neural patterns supporting verbal and visual WM. © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Patterns of interval correlations in neural oscillators with adaptation

Directory of Open Access Journals (Sweden)

Tilo eSchwalger

2013-11-01

Full Text Available Neural firing is often subject to negative feedback by adaptationcurrents. These currents can induce strong correlations among the timeintervals between spikes. Here we study analytically the intervalcorrelations of a broad class of noisy neural oscillators withspike-triggered adaptation of arbitrary strength and time scale. Ourweak-noise theory provides a general relation between the correlationsand the phase-response curve (PRC of the oscillator, provesanti-correlations between neighboring intervals for adapting neuronswith type I PRC and identifies a single order parameter thatdetermines the qualitative pattern of correlations. Monotonicallydecaying or oscillating correlation structures can be related toqualitatively different voltage traces after spiking, which can beexplained by the phase plane geometry. At high firing rates, thelong-term variability of the spike train associated with thecumulative interval correlations becomes small, independent of modeldetails. Our results are verified by comparison with stochasticsimulations of the exponential, leaky, and generalizedintegrate-and-fire models with adaptation.

Pattern of neural responses to verbal fluency shows diagnostic specificity for schizophrenia and bipolar disorder

Directory of Open Access Journals (Sweden)

Walshe Muriel

2011-01-01

Full Text Available Abstract Background Impairments in executive function and language processing are characteristic of both schizophrenia and bipolar disorder. Their functional neuroanatomy demonstrate features that are shared as well as specific to each disorder. Determining the distinct pattern of neural responses in schizophrenia and bipolar disorder may provide biomarkers for their diagnoses. Methods 104 participants underwent functional magnetic resonance imaging (fMRI scans while performing a phonological verbal fluency task. Subjects were 32 patients with schizophrenia in remission, 32 patients with bipolar disorder in an euthymic state, and 40 healthy volunteers. Neural responses to verbal fluency were examined in each group, and the diagnostic potential of the pattern of the neural responses was assessed with machine learning analysis. Results During the verbal fluency task, both patient groups showed increased activation in the anterior cingulate, left dorsolateral prefrontal cortex and right putamen as compared to healthy controls, as well as reduced deactivation of precuneus and posterior cingulate. The magnitude of activation was greatest in patients with schizophrenia, followed by patients with bipolar disorder and then healthy individuals. Additional recruitment in the right inferior frontal and right dorsolateral prefrontal cortices was observed in schizophrenia relative to both bipolar disorder and healthy subjects. The pattern of neural responses correctly identified individual patients with schizophrenia with an accuracy of 92%, and those with bipolar disorder with an accuracy of 79% in which mis-classification was typically of bipolar subjects as healthy controls. Conclusions In summary, both schizophrenia and bipolar disorder are associated with altered function in prefrontal, striatal and default mode networks, but the magnitude of this dysfunction is particularly marked in schizophrenia. The pattern of response to verbal fluency is highly

Patterns of work attitudes: A neural network approach

Science.gov (United States)

Mengov, George D.; Zinovieva, Irina L.; Sotirov, George R.

2000-05-01

In this paper we introduce a neural networks based approach to analyzing empirical data and models from work and organizational psychology (WOP), and suggest possible implications for the practice of managers and business consultants. With this method it becomes possible to have quantitative answers to a bunch of questions like: What are the characteristics of an organization in terms of its employees' motivation? What distinct attitudes towards the work exist? Which pattern is most desirable from the standpoint of productivity and professional achievement? What will be the dynamics of behavior as quantified by our method, during an ongoing organizational change or consultancy intervention? Etc. Our investigation is founded on the theoretical achievements of Maslow (1954, 1970) in human motivation, and of Hackman & Oldham (1975, 1980) in job diagnostics, and applies the mathematical algorithm of the dARTMAP variation (Carpenter et al., 1998) of the Adaptive Resonance Theory (ART) neural networks introduced by Grossberg (1976). We exploit the ART capabilities to visualize the knowledge accumulated in the network's long-term memory in order to interpret the findings in organizational research.

Universal approximation in p-mean by neural networks

NARCIS (Netherlands)

Burton, R.M; Dehling, H.G

A feedforward neural net with d input neurons and with a single hidden layer of n neurons is given by [GRAPHICS] where a(j), theta(j), w(ji) is an element of R. In this paper we study the approximation of arbitrary functions f: R-d --> R by a neural net in an L-p(mu) norm for some finite measure mu

Global Neural Pattern Similarity as a Common Basis for Categorization and Recognition Memory

Science.gov (United States)

Xue, Gui; Love, Bradley C.; Preston, Alison R.; Poldrack, Russell A.

2014-01-01

Familiarity, or memory strength, is a central construct in models of cognition. In previous categorization and long-term memory research, correlations have been found between psychological measures of memory strength and activation in the medial temporal lobes (MTLs), which suggests a common neural locus for memory strength. However, activation alone is insufficient for determining whether the same mechanisms underlie neural function across domains. Guided by mathematical models of categorization and long-term memory, we develop a theory and a method to test whether memory strength arises from the global similarity among neural representations. In human subjects, we find significant correlations between global similarity among activation patterns in the MTLs and both subsequent memory confidence in a recognition memory task and model-based measures of memory strength in a category learning task. Our work bridges formal cognitive theories and neuroscientific models by illustrating that the same global similarity computations underlie processing in multiple cognitive domains. Moreover, by establishing a link between neural similarity and psychological memory strength, our findings suggest that there may be an isomorphism between psychological and neural representational spaces that can be exploited to test cognitive theories at both the neural and behavioral levels. PMID:24872552

A bat's ear view of neural nets in physics

International Nuclear Information System (INIS)

Denby, B.

1997-01-01

The use of neural networks in high energy physics has become a field of its own which now has been in existence for ten years. This paper attempts to draw some conclusions on the utility of neural networks for physics applications, and also to make some projections for the future of this line of research. (orig.)

Goal-seeking neural net for recall and recognition

Science.gov (United States)

Omidvar, Omid M.

1990-07-01

Neural networks have been used to mimic cognitive processes which take place in animal brains. The learning capability inherent in neural networks makes them suitable candidates for adaptive tasks such as recall and recognition. The synaptic reinforcements create a proper condition for adaptation, which results in memorization, formation of perception, and higher order information processing activities. In this research a model of a goal seeking neural network is studied and the operation of the network with regard to recall and recognition is analyzed. In these analyses recall is defined as retrieval of stored information where little or no matching is involved. On the other hand recognition is recall with matching; therefore it involves memorizing a piece of information with complete presentation. This research takes the generalized view of reinforcement in which all the signals are potential reinforcers. The neuronal response is considered to be the source of the reinforcement. This local approach to adaptation leads to the goal seeking nature of the neurons as network components. In the proposed model all the synaptic strengths are reinforced in parallel while the reinforcement among the layers is done in a distributed fashion and pipeline mode from the last layer inward. A model of complex neuron with varying threshold is developed to account for inhibitory and excitatory behavior of real neuron. A goal seeking model of a neural network is presented. This network is utilized to perform recall and recognition tasks. The performance of the model with regard to the assigned tasks is presented.

In-vivo determination of chewing patterns using FBG and artificial neural networks

Science.gov (United States)

Pegorini, Vinicius; Zen Karam, Leandro; Rocha Pitta, Christiano S.; Ribeiro, Richardson; Simioni Assmann, Tangriani; Cardozo da Silva, Jean Carlos; Bertotti, Fábio L.; Kalinowski, Hypolito J.; Cardoso, Rafael

2015-09-01

This paper reports the process of pattern classification of the chewing process of ruminants. We propose a simplified signal processing scheme for optical fiber Bragg grating (FBG) sensors based on machine learning techniques. The FBG sensors measure the biomechanical forces during jaw movements and an artificial neural network is responsible for the classification of the associated chewing pattern. In this study, three patterns associated to dietary supplement, hay and ryegrass were considered. Additionally, two other important events for ingestive behavior studies were monitored, rumination and idle period. Experimental results show that the proposed approach for pattern classification has been capable of differentiating the materials involved in the chewing process with a small classification error.

A Pattern Construction Scheme for Neural Network-Based Cognitive Communication

Directory of Open Access Journals (Sweden)

Ozgur Orcay

2011-01-01

Full Text Available Inefficient utilization of the frequency spectrum due to conventional regulatory limitations and physical performance limiting factors, mainly the Signal to Noise Ratio (SNR, are prominent restrictions in digital wireless communication. Pattern Based Communication System (PBCS is an adaptive and perceptual communication method based on a Cognitive Radio (CR approach. It intends an SNR oriented cognition mechanism in the physical layer for improvement of Link Spectral Efficiency (LSE. The key to this system is construction of optimal communication signals, which consist of encoded data in different pattern forms (waveforms depending on spectral availabilities. The signals distorted in the communication medium are recovered according to the pre-trained pattern glossary by the perceptual receiver. In this study, we have shown that it is possible to improve the bandwidth efficiency when largely uncorrelated signal patterns are chosen in order to form a glossary that represents symbols for different length data groups and the information can be recovered by the Artificial Neural Network (ANN in the receiver site.

EnzyNet: enzyme classification using 3D convolutional neural networks on spatial representation.

Science.gov (United States)

Amidi, Afshine; Amidi, Shervine; Vlachakis, Dimitrios; Megalooikonomou, Vasileios; Paragios, Nikos; Zacharaki, Evangelia I

2018-01-01

During the past decade, with the significant progress of computational power as well as ever-rising data availability, deep learning techniques became increasingly popular due to their excellent performance on computer vision problems. The size of the Protein Data Bank (PDB) has increased more than 15-fold since 1999, which enabled the expansion of models that aim at predicting enzymatic function via their amino acid composition. Amino acid sequence, however, is less conserved in nature than protein structure and therefore considered a less reliable predictor of protein function. This paper presents EnzyNet, a novel 3D convolutional neural networks classifier that predicts the Enzyme Commission number of enzymes based only on their voxel-based spatial structure. The spatial distribution of biochemical properties was also examined as complementary information. The two-layer architecture was investigated on a large dataset of 63,558 enzymes from the PDB and achieved an accuracy of 78.4% by exploiting only the binary representation of the protein shape. Code and datasets are available at https://github.com/shervinea/enzynet.

Application of neural network and pattern recognition software to the automated analysis of continuous nuclear monitoring of on-load reactors

Energy Technology Data Exchange (ETDEWEB)

Howell, J.A.; Eccleston, G.W.; Halbig, J.K.; Klosterbuer, S.F. [Los Alamos National Lab., NM (United States); Larson, T.W. [California Polytechnic State Univ., San Luis Obispo, CA (US)

1993-08-01

Automated analysis using pattern recognition and neural network software can help interpret data, call attention to potential anomalies, and improve safeguards effectiveness. Automated software analysis, based on pattern recognition and neural networks, was applied to data collected from a radiation core discharge monitor system located adjacent to an on-load reactor core. Unattended radiation sensors continuously collect data to monitor on-line refueling operations in the reactor. The huge volume of data collected from a number of radiation channels makes it difficult for a safeguards inspector to review it all, check for consistency among the measurement channels, and find anomalies. Pattern recognition and neural network software can analyze large volumes of data from continuous, unattended measurements, thereby improving and automating the detection of anomalies. The authors developed a prototype pattern recognition program that determines the reactor power level and identifies the times when fuel bundles are pushed through the core during on-line refueling. Neural network models were also developed to predict fuel bundle burnup to calculate the region on the on-load reactor face from which fuel bundles were discharged based on the radiation signals. In the preliminary data set, which was limited and consisted of four distinct burnup regions, the neural network model correctly predicted the burnup region with an accuracy of 92%.

Distinct neural patterns enable grasp types decoding in monkey dorsal premotor cortex

Science.gov (United States)

Hao, Yaoyao; Zhang, Qiaosheng; Controzzi, Marco; Cipriani, Christian; Li, Yue; Li, Juncheng; Zhang, Shaomin; Wang, Yiwen; Chen, Weidong; Chiara Carrozza, Maria; Zheng, Xiaoxiang

2014-12-01

Objective. Recent studies have shown that dorsal premotor cortex (PMd), a cortical area in the dorsomedial grasp pathway, is involved in grasp movements. However, the neural ensemble firing property of PMd during grasp movements and the extent to which it can be used for grasp decoding are still unclear. Approach. To address these issues, we used multielectrode arrays to record both spike and local field potential (LFP) signals in PMd in macaque monkeys performing reaching and grasping of one of four differently shaped objects. Main results. Single and population neuronal activity showed distinct patterns during execution of different grip types. Cluster analysis of neural ensemble signals indicated that the grasp related patterns emerged soon (200-300 ms) after the go cue signal, and faded away during the hold period. The timing and duration of the patterns varied depending on the behaviors of individual monkey. Application of support vector machine model to stable activity patterns revealed classification accuracies of 94% and 89% for each of the two monkeys, indicating a robust, decodable grasp pattern encoded in the PMd. Grasp decoding using LFPs, especially the high-frequency bands, also produced high decoding accuracies. Significance. This study is the first to specify the neuronal population encoding of grasp during the time course of grasp. We demonstrate high grasp decoding performance in PMd. These findings, combined with previous evidence for reach related modulation studies, suggest that PMd may play an important role in generation and maintenance of grasp action and may be a suitable locus for brain-machine interface applications.

Turkey's net energy consumption

International Nuclear Information System (INIS)

Soezen, Adnan; Arcaklioglu, Erol; Oezkaymak, Mehmet

2005-01-01

The main goal of this study is to develop the equations for forecasting net energy consumption (NEC) using an artificial neural-network (ANN) technique in order to determine the future level of energy consumption in Turkey. In this study, two different models were used in order to train the neural network. In one of them, population, gross generation, installed capacity and years are used in the input layer of the network (Model 1). Other energy sources are used in input layer of network (Model 2). The net energy consumption is in the output layer for two models. Data from 1975 to 2003 are used for the training. Three years (1981, 1994 and 2003) are used only as test data to confirm this method. The statistical coefficients of multiple determinations (R 2 -value) for training data are equal to 0.99944 and 0.99913 for Models 1 and 2, respectively. Similarly, R 2 values for testing data are equal to 0.997386 and 0.999558 for Models 1 and 2, respectively. According to the results, the net energy consumption using the ANN technique has been predicted with acceptable accuracy. Apart from reducing the whole time required, with the ANN approach, it is possible to find solutions that make energy applications more viable and thus more attractive to potential users. It is also expected that this study will be helpful in developing highly applicable energy policies

Ex vivo determination of chewing patterns using FBG and artificial neural networks

Science.gov (United States)

Karam, L. Z.; Pegorini, V.; Pitta, C. S. R.; Assmann, T. S.; Cardoso, R.; Kalinowski, H. J.; Silva, J. C. C.

2014-05-01

This paper reports the experimental procedures performed in a bovine head for the determination of chewing patterns during the mastication process. Mandible movements during the chewing have been simulated either by using two plasticine materials with different textures or without material. Fibre Bragg grating sensors were fixed in the jaw to monitor the biomechanical forces involved in the chewing process. The acquired signals from the sensors fed the input of an artificial neural network aiming at the classification of the measured chewing patterns for each material used in the experiment. The results obtained from the simulation of the chewing process presented different patterns for the different textures of plasticine, resulting on the determination of three chewing patterns with a classification error of 5%.

High level cognitive information processing in neural networks

Science.gov (United States)

Barnden, John A.; Fields, Christopher A.

1992-01-01

Two related research efforts were addressed: (1) high-level connectionist cognitive modeling; and (2) local neural circuit modeling. The goals of the first effort were to develop connectionist models of high-level cognitive processes such as problem solving or natural language understanding, and to understand the computational requirements of such models. The goals of the second effort were to develop biologically-realistic model of local neural circuits, and to understand the computational behavior of such models. In keeping with the nature of NASA's Innovative Research Program, all the work conducted under the grant was highly innovative. For instance, the following ideas, all summarized, are contributions to the study of connectionist/neural networks: (1) the temporal-winner-take-all, relative-position encoding, and pattern-similarity association techniques; (2) the importation of logical combinators into connection; (3) the use of analogy-based reasoning as a bridge across the gap between the traditional symbolic paradigm and the connectionist paradigm; and (4) the application of connectionism to the domain of belief representation/reasoning. The work on local neural circuit modeling also departs significantly from the work of related researchers. In particular, its concentration on low-level neural phenomena that could support high-level cognitive processing is unusual within the area of biological local circuit modeling, and also serves to expand the horizons of the artificial neural net field.

MosquitoNet: investigating the use of UAV and artificial neural networks for integrated mosquito management

Science.gov (United States)

Case, E.; Ren, Y.; Shragai, T.; Erickson, D.

2017-12-01

Integrated mosquito control is expensive and resource intensive, and changing climatic factors are predicted to expand the habitable range of disease-carrying mosquitoes into new regions in the United States. Of particular concern in the northeastern United States are aedes albopictus, an aggressive, invasive species of mosquito that can transmit both native and exotic disease. Ae. albopictus prefer to live near human populations and breed in artificial containers with as little as two millimeters of standing water, exponentially increasing the difficulty of source control in suburban and urban areas. However, low-cost unmanned aerial vehicles (UAVs) can be used to photograph large regions at centimeter-resolution, and can image containers of interest in suburban neighborhoods. While proofs-of-concepts have been shown using UAVs to identify naturally occurring bodies of water, they have not been used to identify mosquito habitat in more populated areas. One of the primary challenges is that post-processing high-resolution aerial imagery is still time intensive, often labelled by hand or with programs built for satellite imagery. Artificial neural networks have been highly successful at image recognition tasks; in the past five years, convolutional neural networks (CNN) have surpassed or aided trained humans in identification of skin cancer, agricultural crops, and poverty levels from satellite imagery. MosquitoNet, a dual classifier built from the Single Shot Multibox Detector and VGG16 architectures, was trained on UAV­­­­­ aerial imagery taken during a larval study in Westchester County in southern New York State in July and August 2017. MosquitoNet was designed to assess the habitat risk of suburban properties by automating the identification and counting of containers like tires, toys, garbage bins, flower pots, etc. The SSD-based architecture marked small containers and other habitat indicators while the VGG16-based architecture classified the type of

Comparisons of a Quantum Annealing and Classical Computer Neural Net Approach for Inferring Global Annual CO2 Fluxes over Land

Science.gov (United States)

Halem, M.; Radov, A.; Singh, D.

2017-12-01

Investigations of mid to high latitude atmospheric CO2 show growing amplitudes in seasonal variations over the past several decades. Recent high-resolution satellite measurements of CO2 concentration are now available for three years from the Orbiting Carbon Observatory-2. The Atmospheric Radiation Measurement (ARM) program of DOE has been making long-term CO2-flux measurements (in addition to CO2 concentration and an array of other meteorological quantities) at several towers and mobile sites located around the globe at half-hour frequencies. Recent papers have shown CO2 fluxes inferred by assimilating CO2 observations into ecosystem models are largely inconsistent with station observations. An investigation of how the biosphere has reacted to changes in atmospheric CO2 is essential to our understanding of potential climate-vegetation feedbacks. Thus, new approaches for calculating CO2-flux for assimilation into land surface models are necessary for improving the prediction of annual carbon uptake. In this study, we calculate and compare the predicted CO2 fluxes results employing a Feed Forward Backward Propagation Neural Network model on two architectures, (i) an IBM Minsky Computer node and (ii) a hybrid version of the ARC D-Wave quantum annealing computer. We compare the neural net results of predictions of CO2 flux from ARM station data for three different DOE ecosystem sites; an arid plains near Oklahoma City, a northern arctic site at Barrows AL, and a tropical rainforest site in the Amazon. Training times and predictive results for the calculating annual CO2 flux for the two architectures for each of the three sites are presented. Comparative results of predictions as measured by RMSE and MAE are discussed. Plots and correlations of observed vs predicted CO2 flux are also presented for all three sites. We show the estimated training times for quantum and classical calculations when extended to calculating global annual Carbon Uptake over land. We also

Neural network segmentation of magnetic resonance images

International Nuclear Information System (INIS)

Frederick, B.

1990-01-01

Neural networks are well adapted to the task of grouping input patterns into subsets which share some similarity. Moreover, once trained, they can generalize their classification rules to classify new data sets. Sets of pixel intensities from magnetic resonance (MR) images provide a natural input to a neural network; by varying imaging parameters, MR images can reflect various independent physical parameters of tissues in their pixel intensities. A neural net can then be trained to classify physically similar tissue types based on sets of pixel intensities resulting from different imaging studies on the same subject. This paper reports that a neural network classifier for image segmentation was implanted on a Sun 4/60, and was tested on the task of classifying tissues of canine head MR images. Four images of a transaxial slice with different imaging sequences were taken as input to the network (three spin-echo images and an inversion recovery image). The training set consisted of 691 representative samples of gray matter, white matter, cerebrospinal fluid, bone, and muscle preclassified by a neuroscientist. The network was trained using a fast backpropagation algorithm to derive the decision criteria to classify any location in the image by its pixel intensities, and the image was subsequently segmented by the classifier

Residual Deep Convolutional Neural Network Predicts MGMT Methylation Status.

Science.gov (United States)

Korfiatis, Panagiotis; Kline, Timothy L; Lachance, Daniel H; Parney, Ian F; Buckner, Jan C; Erickson, Bradley J

2017-10-01

Predicting methylation of the O6-methylguanine methyltransferase (MGMT) gene status utilizing MRI imaging is of high importance since it is a predictor of response and prognosis in brain tumors. In this study, we compare three different residual deep neural network (ResNet) architectures to evaluate their ability in predicting MGMT methylation status without the need for a distinct tumor segmentation step. We found that the ResNet50 (50 layers) architecture was the best performing model, achieving an accuracy of 94.90% (+/- 3.92%) for the test set (classification of a slice as no tumor, methylated MGMT, or non-methylated). ResNet34 (34 layers) achieved 80.72% (+/- 13.61%) while ResNet18 (18 layers) accuracy was 76.75% (+/- 20.67%). ResNet50 performance was statistically significantly better than both ResNet18 and ResNet34 architectures (p deep neural architectures can be used to predict molecular biomarkers from routine medical images.

Play It Again: Neural Responses to Reunion with Excluders Predicted by Attachment Patterns

Science.gov (United States)

White, Lars O.; Wu, Jia; Borelli, Jessica L.; Mayes, Linda C.; Crowley, Michael J.

2013-01-01

Reunion behavior following stressful separations from caregivers is often considered the single most sensitive clue to infant attachment patterns. Extending these ideas to middle childhood/early adolescence, we examined participants' neural responses to reunion with peers who had previously excluded them. We recorded event-related potentials…

A modified backpropagation algorithm for training neural networks on data with error bars

International Nuclear Information System (INIS)

Gernoth, K.A.; Clark, J.W.

1994-08-01

A method is proposed for training multilayer feedforward neural networks on data contaminated with noise. Specifically, we consider the case that the artificial neural system is required to learn a physical mapping when the available values of the target variable are subject to experimental uncertainties, but are characterized by error bars. The proposed method, based on maximum likelihood criterion for parameter estimation, involves simple modifications of the on-line backpropagation learning algorithm. These include incorporation of the error-bar assignments in a pattern-specific learning rate, together with epochal updating of a new measure of model accuracy that replaces the usual mean-square error. The extended backpropagation algorithm is successfully tested on two problems relevant to the modelling of atomic-mass systematics by neural networks. Provided the underlying mapping is reasonably smooth, neural nets trained with the new procedure are able to learn the true function to a good approximation even in the presence of high levels of Gaussian noise. (author). 26 refs, 2 figs, 5 tabs

Axial design of fuel for BWRs using neural networks

International Nuclear Information System (INIS)

Ortiz, J.J.; Castillo, A.; Montes, J.L.; Perusquia, R.

2007-01-01

In this work a new system of axial optimization of fuel is presented based on a recurrent multi state neural net called RENODC. They are described with detail the main characteristics of this type of neural net (architecture, energy function and actualization of neural states) and like was adapted to the assemble design of nuclear fuel. The fuel design is proven by means of a fuel recharge and pre determined control rod patterns. By this way a good axial fuel design one has, when the thermal limits are fulfilled along the cycle, the reactor stays critic and at least the wanted longitude of the cycle is reached; also the margin of in cold turned off is verified. The assemble of fuel created with RENODC it is substituted by a recharge assemble and it is sought to verify that the energy requirements and aspects of safety are completed. The used cycle corresponds to a balance cycle of 18 months that it can be applied to the Laguna Verde Nucleo electric Central. The tests demonstrate the effectiveness of the system to reach satisfactory results in times of CPU of around 4 hours. This way, it could be proven that the design proposed with a lightly superior enrichment to that of the substituted design, fulfills the energy requirements. In later stages of this project this system will be coupled to the other optimization modules that are already had. (Author)

Pattern recognition and data mining software based on artificial neural networks applied to proton transfer in aqueous environments

International Nuclear Information System (INIS)

Tahat Amani; Marti Jordi; Khwaldeh Ali; Tahat Kaher

2014-01-01

In computational physics proton transfer phenomena could be viewed as pattern classification problems based on a set of input features allowing classification of the proton motion into two categories: transfer ‘occurred’ and transfer ‘not occurred’. The goal of this paper is to evaluate the use of artificial neural networks in the classification of proton transfer events, based on the feed-forward back propagation neural network, used as a classifier to distinguish between the two transfer cases. In this paper, we use a new developed data mining and pattern recognition tool for automating, controlling, and drawing charts of the output data of an Empirical Valence Bond existing code. The study analyzes the need for pattern recognition in aqueous proton transfer processes and how the learning approach in error back propagation (multilayer perceptron algorithms) could be satisfactorily employed in the present case. We present a tool for pattern recognition and validate the code including a real physical case study. The results of applying the artificial neural networks methodology to crowd patterns based upon selected physical properties (e.g., temperature, density) show the abilities of the network to learn proton transfer patterns corresponding to properties of the aqueous environments, which is in turn proved to be fully compatible with previous proton transfer studies. (condensed matter: structural, mechanical, and thermal properties)

Development of a neural net paradigm that predicts simulator sickness

Energy Technology Data Exchange (ETDEWEB)

Allgood, G.O.

1993-03-01

A disease exists that affects pilots and aircrew members who use Navy Operational Flight Training Systems. This malady, commonly referred to as simulator sickness and whose symptomatology closely aligns with that of motion sickness, can compromise the use of these systems because of a reduced utilization factor, negative transfer of training, and reduction in combat readiness. A report is submitted that develops an artificial neural network (ANN) and behavioral model that predicts the onset and level of simulator sickness in the pilots and aircrews who sue these systems. It is proposed that the paradigm could be implemented in real time as a biofeedback monitor to reduce the risk to users of these systems. The model captures the neurophysiological impact of use (human-machine interaction) by developing a structure that maps the associative and nonassociative behavioral patterns (learned expectations) and vestibular (otolith and semicircular canals of the inner ear) and tactile interaction, derived from system acceleration profiles, onto an abstract space that predicts simulator sickness for a given training flight.

Neural Network Based Recognition of Signal Patterns in Application to Automatic Testing of Rails

Directory of Open Access Journals (Sweden)

Tomasz Ciszewski

2006-01-01

Full Text Available The paper describes the application of neural network for recognition of signal patterns in measuring data gathered by the railroad ultrasound testing car. Digital conversion of the measuring signal allows to store and process large quantities of data. The elaboration of smart, effective and automatic procedures recognizing the obtained patterns on the basisof measured signal amplitude has been presented. The test shows only two classes of pattern recognition. In authors’ opinion if we deliver big enough quantity of training data, presented method is applicable to a system that recognizes many classes.

Using a multi-state recurrent neural network to optimize loading patterns in BWRs

International Nuclear Information System (INIS)

Ortiz, Juan Jose; Requena, Ignacio

2004-01-01

A Multi-State Recurrent Neural Network is used to optimize Loading Patterns (LP) in BWRs. We have proposed an energy function that depends on fuel assembly positions and their nuclear cross sections to carry out optimisation. Multi-State Recurrent Neural Networks creates LPs that satisfy the Radial Power Peaking Factor and maximize the effective multiplication factor at the Beginning of the Cycle, and also satisfy the Minimum Critical Power Ratio and Maximum Linear Heat Generation Rate at the End of the Cycle, thereby maximizing the effective multiplication factor. In order to evaluate the LPs, we have used a trained back-propagation neural network to predict the parameter values, instead of using a reactor core simulator, which saved considerable computation time in the search process. We applied this method to find optimal LPs for five cycles of Laguna Verde Nuclear Power Plant (LVNPP) in Mexico

Definition of new 3D invariants. Applications to pattern recognition problems with neural networks

International Nuclear Information System (INIS)

Proriol, J.

1996-01-01

We propose a definition of new 3D invariants. Usual pattern recognition methods use 2D descriptions of 3D objects, we propose a 2D approximation of the defined 3D invariants which can be used with neural networks to solve pattern recognition problems. We describe some methods to use the 2 D approximants. This work is an extension of previous 3D invariants used to solve some high energy physics problems. (author)

A Restricted Boltzman Neural Net to Infer Carbon Uptake from OCO-2 Satellite Data

Science.gov (United States)

Halem, M.; Dorband, J. E.; Radov, A.; Barr-Dallas, M.; Gentine, P.

2015-12-01

For several decades, scientists have been using satellite observations to infer climate budgets of terrestrial carbon uptake employing inverse methods in conjunction with ecosystem models and coupled global climate models. This is an extremely important Big Data calculation today since the net annual photosynthetic carbon uptake changes annually over land and removes on average ~20% of the emissions from human contributions to atmospheric loading of CO2 from fossil fuels. Unfortunately, such calculations have large uncertainties validated with in-situ networks of measuring stations across the globe. One difficulty in using satellite data for these budget calculations is that the models need to assimilate surface fluxes of CO2 as well as soil moisture, vegatation cover and the eddy covariance of latent and sensible heat to calculate the carbon fixed in the soil while satellite spectral observations only provide near surface concentrations of CO2. In July 2014, NASA successfully launched OCO-2 which provides 3km surface measurements of CO2 over land and oceans. We have collected nearly one year of Level 2 XCO2 data from the OCO-2 satellite for 3 sites of ~200 km2 at equatorial, temperate and high latitudes. Each selected site was part of the Fluxnet or ARM system with tower stations for measuring and collecting CO2 fluxes on an hourly basis, in addition to eddy transports of the other parameters. We are also planning to acquire the 4km NDVI products from MODIS and registering the data to the 3km XCO2 footprints for the three sites. We have implemented a restricted Boltzman machine on the quantum annealing D-Wave computer, a novel deep learning neural net, to be used for training with station data to infer CO2 fluxes from collocated XCO2, MODIS vegetative land cover and MERRA reanalysis surface exchange products. We will present performance assessments of the D-Wave Boltzman machine for generating XCO2 fluxes from the OCO-2 satellite observations for the 3 sites by

Fuzzy-neural network in the automatic detection and volumetry of the spleen on spiral CT scans

International Nuclear Information System (INIS)

Heitmann, K.R.; Mainz Univ.; Rueckert, S.; Heussel, C.P.; Thelen, M.; Kauczor, H.U.; Uthmann, T.

2000-01-01

Purpose: To assess spleen segmentation and volumetry in spiral CT scans with and without pathological changes of splenic tissue. Methods: The image analysis software HYBRIKON is based on region growing, self-organized neural nets, and fuzzy-anatomic rules. The neural nets were trained with spiral CT data from 10 patients, not used in the following evaluation on spiral CT scans from 19 patients. An experienced radiologist verified the results. The true positive and false positive areas were compared in terms to the areas marked by the radiologist. The results were compared with a standard thresholding method. Results: The neural nets achieved a higher accuracy than the thresholding method. Correlation coefficient of the fuzzy-neural nets: 0.99 (thresholding: 0.63). Mean true positive rate: 90% (thresholding: 75%), mean false positive rate: 5% (thresholding>100%). Pitfalls were caused by accessory spleens, extreme changes in the morphology (tumors, metastases, cysts), and parasplenic masses. Conclusions: Self-organizing neural nets combined with fuzzy rules are ready for use in the automatic detection and volumetry of the spleen in spiral CT scans. (orig.) [de

Linking dynamic patterns of neural activity in orbitofrontal cortex with decision making.

Science.gov (United States)

Rich, Erin L; Stoll, Frederic M; Rudebeck, Peter H

2018-04-01

Humans and animals demonstrate extraordinary flexibility in choice behavior, particularly when deciding based on subjective preferences. We evaluate options on different scales, deliberate, and often change our minds. Little is known about the neural mechanisms that underlie these dynamic aspects of decision-making, although neural activity in orbitofrontal cortex (OFC) likely plays a central role. Recent evidence from studies in macaques shows that attention modulates value responses in OFC, and that ensembles of OFC neurons dynamically signal different options during choices. When contexts change, these ensembles flexibly remap to encode the new task. Determining how these dynamic patterns emerge and relate to choices will inform models of decision-making and OFC function. Copyright © 2017 Elsevier Ltd. All rights reserved.

Application of neural networks to seismic active control

International Nuclear Information System (INIS)

Tang, Yu.

1995-01-01

An exploratory study on seismic active control using an artificial neural network (ANN) is presented in which a singledegree-of-freedom (SDF) structural system is controlled by a trained neural network. A feed-forward neural network and the backpropagation training method are used in the study. In backpropagation training, the learning rate is determined by ensuring the decrease of the error function at each training cycle. The training patterns for the neural net are generated randomly. Then, the trained ANN is used to compute the control force according to the control algorithm. The control strategy proposed herein is to apply the control force at every time step to destroy the build-up of the system response. The ground motions considered in the simulations are the N21E and N69W components of the Lake Hughes No. 12 record that occurred in the San Fernando Valley in California on February 9, 1971. Significant reduction of the structural response by one order of magnitude is observed. Also, it is shown that the proposed control strategy has the ability to reduce the peak that occurs during the first few cycles of the time history. These promising results assert the potential of applying ANNs to active structural control under seismic loads

Nets solution of flow for gases, using the Balance Pattern of Nodes and the method of linealization of equations

International Nuclear Information System (INIS)

Narvaez, Paulo Cesar

1999-01-01

The dimension of nets of distribution of gases is a complex problem, so much for the diversity of the phenomena that they are presented, like for the variation of the properties of the fluids, especially, the density for effect of the changes in the pressure along the net. This work presents a model for its simulation starting from the deduction of the general equation of flow in stable and isothermal state, its inclusion in the pattern of balance of nodes and the solution of this for the method of linealization of equations. Additionally, a summary of the empiric equations more used is made for the calculation of the fall of pressure for gases flowing in pipes and an example that it illustrates the application of the pattern and the developed method

Programming NET 35

CERN Document Server

Liberty, Jesse

2009-01-01

Bestselling author Jesse Liberty and industry expert Alex Horovitz uncover the common threads that unite the .NET 3.5 technologies, so you can benefit from the best practices and architectural patterns baked into the new Microsoft frameworks. The book offers a Grand Tour" of .NET 3.5 that describes how the principal technologies can be used together, with Ajax, to build modern n-tier and service-oriented applications. "

Bootstrapped neural nets versus regression kriging in the digital mapping of pedological attributes: the automatic and time-consuming perspectives

Science.gov (United States)

Langella, Giuliano; Basile, Angelo; Bonfante, Antonello; Manna, Piero; Terribile, Fabio

2013-04-01

Digital soil mapping procedures are widespread used to build two-dimensional continuous maps about several pedological attributes. Our work addressed a regression kriging (RK) technique and a bootstrapped artificial neural network approach in order to evaluate and compare (i) the accuracy of prediction, (ii) the susceptibility of being included in automatic engines (e.g. to constitute web processing services), and (iii) the time cost needed for calibrating models and for making predictions. Regression kriging is maybe the most widely used geostatistical technique in the digital soil mapping literature. Here we tried to apply the EBLUP regression kriging as it is deemed to be the most statistically sound RK flavor by pedometricians. An unusual multi-parametric and nonlinear machine learning approach was accomplished, called BAGAP (Bootstrap aggregating Artificial neural networks with Genetic Algorithms and Principal component regression). BAGAP combines a selected set of weighted neural nets having specified characteristics to yield an ensemble response. The purpose of applying these two particular models is to ascertain whether and how much a more cumbersome machine learning method could be much promising in making more accurate/precise predictions. Being aware of the difficulty to handle objects based on EBLUP-RK as well as BAGAP when they are embedded in environmental applications, we explore the susceptibility of them in being wrapped within Web Processing Services. Two further kinds of aspects are faced for an exhaustive evaluation and comparison: automaticity and time of calculation with/without high performance computing leverage.

The principles of artificial neural network information processing

International Nuclear Information System (INIS)

Dai, Ru-Wei

1993-01-01

In this article, the basic structure of an artificial neuron is first introduced. In addition, principles of artificial neural network as well as several important artificial neural models such as Perceptron, Back propagation model, Hopfield net, and ART model are briefly discussed and analyzed. Finally, the application of artificial neural network for Chinese Character Recognition is also given. (author)

The principles of artificial neural network information processing

International Nuclear Information System (INIS)

Dai, Ru-Wei

1993-01-01

In this article, the basic structure of an artificial neuron is first introduced. In addition, principles of artificial neural network as well as several important artificial neural models such as perception, back propagation model, Hopfield net, and ART model are briefly discussed and analyzed. Finally the application of artificial neural network for Chinese character recognition is also given. (author)

A Combination of Central Pattern Generator-based and Reflex-based Neural Networks for Dynamic, Adaptive, Robust Bipedal Locomotion

DEFF Research Database (Denmark)

Di Canio, Giuliano; Larsen, Jørgen Christian; Wörgötter, Florentin

2016-01-01

Robotic systems inspired from humans have always been lightening up the curiosity of engineers and scientists. Of many challenges, human locomotion is a very difficult one where a number of different systems needs to interact in order to generate a correct and balanced pattern. To simulate...... the interaction of these systems, implementations with reflexbased or central pattern generator (CPG)-based controllers have been tested on bipedal robot systems. In this paper we will combine the two controller types, into a controller that works with both reflex and CPG signals. We use a reflex-based neural...... network to generate basic walking patterns of a dynamic bipedal walking robot (DACBOT) and then a CPG-based neural network to ensure robust walking behavior...

Professional ASPNET Design Patterns

CERN Document Server

Millett, Scott

2010-01-01

Professional ASP.NET Design Patterns will show you how to implement design patterns in real ASP.NET applications by introducing you to the basic OOP skills needed to understand and interpret design patterns. A sample application used throughout the book is an enterprise level ASP.NET website with multi-tiered, SOA design techniques that can be applied to your future ASP.NET projects. Read about each design pattern in detail, including how to interpret the UML design, how to implement it in ASP.NET, its importance for ASP.NET development, and how it's integrated into the final project.

Deep convolutional neural networks for annotating gene expression patterns in the mouse brain.

Science.gov (United States)

Zeng, Tao; Li, Rongjian; Mukkamala, Ravi; Ye, Jieping; Ji, Shuiwang

2015-05-07

Profiling gene expression in brain structures at various spatial and temporal scales is essential to understanding how genes regulate the development of brain structures. The Allen Developing Mouse Brain Atlas provides high-resolution 3-D in situ hybridization (ISH) gene expression patterns in multiple developing stages of the mouse brain. Currently, the ISH images are annotated with anatomical terms manually. In this paper, we propose a computational approach to annotate gene expression pattern images in the mouse brain at various structural levels over the course of development. We applied deep convolutional neural network that was trained on a large set of natural images to extract features from the ISH images of developing mouse brain. As a baseline representation, we applied invariant image feature descriptors to capture local statistics from ISH images and used the bag-of-words approach to build image-level representations. Both types of features from multiple ISH image sections of the entire brain were then combined to build 3-D, brain-wide gene expression representations. We employed regularized learning methods for discriminating gene expression patterns in different brain structures. Results show that our approach of using convolutional model as feature extractors achieved superior performance in annotating gene expression patterns at multiple levels of brain structures throughout four developing ages. Overall, we achieved average AUC of 0.894 ± 0.014, as compared with 0.820 ± 0.046 yielded by the bag-of-words approach. Deep convolutional neural network model trained on natural image sets and applied to gene expression pattern annotation tasks yielded superior performance, demonstrating its transfer learning property is applicable to such biological image sets.

An Ultrasonic Pattern Recognition Approach to Welding Defect Classification

International Nuclear Information System (INIS)

Song, Sung Jin

1995-01-01

Classification of flaws in weldments from their ultrasonic scattering signals is very important in quantitative nondestructive evaluation. This problem is ideally suited to a modern ultrasonic pattern recognition technique. Here brief discussion on systematic approach to this methodology is presented including ultrasonic feature extraction, feature selection and classification. A stronger emphasis is placed on probabilistic neural networks as efficient classifiers for many practical classification problems. In an example probabilistic neural networks are applied to classify flaws in weldments into 3 classes such as cracks, porosity and slag inclusions. Probabilistic nets are shown to be able to exhibit high performance of other classifiers without any training time overhead. In addition, forward selection scheme for sensitive features is addressed to enhance network performance

Fuzzy logic and neural networks in artificial intelligence and pattern recognition

Science.gov (United States)

Sanchez, Elie

1991-10-01

With the use of fuzzy logic techniques, neural computing can be integrated in symbolic reasoning to solve complex real world problems. In fact, artificial neural networks, expert systems, and fuzzy logic systems, in the context of approximate reasoning, share common features and techniques. A model of Fuzzy Connectionist Expert System is introduced, in which an artificial neural network is designed to construct the knowledge base of an expert system from, training examples (this model can also be used for specifications of rules in fuzzy logic control). Two types of weights are associated with the synaptic connections in an AND-OR structure: primary linguistic weights, interpreted as labels of fuzzy sets, and secondary numerical weights. Cell activation is computed through min-max fuzzy equations of the weights. Learning consists in finding the (numerical) weights and the network topology. This feedforward network is described and first illustrated in a biomedical application (medical diagnosis assistance from inflammatory-syndromes/proteins profiles). Then, it is shown how this methodology can be utilized for handwritten pattern recognition (characters play the role of diagnoses): in a fuzzy neuron describing a number for example, the linguistic weights represent fuzzy sets on cross-detecting lines and the numerical weights reflect the importance (or weakness) of connections between cross-detecting lines and characters.

Neural nets for massively parallel optimization

Science.gov (United States)

Dixon, Laurence C. W.; Mills, David

1992-07-01

To apply massively parallel processing systems to the solution of large scale optimization problems it is desirable to be able to evaluate any function f(z), z (epsilon) Rn in a parallel manner. The theorem of Cybenko, Hecht Nielsen, Hornik, Stinchcombe and White, and Funahasi shows that this can be achieved by a neural network with one hidden layer. In this paper we address the problem of the number of nodes required in the layer to achieve a given accuracy in the function and gradient values at all points within a given n dimensional interval. The type of activation function needed to obtain nonsingular Hessian matrices is described and a strategy for obtaining accurate minimal networks presented.

Control of 12-Cylinder Camless Engine with Neural Networks

OpenAIRE

Ashhab Moh’d Sami

2017-01-01

The 12-cyliner camless engine breathing process is modeled with artificial neural networks (ANN’s). The inputs to the net are the intake valve lift (IVL) and intake valve closing timing (IVC) whereas the output of the net is the cylinder air charge (CAC). The ANN is trained with data collected from an engine simulation model which is based on thermodynamics principles and calibrated against real engine data. A method for adapting single-output feed-forward neural networks is proposed and appl...

Mechanisms and Neural Basis of Object and Pattern Recognition: A Study with Chess Experts

Science.gov (United States)

Bilalic, Merim; Langner, Robert; Erb, Michael; Grodd, Wolfgang

2010-01-01

Comparing experts with novices offers unique insights into the functioning of cognition, based on the maximization of individual differences. Here we used this expertise approach to disentangle the mechanisms and neural basis behind two processes that contribute to everyday expertise: object and pattern recognition. We compared chess experts and…

Modularity and Sparsity: Evolution of Neural Net Controllers in Physically Embodied Robots

Directory of Open Access Journals (Sweden)

Nicholas Livingston

2016-12-01

Full Text Available While modularity is thought to be central for the evolution of complexity and evolvability, it remains unclear how systems boot-strap themselves into modularity from random or fully integrated starting conditions. Clune et al. (2013 suggested that a positive correlation between sparsity and modularity is the prime cause of this transition. We sought to test the generality of this modularity-sparsity hypothesis by testing it for the first time in physically embodied robots. A population of ten Tadros — autonomous, surface-swimming robots propelled by a flapping tail — was used. Individuals varied only in the structure of their neural net control, a 2 x 6 x 2 network with recurrence in the hidden layer. Each of the 60 possible connections was coded in the genome, and could achieve one of three states: -1, 0, 1. Inputs were two light-dependent resistors and outputs were two motor control variables to the flapping tail, one for the frequency of the flapping and the other for the turning offset. Each Tadro was tested separately in a circular tank lit by a single overhead light source. Fitness was the amount of light gathered by a vertically oriented sensor that was disconnected from the controller net. Reproduction was asexual, with the top performer cloned and then all individuals entered into a roulette wheel selection process, with genomes mutated to create the offspring. The starting population of networks was randomly generated. Over ten generations, the population’s mean fitness increased two-fold. This evolution occurred in spite of an unintentional integer overflow problem in recurrent nodes in the hidden layer that caused outputs to oscillate. Our investigation of the oscillatory behavior showed that the mutual information of inputs and outputs was sufficient for the reactive behaviors observed. While we had predicted that both modularity and sparsity would follow the same trend as fitness, neither did so. Instead, selection gradients

Results from a MA16-based neural trigger in an experiment looking for beauty

International Nuclear Information System (INIS)

Baldanza, C.; Beichter, J.; Bisi, F.; Bruels, N.; Bruschini, C.; Cotta-Ramusino, A.; D'Antone, I.; Malferrari, L.; Mazzanti, P.; Musico, P.; Novelli, P.; Odorici, F.; Odorico, R.; Passaseo, M.; Zuffa, M.

1996-01-01

Results from a neural-network trigger based on the digital MA16 chip of Siemens are reported. The neural trigger has been applied to data from the WA92 experiment, looking for beauty particles, which have been collected during a run in which a neural trigger module based on Intel's analog neural chip ETANN operated, as already reported. The MA16 board hosting the chip has a 16-bit I/O precision and a 53-bit precision for internal calculations. It operated at 50 MHz, yielding a response time for a 16 input-variable net of 3 μs for a Fisher discriminant (1-layer net) and of 6 μs for a 2-layer net. Results are compared with those previously obtained with the ETANN trigger. (orig.)

Results from a MA16-based neural trigger in an experiment looking for beauty

Energy Technology Data Exchange (ETDEWEB)

Baldanza, C. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Beichter, J. [Siemens AG, ZFE T ME2, 81730 Munich (Germany); Bisi, F. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Bruels, N. [Siemens AG, ZFE T ME2, 81730 Munich (Germany); Bruschini, C. [INFN/Genoa, Via Dodecaneso 33, 16146 Genoa (Italy); Cotta-Ramusino, A. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); D`Antone, I. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Malferrari, L. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Mazzanti, P. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Musico, P. [INFN/Genoa, Via Dodecaneso 33, 16146 Genoa (Italy); Novelli, P. [INFN/Genoa, Via Dodecaneso 33, 16146 Genoa (Italy); Odorici, F. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Odorico, R. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Passaseo, M. [CERN, 1211 Geneva 23 (Switzerland); Zuffa, M. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy)

1996-07-11

Results from a neural-network trigger based on the digital MA16 chip of Siemens are reported. The neural trigger has been applied to data from the WA92 experiment, looking for beauty particles, which have been collected during a run in which a neural trigger module based on Intel`s analog neural chip ETANN operated, as already reported. The MA16 board hosting the chip has a 16-bit I/O precision and a 53-bit precision for internal calculations. It operated at 50 MHz, yielding a response time for a 16 input-variable net of 3 {mu}s for a Fisher discriminant (1-layer net) and of 6 {mu}s for a 2-layer net. Results are compared with those previously obtained with the ETANN trigger. (orig.).

A Neural Network-Based Interval Pattern Matcher

Directory of Open Access Journals (Sweden)

Jing Lu

2015-07-01

Full Text Available One of the most important roles in the machine learning area is to classify, and neural networks are very important classifiers. However, traditional neural networks cannot identify intervals, let alone classify them. To improve their identification ability, we propose a neural network-based interval matcher in our paper. After summarizing the theoretical construction of the model, we take a simple and a practical weather forecasting experiment, which show that the recognizer accuracy reaches 100% and that is promising.

Behavioral and Physiological Neural Network Analyses: A Common Pathway toward Pattern Recognition and Prediction

Science.gov (United States)

Ninness, Chris; Lauter, Judy L.; Coffee, Michael; Clary, Logan; Kelly, Elizabeth; Rumph, Marilyn; Rumph, Robin; Kyle, Betty; Ninness, Sharon K.

2012-01-01

Using 3 diversified datasets, we explored the pattern-recognition ability of the Self-Organizing Map (SOM) artificial neural network as applied to diversified nonlinear data distributions in the areas of behavioral and physiological research. Experiment 1 employed a dataset obtained from the UCI Machine Learning Repository. Data for this study…

Learning of N-layers neural network

Directory of Open Access Journals (Sweden)

Vladimír Konečný

2005-01-01

Full Text Available In the last decade we can observe increasing number of applications based on the Artificial Intelligence that are designed to solve problems from different areas of human activity. The reason why there is so much interest in these technologies is that the classical way of solutions does not exist or these technologies are not suitable because of their robustness. They are often used in applications like Business Intelligence that enable to obtain useful information for high-quality decision-making and to increase competitive advantage.One of the most widespread tools for the Artificial Intelligence are the artificial neural networks. Their high advantage is relative simplicity and the possibility of self-learning based on set of pattern situations.For the learning phase is the most commonly used algorithm back-propagation error (BPE. The base of BPE is the method minima of error function representing the sum of squared errors on outputs of neural net, for all patterns of the learning set. However, while performing BPE and in the first usage, we can find out that it is necessary to complete the handling of the learning factor by suitable method. The stability of the learning process and the rate of convergence depend on the selected method. In the article there are derived two functions: one function for the learning process management by the relative great error function value and the second function when the value of error function approximates to global minimum.The aim of the article is to introduce the BPE algorithm in compact matrix form for multilayer neural networks, the derivation of the learning factor handling method and the presentation of the results.

Reduction of the dimension of neural network models in problems of pattern recognition and forecasting

Science.gov (United States)

Nasertdinova, A. D.; Bochkarev, V. V.

2017-11-01

Deep neural networks with a large number of parameters are a powerful tool for solving problems of pattern recognition, prediction and classification. Nevertheless, overfitting remains a serious problem in the use of such networks. A method of solving the problem of overfitting is proposed in this article. This method is based on reducing the number of independent parameters of a neural network model using the principal component analysis, and can be implemented using existing libraries of neural computing. The algorithm was tested on the problem of recognition of handwritten symbols from the MNIST database, as well as on the task of predicting time series (rows of the average monthly number of sunspots and series of the Lorentz system were used). It is shown that the application of the principal component analysis enables reducing the number of parameters of the neural network model when the results are good. The average error rate for the recognition of handwritten figures from the MNIST database was 1.12% (which is comparable to the results obtained using the "Deep training" methods), while the number of parameters of the neural network can be reduced to 130 times.

Organization of anti-phase synchronization pattern in neural networks: what are the key factors?

Directory of Open Access Journals (Sweden)

Dong eLi

2011-12-01

Full Text Available Anti-phase oscillation has been widely observed in cortical neuralnetwork. Elucidating the mechanism underlying the organization ofanti-phase pattern is of significance for better understanding morecomplicated pattern formations in brain networks. In dynamicalsystems theory, the organization of anti-phase oscillation patternhas usually been considered to relate to time-delay in coupling.This is consistent to conduction delays in real neural networks inthe brain due to finite propagation velocity of action potentials.However, other structural factors in cortical neural network, suchas modular organization (connection density and the coupling types(excitatory or inhibitory, could also play an important role. Inthis work, we investigate the anti-phase oscillation patternorganized on a two-module network of either neuronal cell model orneural mass model, and analyze the impact of the conduction delaytimes, the connection densities, and coupling types. Our resultsshow that delay times and coupling types can play key roles in thisorganization. The connection densities may have an influence on thestability if an anti-phase pattern exists due to the other factors.Furthermore, we show that anti-phase synchronization of slowoscillations can be achieved with small delay times if there isinteraction between slow and fast oscillations. These results aresignificant for further understanding more realistic spatiotemporaldynamics of cortico-cortical communications.

Creative-Dynamics Approach To Neural Intelligence

Science.gov (United States)

Zak, Michail A.

1992-01-01

Paper discusses approach to mathematical modeling of artificial neural networks exhibiting complicated behaviors reminiscent of creativity and intelligence of biological neural networks. Neural network treated as non-Lipschitzian dynamical system - as described in "Non-Lipschitzian Dynamics For Modeling Neural Networks" (NPO-17814). System serves as tool for modeling of temporal-pattern memories and recognition of complicated spatial patterns.

ReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation

OpenAIRE

Visin, Francesco; Ciccone, Marco; Romero, Adriana; Kastner, Kyle; Cho, Kyunghyun; Bengio, Yoshua; Matteucci, Matteo; Courville, Aaron

2015-01-01

We propose a structured prediction architecture, which exploits the local generic features extracted by Convolutional Neural Networks and the capacity of Recurrent Neural Networks (RNN) to retrieve distant dependencies. The proposed architecture, called ReSeg, is based on the recently introduced ReNet model for image classification. We modify and extend it to perform the more challenging task of semantic segmentation. Each ReNet layer is composed of four RNN that sweep the image horizontally ...

Sequentially firing neurons confer flexible timing in neural pattern generators

International Nuclear Information System (INIS)

Urban, Alexander; Ermentrout, Bard

2011-01-01

Neuronal networks exhibit a variety of complex spatiotemporal patterns that include sequential activity, synchrony, and wavelike dynamics. Inhibition is the primary means through which such patterns are implemented. This behavior is dependent on both the intrinsic dynamics of the individual neurons as well as the connectivity patterns. Many neural circuits consist of networks of smaller subcircuits (motifs) that are coupled together to form the larger system. In this paper, we consider a particularly simple motif, comprising purely inhibitory interactions, which generates sequential periodic dynamics. We first describe the dynamics of the single motif both for general balanced coupling (all cells receive the same number and strength of inputs) and then for a specific class of balanced networks: circulant systems. We couple these motifs together to form larger networks. We use the theory of weak coupling to derive phase models which, themselves, have a certain structure and symmetry. We show that this structure endows the coupled system with the ability to produce arbitrary timing relationships between symmetrically coupled motifs and that the phase relationships are robust over a wide range of frequencies. The theory is applicable to many other systems in biology and physics.

Stability Switches, Hopf Bifurcations, and Spatio-temporal Patterns in a Delayed Neural Model with Bidirectional Coupling

Science.gov (United States)

Song, Yongli; Zhang, Tonghua; Tadé, Moses O.

2009-12-01

The dynamical behavior of a delayed neural network with bi-directional coupling is investigated by taking the delay as the bifurcating parameter. Some parameter regions are given for conditional/absolute stability and Hopf bifurcations by using the theory of functional differential equations. As the propagation time delay in the coupling varies, stability switches for the trivial solution are found. Conditions ensuring the stability and direction of the Hopf bifurcation are determined by applying the normal form theory and the center manifold theorem. We also discuss the spatio-temporal patterns of bifurcating periodic oscillations by using the symmetric bifurcation theory of delay differential equations combined with representation theory of Lie groups. In particular, we obtain that the spatio-temporal patterns of bifurcating periodic oscillations will alternate according to the change of the propagation time delay in the coupling, i.e., different ranges of delays correspond to different patterns of neural activities. Numerical simulations are given to illustrate the obtained results and show the existence of bursts in some interval of the time for large enough delay.

Neural pattern similarity underlies the mnemonic advantages for living words.

Science.gov (United States)

Xiao, Xiaoqian; Dong, Qi; Chen, Chuansheng; Xue, Gui

2016-06-01

It has been consistently shown that words representing living things are better remembered than words representing nonliving things, yet the underlying cognitive and neural mechanisms have not been clearly elucidated. The present study used both univariate and multivariate pattern analyses to examine the hypotheses that living words are better remembered because (1) they draw more attention and/or (2) they share more overlapping semantic features. Subjects were asked to study a list of living and nonliving words during a semantic judgment task. An unexpected recognition test was administered 30 min later. We found that subjects recognized significantly more living words than nonliving words. Results supported the overlapping semantic feature hypothesis by showing that (a) semantic ratings showed greater semantic similarity for living words than for nonliving words, (b) there was also significantly greater neural global pattern similarity (nGPS) for living words than for nonliving words in the posterior portion of left parahippocampus (LpPHG), (c) the nGPS in the LpPHG reflected the rated semantic similarity, and also mediated the memory differences between two semantic categories, and (d) greater univariate activation was found for living words than for nonliving words in the left hippocampus (LHIP), which mediated the better memory performance for living words and might reflect greater semantic context binding. In contrast, although living words were processed faster and elicited a stronger activity in the dorsal attention network, these differences did not mediate the animacy effect in memory. Taken together, our results provide strong support to the overlapping semantic features hypothesis, and emphasize the important role of semantic organization in episodic memory encoding. Copyright © 2016 Elsevier Ltd. All rights reserved.

Neural electrical activity and neural network growth.

Science.gov (United States)

Gafarov, F M

2018-05-01

The development of central and peripheral neural system depends in part on the emergence of the correct functional connectivity in its input and output pathways. Now it is generally accepted that molecular factors guide neurons to establish a primary scaffold that undergoes activity-dependent refinement for building a fully functional circuit. However, a number of experimental results obtained recently shows that the neuronal electrical activity plays an important role in the establishing of initial interneuronal connections. Nevertheless, these processes are rather difficult to study experimentally, due to the absence of theoretical description and quantitative parameters for estimation of the neuronal activity influence on growth in neural networks. In this work we propose a general framework for a theoretical description of the activity-dependent neural network growth. The theoretical description incorporates a closed-loop growth model in which the neural activity can affect neurite outgrowth, which in turn can affect neural activity. We carried out the detailed quantitative analysis of spatiotemporal activity patterns and studied the relationship between individual cells and the network as a whole to explore the relationship between developing connectivity and activity patterns. The model, developed in this work will allow us to develop new experimental techniques for studying and quantifying the influence of the neuronal activity on growth processes in neural networks and may lead to a novel techniques for constructing large-scale neural networks by self-organization. Copyright © 2018 Elsevier Ltd. All rights reserved.

Neural Conversion and Patterning of Human Pluripotent Stem Cells: A Developmental Perspective.

Science.gov (United States)

Zirra, Alexandra; Wiethoff, Sarah; Patani, Rickie

2016-01-01

Since the reprogramming of adult human terminally differentiated somatic cells into induced pluripotent stem cells (hiPSCs) became a reality in 2007, only eight years have passed. Yet over this relatively short period, myriad experiments have revolutionized previous stem cell dogmata. The tremendous promise of hiPSC technology for regenerative medicine has fuelled rising expectations from both the public and scientific communities alike. In order to effectively harness hiPSCs to uncover fundamental mechanisms of disease, it is imperative to first understand the developmental neurobiology underpinning their lineage restriction choices in order to predictably manipulate cell fate to desired derivatives. Significant progress in developmental biology provides an invaluable resource for rationalising directed differentiation of hiPSCs to cellular derivatives of the nervous system. In this paper we begin by reviewing core developmental concepts underlying neural induction in order to provide context for how such insights have guided reductionist in vitro models of neural conversion from hiPSCs. We then discuss early factors relevant in neural patterning, again drawing upon crucial knowledge gained from developmental neurobiological studies. We conclude by discussing open questions relating to these concepts and how their resolution might serve to strengthen the promise of pluripotent stem cells in regenerative medicine.

Neural Conversion and Patterning of Human Pluripotent Stem Cells: A Developmental Perspective

Directory of Open Access Journals (Sweden)

Alexandra Zirra

2016-01-01

Full Text Available Since the reprogramming of adult human terminally differentiated somatic cells into induced pluripotent stem cells (hiPSCs became a reality in 2007, only eight years have passed. Yet over this relatively short period, myriad experiments have revolutionized previous stem cell dogmata. The tremendous promise of hiPSC technology for regenerative medicine has fuelled rising expectations from both the public and scientific communities alike. In order to effectively harness hiPSCs to uncover fundamental mechanisms of disease, it is imperative to first understand the developmental neurobiology underpinning their lineage restriction choices in order to predictably manipulate cell fate to desired derivatives. Significant progress in developmental biology provides an invaluable resource for rationalising directed differentiation of hiPSCs to cellular derivatives of the nervous system. In this paper we begin by reviewing core developmental concepts underlying neural induction in order to provide context for how such insights have guided reductionist in vitro models of neural conversion from hiPSCs. We then discuss early factors relevant in neural patterning, again drawing upon crucial knowledge gained from developmental neurobiological studies. We conclude by discussing open questions relating to these concepts and how their resolution might serve to strengthen the promise of pluripotent stem cells in regenerative medicine.

Deep learning with convolutional neural networks for EEG decoding and visualization.

Science.gov (United States)

Schirrmeister, Robin Tibor; Springenberg, Jost Tobias; Fiederer, Lukas Dominique Josef; Glasstetter, Martin; Eggensperger, Katharina; Tangermann, Michael; Hutter, Frank; Burgard, Wolfram; Ball, Tonio

2017-11-01

Deep learning with convolutional neural networks (deep ConvNets) has revolutionized computer vision through end-to-end learning, that is, learning from the raw data. There is increasing interest in using deep ConvNets for end-to-end EEG analysis, but a better understanding of how to design and train ConvNets for end-to-end EEG decoding and how to visualize the informative EEG features the ConvNets learn is still needed. Here, we studied deep ConvNets with a range of different architectures, designed for decoding imagined or executed tasks from raw EEG. Our results show that recent advances from the machine learning field, including batch normalization and exponential linear units, together with a cropped training strategy, boosted the deep ConvNets decoding performance, reaching at least as good performance as the widely used filter bank common spatial patterns (FBCSP) algorithm (mean decoding accuracies 82.1% FBCSP, 84.0% deep ConvNets). While FBCSP is designed to use spectral power modulations, the features used by ConvNets are not fixed a priori. Our novel methods for visualizing the learned features demonstrated that ConvNets indeed learned to use spectral power modulations in the alpha, beta, and high gamma frequencies, and proved useful for spatially mapping the learned features by revealing the topography of the causal contributions of features in different frequency bands to the decoding decision. Our study thus shows how to design and train ConvNets to decode task-related information from the raw EEG without handcrafted features and highlights the potential of deep ConvNets combined with advanced visualization techniques for EEG-based brain mapping. Hum Brain Mapp 38:5391-5420, 2017. © 2017 Wiley Periodicals, Inc. © 2017 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Deep learning with convolutional neural networks for EEG decoding and visualization

Science.gov (United States)

Springenberg, Jost Tobias; Fiederer, Lukas Dominique Josef; Glasstetter, Martin; Eggensperger, Katharina; Tangermann, Michael; Hutter, Frank; Burgard, Wolfram; Ball, Tonio

2017-01-01

Abstract Deep learning with convolutional neural networks (deep ConvNets) has revolutionized computer vision through end‐to‐end learning, that is, learning from the raw data. There is increasing interest in using deep ConvNets for end‐to‐end EEG analysis, but a better understanding of how to design and train ConvNets for end‐to‐end EEG decoding and how to visualize the informative EEG features the ConvNets learn is still needed. Here, we studied deep ConvNets with a range of different architectures, designed for decoding imagined or executed tasks from raw EEG. Our results show that recent advances from the machine learning field, including batch normalization and exponential linear units, together with a cropped training strategy, boosted the deep ConvNets decoding performance, reaching at least as good performance as the widely used filter bank common spatial patterns (FBCSP) algorithm (mean decoding accuracies 82.1% FBCSP, 84.0% deep ConvNets). While FBCSP is designed to use spectral power modulations, the features used by ConvNets are not fixed a priori. Our novel methods for visualizing the learned features demonstrated that ConvNets indeed learned to use spectral power modulations in the alpha, beta, and high gamma frequencies, and proved useful for spatially mapping the learned features by revealing the topography of the causal contributions of features in different frequency bands to the decoding decision. Our study thus shows how to design and train ConvNets to decode task‐related information from the raw EEG without handcrafted features and highlights the potential of deep ConvNets combined with advanced visualization techniques for EEG‐based brain mapping. Hum Brain Mapp 38:5391–5420, 2017. © 2017 Wiley Periodicals, Inc. PMID:28782865

Enteric neural crest cells regulate vertebrate stomach patterning and differentiation.

Science.gov (United States)

Faure, Sandrine; McKey, Jennifer; Sagnol, Sébastien; de Santa Barbara, Pascal

2015-01-15

In vertebrates, the digestive tract develops from a uniform structure where reciprocal epithelial-mesenchymal interactions pattern this complex organ into regions with specific morphologies and functions. Concomitant with these early patterning events, the primitive GI tract is colonized by the vagal enteric neural crest cells (vENCCs), a population of cells that will give rise to the enteric nervous system (ENS), the intrinsic innervation of the GI tract. The influence of vENCCs on early patterning and differentiation of the GI tract has never been evaluated. In this study, we report that a crucial number of vENCCs is required for proper chick stomach development, patterning and differentiation. We show that reducing the number of vENCCs by performing vENCC ablations induces sustained activation of the BMP and Notch pathways in the stomach mesenchyme and impairs smooth muscle development. A reduction in vENCCs also leads to the transdifferentiation of the stomach into a stomach-intestinal mixed phenotype. In addition, sustained Notch signaling activity in the stomach mesenchyme phenocopies the defects observed in vENCC-ablated stomachs, indicating that inhibition of the Notch signaling pathway is essential for stomach patterning and differentiation. Finally, we report that a crucial number of vENCCs is also required for maintenance of stomach identity and differentiation through inhibition of the Notch signaling pathway. Altogether, our data reveal that, through the regulation of mesenchyme identity, vENCCs act as a new mediator in the mesenchymal-epithelial interactions that control stomach development. © 2015. Published by The Company of Biologists Ltd.

Bioprinting for Neural Tissue Engineering.

Science.gov (United States)

Knowlton, Stephanie; Anand, Shivesh; Shah, Twisha; Tasoglu, Savas

2018-01-01

Bioprinting is a method by which a cell-encapsulating bioink is patterned to create complex tissue architectures. Given the potential impact of this technology on neural research, we review the current state-of-the-art approaches for bioprinting neural tissues. While 2D neural cultures are ubiquitous for studying neural cells, 3D cultures can more accurately replicate the microenvironment of neural tissues. By bioprinting neuronal constructs, one can precisely control the microenvironment by specifically formulating the bioink for neural tissues, and by spatially patterning cell types and scaffold properties in three dimensions. We review a range of bioprinted neural tissue models and discuss how they can be used to observe how neurons behave, understand disease processes, develop new therapies and, ultimately, design replacement tissues. Copyright © 2017 Elsevier Ltd. All rights reserved.

Lim homeobox genes in the Ctenophore Mnemiopsis leidyi: the evolution of neural cell type specification

Directory of Open Access Journals (Sweden)

Simmons David K

2012-01-01

Full Text Available Abstract Background Nervous systems are thought to be important to the evolutionary success and diversification of metazoans, yet little is known about the origin of simple nervous systems at the base of the animal tree. Recent data suggest that ctenophores, a group of macroscopic pelagic marine invertebrates, are the most ancient group of animals that possess a definitive nervous system consisting of a distributed nerve net and an apical statocyst. This study reports on details of the evolution of the neural cell type specifying transcription factor family of LIM homeobox containing genes (Lhx, which have highly conserved functions in neural specification in bilaterian animals. Results Using next generation sequencing, the first draft of the genome of the ctenophore Mnemiopsis leidyi has been generated. The Lhx genes in all animals are represented by seven subfamilies (Lhx1/5, Lhx3/4, Lmx, Islet, Lhx2/9, Lhx6/8, and LMO of which four were found to be represented in the ctenophore lineage (Lhx1/5, Lhx3/4, Lmx, and Islet. Interestingly, the ctenophore Lhx gene complement is more similar to the sponge complement (sponges do not possess neurons than to either the cnidarian-bilaterian or placozoan Lhx complements. Using whole mount in situ hybridization, the Lhx gene expression patterns were examined and found to be expressed around the blastopore and in cells that give rise to the apical organ and putative neural sensory cells. Conclusion This research gives us a first look at neural cell type specification in the ctenophore M. leidyi. Within M. leidyi, Lhx genes are expressed in overlapping domains within proposed neural cellular and sensory cell territories. These data suggest that Lhx genes likely played a conserved role in the patterning of sensory cells in the ancestor of sponges and ctenophores, and may provide a link to the expression of Lhx orthologs in sponge larval photoreceptive cells. Lhx genes were later co-opted into patterning more

The Neural Border: Induction, Specification and Maturation of the territory that generates Neural Crest cells.

Science.gov (United States)

Pla, Patrick; Monsoro-Burq, Anne H

2018-05-28

The neural crest is induced at the edge between the neural plate and the nonneural ectoderm, in an area called the neural (plate) border, during gastrulation and neurulation. In recent years, many studies have explored how this domain is patterned, and how the neural crest is induced within this territory, that also participates to the prospective dorsal neural tube, the dorsalmost nonneural ectoderm, as well as placode derivatives in the anterior area. This review highlights the tissue interactions, the cell-cell signaling and the molecular mechanisms involved in this dynamic spatiotemporal patterning, resulting in the induction of the premigratory neural crest. Collectively, these studies allow building a complex neural border and early neural crest gene regulatory network, mostly composed by transcriptional regulations but also, more recently, including novel signaling interactions. Copyright © 2018. Published by Elsevier Inc.

Differential theory of learning for efficient neural network pattern recognition

Science.gov (United States)

Hampshire, John B., II; Vijaya Kumar, Bhagavatula

1993-09-01

We describe a new theory of differential learning by which a broad family of pattern classifiers (including many well-known neural network paradigms) can learn stochastic concepts efficiently. We describe the relationship between a classifier's ability to generate well to unseen test examples and the efficiency of the strategy by which it learns. We list a series of proofs that differential learning is efficient in its information and computational resource requirements, whereas traditional probabilistic learning strategies are not. The proofs are illustrated by a simple example that lends itself to closed-form analysis. We conclude with an optical character recognition task for which three different types of differentially generated classifiers generalize significantly better than their probabilistically generated counterparts.

Human brain basis of musical rhythm perception: common and distinct neural substrates for meter, tempo, and pattern.

Science.gov (United States)

Thaut, Michael H; Trimarchi, Pietro Davide; Parsons, Lawrence M

2014-06-17

Rhythm as the time structure of music is composed of distinct temporal components such as pattern, meter, and tempo. Each feature requires different computational processes: meter involves representing repeating cycles of strong and weak beats; pattern involves representing intervals at each local time point which vary in length across segments and are linked hierarchically; and tempo requires representing frequency rates of underlying pulse structures. We explored whether distinct rhythmic elements engage different neural mechanisms by recording brain activity of adult musicians and non-musicians with positron emission tomography (PET) as they made covert same-different discriminations of (a) pairs of rhythmic, monotonic tone sequences representing changes in pattern, tempo, and meter, and (b) pairs of isochronous melodies. Common to pattern, meter, and tempo tasks were focal activities in right, or bilateral, areas of frontal, cingulate, parietal, prefrontal, temporal, and cerebellar cortices. Meter processing alone activated areas in right prefrontal and inferior frontal cortex associated with more cognitive and abstract representations. Pattern processing alone recruited right cortical areas involved in different kinds of auditory processing. Tempo processing alone engaged mechanisms subserving somatosensory and premotor information (e.g., posterior insula, postcentral gyrus). Melody produced activity different from the rhythm conditions (e.g., right anterior insula and various cerebellar areas). These exploratory findings suggest the outlines of some distinct neural components underlying the components of rhythmic structure.

The Elementary Nature of Purposive Behavior: Evolving Minimal Neural Structures that Display Intrinsic Intentionality

Directory of Open Access Journals (Sweden)

John S. Watson

2005-01-01

Full Text Available A study of the evolution of agency in artificial life was designed to access the potential emergence of purposiveness and intentionality as these attributes of behavior have been defined in psychology and philosophy. The study involved Darwinian evolution of mobile neural nets (autonomous agents in terms of their adaptive weight patterning and structure (number of sensory, hidden, and memory units that controlled movement. An agent was embedded in a 10 × 10 toroidal matrix along with “containers” that held benefit or harm if entered. Sensory exposure to content of a container was only briefly available at a distance so that adaptive response to a nearby container required use of relevant memory. The best 20% of each generation of agents, based on net benefit consumed during limited lifetime, were selected to parent the following generation. Purposiveness emerged for all selected agents by 300 generations. By 4000 generations, 90% passed a test of purposive intentionality based on Piaget's criteria for Stage IV object permanence in human infants. An additional test of these agents confirmed that the behavior of 67% of them was consistent with the philosophical criterion of intention being “about” the container's contents. Given that the evolved neural structure of more than half of the successful agents had only 1 hidden and 1 memory node, it is argued that, contrary to common assumption, purposive and intentional aspects of adaptive behavior require an evolution of minimal complexity of supportive neural structure.

A neutron spectrum unfolding computer code based on artificial neural networks

International Nuclear Information System (INIS)

Ortiz-Rodríguez, J.M.; Reyes Alfaro, A.; Reyes Haro, A.; Cervantes Viramontes, J.M.; Vega-Carrillo, H.R.

2014-01-01

The Bonner Spheres Spectrometer consists of a thermal neutron sensor placed at the center of a number of moderating polyethylene spheres of different diameters. From the measured readings, information can be derived about the spectrum of the neutron field where measurements were made. Disadvantages of the Bonner system are the weight associated with each sphere and the need to sequentially irradiate the spheres, requiring long exposure periods. Provided a well-established response matrix and adequate irradiation conditions, the most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. The drawbacks associated with traditional unfolding procedures have motivated the need of complementary approaches. Novel methods based on Artificial Intelligence, mainly Artificial Neural Networks, have been widely investigated. In this work, a neutron spectrum unfolding code based on neural nets technology is presented. This code is called Neutron Spectrometry and Dosimetry with Artificial Neural networks unfolding code that was designed in a graphical interface. The core of the code is an embedded neural network architecture previously optimized using the robust design of artificial neural networks methodology. The main features of the code are: easy to use, friendly and intuitive to the user. This code was designed for a Bonner Sphere System based on a 6 LiI(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. The main feature of the code is that as entrance data, for unfolding the neutron spectrum, only seven rate counts measured with seven Bonner spheres are required; simultaneously the code calculates 15 dosimetric quantities as well as the total flux for radiation protection purposes. This code generates a full report with all information of the unfolding

Neural code alterations and abnormal time patterns in Parkinson’s disease

Science.gov (United States)

Andres, Daniela Sabrina; Cerquetti, Daniel; Merello, Marcelo

2015-04-01

Objective. The neural code used by the basal ganglia is a current question in neuroscience, relevant for the understanding of the pathophysiology of Parkinson’s disease. While a rate code is known to participate in the communication between the basal ganglia and the motor thalamus/cortex, different lines of evidence have also favored the presence of complex time patterns in the discharge of the basal ganglia. To gain insight into the way the basal ganglia code information, we studied the activity of the globus pallidus pars interna (GPi), an output node of the circuit. Approach. We implemented the 6-hydroxydopamine model of Parkinsonism in Sprague-Dawley rats, and recorded the spontaneous discharge of single GPi neurons, in head-restrained conditions at full alertness. Analyzing the temporal structure function, we looked for characteristic scales in the neuronal discharge of the GPi. Main results. At a low-scale, we observed the presence of dynamic processes, which allow the transmission of time patterns. Conversely, at a middle-scale, stochastic processes force the use of a rate code. Regarding the time patterns transmitted, we measured the word length and found that it is increased in Parkinson’s disease. Furthermore, it showed a positive correlation with the frequency of discharge, indicating that an exacerbation of this abnormal time pattern length can be expected, as the dopamine depletion progresses. Significance. We conclude that a rate code and a time pattern code can co-exist in the basal ganglia at different temporal scales. However, their normal balance is progressively altered and replaced by pathological time patterns in Parkinson’s disease.

Neural network error correction for solving coupled ordinary differential equations

Science.gov (United States)

Shelton, R. O.; Darsey, J. A.; Sumpter, B. G.; Noid, D. W.

1992-01-01

A neural network is presented to learn errors generated by a numerical algorithm for solving coupled nonlinear differential equations. The method is based on using a neural network to correctly learn the error generated by, for example, Runge-Kutta on a model molecular dynamics (MD) problem. The neural network programs used in this study were developed by NASA. Comparisons are made for training the neural network using backpropagation and a new method which was found to converge with fewer iterations. The neural net programs, the MD model and the calculations are discussed.

Mobile phone use patterns and preferences in safety net office-based buprenorphine patients.

Science.gov (United States)

Tofighi, Babak; Grossman, Ellie; Buirkle, Emily; McNeely, Jennifer; Gourevitch, Marc; Lee, Joshua D

2015-01-01

Integrating mobile phone technologies in addiction treatment is of increasing importance and may optimize patient engagement with their care and enhance the delivery of existing treatment strategies. Few studies have evaluated mobile phone and text message (TM) use patterns in persons enrolled in addiction treatment, and none have assessed the use in safety net, office-based buprenorphine practices. A 28-item, quantitative and qualitative semistructured survey was administered to opiate-dependent adults in an urban, publicly funded, office-based buprenorphine program. Survey domains included demographic characteristics, mobile phone and TM use patterns, and preferences pertaining to their recovery. Surveyors approached 73 of the 155 eligible subjects (47%); 71 respondents completed the survey. Nearly all participants reported mobile phone ownership (93%) and TM use (93%), and most reported "very much" or "somewhat" comfort sending TM (79%). Text message contact with 12-step group sponsors, friends, family members, and counselors was also described (32%). Nearly all preferred having their providers' mobile phone number (94%), and alerting the clinic via TM in the event of a potential relapse to receive both supportive TM and a phone call from their buprenorphine provider was also well received (62%). Mobile phone and TM use patterns and preferences among this sample of office-based buprenorphine participants highlight the potential of adopting patient-centered mobile phone-based interventions in this treatment setting.

The Challenges of Neural Mind-reading Paradigms

Directory of Open Access Journals (Sweden)

Oscar eVilarroya

2013-06-01

Full Text Available Neural mind-reading studies, based on multivariate pattern analysis (MVPA methods, are providing exciting new studies. Some of the results obtained with these paradigms have raised high expectations, such as the possibility of creating brain reading devices. However, such hopes are based on the assumptions that: a the BOLD signal is a marker of neural activity; b the BOLD pattern identified by a MVPA is a neurally sound pattern; c the MVPA’s feature space is a good mapping of the neural representation of a stimulus, and d the pattern identified by a MVPA corresponds to a representation. I examine here the challenges that still have to be met before fully accepting such assumptions.

The challenges of neural mind-reading paradigms.

Science.gov (United States)

Vilarroya, Oscar

2013-01-01

Neural mind-reading studies, based on multivariate pattern analysis (MVPA) methods, are providing exciting new studies. Some of the results obtained with these paradigms have raised high expectations, such as the possibility of creating brain reading devices. However, such hopes are based on the assumptions that: (a) the BOLD signal is a marker of neural activity; (b) the BOLD pattern identified by a MVPA is a neurally sound pattern; (c) the MVPA's feature space is a good mapping of the neural representation of a stimulus, and (d) the pattern identified by a MVPA corresponds to a representation. I examine here the challenges that still have to be met before fully accepting such assumptions.

Image Classification Using Biomimetic Pattern Recognition with Convolutional Neural Networks Features

Science.gov (United States)

Huo, Guanying

2017-01-01

As a typical deep-learning model, Convolutional Neural Networks (CNNs) can be exploited to automatically extract features from images using the hierarchical structure inspired by mammalian visual system. For image classification tasks, traditional CNN models employ the softmax function for classification. However, owing to the limited capacity of the softmax function, there are some shortcomings of traditional CNN models in image classification. To deal with this problem, a new method combining Biomimetic Pattern Recognition (BPR) with CNNs is proposed for image classification. BPR performs class recognition by a union of geometrical cover sets in a high-dimensional feature space and therefore can overcome some disadvantages of traditional pattern recognition. The proposed method is evaluated on three famous image classification benchmarks, that is, MNIST, AR, and CIFAR-10. The classification accuracies of the proposed method for the three datasets are 99.01%, 98.40%, and 87.11%, respectively, which are much higher in comparison with the other four methods in most cases. PMID:28316614

Evaluation and scoring of radiotherapy treatment plans using an artificial neural network

International Nuclear Information System (INIS)

Willoughby, Twyla R.; Starkschall, George; Janjan, Nora A.; Rosen, Isaac I.

1996-01-01

Purpose: The objective of this work was to demonstrate the feasibility of using an artificial neural network to predict the clinical evaluation of radiotherapy treatment plans. Methods and Materials: Approximately 150 treatment plans were developed for 16 patients who received external-beam radiotherapy for soft-tissue sarcomas of the lower extremity. Plans were assigned a figure of merit by a radiation oncologist using a five-point rating scale. Plan scoring was performed by a single physician to ensure consistency in rating. Dose-volume information extracted from a training set of 511 treatment plans on 14 patients was correlated to the physician-generated figure of merit using an artificial neural network. The neural network was tested with a test set of 19 treatment plans on two patients whose plans were not used in the training of the neural net. Results: Physician scoring of treatment plans was consistent to within one point on the rating scale 88% of the time. The neural net reproduced the physician scores in the training set to within one point approximately 90% of the time. It reproduced the physician scores in the test set to within one point approximately 83% of the time. Conclusions: An artificial neural network can be trained to generate a score for a treatment plan that can be correlated to a clinically-based figure of merit. The accuracy of the neural net in scoring plans compares well with the reproducibility of the clinical scoring. The system of radiotherapy treatment plan evaluation using an artificial neural network demonstrates promise as a method for generating a clinically relevant figure of merit

Neural nets for the plausibility check of measured values in the integrated measurement and information system for the surveillance of environmental radioactivity (IMIS)

International Nuclear Information System (INIS)

Haase, G.

2003-01-01

Neural nets to the plausibility check of measured values in the ''integrated measurement and information system for the surveillance of environmental radioactivity, IMIS'' is a research project supported by the Federal Minister for the Environment, Nature Conservation and Nuclear Safety. A goal of this project was the automatic recognition of implausible measured values in the data base ORACLE, which measured values from surveillance of environmental radioactivity of most diverse environmental media contained. The conversion of this project [ 1 ] was realized by institut of logic, complexity and deduction systems of the university Karlsruhe under the direction of Professor Dr. Menzel, Dr. Martin Riedmueller and Martin Lauer. (orig.)

Reconstruction of neutron spectra through neural networks; Reconstruccion de espectros de neutrones mediante redes neuronales

Energy Technology Data Exchange (ETDEWEB)

Vega C, H.R.; Hernandez D, V.M.; Manzanares A, E. [Cuerpo Academico de Radiobiologia, Estudios Nucleares, Universidad Autonoma de Zacatecas, A.P. 336, 98000 Zacatecas (Mexico)] e-mail: rvega@cantera.reduaz.mx [and others

2003-07-01

A neural network has been used to reconstruct the neutron spectra starting from the counting rates of the detectors of the Bonner sphere spectrophotometric system. A group of 56 neutron spectra was selected to calculate the counting rates that would produce in a Bonner sphere system, with these data and the spectra it was trained the neural network. To prove the performance of the net, 12 spectra were used, 6 were taken of the group used for the training, 3 were obtained of mathematical functions and those other 3 correspond to real spectra. When comparing the original spectra of those reconstructed by the net we find that our net has a poor performance when reconstructing monoenergetic spectra, this attributes it to those characteristic of the spectra used for the training of the neural network, however for the other groups of spectra the results of the net are appropriate with the prospective ones. (Author)

Risk-taking on the road and in the mind: behavioural and neural patterns of decision making between risky and safe drivers.

Science.gov (United States)

Ba, Yutao; Zhang, Wei; Peng, QiJia; Salvendy, Gavriel; Crundall, David

2016-01-01

Drivers' risk-taking is a key issue of road safety. This study explored individual differences in drivers' decision-making, linking external behaviours to internal neural activity, to reveal the cognitive mechanisms of risky driving. Twenty-four male drivers were split into two groups (risky vs. safe drivers) via the Drivier Behaviour Questionnaire-violation. The risky drivers demonstrated higher preference for the risky choices in the paradigms of Iowa Gambling Task and Balloon Analogue Risk Task. More importantly, the risky drivers showed lower amplitudes of feedback-related negativity (FRN) and loss-minus-gain FRN in both paradigms, which indicated their neural processing of error-detection. A significant difference of P300 amplitudes was also reported between groups, which indicated their neural processing of reward-evaluation and were modified by specific paradigm and feedback. These results suggested that the neural basis of risky driving was the decision patterns less revised by losses and more motivated by rewards. Risk-taking on the road is largely determined by inherent cognitive mechanisms, which can be indicated by the behavioural and neural patterns of decision-making. In this regard, it is feasible to quantize drivers’ riskiness in the cognitive stage before actual risky driving or accidents, and intervene accordingly.

Generalized Net Model of the Cognitive and Neural Algorithm for Adaptive Resonance Theory 1

Directory of Open Access Journals (Sweden)

Todor Petkov

2013-12-01

Full Text Available The artificial neural networks are inspired by biological properties of human and animal brains. One of the neural networks type is called ART [4]. The abbreviation of ART stands for Adaptive Resonance Theory that has been invented by Stephen Grossberg in 1976 [5]. ART represents a family of Neural Networks. It is a cognitive and neural theory that describes how the brain autonomously learns to categorize, recognize and predict objects and events in the changing world. In this paper we introduce a GN model that represent ART1 Neural Network learning algorithm [1]. The purpose of this model is to explain when the input vector will be clustered or rejected among all nodes by the network. It can also be used for explanation and optimization of ART1 learning algorithm.

Longevity and efficacy of bifenthrin treatment on desert-pattern U.S. military camouflage netting against mosquitoes in a hot-arid environment

Science.gov (United States)

Personnel deployed in support of US military operations will benefit from additions to the current Department of Defense pest management system. A recent study showed that residual insecticide treatment of woodland pattern US military camouflage netting was long lasting and effective at reducing mos...

Patterns of cortical oscillations organize neural activity into whole-brain functional networks evident in the fMRI BOLD signal

Directory of Open Access Journals (Sweden)

Jennifer C Whitman

2013-03-01

Full Text Available Recent findings from electrophysiology and multimodal neuroimaging have elucidated the relationship between patterns of cortical oscillations evident in EEG / MEG and the functional brain networks evident in the BOLD signal. Much of the existing literature emphasized how high-frequency cortical oscillations are thought to coordinate neural activity locally, while low-frequency oscillations play a role in coordinating activity between more distant brain regions. However, the assignment of different frequencies to different spatial scales is an oversimplification. A more informative approach is to explore the arrangements by which these low- and high-frequency oscillations work in concert, coordinating neural activity into whole-brain functional networks. When relating such networks to the BOLD signal, we must consider how the patterns of cortical oscillations change at the same speed as cognitive states, which often last less than a second. Consequently, the slower BOLD signal may often reflect the summed neural activity of several transient network configurations. This temporal mismatch can be circumvented if we use spatial maps to assess correspondence between oscillatory networks and BOLD networks.

Artificial Neural Network approach to develop unique Classification and Raga identification tools for Pattern Recognition in Carnatic Music

Science.gov (United States)

Srimani, P. K.; Parimala, Y. G.

2011-12-01

A unique approach has been developed to study patterns in ragas of Carnatic Classical music based on artificial neural networks. Ragas in Carnatic music which have found their roots in the Vedic period, have grown on a Scientific foundation over thousands of years. However owing to its vastness and complexities it has always been a challenge for scientists and musicologists to give an all encompassing perspective both qualitatively and quantitatively. Cognition, comprehension and perception of ragas in Indian classical music have always been the subject of intensive research, highly intriguing and many facets of these are hitherto not unravelled. This paper is an attempt to view the melakartha ragas with a cognitive perspective using artificial neural network based approach which has given raise to very interesting results. The 72 ragas of the melakartha system were defined through the combination of frequencies occurring in each of them. The data sets were trained using several neural networks. 100% accurate pattern recognition and classification was obtained using linear regression, TLRN, MLP and RBF networks. Performance of the different network topologies, by varying various network parameters, were compared. Linear regression was found to be the best performing network.

Pattern Extraction Algorithm for NetFlow-Based Botnet Activities Detection

Directory of Open Access Journals (Sweden)

Rafał Kozik

2017-01-01

Full Text Available As computer and network technologies evolve, the complexity of cybersecurity has dramatically increased. Advanced cyber threats have led to current approaches to cyber-attack detection becoming ineffective. Many currently used computer systems and applications have never been deeply tested from a cybersecurity point of view and are an easy target for cyber criminals. The paradigm of security by design is still more of a wish than a reality, especially in the context of constantly evolving systems. On the other hand, protection technologies have also improved. Recently, Big Data technologies have given network administrators a wide spectrum of tools to combat cyber threats. In this paper, we present an innovative system for network traffic analysis and anomalies detection to utilise these tools. The systems architecture is based on a Big Data processing framework, data mining, and innovative machine learning techniques. So far, the proposed system implements pattern extraction strategies that leverage batch processing methods. As a use case we consider the problem of botnet detection by means of data in the form of NetFlows. Results are promising and show that the proposed system can be a useful tool to improve cybersecurity.

Analysis of Salinity Intrusion in the San Francisco Bay-Delta Using a GA-Optimized Neural Net, and Application of the Model to Prediction in the Elkhorn Slough Habitat

Science.gov (United States)

Thompson, D. E.; Rajkumar, T.

2002-12-01

The San Francisco Bay Delta is a large hydrodynamic complex that incorporates the Sacramento and San Joaquin Estuaries, the Suisan Marsh, and the San Francisco Bay proper. Competition exists for the use of this extensive water system both from the fisheries industry, the agricultural industry, and from the marine and estuarine animal species within the Delta. As tidal fluctuations occur, more saline water pushes upstream allowing fish to migrate beyond the Suisan Marsh for breeding and habitat occupation. However, the agriculture industry does not want extensive salinity intrusion to impact water quality for human and plant consumption. The balance is regulated by pumping stations located along the estuaries and reservoirs whereby flushing of fresh water keeps the saline intrusion at bay. The pumping schedule is driven by data collected at various locations within the Bay Delta and by numerical models that predict the salinity intrusion as part of a larger model of the system. The Interagency Ecological Program (IEP) for the San Francisco Bay / Sacramento-San Joaquin Estuary collects, monitors, and archives the data, and the Department of Water Resources provides a numerical model simulation (DSM2) from which predictions are made that drive the pumping schedule. A problem with DSM2 is that the numerical simulation takes roughly 16 hours to complete a prediction. We have created a neural net, optimized with a genetic algorithm, that takes as input the archived data from multiple gauging stations and predicts stage, salinity, and flow at the Carquinez Straits (at the downstream end of the Suisan Marsh). This model seems to be robust in its predictions and operates much faster than the current numerical DSM2 model. Because the Bay-Delta is strongly tidally driven, we used both Principal Component Analysis and Fast Fourier Transforms to discover dominant features within the IEP data. We then filtered out the dominant tidal forcing to discover non-primary tidal effects

Getting started with Knockout.js for .NET developers

CERN Document Server

Akinshin, Andrey

2015-01-01

This book is intended for .NET developers who want to use the MVVM design pattern to create powerful client-side JavaScript linked to server-side C# logic. Basic experience with ASP.NET, Razor, and creating web applications is needed.

NeMO-Net - The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment

Science.gov (United States)

Li, A. S. X.; Chirayath, V.; Segal-Rosenhaimer, M.; Das, K.

2017-12-01

In the past decade, coral reefs worldwide have experienced unprecedented stresses due to climate change, ocean acidification, and anthropomorphic pressures, instigating massive bleaching and die-off of these fragile and diverse ecosystems. Furthermore, remote sensing of these shallow marine habitats is hindered by ocean wave distortion, refraction and optical attenuation, leading invariably to data products that are often of low resolution and signal-to-noise (SNR) ratio. However, recent advances in UAV and Fluid Lensing technology have allowed us to capture multispectral 3D imagery of these systems at sub-cm scales from above the water surface, giving us an unprecedented view of their growth and decay. Exploiting the fine-scaled features of these datasets, machine learning methods such as MAP, PCA, and SVM can not only accurately classify the living cover and morphology of these reef systems (below 8% error), but are also able to map the spectral space between airborne and satellite imagery, augmenting and improving the classification accuracy of previously low-resolution datasets.We are currently implementing NeMO-Net, the first open-source deep convolutional neural network (CNN) and interactive active learning and training software to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology. NeMO-Net will be built upon the QGIS platform to ingest UAV, airborne and satellite datasets from various sources and sensor capabilities, and through data-fusion determine the coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. To achieve this, we will exploit virtual data augmentation, the use of semi-supervised learning, and active learning through a tablet platform allowing for users to manually train uncertain or difficult to classify datasets. The project will make use of Python's extensive libraries for machine learning, as well as extending integration to GPU

A study on the optimal fuel loading pattern design in pressurized water reactor using the artificial neural network and the fuzzy rule based system

International Nuclear Information System (INIS)

Kim, Han Gon; Chang, Soon Heung; Lee, Byung

2004-01-01

The Optimal Fuel Shuffling System (OFSS) is developed for optimal design of PWR fuel loading pattern. In this paper, an optimal loading pattern is defined that the local power peaking factor is lower than predetermined value during one cycle and the effective multiplication factor is maximized in order to extract maximum energy. OFSS is a hybrid system that a rule based system, a fuzzy logic, and an artificial neural network are connected each other. The rule based system classifies loading patterns into two classes using several heuristic rules and a fuzzy rule. A fuzzy rule is introduced to achieve more effective and fast searching. Its membership function is automatically updated in accordance with the prediction results. The artificial neural network predicts core parameters for the patterns generated from the rule based system. The back-propagation network is used for fast prediction of core parameters. The artificial neural network and the fuzzy logic can be used as the tool for improvement of existing algorithm's capabilities. OFSS was demonstrated and validated for cycle 1 of Kori unit 1 PWR. (author)

A study on the optimal fuel loading pattern design in pressurized water reactor using the artificial neural network and the fuzzy rule based system

Energy Technology Data Exchange (ETDEWEB)

Kim, Han Gon; Chang, Soon Heung; Lee, Byung [Department of Nuclear Engineering, Korea Advanced Institute of Science and Technology, Yusong-gu, Taejon (Korea, Republic of)

2004-07-01

The Optimal Fuel Shuffling System (OFSS) is developed for optimal design of PWR fuel loading pattern. In this paper, an optimal loading pattern is defined that the local power peaking factor is lower than predetermined value during one cycle and the effective multiplication factor is maximized in order to extract maximum energy. OFSS is a hybrid system that a rule based system, a fuzzy logic, and an artificial neural network are connected each other. The rule based system classifies loading patterns into two classes using several heuristic rules and a fuzzy rule. A fuzzy rule is introduced to achieve more effective and fast searching. Its membership function is automatically updated in accordance with the prediction results. The artificial neural network predicts core parameters for the patterns generated from the rule based system. The back-propagation network is used for fast prediction of core parameters. The artificial neural network and the fuzzy logic can be used as the tool for improvement of existing algorithm's capabilities. OFSS was demonstrated and validated for cycle 1 of Kori unit 1 PWR. (author)

Neural net classification of x-ray pistachio nut data

Science.gov (United States)

Casasent, David P.; Sipe, Michael A.; Schatzki, Thomas F.; Keagy, Pamela M.; Le, Lan Chau

1996-12-01

Classification results for agricultural products are presented using a new neural network. This neural network inherently produces higher-order decision surfaces. It achieves this with fewer hidden layer neurons than other classifiers require. This gives better generalization. It uses new techniques to select the number of hidden layer neurons and adaptive algorithms that avoid other such ad hoc parameter selection problems; it allows selection of the best classifier parameters without the need to analyze the test set results. The agriculture case study considered is the inspection and classification of pistachio nuts using x- ray imagery. Present inspection techniques cannot provide good rejection of worm damaged nuts without rejecting too many good nuts. X-ray imagery has the potential to provide 100% inspection of such agricultural products in real time. Only preliminary results are presented, but these indicate the potential to reduce major defects to 2% of the crop with 1% of good nuts rejected. Future image processing techniques that should provide better features to improve performance and allow inspection of a larger variety of nuts are noted. These techniques and variations of them have uses in a number of other agricultural product inspection problems.

Fuzzy Neuroidal Nets and Recurrent Fuzzy Computations

Czech Academy of Sciences Publication Activity Database

Wiedermann, Jiří

2001-01-01

Roč. 11, č. 6 (2001), s. 675-686 ISSN 1210-0552. [SOFSEM 2001 Workshop on Soft Computing. Piešťany, 29.11.2001-30.11.2001] R&D Projects: GA ČR GA201/00/1489; GA AV ČR KSK1019101 Institutional research plan: AV0Z1030915 Keywords : fuzzy computing * fuzzy neural nets * fuzzy Turing machines * non-uniform computational complexity Subject RIV: BA - General Mathematics

The challenges of neural mind-reading paradigms

OpenAIRE

Vilarroya, Oscar

2013-01-01

Neural mind-reading studies, based on multivariate pattern analysis (MVPA) methods, are providing exciting new studies. Some of the results obtained with these paradigms have raised high expectations, such as the possibility of creating brain reading devices. However, such hopes are based on the assumptions that: (a) the BOLD signal is a marker of neural activity; (b) the BOLD pattern identified by a MVPA is a neurally sound pattern; (c) the MVPA's feature space is a good mapping of the neura...

Biological oscillations for learning walking coordination: dynamic recurrent neural network functionally models physiological central pattern generator.

Science.gov (United States)

Hoellinger, Thomas; Petieau, Mathieu; Duvinage, Matthieu; Castermans, Thierry; Seetharaman, Karthik; Cebolla, Ana-Maria; Bengoetxea, Ana; Ivanenko, Yuri; Dan, Bernard; Cheron, Guy

2013-01-01

The existence of dedicated neuronal modules such as those organized in the cerebral cortex, thalamus, basal ganglia, cerebellum, or spinal cord raises the question of how these functional modules are coordinated for appropriate motor behavior. Study of human locomotion offers an interesting field for addressing this central question. The coordination of the elevation of the 3 leg segments under a planar covariation rule (Borghese et al., 1996) was recently modeled (Barliya et al., 2009) by phase-adjusted simple oscillators shedding new light on the understanding of the central pattern generator (CPG) processing relevant oscillation signals. We describe the use of a dynamic recurrent neural network (DRNN) mimicking the natural oscillatory behavior of human locomotion for reproducing the planar covariation rule in both legs at different walking speeds. Neural network learning was based on sinusoid signals integrating frequency and amplitude features of the first three harmonics of the sagittal elevation angles of the thigh, shank, and foot of each lower limb. We verified the biological plausibility of the neural networks. Best results were obtained with oscillations extracted from the first three harmonics in comparison to oscillations outside the harmonic frequency peaks. Physiological replication steadily increased with the number of neuronal units from 1 to 80, where similarity index reached 0.99. Analysis of synaptic weighting showed that the proportion of inhibitory connections consistently increased with the number of neuronal units in the DRNN. This emerging property in the artificial neural networks resonates with recent advances in neurophysiology of inhibitory neurons that are involved in central nervous system oscillatory activities. The main message of this study is that this type of DRNN may offer a useful model of physiological central pattern generator for gaining insights in basic research and developing clinical applications.

A Configurable Event-Driven Convolutional Node with Rate Saturation Mechanism for Modular ConvNet Systems Implementation

Science.gov (United States)

Camuñas-Mesa, Luis A.; Domínguez-Cordero, Yaisel L.; Linares-Barranco, Alejandro; Serrano-Gotarredona, Teresa; Linares-Barranco, Bernabé

2018-01-01

Convolutional Neural Networks (ConvNets) are a particular type of neural network often used for many applications like image recognition, video analysis or natural language processing. They are inspired by the human brain, following a specific organization of the connectivity pattern between layers of neurons known as receptive field. These networks have been traditionally implemented in software, but they are becoming more computationally expensive as they scale up, having limitations for real-time processing of high-speed stimuli. On the other hand, hardware implementations show difficulties to be used for different applications, due to their reduced flexibility. In this paper, we propose a fully configurable event-driven convolutional node with rate saturation mechanism that can be used to implement arbitrary ConvNets on FPGAs. This node includes a convolutional processing unit and a routing element which allows to build large 2D arrays where any multilayer structure can be implemented. The rate saturation mechanism emulates the refractory behavior in biological neurons, guaranteeing a minimum separation in time between consecutive events. A 4-layer ConvNet with 22 convolutional nodes trained for poker card symbol recognition has been implemented in a Spartan6 FPGA. This network has been tested with a stimulus where 40 poker cards were observed by a Dynamic Vision Sensor (DVS) in 1 s time. Different slow-down factors were applied to characterize the behavior of the system for high speed processing. For slow stimulus play-back, a 96% recognition rate is obtained with a power consumption of 0.85 mW. At maximum play-back speed, a traffic control mechanism downsamples the input stimulus, obtaining a recognition rate above 63% when less than 20% of the input events are processed, demonstrating the robustness of the network. PMID:29515349

A Configurable Event-Driven Convolutional Node with Rate Saturation Mechanism for Modular ConvNet Systems Implementation

Directory of Open Access Journals (Sweden)

Luis A. Camuñas-Mesa

2018-02-01

Full Text Available Convolutional Neural Networks (ConvNets are a particular type of neural network often used for many applications like image recognition, video analysis or natural language processing. They are inspired by the human brain, following a specific organization of the connectivity pattern between layers of neurons known as receptive field. These networks have been traditionally implemented in software, but they are becoming more computationally expensive as they scale up, having limitations for real-time processing of high-speed stimuli. On the other hand, hardware implementations show difficulties to be used for different applications, due to their reduced flexibility. In this paper, we propose a fully configurable event-driven convolutional node with rate saturation mechanism that can be used to implement arbitrary ConvNets on FPGAs. This node includes a convolutional processing unit and a routing element which allows to build large 2D arrays where any multilayer structure can be implemented. The rate saturation mechanism emulates the refractory behavior in biological neurons, guaranteeing a minimum separation in time between consecutive events. A 4-layer ConvNet with 22 convolutional nodes trained for poker card symbol recognition has been implemented in a Spartan6 FPGA. This network has been tested with a stimulus where 40 poker cards were observed by a Dynamic Vision Sensor (DVS in 1 s time. Different slow-down factors were applied to characterize the behavior of the system for high speed processing. For slow stimulus play-back, a 96% recognition rate is obtained with a power consumption of 0.85 mW. At maximum play-back speed, a traffic control mechanism downsamples the input stimulus, obtaining a recognition rate above 63% when less than 20% of the input events are processed, demonstrating the robustness of the network.

A Configurable Event-Driven Convolutional Node with Rate Saturation Mechanism for Modular ConvNet Systems Implementation.

Science.gov (United States)

Camuñas-Mesa, Luis A; Domínguez-Cordero, Yaisel L; Linares-Barranco, Alejandro; Serrano-Gotarredona, Teresa; Linares-Barranco, Bernabé

2018-01-01

Convolutional Neural Networks (ConvNets) are a particular type of neural network often used for many applications like image recognition, video analysis or natural language processing. They are inspired by the human brain, following a specific organization of the connectivity pattern between layers of neurons known as receptive field. These networks have been traditionally implemented in software, but they are becoming more computationally expensive as they scale up, having limitations for real-time processing of high-speed stimuli. On the other hand, hardware implementations show difficulties to be used for different applications, due to their reduced flexibility. In this paper, we propose a fully configurable event-driven convolutional node with rate saturation mechanism that can be used to implement arbitrary ConvNets on FPGAs. This node includes a convolutional processing unit and a routing element which allows to build large 2D arrays where any multilayer structure can be implemented. The rate saturation mechanism emulates the refractory behavior in biological neurons, guaranteeing a minimum separation in time between consecutive events. A 4-layer ConvNet with 22 convolutional nodes trained for poker card symbol recognition has been implemented in a Spartan6 FPGA. This network has been tested with a stimulus where 40 poker cards were observed by a Dynamic Vision Sensor (DVS) in 1 s time. Different slow-down factors were applied to characterize the behavior of the system for high speed processing. For slow stimulus play-back, a 96% recognition rate is obtained with a power consumption of 0.85 mW. At maximum play-back speed, a traffic control mechanism downsamples the input stimulus, obtaining a recognition rate above 63% when less than 20% of the input events are processed, demonstrating the robustness of the network.

Segmentation of corneal endothelium images using a U-Net-based convolutional neural network.

Science.gov (United States)

Fabijańska, Anna

2018-04-18

Diagnostic information regarding the health status of the corneal endothelium may be obtained by analyzing the size and the shape of the endothelial cells in specular microscopy images. Prior to the analysis, the endothelial cells need to be extracted from the image. Up to today, this has been performed manually or semi-automatically. Several approaches to automatic segmentation of endothelial cells exist; however, none of them is perfect. Therefore this paper proposes to perform cell segmentation using a U-Net-based convolutional neural network. Particularly, the network is trained to discriminate pixels located at the borders between cells. The edge probability map outputted by the network is next binarized and skeletonized in order to obtain one-pixel wide edges. The proposed solution was tested on a dataset consisting of 30 corneal endothelial images presenting cells of different sizes, achieving an AUROC level of 0.92. The resulting DICE is on average equal to 0.86, which is a good result, regarding the thickness of the compared edges. The corresponding mean absolute percentage error of cell number is at the level of 4.5% which confirms the high accuracy of the proposed approach. The resulting cell edges are well aligned to the ground truths and require a limited number of manual corrections. This also results in accurate values of the cell morphometric parameters. The corresponding errors range from 5.2% for endothelial cell density, through 6.2% for cell hexagonality to 11.93% for the coefficient of variation of the cell size. Copyright © 2018 Elsevier B.V. All rights reserved.

Distributed Recurrent Neural Forward Models with Neural Control for Complex Locomotion in Walking Robots

DEFF Research Database (Denmark)

Dasgupta, Sakyasingha; Goldschmidt, Dennis; Wörgötter, Florentin

2015-01-01

here, an artificial bio-inspired walking system which effectively combines biomechanics (in terms of the body and leg structures) with the underlying neural mechanisms. The neural mechanisms consist of (1) central pattern generator based control for generating basic rhythmic patterns and coordinated......Walking animals, like stick insects, cockroaches or ants, demonstrate a fascinating range of locomotive abilities and complex behaviors. The locomotive behaviors can consist of a variety of walking patterns along with adaptation that allow the animals to deal with changes in environmental...... conditions, like uneven terrains, gaps, obstacles etc. Biological study has revealed that such complex behaviors are a result of a combination of biomechanics and neural mechanism thus representing the true nature of embodied interactions. While the biomechanics helps maintain flexibility and sustain...

Neural Networks for the Beginner.

Science.gov (United States)

Snyder, Robin M.

Motivated by the brain, neural networks are a right-brained approach to artificial intelligence that is used to recognize patterns based on previous training. In practice, one would not program an expert system to recognize a pattern and one would not train a neural network to make decisions from rules; but one could combine the best features of…

Improved Discriminability of Spatiotemporal Neural Patterns in Rat Motor Cortical Areas as Directional Choice Learning Progresses

Directory of Open Access Journals (Sweden)

Hongwei eMao

2015-03-01

Full Text Available Animals learn to choose a proper action among alternatives to improve their odds of success in food foraging and other activities critical for survival. Through trial-and-error, they learn correct associations between their choices and external stimuli. While a neural network that underlies such learning process has been identified at a high level, it is still unclear how individual neurons and a neural ensemble adapt as learning progresses. In this study, we monitored the activity of single units in the rat medial and lateral agranular (AGm and AGl, respectively areas as rats learned to make a left or right side lever press in response to a left or right side light cue. We noticed that rat movement parameters during the performance of the directional choice task quickly became stereotyped during the first 2-3 days or sessions. But learning the directional choice problem took weeks to occur. Accompanying rats’ behavioral performance adaptation, we observed neural modulation by directional choice in recorded single units. Our analysis shows that ensemble mean firing rates in the cue-on period did not change significantly as learning progressed, and the ensemble mean rate difference between left and right side choices did not show a clear trend of change either. However, the spatiotemporal firing patterns of the neural ensemble exhibited improved discriminability between the two directional choices through learning. These results suggest a spatiotemporal neural coding scheme in a motor cortical neural ensemble that may be responsible for and contributing to learning the directional choice task.

Using c-Jun to identify fear extinction learning-specific patterns of neural activity that are affected by single prolonged stress.

Science.gov (United States)

Knox, Dayan; Stanfield, Briana R; Staib, Jennifer M; David, Nina P; DePietro, Thomas; Chamness, Marisa; Schneider, Elizabeth K; Keller, Samantha M; Lawless, Caroline

2018-04-02

Neural circuits via which stress leads to disruptions in fear extinction is often explored in animal stress models. Using the single prolonged stress (SPS) model of post traumatic stress disorder and the immediate early gene (IEG) c-Fos as a measure of neural activity, we previously identified patterns of neural activity through which SPS disrupts extinction retention. However, none of these stress effects were specific to fear or extinction learning and memory. C-Jun is another IEG that is sometimes regulated in a different manner to c-Fos and could be used to identify emotional learning/memory specific patterns of neural activity that are sensitive to SPS. Animals were either fear conditioned (CS-fear) or presented with CSs only (CS-only) then subjected to extinction training and testing. C-Jun was then assayed within neural substrates critical for extinction memory. Inhibited c-Jun levels in the hippocampus (Hipp) and enhanced functional connectivity between the ventromedial prefrontal cortex (vmPFC) and basolateral amygdala (BLA) during extinction training was disrupted by SPS in the CS-fear group only. As a result, these effects were specific to emotional learning/memory. SPS also disrupted inhibited Hipp c-Jun levels, enhanced BLA c-Jun levels, and altered functional connectivity among the vmPFC, BLA, and Hipp during extinction testing in SPS rats in the CS-fear and CS-only groups. As a result, these effects were not specific to emotional learning/memory. Our findings suggest that SPS disrupts neural activity specific to extinction memory, but may also disrupt the retention of fear extinction by mechanisms that do not involve emotional learning/memory. Copyright © 2017 Elsevier B.V. All rights reserved.

Global reinforcement training of CrossNets

Science.gov (United States)

Ma, Xiaolong

2007-10-01

Hybrid "CMOL" integrated circuits, incorporating advanced CMOS devices for neural cell bodies, nanowires as axons and dendrites, and latching switches as synapses, may be used for the hardware implementation of extremely dense (107 cells and 1012 synapses per cm2) neuromorphic networks, operating up to 10 6 times faster than their biological prototypes. We are exploring several "Cross- Net" architectures that accommodate the limitations imposed by CMOL hardware and should allow effective training of the networks without a direct external access to individual synapses. Our studies have show that CrossNets based on simple (two-terminal) crosspoint devices can work well in at least two modes: as Hop-field networks for associative memory and multilayer perceptrons for classification tasks. For more intelligent tasks (such as robot motion control or complex games), which do not have "examples" for supervised learning, more advanced training methods such as the global reinforcement learning are necessary. For application of global reinforcement training algorithms to CrossNets, we have extended Williams's REINFORCE learning principle to a more general framework and derived several learning rules that are more suitable for CrossNet hardware implementation. The results of numerical experiments have shown that these new learning rules can work well for both classification tasks and reinforcement tasks such as the cartpole balancing control problem. Some limitations imposed by the CMOL hardware need to be carefully addressed for the the successful application of in situ reinforcement training to CrossNets.

Using neural networks and extreme value distributions to model electricity pool prices: Evidence from the Australian National Electricity Market 1998–2013

International Nuclear Information System (INIS)

Dev, Priya; Martin, Michael A.

2014-01-01

Highlights: • Neural nets are unable to properly capture spiky price behavior found in the electricity market. • We modeled electricity price data from the Australian National Electricity Market over 15 years. • Neural nets need to be augmented with other modeling techniques to capture price spikes. • We fit a Generalized Pareto Distribution to price spikes using a peaks-over-thresholds approach. - Abstract: Competitors in the electricity supply industry desire accurate predictions of electricity spot prices to hedge against financial risks. Neural networks are commonly used for forecasting such prices, but certain features of spot price series, such as extreme price spikes, present critical challenges for such modeling. We investigate the predictive capacity of neural networks for electricity spot prices using Australian National Electricity Market data. Following neural net modeling of the data, we explore extreme price spikes through extreme value modeling, fitting a Generalized Pareto Distribution to price peaks over an estimated threshold. While neural nets capture the smoother aspects of spot price data, they are unable to capture local, volatile features that characterize electricity spot price data. Price spikes can be modeled successfully through extreme value modeling

Portable Rule Extraction Method for Neural Network Decisions Reasoning

Directory of Open Access Journals (Sweden)

Darius PLIKYNAS

2005-08-01

Full Text Available Neural network (NN methods are sometimes useless in practical applications, because they are not properly tailored to the particular market's needs. We focus thereinafter specifically on financial market applications. NNs have not gained full acceptance here yet. One of the main reasons is the "Black Box" problem (lack of the NN decisions explanatory power. There are though some NN decisions rule extraction methods like decompositional, pedagogical or eclectic, but they suffer from low portability of the rule extraction technique across various neural net architectures, high level of granularity, algorithmic sophistication of the rule extraction technique etc. The authors propose to eliminate some known drawbacks using an innovative extension of the pedagogical approach. The idea is exposed by the use of a widespread MLP neural net (as a common tool in the financial problems' domain and SOM (input data space clusterization. The feedback of both nets' performance is related and targeted through the iteration cycle by achievement of the best matching between the decision space fragments and input data space clusters. Three sets of rules are generated algorithmically or by fuzzy membership functions. Empirical validation of the common financial benchmark problems is conducted with an appropriately prepared software solution.

Neural Network Approach to Locating Cryptography in Object Code

Energy Technology Data Exchange (ETDEWEB)

Jason L. Wright; Milos Manic

2009-09-01

Finding and identifying cryptography is a growing concern in the malware analysis community. In this paper, artificial neural networks are used to classify functional blocks from a disassembled program as being either cryptography related or not. The resulting system, referred to as NNLC (Neural Net for Locating Cryptography) is presented and results of applying this system to various libraries are described.

Recurrent Neural Networks for Multivariate Time Series with Missing Values.

Science.gov (United States)

Che, Zhengping; Purushotham, Sanjay; Cho, Kyunghyun; Sontag, David; Liu, Yan

2018-04-17

Multivariate time series data in practical applications, such as health care, geoscience, and biology, are characterized by a variety of missing values. In time series prediction and other related tasks, it has been noted that missing values and their missing patterns are often correlated with the target labels, a.k.a., informative missingness. There is very limited work on exploiting the missing patterns for effective imputation and improving prediction performance. In this paper, we develop novel deep learning models, namely GRU-D, as one of the early attempts. GRU-D is based on Gated Recurrent Unit (GRU), a state-of-the-art recurrent neural network. It takes two representations of missing patterns, i.e., masking and time interval, and effectively incorporates them into a deep model architecture so that it not only captures the long-term temporal dependencies in time series, but also utilizes the missing patterns to achieve better prediction results. Experiments of time series classification tasks on real-world clinical datasets (MIMIC-III, PhysioNet) and synthetic datasets demonstrate that our models achieve state-of-the-art performance and provide useful insights for better understanding and utilization of missing values in time series analysis.

Drug-like and non drug-like pattern classification based on simple topology descriptor using hybrid neural network.

Science.gov (United States)

Wan-Mamat, Wan Mohd Fahmi; Isa, Nor Ashidi Mat; Wahab, Habibah A; Wan-Mamat, Wan Mohd Fairuz

2009-01-01

An intelligent prediction system has been developed to discriminate drug-like and non drug-like molecules pattern. The system is constructed by using the application of advanced version of standard multilayer perceptron (MLP) neural network called Hybrid Multilayer Perceptron (HMLP) neural network and trained using Modified Recursive Prediction Error (MRPE) training algorithm. In this work, a well understood and easy excess Rule of Five + Veber filter properties are selected as the topological descriptor. The main idea behind the selection of this simple descriptor is to assure that the system could be used widely, beneficial and more advantageous regardless at all user level within a drug discovery organization.

Neural Networks

International Nuclear Information System (INIS)

Smith, Patrick I.

2003-01-01

Physicists use large detectors to measure particles created in high-energy collisions at particle accelerators. These detectors typically produce signals indicating either where ionization occurs along the path of the particle, or where energy is deposited by the particle. The data produced by these signals is fed into pattern recognition programs to try to identify what particles were produced, and to measure the energy and direction of these particles. Ideally, there are many techniques used in this pattern recognition software. One technique, neural networks, is particularly suitable for identifying what type of particle caused by a set of energy deposits. Neural networks can derive meaning from complicated or imprecise data, extract patterns, and detect trends that are too complex to be noticed by either humans or other computer related processes. To assist in the advancement of this technology, Physicists use a tool kit to experiment with several neural network techniques. The goal of this research is interface a neural network tool kit into Java Analysis Studio (JAS3), an application that allows data to be analyzed from any experiment. As the final result, a physicist will have the ability to train, test, and implement a neural network with the desired output while using JAS3 to analyze the results or output. Before an implementation of a neural network can take place, a firm understanding of what a neural network is and how it works is beneficial. A neural network is an artificial representation of the human brain that tries to simulate the learning process [5]. It is also important to think of the word artificial in that definition as computer programs that use calculations during the learning process. In short, a neural network learns by representative examples. Perhaps the easiest way to describe the way neural networks learn is to explain how the human brain functions. The human brain contains billions of neural cells that are responsible for processing

Optical Calibration Process Developed for Neural-Network-Based Optical Nondestructive Evaluation Method

Science.gov (United States)

Decker, Arthur J.

2004-01-01

A completely optical calibration process has been developed at Glenn for calibrating a neural-network-based nondestructive evaluation (NDE) method. The NDE method itself detects very small changes in the characteristic patterns or vibration mode shapes of vibrating structures as discussed in many references. The mode shapes or characteristic patterns are recorded using television or electronic holography and change when a structure experiences, for example, cracking, debonds, or variations in fastener properties. An artificial neural network can be trained to be very sensitive to changes in the mode shapes, but quantifying or calibrating that sensitivity in a consistent, meaningful, and deliverable manner has been challenging. The standard calibration approach has been difficult to implement, where the response to damage of the trained neural network is compared with the responses of vibration-measurement sensors. In particular, the vibration-measurement sensors are intrusive, insufficiently sensitive, and not numerous enough. In response to these difficulties, a completely optical alternative to the standard calibration approach was proposed and tested successfully. Specifically, the vibration mode to be monitored for structural damage was intentionally contaminated with known amounts of another mode, and the response of the trained neural network was measured as a function of the peak-to-peak amplitude of the contaminating mode. The neural network calibration technique essentially uses the vibration mode shapes of the undamaged structure as standards against which the changed mode shapes are compared. The published response of the network can be made nearly independent of the contaminating mode, if enough vibration modes are used to train the net. The sensitivity of the neural network can be adjusted for the environment in which the test is to be conducted. The response of a neural network trained with measured vibration patterns for use on a vibration isolation

SOX1 links the function of neural patterning and Notch signalling in the ventral spinal cord during the neuron-glial fate switch

Energy Technology Data Exchange (ETDEWEB)

Genethliou, Nicholas; Panayiotou, Elena [The Cyprus Institute of Neurology and Genetics, Airport Avenue, No. 6, Agios Dometios, 2370 Nicosia (Cyprus); Department of Biological Sciences, University of Cyprus, P.O. Box 20537, 1678 Nicosia (Cyprus); Panayi, Helen; Orford, Michael; Mean, Richard; Lapathitis, George; Gill, Herman; Raoof, Sahir [The Cyprus Institute of Neurology and Genetics, Airport Avenue, No. 6, Agios Dometios, 2370 Nicosia (Cyprus); Gasperi, Rita De; Elder, Gregory [James J. Peters VA Medical Center, Research and Development (3F22), 130 West Kingsbridge Road, Bronx, NY 10468 (United States); Kessaris, Nicoletta; Richardson, William D. [Wolfson Institute for Biomedical Research and Research Department of Cell and Developmental Biology, University College London, Gower Street, London WC1E 6BT (United Kingdom); Malas, Stavros, E-mail: smalas@cing.ac.cy [The Cyprus Institute of Neurology and Genetics, Airport Avenue, No. 6, Agios Dometios, 2370 Nicosia (Cyprus); Department of Biological Sciences, University of Cyprus, P.O. Box 20537, 1678 Nicosia (Cyprus)

2009-12-25

During neural development the transition from neurogenesis to gliogenesis, known as the neuron-glial ({Nu}/G) fate switch, requires the coordinated function of patterning factors, pro-glial factors and Notch signalling. How this process is coordinated in the embryonic spinal cord is poorly understood. Here, we demonstrate that during the N/G fate switch in the ventral spinal cord (vSC) SOX1 links the function of neural patterning and Notch signalling. We show that, SOX1 expression in the vSC is regulated by PAX6, NKX2.2 and Notch signalling in a domain-specific manner. We further show that SOX1 regulates the expression of Hes1 and that loss of Sox1 leads to enhanced production of oligodendrocyte precursors from the pMN. Finally, we show that Notch signalling functions upstream of SOX1 during this fate switch and is independently required for the acquisition of the glial fate perse by regulating Nuclear Factor I A expression in a PAX6/SOX1/HES1/HES5-independent manner. These data integrate functional roles of neural patterning factors, Notch signalling and SOX1 during gliogenesis.

Improving Pattern Recognition and Neural Network Algorithms with Applications to Solar Panel Energy Optimization

Science.gov (United States)

Zamora Ramos, Ernesto

Artificial Intelligence is a big part of automation and with today's technological advances, artificial intelligence has taken great strides towards positioning itself as the technology of the future to control, enhance and perfect automation. Computer vision includes pattern recognition and classification and machine learning. Computer vision is at the core of decision making and it is a vast and fruitful branch of artificial intelligence. In this work, we expose novel algorithms and techniques built upon existing technologies to improve pattern recognition and neural network training, initially motivated by a multidisciplinary effort to build a robot that helps maintain and optimize solar panel energy production. Our contributions detail an improved non-linear pre-processing technique to enhance poorly illuminated images based on modifications to the standard histogram equalization for an image. While the original motivation was to improve nocturnal navigation, the results have applications in surveillance, search and rescue, medical imaging enhancing, and many others. We created a vision system for precise camera distance positioning motivated to correctly locate the robot for capture of solar panel images for classification. The classification algorithm marks solar panels as clean or dirty for later processing. Our algorithm extends past image classification and, based on historical and experimental data, it identifies the optimal moment in which to perform maintenance on marked solar panels as to minimize the energy and profit loss. In order to improve upon the classification algorithm, we delved into feedforward neural networks because of their recent advancements, proven universal approximation and classification capabilities, and excellent recognition rates. We explore state-of-the-art neural network training techniques offering pointers and insights, culminating on the implementation of a complete library with support for modern deep learning architectures

Markers of neural degeneration and regeneration in Down ...

African Journals Online (AJOL)

Iman Ehsan Abdel-Meguid

2012-11-02

Nov 2, 2012 ... The Egyptian Journal of Medical Human Genetics www.ejmhg.eg.net ... stem cells (TCSCs), including neural TCSCs and endothelial. TCSCs [10,11]. ..... directs human embryonic stem cell proliferation and differentia- tion into.

End-to-end unsupervised deformable image registration with a convolutional neural network

NARCIS (Netherlands)

de Vos, Bob D.; Berendsen, Floris; Viergever, Max A.; Staring, Marius; Išgum, Ivana

2017-01-01

In this work we propose a deep learning network for deformable image registration (DIRNet). The DIRNet consists of a convolutional neural network (ConvNet) regressor, a spatial transformer, and a resampler. The ConvNet analyzes a pair of fixed and moving images and outputs parameters for the spatial

Diagnosing Autism Spectrum Disorder from Brain Resting-State Functional Connectivity Patterns Using a Deep Neural Network with a Novel Feature Selection Method.

Science.gov (United States)

Guo, Xinyu; Dominick, Kelli C; Minai, Ali A; Li, Hailong; Erickson, Craig A; Lu, Long J

2017-01-01

The whole-brain functional connectivity (FC) pattern obtained from resting-state functional magnetic resonance imaging data are commonly applied to study neuropsychiatric conditions such as autism spectrum disorder (ASD) by using different machine learning models. Recent studies indicate that both hyper- and hypo- aberrant ASD-associated FCs were widely distributed throughout the entire brain rather than only in some specific brain regions. Deep neural networks (DNN) with multiple hidden layers have shown the ability to systematically extract lower-to-higher level information from high dimensional data across a series of neural hidden layers, significantly improving classification accuracy for such data. In this study, a DNN with a novel feature selection method (DNN-FS) is developed for the high dimensional whole-brain resting-state FC pattern classification of ASD patients vs. typical development (TD) controls. The feature selection method is able to help the DNN generate low dimensional high-quality representations of the whole-brain FC patterns by selecting features with high discriminating power from multiple trained sparse auto-encoders. For the comparison, a DNN without the feature selection method (DNN-woFS) is developed, and both of them are tested with different architectures (i.e., with different numbers of hidden layers/nodes). Results show that the best classification accuracy of 86.36% is generated by the DNN-FS approach with 3 hidden layers and 150 hidden nodes (3/150). Remarkably, DNN-FS outperforms DNN-woFS for all architectures studied. The most significant accuracy improvement was 9.09% with the 3/150 architecture. The method also outperforms other feature selection methods, e.g., two sample t -test and elastic net. In addition to improving the classification accuracy, a Fisher's score-based biomarker identification method based on the DNN is also developed, and used to identify 32 FCs related to ASD. These FCs come from or cross different pre

Neural activation patterns and connectivity in visual attention during Number and Non-number processing: An ERP study using the Ishihara pseudoisochromatic plates.

Science.gov (United States)

Al-Marri, Faraj; Reza, Faruque; Begum, Tahamina; Hitam, Wan Hazabbah Wan; Jin, Goh Khean; Xiang, Jing

2017-10-25

Visual cognitive function is important to build up executive function in daily life. Perception of visual Number form (e.g., Arabic digit) and numerosity (magnitude of the Number) is of interest to cognitive neuroscientists. Neural correlates and the functional measurement of Number representations are complex occurrences when their semantic categories are assimilated with other concepts of shape and colour. Colour perception can be processed further to modulate visual cognition. The Ishihara pseudoisochromatic plates are one of the best and most common screening tools for basic red-green colour vision testing. However, there is a lack of study of visual cognitive function assessment using these pseudoisochromatic plates. We recruited 25 healthy normal trichromat volunteers and extended these studies using a 128-sensor net to record event-related EEG. Subjects were asked to respond by pressing Numbered buttons when they saw the Number and Non-number plates of the Ishihara colour vision test. Amplitudes and latencies of N100 and P300 event related potential (ERP) components were analysed from 19 electrode sites in the international 10-20 system. A brain topographic map, cortical activation patterns and Granger causation (effective connectivity) were analysed from 128 electrode sites. No major significant differences between N100 ERP components in either stimulus indicate early selective attention processing was similar for Number and Non-number plate stimuli, but Non-number plate stimuli evoked significantly higher amplitudes, longer latencies of the P300 ERP component with a slower reaction time compared to Number plate stimuli imply the allocation of attentional load was more in Non-number plate processing. A different pattern of asymmetric scalp voltage map was noticed for P300 components with a higher intensity in the left hemisphere for Number plate tasks and higher intensity in the right hemisphere for Non-number plate tasks. Asymmetric cortical activation

Diagnosing Autism Spectrum Disorder from Brain Resting-State Functional Connectivity Patterns Using a Deep Neural Network with a Novel Feature Selection Method

Directory of Open Access Journals (Sweden)

Xinyu Guo

2017-08-01

Full Text Available The whole-brain functional connectivity (FC pattern obtained from resting-state functional magnetic resonance imaging data are commonly applied to study neuropsychiatric conditions such as autism spectrum disorder (ASD by using different machine learning models. Recent studies indicate that both hyper- and hypo- aberrant ASD-associated FCs were widely distributed throughout the entire brain rather than only in some specific brain regions. Deep neural networks (DNN with multiple hidden layers have shown the ability to systematically extract lower-to-higher level information from high dimensional data across a series of neural hidden layers, significantly improving classification accuracy for such data. In this study, a DNN with a novel feature selection method (DNN-FS is developed for the high dimensional whole-brain resting-state FC pattern classification of ASD patients vs. typical development (TD controls. The feature selection method is able to help the DNN generate low dimensional high-quality representations of the whole-brain FC patterns by selecting features with high discriminating power from multiple trained sparse auto-encoders. For the comparison, a DNN without the feature selection method (DNN-woFS is developed, and both of them are tested with different architectures (i.e., with different numbers of hidden layers/nodes. Results show that the best classification accuracy of 86.36% is generated by the DNN-FS approach with 3 hidden layers and 150 hidden nodes (3/150. Remarkably, DNN-FS outperforms DNN-woFS for all architectures studied. The most significant accuracy improvement was 9.09% with the 3/150 architecture. The method also outperforms other feature selection methods, e.g., two sample t-test and elastic net. In addition to improving the classification accuracy, a Fisher's score-based biomarker identification method based on the DNN is also developed, and used to identify 32 FCs related to ASD. These FCs come from or cross

Optical neural network system for pose determination of spinning satellites

Science.gov (United States)

Lee, Andrew; Casasent, David

1990-01-01

An optical neural network architecture and algorithm based on a Hopfield optimization network are presented for multitarget tracking. This tracker utilizes a neuron for every possible target track, and a quadratic energy function of neural activities which is minimized using gradient descent neural evolution. The neural net tracker is demonstrated as part of a system for determining position and orientation (pose) of spinning satellites with respect to a robotic spacecraft. The input to the system is time sequence video from a single camera. Novelty detection and filtering are utilized to locate and segment novel regions from the input images. The neural net multitarget tracker determines the correspondences (or tracks) of the novel regions as a function of time, and hence the paths of object (satellite) parts. The path traced out by a given part or region is approximately elliptical in image space, and the position, shape and orientation of the ellipse are functions of the satellite geometry and its pose. Having a geometric model of the satellite, and the elliptical path of a part in image space, the three-dimensional pose of the satellite is determined. Digital simulation results using this algorithm are presented for various satellite poses and lighting conditions.

Computer-assisted detection of colonic polyps with CT colonography using neural networks and binary classification trees

International Nuclear Information System (INIS)

Jerebko, Anna K.; Summers, Ronald M.; Malley, James D.; Franaszek, Marek; Johnson, C. Daniel

2003-01-01

Detection of colonic polyps in CT colonography is problematic due to complexities of polyp shape and the surface of the normal colon. Published results indicate the feasibility of computer-aided detection of polyps but better classifiers are needed to improve specificity. In this paper we compare the classification results of two approaches: neural networks and recursive binary trees. As our starting point we collect surface geometry information from three-dimensional reconstruction of the colon, followed by a filter based on selected variables such as region density, Gaussian and average curvature and sphericity. The filter returns sites that are candidate polyps, based on earlier work using detection thresholds, to which the neural nets or the binary trees are applied. A data set of 39 polyps from 3 to 25 mm in size was used in our investigation. For both neural net and binary trees we use tenfold cross-validation to better estimate the true error rates. The backpropagation neural net with one hidden layer trained with Levenberg-Marquardt algorithm achieved the best results: sensitivity 90% and specificity 95% with 16 false positives per study

Decoding Visual Location From Neural Patterns in the Auditory Cortex of the Congenitally Deaf

Science.gov (United States)

Almeida, Jorge; He, Dongjun; Chen, Quanjing; Mahon, Bradford Z.; Zhang, Fan; Gonçalves, Óscar F.; Fang, Fang; Bi, Yanchao

2016-01-01

Sensory cortices of individuals who are congenitally deprived of a sense can exhibit considerable plasticity and be recruited to process information from the senses that remain intact. Here, we explored whether the auditory cortex of congenitally deaf individuals represents visual field location of a stimulus—a dimension that is represented in early visual areas. We used functional MRI to measure neural activity in auditory and visual cortices of congenitally deaf and hearing humans while they observed stimuli typically used for mapping visual field preferences in visual cortex. We found that the location of a visual stimulus can be successfully decoded from the patterns of neural activity in auditory cortex of congenitally deaf but not hearing individuals. This is particularly true for locations within the horizontal plane and within peripheral vision. These data show that the representations stored within neuroplastically changed auditory cortex can align with dimensions that are typically represented in visual cortex. PMID:26423461

Morphological neural networks

Energy Technology Data Exchange (ETDEWEB)

Ritter, G.X.; Sussner, P. [Univ. of Florida, Gainesville, FL (United States)

1996-12-31

The theory of artificial neural networks has been successfully applied to a wide variety of pattern recognition problems. In this theory, the first step in computing the next state of a neuron or in performing the next layer neural network computation involves the linear operation of multiplying neural values by their synaptic strengths and adding the results. Thresholding usually follows the linear operation in order to provide for nonlinearity of the network. In this paper we introduce a novel class of neural networks, called morphological neural networks, in which the operations of multiplication and addition are replaced by addition and maximum (or minimum), respectively. By taking the maximum (or minimum) of sums instead of the sum of products, morphological network computation is nonlinear before thresholding. As a consequence, the properties of morphological neural networks are drastically different than those of traditional neural network models. In this paper we consider some of these differences and provide some particular examples of morphological neural network.

Processing of chromatic information in a deep convolutional neural network.

Science.gov (United States)

Flachot, Alban; Gegenfurtner, Karl R

2018-04-01

Deep convolutional neural networks are a class of machine-learning algorithms capable of solving non-trivial tasks, such as object recognition, with human-like performance. Little is known about the exact computations that deep neural networks learn, and to what extent these computations are similar to the ones performed by the primate brain. Here, we investigate how color information is processed in the different layers of the AlexNet deep neural network, originally trained on object classification of over 1.2M images of objects in their natural contexts. We found that the color-responsive units in the first layer of AlexNet learned linear features and were broadly tuned to two directions in color space, analogously to what is known of color responsive cells in the primate thalamus. Moreover, these directions are decorrelated and lead to statistically efficient representations, similar to the cardinal directions of the second-stage color mechanisms in primates. We also found, in analogy to the early stages of the primate visual system, that chromatic and achromatic information were segregated in the early layers of the network. Units in the higher layers of AlexNet exhibit on average a lower responsivity for color than units at earlier stages.

ClimateNet: A Machine Learning dataset for Climate Science Research

Science.gov (United States)

Prabhat, M.; Biard, J.; Ganguly, S.; Ames, S.; Kashinath, K.; Kim, S. K.; Kahou, S.; Maharaj, T.; Beckham, C.; O'Brien, T. A.; Wehner, M. F.; Williams, D. N.; Kunkel, K.; Collins, W. D.

2017-12-01

Deep Learning techniques have revolutionized commercial applications in Computer vision, speech recognition and control systems. The key for all of these developments was the creation of a curated, labeled dataset ImageNet, for enabling multiple research groups around the world to develop methods, benchmark performance and compete with each other. The success of Deep Learning can be largely attributed to the broad availability of this dataset. Our empirical investigations have revealed that Deep Learning is similarly poised to benefit the task of pattern detection in climate science. Unfortunately, labeled datasets, a key pre-requisite for training, are hard to find. Individual research groups are typically interested in specialized weather patterns, making it hard to unify, and share datasets across groups and institutions. In this work, we are proposing ClimateNet: a labeled dataset that provides labeled instances of extreme weather patterns, as well as associated raw fields in model and observational output. We develop a schema in NetCDF to enumerate weather pattern classes/types, store bounding boxes, and pixel-masks. We are also working on a TensorFlow implementation to natively import such NetCDF datasets, and are providing a reference convolutional architecture for binary classification tasks. Our hope is that researchers in Climate Science, as well as ML/DL, will be able to use (and extend) ClimateNet to make rapid progress in the application of Deep Learning for Climate Science research.

NEURAL PROGENITORS, PATTERNING AND ECOLOGY IN NEOCORTICAL ORIGINS

Directory of Open Access Journals (Sweden)

Francisco eAboitiz

2013-11-01

Full Text Available The anatomical organization of the mammalian neocortex stands out among vertebrates for its laminar and columnar arrangement, featuring vertically oriented, excitatory pyramidal neurons. The evolutionary origin of this structure is discussed here in relation to the brain organization of other amniotes, i.e. the sauropsids (reptiles and birds. Specifically, we address the developmental modifications that had to take place to generate the neocortex, and to what extent these modifications were shared by other amniote lineages or can be considered unique to mammals. In this article, we propose a hypothesis that combines the control of proliferation in neural progenitor pools with the specification of regional morphogenetic gradients, yielding different anatomical results by virtue of the differential modulation of these processes in each lineage. Thus, there is a highly conserved genetic and developmental battery that becomes modulated in different directions according to specific selective pressures. In the case of early mammals, ecological conditions like nocturnal habits and reproductive strategies are considered to have played a key role in the selection of the particular brain patterning mechanisms that led to the origin of the neocortex.

Computation and control with neural nets

Energy Technology Data Exchange (ETDEWEB)

Corneliusen, A.; Terdal, P.; Knight, T.; Spencer, J.

1989-10-04

As energies have increased exponentially with time so have the size and complexity of accelerators and control systems. NN may offer the kinds of improvements in computation and control that are needed to maintain acceptable functionality. For control their associative characteristics could provide signal conversion or data translation. Because they can do any computation such as least squares, they can close feedback loops autonomously to provide intelligent control at the point of action rather than at a central location that requires transfers, conversions, hand-shaking and other costly repetitions like input protection. Both computation and control can be integrated on a single chip, printed circuit or an optical equivalent that is also inherently faster through full parallel operation. For such reasons one expects lower costs and better results. Such systems could be optimized by integrating sensor and signal processing functions. Distributed nets of such hardware could communicate and provide global monitoring and multiprocessing in various ways e.g. via token, slotted or parallel rings (or Steiner trees) for compatibility with existing systems. Problems and advantages of this approach such as an optimal, real-time Turing machine are discussed. Simple examples are simulated and hardware implemented using discrete elements that demonstrate some basic characteristics of learning and parallelism. Future microprocessors' are predicted and requested on this basis. 19 refs., 18 figs.

Computation and control with neural nets

International Nuclear Information System (INIS)

Corneliusen, A.; Terdal, P.; Knight, T.; Spencer, J.

1989-01-01

As energies have increased exponentially with time so have the size and complexity of accelerators and control systems. NN may offer the kinds of improvements in computation and control that are needed to maintain acceptable functionality. For control their associative characteristics could provide signal conversion or data translation. Because they can do any computation such as least squares, they can close feedback loops autonomously to provide intelligent control at the point of action rather than at a central location that requires transfers, conversions, hand-shaking and other costly repetitions like input protection. Both computation and control can be integrated on a single chip, printed circuit or an optical equivalent that is also inherently faster through full parallel operation. For such reasons one expects lower costs and better results. Such systems could be optimized by integrating sensor and signal processing functions. Distributed nets of such hardware could communicate and provide global monitoring and multiprocessing in various ways e.g. via token, slotted or parallel rings (or Steiner trees) for compatibility with existing systems. Problems and advantages of this approach such as an optimal, real-time Turing machine are discussed. Simple examples are simulated and hardware implemented using discrete elements that demonstrate some basic characteristics of learning and parallelism. Future 'microprocessors' are predicted and requested on this basis. 19 refs., 18 figs

A Feasibility Study for Perioperative Ventricular Tachycardia Prognosis and Detection and Noise Detection Using a Neural Network and Predictive Linear Operators

Science.gov (United States)

Moebes, T. A.

1994-01-01

To locate the accessory pathway(s) in preexicitation syndromes, epicardial and endocardial ventricular mapping is performed during anterograde ventricular activation via accessory pathway(s) from data originally received in signal form. As the number of channels increases, it is pertinent that more automated detection of coherent/incoherent signals is achieved as well as the prediction and prognosis of ventricular tachywardia (VT). Today's computers and computer program algorithms are not good in simple perceptual tasks such as recognizing a pattern or identifying a sound. This discrepancy, among other things, has been a major motivating factor in developing brain-based, massively parallel computing architectures. Neural net paradigms have proven to be effective at pattern recognition tasks. In signal processing, the picking of coherent/incoherent signals represents a pattern recognition task for computer systems. The picking of signals representing the onset ot VT also represents such a computer task. We attacked this problem by defining four signal attributes for each potential first maximal arrival peak and one signal attribute over the entire signal as input to a back propagation neural network. One attribute was the predicted amplitude value after the maximum amplitude over a data window. Then, by using a set of known (user selected) coherent/incoherent signals, and signals representing the onset of VT, we trained the back propagation network to recognize coherent/incoherent signals, and signals indicating the onset of VT. Since our output scheme involves a true or false decision, and since the output unit computes values between 0 and 1, we used a Fuzzy Arithmetic approach to classify data as coherent/incoherent signals. Furthermore, a Mean-Square Error Analysis was used to determine system stability. The neural net based picking coherent/incoherent signal system achieved high accuracy on picking coherent/incoherent signals on different patients. The system

Temporal-pattern learning in neural models

CERN Document Server

Genís, Carme Torras

1985-01-01

While the ability of animals to learn rhythms is an unquestionable fact, the underlying neurophysiological mechanisms are still no more than conjectures. This monograph explores the requirements of such mechanisms, reviews those previously proposed and postulates a new one based on a direct electric coding of stimulation frequencies. Experi­ mental support for the option taken is provided both at the single neuron and neural network levels. More specifically, the material presented divides naturally into four parts: a description of the experimental and theoretical framework where this work becomes meaningful (Chapter 2), a detailed specifica­ tion of the pacemaker neuron model proposed together with its valida­ tion through simulation (Chapter 3), an analytic study of the behavior of this model when submitted to rhythmic stimulation (Chapter 4) and a description of the neural network model proposed for learning, together with an analysis of the simulation results obtained when varying seve­ ral factors r...

Axial design of fuel for BWRs using neural networks; Diseno axial de combustible para BWRs usando redes neuronales

Energy Technology Data Exchange (ETDEWEB)

Ortiz, J.J.; Castillo, A.; Montes, J.L.; Perusquia, R. [ININ, Carretera Mexico-Toluca s/n, 52750 La Marquesa, Ocoyoacac, Estado de Mexico (Mexico)]. e-mail: jjortiz@nuclear.inin.mx

2007-07-01

In this work a new system of axial optimization of fuel is presented based on a recurrent multi state neural net called RENODC. They are described with detail the main characteristics of this type of neural net (architecture, energy function and actualization of neural states) and like was adapted to the assemble design of nuclear fuel. The fuel design is proven by means of a fuel recharge and pre determined control rod patterns. By this way a good axial fuel design one has, when the thermal limits are fulfilled along the cycle, the reactor stays critic and at least the wanted longitude of the cycle is reached; also the margin of in cold turned off is verified. The assemble of fuel created with RENODC it is substituted by a recharge assemble and it is sought to verify that the energy requirements and aspects of safety are completed. The used cycle corresponds to a balance cycle of 18 months that it can be applied to the Laguna Verde Nucleo electric Central. The tests demonstrate the effectiveness of the system to reach satisfactory results in times of CPU of around 4 hours. This way, it could be proven that the design proposed with a lightly superior enrichment to that of the substituted design, fulfills the energy requirements. In later stages of this project this system will be coupled to the other optimization modules that are already had. (Author)

Forecasting macroeconomic variables using neural network models and three automated model selection techniques

DEFF Research Database (Denmark)

Kock, Anders Bredahl; Teräsvirta, Timo

2016-01-01

When forecasting with neural network models one faces several problems, all of which influence the accuracy of the forecasts. First, neural networks are often hard to estimate due to their highly nonlinear structure. To alleviate the problem, White (2006) presented a solution (QuickNet) that conv...

Optical-Correlator Neural Network Based On Neocognitron

Science.gov (United States)

Chao, Tien-Hsin; Stoner, William W.

1994-01-01

Multichannel optical correlator implements shift-invariant, high-discrimination pattern-recognizing neural network based on paradigm of neocognitron. Selected as basic building block of this neural network because invariance under shifts is inherent advantage of Fourier optics included in optical correlators in general. Neocognitron is conceptual electronic neural-network model for recognition of visual patterns. Multilayer processing achieved by iteratively feeding back output of feature correlator to input spatial light modulator and updating Fourier filters. Neural network trained by use of characteristic features extracted from target images. Multichannel implementation enables parallel processing of large number of selected features.

WATER DEMAND PREDICTION USING ARTIFICIAL NEURAL ...

African Journals Online (AJOL)

This paper presents Hourly water demand prediction at the demand nodes of a water distribution network using NeuNet Pro 2.3 neural network software and the monitoring and control of water distribution using supervisory control. The case study is the Laminga Water Treatment Plant and its water distribution network, Jos.

Pattern recognition, neural networks, genetic algorithms and high performance computing in nuclear reactor diagnostics. Results and perspectives

International Nuclear Information System (INIS)

Dzwinel, W.; Pepyolyshev, N.

1996-01-01

The main goal of this paper is the presentation of our experience in development of the diagnostic system for the IBR-2 (Russia - Dubna) nuclear reactor. The authors show the principal results of the system modifications to make it work more reliable and much faster. The former needs the adaptation of new techniques of data processing, the latter, implementation of the newest computational facilities. The results of application of the clustering techniques and a method of visualization of the multi-dimensional information directly on the operator display are presented. The experiences with neural nets, used for prediction of the reactor operation, are discussed. The genetic algorithms were also tested, to reduce the quantity of data nd extracting the most informative components of the analyzed spectra. (authors)

Towards semen quality assessment using neural networks

DEFF Research Database (Denmark)

Linneberg, Christian; Salamon, P.; Svarer, C.

1994-01-01

The paper presents the methodology and results from a neural net based classification of human sperm head morphology. The methodology uses a preprocessing scheme in which invariant Fourier descriptors are lumped into “energy” bands. The resulting networks are pruned using optimal brain damage. Pe...

Quantitative phase microscopy using deep neural networks

Science.gov (United States)

Li, Shuai; Sinha, Ayan; Lee, Justin; Barbastathis, George

2018-02-01

Deep learning has been proven to achieve ground-breaking accuracy in various tasks. In this paper, we implemented a deep neural network (DNN) to achieve phase retrieval in a wide-field microscope. Our DNN utilized the residual neural network (ResNet) architecture and was trained using the data generated by a phase SLM. The results showed that our DNN was able to reconstruct the profile of the phase target qualitatively. In the meantime, large error still existed, which indicated that our approach still need to be improved.

Control of 12-Cylinder Camless Engine with Neural Networks

Directory of Open Access Journals (Sweden)

Ashhab Moh’d Sami

2017-01-01

Full Text Available The 12-cyliner camless engine breathing process is modeled with artificial neural networks (ANN’s. The inputs to the net are the intake valve lift (IVL and intake valve closing timing (IVC whereas the output of the net is the cylinder air charge (CAC. The ANN is trained with data collected from an engine simulation model which is based on thermodynamics principles and calibrated against real engine data. A method for adapting single-output feed-forward neural networks is proposed and applied to the camless engine ANN model. As a consequence the overall 12-cyliner camless engine feedback controller is upgraded and the necessary changes are implemented in order to contain the adaptive neural network with the objective of tracking the cylinder air charge (driver’s torque demand while minimizing the pumping losses (increasing engine efficiency. All the needed measurements are extracted only from the two conventional and inexpensive sensors, namely, the mass air flow through the throttle body (MAF and the intake manifold absolute pressure (MAP sensors. The feedback controller’s capability is demonstrated through computer simulation.

Patterning and predicting aquatic insect richness in four West-African coastal rivers using artificial neural networks

OpenAIRE

Edia E.O.; Gevrey M.; Ouattara A.; Brosse S.; Gourène G.; Lek S.

2010-01-01

Despite their importance in stream management, the aquatic insect assemblages are still little known in West Africa. This is particularly true in South-Eastern Ivory Coast, where aquatic insect assemblages were hardly studied. We therefore aimed at characterising aquatic insect assemblages on four coastal rivers in South-Eastern Ivory Coast. Patterning aquatic insect assemblages was achieved using a Self-Organizing Map (SOM), an unsupervised Artificial Neural Networks (ANN) method. This metho...

Neural breathing pattern in newborn infants pre- and postextubation.

Science.gov (United States)

Iyer, Narayan P; Dickson, John; Ruiz, Michelle E; Chatburn, Robert; Beck, Jennifer; Sinderby, Chister; Rodriguez, Ricardo J

2017-12-01

To describe the neural breathing pattern before and after extubation in newborn infants. Prospective, observational study. In infants deemed ready for extubation, the diaphragm electrical activity (EAdi) was continuously recorded from 30 minute before to two hours after extubation. Total of 25 neonates underwent 29 extubations; 10 extubations resulted in re-intubation within 72 hours. Postextubation, there was an increase in peak EAdi (EAdi-max) and EAdi-delta (peak minus minimum EAdi) in both groups. The pre- to postextubation change in EAdi-max (8.9-11.1 μv) and EAdi-delta (6-8 μv) was less in the failure group in comparison with the change in EAdi-max (10.2-13.4 μv) and EAdi-delta (6.3-10.6 μv) in the success group, (p = 0.02 and 0.01, respectively). In our neonatal cohort, extubation failure was associated with a smaller increase in peak and delta EAdi after extubation. If confirmed, these findings indicate an important cause of extubation failure in preterm infants. ©2017 Foundation Acta Paediatrica. Published by John Wiley & Sons Ltd.

Using Petri nets for modeling enterprise integration patterns

NARCIS (Netherlands)

Fahland, D.; Gierds, C.

2012-01-01

Enterprise Integration Patterns are a collection of widely used patterns for integrating enterprise applications and business processes. These patterns informally represent typical design decisions for connecting enterprise applications. For the set of patterns collected by Hohpe and Woolf in

Forecast of TEXT plasma disruptions using soft X-rays as input signal in a neural network

International Nuclear Information System (INIS)

Vannucci, A.; Oliveira, K.A.; Tajima, T.; Tajima, Y.J.

2001-01-01

A feed-forward neural network is used to forecast major and minor disruptions in TEXT tokamak discharges. Using the experimental data of soft X-ray signals as input data, the neural net is trained with one disruptive plasma discharge, while a different disruptive discharge is used for validation. After proper training, the net works with the same set of weights, it is then used to forecast disruptions in two other different plasma discharges. It is observed that the neural net is capable of predicting the onset of a disruption up to 3.12 ms in advance. From what we observe in the predictive behavior of our network, speculations are made whether the disruption triggering mechanism is associated with an increase in the m=2 magnetic island, that disturbs the central part of the plasma column afterwards, or the initial perturbation has first occurred in the central part of the plasma column and then the m=2 MHD mode is destabilized. (author)

Optimization of artificial neural networks for the reconstruction of the neutrons spectrum and their equivalent doses

International Nuclear Information System (INIS)

Reyes A, A.; Ortiz R, J. M.; Reyes H, A.; Castaneda M, R.; Solis S, L. O.; Vega C, H. R.

2014-08-01

In this work was used the robust design methodology of artificial neural networks to determine a good topology of net able to solve with efficiency the problems of neutrons spectrometry and dosimetry. For the design of the topology of optimized net 36 different net architectures based on an orthogonal arrangement with a configuration L 9 (3 4 ), L 4 (3 2 ) were trained. For the training of the neural networks, was used a computer code developed in the ambient of Mat lab programming, which automates the process and analysis of the information, reducing the time used in this activity considerably for the investigator. For the training of the propagation nets forward was utilized a neutrons spectrum compendium published by the International Atomic Energy Agency, where of the total 80% was used for the training and 20% for the test, it trained with an inverse propagation algorithm being the entrance data the count rates corresponding to the 7 spheres of the spectrometric system of Bonner spheres, as exit data, the neural network obtains the neutrons spectrum expressed in 60 energy groups and are calculated of simultaneous way 15 dosimetric quantities. (Author)

Patterning and predicting aquatic insect richness in four West-African coastal rivers using artificial neural networks

Directory of Open Access Journals (Sweden)

Edia E.O.

2010-10-01

Full Text Available Despite their importance in stream management, the aquatic insect assemblages are still little known in West Africa. This is particularly true in South-Eastern Ivory Coast, where aquatic insect assemblages were hardly studied. We therefore aimed at characterising aquatic insect assemblages on four coastal rivers in South-Eastern Ivory Coast. Patterning aquatic insect assemblages was achieved using a Self-Organizing Map (SOM, an unsupervised Artificial Neural Networks (ANN method. This method was applied to pattern the samples based on the richness of five major orders of aquatic insects (Diptera, Ephemeroptera, Coleoptera, Trichoptera and Odonata. This permitted to identify three clusters that were mainly related to the local environmental status of sampling sites. Then, we used the environmental characteristics of the sites to predict, using a multilayer perceptron neural network (MLP, trained by BackPropagation algorithm (BP, a supervised ANN, the richness of the five insect orders. The BP showed high predictability (0.90 for both Diptera and Trichoptera, 0.84 for both Coleoptera and Odonata, 0.69 for Ephemeroptera. The most contributing variables in predicting the five insect order richness were pH, conductivity, total dissolved solids, water temperature, percentage of rock and the canopy. This underlines the crucial influence of both instream characteristics and riparian context.

Fluid pipeline system leak detection based on neural network and pattern recognition

International Nuclear Information System (INIS)

Tang Xiujia

1998-01-01

The mechanism of the stress wave propagation along the pipeline system of NPP, caused by turbulent ejection from pipeline leakage, is researched. A series of characteristic index are described in time domain or frequency domain, and compress numerical algorithm is developed for original data compression. A back propagation neural networks (BPNN) with the input matrix composed by stress wave characteristics in time domain or frequency domain is first proposed to classify various situations of the pipeline, in order to detect the leakage in the fluid flow pipelines. The capability of the new method had been demonstrated by experiments and finally used to design a handy instrument for the pipeline leakage detection. Usually a pipeline system has many inner branches and often in adjusting dynamic condition, it is difficult for traditional pipeline diagnosis facilities to identify the difference between inner pipeline operation and pipeline fault. The author first proposed pipeline wave propagation identification by pattern recognition to diagnose pipeline leak. A series of pattern primitives such as peaks, valleys, horizon lines, capstan peaks, dominant relations, slave relations, etc., are used to extract features of the negative pressure wave form. The context-free grammar of symbolic representation of the negative wave form is used, and a negative wave form parsing system with application to structural pattern recognition based on the representation is first proposed to detect and localize leaks of the fluid pipelines

Weaving and neural complexity in symmetric quantum states

Science.gov (United States)

Susa, Cristian E.; Girolami, Davide

2018-04-01

We study the behaviour of two different measures of the complexity of multipartite correlation patterns, weaving and neural complexity, for symmetric quantum states. Weaving is the weighted sum of genuine multipartite correlations of any order, where the weights are proportional to the correlation order. The neural complexity, originally introduced to characterize correlation patterns in classical neural networks, is here extended to the quantum scenario. We derive closed formulas of the two quantities for GHZ states mixed with white noise.

Neural avalanches at the critical point between replay and non-replay of spatiotemporal patterns.

Directory of Open Access Journals (Sweden)

Silvia Scarpetta

Full Text Available We model spontaneous cortical activity with a network of coupled spiking units, in which multiple spatio-temporal patterns are stored as dynamical attractors. We introduce an order parameter, which measures the overlap (similarity between the activity of the network and the stored patterns. We find that, depending on the excitability of the network, different working regimes are possible. For high excitability, the dynamical attractors are stable, and a collective activity that replays one of the stored patterns emerges spontaneously, while for low excitability, no replay is induced. Between these two regimes, there is a critical region in which the dynamical attractors are unstable, and intermittent short replays are induced by noise. At the critical spiking threshold, the order parameter goes from zero to one, and its fluctuations are maximized, as expected for a phase transition (and as observed in recent experimental results in the brain. Notably, in this critical region, the avalanche size and duration distributions follow power laws. Critical exponents are consistent with a scaling relationship observed recently in neural avalanches measurements. In conclusion, our simple model suggests that avalanche power laws in cortical spontaneous activity may be the effect of a network at the critical point between the replay and non-replay of spatio-temporal patterns.

Nonlinear signal processing using neural networks: Prediction and system modelling

Energy Technology Data Exchange (ETDEWEB)

Lapedes, A.; Farber, R.

1987-06-01

The backpropagation learning algorithm for neural networks is developed into a formalism for nonlinear signal processing. We illustrate the method by selecting two common topics in signal processing, prediction and system modelling, and show that nonlinear applications can be handled extremely well by using neural networks. The formalism is a natural, nonlinear extension of the linear Least Mean Squares algorithm commonly used in adaptive signal processing. Simulations are presented that document the additional performance achieved by using nonlinear neural networks. First, we demonstrate that the formalism may be used to predict points in a highly chaotic time series with orders of magnitude increase in accuracy over conventional methods including the Linear Predictive Method and the Gabor-Volterra-Weiner Polynomial Method. Deterministic chaos is thought to be involved in many physical situations including the onset of turbulence in fluids, chemical reactions and plasma physics. Secondly, we demonstrate the use of the formalism in nonlinear system modelling by providing a graphic example in which it is clear that the neural network has accurately modelled the nonlinear transfer function. It is interesting to note that the formalism provides explicit, analytic, global, approximations to the nonlinear maps underlying the various time series. Furthermore, the neural net seems to be extremely parsimonious in its requirements for data points from the time series. We show that the neural net is able to perform well because it globally approximates the relevant maps by performing a kind of generalized mode decomposition of the maps. 24 refs., 13 figs.

Bio-inspired Artificial Intelligence: А Generalized Net Model of the Regularization Process in MLP

Directory of Open Access Journals (Sweden)

Stanimir Surchev

2013-10-01

Full Text Available Many objects and processes inspired by the nature have been recreated by the scientists. The inspiration to create a Multilayer Neural Network came from human brain as member of the group. It possesses complicated structure and it is difficult to recreate, because of the existence of too many processes that require different solving methods. The aim of the following paper is to describe one of the methods that improve learning process of Artificial Neural Network. The proposed generalized net method presents Regularization process in Multilayer Neural Network. The purpose of verification is to protect the neural network from overfitting. The regularization is commonly used in neural network training process. Many methods of verification are present, the subject of interest is the one known as Regularization. It contains function in order to set weights and biases with smaller values to protect from overfitting.

Neural network application to diesel generator diagnostics

International Nuclear Information System (INIS)

Logan, K.P.

1990-01-01

Diagnostic problems typically begin with the observation of some system behavior which is recognized as a deviation from the expected. The fundamental underlying process is one involving pattern matching cf observed symptoms to a set of compiled symptoms belonging to a fault-symptom mapping. Pattern recognition is often relied upon for initial fault detection and diagnosis. Parallel distributed processing (PDP) models employing neural network paradigms are known to be good pattern recognition devices. This paper describes the application of neural network processing techniques to the malfunction diagnosis of subsystems within a typical diesel generator configuration. Neural network models employing backpropagation learning were developed to correctly recognize fault conditions from the input diagnostic symptom patterns pertaining to various engine subsystems. The resulting network models proved to be excellent pattern recognizers for malfunction examples within the training set. The motivation for employing network models in lieu of a rule-based expert system, however, is related to the network's potential for generalizing malfunctions outside of the training set, as in the case of noisy or partial symptom patterns

Beneficial role of noise in artificial neural networks

International Nuclear Information System (INIS)

Monterola, Christopher; Saloma, Caesar; Zapotocky, Martin

2008-01-01

We demonstrate enhancement of neural networks efficacy to recognize frequency encoded signals and/or to categorize spatial patterns of neural activity as a result of noise addition. For temporal information recovery, noise directly added to the receiving neurons allow instantaneous improvement of signal-to-noise ratio [Monterola and Saloma, Phys. Rev. Lett. 2002]. For spatial patterns however, recurrence is necessary to extend and homogenize the operating range of a feed-forward neural network [Monterola and Zapotocky, Phys. Rev. E 2005]. Finally, using the size of the basin of attraction of the networks learned patterns (dynamical fixed points), a procedure for estimating the optimal noise is demonstrated

Thermal photovoltaic solar integrated system analysis using neural networks

Energy Technology Data Exchange (ETDEWEB)

Ashhab, S. [Hashemite Univ., Zarqa (Jordan). Dept. of Mechanical Engineering

2007-07-01

The energy demand in Jordan is primarily met by petroleum products. As such, the development of renewable energy systems is quite attractive. In particular, solar energy is a promising renewable energy source in Jordan and has been used for food canning, paper production, air-conditioning and sterilization. Artificial neural networks (ANNs) have received significant attention due to their capabilities in forecasting, modelling of complex nonlinear systems and control. ANNs have been used for forecasting solar energy. This paper presented a study that examined a thermal photovoltaic solar integrated system that was built in Jordan. Historical input-output system data that was collected experimentally was used to train an ANN that predicted the collector, PV module, pump and total efficiencies. The model predicted the efficiencies well and can therefore be utilized to find the operating conditions of the system that will produce the maximum system efficiencies. The paper provided a description of the photovoltaic solar system including equations for PV module efficiency; pump efficiency; and total efficiency. The paper also presented data relevant to the system performance and neural networks. The results of a neural net model were also presented based on the thermal PV solar integrated system data that was collected. It was concluded that the neural net model of the thermal photovoltaic solar integrated system set the background for achieving the best system performance. 10 refs., 6 figs.

Automatic slice identification in 3D medical images with a ConvNet regressor

NARCIS (Netherlands)

de Vos, Bob D.; Viergever, Max A.; de Jong, Pim A.; Išgum, Ivana

2016-01-01

Identification of anatomical regions of interest is a prerequisite in many medical image analysis tasks. We propose a method that automatically identifies a slice of interest (SOI) in 3D images with a convolutional neural network (ConvNet) regressor. In 150 chest CT scans two reference slices were

Developing Scene Understanding Neural Software for Realistic Autonomous Outdoor Missions

Science.gov (United States)

2017-09-01

computer using a single graphics processing unit (GPU). To the best of our knowledge, an implementation of the open-source Python -based AlexNet CNN on...1. Introduction Neurons in the brain enable us to understand scenes by assessing the spatial, temporal, and feature relations of objects in the...effort to use computer neural networks to augment human neural intelligence to improve our scene understanding (Krizhevsky et al. 2012; Zhou et al

Optimizing Photosynthetic and Respiratory Parameters Based on the Seasonal Variation Pattern in Regional Net Ecosystem Productivity Obtained from Atmospheric Inversion

Science.gov (United States)

Chen, Z.; Chen, J.; Zheng, X.; Jiang, F.; Zhang, S.; Ju, W.; Yuan, W.; Mo, G.

2014-12-01

In this study, we explore the feasibility of optimizing ecosystem photosynthetic and respiratory parameters from the seasonal variation pattern of the net carbon flux. An optimization scheme is proposed to estimate two key parameters (Vcmax and Q10) by exploiting the seasonal variation in the net ecosystem carbon flux retrieved by an atmospheric inversion system. This scheme is implemented to estimate Vcmax and Q10 of the Boreal Ecosystem Productivity Simulator (BEPS) to improve its NEP simulation in the Boreal North America (BNA) region. Simultaneously, in-situ NEE observations at six eddy covariance sites are used to evaluate the NEE simulations. The results show that the performance of the optimized BEPS is superior to that of the BEPS with the default parameter values. These results have the implication on using atmospheric CO2 data for optimizing ecosystem parameters through atmospheric inversion or data assimilation techniques.

Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT.

Science.gov (United States)

Han, Yoseob; Ye, Jong Chul

2018-06-01

X-ray computed tomography (CT) using sparse projection views is a recent approach to reduce the radiation dose. However, due to the insufficient projection views, an analytic reconstruction approach using the filtered back projection (FBP) produces severe streaking artifacts. Recently, deep learning approaches using large receptive field neural networks such as U-Net have demonstrated impressive performance for sparse-view CT reconstruction. However, theoretical justification is still lacking. Inspired by the recent theory of deep convolutional framelets, the main goal of this paper is, therefore, to reveal the limitation of U-Net and propose new multi-resolution deep learning schemes. In particular, we show that the alternative U-Net variants such as dual frame and tight frame U-Nets satisfy the so-called frame condition which makes them better for effective recovery of high frequency edges in sparse-view CT. Using extensive experiments with real patient data set, we demonstrate that the new network architectures provide better reconstruction performance.

A neural model for transient identification in dynamic processes with 'don't know' response

International Nuclear Information System (INIS)

Mol, Antonio C. de A.; Martinez, Aquilino S.; Schirru, Roberto

2003-01-01

This work presents an approach for neural network based transient identification which allows either dynamic identification or a 'don't know' response. The approach uses two 'jump' multilayer neural networks (NN) trained with the backpropagation algorithm. The 'jump' network is used because it is useful to dealing with very complex patterns, which is the case of the space of the state variables during some abnormal events. The first one is responsible for the dynamic identification. This NN uses, as input, a short set (in a moving time window) of recent measurements of each variable avoiding the necessity of using starting events. The other one is used to validate the instantaneous identification (from the first net) through the validation of each variable. This net is responsible for allowing the system to provide a 'don't know' response. In order to validate the method, a Nuclear Power Plant (NPP) transient identification problem comprising 15 postulated accidents, simulated for a pressurized water reactor (PWR), was proposed in the validation process it has been considered noisy data in order to evaluate the method robustness. Obtained results reveal the ability of the method in dealing with both dynamic identification of transients and correct 'don't know' response. Another important point studied in this work is that the system has shown to be independent of a trigger signal which indicates the beginning of the transient, thus making it robust in relation to this limitation

Identification of phosphorylation sites in protein kinase A substrates using artificial neural networks and mass spectrometry

DEFF Research Database (Denmark)

Hjerrild, M.; Stensballe, A.; Rasmussen, T.E.

2004-01-01

Protein phosphorylation plays a key role in cell regulation and identification of phosphorylation sites is important for understanding their functional significance. Here, we present an artificial neural network algorithm: NetPhosK (http://www.cbs.dtu.dk/services/NetPhosK/) that predicts protein...

Identification of phosphorylation sites in protein kinase A substrates using artificial neural networks and mass spectrometry

DEFF Research Database (Denmark)

Hjerrild, Majbrit; Stensballe, Allan; Rasmussen, Thomas E

2011-01-01

Protein phosphorylation plays a key role in cell regulation and identification of phosphorylation sites is important for understanding their functional significance. Here, we present an artificial neural network algorithm: NetPhosK (http://www.cbs.dtu.dk/services/NetPhosK/) that predicts protein...

A novel low-voltage low-power analogue VLSI implementation of neural networks with on-chip back-propagation learning

Science.gov (United States)

Carrasco, Manuel; Garde, Andres; Murillo, Pilar; Serrano, Luis

2005-06-01

In this paper a novel design and implementation of a VLSI Analogue Neural Net based on Multi-Layer Perceptron (MLP) with on-chip Back Propagation (BP) learning algorithm suitable for the resolution of classification problems is described. In order to implement a general and programmable analogue architecture, the design has been carried out in a hierarchical way. In this way the net has been divided in synapsis-blocks and neuron-blocks providing an easy method for the analysis. These blocks basically consist on simple cells, which are mainly, the activation functions (NAF), derivatives (DNAF), multipliers and weight update circuits. The analogue design is based on current-mode translinear techniques using MOS transistors working in the weak inversion region in order to reduce both the voltage supply and the power consumption. Moreover, with the purpose of minimizing the noise, offset and distortion of even order, the topologies are fully-differential and balanced. The circuit, named ANNE (Analogue Neural NEt), has been prototyped and characterized as a proof of concept on CMOS AMI-0.5A technology occupying a total area of 2.7mm2. The chip includes two versions of neural nets with on-chip BP learning algorithm, which are respectively a 2-1 and a 2-2-1 implementations. The proposed nets have been experimentally tested using supply voltages from 2.5V to 1.8V, which is suitable for single cell lithium-ion battery supply applications. Experimental results of both implementations included in ANNE exhibit a good performance on solving classification problems. These results have been compared with other proposed Analogue VLSI implementations of Neural Nets published in the literature demonstrating that our proposal is very efficient in terms of occupied area and power consumption.

Schema benefit vs. proactive interference: Contradicting behavioral outcomes and coexisting neural patterns.

Science.gov (United States)

Oren, Noga; Shapira-Lichter, Irit; Lerner, Yulia; Tarrasch, Ricardo; Hendler, Talma; Giladi, Nir; Ash, Elissa L

2017-09-01

Prior knowledge can either assist or hinder the ability to learn new information. These contradicting behavioral outcomes, referred to as schema benefit and proactive interference respectively, have been studied separately. Here we examined whether the known neural correlates of each process coexist, and how they are influenced by attentional loading and aging. To this end we used an fMRI task that affected both processes simultaneously by presenting pairs of related short movies in succession. The first movie of each pair provided context for the second movie, which could evoke schema benefit and/or proactive interference. Inclusion of an easy or hard secondary task performed during encoding of the movies, as well as testing both younger (22-35y) and older (65-79y) adults, allowed examining the effect of attentional load and older age on the neural patterns associated with context. Analyses focused on three predefined regions and examined how their inter-subject correlation (inter-SC) and functional connectivity (FC) with the hippocampi changed between the first and second movie. The results in the medial prefrontal cortex (mPFC) and posterior cingulate cortex (PCC) matched and expanded previous findings: higher inter-SC and lower FC were observed during the second compared to the first movie; yet the differentiation between the first and second movies in these regions was attenuated under high attentional load, pointing to dependency on attentional resources. Instead, at high load there was a significant context effect in the FC of the left ventrolateral prefrontal cortex (vlPFC), and greater FC in the second movie was related to greater proactive interference. Further, older adults showed context effect in the PCC and vlPFC. Intriguingly, older adults with inter-SC mPFC patterns similar to younger adults exhibited schema benefit in our task, while those with inter-SC PCC patterns similar to younger adults showed proactive interference in an independent task. The

Comparison of eye imaging pattern recognition using neural network

Science.gov (United States)

Bukhari, W. M.; Syed A., M.; Nasir, M. N. M.; Sulaima, M. F.; Yahaya, M. S.

2015-05-01

The beauty of eye recognition system that it is used in automatic identifying and verifies a human weather from digital images or video source. There are various behaviors of the eye such as the color of the iris, size of pupil and shape of the eye. This study represents the analysis, design and implementation of a system for recognition of eye imaging. All the eye images that had been captured from the webcam in RGB format must through several techniques before it can be input for the pattern and recognition processes. The result shows that the final value of weight and bias after complete training 6 eye images for one subject is memorized by the neural network system and be the reference value of the weight and bias for the testing part. The target classifies to 5 different types for 5 subjects. The eye images can recognize the subject based on the target that had been set earlier during the training process. When the values between new eye image and the eye image in the database are almost equal, it is considered the eye image is matched.

Using Neural Pattern Classifiers to Quantify the Modularity of Conflict–Control Mechanisms in the Human Brain

Science.gov (United States)

Jiang, Jiefeng; Egner, Tobias

2014-01-01

Resolving conflicting sensory and motor representations is a core function of cognitive control, but it remains uncertain to what degree control over different sources of conflict is implemented by shared (domain general) or distinct (domain specific) neural resources. Behavioral data suggest conflict–control to be domain specific, but results from neuroimaging studies have been ambivalent. Here, we employed multivoxel pattern analyses that can decode a brain region's informational content, allowing us to distinguish incidental activation overlap from actual shared information processing. We trained independent sets of “searchlight” classifiers on functional magnetic resonance imaging data to decode control processes associated with stimulus-conflict (Stroop task) and ideomotor-conflict (Simon task). Quantifying the proportion of domain-specific searchlights (capable of decoding only one type of conflict) and domain-general searchlights (capable of decoding both conflict types) in each subject, we found both domain-specific and domain-general searchlights, though the former were more common. When mapping anatomical loci of these searchlights across subjects, neural substrates of stimulus- and ideomotor-specific conflict–control were found to be anatomically consistent across subjects, whereas the substrates of domain-general conflict–control were not. Overall, these findings suggest a hybrid neural architecture of conflict–control that entails both modular (domain specific) and global (domain general) components. PMID:23402762

Convolutional Neural Network for Histopathological Analysis of Osteosarcoma.

Science.gov (United States)

Mishra, Rashika; Daescu, Ovidiu; Leavey, Patrick; Rakheja, Dinesh; Sengupta, Anita

2018-03-01

Pathologists often deal with high complexity and sometimes disagreement over osteosarcoma tumor classification due to cellular heterogeneity in the dataset. Segmentation and classification of histology tissue in H&E stained tumor image datasets is a challenging task because of intra-class variations, inter-class similarity, crowded context, and noisy data. In recent years, deep learning approaches have led to encouraging results in breast cancer and prostate cancer analysis. In this article, we propose convolutional neural network (CNN) as a tool to improve efficiency and accuracy of osteosarcoma tumor classification into tumor classes (viable tumor, necrosis) versus nontumor. The proposed CNN architecture contains eight learned layers: three sets of stacked two convolutional layers interspersed with max pooling layers for feature extraction and two fully connected layers with data augmentation strategies to boost performance. The use of a neural network results in higher accuracy of average 92% for the classification. We compare the proposed architecture with three existing and proven CNN architectures for image classification: AlexNet, LeNet, and VGGNet. We also provide a pipeline to calculate percentage necrosis in a given whole slide image. We conclude that the use of neural networks can assure both high accuracy and efficiency in osteosarcoma classification.

Convolutional neural network approach for enhanced capture of breast parenchymal complexity patterns associated with breast cancer risk

Science.gov (United States)

Oustimov, Andrew; Gastounioti, Aimilia; Hsieh, Meng-Kang; Pantalone, Lauren; Conant, Emily F.; Kontos, Despina

2017-03-01

We assess the feasibility of a parenchymal texture feature fusion approach, utilizing a convolutional neural network (ConvNet) architecture, to benefit breast cancer risk assessment. Hypothesizing that by capturing sparse, subtle interactions between localized motifs present in two-dimensional texture feature maps derived from mammographic images, a multitude of texture feature descriptors can be optimally reduced to five meta-features capable of serving as a basis on which a linear classifier, such as logistic regression, can efficiently assess breast cancer risk. We combine this methodology with our previously validated lattice-based strategy for parenchymal texture analysis and we evaluate the feasibility of this approach in a case-control study with 424 digital mammograms. In a randomized split-sample setting, we optimize our framework in training/validation sets (N=300) and evaluate its descriminatory performance in an independent test set (N=124). The discriminatory capacity is assessed in terms of the the area under the curve (AUC) of the receiver operator characteristic (ROC). The resulting meta-features exhibited strong classification capability in the test dataset (AUC = 0.90), outperforming conventional, non-fused, texture analysis which previously resulted in an AUC=0.85 on the same case-control dataset. Our results suggest that informative interactions between localized motifs exist and can be extracted and summarized via a fairly simple ConvNet architecture.

Activity patterns of cultured neural networks on micro electrode arrays

NARCIS (Netherlands)

Rutten, Wim; van Pelt, J.

2001-01-01

A hybrid neuro-electronic interface is a cell-cultured micro electrode array, acting as a neural information transducer for stimulation and/or recording of neural activity in the brain or the spinal cord (ventral motor region or dorsal sensory region). It consists of an array of micro electrodes on

Evaluating the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks

International Nuclear Information System (INIS)

Ortiz-Rodríguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solís Sánches, L. O.; Miranda, R. Castañeda; Cervantes Viramontes, J. M.; Vega-Carrillo, H. R.

2013-01-01

In this work the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks is evaluated. The first one code based on traditional iterative procedures and called Neutron spectrometry and dosimetry from the Universidad Autonoma de Zacatecas (NSDUAZ) use the SPUNIT iterative algorithm and was designed to unfold neutron spectrum and calculate 15 dosimetric quantities and 7 IAEA survey meters. The main feature of this code is the automated selection of the initial guess spectrum trough a compendium of neutron spectrum compiled by the IAEA. The second one code known as Neutron spectrometry and dosimetry with artificial neural networks (NDSann) is a code designed using neural nets technology. The artificial intelligence approach of neural net does not solve mathematical equations. By using the knowledge stored at synaptic weights on a neural net properly trained, the code is capable to unfold neutron spectrum and to simultaneously calculate 15 dosimetric quantities, needing as entrance data, only the rate counts measured with a Bonner spheres system. Similarities of both NSDUAZ and NSDann codes are: they follow the same easy and intuitive user's philosophy and were designed in a graphical interface under the LabVIEW programming environment. Both codes unfold the neutron spectrum expressed in 60 energy bins, calculate 15 dosimetric quantities and generate a full report in HTML format. Differences of these codes are: NSDUAZ code was designed using classical iterative approaches and needs an initial guess spectrum in order to initiate the iterative procedure. In NSDUAZ, a programming routine was designed to calculate 7 IAEA instrument survey meters using the fluence-dose conversion coefficients. NSDann code use artificial neural networks for solving the ill-conditioned equation system of neutron spectrometry problem through synaptic weights of a properly trained neural network. Contrary to iterative procedures, in neural

Evaluating the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks

Science.gov (United States)

Ortiz-Rodríguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solís Sánches, L. O.; Miranda, R. Castañeda; Cervantes Viramontes, J. M.; Vega-Carrillo, H. R.

2013-07-01

In this work the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks is evaluated. The first one code based on traditional iterative procedures and called Neutron spectrometry and dosimetry from the Universidad Autonoma de Zacatecas (NSDUAZ) use the SPUNIT iterative algorithm and was designed to unfold neutron spectrum and calculate 15 dosimetric quantities and 7 IAEA survey meters. The main feature of this code is the automated selection of the initial guess spectrum trough a compendium of neutron spectrum compiled by the IAEA. The second one code known as Neutron spectrometry and dosimetry with artificial neural networks (NDSann) is a code designed using neural nets technology. The artificial intelligence approach of neural net does not solve mathematical equations. By using the knowledge stored at synaptic weights on a neural net properly trained, the code is capable to unfold neutron spectrum and to simultaneously calculate 15 dosimetric quantities, needing as entrance data, only the rate counts measured with a Bonner spheres system. Similarities of both NSDUAZ and NSDann codes are: they follow the same easy and intuitive user's philosophy and were designed in a graphical interface under the LabVIEW programming environment. Both codes unfold the neutron spectrum expressed in 60 energy bins, calculate 15 dosimetric quantities and generate a full report in HTML format. Differences of these codes are: NSDUAZ code was designed using classical iterative approaches and needs an initial guess spectrum in order to initiate the iterative procedure. In NSDUAZ, a programming routine was designed to calculate 7 IAEA instrument survey meters using the fluence-dose conversion coefficients. NSDann code use artificial neural networks for solving the ill-conditioned equation system of neutron spectrometry problem through synaptic weights of a properly trained neural network. Contrary to iterative procedures, in neural

Evaluating the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks

Energy Technology Data Exchange (ETDEWEB)

Ortiz-Rodriguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solis Sanches, L. O.; Miranda, R. Castaneda; Cervantes Viramontes, J. M. [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica. Av. Ramon Lopez Velarde 801. Col. Centro Zacatecas, Zac (Mexico); Vega-Carrillo, H. R. [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica. Av. Ramon Lopez Velarde 801. Col. Centro Zacatecas, Zac., Mexico. and Unidad Academica de Estudios Nucleares. C. Cip (Mexico)

2013-07-03

In this work the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks is evaluated. The first one code based on traditional iterative procedures and called Neutron spectrometry and dosimetry from the Universidad Autonoma de Zacatecas (NSDUAZ) use the SPUNIT iterative algorithm and was designed to unfold neutron spectrum and calculate 15 dosimetric quantities and 7 IAEA survey meters. The main feature of this code is the automated selection of the initial guess spectrum trough a compendium of neutron spectrum compiled by the IAEA. The second one code known as Neutron spectrometry and dosimetry with artificial neural networks (NDSann) is a code designed using neural nets technology. The artificial intelligence approach of neural net does not solve mathematical equations. By using the knowledge stored at synaptic weights on a neural net properly trained, the code is capable to unfold neutron spectrum and to simultaneously calculate 15 dosimetric quantities, needing as entrance data, only the rate counts measured with a Bonner spheres system. Similarities of both NSDUAZ and NSDann codes are: they follow the same easy and intuitive user's philosophy and were designed in a graphical interface under the LabVIEW programming environment. Both codes unfold the neutron spectrum expressed in 60 energy bins, calculate 15 dosimetric quantities and generate a full report in HTML format. Differences of these codes are: NSDUAZ code was designed using classical iterative approaches and needs an initial guess spectrum in order to initiate the iterative procedure. In NSDUAZ, a programming routine was designed to calculate 7 IAEA instrument survey meters using the fluence-dose conversion coefficients. NSDann code use artificial neural networks for solving the ill-conditioned equation system of neutron spectrometry problem through synaptic weights of a properly trained neural network. Contrary to iterative procedures, in

Visualizing deep neural network by alternately image blurring and deblurring.

Science.gov (United States)

Wang, Feng; Liu, Haijun; Cheng, Jian

2018-01-01

Visualization from trained deep neural networks has drawn massive public attention in recent. One of the visualization approaches is to train images maximizing the activation of specific neurons. However, directly maximizing the activation would lead to unrecognizable images, which cannot provide any meaningful information. In this paper, we introduce a simple but effective technique to constrain the optimization route of the visualization. By adding two totally inverse transformations, image blurring and deblurring, to the optimization procedure, recognizable images can be created. Our algorithm is good at extracting the details in the images, which are usually filtered by previous methods in the visualizations. Extensive experiments on AlexNet, VGGNet and GoogLeNet illustrate that we can better understand the neural networks utilizing the knowledge obtained by the visualization. Copyright © 2017 Elsevier Ltd. All rights reserved.

Development of nuclear power plant diagnosis technique using neural networks

International Nuclear Information System (INIS)

Horiguchi, Masahiro; Fukawa, Naohiro; Nishimura, Kazuo

1991-01-01

A nuclear power plant diagnosis technique has been developed, called transient phenomena analysis, which employs neural network. The neural networks identify malfunctioning equipment by recognizing the pattern of main plant parameters, making it possible to locate the cause of an abnormality when a plant is in a transient state. In a case where some piece of equipment shows abnormal behavior, many plant parameters either directly or indirectly related to that equipment change simultaneously. When an abrupt change in a plant parameter is detected, changes in the 49 main plant parameters are classified into three types and a characteristic change pattern consisting of 49 data is defined. The neural networks then judge the cause of the abnormality from this pattern. This neural-network-based technique can recognize 100 patterns that are characterized by the causes of plant abnormality. (author)

An Effective and Novel Neural Network Ensemble for Shift Pattern Detection in Control Charts

Directory of Open Access Journals (Sweden)

Mahmoud Barghash

2015-01-01

Full Text Available Pattern recognition in control charts is critical to make a balance between discovering faults as early as possible and reducing the number of false alarms. This work is devoted to designing a multistage neural network ensemble that achieves this balance which reduces rework and scrape without reducing productivity. The ensemble under focus is composed of a series of neural network stages and a series of decision points. Initially, this work compared using multidecision points and single-decision point on the performance of the ANN which showed that multidecision points are highly preferable to single-decision points. This work also tested the effect of population percentages on the ANN and used this to optimize the ANN’s performance. Also this work used optimized and nonoptimized ANNs in an ensemble and proved that using nonoptimized ANN may reduce the performance of the ensemble. The ensemble that used only optimized ANNs has improved performance over individual ANNs and three-sigma level rule. In that respect using the designed ensemble can help in reducing the number of false stops and increasing productivity. It also can be used to discover even small shifts in the mean as early as possible.

Dlx proteins position the neural plate border and determine adjacent cell fates.

Science.gov (United States)

Woda, Juliana M; Pastagia, Julie; Mercola, Mark; Artinger, Kristin Bruk

2003-01-01

The lateral border of the neural plate is a major source of signals that induce primary neurons, neural crest cells and cranial placodes as well as provide patterning cues to mesodermal structures such as somites and heart. Whereas secreted BMP, FGF and Wnt proteins influence the differentiation of neural and non-neural ectoderm, we show here that members of the Dlx family of transcription factors position the border between neural and non-neural ectoderm and are required for the specification of adjacent cell fates. Inhibition of endogenous Dlx activity in Xenopus embryos with an EnR-Dlx homeodomain fusion protein expands the neural plate into non-neural ectoderm tissue whereas ectopic activation of Dlx target genes inhibits neural plate differentiation. Importantly, the stereotypic pattern of border cell fates in the adjacent ectoderm is re-established only under conditions where the expanded neural plate abuts Dlx-positive non-neural ectoderm. Experiments in which presumptive neural plate was grafted to ventral ectoderm reiterate induction of neural crest and placodal lineages and also demonstrate that Dlx activity is required in non-neural ectoderm for the production of signals needed for induction of these cells. We propose that Dlx proteins regulate intercellular signaling across the interface between neural and non-neural ectoderm that is critical for inducing and patterning adjacent cell fates.

predicting water levels at kainji dam using artificial neural networks

African Journals Online (AJOL)

2013-03-01

Mar 1, 2013 ... Apart from insufficient number of power generation plants, existing ones are ... ture and/or functional aspects of biological neural net-. Nigerian Journal of ... Their model used the radiosonde-based 700-hPa wind direction and ...

Emergent intelligent properties of progressively structured pattern recognition nets

Energy Technology Data Exchange (ETDEWEB)

Aleksander, I

1983-07-01

The n-tuple recognition net is seen as a building brick of a progression of network structures. The emergent intelligent properties of such systems are discussed. They include the amplification of confidence for the recognition of images that differ in small detail, a short term memory of the last seen image, sequence sensitivity, sequence sensitivity, sequence acceptance and saccadic inspection as an aid in scene analysis. 12 references.

ObamaNet: Photo-realistic lip-sync from text

OpenAIRE

Kumar, Rithesh; Sotelo, Jose; Kumar, Kundan; de Brebisson, Alexandre; Bengio, Yoshua

2017-01-01

We present ObamaNet, the first architecture that generates both audio and synchronized photo-realistic lip-sync videos from any new text. Contrary to other published lip-sync approaches, ours is only composed of fully trainable neural modules and does not rely on any traditional computer graphics methods. More precisely, we use three main modules: a text-to-speech network based on Char2Wav, a time-delayed LSTM to generate mouth-keypoints synced to the audio, and a network based on Pix2Pix to ...

HANPP Collection: Human Appropriation of Net Primary Productivity (HANPP) by Country and Product

Data.gov (United States)

National Aeronautics and Space Administration — The Global Patterns in Human Appropriation of Net Primary Productivity (HANPP) portion of the HANPP Collection represents a digital map of human appropriation of net...

Artificial neural networks in NDT

International Nuclear Information System (INIS)

Abdul Aziz Mohamed

2001-01-01

Artificial neural networks, simply known as neural networks, have attracted considerable interest in recent years largely because of a growing recognition of the potential of these computational paradigms as powerful alternative models to conventional pattern recognition or function approximation techniques. The neural networks approach is having a profound effect on almost all fields, and has been utilised in fields Where experimental inter-disciplinary work is being carried out. Being a multidisciplinary subject with a broad knowledge base, Nondestructive Testing (NDT) or Nondestructive Evaluation (NDE) is no exception. This paper explains typical applications of neural networks in NDT/NDE. Three promising types of neural networks are highlighted, namely, back-propagation, binary Hopfield and Kohonen's self-organising maps. (Author)

Neural network approach to radiologic lesion detection

International Nuclear Information System (INIS)

Newman, F.D.; Raff, U.; Stroud, D.

1989-01-01

An area of artificial intelligence that has gained recent attention is the neural network approach to pattern recognition. The authors explore the use of neural networks in radiologic lesion detection with what is known in the literature as the novelty filter. This filter uses a linear model; images of normal patterns become training vectors and are stored as columns of a matrix. An image of an abnormal pattern is introduced and the abnormality or novelty is extracted. A VAX 750 was used to encode the novelty filter, and two experiments have been examined

Neural coding in graphs of bidirectional associative memories.

Science.gov (United States)

Bouchain, A David; Palm, Günther

2012-01-24

In the last years we have developed large neural network models for the realization of complex cognitive tasks in a neural network architecture that resembles the network of the cerebral cortex. We have used networks of several cortical modules that contain two populations of neurons (one excitatory, one inhibitory). The excitatory populations in these so-called "cortical networks" are organized as a graph of Bidirectional Associative Memories (BAMs), where edges of the graph correspond to BAMs connecting two neural modules and nodes of the graph correspond to excitatory populations with associative feedback connections (and inhibitory interneurons). The neural code in each of these modules consists essentially of the firing pattern of the excitatory population, where mainly it is the subset of active neurons that codes the contents to be represented. The overall activity can be used to distinguish different properties of the patterns that are represented which we need to distinguish and control when performing complex tasks like language understanding with these cortical networks. The most important pattern properties or situations are: exactly fitting or matching input, incomplete information or partially matching pattern, superposition of several patterns, conflicting information, and new information that is to be learned. We show simple simulations of these situations in one area or module and discuss how to distinguish these situations based on the overall internal activation of the module. This article is part of a Special Issue entitled "Neural Coding". Copyright © 2011 Elsevier B.V. All rights reserved.

Built-in self-repair of VLSI memories employing neural nets

Science.gov (United States)

Mazumder, Pinaki

1998-10-01

The decades of the Eighties and the Nineties have witnessed the spectacular growth of VLSI technology, when the chip size has increased from a few hundred devices to a staggering multi-millon transistors. This trend is expected to continue as the CMOS feature size progresses towards the nanometric dimension of 100 nm and less. SIA roadmap projects that, where as the DRAM chips will integrate over 20 billion devices in the next millennium, the future microprocessors may incorporate over 100 million transistors on a single chip. As the VLSI chip size increase, the limited accessibility of circuit components poses great difficulty for external diagnosis and replacement in the presence of faulty components. For this reason, extensive work has been done in built-in self-test techniques, but little research is known concerning built-in self-repair. Moreover, the extra hardware introduced by conventional fault-tolerance techniques is also likely to become faulty, therefore causing the circuit to be useless. This research demonstrates the feasibility of implementing electronic neural networks as intelligent hardware for memory array repair. Most importantly, we show that the neural network control possesses a robust and degradable computing capability under various fault conditions. Overall, a yield analysis performed on 64K DRAM's shows that the yield can be improved from as low as 20 percent to near 99 percent due to the self-repair design, with overhead no more than 7 percent.

Pulse-coupled neural nets: translation, rotation, scale, distortion, and intensity signal invariance for images.

Science.gov (United States)

Johnson, J L

1994-09-10

The linking-field neural network model of Eckhorn et al. [Neural Comput. 2, 293-307 (1990)] was introduced to explain the experimentally observed synchronous activity among neural assemblies in the cat cortex induced by feature-dependent visual activity. The model produces synchronous bursts of pulses from neurons with similar activity, effectively grouping them by phase and pulse frequency. It gives a basic new function: grouping by similarity. The synchronous bursts are obtained in the limit of strong linking strengths. The linking-field model in the limit of moderate-to-weak linking characterized by few if any multiple bursts is investigated. In this limit dynamic, locally periodic traveling waves exist whose time signal encodes the geometrical structure of a two-dimensional input image. The signal can be made insensitive to translation, scale, rotation, distortion, and intensity. The waves transmit information beyond the physical interconnect distance. The model is implemented in an optical hybrid demonstration system. Results of the simulations and the optical system are presented.

Migration signatures across the decades: Net migration by age in U.S. counties, 1950-2010

Directory of Open Access Journals (Sweden)

Richelle L. Winkler

2015-05-01

Full Text Available Background: Migration is the primary population redistribution process in the United States. Selective migration by age, race/ethnic group, and spatial location governs population integration, affects community and economic development, contributes to land use change, and structures service needs. Objective: Delineate historical net migration patterns by age, race/ethnic, and rural-urban dimensions for United States counties. Methods: Net migration rates by age for all US counties are aggregated from 1950−2010, summarized by rural-urban location and compared to explore differential race/ethnic patterns of age-specific net migration over time. Results: We identify distinct age-specific net migration 'signatures' that are consistent over time within county types, but different by rural-urban location and race/ethnic group. There is evidence of moderate population deconcentration and diminished racial segregation between 1990 and 2010. This includes a net outflow of Blacks from large urban core counties to suburban and smaller metropolitan counties, continued Hispanic deconcentration, and a slowdown in White counterurbanization. Conclusions: This paper contributes to a fuller understanding of the complex patterns of migration that have redistributed the U.S. population over the past six decades. It documents the variability in county age-specific net migration patterns both temporally and spatially, as well as the longitudinal consistency in migration signatures among county types and race/ethnic groups.

Neural processing of auditory signals and modular neural control for sound tropism of walking machines

DEFF Research Database (Denmark)

Manoonpong, Poramate; Pasemann, Frank; Fischer, Joern

2005-01-01

and a neural preprocessing system together with a modular neural controller are used to generate a sound tropism of a four-legged walking machine. The neural preprocessing network is acting as a low-pass filter and it is followed by a network which discerns between signals coming from the left or the right....... The parameters of these networks are optimized by an evolutionary algorithm. In addition, a simple modular neural controller then generates the desired different walking patterns such that the machine walks straight, then turns towards a switched-on sound source, and then stops near to it....

Improvement of the Hopfield Neural Network by MC-Adaptation Rule

Science.gov (United States)

Zhou, Zhen; Zhao, Hong

2006-06-01

We show that the performance of the Hopfield neural networks, especially the quality of the recall and the capacity of the effective storing, can be greatly improved by making use of a recently presented neural network designing method without altering the whole structure of the network. In the improved neural network, a memory pattern is recalled exactly from initial states having a given degree of similarity with the memory pattern, and thus one can avoids to apply the overlap criterion as carried out in the Hopfield neural networks.

Character Recognition Using Genetically Trained Neural Networks

Energy Technology Data Exchange (ETDEWEB)

Diniz, C.; Stantz, K.M.; Trahan, M.W.; Wagner, J.S.

1998-10-01

Computationally intelligent recognition of characters and symbols addresses a wide range of applications including foreign language translation and chemical formula identification. The combination of intelligent learning and optimization algorithms with layered neural structures offers powerful techniques for character recognition. These techniques were originally developed by Sandia National Laboratories for pattern and spectral analysis; however, their ability to optimize vast amounts of data make them ideal for character recognition. An adaptation of the Neural Network Designer soflsvare allows the user to create a neural network (NN_) trained by a genetic algorithm (GA) that correctly identifies multiple distinct characters. The initial successfid recognition of standard capital letters can be expanded to include chemical and mathematical symbols and alphabets of foreign languages, especially Arabic and Chinese. The FIN model constructed for this project uses a three layer feed-forward architecture. To facilitate the input of characters and symbols, a graphic user interface (GUI) has been developed to convert the traditional representation of each character or symbol to a bitmap. The 8 x 8 bitmap representations used for these tests are mapped onto the input nodes of the feed-forward neural network (FFNN) in a one-to-one correspondence. The input nodes feed forward into a hidden layer, and the hidden layer feeds into five output nodes correlated to possible character outcomes. During the training period the GA optimizes the weights of the NN until it can successfully recognize distinct characters. Systematic deviations from the base design test the network's range of applicability. Increasing capacity, the number of letters to be recognized, requires a nonlinear increase in the number of hidden layer neurodes. Optimal character recognition performance necessitates a minimum threshold for the number of cases when genetically training the net. And, the

An electronic system for simulation of neural networks with a micro-second real time constraint

International Nuclear Information System (INIS)

Chorti, Arsenia; Granado, Bertrand; Denby, Bruce; Garda, Patrick

2001-01-01

Neural networks implemented in hardware can perform pattern recognition very quickly, and as such have been used to advantage in the triggering systems of certain high energy physics experiments. Typically, time constants of the order of a few microseconds are required. In this paper, we present a new system. MAHARADJA, for evaluating MLP and RBF neural network paradigms in real time. The system is tested on a possible ATLAS muon triggering application suggested by the Tel Aviv ATLAS group, consisting of a 4-8-8-4 MLP which must be evaluated in 10 microseconds. The inputs to the net are dx/dz, x(z=0), dy/dz, and y(z=0), whereas the outputs give pt, tan(phi), sin(theta), and q, the charge. With a 10 MHz clock, MAHARADJA calculates the result in 6.8 microseconds; at 20 MHz, which is readily attainable, this would be reduced to only 3.4 microseconds. The system can also handle RBF networks with 3 different distance metrics (Euclidean, Manhattan and Mahalanobis), and can simulate any MLP of 10 hidden layers or less. The electronic implementation is with FPGA's, which can be optimized for a specific neural network because the number of processing elements can be modified

Neural-net predictor for beta limit disruptions in JT-60U

International Nuclear Information System (INIS)

Yoshino, R.

2005-01-01

Prediction of major disruptions occurring at the β -limit for tokamak plasmas with a normal magnetic shear in JT-60U was conducted using neural networks. Since no clear precursors are generally observed a few tens of milliseconds before the β -limit disruption, a sub-neural network is trained to output the value of the β N limit every 2 ms. The target β N limit is artificially set by the operator in the first step to train a network with non-disruptive shots as well as disruptive shots, and then in the second step the target limit is modified using the β N limit output from the trained network. The adjusted target greatly improves the consistency between the input data and the output. This training, the 'self-teaching method', has greatly reduced the false alarm rate triggered for non-disruptive shots. To improve the prediction performance further, the difference between the output β N limit and the measured β N , and 11 parameters, are inputted to the main neural network to calculate the 'stability level'. The occurrence of a major disruption is predicted when the stability level decreases to the 'alarm level'. Major disruptions at the β -limit have been predicted by the main network with a prediction success rate of 80% at 10 ms prior to the disruption while the false alarm rate is lower than 4% for non-disruptive shots. This 80% value is much higher than that obtained for a network trained with a fixed target β N limit set to be the maximum β N observed at the start of a major disruption, lower than 10%. A prediction success rate of 90% with a false alarm rate of 12% at 10 ms prior to the disruption has also been obtained. This 12% value is about half of that obtained for a network trained with a fixed target β N limit

Effect of the size of an artificial neural network used as pattern identifier

International Nuclear Information System (INIS)

Reynoso V, M.R.; Vega C, J.J.

2003-01-01

A novel way to extract relevant parameters associated with the outgoing ions from nuclear reactions, obtained by digitizing the signals provided by a Bragg curve spectrometer (BCS) is presented. This allowed the implementation of a more thorough pulse-shape analysis. Due to the complexity of this task, it was required to take advantage of new and more powerful computational paradigms. This was fulfilled using a back-propagation artificial neural network (ANN) as a pattern identifier. Over training of ANNs is a common problem during the training stage. In the performance of the ANN there is a compromise between its size and the size of the training set. Here, this effect will be illustrated in relation to the problem of Bragg Curve (BC) identification. (Author)

Effect of the size of an artificial neural network used as pattern identifier

Energy Technology Data Exchange (ETDEWEB)

Reynoso V, M.R.; Vega C, J.J. [ININ, 52045 Ocoyoacac, Estado de Mexico (Mexico)

2003-07-01

A novel way to extract relevant parameters associated with the outgoing ions from nuclear reactions, obtained by digitizing the signals provided by a Bragg curve spectrometer (BCS) is presented. This allowed the implementation of a more thorough pulse-shape analysis. Due to the complexity of this task, it was required to take advantage of new and more powerful computational paradigms. This was fulfilled using a back-propagation artificial neural network (ANN) as a pattern identifier. Over training of ANNs is a common problem during the training stage. In the performance of the ANN there is a compromise between its size and the size of the training set. Here, this effect will be illustrated in relation to the problem of Bragg Curve (BC) identification. (Author)

Neural Networks for Self-tuning Control Systems

Directory of Open Access Journals (Sweden)

A. Noriega Ponce

2004-01-01

Full Text Available In this paper, we presented a self-tuning control algorithm based on a three layers perceptron type neural network. The proposed algorithm is advantageous in the sense that practically a previous training of the net is not required and some changes in the set-point are generally enough to adjust the learning coefficient. Optionally, it is possible to introduce a self-tuning mechanism of the learning coefficient although by the moment it is not possible to give final conclusions about this possibility. The proposed algorithm has the special feature that the regulation error instead of the net output error is retropropagated for the weighting coefficients modifications. 

The neural signature of emotional memories in serial crimes.

Science.gov (United States)

Chassy, Philippe

2017-10-01

Neural plasticity is the process whereby semantic information and emotional responses are stored in neural networks. It is hypothesized that the neural networks built over time to encode the sexual fantasies that motivate serial killers to act should display a unique, detectable activation pattern. The pathological neural watermark hypothesis posits that such networks comprise activation of brain sites that reflect four cognitive components: autobiographical memory, sexual arousal, aggression, and control over aggression. The neural sites performing these cognitive functions have been successfully identified by previous research. The key findings are reviewed to hypothesise the typical pattern of activity that serial killers should display. Through the integration of biological findings into one framework, the neural approach proposed in this paper is in stark contrast with the many theories accounting for serial killers that offer non-medical taxonomies. The pathological neural watermark hypothesis offers a new framework to understand and detect deviant individuals. The technical and legal issues are briefly discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Petri neural network model for the effect of controlled thermomechanical process parameters on the mechanical properties of HSLA steels

Energy Technology Data Exchange (ETDEWEB)

Datta, S.

1999-10-01

The effect of composition and controlled thermomechanical process parameters on the mechanical properties of HSLA steels is modelled using the Widrow-Hoff's concept of training a neural net with feed-forward topology by applying Rumelhart's back propagation type algorithm for supervised learning, using a Petri like net structure. The data used are from laboratory experiments as well as from the published literature. The results from the neural network are found to be consistent and in good agreement with the experimented results. (author)

Using neural pattern classifiers to quantify the modularity of conflict-control mechanisms in the human brain.

Science.gov (United States)

Jiang, Jiefeng; Egner, Tobias

2014-07-01

Resolving conflicting sensory and motor representations is a core function of cognitive control, but it remains uncertain to what degree control over different sources of conflict is implemented by shared (domain general) or distinct (domain specific) neural resources. Behavioral data suggest conflict-control to be domain specific, but results from neuroimaging studies have been ambivalent. Here, we employed multivoxel pattern analyses that can decode a brain region's informational content, allowing us to distinguish incidental activation overlap from actual shared information processing. We trained independent sets of "searchlight" classifiers on functional magnetic resonance imaging data to decode control processes associated with stimulus-conflict (Stroop task) and ideomotor-conflict (Simon task). Quantifying the proportion of domain-specific searchlights (capable of decoding only one type of conflict) and domain-general searchlights (capable of decoding both conflict types) in each subject, we found both domain-specific and domain-general searchlights, though the former were more common. When mapping anatomical loci of these searchlights across subjects, neural substrates of stimulus- and ideomotor-specific conflict-control were found to be anatomically consistent across subjects, whereas the substrates of domain-general conflict-control were not. Overall, these findings suggest a hybrid neural architecture of conflict-control that entails both modular (domain specific) and global (domain general) components. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Deep nets vs expert designed features in medical physics: An IMRT QA case study.

Science.gov (United States)

Interian, Yannet; Rideout, Vincent; Kearney, Vasant P; Gennatas, Efstathios; Morin, Olivier; Cheung, Joey; Solberg, Timothy; Valdes, Gilmer

2018-03-30

The purpose of this study was to compare the performance of Deep Neural Networks against a technique designed by domain experts in the prediction of gamma passing rates for Intensity Modulated Radiation Therapy Quality Assurance (IMRT QA). A total of 498 IMRT plans across all treatment sites were planned in Eclipse version 11 and delivered using a dynamic sliding window technique on Clinac iX or TrueBeam Linacs. Measurements were performed using a commercial 2D diode array, and passing rates for 3%/3 mm local dose/distance-to-agreement (DTA) were recorded. Separately, fluence maps calculated for each plan were used as inputs to a convolution neural network (CNN). The CNNs were trained to predict IMRT QA gamma passing rates using TensorFlow and Keras. A set of model architectures, inspired by the convolutional blocks of the VGG-16 ImageNet model, were constructed and implemented. Synthetic data, created by rotating and translating the fluence maps during training, was created to boost the performance of the CNNs. Dropout, batch normalization, and data augmentation were utilized to help train the model. The performance of the CNNs was compared to a generalized Poisson regression model, previously developed for this application, which used 78 expert designed features. Deep Neural Networks without domain knowledge achieved comparable performance to a baseline system designed by domain experts in the prediction of 3%/3 mm Local gamma passing rates. An ensemble of neural nets resulted in a mean absolute error (MAE) of 0.70 ± 0.05 and the domain expert model resulted in a 0.74 ± 0.06. Convolutional neural networks (CNNs) with transfer learning can predict IMRT QA passing rates by automatically designing features from the fluence maps without human expert supervision. Predictions from CNNs are comparable to a system carefully designed by physicist experts. © 2018 American Association of Physicists in Medicine.

Electrocardiogram (ECG Signal Modeling and Noise Reduction Using Hopfield Neural Networks

Directory of Open Access Journals (Sweden)

F. Bagheri

2013-02-01

Full Text Available The Electrocardiogram (ECG signal is one of the diagnosing approaches to detect heart disease. In this study the Hopfield Neural Network (HNN is applied and proposed for ECG signal modeling and noise reduction. The Hopfield Neural Network (HNN is a recurrent neural network that stores the information in a dynamic stable pattern. This algorithm retrieves a pattern stored in memory in response to the presentation of an incomplete or noisy version of that pattern. Computer simulation results show that this method can successfully model the ECG signal and remove high-frequency noise.

Controlling the dynamics of multi-state neural networks

International Nuclear Information System (INIS)

Jin, Tao; Zhao, Hong

2008-01-01

In this paper, we first analyze the distribution of local fields (DLF) which is induced by the memory patterns in the Q-Ising model. It is found that the structure of the DLF is closely correlated with the network dynamics and the system performance. However, the design rule adopted in the Q-Ising model, like the other rules adopted for multi-state neural networks with associative memories, cannot be applied to directly control the DLF for a given set of memory patterns, and thus cannot be applied to further study the relationships between the structure of the DLF and the dynamics of the network. We then extend a design rule, which was presented recently for designing binary-state neural networks, to make it suitable for designing general multi-state neural networks. This rule is able to control the structure of the DLF as expected. We show that controlling the DLF not only can affect the dynamic behaviors of the multi-state neural networks for a given set of memory patterns, but also can improve the storage capacity. With the change of the DLF, the network shows very rich dynamic behaviors, such as the 'chaos phase', the 'memory phase', and the 'mixture phase'. These dynamic behaviors are also observed in the binary-state neural networks; therefore, our results imply that they may be the universal behaviors of feedback neural networks

Consciousness of Unification: The Mind-Matter Phallacy Bites the Dust

Science.gov (United States)

Beichler, James E.

A complete theoretical model of how consciousness arises in neural nets can be developed based on a mixed quantum/classical basis. Both mind and consciousness are multi-leveled scalar and vector electromagnetic complexity patterns, respectively, which emerge within all living organisms through the process of evolution. Like life, the mind and consciousness patterns extend throughout living organisms (bodies), but the neural nets and higher level groupings that distinguish higher levels of consciousness only exist in the brain so mind and consciousness have been traditionally associated with the brain alone. A close study of neurons and neural nets in the brain shows that the microtubules within axons are classical bio-magnetic inductors that emit and absorb electromagnetic pulses from each other. These pulses establish interference patterns that influence the quantized vector potential patterns of interstitial water molecules within the neurons as well as create the coherence within neurons and neural nets that scientists normally associate with more complex memories, thought processes and streams of thought. Memory storage and recall are guided by the microtubules and the actual memory patterns are stored as magnetic vector potential complexity patterns in the points of space at the quantum level occupied by the water molecules. This model also accounts for the plasticity of the brain and implies that mind and consciousness, like life itself, are the result of evolutionary processes. However, consciousness can evolve independent of an organism's birth genetics once it has evolved by normal bottom-up genetic processes and thus force a new type of top-down evolution on living organisms and species as a whole that can be explained by expanding the laws of thermodynamics to include orderly systems.

Optimization of patterns of control bars using neural networks; Optimizacion de patrones de barras de control usando redes neuronales

Energy Technology Data Exchange (ETDEWEB)

Mejia S, D.M. [IPN, ESFM, Depto. de Ingenieria Nuclear, 07738 Mexico D.F. (Mexico); Ortiz S, J.J. [ININ, 52045 Ocoyoacac, Estado de Mexico (Mexico)]. e-mail: dulcema6715@hotmail.com

2005-07-01

In this work the RENOPBC system that is based on a recurrent multi state neural network, for the optimization of patterns of control bars in a cycle of balance of a boiling water reactor (BWR for their initials in English) is presented. The design of patterns of bars is based on the execution of operation thermal limits, to maintain criticizes the reactor and that the axial profile of power is adjusted to one predetermined along several steps of burnt. The patterns of control bars proposed by the system are comparable to those proposed by human experts with many hour-man of experience. These results are compared with those proposed by other techniques as genetic algorithms, colonies of ants and tabu search for the same operation cycle. As consequence it is appreciated that the proposed patterns of control bars, have bigger operation easiness that those proposed by the other techniques. (Author)

SCYNet. Testing supersymmetric models at the LHC with neural networks

Energy Technology Data Exchange (ETDEWEB)

Bechtle, Philip; Belkner, Sebastian; Hamer, Matthias [Universitaet Bonn, Bonn (Germany); Dercks, Daniel [Universitaet Hamburg, Hamburg (Germany); Keller, Tim; Kraemer, Michael; Sarrazin, Bjoern; Schuette-Engel, Jan; Tattersall, Jamie [RWTH Aachen University, Institute for Theoretical Particle Physics and Cosmology, Aachen (Germany)

2017-10-15

SCYNet (SUSY Calculating Yield Net) is a tool for testing supersymmetric models against LHC data. It uses neural network regression for a fast evaluation of the profile likelihood ratio. Two neural network approaches have been developed: one network has been trained using the parameters of the 11-dimensional phenomenological Minimal Supersymmetric Standard Model (pMSSM-11) as an input and evaluates the corresponding profile likelihood ratio within milliseconds. It can thus be used in global pMSSM-11 fits without time penalty. In the second approach, the neural network has been trained using model-independent signature-related objects, such as energies and particle multiplicities, which were estimated from the parameters of a given new physics model. (orig.)

Neural network models: from biology to many - body phenomenology

International Nuclear Information System (INIS)

Clark, J.W.

1993-01-01

The current surge of research on practical side of neural networks and their utility in memory storage/recall, pattern recognition and classification is given in this article. The initial attraction of neural networks as dynamical and statistical system has been investigated. From the view of many-body theorist, the neurons may be thought of as particles, and the weighted connection between the units, as the interaction between these particles. Finally, the author has seen the impressive capabilities of artificial neural networks in pattern recognition and classification may be exploited to solve data management problems in experimental physics and the discovery of radically new theoretically description of physical problems and neural networks can be used in physics. (A.B.)

Spatial patterns of persistent neural activity vary with the behavioral context of short-term memory.

Science.gov (United States)

Daie, Kayvon; Goldman, Mark S; Aksay, Emre R F

2015-02-18

A short-term memory can be evoked by different inputs and control separate targets in different behavioral contexts. To address the circuit mechanisms underlying context-dependent memory function, we determined through optical imaging how memory is encoded at the whole-network level in two behavioral settings. Persistent neural activity maintaining a memory of desired eye position was imaged throughout the oculomotor integrator after saccadic or optokinetic stimulation. While eye position was encoded by the amplitude of network activity, the spatial patterns of firing were context dependent: cells located caudally generally were most persistent following saccadic input, whereas cells located rostrally were most persistent following optokinetic input. To explain these data, we computationally identified four independent modes of network activity and found these were differentially accessed by saccadic and optokinetic inputs. These results show how a circuit can simultaneously encode memory value and behavioral context, respectively, in its amplitude and spatial pattern of persistent firing. Copyright © 2015 Elsevier Inc. All rights reserved.

Neural networks and their potential application to nuclear power plants

International Nuclear Information System (INIS)

Uhrig, R.E.

1991-01-01

A network of artificial neurons, usually called an artificial neural network is a data processing system consisting of a number of highly interconnected processing elements in an architecture inspired by the structure of the cerebral cortex portion of the brain. Hence, neural networks are often capable of doing things which humans or animals do well but which conventional computers often do poorly. Neural networks exhibit characteristics and capabilities not provided by any other technology. Neural networks may be designed so as to classify an input pattern as one of several predefined types or to create, as needed, categories or classes of system states which can be interpreted by a human operator. Neural networks have the ability to recognize patterns, even when the information comprising these patterns is noisy, sparse, or incomplete. Thus, systems of artificial neural networks show great promise for use in environments in which robust, fault-tolerant pattern recognition is necessary in a real-time mode, and in which the incoming data may be distorted or noisy. The application of neural networks, a rapidly evolving technology used extensively in defense applications, alone or in conjunction with other advanced technologies, to some of the problems of operating nuclear power plants has the potential to enhance the safety, reliability and operability of nuclear power plants. The potential applications of neural networking include, but are not limited to diagnosing specific abnormal conditions, identification of nonlinear dynamics and transients, detection of the change of mode of operation, control of temperature and pressure during start-up, signal validation, plant-wide monitoring using autoassociative neural networks, monitoring of check valves, modeling of the plant thermodynamics, emulation of core reload calculations, analysis of temporal sequences in NRC's ''licensee event reports,'' and monitoring of plant parameters

Embedding responses in spontaneous neural activity shaped through sequential learning.

Directory of Open Access Journals (Sweden)

Tomoki Kurikawa

Full Text Available Recent experimental measurements have demonstrated that spontaneous neural activity in the absence of explicit external stimuli has remarkable spatiotemporal structure. This spontaneous activity has also been shown to play a key role in the response to external stimuli. To better understand this role, we proposed a viewpoint, "memories-as-bifurcations," that differs from the traditional "memories-as-attractors" viewpoint. Memory recall from the memories-as-bifurcations viewpoint occurs when the spontaneous neural activity is changed to an appropriate output activity upon application of an input, known as a bifurcation in dynamical systems theory, wherein the input modifies the flow structure of the neural dynamics. Learning, then, is a process that helps create neural dynamical systems such that a target output pattern is generated as an attractor upon a given input. Based on this novel viewpoint, we introduce in this paper an associative memory model with a sequential learning process. Using a simple hebbian-type learning, the model is able to memorize a large number of input/output mappings. The neural dynamics shaped through the learning exhibit different bifurcations to make the requested targets stable upon an increase in the input, and the neural activity in the absence of input shows chaotic dynamics with occasional approaches to the memorized target patterns. These results suggest that these dynamics facilitate the bifurcations to each target attractor upon application of the corresponding input, which thus increases the capacity for learning. This theoretical finding about the behavior of the spontaneous neural activity is consistent with recent experimental observations in which the neural activity without stimuli wanders among patterns evoked by previously applied signals. In addition, the neural networks shaped by learning properly reflect the correlations of input and target-output patterns in a similar manner to those designed in

Automated Understanding of Financial Statements Using Neural Networks and Semantic Grammars

OpenAIRE

Markovitch, J. S.

1995-01-01

This article discusses how neural networks and semantic grammars may be used to locate and understand financial statements embedded in news stories received from on-line news wires. A neural net is used to identify where in the news story a financial statement appears to begin. A grammar then is applied to this text in an effort to extract specific facts from the financial statement. Applying grammars to financial statements presents unique parsing problems since the dollar amounts of financi...

Neural estimation of kinetic rate constants from dynamic PET-scans

DEFF Research Database (Denmark)

Fog, Torben L.; Nielsen, Lars Hupfeldt; Hansen, Lars Kai

1994-01-01

A feedforward neural net is trained to invert a simple three compartment model describing the tracer kinetics involved in the metabolism of [18F]fluorodeoxyglucose in the human brain. The network can estimate rate constants from positron emission tomography sequences and is about 50 times faster ...

Investment Valuation Analysis with Artificial Neural Networks

Directory of Open Access Journals (Sweden)

Hüseyin İNCE

2017-07-01

Full Text Available This paper shows that discounted cash flow and net present value, which are traditional investment valuation models, can be combined with artificial neural network model forecasting. The main inputs for the valuation models, such as revenue, costs, capital expenditure, and their growth rates, are heavily related to sector dynamics and macroeconomics. The growth rates of those inputs are related to inflation and exchange rates. Therefore, predicting inflation and exchange rates is a critical issue for the valuation output. In this paper, the Turkish economy’s inflation rate and the exchange rate of USD/TRY are forecast by artificial neural networks and implemented to the discounted cash flow model. Finally, the results are benchmarked with conventional practices.

Application and Simulation of Fuzzy Neural Network PID Controller in the Aircraft Cabin Temperature

Directory of Open Access Journals (Sweden)

Ding Fang

2013-06-01

Full Text Available Considering complex factors of affecting ambient temperature in Aircraft cabin, and some shortages of traditional PID control like the parameters difficult to be tuned and control ineffective, this paper puts forward the intelligent PID algorithm that makes fuzzy logic method and neural network together, scheming out the fuzzy neural net PID controller. After the correction of the fuzzy inference and dynamic learning of neural network, PID parameters of the controller get the optimal parameters. MATLAB simulation results of the cabin temperature control model show that the performance of the fuzzy neural network PID controller has been greatly improved, with faster response, smaller overshoot and better adaptability.

Discrete Neural Signatures of Basic Emotions.

Science.gov (United States)

Saarimäki, Heini; Gotsopoulos, Athanasios; Jääskeläinen, Iiro P; Lampinen, Jouko; Vuilleumier, Patrik; Hari, Riitta; Sams, Mikko; Nummenmaa, Lauri

2016-06-01

Categorical models of emotions posit neurally and physiologically distinct human basic emotions. We tested this assumption by using multivariate pattern analysis (MVPA) to classify brain activity patterns of 6 basic emotions (disgust, fear, happiness, sadness, anger, and surprise) in 3 experiments. Emotions were induced with short movies or mental imagery during functional magnetic resonance imaging. MVPA accurately classified emotions induced by both methods, and the classification generalized from one induction condition to another and across individuals. Brain regions contributing most to the classification accuracy included medial and inferior lateral prefrontal cortices, frontal pole, precentral and postcentral gyri, precuneus, and posterior cingulate cortex. Thus, specific neural signatures across these regions hold representations of different emotional states in multimodal fashion, independently of how the emotions are induced. Similarity of subjective experiences between emotions was associated with similarity of neural patterns for the same emotions, suggesting a direct link between activity in these brain regions and the subjective emotional experience. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Classification of breast cancer cytological specimen using convolutional neural network

Science.gov (United States)

Żejmo, Michał; Kowal, Marek; Korbicz, Józef; Monczak, Roman

2017-01-01

The paper presents a deep learning approach for automatic classification of breast tumors based on fine needle cytology. The main aim of the system is to distinguish benign from malignant cases based on microscopic images. Experiment was carried out on cytological samples derived from 50 patients (25 benign cases + 25 malignant cases) diagnosed in Regional Hospital in Zielona Góra. To classify microscopic images, we used convolutional neural networks (CNN) of two types: GoogLeNet and AlexNet. Due to the very large size of images of cytological specimen (on average 200000 × 100000 pixels), they were divided into smaller patches of size 256 × 256 pixels. Breast cancer classification usually is based on morphometric features of nuclei. Therefore, training and validation patches were selected using Support Vector Machine (SVM) so that suitable amount of cell material was depicted. Neural classifiers were tuned using GPU accelerated implementation of gradient descent algorithm. Training error was defined as a cross-entropy classification loss. Classification accuracy was defined as the percentage ratio of successfully classified validation patches to the total number of validation patches. The best accuracy rate of 83% was obtained by GoogLeNet model. We observed that more misclassified patches belong to malignant cases.

Pattern Classification with Memristive Crossbar Circuits

Science.gov (United States)

2016-03-31

Pattern Classification with Memristive Crossbar Circuits Dmitri B. Strukov Department of Electrical and Computer Engineering Department UC Santa...pattern classification ; deep learning; convolutional neural network networks. Introduction Deep-learning convolutional neural networks (DLCNN), which...the best classification performances on a variety of benchmark tasks [1]. The major challenge in building fast and energy- efficient networks of this

Neural network recognition of mammographic lesions

International Nuclear Information System (INIS)

Oldham, W.J.B.; Downes, P.T.; Hunter, V.

1987-01-01

A method for recognition of mammographic lesions through the use of neural networks is presented. Neural networks have exhibited the ability to learn the shape andinternal structure of patterns. Digitized mammograms containing circumscribed and stelate lesions were used to train a feedfoward synchronous neural network that self-organizes to stable attractor states. Encoding of data for submission to the network was accomplished by performing a fractal analysis of the digitized image. This results in scale invariant representation of the lesions. Results are discussed

Radio frequency interference mitigation using deep convolutional neural networks

Science.gov (United States)

Akeret, J.; Chang, C.; Lucchi, A.; Refregier, A.

2017-01-01

We propose a novel approach for mitigating radio frequency interference (RFI) signals in radio data using the latest advances in deep learning. We employ a special type of Convolutional Neural Network, the U-Net, that enables the classification of clean signal and RFI signatures in 2D time-ordered data acquired from a radio telescope. We train and assess the performance of this network using the HIDE &SEEK radio data simulation and processing packages, as well as early Science Verification data acquired with the 7m single-dish telescope at the Bleien Observatory. We find that our U-Net implementation is showing competitive accuracy to classical RFI mitigation algorithms such as SEEK's SUMTHRESHOLD implementation. We publish our U-Net software package on GitHub under GPLv3 license.

Resting-state hemodynamics are spatiotemporally coupled to synchronized and symmetric neural activity in excitatory neurons

Science.gov (United States)

Ma, Ying; Shaik, Mohammed A.; Kozberg, Mariel G.; Portes, Jacob P.; Timerman, Dmitriy

2016-01-01

Brain hemodynamics serve as a proxy for neural activity in a range of noninvasive neuroimaging techniques including functional magnetic resonance imaging (fMRI). In resting-state fMRI, hemodynamic fluctuations have been found to exhibit patterns of bilateral synchrony, with correlated regions inferred to have functional connectivity. However, the relationship between resting-state hemodynamics and underlying neural activity has not been well established, making the neural underpinnings of functional connectivity networks unclear. In this study, neural activity and hemodynamics were recorded simultaneously over the bilateral cortex of awake and anesthetized Thy1-GCaMP mice using wide-field optical mapping. Neural activity was visualized via selective expression of the calcium-sensitive fluorophore GCaMP in layer 2/3 and 5 excitatory neurons. Characteristic patterns of resting-state hemodynamics were accompanied by more rapidly changing bilateral patterns of resting-state neural activity. Spatiotemporal hemodynamics could be modeled by convolving this neural activity with hemodynamic response functions derived through both deconvolution and gamma-variate fitting. Simultaneous imaging and electrophysiology confirmed that Thy1-GCaMP signals are well-predicted by multiunit activity. Neurovascular coupling between resting-state neural activity and hemodynamics was robust and fast in awake animals, whereas coupling in urethane-anesthetized animals was slower, and in some cases included lower-frequency (resting-state hemodynamics in the awake and anesthetized brain are coupled to underlying patterns of excitatory neural activity. The patterns of bilaterally-symmetric spontaneous neural activity revealed by wide-field Thy1-GCaMP imaging may depict the neural foundation of functional connectivity networks detected in resting-state fMRI. PMID:27974609

Higher-order neural network software for distortion invariant object recognition

Science.gov (United States)

Reid, Max B.; Spirkovska, Lilly

1991-01-01

The state-of-the-art in pattern recognition for such applications as automatic target recognition and industrial robotic vision relies on digital image processing. We present a higher-order neural network model and software which performs the complete feature extraction-pattern classification paradigm required for automatic pattern recognition. Using a third-order neural network, we demonstrate complete, 100 percent accurate invariance to distortions of scale, position, and in-plate rotation. In a higher-order neural network, feature extraction is built into the network, and does not have to be learned. Only the relatively simple classification step must be learned. This is key to achieving very rapid training. The training set is much smaller than with standard neural network software because the higher-order network only has to be shown one view of each object to be learned, not every possible view. The software and graphical user interface run on any Sun workstation. Results of the use of the neural software in autonomous robotic vision systems are presented. Such a system could have extensive application in robotic manufacturing.

Memory and pattern storage in neural networks with activity dependent synapses

Science.gov (United States)

Mejias, J. F.; Torres, J. J.

2009-01-01

We present recently obtained results on the influence of the interplay between several activity dependent synaptic mechanisms, such as short-term depression and facilitation, on the maximum memory storage capacity in an attractor neural network [1]. In contrast with the case of synaptic depression, which drastically reduces the capacity of the network to store and retrieve activity patterns [2], synaptic facilitation is able to enhance the memory capacity in different situations. In particular, we find that a convenient balance between depression and facilitation can enhance the memory capacity, reaching maximal values similar to those obtained with static synapses, that is, without activity-dependent processes. We also argue, employing simple arguments, that this level of balance is compatible with experimental data recorded from some cortical areas, where depression and facilitation may play an important role for both memory-oriented tasks and information processing. We conclude that depressing synapses with a certain level of facilitation allow to recover the good retrieval properties of networks with static synapses while maintaining the nonlinear properties of dynamic synapses, convenient for information processing and coding.

Which family members use the best nets? An analysis of the condition of mosquito nets and their distribution within households in Tanzania

Directory of Open Access Journals (Sweden)

Lines Jo

2010-07-01

Full Text Available Abstract Background Household ownership of insecticide-treated mosquito nets (ITNs is increasing, and coverage targets have been revised to address universal coverage with ITNs. However, many households do not have enough nets to cover everyone, and the nets available vary in physical condition and insecticide treatment status. Since 2004, the Government of Tanzania has been implementing the Tanzania National Voucher Scheme (TNVS, which distributes vouchers for ITNs through antenatal clinics to target pregnant women and their infants. This analysis aimed to determine the following: (1 coverage patterns of bed nets within households according to physical condition and treatment status; (2 who might be at risk if mosquitoes were diverted from occupants of untreated nets to those not using nets? (3 the degree to which those at highest risk of malaria use the most protective nets. Methods Data from the 2006 TNVS household survey were analysed to assess within-household distribution of net use. The associations between net characteristics and net user were also evaluated. Multivariate analysis was applied to the relationship between the number of holes per net and user characteristics while adjusting for confounders. Results In households with a net:person ratio better than 1:4 (one net for every four household members, more than 80% of the people in such households reported using a net the previous night. ITNs were most likely to be used by infants, young children (1-4 y, and women of childbearing age; they were least likely to be used by older women (≥50 y, older children (5-14 y, and adult men. The nets used by infants and women of childbearing age were in better-than-average physical condition; the nets used by older women and older children were in worse-than-average condition; while young children and adult men used nets in intermediate (average condition. When adjusted for confounders, the nets used by young and older children had more holes

Neural fields theory and applications

CERN Document Server

Graben, Peter; Potthast, Roland; Wright, James

2014-01-01

With this book, the editors present the first comprehensive collection in neural field studies, authored by leading scientists in the field - among them are two of the founding-fathers of neural field theory. Up to now, research results in the field have been disseminated across a number of distinct journals from mathematics, computational neuroscience, biophysics, cognitive science and others. Starting with a tutorial for novices in neural field studies, the book comprises chapters on emergent patterns, their phase transitions and evolution, on stochastic approaches, cortical development, cognition, robotics and computation, large-scale numerical simulations, the coupling of neural fields to the electroencephalogram and phase transitions in anesthesia. The intended readership are students and scientists in applied mathematics, theoretical physics, theoretical biology, and computational neuroscience. Neural field theory and its applications have a long-standing tradition in the mathematical and computational ...

Pattern activation/recognition theory of mind.

Science.gov (United States)

du Castel, Bertrand

2015-01-01

In his 2012 book How to Create a Mind, Ray Kurzweil defines a "Pattern Recognition Theory of Mind" that states that the brain uses millions of pattern recognizers, plus modules to check, organize, and augment them. In this article, I further the theory to go beyond pattern recognition and include also pattern activation, thus encompassing both sensory and motor functions. In addition, I treat checking, organizing, and augmentation as patterns of patterns instead of separate modules, therefore handling them the same as patterns in general. Henceforth I put forward a unified theory I call "Pattern Activation/Recognition Theory of Mind." While the original theory was based on hierarchical hidden Markov models, this evolution is based on their precursor: stochastic grammars. I demonstrate that a class of self-describing stochastic grammars allows for unifying pattern activation, recognition, organization, consistency checking, metaphor, and learning, into a single theory that expresses patterns throughout. I have implemented the model as a probabilistic programming language specialized in activation/recognition grammatical and neural operations. I use this prototype to compute and present diagrams for each stochastic grammar and corresponding neural circuit. I then discuss the theory as it relates to artificial network developments, common coding, neural reuse, and unity of mind, concluding by proposing potential paths to validation.

Neural codes of seeing architectural styles.

Science.gov (United States)

Choo, Heeyoung; Nasar, Jack L; Nikrahei, Bardia; Walther, Dirk B

2017-01-10

Images of iconic buildings, such as the CN Tower, instantly transport us to specific places, such as Toronto. Despite the substantial impact of architectural design on people's visual experience of built environments, we know little about its neural representation in the human brain. In the present study, we have found patterns of neural activity associated with specific architectural styles in several high-level visual brain regions, but not in primary visual cortex (V1). This finding suggests that the neural correlates of the visual perception of architectural styles stem from style-specific complex visual structure beyond the simple features computed in V1. Surprisingly, the network of brain regions representing architectural styles included the fusiform face area (FFA) in addition to several scene-selective regions. Hierarchical clustering of error patterns further revealed that the FFA participated to a much larger extent in the neural encoding of architectural styles than entry-level scene categories. We conclude that the FFA is involved in fine-grained neural encoding of scenes at a subordinate-level, in our case, architectural styles of buildings. This study for the first time shows how the human visual system encodes visual aspects of architecture, one of the predominant and longest-lasting artefacts of human culture.

Detection and diagnosis of colitis on computed tomography using deep convolutional neural networks.

Science.gov (United States)

Liu, Jiamin; Wang, David; Lu, Le; Wei, Zhuoshi; Kim, Lauren; Turkbey, Evrim B; Sahiner, Berkman; Petrick, Nicholas A; Summers, Ronald M

2017-09-01

Colitis refers to inflammation of the inner lining of the colon that is frequently associated with infection and allergic reactions. In this paper, we propose deep convolutional neural networks methods for lesion-level colitis detection and a support vector machine (SVM) classifier for patient-level colitis diagnosis on routine abdominal CT scans. The recently developed Faster Region-based Convolutional Neural Network (Faster RCNN) is utilized for lesion-level colitis detection. For each 2D slice, rectangular region proposals are generated by region proposal networks (RPN). Then, each region proposal is jointly classified and refined by a softmax classifier and bounding-box regressor. Two convolutional neural networks, eight layers of ZF net and 16 layers of VGG net are compared for colitis detection. Finally, for each patient, the detections on all 2D slices are collected and a SVM classifier is applied to develop a patient-level diagnosis. We trained and evaluated our method with 80 colitis patients and 80 normal cases using 4 × 4-fold cross validation. For lesion-level colitis detection, with ZF net, the mean of average precisions (mAP) were 48.7% and 50.9% for RCNN and Faster RCNN, respectively. The detection system achieved sensitivities of 51.4% and 54.0% at two false positives per patient for RCNN and Faster RCNN, respectively. With VGG net, Faster RCNN increased the mAP to 56.9% and increased the sensitivity to 58.4% at two false positive per patient. For patient-level colitis diagnosis, with ZF net, the average areas under the ROC curve (AUC) were 0.978 ± 0.009 and 0.984 ± 0.008 for RCNN and Faster RCNN method, respectively. The difference was not statistically significant with P = 0.18. At the optimal operating point, the RCNN method correctly identified 90.4% (72.3/80) of the colitis patients and 94.0% (75.2/80) of normal cases. The sensitivity improved to 91.6% (73.3/80) and the specificity improved to 95.0% (76.0/80) for the Faster RCNN

The effect of the neural activity on topological properties of growing neural networks.

Science.gov (United States)

Gafarov, F M; Gafarova, V R

2016-09-01

The connectivity structure in cortical networks defines how information is transmitted and processed, and it is a source of the complex spatiotemporal patterns of network's development, and the process of creation and deletion of connections is continuous in the whole life of the organism. In this paper, we study how neural activity influences the growth process in neural networks. By using a two-dimensional activity-dependent growth model we demonstrated the neural network growth process from disconnected neurons to fully connected networks. For making quantitative investigation of the network's activity influence on its topological properties we compared it with the random growth network not depending on network's activity. By using the random graphs theory methods for the analysis of the network's connections structure it is shown that the growth in neural networks results in the formation of a well-known "small-world" network.

Horizontal ichthyoplankton tow-net system with unobstructed net opening

Science.gov (United States)

Nester, Robert T.

1987-01-01

The larval fish sampler described here consists of a modified bridle, frame, and net system with an obstruction-free net opening and is small enough for use on boats 10 m or less in length. The tow net features a square net frame attached to a 0.5-m-diameter cylinder-on-cone plankton net with a bridle designed to eliminate all obstructions forward of the net opening, significantly reducing currents and vibrations in the water directly preceding the net. This system was effective in collecting larvae representing more than 25 species of fish at sampling depths ranging from surface to 10 m and could easily be used at greater depths.

MMPM - Mars MetNet Precursor Mission

Science.gov (United States)

Harri, A.-M.; Schmidt, W.; Pichkhadze, K.; Linkin, V.; Vazquez, L.; Uspensky, M.; Polkko, J.; Genzer, M.; Lipatov, A.; Guerrero, H.; Alexashkin, S.; Haukka, H.; Savijarvi, H.; Kauhanen, J.

2008-09-01

We are developing a new kind of planetary exploration mission for Mars - MetNet in situ observation network based on a new semi-hard landing vehicle called the Met-Net Lander (MNL). The eventual scope of the MetNet Mission is to deploy some 20 MNLs on the Martian surface using inflatable descent system structures, which will be supported by observations from the orbit around Mars. Currently we are working on the MetNet Mars Precursor Mission (MMPM) to deploy one MetNet Lander to Mars in the 2009/2011 launch window as a technology and science demonstration mission. The MNL will have a versatile science payload focused on the atmospheric science of Mars. Detailed characterization of the Martian atmospheric circulation patterns, boundary layer phenomena, and climatology cycles, require simultaneous in-situ measurements by a network of observation posts on the Martian surface. The scientific payload of the MetNet Mission encompasses separate instrument packages for the atmospheric entry and descent phase and for the surface operation phase. The MetNet mission concept and key probe technologies have been developed and the critical subsystems have been qualified to meet the Martian environmental and functional conditions. Prototyping of the payload instrumentation with final dimensions was carried out in 2003-2006.This huge development effort has been fulfilled in collaboration between the Finnish Meteorological Institute (FMI), the Russian Lavoschkin Association (LA) and the Russian Space Research Institute (IKI) since August 2001. Currently the INTA (Instituto Nacional de Técnica Aeroespacial) from Spain is also participating in the MetNet payload development. To understand the behavior and dynamics of the Martian atmosphere, a wealth of simultaneous in situ observations are needed on varying types of Martian orography, terrain and altitude spanning all latitudes and longitudes. This will be performed by the Mars MetNet Mission. In addition to the science aspects the

Techniques for extracting single-trial activity patterns from large-scale neural recordings

Science.gov (United States)

Churchland, Mark M; Yu, Byron M; Sahani, Maneesh; Shenoy, Krishna V

2008-01-01

Summary Large, chronically-implanted arrays of microelectrodes are an increasingly common tool for recording from primate cortex, and can provide extracellular recordings from many (order of 100) neurons. While the desire for cortically-based motor prostheses has helped drive their development, such arrays also offer great potential to advance basic neuroscience research. Here we discuss the utility of array recording for the study of neural dynamics. Neural activity often has dynamics beyond that driven directly by the stimulus. While governed by those dynamics, neural responses may nevertheless unfold differently for nominally identical trials, rendering many traditional analysis methods ineffective. We review recent studies – some employing simultaneous recording, some not – indicating that such variability is indeed present both during movement generation, and during the preceding premotor computations. In such cases, large-scale simultaneous recordings have the potential to provide an unprecedented view of neural dynamics at the level of single trials. However, this enterprise will depend not only on techniques for simultaneous recording, but also on the use and further development of analysis techniques that can appropriately reduce the dimensionality of the data, and allow visualization of single-trial neural behavior. PMID:18093826

Higher-moment measurements of net-kaon, net-charge and net-proton multiplicity distributions at STAR

International Nuclear Information System (INIS)

Sarkar, Amal

2014-01-01

In this paper, we report the measurements of the various moments, such as mean, standard deviation (σ), skewness (S) and kurtosis (κ) of the net-kaon, net-charge and net-proton multiplicity distributions at mid-rapidity in Au + Au collisions from √(s NN )=7.7 to 200 GeV with the STAR experiment at RHIC. This work has been done with the aim to locate the critical point on the QCD phase diagram. These moments and their products are related to the thermodynamic susceptibilities of conserved quantities such as net baryon number, net charge, and net strangeness as well as to the correlation length of the system which diverges in an ideal infinite thermodynamic system at the critical point. For a finite system, existing for a finite time, a non-monotonic behavior of these variables would indicate the presence of the critical point. Furthermore, we also present the moment products Sσ, κσ 2 of net-kaon, net-charge and net-proton multiplicity distributions as a function of collision centrality and energy. The energy and the centrality dependence of higher moments and their products have been compared with different models

Hierarchical surface patterning of Ni- and Be-free Ti- and Zr-based bulk metallic glasses by thermoplastic net-shaping

Energy Technology Data Exchange (ETDEWEB)

Sarac, Baran, E-mail: b.sarac@ifw-dresden.de [IFW Dresden, Institute for Complex Materials, Helmholtzstrasse 20, D-01069 Dresden (Germany); Erich Schmid Institute of Materials Science, Austrian Academy of Sciences (ÖAW), Jahnstrasse 12, A-8700 Leoben (Austria); Bera, Supriya [IFW Dresden, Institute for Complex Materials, Helmholtzstrasse 20, D-01069 Dresden (Germany); Balakin, Sascha [IFW Dresden, Institute for Complex Materials, Helmholtzstrasse 20, D-01069 Dresden (Germany); ETH Zurich, Department of Materials, Metal physics und Technology, Vladimir-Prelog-Weg 4, HCI J 492, 8093 Zürich (Switzerland); Stoica, Mihai [IFW Dresden, Institute for Complex Materials, Helmholtzstrasse 20, D-01069 Dresden (Germany); Politehnica University of Timisoara, P-ta Victoriei 2, RO-300006 Timisoara (Romania); Fraunhofer Institute for Ceramic Technologies and Systems IKTS, Winterbergstrasse 28, 01277, Dresden (Germany); Calin, Mariana, E-mail: m.calin@ifw-dresden.de [IFW Dresden, Institute for Complex Materials, Helmholtzstrasse 20, D-01069 Dresden (Germany); Eckert, Jürgen [Erich Schmid Institute of Materials Science, Austrian Academy of Sciences (ÖAW), Jahnstrasse 12, A-8700 Leoben (Austria); Department Materials Physics, Montanuniversität Leoben, Jahnstrasse 12, A-8700 Leoben (Austria)

2017-04-01

In order to establish a strong cell-material interaction, the surface topography of the implant material plays an important role. This contribution aims to analyze the formation kinetics of nickel and beryllium-free Ti- and Zr-based Bulk Metallic Glasses (BMGs) with potential biomedical applications. The surface patterning of the BMGs is achieved by thermoplastic net-shaping (TPN) into anisotropically etched cavities of silicon chips. The forming kinetics of the BMG alloys is assessed by thermal and mechanical measurements to determine the most suitable processing temperature and time, and load applied. Array of pyramidal micropatterns with a tip resolution down to 50 nm is achievable for the Zr-BMG, where the generated hierarchical features are crucial for surface functionalization, acting as topographic cues for cell attachment. The unique processability and intrinsic properties of this new class of amorphous alloys make them competitive with the conventional biomaterials. - Highlights: • Micro to nano-scale hierarchical surface patterns achieved by TPN of BMGs • Ni- and Be-free Zr-/Ti-BMGs with different GFA compared in terms of flow kinetics • Correlation between filling depths of Zr- and Ti-BMGs best described by formability • Multi-scale hierarchical patterning envisaged to facilitate BMG-cell interaction.

NetBench. Automated Network Performance Testing

CERN Document Server

Cadeddu, Mattia

2016-01-01

In order to evaluate the operation of high performance routers, CERN has developed the NetBench software to run benchmarking tests by injecting various traffic patterns and observing the network devices behaviour in real-time. The tool features a modular design with a Python based console used to inject traffic and collect the results in a database, and a web user

Gastroenteropancreatic neuroendocrine tumors (GEP-NETS)

International Nuclear Information System (INIS)

Vargas Martinez, Cristian Camilo; Castano Llano, Rodrigo

2010-01-01

Gastroenteropancreatic neuroendocrine tumors (GEP-NETS) are rare neoplasms which can occur anywhere in the gastrointestinal tract. Their particular characteristics include uptake of silver salts, neuroendocrine cell marker expression and hormonal secretory granules. Depending on their size, anatomical location and upon whether or not metastasis has occurred, these tumors can show different clinical patterns and have different prognoses. Early diagnosis is essential for treating these lesions and improving the patients' prognoses, but it requires a high degree of suspicion and confirmation by special testing. Surgical treatment is the first choice, but other medical therapy can be helpful for patients who have unresectable disease. This review presents the most relevant aspects of classification, morphology, methods of locating tumors, diagnosis and treatment of GEP-NETS. It presents only the Colombian experience in the epidemiology and management of these tumors.

Adaptive Learning Rule for Hardware-based Deep Neural Networks Using Electronic Synapse Devices

OpenAIRE

Lim, Suhwan; Bae, Jong-Ho; Eum, Jai-Ho; Lee, Sungtae; Kim, Chul-Heung; Kwon, Dongseok; Park, Byung-Gook; Lee, Jong-Ho

2017-01-01

In this paper, we propose a learning rule based on a back-propagation (BP) algorithm that can be applied to a hardware-based deep neural network (HW-DNN) using electronic devices that exhibit discrete and limited conductance characteristics. This adaptive learning rule, which enables forward, backward propagation, as well as weight updates in hardware, is helpful during the implementation of power-efficient and high-speed deep neural networks. In simulations using a three-layer perceptron net...

Gas Classification Using Deep Convolutional Neural Networks

Science.gov (United States)

Peng, Pai; Zhao, Xiaojin; Pan, Xiaofang; Ye, Wenbin

2018-01-01

In this work, we propose a novel Deep Convolutional Neural Network (DCNN) tailored for gas classification. Inspired by the great success of DCNN in the field of computer vision, we designed a DCNN with up to 38 layers. In general, the proposed gas neural network, named GasNet, consists of: six convolutional blocks, each block consist of six layers; a pooling layer; and a fully-connected layer. Together, these various layers make up a powerful deep model for gas classification. Experimental results show that the proposed DCNN method is an effective technique for classifying electronic nose data. We also demonstrate that the DCNN method can provide higher classification accuracy than comparable Support Vector Machine (SVM) methods and Multiple Layer Perceptron (MLP). PMID:29316723

Gas Classification Using Deep Convolutional Neural Networks.

Science.gov (United States)

Peng, Pai; Zhao, Xiaojin; Pan, Xiaofang; Ye, Wenbin

2018-01-08

In this work, we propose a novel Deep Convolutional Neural Network (DCNN) tailored for gas classification. Inspired by the great success of DCNN in the field of computer vision, we designed a DCNN with up to 38 layers. In general, the proposed gas neural network, named GasNet, consists of: six convolutional blocks, each block consist of six layers; a pooling layer; and a fully-connected layer. Together, these various layers make up a powerful deep model for gas classification. Experimental results show that the proposed DCNN method is an effective technique for classifying electronic nose data. We also demonstrate that the DCNN method can provide higher classification accuracy than comparable Support Vector Machine (SVM) methods and Multiple Layer Perceptron (MLP).

Stability switches, oscillatory multistability, and spatio-temporal patterns of nonlinear oscillations in recurrently delay coupled neural networks.

Science.gov (United States)

Song, Yongli; Makarov, Valeri A; Velarde, Manuel G

2009-08-01

A model of time-delay recurrently coupled spatially segregated neural assemblies is here proposed. We show that it operates like some of the hierarchical architectures of the brain. Each assembly is a neural network with no delay in the local couplings between the units. The delay appears in the long range feedforward and feedback inter-assemblies communications. Bifurcation analysis of a simple four-units system in the autonomous case shows the richness of the dynamical behaviors in a biophysically plausible parameter region. We find oscillatory multistability, hysteresis, and stability switches of the rest state provoked by the time delay. Then we investigate the spatio-temporal patterns of bifurcating periodic solutions by using the symmetric local Hopf bifurcation theory of delay differential equations and derive the equation describing the flow on the center manifold that enables us determining the direction of Hopf bifurcations and stability of the bifurcating periodic orbits. We also discuss computational properties of the system due to the delay when an external drive of the network mimicks external sensory input.

Artificial neural network detects human uncertainty

Science.gov (United States)

Hramov, Alexander E.; Frolov, Nikita S.; Maksimenko, Vladimir A.; Makarov, Vladimir V.; Koronovskii, Alexey A.; Garcia-Prieto, Juan; Antón-Toro, Luis Fernando; Maestú, Fernando; Pisarchik, Alexander N.

2018-03-01

Artificial neural networks (ANNs) are known to be a powerful tool for data analysis. They are used in social science, robotics, and neurophysiology for solving tasks of classification, forecasting, pattern recognition, etc. In neuroscience, ANNs allow the recognition of specific forms of brain activity from multichannel EEG or MEG data. This makes the ANN an efficient computational core for brain-machine systems. However, despite significant achievements of artificial intelligence in recognition and classification of well-reproducible patterns of neural activity, the use of ANNs for recognition and classification of patterns in neural networks still requires additional attention, especially in ambiguous situations. According to this, in this research, we demonstrate the efficiency of application of the ANN for classification of human MEG trials corresponding to the perception of bistable visual stimuli with different degrees of ambiguity. We show that along with classification of brain states associated with multistable image interpretations, in the case of significant ambiguity, the ANN can detect an uncertain state when the observer doubts about the image interpretation. With the obtained results, we describe the possible application of ANNs for detection of bistable brain activity associated with difficulties in the decision-making process.

Morphogens, modeling and patterning the neural tube: an interview with James Briscoe.

Science.gov (United States)

Briscoe, James

2015-01-20

James Briscoe has a BSc in Microbiology and Virology (from the University of Warwick, UK) and a PhD in Molecular and Cellular Biology (from the Imperial Cancer Research Fund, London, now Cancer Research UK). He started working on the development of the neural tube in the lab of Tom Jessel as a postdoctoral fellow, establishing that there was graded sonic hedgehog signaling in the ventral neural tube. He is currently a group leader and Head of Division in Developmental Biology at the MRC National Institute for Medical Research (which will become part of the Francis Crick Institute in April 2015). He is working to understand the molecular and cellular mechanisms of graded signaling in the vertebrate neural tube.We interviewed him about the development of ideas on morphogenetic gradients and his own work on modeling the development of the neural tube for our series on modeling in biology.

Generalization error analysis: deep convolutional neural network in mammography

Science.gov (United States)

Richter, Caleb D.; Samala, Ravi K.; Chan, Heang-Ping; Hadjiiski, Lubomir; Cha, Kenny

2018-02-01

We conducted a study to gain understanding of the generalizability of deep convolutional neural networks (DCNNs) given their inherent capability to memorize data. We examined empirically a specific DCNN trained for classification of masses on mammograms. Using a data set of 2,454 lesions from 2,242 mammographic views, a DCNN was trained to classify masses into malignant and benign classes using transfer learning from ImageNet LSVRC-2010. We performed experiments with varying amounts of label corruption and types of pixel randomization to analyze the generalization error for the DCNN. Performance was evaluated using the area under the receiver operating characteristic curve (AUC) with an N-fold cross validation. Comparisons were made between the convergence times, the inference AUCs for both the training set and the test set of the original image patches without corruption, and the root-mean-squared difference (RMSD) in the layer weights of the DCNN trained with different amounts and methods of corruption. Our experiments observed trends which revealed that the DCNN overfitted by memorizing corrupted data. More importantly, this study improved our understanding of DCNN weight updates when learning new patterns or new labels. Although we used a specific classification task with the ImageNet as example, similar methods may be useful for analysis of the DCNN learning processes, especially those that employ transfer learning for medical image analysis where sample size is limited and overfitting risk is high.

The use of global image characteristics for neural network pattern recognitions

Science.gov (United States)

Kulyas, Maksim O.; Kulyas, Oleg L.; Loshkarev, Aleksey S.

2017-04-01

The recognition system is observed, where the information is transferred by images of symbols generated by a television camera. For descriptors of objects the coefficients of two-dimensional Fourier transformation generated in a special way. For solution of the task of classification the one-layer neural network trained on reference images is used. Fast learning of a neural network with a single neuron calculation of coefficients is applied.

Evidence for a neural law of effect.

Science.gov (United States)

Athalye, Vivek R; Santos, Fernando J; Carmena, Jose M; Costa, Rui M

2018-03-02

Thorndike's law of effect states that actions that lead to reinforcements tend to be repeated more often. Accordingly, neural activity patterns leading to reinforcement are also reentered more frequently. Reinforcement relies on dopaminergic activity in the ventral tegmental area (VTA), and animals shape their behavior to receive dopaminergic stimulation. Seeking evidence for a neural law of effect, we found that mice learn to reenter more frequently motor cortical activity patterns that trigger optogenetic VTA self-stimulation. Learning was accompanied by gradual shaping of these patterns, with participating neurons progressively increasing and aligning their covariance to that of the target pattern. Motor cortex patterns that lead to phasic dopaminergic VTA activity are progressively reinforced and shaped, suggesting a mechanism by which animals select and shape actions to reliably achieve reinforcement. Copyright © 2018 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works.

Identification of Complex Dynamical Systems with Neural Networks (2/2)

CERN Multimedia

CERN. Geneva

2016-01-01

The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...

Identification of Complex Dynamical Systems with Neural Networks (1/2)

CERN Multimedia

CERN. Geneva

2016-01-01

The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...

A neural model for transient identification in dynamic processes with 'don't know' response

Energy Technology Data Exchange (ETDEWEB)

Mol, Antonio C. de A. E-mail: mol@ien.gov.br; Martinez, Aquilino S. E-mail: aquilino@lmp.ufrj.br; Schirru, Roberto E-mail: schirru@lmp.ufrj.br

2003-09-01

This work presents an approach for neural network based transient identification which allows either dynamic identification or a 'don't know' response. The approach uses two 'jump' multilayer neural networks (NN) trained with the backpropagation algorithm. The 'jump' network is used because it is useful to dealing with very complex patterns, which is the case of the space of the state variables during some abnormal events. The first one is responsible for the dynamic identification. This NN uses, as input, a short set (in a moving time window) of recent measurements of each variable avoiding the necessity of using starting events. The other one is used to validate the instantaneous identification (from the first net) through the validation of each variable. This net is responsible for allowing the system to provide a 'don't know' response. In order to validate the method, a Nuclear Power Plant (NPP) transient identification problem comprising 15 postulated accidents, simulated for a pressurized water reactor (PWR), was proposed in the validation process it has been considered noisy data in order to evaluate the method robustness. Obtained results reveal the ability of the method in dealing with both dynamic identification of transients and correct 'don't know' response. Another important point studied in this work is that the system has shown to be independent of a trigger signal which indicates the beginning of the transient, thus making it robust in relation to this limitation.

msh/Msx gene family in neural development.

Science.gov (United States)

Ramos, Casto; Robert, Benoît

2005-11-01

The involvement of Msx homeobox genes in skull and tooth formation has received a great deal of attention. Recent studies also indicate a role for the msh/Msx gene family in development of the nervous system. In this article, we discuss the functions of these transcription factors in neural-tissue organogenesis. We will deal mainly with the interactions of the Drosophila muscle segment homeobox (msh) gene with other homeobox genes and the repressive cascade that leads to neuroectoderm patterning; the role of Msx genes in neural-crest induction, focusing especially on the differences between lower and higher vertebrates; their implication in patterning of the vertebrate neural tube, particularly in diencephalon midline formation. Finally, we will examine the distinct activities of Msx1, Msx2 and Msx3 genes during neurogenesis, taking into account their relationships with signalling molecules such as BMP.

Decoding of visual activity patterns from fMRI responses using multivariate pattern analyses and convolutional neural network.

Science.gov (United States)

Zafar, Raheel; Kamel, Nidal; Naufal, Mohamad; Malik, Aamir Saeed; Dass, Sarat C; Ahmad, Rana Fayyaz; Abdullah, Jafri M; Reza, Faruque

2017-01-01

Decoding of human brain activity has always been a primary goal in neuroscience especially with functional magnetic resonance imaging (fMRI) data. In recent years, Convolutional neural network (CNN) has become a popular method for the extraction of features due to its higher accuracy, however it needs a lot of computation and training data. In this study, an algorithm is developed using Multivariate pattern analysis (MVPA) and modified CNN to decode the behavior of brain for different images with limited data set. Selection of significant features is an important part of fMRI data analysis, since it reduces the computational burden and improves the prediction performance; significant features are selected using t-test. MVPA uses machine learning algorithms to classify different brain states and helps in prediction during the task. General linear model (GLM) is used to find the unknown parameters of every individual voxel and the classification is done using multi-class support vector machine (SVM). MVPA-CNN based proposed algorithm is compared with region of interest (ROI) based method and MVPA based estimated values. The proposed method showed better overall accuracy (68.6%) compared to ROI (61.88%) and estimation values (64.17%).

Connectivity strategies for higher-order neural networks applied to pattern recognition

Science.gov (United States)

Spirkovska, Lilly; Reid, Max B.

1990-01-01

Different strategies for non-fully connected HONNs (higher-order neural networks) are discussed, showing that by using such strategies an input field of 128 x 128 pixels can be attained while still achieving in-plane rotation and translation-invariant recognition. These techniques allow HONNs to be used with the larger input scenes required for practical pattern-recognition applications. The number of interconnections that must be stored has been reduced by a factor of approximately 200,000 in a T/C case and about 2000 in a Space Shuttle/F-18 case by using regional connectivity. Third-order networks have been simulated using several connection strategies. The method found to work best is regional connectivity. The main advantages of this strategy are the following: (1) it considers features of various scales within the image and thus gets a better sample of what the image looks like; (2) it is invariant to shape-preserving geometric transformations, such as translation and rotation; (3) the connections are predetermined so that no extra computations are necessary during run time; and (4) it does not require any extra storage for recording which connections were formed.

Pattern recognition

CERN Document Server

Theodoridis, Sergios

2003-01-01

Pattern recognition is a scientific discipline that is becoming increasingly important in the age of automation and information handling and retrieval. Patter Recognition, 2e covers the entire spectrum of pattern recognition applications, from image analysis to speech recognition and communications. This book presents cutting-edge material on neural networks, - a set of linked microprocessors that can form associations and uses pattern recognition to ""learn"" -and enhances student motivation by approaching pattern recognition from the designer's point of view. A direct result of more than 10

Identification of Abnormal System Noise Temperature Patterns in Deep Space Network Antennas Using Neural Network Trained Fuzzy Logic

Science.gov (United States)

Lu, Thomas; Pham, Timothy; Liao, Jason

2011-01-01

This paper presents the development of a fuzzy logic function trained by an artificial neural network to classify the system noise temperature (SNT) of antennas in the NASA Deep Space Network (DSN). The SNT data were classified into normal, marginal, and abnormal classes. The irregular SNT pattern was further correlated with link margin and weather data. A reasonably good correlation is detected among high SNT, low link margin and the effect of bad weather; however we also saw some unexpected non-correlations which merit further study in the future.

NSDann2BS, a neutron spectrum unfolding code based on neural networks technology and two bonner spheres

Energy Technology Data Exchange (ETDEWEB)

Ortiz-Rodriguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solis Sanches, L. O.; Miranda, R. Castaneda; Cervantes Viramontes, J. M. [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica. Av. Ramon Lopez Velarde 801. Col. Centro Zacatecas, Zac (Mexico); Vega-Carrillo, H. R. [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica. Av. Ramon Lopez Velarde 801. Col. Centro Zacatecas, Zac., Mexico. and Unidad Academica de Estudios Nucleares. C. Cip (Mexico)

2013-07-03

In this work a neutron spectrum unfolding code, based on artificial intelligence technology is presented. The code called ''Neutron Spectrometry and Dosimetry with Artificial Neural Networks and two Bonner spheres'', (NSDann2BS), was designed in a graphical user interface under the LabVIEW programming environment. The main features of this code are to use an embedded artificial neural network architecture optimized with the ''Robust design of artificial neural networks methodology'' and to use two Bonner spheres as the only piece of information. In order to build the code here presented, once the net topology was optimized and properly trained, knowledge stored at synaptic weights was extracted and using a graphical framework build on the LabVIEW programming environment, the NSDann2BS code was designed. This code is friendly, intuitive and easy to use for the end user. The code is freely available upon request to authors. To demonstrate the use of the neural net embedded in the NSDann2BS code, the rate counts of {sup 252}Cf, {sup 241}AmBe and {sup 239}PuBe neutron sources measured with a Bonner spheres system.

NSDann2BS, a neutron spectrum unfolding code based on neural networks technology and two bonner spheres

International Nuclear Information System (INIS)

Ortiz-Rodríguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solís Sánches, L. O.; Miranda, R. Castañeda; Cervantes Viramontes, J. M.; Vega-Carrillo, H. R.

2013-01-01

In this work a neutron spectrum unfolding code, based on artificial intelligence technology is presented. The code called ''Neutron Spectrometry and Dosimetry with Artificial Neural Networks and two Bonner spheres'', (NSDann2BS), was designed in a graphical user interface under the LabVIEW programming environment. The main features of this code are to use an embedded artificial neural network architecture optimized with the ''Robust design of artificial neural networks methodology'' and to use two Bonner spheres as the only piece of information. In order to build the code here presented, once the net topology was optimized and properly trained, knowledge stored at synaptic weights was extracted and using a graphical framework build on the LabVIEW programming environment, the NSDann2BS code was designed. This code is friendly, intuitive and easy to use for the end user. The code is freely available upon request to authors. To demonstrate the use of the neural net embedded in the NSDann2BS code, the rate counts of 252 Cf, 241 AmBe and 239 PuBe neutron sources measured with a Bonner spheres system

NSDann2BS, a neutron spectrum unfolding code based on neural networks technology and two bonner spheres

Science.gov (United States)

Ortiz-Rodríguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solís Sánches, L. O.; Miranda, R. Castañeda; Cervantes Viramontes, J. M.; Vega-Carrillo, H. R.

2013-07-01

In this work a neutron spectrum unfolding code, based on artificial intelligence technology is presented. The code called "Neutron Spectrometry and Dosimetry with Artificial Neural Networks and two Bonner spheres", (NSDann2BS), was designed in a graphical user interface under the LabVIEW programming environment. The main features of this code are to use an embedded artificial neural network architecture optimized with the "Robust design of artificial neural networks methodology" and to use two Bonner spheres as the only piece of information. In order to build the code here presented, once the net topology was optimized and properly trained, knowledge stored at synaptic weights was extracted and using a graphical framework build on the LabVIEW programming environment, the NSDann2BS code was designed. This code is friendly, intuitive and easy to use for the end user. The code is freely available upon request to authors. To demonstrate the use of the neural net embedded in the NSDann2BS code, the rate counts of 252Cf, 241AmBe and 239PuBe neutron sources measured with a Bonner spheres system.

Classification of polycystic ovary based on ultrasound images using competitive neural network

Science.gov (United States)

Dewi, R. M.; Adiwijaya; Wisesty, U. N.; Jondri

2018-03-01

Infertility in the women reproduction system due to inhibition of follicles maturation process causing the number of follicles which is called polycystic ovaries (PCO). PCO detection is still operated manually by a gynecologist by counting the number and size of follicles in the ovaries, so it takes a long time and needs high accuracy. In general, PCO can be detected by calculating stereology or feature extraction and classification. In this paper, we designed a system to classify PCO by using the feature extraction (Gabor Wavelet method) and Competitive Neural Network (CNN). CNN was selected because this method is the combination between Hemming Net and The Max Net so that the data classification can be performed based on the specific characteristics of ultrasound data. Based on the result of system testing, Competitive Neural Network obtained the highest accuracy is 80.84% and the time process is 60.64 seconds (when using 32 feature vectors as well as weight and bias values respectively of 0.03 and 0.002).

Net primary productivity, allocation pattern and carbon use efficiency in an apple orchard assessed by integrating eddy covariance, biometric and continuous soil chamber measurements

Directory of Open Access Journals (Sweden)

D. Zanotelli

2013-05-01

Full Text Available Carbon use efficiency (CUE, the ratio of net primary production (NPP over gross primary production (GPP, is a functional parameter that could possibly link the current increasingly accurate global GPP estimates with those of net ecosystem exchange, for which global predictors are still unavailable. Nevertheless, CUE estimates are actually available for only a few ecosystem types, while information regarding agro-ecosystems is scarce, in spite of the simplified spatial structure of these ecosystems that facilitates studies on allocation patterns and temporal growth dynamics. We combined three largely deployed methods, eddy covariance, soil respiration and biometric measurements, to assess monthly values of CUE, NPP and allocation patterns in different plant organs in an apple orchard during a complete year (2010. We applied a measurement protocol optimized for quantifying monthly values of carbon fluxes in this ecosystem type, which allows for a cross check between estimates obtained from different methods. We also attributed NPP components to standing biomass increments, detritus cycle feeding and lateral exports. We found that in the apple orchard, both net ecosystem production and gross primary production on a yearly basis, 380 ± 30 g C m−2 and 1263 ± 189 g C m−2 respectively, were of a magnitude comparable to those of natural forests growing in similar climate conditions. The largest differences with respect to forests are in the allocation pattern and in the fate of produced biomass. The carbon sequestered from the atmosphere was largely allocated to production of fruit: 49% of annual NPP was taken away from the ecosystem through apple production. Organic material (leaves, fine root litter, pruned wood and early fruit falls contributing to the detritus cycle was 46% of the NPP. Only 5% was attributable to standing biomass increment, while this NPP component is generally the largest in forests. The CUE, with an annual average of 0.71 �

Net primary productivity, allocation pattern and carbon use efficiency in an apple orchard assessed by integrating eddy-covariance, biometric and continuous soil chamber measurements

Science.gov (United States)

Zanotelli, D.; Montagnani, L.; Manca, G.; Tagliavini, M.

2012-10-01

Carbon use efficiency (CUE) is a functional parameter that could possibly link the current increasingly accurate global estimates of gross primary production with those of net ecosystem exchange, for which global predictors are still unavailable. Nevertheless, CUE estimates are actually available for only a few ecosystem types, while information regarding agro-ecosystems is scarce, in spite of the simplified spatial structure of these ecosystems that facilitates studies on allocation patterns and temporal growth dynamics. We combined three largely deployed methods, eddy covariance, soil respiration and biometric measurements, to assess monthly values of CUE, net primary production (NPP) and allocation patterns in different plant organs in an apple orchard during a complete year (2010). We applied a~measurement protocol optimized for quantifying monthly values of carbon fluxes in this ecosystem type, which allows for a cross-check between estimates obtained from different methods. We also attributed NPP components to standing biomass increments, detritus cycle feeding and lateral exports. We found that in the apple orchard both net ecosystem production and gross primary production on yearly basis, 380 ± 30 g C m-2 and 1263 ± 189 g C m-2 respectively, were of a magnitude comparable to those of natural forests growing in similar climate conditions. The largest differences with respect to forests are in the allocation pattern and in the fate of produced biomass. The carbon sequestered from the atmosphere was largely allocated to production of fruits: 49% of annual NPP was taken away from the ecosystem through apple production. Organic material (leaves, fine root litter, pruned wood and early fruit falls) contributing to the detritus cycle was 46% of the NPP. Only 5% was attributable to standing biomass increment, while this NPP component is generally the largest in forests. The CUE, with an annual average of 0.71 ± 0.09, was higher than the previously suggested

Net primary productivity, allocation pattern and carbon use efficiency in an apple orchard assessed by integrating eddy covariance, biometric and continuous soil chamber measurements

Science.gov (United States)

Zanotelli, D.; Montagnani, L.; Manca, G.; Tagliavini, M.

2013-05-01

Carbon use efficiency (CUE), the ratio of net primary production (NPP) over gross primary production (GPP), is a functional parameter that could possibly link the current increasingly accurate global GPP estimates with those of net ecosystem exchange, for which global predictors are still unavailable. Nevertheless, CUE estimates are actually available for only a few ecosystem types, while information regarding agro-ecosystems is scarce, in spite of the simplified spatial structure of these ecosystems that facilitates studies on allocation patterns and temporal growth dynamics. We combined three largely deployed methods, eddy covariance, soil respiration and biometric measurements, to assess monthly values of CUE, NPP and allocation patterns in different plant organs in an apple orchard during a complete year (2010). We applied a measurement protocol optimized for quantifying monthly values of carbon fluxes in this ecosystem type, which allows for a cross check between estimates obtained from different methods. We also attributed NPP components to standing biomass increments, detritus cycle feeding and lateral exports. We found that in the apple orchard, both net ecosystem production and gross primary production on a yearly basis, 380 ± 30 g C m-2 and 1263 ± 189 g C m-2 respectively, were of a magnitude comparable to those of natural forests growing in similar climate conditions. The largest differences with respect to forests are in the allocation pattern and in the fate of produced biomass. The carbon sequestered from the atmosphere was largely allocated to production of fruit: 49% of annual NPP was taken away from the ecosystem through apple production. Organic material (leaves, fine root litter, pruned wood and early fruit falls) contributing to the detritus cycle was 46% of the NPP. Only 5% was attributable to standing biomass increment, while this NPP component is generally the largest in forests. The CUE, with an annual average of 0.71 ± 0.12, was higher

Topology influences performance in the associative memory neural networks

International Nuclear Information System (INIS)

Lu Jianquan; He Juan; Cao Jinde; Gao Zhiqiang

2006-01-01

To explore how topology affects performance within Hopfield-type associative memory neural networks (AMNNs), we studied the computational performance of the neural networks with regular lattice, random, small-world, and scale-free structures. In this Letter, we found that the memory performance of neural networks obtained through asynchronous updating from 'larger' nodes to 'smaller' nodes are better than asynchronous updating in random order, especially for the scale-free topology. The computational performance of associative memory neural networks linked by the above-mentioned network topologies with the same amounts of nodes (neurons) and edges (synapses) were studied respectively. Along with topologies becoming more random and less locally disordered, we will see that the performance of associative memory neural network is quite improved. By comparing, we show that the regular lattice and random network form two extremes in terms of patterns stability and retrievability. For a network, its patterns stability and retrievability can be largely enhanced by adding a random component or some shortcuts to its structured component. According to the conclusions of this Letter, we can design the associative memory neural networks with high performance and minimal interconnect requirements

Classification of behavior using unsupervised temporal neural networks

International Nuclear Information System (INIS)

Adair, K.L.

1998-03-01

Adding recurrent connections to unsupervised neural networks used for clustering creates a temporal neural network which clusters a sequence of inputs as they appear over time. The model presented combines the Jordan architecture with the unsupervised learning technique Adaptive Resonance Theory, Fuzzy ART. The combination yields a neural network capable of quickly clustering sequential pattern sequences as the sequences are generated. The applicability of the architecture is illustrated through a facility monitoring problem

Behavioral and neural concordance in parent-child dyadic sleep patterns.

Science.gov (United States)

Lee, Tae-Ho; Miernicki, Michelle E; Telzer, Eva H

2017-08-01

Sleep habits developed in adolescence shape long-term trajectories of psychological, educational, and physiological well-being. Adolescents' sleep behaviors are shaped by their parents' sleep at both the behavioral and biological levels. In the current study, we sought to examine how neural concordance in resting-state functional connectivity between parent-child dyads is associated with dyadic concordance in sleep duration and adolescents' sleep quality. To this end, we scanned both parents and their child (N=28 parent-child dyads; parent M age =42.8years; adolescent M age =14.9years; 14.3% father; 46.4% female adolescent) as they each underwent a resting-state scan. Using daily diaries, we also assessed dyadic concordance in sleep duration across two weeks. Our results show that greater daily concordance in sleep behavior is associated with greater neural concordance in default-mode network connectivity between parents and children. Moreover, greater neural and behavioral concordances in sleep is associated with more optimal sleep quality in adolescents. The current findings expand our understanding of dyadic concordance by providing a neurobiological mechanism by which parents and children share daily sleep behaviors. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Influence of net freshwater supply on salinity in Florida Bay

Science.gov (United States)

Nuttle, William K.; Fourqurean, James W.; Cosby, Bernard J.; Zieman, Joseph C.; Robblee, Michael B.

2000-01-01

An annual water budget for Florida Bay, the large, seasonally hypersaline estuary in the Everglades National Park, was constructed using physically based models and long‐term (31 years) data on salinity, hydrology, and climate. Effects of seasonal and interannual variations of the net freshwater supply (runoff plus rainfall minus evaporation) on salinity variation within the bay were also examined. Particular attention was paid to the effects of runoff, which are the focus of ambitious plans to restore and conserve the Florida Bay ecosystem. From 1965 to 1995 the annual runoff from the Everglades into the bay was less than one tenth of the annual direct rainfall onto the bay, while estimated annual evaporation slightly exceeded annual rainfall. The average net freshwater supply to the bay over a year was thus approximately zero, and interannual variations in salinity appeared to be affected primarily by interannual fluctuations in rainfall. At the annual scale, runoff apparently had little effect on the bay as a whole during this period. On a seasonal basis, variations in rainfall, evaporation, and runoff were not in phase, and the net freshwater supply to the bay varied between positive and negative values, contributing to a strong seasonal pattern in salinity, especially in regions of the bay relatively isolated from exchanges with the Gulf of Mexico and Atlantic Ocean. Changes in runoff could have a greater effect on salinity in the bay if the seasonal patterns of rainfall and evaporation and the timing of the runoff are considered. One model was also used to simulate spatial and temporal patterns of salinity responses expected to result from changes in net freshwater supply. Simulations in which runoff was increased by a factor of 2 (but with no change in spatial pattern) indicated that increased runoff will lower salinity values in eastern Florida Bay, increase the variability of salinity in the South Region, but have little effect on salinity in the Central

Local community detection as pattern restoration by attractor dynamics of recurrent neural networks.

Science.gov (United States)

Okamoto, Hiroshi

2016-08-01

Densely connected parts in networks are referred to as "communities". Community structure is a hallmark of a variety of real-world networks. Individual communities in networks form functional modules of complex systems described by networks. Therefore, finding communities in networks is essential to approaching and understanding complex systems described by networks. In fact, network science has made a great deal of effort to develop effective and efficient methods for detecting communities in networks. Here we put forward a type of community detection, which has been little examined so far but will be practically useful. Suppose that we are given a set of source nodes that includes some (but not all) of "true" members of a particular community; suppose also that the set includes some nodes that are not the members of this community (i.e., "false" members of the community). We propose to detect the community from this "imperfect" and "inaccurate" set of source nodes using attractor dynamics of recurrent neural networks. Community detection by the proposed method can be viewed as restoration of the original pattern from a deteriorated pattern, which is analogous to cue-triggered recall of short-term memory in the brain. We demonstrate the effectiveness of the proposed method using synthetic networks and real social networks for which correct communities are known. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Neural networks and applications tutorial

Science.gov (United States)

Guyon, I.

1991-09-01

The importance of neural networks has grown dramatically during this decade. While only a few years ago they were primarily of academic interest, now dozens of companies and many universities are investigating the potential use of these systems and products are beginning to appear. The idea of building a machine whose architecture is inspired by that of the brain has roots which go far back in history. Nowadays, technological advances of computers and the availability of custom integrated circuits, permit simulations of hundreds or even thousands of neurons. In conjunction, the growing interest in learning machines, non-linear dynamics and parallel computation spurred renewed attention in artificial neural networks. Many tentative applications have been proposed, including decision systems (associative memories, classifiers, data compressors and optimizers), or parametric models for signal processing purposes (system identification, automatic control, noise canceling, etc.). While they do not always outperform standard methods, neural network approaches are already used in some real world applications for pattern recognition and signal processing tasks. The tutorial is divided into six lectures, that where presented at the Third Graduate Summer Course on Computational Physics (September 3-7, 1990) on Parallel Architectures and Applications, organized by the European Physical Society: (1) Introduction: machine learning and biological computation. (2) Adaptive artificial neurons (perceptron, ADALINE, sigmoid units, etc.): learning rules and implementations. (3) Neural network systems: architectures, learning algorithms. (4) Applications: pattern recognition, signal processing, etc. (5) Elements of learning theory: how to build networks which generalize. (6) A case study: a neural network for on-line recognition of handwritten alphanumeric characters.

Genetic and neural approaches to nuclear transient identification

International Nuclear Information System (INIS)

Almeida, Jose Carlos Soares de; Mol, Antonio Carlos de Abreu; Pereira, Claudio Marcio Nascimento Abreu; Lapa, Celso Marcelo Franklin

2005-01-01

This work presents two approaches for pattern recognition to the same set of reactor signals. The first one describes a possibilistic approach optimized by genetic algorithm. The use of a possibilistic classification provides a natural and consistent classification rules, leading naturally to a good heuristic to handle the 'don't know' response, in case of unrecognized transient, which is fairly desirable in transient classification systems where safety is critical, since wrong or not reliable classifications can be catastrophic. Application of the proposed approach to a nuclear transient identification problem reveals good capability of the genetic algorithm in learning optimized possibilistic classification rules for efficient diagnosis including 'don't know' response. The second one uses two multilayer neural networks (NN). The first NN is responsible for the dynamic identification. This NN uses, as input, a short set (in a moving time window) of recent measurements of each variable avoiding the necessity of using starting events. The second NN is used to validate the instantaneous identification (from the first net) through the validation of each variable. This net is responsible for allowing the system to provide a 'don't know' response. In order to validate both methods, a Nuclear Power Plant (NPP) transient identification problem comprising postulated accidents, simulated for a pressurized water reactor, was proposed in the validation process it has been considered noisy data in order to evaluate the method robustness. Obtained results reveal the ability of the methods in dealing with both dynamic identification of transients and correct 'don't know' response. (author)

Comparing success levels of different neural network structures in extracting discriminative information from the response patterns of a temperature-modulated resistive gas sensor

Science.gov (United States)

Hosseini-Golgoo, S. M.; Bozorgi, H.; Saberkari, A.

2015-06-01

Performances of three neural networks, consisting of a multi-layer perceptron, a radial basis function, and a neuro-fuzzy network with local linear model tree training algorithm, in modeling and extracting discriminative features from the response patterns of a temperature-modulated resistive gas sensor are quantitatively compared. For response pattern recording, a voltage staircase containing five steps each with a 20 s plateau is applied to the micro-heater of the sensor, when 12 different target gases, each at 11 concentration levels, are present. In each test, the hidden layer neuron weights are taken as the discriminatory feature vector of the target gas. These vectors are then mapped to a 3D feature space using linear discriminant analysis. The discriminative information content of the feature vectors are determined by the calculation of the Fisher’s discriminant ratio, affording quantitative comparison among the success rates achieved by the different neural network structures. The results demonstrate a superior discrimination ratio for features extracted from local linear neuro-fuzzy and radial-basis-function networks with recognition rates of 96.27% and 90.74%, respectively.

Comparing success levels of different neural network structures in extracting discriminative information from the response patterns of a temperature-modulated resistive gas sensor

International Nuclear Information System (INIS)

Hosseini-Golgoo, S M; Bozorgi, H; Saberkari, A

2015-01-01

Performances of three neural networks, consisting of a multi-layer perceptron, a radial basis function, and a neuro-fuzzy network with local linear model tree training algorithm, in modeling and extracting discriminative features from the response patterns of a temperature-modulated resistive gas sensor are quantitatively compared. For response pattern recording, a voltage staircase containing five steps each with a 20 s plateau is applied to the micro-heater of the sensor, when 12 different target gases, each at 11 concentration levels, are present. In each test, the hidden layer neuron weights are taken as the discriminatory feature vector of the target gas. These vectors are then mapped to a 3D feature space using linear discriminant analysis. The discriminative information content of the feature vectors are determined by the calculation of the Fisher’s discriminant ratio, affording quantitative comparison among the success rates achieved by the different neural network structures. The results demonstrate a superior discrimination ratio for features extracted from local linear neuro-fuzzy and radial-basis-function networks with recognition rates of 96.27% and 90.74%, respectively. (paper)

Net-baryon-, net-proton-, and net-charge kurtosis in heavy-ion collisions within a relativistic transport approach

International Nuclear Information System (INIS)

Nahrgang, Marlene; Schuster, Tim; Stock, Reinhard; Mitrovski, Michael; Bleicher, Marcus

2012-01-01

We explore the potential of net-baryon, net-proton and net-charge kurtosis measurements to investigate the properties of hot and dense matter created in relativistic heavy-ion collisions. Contrary to calculations in a grand-canonical ensemble we explicitly take into account exact electric and baryon charge conservation on an event-by-event basis. This drastically limits the width of baryon fluctuations. A simple model to account for this is to assume a grand-canonical distribution with a sharp cut-off at the tails. We present baseline predictions of the energy dependence of the net-baryon, net-proton and net-charge kurtosis for central (b≤2.75 fm) Pb+Pb/Au+Au collisions from E lab =2A GeV to √(s NN )=200 GeV from the UrQMD model. While the net-charge kurtosis is compatible with values around zero, the net-baryon number decreases to large negative values with decreasing beam energy. The net-proton kurtosis becomes only slightly negative for low √(s NN ). (orig.)

Classification of Company Performance using Weighted Probabilistic Neural Network

Science.gov (United States)

Yasin, Hasbi; Waridi Basyiruddin Arifin, Adi; Warsito, Budi

2018-05-01

Classification of company performance can be judged by looking at its financial status, whether good or bad state. Classification of company performance can be achieved by some approach, either parametric or non-parametric. Neural Network is one of non-parametric methods. One of Artificial Neural Network (ANN) models is Probabilistic Neural Network (PNN). PNN consists of four layers, i.e. input layer, pattern layer, addition layer, and output layer. The distance function used is the euclidean distance and each class share the same values as their weights. In this study used PNN that has been modified on the weighting process between the pattern layer and the addition layer by involving the calculation of the mahalanobis distance. This model is called the Weighted Probabilistic Neural Network (WPNN). The results show that the company's performance modeling with the WPNN model has a very high accuracy that reaches 100%.

A neural network approach to job-shop scheduling.

Science.gov (United States)

Zhou, D N; Cherkassky, V; Baldwin, T R; Olson, D E

1991-01-01

A novel analog computational network is presented for solving NP-complete constraint satisfaction problems, i.e. job-shop scheduling. In contrast to most neural approaches to combinatorial optimization based on quadratic energy cost function, the authors propose to use linear cost functions. As a result, the network complexity (number of neurons and the number of resistive interconnections) grows only linearly with problem size, and large-scale implementations become possible. The proposed approach is related to the linear programming network described by D.W. Tank and J.J. Hopfield (1985), which also uses a linear cost function for a simple optimization problem. It is shown how to map a difficult constraint-satisfaction problem onto a simple neural net in which the number of neural processors equals the number of subjobs (operations) and the number of interconnections grows linearly with the total number of operations. Simulations show that the authors' approach produces better solutions than existing neural approaches to job-shop scheduling, i.e. the traveling salesman problem-type Hopfield approach and integer linear programming approach of J.P.S. Foo and Y. Takefuji (1988), in terms of the quality of the solution and the network complexity.

Auto-Context Convolutional Neural Network (Auto-Net) for Brain Extraction in Magnetic Resonance Imaging.

Science.gov (United States)

Mohseni Salehi, Seyed Sadegh; Erdogmus, Deniz; Gholipour, Ali

2017-11-01

Brain extraction or whole brain segmentation is an important first step in many of the neuroimage analysis pipelines. The accuracy and the robustness of brain extraction, therefore, are crucial for the accuracy of the entire brain analysis process. The state-of-the-art brain extraction techniques rely heavily on the accuracy of alignment or registration between brain atlases and query brain anatomy, and/or make assumptions about the image geometry, and therefore have limited success when these assumptions do not hold or image registration fails. With the aim of designing an accurate, learning-based, geometry-independent, and registration-free brain extraction tool, in this paper, we present a technique based on an auto-context convolutional neural network (CNN), in which intrinsic local and global image features are learned through 2-D patches of different window sizes. We consider two different architectures: 1) a voxelwise approach based on three parallel 2-D convolutional pathways for three different directions (axial, coronal, and sagittal) that implicitly learn 3-D image information without the need for computationally expensive 3-D convolutions and 2) a fully convolutional network based on the U-net architecture. Posterior probability maps generated by the networks are used iteratively as context information along with the original image patches to learn the local shape and connectedness of the brain to extract it from non-brain tissue. The brain extraction results we have obtained from our CNNs are superior to the recently reported results in the literature on two publicly available benchmark data sets, namely, LPBA40 and OASIS, in which we obtained the Dice overlap coefficients of 97.73% and 97.62%, respectively. Significant improvement was achieved via our auto-context algorithm. Furthermore, we evaluated the performance of our algorithm in the challenging problem of extracting arbitrarily oriented fetal brains in reconstructed fetal brain magnetic

DeepFix: A Fully Convolutional Neural Network for Predicting Human Eye Fixations.

Science.gov (United States)

Kruthiventi, Srinivas S S; Ayush, Kumar; Babu, R Venkatesh

2017-09-01

Understanding and predicting the human visual attention mechanism is an active area of research in the fields of neuroscience and computer vision. In this paper, we propose DeepFix, a fully convolutional neural network, which models the bottom-up mechanism of visual attention via saliency prediction. Unlike classical works, which characterize the saliency map using various hand-crafted features, our model automatically learns features in a hierarchical fashion and predicts the saliency map in an end-to-end manner. DeepFix is designed to capture semantics at multiple scales while taking global context into account, by using network layers with very large receptive fields. Generally, fully convolutional nets are spatially invariant-this prevents them from modeling location-dependent patterns (e.g., centre-bias). Our network handles this by incorporating a novel location-biased convolutional layer. We evaluate our model on multiple challenging saliency data sets and show that it achieves the state-of-the-art results.

Patterns of altered neural synchrony in the default mode network in autism spectrum disorder revealed with magnetoencephalography (MEG): Relationship to clinical symptomatology.

Science.gov (United States)

Lajiness-O'Neill, Renée; Brennan, Jonathan R; Moran, John E; Richard, Annette E; Flores, Ana-Mercedes; Swick, Casey; Goodcase, Ryan; Andersen, Tiffany; McFarlane, Kaitlyn; Rusiniak, Kenneth; Kovelman, Ioulia; Wagley, Neelima; Ugolini, Maggie; Albright, Jeremy; Bowyer, Susan M

2018-03-01

Disrupted neural synchrony may be a primary electrophysiological abnormality in autism spectrum disorders (ASD), altering communication between discrete brain regions and contributing to abnormalities in patterns of connectivity within identified neural networks. Studies exploring brain dynamics to comprehensively characterize and link connectivity to large-scale cortical networks and clinical symptoms are lagging considerably. Patterns of neural coherence within the Default Mode Network (DMN) and Salience Network (SN) during resting state were investigated in 12 children with ASD (M Age  = 9.2) and 13 age and gender-matched neurotypicals (NT) (M Age  = 9.3) with magnetoencephalography. Coherence between 231 brain region pairs within four frequency bands (theta (4-7 Hz), alpha, (8-12 Hz), beta (13-30 Hz), and gamma (30-80 Hz)) was calculated. Relationships between neural coherence and social functioning were examined. ASD was characterized by lower synchronization across all frequencies, reaching clinical significance in the gamma band. Lower gamma synchrony between fronto-temporo-parietal regions was observed, partially consistent with diminished default mode network (DMN) connectivity. Lower gamma coherence in ASD was evident in cross-hemispheric connections between: angular with inferior/middle frontal; middle temporal with middle/inferior frontal; and within right-hemispheric connections between angular, middle temporal, and inferior/middle frontal cortices. Lower gamma coherence between left angular and left superior frontal, right inferior/middle frontal, and right precuneus and between right angular and inferior/middle frontal cortices was related to lower social/social-communication functioning. Results suggest a pattern of lower gamma band coherence in a subset of regions within the DMN in ASD (angular and middle temporal cortical areas) related to lower social/social-communicative functioning. Autism Res 2018, 11: 434-449. © 2017 International

On-line plant-wide monitoring using neural networks

International Nuclear Information System (INIS)

Turkcan, E.; Ciftcioglu, O.; Eryurek, E.; Upadhyaya, B.R.

1992-06-01

The on-line signal analysis system designed for a multi-level mode operation using neural networks is described. The system is capable of monitoring the plant states by tracking different number of signals up to 32 simultaneously. The data used for this study were acquired from the Borssele Nuclear Power Plant (PWR type), and using the on-line monitoring system. An on-line plant-wide monitoring study using a multilayer neural network model is discussed in this paper. The back-propagation neural network algorithm is used for training the network. The technique assumes that each physical state of the power plant can be represented by a unique pattern of instrument readings which can be related to the condition of the plant. When disturbance occurs, the sensor readings undergo a transient, and form a different set of patterns which represent the new operational status. Diagnosing these patterns can be helpful in identifying this new state of the power plant. To this end, plant-wide monitoring with neutral networks is one of the new techniques in real-time applications. (author). 9 refs.; 5 figs

Petri Nets

Indian Academy of Sciences (India)

In a computer system, for example, typical discrete events ... This project brought out a series of influential reports on Petri net theory in the mid and late ... Technology became a leading centre for Petri net research and from then on, Petri nets ...

Fine-grained vehicle type recognition based on deep convolution neural networks

Directory of Open Access Journals (Sweden)

Hongcai CHEN

2017-12-01

Full Text Available Public security and traffic department put forward higher requirements for real-time performance and accuracy of vehicle type recognition in complex traffic scenes. Aiming at the problems of great plice forces occupation, low retrieval efficiency, and lacking of intelligence for dealing with false license, fake plate vehicles and vehicles without plates, this paper proposes a vehicle type fine-grained recognition method based GoogleNet deep convolution neural networks. The filter size and numbers of convolution neural network are designed, the activation function and vehicle type classifier are optimally selected, and a new network framework is constructed for vehicle type fine-grained recognition. The experimental results show that the proposed method has 97% accuracy for vehicle type fine-grained recognition and has greater improvement than the original GoogleNet model. Moreover, the new model effectively reduces the number of training parameters, and saves computer memory. Fine-grained vehicle type recognition can be used in intelligent traffic management area, and has important theoretical research value and practical significance.

Plasma startup patterns in tokamak reactors

International Nuclear Information System (INIS)

Maki, Koichi; Tone, Tatsuzo.

1983-01-01

Plasma startup patterns are studied from the viewpoint of net power loss represented by the total power loss less the α-particle heating power. The existence is shown of a critical temperature of plasma at which the net power loss becomes independent of plasma density. Observations are made which indicate that the net power loss decreases with lowering plasma density in the range below the critical temperature and vice versa, whether governed by empirical or trapped-ion scaling laws. A startup pattern is presented which minimizes the net power loss during startup, and which prescribes that: (1) The plasma density should be kept as low as possible until the plasma is heated up to the critical temperature; (2) thereafter, the plasma density should be increased to its steady state value while retaining the critical temperature; and (3) finally, with the density kept constant, the temperature should be further raised to its steady state value. The net power loss at critical temperature represents the lower limit of heating power required to bring the plasma to steady state in tokamak reactors. (author)

Application of artificial neural network for medical image recognition and diagnostic decision making

International Nuclear Information System (INIS)

Asada, N.; Eiho, S.; Doi, K.; MacMahon, H.; Montner, S.M.; Giger, M.L.

1989-01-01

An artificial neural network has been applied for pattern recognition and used as a tool in an expert system. The purpose of this study is to examine the potential usefulness of the neural network approach in medical applications for image recognition and decision making. The authors designed multilayer feedforward neural networks with a back-propagation algorithm for our study. Using first-pass radionuclide ventriculograms, we attempted to identify the right and left ventricles of the heart and the lungs by training the neural network from patterns of time-activity curves. In a preliminary study, the neural network enabled identification of the lungs and heart chambers once the network was trained sufficiently by means of repeated entries of data from the same case

Neural activity patterns in response to interspecific and intraspecific variation in mating calls in the túngara frog.

Directory of Open Access Journals (Sweden)

Mukta Chakraborty

2010-09-01

Full Text Available During mate choice, individuals must classify potential mates according to species identity and relative attractiveness. In many species, females do so by evaluating variation in the signals produced by males. Male túngara frogs (Physalaemus pustulosus can produce single note calls (whines and multi-note calls (whine-chucks. While the whine alone is sufficient for species recognition, females greatly prefer the whine-chuck when given a choice.To better understand how the brain responds to variation in male mating signals, we mapped neural activity patterns evoked by interspecific and intraspecific variation in mating calls in túngara frogs by measuring expression of egr-1. We predicted that egr-1 responses to conspecific calls would identify brain regions that are potentially important for species recognition and that at least some of those brain regions would vary in their egr-1 responses to mating calls that vary in attractiveness. We measured egr-1 in the auditory brainstem and its forebrain targets and found that conspecific whine-chucks elicited greater egr-1 expression than heterospecific whines in all but three regions. We found no evidence that preferred whine-chuck calls elicited greater egr-1 expression than conspecific whines in any of eleven brain regions examined, in contrast to predictions that mating preferences in túngara frogs emerge from greater responses in the auditory system.Although selectivity for species-specific signals is apparent throughout the túngara frog brain, further studies are necessary to elucidate how neural activity patterns vary with the attractiveness of conspecific mating calls.

Briefly Cuing Memories Leads to Suppression of Their Neural Representations

Science.gov (United States)

Norman, Kenneth A.

2014-01-01

Previous studies have linked partial memory activation with impaired subsequent memory retrieval (e.g., Detre et al., 2013) but have not provided an account of this phenomenon at the level of memory representations: How does partial activation change the neural pattern subsequently elicited when the memory is cued? To address this question, we conducted a functional magnetic resonance imaging (fMRI) experiment in which participants studied word-scene paired associates. Later, we weakly reactivated some memories by briefly presenting the cue word during a rapid serial visual presentation (RSVP) task; other memories were more strongly reactivated or not reactivated at all. We tested participants' memory for the paired associates before and after RSVP. Cues that were briefly presented during RSVP triggered reduced levels of scene activity on the post-RSVP memory test, relative to the other conditions. We used pattern similarity analysis to assess how representations changed as a function of the RSVP manipulation. For briefly cued pairs, we found that neural patterns elicited by the same cue on the pre- and post-RSVP tests (preA–postA; preB–postB) were less similar than neural patterns elicited by different cues (preA–postB; preB–postA). These similarity reductions were predicted by neural measures of memory activation during RSVP. Through simulation, we show that our pattern similarity results are consistent with a model in which partial memory activation triggers selective weakening of the strongest parts of the memory. PMID:24899722

Semantic Segmentation of Convolutional Neural Network for Supervised Classification of Multispectral Remote Sensing

Science.gov (United States)

Xue, L.; Liu, C.; Wu, Y.; Li, H.

2018-04-01

Semantic segmentation is a fundamental research in remote sensing image processing. Because of the complex maritime environment, the classification of roads, vegetation, buildings and water from remote Sensing Imagery is a challenging task. Although the neural network has achieved excellent performance in semantic segmentation in the last years, there are a few of works using CNN for ground object segmentation and the results could be further improved. This paper used convolution neural network named U-Net, its structure has a contracting path and an expansive path to get high resolution output. In the network , We added BN layers, which is more conducive to the reverse pass. Moreover, after upsampling convolution , we add dropout layers to prevent overfitting. They are promoted to get more precise segmentation results. To verify this network architecture, we used a Kaggle dataset. Experimental results show that U-Net achieved good performance compared with other architectures, especially in high-resolution remote sensing imagery.

High-Performance Neural Networks for Visual Object Classification

OpenAIRE

Cireşan, Dan C.; Meier, Ueli; Masci, Jonathan; Gambardella, Luca M.; Schmidhuber, Jürgen