Attractor neural networks with resource-efficient synaptic connectivity

Science.gov (United States)

Pehlevan, Cengiz; Sengupta, Anirvan

Memories are thought to be stored in the attractor states of recurrent neural networks. Here we explore how resource constraints interplay with memory storage function to shape synaptic connectivity of attractor networks. We propose that given a set of memories, in the form of population activity patterns, the neural circuit choses a synaptic connectivity configuration that minimizes a resource usage cost. We argue that the total synaptic weight (l1-norm) in the network measures the resource cost because synaptic weight is correlated with synaptic volume, which is a limited resource, and is proportional to neurotransmitter release and post-synaptic current, both of which cost energy. Using numerical simulations and replica theory, we characterize optimal connectivity profiles in resource-efficient attractor networks. Our theory explains several experimental observations on cortical connectivity profiles, 1) connectivity is sparse, because synapses are costly, 2) bidirectional connections are overrepresented and 3) are stronger, because attractor states need strong recurrence.

Knowledge synthesis with maps of neural connectivity.

Science.gov (United States)

Tallis, Marcelo; Thompson, Richard; Russ, Thomas A; Burns, Gully A P C

2011-01-01

This paper describes software for neuroanatomical knowledge synthesis based on neural connectivity data. This software supports a mature methodology developed since the early 1990s. Over this time, the Swanson laboratory at USC has generated an account of the neural connectivity of the sub-structures of the hypothalamus, amygdala, septum, hippocampus, and bed nucleus of the stria terminalis. This is based on neuroanatomical data maps drawn into a standard brain atlas by experts. In earlier work, we presented an application for visualizing and comparing anatomical macro connections using the Swanson third edition atlas as a framework for accurate registration. Here we describe major improvements to the NeuARt application based on the incorporation of a knowledge representation of experimental design. We also present improvements in the interface and features of the data mapping components within a unified web-application. As a step toward developing an accurate sub-regional account of neural connectivity, we provide navigational access between the data maps and a semantic representation of area-to-area connections that they support. We do so based on an approach called "Knowledge Engineering from Experimental Design" (KEfED) model that is based on experimental variables. We have extended the underlying KEfED representation of tract-tracing experiments by incorporating the definition of a neuronanatomical data map as a measurement variable in the study design. This paper describes the software design of a web-application that allows anatomical data sets to be described within a standard experimental context and thus indexed by non-spatial experimental design features.

Finite connectivity attractor neural networks

International Nuclear Information System (INIS)

Wemmenhove, B; Coolen, A C C

2003-01-01

We study a family of diluted attractor neural networks with a finite average number of (symmetric) connections per neuron. As in finite connectivity spin glasses, their equilibrium properties are described by order parameter functions, for which we derive an integral equation in replica symmetric approximation. A bifurcation analysis of this equation reveals the locations of the paramagnetic to recall and paramagnetic to spin-glass transition lines in the phase diagram. The line separating the retrieval phase from the spin-glass phase is calculated at zero temperature. All phase transitions are found to be continuous

Deep neural nets as a method for quantitative structure-activity relationships.

Science.gov (United States)

Ma, Junshui; Sheridan, Robert P; Liaw, Andy; Dahl, George E; Svetnik, Vladimir

2015-02-23

Neural networks were widely used for quantitative structure-activity relationships (QSAR) in the 1990s. Because of various practical issues (e.g., slow on large problems, difficult to train, prone to overfitting, etc.), they were superseded by more robust methods like support vector machine (SVM) and random forest (RF), which arose in the early 2000s. The last 10 years has witnessed a revival of neural networks in the machine learning community thanks to new methods for preventing overfitting, more efficient training algorithms, and advancements in computer hardware. In particular, deep neural nets (DNNs), i.e. neural nets with more than one hidden layer, have found great successes in many applications, such as computer vision and natural language processing. Here we show that DNNs can routinely make better prospective predictions than RF on a set of large diverse QSAR data sets that are taken from Merck's drug discovery effort. The number of adjustable parameters needed for DNNs is fairly large, but our results show that it is not necessary to optimize them for individual data sets, and a single set of recommended parameters can achieve better performance than RF for most of the data sets we studied. The usefulness of the parameters is demonstrated on additional data sets not used in the calibration. Although training DNNs is still computationally intensive, using graphical processing units (GPUs) can make this issue manageable.

Vector control of wind turbine on the basis of the fuzzy selective neural net*

Science.gov (United States)

Engel, E. A.; Kovalev, I. V.; Engel, N. E.

2016-04-01

An article describes vector control of wind turbine based on fuzzy selective neural net. Based on the wind turbine system’s state, the fuzzy selective neural net tracks an maximum power point under random perturbations. Numerical simulations are accomplished to clarify the applicability and advantages of the proposed vector wind turbine’s control on the basis of the fuzzy selective neuronet. The simulation results show that the proposed intelligent control of wind turbine achieves real-time control speed and competitive performance, as compared to a classical control model with PID controllers based on traditional maximum torque control strategy.

Face recognition: Eigenface, elastic matching, and neural nets

International Nuclear Information System (INIS)

Zhang, J.; Lades, M.

1997-01-01

This paper is a comparative study of three recently proposed algorithms for face recognition: eigenface, autoassociation and classification neural nets, and elastic matching. After these algorithms were analyzed under a common statistical decision framework, they were evaluated experimentally on four individual data bases, each with a moderate subject size, and a combined data base with more than a hundred different subjects. Analysis and experimental results indicate that the eigenface algorithm, which is essentially a minimum distance classifier, works well when lighting variation is small. Its performance deteriorates significantly as lighting variation increases. The elastic matching algorithm, on the other hand, is insensitive to lighting, face position, and expression variations and therefore is more versatile. The performance of the autoassociation and classification nets is upper bounded by that of the eigenface but is more difficult to implement in practice

tf_unet: Generic convolutional neural network U-Net implementation in Tensorflow

Science.gov (United States)

Akeret, Joel; Chang, Chihway; Lucchi, Aurelien; Refregier, Alexandre

2016-11-01

tf_unet mitigates radio frequency interference (RFI) signals in radio data using a special type of Convolutional Neural Network, the U-Net, that enables the classification of clean signal and RFI signatures in 2D time-ordered data acquired from a radio telescope. The code is not tied to a specific segmentation and can be used, for example, to detect radio frequency interference (RFI) in radio astronomy or galaxies and stars in widefield imaging data. This U-Net implementation can outperform classical RFI mitigation algorithms.

Knowledge synthesis with maps of neural connectivity

Directory of Open Access Journals (Sweden)

Marcelo eTallis

2011-11-01

Full Text Available This paper describes software for neuroanatomical knowledge synthesis based on high-quality neural connectivity data. This software supports a mature neuroanatomical methodology developed since the early 1990s. Over this time, the Swanson laboratory at USC has generated an account of the neural connectivity of the sub-structures of the hypothalamus, amygdala, septum, hippocampus and bed nucleus of the stria terminalis. This is based on neuroanatomical data maps drawn into a standard brain atlas by experts. In earlier work, we presented an application for visualizing and comparing anatomical macroconnections using the Swanson 3rd edition atlas as a framework for accurate registration. Here we describe major improvements to the NeuARt application based on the incorporation of a knowledge representation of experimental design. We also present improvements in the interface and features of the neuroanatomical data mapping components within a unified web-application. As a step towards developing an accurate sub-regional account of neural connectivity, we provide navigational access between the neuroanatomical data maps and a semantic representation of area-to-area connections that they support. We do so based on an approach called ’Knowledge Engineering from Experimental Design’ (KEfED model that is based on experimental variables. We have extended the underlying KEfED representation of tract-tracing experiments by incorporating the definition of a neuronanatomical data map as a measurement variable in the study design. This paper describes the software design of a web application that allows anatomical data sets to be described within a standard experimental context and thus incorporated with non-spatial data sets.

NIRFaceNet: A Convolutional Neural Network for Near-Infrared Face Identification

Directory of Open Access Journals (Sweden)

Min Peng

2016-10-01

Full Text Available Near-infrared (NIR face recognition has attracted increasing attention because of its advantage of illumination invariance. However, traditional face recognition methods based on NIR are designed for and tested in cooperative-user applications. In this paper, we present a convolutional neural network (CNN for NIR face recognition (specifically face identification in non-cooperative-user applications. The proposed NIRFaceNet is modified from GoogLeNet, but has a more compact structure designed specifically for the Chinese Academy of Sciences Institute of Automation (CASIA NIR database and can achieve higher identification rates with less training time and less processing time. The experimental results demonstrate that NIRFaceNet has an overall advantage compared to other methods in the NIR face recognition domain when image blur and noise are present. The performance suggests that the proposed NIRFaceNet method may be more suitable for non-cooperative-user applications.

Neural-net based coordinated stabilizing control for the exciter and governor loops of low head hydropower plants

Energy Technology Data Exchange (ETDEWEB)

Djukanovic, M.; Novicevic, M.; Dobrijevic, D.; Babic, B. [Electrical Engineering Inst. Nikola Tesla, Belgrade (Yugoslavia); Sobajic, D.J. [Electric Power Research Inst., Palo Alto, CA (United States); Pao, Y.H. [Case Western Reserve Univ., Cleveland, OH (United States)]|[AI WARE, Inc., Cleveland, OH (United States)

1995-12-01

This paper presents a design technique of a new adaptive optimal controller of the low head hydropower plant using artificial neural networks (ANN). The adaptive controller is to operate in real time to improve the generating unit transients through the exciter input, the guide vane position and the runner blade position. The new design procedure is based on self-organization and the predictive estimation capabilities of neural-nets implemented through the cluster-wise segmented associative memory scheme. The developed neural-net based controller (NNC) whose control signals are adjusted using the on-line measurements, can offer better damping effects for generator oscillations over a wide range of operating conditions than conventional controllers. Digital simulations of hydropower plant equipped with low head Kaplan turbine are performed and the comparisons of conventional excitation-governor control, state-space optimal control and neural-net based control are presented. Results obtained on the non-linear mathematical model demonstrate that the effects of the NNC closely agree with those obtained using the state-space multivariable discrete-time optimal controllers.

Neural net prediction of tokamak plasma disruptions

International Nuclear Information System (INIS)

Hernandez, J.V.; Lin, Z.; Horton, W.; McCool, S.C.

1994-10-01

The computation based on neural net algorithms in predicting minor and major disruptions in TEXT tokamak discharges has been performed. Future values of the fluctuating magnetic signal are predicted based on L past values of the magnetic fluctuation signal, measured by a single Mirnov coil. The time step used (= 0.04ms) corresponds to the experimental data sampling rate. Two kinds of approaches are adopted for the task, the contiguous future prediction and the multi-timescale prediction. Results are shown for comparison. Both networks are trained through the back-propagation algorithm with inertial terms. The degree of this success indicates that the magnetic fluctuations associated with tokamak disruptions may be characterized by a relatively low-dimensional dynamical system

Intranasal oxytocin modulates neural functional connectivity during human social interaction.

Science.gov (United States)

Rilling, James K; Chen, Xiangchuan; Chen, Xu; Haroon, Ebrahim

2018-02-10

Oxytocin (OT) modulates social behavior in primates and many other vertebrate species. Studies in non-primate animals have demonstrated that, in addition to influencing activity within individual brain areas, OT influences functional connectivity across networks of areas involved in social behavior. Previously, we used fMRI to image brain function in human subjects during a dyadic social interaction task following administration of either intranasal oxytocin (INOT) or placebo, and analyzed the data with a standard general linear model. Here, we conduct an extensive re-analysis of these data to explore how OT modulates functional connectivity across a neural network that animal studies implicate in social behavior. OT induced widespread increases in functional connectivity in response to positive social interactions among men and widespread decreases in functional connectivity in response to negative social interactions among women. Nucleus basalis of Meynert, an important regulator of selective attention and motivation with a particularly high density of OT receptors, had the largest number of OT-modulated connections. Regions known to receive mesolimbic dopamine projections such as the nucleus accumbens and lateral septum were also hubs for OT effects on functional connectivity. Our results suggest that the neural mechanism by which OT influences primate social cognition may include changes in patterns of activity across neural networks that regulate social behavior in other animals. © 2018 Wiley Periodicals, Inc.

Unfolding code for neutron spectrometry based on neural nets technology

International Nuclear Information System (INIS)

Ortiz R, J. M.; Vega C, H. R.

2012-10-01

The most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. The drawbacks associated with traditional unfolding procedures have motivated the need of complementary approaches. Novel methods based on Artificial Neural Networks have been widely investigated. In this work, a neutron spectrum unfolding code based on neural nets technology is presented. This unfolding code called Neutron Spectrometry and Dosimetry by means of Artificial Neural Networks was designed in a graphical interface under LabVIEW programming environment. The core of the code is an embedded neural network architecture, previously optimized by the R obust Design of Artificial Neural Networks Methodology . The main features of the code are: is easy to use, friendly and intuitive to the user. This code was designed for a Bonner Sphere System based on a 6 Lil(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. The main feature of the code is that as entrance data, only seven rate counts measurement with a Bonner spheres spectrometer are required for simultaneously unfold the 60 energy bins of the neutron spectrum and to calculate 15 dosimetric quantities, for radiation protection porpoises. This code generates a full report in html format with all relevant information. (Author)

Neural net generated seismic facies map and attribute facies map

International Nuclear Information System (INIS)

Addy, S.K.; Neri, P.

1998-01-01

The usefulness of 'seismic facies maps' in the analysis of an Upper Wilcox channel system in a 3-D survey shot by CGG in 1995 in Lavaca county in south Texas was discussed. A neural net-generated seismic facies map is a quick hydrocarbon exploration tool that can be applied regionally as well as on a prospect scale. The new technology is used to classify a constant interval parallel to a horizon in a 3-D seismic volume based on the shape of the wiggle traces using a neural network technology. The tool makes it possible to interpret sedimentary features of a petroleum deposit. The same technology can be used in regional mapping by making 'attribute facies maps' in which various forms of amplitude attributes, phase attributes or frequency attributes can be used

Assessment of the expected construction company’s net profit using neural network and multiple regression models

Directory of Open Access Journals (Sweden)

H.H. Mohamad

2013-09-01

This research aims to develop a mathematical model for assessing the expected net profit of any construction company. To achieve the research objective, four steps were performed. First, the main factors affecting firms’ net profit were identified. Second, pertinent data regarding the net profit factors were collected. Third, two different net profit models were developed using the Multiple Regression (MR and the Neural Network (NN techniques. The validity of the proposed models was also investigated. Finally, the results of both MR and NN models were compared to investigate the predictive capabilities of the two models.

Exemplar-based optical neural net classifier for color pattern recognition

Science.gov (United States)

Yu, Francis T. S.; Uang, Chii-Maw; Yang, Xiangyang

1992-10-01

We present a color exemplar-based neural network that can be used as an optimum image classifier or an associative memory. Color decomposition and composition technique is used for constructing the polychromatic interconnection weight matrix (IWM). The Hamming net algorithm is modified to relax the dynamic range requirement of the spatial light modulator and to reduce the number of iteration cycles in the winner-take-all layer. Computer simulation results demonstrated the feasibility of this approach

Real-time applications of neural nets

International Nuclear Information System (INIS)

Spencer, J.E.

1989-05-01

Producing, accelerating and colliding very high power, low emittance beams for long periods is a formidable problem in real-time control. As energy has grown exponentially in time so has the complexity of the machines and their control systems. Similar growth rates have occurred in many areas, e.g., improved integrated circuits have been paid for with comparable increases in complexity. However, in this case, reliability, capability and cost have improved due to reduced size, high production and increased integration which allow various kinds of feedback. In contrast, most large complex systems (LCS) are perceived to lack such possibilities because only one copy is made. Neural nets, as a metaphor for LCS, suggest ways to circumvent such limitations. It is argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems. While complimentary to AI, they mesh nicely with characteristics desired for real-time systems. Such issues are considered, examples given and possibilities discussed. 21 refs., 6 figs

Real-time applications of neural nets

International Nuclear Information System (INIS)

Spencer, J.E.

1989-01-01

Producing, accelerating and colliding very high power, low emittance beams for long periods is a formidable problem in real-time control. As energy has grown exponentially in time so has the complexity of the machines and their control systems. Similar growth rates have occurred in many areas e.g. improved integrated circuits have been paid for with comparable increases in complexity. However, in this case, reliability, capability and cost have improved due to reduced size, high production and increased integration which allow various kinds of feedback. In contrast, most large complex systems (LCS) are perceived to lack such possibilities because only one copy is made. Neural nets, as a metaphor for LCS, suggest ways to circumvent such limitations. It is argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems. While complimentary to AI, they mesh nicely with characteristics desired for real-time systems. In this paper, such issues are considered, examples given and possibilities discussed

Real-time applications of neural nets

Energy Technology Data Exchange (ETDEWEB)

Spencer, J.E.

1989-05-01

Producing, accelerating and colliding very high power, low emittance beams for long periods is a formidable problem in real-time control. As energy has grown exponentially in time so has the complexity of the machines and their control systems. Similar growth rates have occurred in many areas, e.g., improved integrated circuits have been paid for with comparable increases in complexity. However, in this case, reliability, capability and cost have improved due to reduced size, high production and increased integration which allow various kinds of feedback. In contrast, most large complex systems (LCS) are perceived to lack such possibilities because only one copy is made. Neural nets, as a metaphor for LCS, suggest ways to circumvent such limitations. It is argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems. While complimentary to AI, they mesh nicely with characteristics desired for real-time systems. Such issues are considered, examples given and possibilities discussed. 21 refs., 6 figs.

LiteNet: Lightweight Neural Network for Detecting Arrhythmias at Resource-Constrained Mobile Devices

Directory of Open Access Journals (Sweden)

Ziyang He

2018-04-01

Full Text Available By running applications and services closer to the user, edge processing provides many advantages, such as short response time and reduced network traffic. Deep-learning based algorithms provide significantly better performances than traditional algorithms in many fields but demand more resources, such as higher computational power and more memory. Hence, designing deep learning algorithms that are more suitable for resource-constrained mobile devices is vital. In this paper, we build a lightweight neural network, termed LiteNet which uses a deep learning algorithm design to diagnose arrhythmias, as an example to show how we design deep learning schemes for resource-constrained mobile devices. Compare to other deep learning models with an equivalent accuracy, LiteNet has several advantages. It requires less memory, incurs lower computational cost, and is more feasible for deployment on resource-constrained mobile devices. It can be trained faster than other neural network algorithms and requires less communication across different processing units during distributed training. It uses filters of heterogeneous size in a convolutional layer, which contributes to the generation of various feature maps. The algorithm was tested using the MIT-BIH electrocardiogram (ECG arrhythmia database; the results showed that LiteNet outperforms comparable schemes in diagnosing arrhythmias, and in its feasibility for use at the mobile devices.

LiteNet: Lightweight Neural Network for Detecting Arrhythmias at Resource-Constrained Mobile Devices.

Science.gov (United States)

He, Ziyang; Zhang, Xiaoqing; Cao, Yangjie; Liu, Zhi; Zhang, Bo; Wang, Xiaoyan

2018-04-17

By running applications and services closer to the user, edge processing provides many advantages, such as short response time and reduced network traffic. Deep-learning based algorithms provide significantly better performances than traditional algorithms in many fields but demand more resources, such as higher computational power and more memory. Hence, designing deep learning algorithms that are more suitable for resource-constrained mobile devices is vital. In this paper, we build a lightweight neural network, termed LiteNet which uses a deep learning algorithm design to diagnose arrhythmias, as an example to show how we design deep learning schemes for resource-constrained mobile devices. Compare to other deep learning models with an equivalent accuracy, LiteNet has several advantages. It requires less memory, incurs lower computational cost, and is more feasible for deployment on resource-constrained mobile devices. It can be trained faster than other neural network algorithms and requires less communication across different processing units during distributed training. It uses filters of heterogeneous size in a convolutional layer, which contributes to the generation of various feature maps. The algorithm was tested using the MIT-BIH electrocardiogram (ECG) arrhythmia database; the results showed that LiteNet outperforms comparable schemes in diagnosing arrhythmias, and in its feasibility for use at the mobile devices.

Unfolding code for neutron spectrometry based on neural nets technology

Energy Technology Data Exchange (ETDEWEB)

Ortiz R, J. M.; Vega C, H. R., E-mail: morvymm@yahoo.com.mx [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica, Apdo. Postal 336, 98000 Zacatecas (Mexico)

2012-10-15

The most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. The drawbacks associated with traditional unfolding procedures have motivated the need of complementary approaches. Novel methods based on Artificial Neural Networks have been widely investigated. In this work, a neutron spectrum unfolding code based on neural nets technology is presented. This unfolding code called Neutron Spectrometry and Dosimetry by means of Artificial Neural Networks was designed in a graphical interface under LabVIEW programming environment. The core of the code is an embedded neural network architecture, previously optimized by the {sup R}obust Design of Artificial Neural Networks Methodology{sup .} The main features of the code are: is easy to use, friendly and intuitive to the user. This code was designed for a Bonner Sphere System based on a {sup 6}Lil(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. The main feature of the code is that as entrance data, only seven rate counts measurement with a Bonner spheres spectrometer are required for simultaneously unfold the 60 energy bins of the neutron spectrum and to calculate 15 dosimetric quantities, for radiation protection porpoises. This code generates a full report in html format with all relevant information. (Author)

Estimação do volume de árvores utilizando redes neurais artificiais Estimate of tree volume using artificial neural nets

Directory of Open Access Journals (Sweden)

Eric Bastos Gorgens

2009-12-01

Full Text Available Rede neural artificial consiste em um conjunto de unidades que contêm funções matemáticas, unidas por pesos. As redes são capazes de aprender, mediante modificação dos pesos sinápticos, e generalizar o aprendizado para outros arquivos desconhecidos. O projeto de redes neurais é composto por três etapas: pré-processamento, processamento e, por fim, pós-processamento dos dados. Um dos problemas clássicos que podem ser abordados por redes é a aproximação de funções. Nesse grupo, pode-se incluir a estimação do volume de árvores. Foram utilizados quatro arquiteturas diferentes, cinco pré-processamentos e duas funções de ativação. As redes que se apresentaram estatisticamente iguais aos dados observados também foram analisadas quanto ao resíduo e à distribuição dos volumes e comparadas com a estimação de volume pelo modelo de Schumacher e Hall. As redes neurais formadas por neurônios, cuja função de ativação era exponencial, apresentaram estimativas estatisticamente iguais aos dados observados. As redes treinadas com os dados normalizados pelo método da interpolação linear e equalizados tiveram melhor desempenho na estimação.The artificial neural network consists of a set of units containing mathematical functions connected by weights. Such nets are capable of learning by means of synaptic weight modification, generalizing learning for other unknown archives. The neural network project comprises three stages: pre-processing, processing and post-processing of data. One of the classical problems approached by networks is function approximation. Tree volume estimate can be included in this group. Four different architectures, five pre-processings and two activation functions were used. The nets which were statistically similar to the observed data were also analyzed in relation to residue and volume and compared to the volume estimate provided by the Schumacher and Hall equation. The neural nets formed by

Neural systems language: a formal modeling language for the systematic description, unambiguous communication, and automated digital curation of neural connectivity.

Science.gov (United States)

Brown, Ramsay A; Swanson, Larry W

2013-09-01

Systematic description and the unambiguous communication of findings and models remain among the unresolved fundamental challenges in systems neuroscience. No common descriptive frameworks exist to describe systematically the connective architecture of the nervous system, even at the grossest level of observation. Furthermore, the accelerating volume of novel data generated on neural connectivity outpaces the rate at which this data is curated into neuroinformatics databases to synthesize digitally systems-level insights from disjointed reports and observations. To help address these challenges, we propose the Neural Systems Language (NSyL). NSyL is a modeling language to be used by investigators to encode and communicate systematically reports of neural connectivity from neuroanatomy and brain imaging. NSyL engenders systematic description and communication of connectivity irrespective of the animal taxon described, experimental or observational technique implemented, or nomenclature referenced. As a language, NSyL is internally consistent, concise, and comprehensible to both humans and computers. NSyL is a promising development for systematizing the representation of neural architecture, effectively managing the increasing volume of data on neural connectivity and streamlining systems neuroscience research. Here we present similar precedent systems, how NSyL extends existing frameworks, and the reasoning behind NSyL's development. We explore NSyL's potential for balancing robustness and consistency in representation by encoding previously reported assertions of connectivity from the literature as examples. Finally, we propose and discuss the implications of a framework for how NSyL will be digitally implemented in the future to streamline curation of experimental results and bridge the gaps among anatomists, imagers, and neuroinformatics databases. Copyright © 2013 Wiley Periodicals, Inc.

Quest for Highly-connected MOF Platforms: Rare-Earth Polynuclear Clusters Versatility Meets Net Topology Needs.

KAUST Repository

Alezi, Dalal

2015-04-07

Gaining control over the assembly of highly porous rare-earth (RE) based metal-organic frameworks (MOFs) remains challenging. Here we report the latest discoveries on our continuous quest for highly-connected nets. The topological exploration based on the non-compatibility of 12-connected RE polynuclear carboxylate-based cluster, points of extension matching the 12 vertices of the cuboctahedron (cuo), with 3-connected organic ligands led to the discovery of two fascinating and highly-connected minimal edge-transitive nets, pek and aea. The reduced symmetry of the employed triangular tricarboxylate ligand, as compared to the prototype highly symmetrical 1,3,5-benzene(tris)benzoic acid guided the concurrent occurrence of nonanuclear [RE9(μ3-OH)12(μ3-O)2(O2C–)12] and hexanuclear [RE6(OH)8(O2C–)8] carboxylate-based clusters as 12-connected and 8-connected molecular building blocks in the structure of a 3-periodic pek-MOF based on a novel (3,8,12)-c trinodal net. The use of a tricarboxylate ligand with modified angles between carboxylate moieties led to the formation of a second MOF containing solely nonanuclear clusters and exhibiting once more a novel and a highly-connected (3,12,12)-c trinodal net with aea topology. Notably, it is the first time that RE-MOFs with double six-membered ring (d6R) secondary building units are isolated, representing therefore a critical step forward toward the design of novel and highly coordinated materials using the supermolecular building layer approach while considering the d6Rs as building pillars. Lastly, the potential of these new MOFs for gas separation/storage was investigated by performing gas adsorption studies of various probe gas molecules over a wide range of pressures. Noticeably, pek-MOF-1 showed excellent volumetric CO2 and CH4 uptakes at high pressures.

TopologyNet: Topology based deep convolutional and multi-task neural networks for biomolecular property predictions

Science.gov (United States)

2017-01-01

Although deep learning approaches have had tremendous success in image, video and audio processing, computer vision, and speech recognition, their applications to three-dimensional (3D) biomolecular structural data sets have been hindered by the geometric and biological complexity. To address this problem we introduce the element-specific persistent homology (ESPH) method. ESPH represents 3D complex geometry by one-dimensional (1D) topological invariants and retains important biological information via a multichannel image-like representation. This representation reveals hidden structure-function relationships in biomolecules. We further integrate ESPH and deep convolutional neural networks to construct a multichannel topological neural network (TopologyNet) for the predictions of protein-ligand binding affinities and protein stability changes upon mutation. To overcome the deep learning limitations from small and noisy training sets, we propose a multi-task multichannel topological convolutional neural network (MM-TCNN). We demonstrate that TopologyNet outperforms the latest methods in the prediction of protein-ligand binding affinities, mutation induced globular protein folding free energy changes, and mutation induced membrane protein folding free energy changes. Availability: weilab.math.msu.edu/TDL/ PMID:28749969

Topological probability and connection strength induced activity in complex neural networks

International Nuclear Information System (INIS)

Du-Qu, Wei; Bo, Zhang; Dong-Yuan, Qiu; Xiao-Shu, Luo

2010-01-01

Recent experimental evidence suggests that some brain activities can be assigned to small-world networks. In this work, we investigate how the topological probability p and connection strength C affect the activities of discrete neural networks with small-world (SW) connections. Network elements are described by two-dimensional map neurons (2DMNs) with the values of parameters at which no activity occurs. It is found that when the value of p is smaller or larger, there are no active neurons in the network, no matter what the value of connection strength is; for a given appropriate connection strength, there is an intermediate range of topological probability where the activity of 2DMN network is induced and enhanced. On the other hand, for a given intermediate topological probability level, there exists an optimal value of connection strength such that the frequency of activity reaches its maximum. The possible mechanism behind the action of topological probability and connection strength is addressed based on the bifurcation method. Furthermore, the effects of noise and transmission delay on the activity of neural network are also studied. (general)

Neural nets with varying topology for high energy particle recognition. Theory and applications

International Nuclear Information System (INIS)

Perrone, A.L.; Basti, G.; Messi, R.; Paoluzi, L.; Picozza, P.

1995-01-01

In this paper we propose a strategy to solve the problem of parallel compuation based on a dynamic definition of the net topology showing its effectiveness for problems of particle track recognition in high-energy physics. In this way, we can maintain the linear architecture like in the geometric perceptron, but with a partial and dynamic connectivity so to overcome the intrinsic limiations of the geometric perceptron. Namely, the computation is truly parallel because of the partial connectivity but the net topology is always the optimal one because of its dynamic redefinition on the single input pattern. For these properties, we call this new architecture dynamic perceptron

Bayesian Inference using Neural Net Likelihood Models for Protein Secondary Structure Prediction

Directory of Open Access Journals (Sweden)

Seong-Gon Kim

2011-06-01

Full Text Available Several techniques such as Neural Networks, Genetic Algorithms, Decision Trees and other statistical or heuristic methods have been used to approach the complex non-linear task of predicting Alpha-helicies, Beta-sheets and Turns of a proteins secondary structure in the past. This project introduces a new machine learning method by using an offline trained Multilayered Perceptrons (MLP as the likelihood models within a Bayesian Inference framework to predict secondary structures proteins. Varying window sizes are used to extract neighboring amino acid information and passed back and forth between the Neural Net models and the Bayesian Inference process until there is a convergence of the posterior secondary structure probability.

Modularity and Sparsity: Evolution of Neural Net Controllers in Physically Embodied Robots

Directory of Open Access Journals (Sweden)

Nicholas Livingston

2016-12-01

Full Text Available While modularity is thought to be central for the evolution of complexity and evolvability, it remains unclear how systems boot-strap themselves into modularity from random or fully integrated starting conditions. Clune et al. (2013 suggested that a positive correlation between sparsity and modularity is the prime cause of this transition. We sought to test the generality of this modularity-sparsity hypothesis by testing it for the first time in physically embodied robots. A population of ten Tadros — autonomous, surface-swimming robots propelled by a flapping tail — was used. Individuals varied only in the structure of their neural net control, a 2 x 6 x 2 network with recurrence in the hidden layer. Each of the 60 possible connections was coded in the genome, and could achieve one of three states: -1, 0, 1. Inputs were two light-dependent resistors and outputs were two motor control variables to the flapping tail, one for the frequency of the flapping and the other for the turning offset. Each Tadro was tested separately in a circular tank lit by a single overhead light source. Fitness was the amount of light gathered by a vertically oriented sensor that was disconnected from the controller net. Reproduction was asexual, with the top performer cloned and then all individuals entered into a roulette wheel selection process, with genomes mutated to create the offspring. The starting population of networks was randomly generated. Over ten generations, the population’s mean fitness increased two-fold. This evolution occurred in spite of an unintentional integer overflow problem in recurrent nodes in the hidden layer that caused outputs to oscillate. Our investigation of the oscillatory behavior showed that the mutual information of inputs and outputs was sufficient for the reactive behaviors observed. While we had predicted that both modularity and sparsity would follow the same trend as fitness, neither did so. Instead, selection gradients

Neural Net Safety Monitor Design

Science.gov (United States)

Larson, Richard R.

2007-01-01

The National Aeronautics and Space Administration (NASA) at the Dryden Flight Research Center (DFRC) has been conducting flight-test research using an F-15 aircraft (figure 1). This aircraft has been specially modified to interface a neural net (NN) controller as part of a single-string Airborne Research Test System (ARTS) computer with the existing quad-redundant flight control system (FCC) shown in figure 2. The NN commands are passed to FCC channels 2 and 4 and are cross channel data linked (CCDL) to the other computers as shown. Numerous types of fault-detection monitors exist in the FCC when the NN mode is engaged; these monitors would cause an automatic disengagement of the NN in the event of a triggering fault. Unfortunately, these monitors still may not prevent a possible NN hard-over command from coming through to the control laws. Therefore, an additional and unique safety monitor was designed for a single-string source that allows authority at maximum actuator rates but protects the pilot and structural loads against excessive g-limits in the case of a NN hard-over command input. This additional monitor resides in the FCCs and is executed before the control laws are computed. This presentation describes a floating limiter (FL) concept1 that was developed and successfully test-flown for this program (figure 3). The FL computes the rate of change of the NN commands that are input to the FCC from the ARTS. A window is created with upper and lower boundaries, which is constantly floating and trying to stay centered as the NN command rates are changing. The limiter works by only allowing the window to move at a much slower rate than those of the NN commands. Anywhere within the window, however, full rates are allowed. If a rate persists in one direction, it will eventually hit the boundary and be rate-limited to the floating limiter rate. When this happens, a persistent counter begins and after a limit is reached, a NN disengage command is generated. The

Exponential stability of neural networks with asymmetric connection weights

International Nuclear Information System (INIS)

Yang Jinxiang; Zhong Shouming

2007-01-01

This paper investigates the exponential stability of a class of neural networks with asymmetric connection weights. By dividing the network state variables into various parts according to the characters of the neural networks, some new sufficient conditions of exponential stability are derived via constructing a Lyapunov function and using the method of the variation of constant. The new conditions are associated with the initial values and are described by some blocks of the interconnection matrix, and do not depend on other blocks. Examples are given to further illustrate the theory

Neural network connectivity and response latency modelled by stochastic processes

DEFF Research Database (Denmark)

Tamborrino, Massimiliano

is connected to thousands of other neurons. The rst question is: how to model neural networks through stochastic processes? A multivariate Ornstein-Uhlenbeck process, obtained as a diffusion approximation of a jump process, is the proposed answer. Obviously, dependencies between neurons imply dependencies......Stochastic processes and their rst passage times have been widely used to describe the membrane potential dynamics of single neurons and to reproduce neuronal spikes, respectively.However, cerebral cortex in human brains is estimated to contain 10-20 billions of neurons and each of them...... between their spike times. Therefore, the second question is: how to detect neural network connectivity from simultaneously recorded spike trains? Answering this question corresponds to investigate the joint distribution of sequences of rst passage times. A non-parametric method based on copulas...

Neural net based determination of generator-shedding requirements in electric power systems

Energy Technology Data Exchange (ETDEWEB)

Djukanovic, M [Electrical Engineering Inst. ' Nikola Tesla' , Belgrade (Yugoslavia); Sobajic, D J; Pao, Y -H [Case Western Reserve Univ., Cleveland, OH (United States). Dept. of Electrical Engineering and Applied Physics Case Western Reserve Univ., Cleveland, OH (United States). Dept. of Computer Engineering and Science AI WARE Inc., Cleveland, OH (United States)

1992-09-01

This paper presents an application of artificial neural networks (ANN) in support of a decision-making process by power system operators directed towards the fast stabilisation of multi-machine systems. The proposed approach considers generator shedding as the most effective discrete supplementary control for improving the dynamic performance of faulted power systems and preventing instabilities. The sensitivity of the transient energy function (TEF) with respect to changes in the amount of dropped generation is used during the training phase of ANNs to assess the critical amount of generator shedding required to prevent the loss of synchronism. The learning capabilities of neural nets are used to establish complex mappings between fault information and the amount of generation to be shed, suggesting it as the control signal to the power system operator. (author)

Neural-net disruption predictor in JT-60U

International Nuclear Information System (INIS)

Yoshino, R.

2003-01-01

The prediction of major disruptions caused by the density limit, the plasma current ramp-down with high internal inductance l i , the low density locked mode and the β-limit has been investigated in JT-60U. The concept of 'stability level', newly proposed in this paper to predict the occurrence of a major disruption, is calculated from nine input parameters every 2 ms by the neural network and the start of a major disruption is predicted when the stability level decreases to a certain level, the 'alarm level'. The neural network is trained in two steps. It is first trained with 12 disruptive and six non-disruptive shots (total of 8011 data points). Second, the target output data for 12 disruptive shots are modified and the network is trained again with additional data points generated by the operator. The 'neural-net disruption predictor' obtained has been tested for 300 disruptive shots (128 945 data points) and 1008 non-disruptive shots (982 800 data points) selected from nine years of operation (1991-1999) of JT-60U. Major disruptions except for those caused by the -limit have been predicted with a prediction success rate of 97-98% at 10 ms prior to the disruption and higher than 90% at 30 ms prior to the disruption while the false alarm rate is 2.1% for non-disruptive shots. This prediction performance has been confirmed for 120 disruptive shots (56 163 data points), caused by the density limit, as well as 1032 non-disruptive shots (1004 611 data points) in the last four years of operation (1999-2002) of JT-60U. A careful selection of the input parameters supplied to the network and the newly developed two-step training of the network have reduced the false alarm rate resulting in a considerable improvement of the prediction success rate. (author)

Connectivity effects in the dynamic model of neural networks

International Nuclear Information System (INIS)

Choi, J; Choi, M Y; Yoon, B-G

2009-01-01

We study, via extensive Monte Carlo calculations, the effects of connectivity in the dynamic model of neural networks, to observe that the Mattis-state order parameter increases with the number of coupled neurons. Such effects appear more pronounced when the average number of connections is increased by introducing shortcuts in the network. In particular, the power spectra of the order parameter at stationarity are found to exhibit power-law behavior, depending on how the average number of connections is increased. The cluster size distribution of the 'memory-unmatched' sites also follows a power law and possesses strong correlations with the power spectra. It is further observed that the distribution of waiting times for neuron firing fits roughly to a power law, again depending on how neuronal connections are increased

Prediction of Disease Causing Non-Synonymous SNPs by the Artificial Neural Network Predictor NetDiseaseSNP

DEFF Research Database (Denmark)

Johansen, Morten Bo; Gonzalez-Izarzugaza, Jose Maria; Brunak, Søren

2013-01-01

We have developed a sequence conservation-based artificial neural network predictor called NetDiseaseSNP which classifies nsSNPs as disease-causing or neutral. Our method uses the excellent alignment generation algorithm of SIFT to identify related sequences and a combination of 31 features...

Accelerator diagnosis and control by Neural Nets

International Nuclear Information System (INIS)

Spencer, J.E.

1989-01-01

Neural Nets (NN) have been described as a solution looking for a problem. In the last conference, Artificial Intelligence (AI) was considered in the accelerator context. While good for local surveillance and control, its use for large complex systems (LCS) was much more restricted. By contrast, NN provide a good metaphor for LCS. It can be argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems, and therefore provide an ideal adaptive control system. Thus, where AI may be good for maintaining a 'golden orbit,' NN should be good for obtaining it via a quantitative approach to 'look and adjust' methods like operator tweaking which use pattern recognition to deal with hardware and software limitations, inaccuracies or errors as well as imprecise knowledge or understanding of effects like annealing and hysteresis. Further, insights from NN allow one to define feasibility conditions for LCS in terms of design constraints and tolerances. Hardware and software implications are discussed and several LCS of current interest are compared and contrasted. 15 refs., 5 figs

Accelerator diagnosis and control by Neural Nets

International Nuclear Information System (INIS)

Spencer, J.E.

1989-01-01

Neural Nets (NN) have been described as a solution looking for a problem. In the last conference, Artificial Intelligence (AI) was considered in the accelerator context. While good for local surveillance and control, its use for large complex systems (LCS) was much more restricted. By contrast, NN provide a good metaphore for LCS. It can be argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems and therefore provide an ideal adaptive control system. Thus, where A1 may be good for maintaining a golden orbit, NN should be good for obtaining it via a quantitative approach to look and adjust methods like operator tweaking which use pattern recognition to deal with hardware and software limitations, inaccuracies or errors as well as imprecise knowledge or understanding of effects like annealing and hysteresis. Further, insights from NN allow one to define feasibility conditions for LCS in terms of design constraints and tolerances. Hardware and software implications are discussed and several LCS of current interest are compared and contrasted. 15 refs., 5 figs

Prediction of disease causing non-synonymous SNPs by the Artificial Neural Network Predictor NetDiseaseSNP.

Directory of Open Access Journals (Sweden)

Morten Bo Johansen

Full Text Available We have developed a sequence conservation-based artificial neural network predictor called NetDiseaseSNP which classifies nsSNPs as disease-causing or neutral. Our method uses the excellent alignment generation algorithm of SIFT to identify related sequences and a combination of 31 features assessing sequence conservation and the predicted surface accessibility to produce a single score which can be used to rank nsSNPs based on their potential to cause disease. NetDiseaseSNP classifies successfully disease-causing and neutral mutations. In addition, we show that NetDiseaseSNP discriminates cancer driver and passenger mutations satisfactorily. Our method outperforms other state-of-the-art methods on several disease/neutral datasets as well as on cancer driver/passenger mutation datasets and can thus be used to pinpoint and prioritize plausible disease candidates among nsSNPs for further investigation. NetDiseaseSNP is publicly available as an online tool as well as a web service: http://www.cbs.dtu.dk/services/NetDiseaseSNP.

Effect of Explicit Evaluation on Neural Connectivity Related to Listening to Unfamiliar Music

Science.gov (United States)

Liu, Chao; Brattico, Elvira; Abu-jamous, Basel; Pereira, Carlos S.; Jacobsen, Thomas; Nandi, Asoke K.

2017-01-01

People can experience different emotions when listening to music. A growing number of studies have investigated the brain structures and neural connectivities associated with perceived emotions. However, very little is known about the effect of an explicit act of judgment on the neural processing of emotionally-valenced music. In this study, we adopted the novel consensus clustering paradigm, called binarisation of consensus partition matrices (Bi-CoPaM), to study whether and how the conscious aesthetic evaluation of the music would modulate brain connectivity networks related to emotion and reward processing. Participants listened to music under three conditions – one involving a non-evaluative judgment, one involving an explicit evaluative aesthetic judgment, and one involving no judgment at all (passive listening only). During non-evaluative attentive listening we obtained auditory-limbic connectivity whereas when participants were asked to decide explicitly whether they liked or disliked the music excerpt, only two clusters of intercommunicating brain regions were found: one including areas related to auditory processing and action observation, and the other comprising higher-order structures involved with visual processing. Results indicate that explicit evaluative judgment has an impact on the neural auditory-limbic connectivity during affective processing of music. PMID:29311874

Unlearning in feed-forward multi-nets

NARCIS (Netherlands)

Spaanenburg, L; Kurkova,; Steele, NC; Neruda, R; Karny, M

2001-01-01

Multi-nets promise an improved performance over monolithic neural networks by virtue of their distributed implementation. Modular neural networks are multi-nets based on an judicious assembly of functionally different parts. This can be viewed as again a monolithic network, but with more complex

Lasting modulation effects of rTMS on neural activity and connectivity as revealed by resting-state EEG.

Science.gov (United States)

Ding, Lei; Shou, Guofa; Yuan, Han; Urbano, Diamond; Cha, Yoon-Hee

2014-07-01

The long-lasting neuromodulatory effects of repetitive transcranial magnetic stimulation (rTMS) are of great interest for therapeutic applications in various neurological and psychiatric disorders, due to which functional connectivity among brain regions is profoundly disturbed. Classic TMS studies selectively alter neural activity in specific brain regions and observe neural activity changes on nonperturbed areas to infer underlying connectivity and its changes. Less has been indicated in direct measures of functional connectivity and/or neural network and on how connectivity/network alterations occur. Here, we developed a novel analysis framework to directly investigate both neural activity and connectivity changes induced by rTMS from resting-state EEG (rsEEG) acquired in a group of subjects with a chronic disorder of imbalance, known as the mal de debarquement syndrome (MdDS). Resting-state activity in multiple functional brain areas was identified through a data-driven blind source separation analysis on rsEEG data, and the connectivity among them was characterized using a phase synchronization measure. Our study revealed that there were significant long-lasting changes in resting-state neural activity, in theta, low alpha, and high alpha bands and neural networks in theta, low alpha, high alpha and beta bands, over broad cortical areas 4 to 5 h after the last application of rTMS in a consecutive five-day protocol. Our results of rsEEG connectivity further indicated that the changes, mainly in the alpha band, over the parietal and occipital cortices from pre- to post-TMS sessions were significantly correlated, in both magnitude and direction, to symptom changes in this group of subjects with MdDS. This connectivity measure not only suggested that rTMS can generate positive treatment effects in MdDS patients, but also revealed new potential targets for future therapeutic trials to improve treatment effects. It is promising that the new connectivity measure

Intrinsic connectivity of neural networks in the awake rabbit.

Science.gov (United States)

Schroeder, Matthew P; Weiss, Craig; Procissi, Daniel; Disterhoft, John F; Wang, Lei

2016-04-01

The way in which the brain is functionally connected into different networks has emerged as an important research topic in order to understand normal neural processing and signaling. Since some experimental manipulations are difficult or unethical to perform in humans, animal models are better suited to investigate this topic. Rabbits are a species that can undergo MRI scanning in an awake and conscious state with minimal preparation and habituation. In this study, we characterized the intrinsic functional networks of the resting New Zealand White rabbit brain using BOLD fMRI data. Group independent component analysis revealed seven networks similar to those previously found in humans, non-human primates and/or rodents including the hippocampus, default mode, cerebellum, thalamus, and visual, somatosensory, and parietal cortices. For the first time, the intrinsic functional networks of the resting rabbit brain have been elucidated demonstrating the rabbit's applicability as a translational animal model. Without the confounding effects of anesthetics or sedatives, future experiments may employ rabbits to understand changes in neural connectivity and brain functioning as a result of experimental manipulation (e.g., temporary or permanent network disruption, learning-related changes, and drug administration). Copyright © 2016 Elsevier Inc. All rights reserved.

Multi-Connection Pattern Analysis: Decoding the representational content of neural communication.

Science.gov (United States)

Li, Yuanning; Richardson, Robert Mark; Ghuman, Avniel Singh

2017-11-15

The lack of multivariate methods for decoding the representational content of interregional neural communication has left it difficult to know what information is represented in distributed brain circuit interactions. Here we present Multi-Connection Pattern Analysis (MCPA), which works by learning mappings between the activity patterns of the populations as a factor of the information being processed. These maps are used to predict the activity from one neural population based on the activity from the other population. Successful MCPA-based decoding indicates the involvement of distributed computational processing and provides a framework for probing the representational structure of the interaction. Simulations demonstrate the efficacy of MCPA in realistic circumstances. In addition, we demonstrate that MCPA can be applied to different signal modalities to evaluate a variety of hypothesis associated with information coding in neural communications. We apply MCPA to fMRI and human intracranial electrophysiological data to provide a proof-of-concept of the utility of this method for decoding individual natural images and faces in functional connectivity data. We further use a MCPA-based representational similarity analysis to illustrate how MCPA may be used to test computational models of information transfer among regions of the visual processing stream. Thus, MCPA can be used to assess the information represented in the coupled activity of interacting neural circuits and probe the underlying principles of information transformation between regions. Copyright © 2017 Elsevier Inc. All rights reserved.

The EB factory project. I. A fast, neural-net-based, general purpose light curve classifier optimized for eclipsing binaries

International Nuclear Information System (INIS)

Paegert, Martin; Stassun, Keivan G.; Burger, Dan M.

2014-01-01

We describe a new neural-net-based light curve classifier and provide it with documentation as a ready-to-use tool for the community. While optimized for identification and classification of eclipsing binary stars, the classifier is general purpose, and has been developed for speed in the context of upcoming massive surveys such as the Large Synoptic Survey Telescope. A challenge for classifiers in the context of neural-net training and massive data sets is to minimize the number of parameters required to describe each light curve. We show that a simple and fast geometric representation that encodes the overall light curve shape, together with a chi-square parameter to capture higher-order morphology information results in efficient yet robust light curve classification, especially for eclipsing binaries. Testing the classifier on the ASAS light curve database, we achieve a retrieval rate of 98% and a false-positive rate of 2% for eclipsing binaries. We achieve similarly high retrieval rates for most other periodic variable-star classes, including RR Lyrae, Mira, and delta Scuti. However, the classifier currently has difficulty discriminating between different sub-classes of eclipsing binaries, and suffers a relatively low (∼60%) retrieval rate for multi-mode delta Cepheid stars. We find that it is imperative to train the classifier's neural network with exemplars that include the full range of light curve quality to which the classifier will be expected to perform; the classifier performs well on noisy light curves only when trained with noisy exemplars. The classifier source code, ancillary programs, a trained neural net, and a guide for use, are provided.

An adaptable Boolean net trainable to control a computing robot

International Nuclear Information System (INIS)

Lauria, F. E.; Prevete, R.; Milo, M.; Visco, S.

1999-01-01

We discuss a method to implement in a Boolean neural network a Hebbian rule so to obtain an adaptable universal control system. We start by presenting both the Boolean neural net and the Hebbian rule we have considered. Then we discuss, first, the problems arising when the latter is naively implemented in a Boolean neural net, second, the method consenting us to overcome them and the ensuing adaptable Boolean neural net paradigm. Next, we present the adaptable Boolean neural net as an intelligent control system, actually controlling a writing robot, and discuss how to train it in the execution of the elementary arithmetic operations on operands represented by numerals with an arbitrary number of digits

ConvNetQuake: Convolutional Neural Network for Earthquake Detection and Location

Science.gov (United States)

Denolle, M.; Perol, T.; Gharbi, M.

2017-12-01

Over the last decades, the volume of seismic data has increased exponentially, creating a need for efficient algorithms to reliably detect and locate earthquakes. Today's most elaborate methods scan through the plethora of continuous seismic records, searching for repeating seismic signals. In this work, we leverage the recent advances in artificial intelligence and present ConvNetQuake, a highly scalable convolutional neural network for probabilistic earthquake detection and location from single stations. We apply our technique to study two years of induced seismicity in Oklahoma (USA). We detect 20 times more earthquakes than previously cataloged by the Oklahoma Geological Survey. Our algorithm detection performances are at least one order of magnitude faster than other established methods.

Reconstruction of sparse connectivity in neural networks from spike train covariances

International Nuclear Information System (INIS)

Pernice, Volker; Rotter, Stefan

2013-01-01

The inference of causation from correlation is in general highly problematic. Correspondingly, it is difficult to infer the existence of physical synaptic connections between neurons from correlations in their activity. Covariances in neural spike trains and their relation to network structure have been the subject of intense research, both experimentally and theoretically. The influence of recurrent connections on covariances can be characterized directly in linear models, where connectivity in the network is described by a matrix of linear coupling kernels. However, as indirect connections also give rise to covariances, the inverse problem of inferring network structure from covariances can generally not be solved unambiguously. Here we study to what degree this ambiguity can be resolved if the sparseness of neural networks is taken into account. To reconstruct a sparse network, we determine the minimal set of linear couplings consistent with the measured covariances by minimizing the L 1 norm of the coupling matrix under appropriate constraints. Contrary to intuition, after stochastic optimization of the coupling matrix, the resulting estimate of the underlying network is directed, despite the fact that a symmetric matrix of count covariances is used for inference. The performance of the new method is best if connections are neither exceedingly sparse, nor too dense, and it is easily applicable for networks of a few hundred nodes. Full coupling kernels can be obtained from the matrix of full covariance functions. We apply our method to networks of leaky integrate-and-fire neurons in an asynchronous–irregular state, where spike train covariances are well described by a linear model. (paper)

Transcranial magnetic stimulation and connectivity mapping: tools for studying the neural bases of brain disorders.

Science.gov (United States)

Hampson, M; Hoffman, R E

2010-01-01

There has been an increasing emphasis on characterizing pathophysiology underlying psychiatric and neurological disorders in terms of altered neural connectivity and network dynamics. Transcranial magnetic stimulation (TMS) provides a unique opportunity for investigating connectivity in the human brain. TMS allows researchers and clinicians to directly stimulate cortical regions accessible to electromagnetic coils positioned on the scalp. The induced activation can then propagate through long-range connections to other brain areas. Thus, by identifying distal regions activated during TMS, researchers can infer connectivity patterns in the healthy human brain and can examine how those patterns may be disrupted in patients with different brain disorders. Conversely, connectivity maps derived using neuroimaging methods can identify components of a dysfunctional network. Nodes in this dysfunctional network accessible as targets for TMS by virtue of their proximity to the scalp may then permit TMS-induced alterations of components of the network not directly accessible to TMS via propagated effects. Thus TMS can provide a portal for accessing and altering neural dynamics in networks that are widely distributed anatomically. Finally, when long-term modulation of network dynamics is induced by trains of repetitive TMS, changes in functional connectivity patterns can be studied in parallel with changes in patient symptoms. These correlational data can elucidate neural mechanisms underlying illness and recovery. In this review, we focus on the application of these approaches to the study of psychiatric and neurological illnesses.

Transcranial magnetic stimulation and connectivity mapping: tools for studying the neural bases of brain disorders.

Directory of Open Access Journals (Sweden)

Michelle Hampson

2010-08-01

Full Text Available There has been an increasing emphasis on characterizing pathophysiology underlying psychiatric and neurological disorders in terms of altered neural connectivity and network dynamics. Transcranial magnetic stimulation (TMS provides a unique opportunity for investigating connectivity in the human brain. TMS allows researchers and clinicians to directly stimulate cortical regions accessible to electromagnetic coils positioned on the scalp. The induced activation can then propagate through long-range connections to other brain areas. Thus, by identifying distal regions activated during TMS, researchers can infer connectivity patterns in the healthy human brain and can examine how those patterns may be disrupted in patients with different brain disorders. Conversely, connectivity maps derived using neuroimaging methods can identify components of a dysfunctional network. Nodes in this dysfunctional network accessible as targets for TMS by virtue of their proximity to the scalp may then permit TMS-induced alterations of components of the network not directly accessible to TMS via propagated effects. Thus TMS can provide a portal for accessing and altering neural dynamics in networks that are widely distributed anatomically. Finally, when long-term modulation of network dynamics is induced by trains of repetitive TMS, changes in functional connectivity patterns can be studied in parallel with changes in patient symptoms. These correlational data can elucidate neural mechanisms underlying illness and recovery. In this review, we focus on the application of these approaches to the study of psychiatric and neurological illnesses.

Neural activity, neural connectivity, and the processing of emotionally valenced information in older adults: links with life satisfaction.

Science.gov (United States)

Waldinger, Robert J; Kensinger, Elizabeth A; Schulz, Marc S

2011-09-01

This study examines whether differences in late-life well-being are linked to how older adults encode emotionally valenced information. Using fMRI with 39 older adults varying in life satisfaction, we examined how viewing positive and negative images would affect activation and connectivity of an emotion-processing network. Participants engaged most regions within this network more robustly for positive than for negative images, but within the PFC this effect was moderated by life satisfaction, with individuals higher in satisfaction showing lower levels of activity during the processing of positive images. Participants high in satisfaction showed stronger correlations among network regions-particularly between the amygdala and other emotion processing regions-when viewing positive, as compared with negative, images. Participants low in satisfaction showed no valence effect. Findings suggest that late-life satisfaction is linked with how emotion-processing regions are engaged and connected during processing of valenced information. This first demonstration of a link between neural recruitment and late-life well-being suggests that differences in neural network activation and connectivity may account for the preferential encoding of positive information seen in some older adults.

Development of the neural net technique for particle physics. Study of the e+e- → Z0 → γH reaction

International Nuclear Information System (INIS)

Guicheney, C.

1992-01-01

This study is concerned with the application of pattern recognition methods through neural networks to High Energy physics. Two methods, Hopfield nets and multilayer nets, are analyzed and shown to have high potential for (resp.) clusterization and classification. Hopfield nets are used for the recognition of jets occurring during the fragmentation process of the e + e - reaction. Multilayer nets are used for the whole reaction analysis. Impediments are pointed out. Associated background noise is also examined. Multilayer nets may enhance the signal to noise ratio when looking for an upper limit for the production of a Higgs boson in the expected canal, and allow for the specific study of the γ b anti b

Application of artificial neural networks in particle physics

International Nuclear Information System (INIS)

Kolanoski, H.

1995-04-01

The application of Artificial Neural Networks in Particle Physics is reviewed. Most common is the use of feed-forward nets for event classification and function approximation. This network type is best suited for a hardware implementation and special VLSI chips are available which are used in fast trigger processors. Also discussed are fully connected networks of the Hopfield type for pattern recognition in tracking detectors. (orig.)

Artificial neural net system for interactive tissue classification with MR imaging and image segmentation

International Nuclear Information System (INIS)

Clarke, L.P.; Silbiger, M.; Naylor, C.; Brown, K.

1990-01-01

This paper reports on the development of interactive methods for MR tissue classification that permit mathematically rigorous methods for three-dimensional image segmentation and automatic organ/tumor contouring, as required for surgical and RTP planning. The authors investigate a number of image-intensity based tissue- classification methods that make no implicit assumptions on the MR parameters and hence are not limited by image data set. Similarly, we have trained artificial neural net (ANN) systems for both supervised and unsupervised tissue classification

Door and cabinet recognition using convolutional neural nets and real-time method fusion for handle detection and grasping

DEFF Research Database (Denmark)

Maurin, Adrian Llopart; Ravn, Ole; Andersen, Nils Axel

2017-01-01

In this paper we present a new method that robustly identifies doors, cabinets and their respective handles, with special emphasis on extracting useful features from handles to be then manipulated. The novelty of this system relies on the combination of a Convolutional Neural Net (CNN), as a form...

A 3D Active Learning Application for NeMO-Net, the NASA Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

Science.gov (United States)

van den Bergh, J.; Schutz, J.; Chirayath, V.; Li, A.

2017-12-01

NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Net's convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign.Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users' input against pre-classified coral imagery to gauge their accuracy and utilizes in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.

A 3D Active Learning Application for NeMO-Net, the NASA Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

Science.gov (United States)

van den Bergh, Jarrett; Schutz, Joey; Li, Alan; Chirayath, Ved

2017-01-01

NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Nets convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign. Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users input against pre-classified coral imagery to gauge their accuracy and utilize in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.

Connectivity inference from neural recording data: Challenges, mathematical bases and research directions.

Science.gov (United States)

Magrans de Abril, Ildefons; Yoshimoto, Junichiro; Doya, Kenji

2018-06-01

This article presents a review of computational methods for connectivity inference from neural activity data derived from multi-electrode recordings or fluorescence imaging. We first identify biophysical and technical challenges in connectivity inference along the data processing pipeline. We then review connectivity inference methods based on two major mathematical foundations, namely, descriptive model-free approaches and generative model-based approaches. We investigate representative studies in both categories and clarify which challenges have been addressed by which method. We further identify critical open issues and possible research directions. Copyright © 2018 The Author(s). Published by Elsevier Ltd.. All rights reserved.

22nd Italian Workshop on Neural Nets

CERN Document Server

Bassis, Simone; Esposito, Anna; Morabito, Francesco

2013-01-01

This volume collects a selection of contributions which has been presented at the 22nd Italian Workshop on Neural Networks, the yearly meeting of the Italian Society for Neural Networks (SIREN). The conference was held in Italy, Vietri sul Mare (Salerno), during May 17-19, 2012. The annual meeting of SIREN is sponsored by International Neural Network Society (INNS), European Neural Network Society (ENNS) and IEEE Computational Intelligence Society (CIS). The book – as well as the workshop-  is organized in three main components, two special sessions and a group of regular sessions featuring different aspects and point of views of artificial neural networks and natural intelligence, also including applications of present compelling interest.

Resting State fMRI Functional Connectivity-Based Classification Using a Convolutional Neural Network Architecture.

Science.gov (United States)

Meszlényi, Regina J; Buza, Krisztian; Vidnyánszky, Zoltán

2017-01-01

Machine learning techniques have become increasingly popular in the field of resting state fMRI (functional magnetic resonance imaging) network based classification. However, the application of convolutional networks has been proposed only very recently and has remained largely unexplored. In this paper we describe a convolutional neural network architecture for functional connectome classification called connectome-convolutional neural network (CCNN). Our results on simulated datasets and a publicly available dataset for amnestic mild cognitive impairment classification demonstrate that our CCNN model can efficiently distinguish between subject groups. We also show that the connectome-convolutional network is capable to combine information from diverse functional connectivity metrics and that models using a combination of different connectivity descriptors are able to outperform classifiers using only one metric. From this flexibility follows that our proposed CCNN model can be easily adapted to a wide range of connectome based classification or regression tasks, by varying which connectivity descriptor combinations are used to train the network.

Toward Rigorous Parameterization of Underconstrained Neural Network Models Through Interactive Visualization and Steering of Connectivity Generation

Directory of Open Access Journals (Sweden)

Christian Nowke

2018-06-01

Full Text Available Simulation models in many scientific fields can have non-unique solutions or unique solutions which can be difficult to find. Moreover, in evolving systems, unique final state solutions can be reached by multiple different trajectories. Neuroscience is no exception. Often, neural network models are subject to parameter fitting to obtain desirable output comparable to experimental data. Parameter fitting without sufficient constraints and a systematic exploration of the possible solution space can lead to conclusions valid only around local minima or around non-minima. To address this issue, we have developed an interactive tool for visualizing and steering parameters in neural network simulation models. In this work, we focus particularly on connectivity generation, since finding suitable connectivity configurations for neural network models constitutes a complex parameter search scenario. The development of the tool has been guided by several use cases—the tool allows researchers to steer the parameters of the connectivity generation during the simulation, thus quickly growing networks composed of multiple populations with a targeted mean activity. The flexibility of the software allows scientists to explore other connectivity and neuron variables apart from the ones presented as use cases. With this tool, we enable an interactive exploration of parameter spaces and a better understanding of neural network models and grapple with the crucial problem of non-unique network solutions and trajectories. In addition, we observe a reduction in turn around times for the assessment of these models, due to interactive visualization while the simulation is computed.

Functional Connectivity with Distinct Neural Networks Tracks Fluctuations in Gain/Loss Framing Susceptibility

Science.gov (United States)

Smith, David V.; Sip, Kamila E.; Delgado, Mauricio R.

2016-01-01

Multiple large-scale neural networks orchestrate a wide range of cognitive processes. For example, interoceptive processes related to self-referential thinking have been linked to the default-mode network (DMN); whereas exteroceptive processes related to cognitive control have been linked to the executive-control network (ECN). Although the DMN and ECN have been postulated to exert opposing effects on cognition, it remains unclear how connectivity with these spatially overlapping networks contribute to fluctuations in behavior. While previous work has suggested the medial prefrontal cortex (MPFC) is involved in behavioral change following feedback, these observations could be linked to interoceptive processes tied to DMN or exteroceptive processes tied to ECN because MPFC is positioned in both networks. To address this problem, we employed independent component analysis combined with dual-regression functional connectivity analysis. Participants made a series of financial decisions framed as monetary gains or losses. In some sessions, participants received feedback from a peer observing their choices; in other sessions, feedback was not provided. Following feedback, framing susceptibility—indexed as the increase in gambling behavior in loss frames compared to gain frames—was heightened in some participants and diminished in others. We examined whether these individual differences were linked to differences in connectivity by contrasting sessions containing feedback against those that did not contain feedback. We found two key results. As framing susceptibility increased, the MPFC increased connectivity with DMN; in contrast, temporal-parietal junction decreased connectivity with the ECN. Our results highlight how functional connectivity patterns with distinct neural networks contribute to idiosyncratic behavioral changes. PMID:25858445

Neural activation and functional connectivity during motor imagery of bimanual everyday actions.

Directory of Open Access Journals (Sweden)

André J Szameitat

Full Text Available Bimanual actions impose intermanual coordination demands not present during unimanual actions. We investigated the functional neuroanatomical correlates of these coordination demands in motor imagery (MI of everyday actions using functional magnetic resonance imaging (fMRI. For this, 17 participants imagined unimanual actions with the left and right hand as well as bimanual actions while undergoing fMRI. A univariate fMRI analysis showed no reliable cortical activations specific to bimanual MI, indicating that intermanual coordination demands in MI are not associated with increased neural processing. A functional connectivity analysis based on psychophysiological interactions (PPI, however, revealed marked increases in connectivity between parietal and premotor areas within and between hemispheres. We conclude that in MI of everyday actions intermanual coordination demands are primarily met by changes in connectivity between areas and only moderately, if at all, by changes in the amount of neural activity. These results are the first characterization of the neuroanatomical correlates of bimanual coordination demands in MI. Our findings support the assumed equivalence of overt and imagined actions and highlight the differences between uni- and bimanual actions. The findings extent our understanding of the motor system and may aid the development of clinical neurorehabilitation approaches based on mental practice.

Activity-dependent modulation of neural circuit synaptic connectivity

Directory of Open Access Journals (Sweden)

Charles R Tessier

2009-07-01

Full Text Available In many nervous systems, the establishment of neural circuits is known to proceed via a two-stage process; 1 early, activity-independent wiring to produce a rough map characterized by excessive synaptic connections, and 2 subsequent, use-dependent pruning to eliminate inappropriate connections and reinforce maintained synapses. In invertebrates, however, evidence of the activity-dependent phase of synaptic refinement has been elusive, and the dogma has long been that invertebrate circuits are “hard-wired” in a purely activity-independent manner. This conclusion has been challenged recently through the use of new transgenic tools employed in the powerful Drosophila system, which have allowed unprecedented temporal control and single neuron imaging resolution. These recent studies reveal that activity-dependent mechanisms are indeed required to refine circuit maps in Drosophila during precise, restricted windows of late-phase development. Such mechanisms of circuit refinement may be key to understanding a number of human neurological diseases, including developmental disorders such as Fragile X syndrome (FXS and autism, which are hypothesized to result from defects in synaptic connectivity and activity-dependent circuit function. This review focuses on our current understanding of activity-dependent synaptic connectivity in Drosophila, primarily through analyzing the role of the fragile X mental retardation protein (FMRP in the Drosophila FXS disease model. The particular emphasis of this review is on the expanding array of new genetically-encoded tools that are allowing cellular events and molecular players to be dissected with ever greater precision and detail.

Artificial neural networks for control of a grid-connected rectifier/inverter under disturbance, dynamic and power converter switching conditions.

Science.gov (United States)

Li, Shuhui; Fairbank, Michael; Johnson, Cameron; Wunsch, Donald C; Alonso, Eduardo; Proaño, Julio L

2014-04-01

Three-phase grid-connected converters are widely used in renewable and electric power system applications. Traditionally, grid-connected converters are controlled with standard decoupled d-q vector control mechanisms. However, recent studies indicate that such mechanisms show limitations in their applicability to dynamic systems. This paper investigates how to mitigate such restrictions using a neural network to control a grid-connected rectifier/inverter. The neural network implements a dynamic programming algorithm and is trained by using back-propagation through time. To enhance performance and stability under disturbance, additional strategies are adopted, including the use of integrals of error signals to the network inputs and the introduction of grid disturbance voltage to the outputs of a well-trained network. The performance of the neural-network controller is studied under typical vector control conditions and compared against conventional vector control methods, which demonstrates that the neural vector control strategy proposed in this paper is effective. Even in dynamic and power converter switching environments, the neural vector controller shows strong ability to trace rapidly changing reference commands, tolerate system disturbances, and satisfy control requirements for a faulted power system.

Aberrant Neural Connectivity during Emotional Processing Associated with Posttraumatic Stress.

Science.gov (United States)

Sadeh, Naomi; Spielberg, Jeffrey M; Warren, Stacie L; Miller, Gregory A; Heller, Wendy

2014-11-01

Given the complexity of the brain, characterizing relations among distributed brain regions is likely essential to describing the neural instantiation of posttraumatic stress symptoms. This study examined patterns of functional connectivity among key brain regions implicated in the pathophysiology of posttraumatic stress disorder (PTSD) in 35 trauma-exposed adults using an emotion-word Stroop task. PTSD symptom severity (particularly hyperarousal symptoms) moderated amygdala-mPFC coupling during the processing of unpleasant words, and this moderation correlated positively with reported real-world impairment and amygdala reactivity. Reexperiencing severity moderated hippocampus-insula coupling during pleasant and unpleasant words. Results provide evidence that PTSD symptoms differentially moderate functional coupling during emotional interference and underscore the importance of examining network connectivity in research on PTSD. They suggest that hyperarousal is associated with negative mPFC-amygdala coupling and that reexperiencing is associated with altered insula-hippocampus function, patterns of connectivity that may represent separable indicators of dysfunctional inhibitory control during affective processing.

Connectivity strategies for higher-order neural networks applied to pattern recognition

Science.gov (United States)

Spirkovska, Lilly; Reid, Max B.

1990-01-01

Different strategies for non-fully connected HONNs (higher-order neural networks) are discussed, showing that by using such strategies an input field of 128 x 128 pixels can be attained while still achieving in-plane rotation and translation-invariant recognition. These techniques allow HONNs to be used with the larger input scenes required for practical pattern-recognition applications. The number of interconnections that must be stored has been reduced by a factor of approximately 200,000 in a T/C case and about 2000 in a Space Shuttle/F-18 case by using regional connectivity. Third-order networks have been simulated using several connection strategies. The method found to work best is regional connectivity. The main advantages of this strategy are the following: (1) it considers features of various scales within the image and thus gets a better sample of what the image looks like; (2) it is invariant to shape-preserving geometric transformations, such as translation and rotation; (3) the connections are predetermined so that no extra computations are necessary during run time; and (4) it does not require any extra storage for recording which connections were formed.

Estimation of effective connectivity using multi-layer perceptron artificial neural network.

Science.gov (United States)

Talebi, Nasibeh; Nasrabadi, Ali Motie; Mohammad-Rezazadeh, Iman

2018-02-01

Studies on interactions between brain regions estimate effective connectivity, (usually) based on the causality inferences made on the basis of temporal precedence. In this study, the causal relationship is modeled by a multi-layer perceptron feed-forward artificial neural network, because of the ANN's ability to generate appropriate input-output mapping and to learn from training examples without the need of detailed knowledge of the underlying system. At any time instant, the past samples of data are placed in the network input, and the subsequent values are predicted at its output. To estimate the strength of interactions, the measure of " Causality coefficient " is defined based on the network structure, the connecting weights and the parameters of hidden layer activation function. Simulation analysis demonstrates that the method, called "CREANN" (Causal Relationship Estimation by Artificial Neural Network), can estimate time-invariant and time-varying effective connectivity in terms of MVAR coefficients. The method shows robustness with respect to noise level of data. Furthermore, the estimations are not significantly influenced by the model order (considered time-lag), and the different initial conditions (initial random weights and parameters of the network). CREANN is also applied to EEG data collected during a memory recognition task. The results implicate that it can show changes in the information flow between brain regions, involving in the episodic memory retrieval process. These convincing results emphasize that CREANN can be used as an appropriate method to estimate the causal relationship among brain signals.

NetTurnP – Neural Network Prediction of Beta-turns by Use of Evolutionary Information and Predicted Protein Sequence Features

DEFF Research Database (Denmark)

Petersen, Bent; Lundegaard, Claus; Petersen, Thomas Nordahl

2010-01-01

is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino......β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method...... NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which...

Discovery and introduction of a (3,18)-connected net as an ideal blueprint for the design of metal-organic frameworks

KAUST Repository

Guillerm, Vincent

2014-06-29

Metal-organic frameworks (MOFs) are a promising class of porous materials because it is possible to mutually control their porous structure, composition and functionality. However, it is still a challenge to predict the network topology of such framework materials prior to their synthesis. Here we use a new rare earth (RE) nonanuclear carboxylate-based cluster as an 18-connected molecular building block to form a gea-MOF (gea-MOF-1) based on a (3,18)-connected net. We then utilized this gea net as a blueprint to design and assemble another MOF (gea-MOF-2). In gea-MOF-2, the 18-connected RE clusters are replaced by metal-organic polyhedra, peripherally functionalized so as to have the same connectivity as the RE clusters. These metal-organic polyhedra act as supermolecular building blocks when they form gea-MOF-2. The discovery of a (3,18)-connected MOF followed by deliberate transposition of its topology to a predesigned second MOF with a different chemical system validates the prospective rational design of MOFs. © 2014 Macmillan Publishers Limited. All rights reserved.

Differential Covariance: A New Class of Methods to Estimate Sparse Connectivity from Neural Recordings.

Science.gov (United States)

Lin, Tiger W; Das, Anup; Krishnan, Giri P; Bazhenov, Maxim; Sejnowski, Terrence J

2017-10-01

With our ability to record more neurons simultaneously, making sense of these data is a challenge. Functional connectivity is one popular way to study the relationship of multiple neural signals. Correlation-based methods are a set of currently well-used techniques for functional connectivity estimation. However, due to explaining away and unobserved common inputs (Stevenson, Rebesco, Miller, & Körding, 2008 ), they produce spurious connections. The general linear model (GLM), which models spike trains as Poisson processes (Okatan, Wilson, & Brown, 2005 ; Truccolo, Eden, Fellows, Donoghue, & Brown, 2005 ; Pillow et al., 2008 ), avoids these confounds. We develop here a new class of methods by using differential signals based on simulated intracellular voltage recordings. It is equivalent to a regularized AR(2) model. We also expand the method to simulated local field potential recordings and calcium imaging. In all of our simulated data, the differential covariance-based methods achieved performance better than or similar to the GLM method and required fewer data samples. This new class of methods provides alternative ways to analyze neural signals.

Differential Covariance: A New Class of Methods to Estimate Sparse Connectivity from Neural Recordings

Science.gov (United States)

Lin, Tiger W.; Das, Anup; Krishnan, Giri P.; Bazhenov, Maxim; Sejnowski, Terrence J.

2017-01-01

With our ability to record more neurons simultaneously, making sense of these data is a challenge. Functional connectivity is one popular way to study the relationship of multiple neural signals. Correlation-based methods are a set of currently well-used techniques for functional connectivity estimation. However, due to explaining away and unobserved common inputs (Stevenson, Rebesco, Miller, & Körding, 2008), they produce spurious connections. The general linear model (GLM), which models spike trains as Poisson processes (Okatan, Wilson, & Brown, 2005; Truccolo, Eden, Fellows, Donoghue, & Brown, 2005; Pillow et al., 2008), avoids these confounds. We develop here a new class of methods by using differential signals based on simulated intracellular voltage recordings. It is equivalent to a regularized AR(2) model. We also expand the method to simulated local field potential recordings and calcium imaging. In all of our simulated data, the differential covariance-based methods achieved performance better than or similar to the GLM method and required fewer data samples. This new class of methods provides alternative ways to analyze neural signals. PMID:28777719

The necessity of connection structures in neural models of variable binding.

Science.gov (United States)

van der Velde, Frank; de Kamps, Marc

2015-08-01

In his review of neural binding problems, Feldman (Cogn Neurodyn 7:1-11, 2013) addressed two types of models as solutions of (novel) variable binding. The one type uses labels such as phase synchrony of activation. The other ('connectivity based') type uses dedicated connections structures to achieve novel variable binding. Feldman argued that label (synchrony) based models are the only possible candidates to handle novel variable binding, whereas connectivity based models lack the flexibility required for that. We argue and illustrate that Feldman's analysis is incorrect. Contrary to his conclusion, connectivity based models are the only viable candidates for models of novel variable binding because they are the only type of models that can produce behavior. We will show that the label (synchrony) based models analyzed by Feldman are in fact examples of connectivity based models. Feldman's analysis that novel variable binding can be achieved without existing connection structures seems to result from analyzing the binding problem in a wrong frame of reference, in particular in an outside instead of the required inside frame of reference. Connectivity based models can be models of novel variable binding when they possess a connection structure that resembles a small-world network, as found in the brain. We will illustrate binding with this type of model with episode binding and the binding of words, including novel words, in sentence structures.

Transcranial Magnetic Stimulation and Connectivity Mapping: Tools for Studying the Neural Bases of Brain Disorders

OpenAIRE

Hampson, M.; Hoffman, R. E.

2010-01-01

There has been an increasing emphasis on characterizing pathophysiology underlying psychiatric and neurological disorders in terms of altered neural connectivity and network dynamics. Transcranial magnetic stimulation (TMS) provides a unique opportunity for investigating connectivity in the human brain. TMS allows researchers and clinicians to directly stimulate cortical regions accessible to electromagnetic coils positioned on the scalp. The induced activation can then propagate through...

A biologically inspired neural net for trajectory formation and obstacle avoidance.

Science.gov (United States)

Glasius, R; Komoda, A; Gielen, S C

1996-06-01

In this paper we present a biologically inspired two-layered neural network for trajectory formation and obstacle avoidance. The two topographically ordered neural maps consist of analog neurons having continuous dynamics. The first layer, the sensory map, receives sensory information and builds up an activity pattern which contains the optimal solution (i.e. shortest path without collisions) for any given set of current position, target positions and obstacle positions. Targets and obstacles are allowed to move, in which case the activity pattern in the sensory map will change accordingly. The time evolution of the neural activity in the second layer, the motor map, results in a moving cluster of activity, which can be interpreted as a population vector. Through the feedforward connections between the two layers, input of the sensory map directs the movement of the cluster along the optimal path from the current position of the cluster to the target position. The smooth trajectory is the result of the intrinsic dynamics of the network only. No supervisor is required. The output of the motor map can be used for direct control of an autonomous system in a cluttered environment or for control of the actuators of a biological limb or robot manipulator. The system is able to reach a target even in the presence of an external perturbation. Computer simulations of a point robot and a multi-joint manipulator illustrate the theory.

Training for Micrographia Alters Neural Connectivity in Parkinson's Disease

Directory of Open Access Journals (Sweden)

Evelien Nackaerts

2018-01-01

Full Text Available Despite recent advances in clarifying the neural networks underlying rehabilitation in Parkinson's disease (PD, the impact of prolonged motor learning interventions on brain connectivity in people with PD is currently unknown. Therefore, the objective of this study was to compare cortical network changes after 6 weeks of visually cued handwriting training (= experimental with a placebo intervention to address micrographia, a common problem in PD. Twenty seven early Parkinson's patients on dopaminergic medication performed a pre-writing task in both the presence and absence of visual cues during behavioral tests and during fMRI. Subsequently, patients were randomized to the experimental (N = 13 or placebo intervention (N = 14 both lasting 6 weeks, after which they underwent the same testing procedure. We used dynamic causal modeling to compare the neural network dynamics in both groups before and after training. Most importantly, intensive writing training propagated connectivity via the left hemispheric visuomotor stream to an increased coupling with the supplementary motor area, not witnessed in the placebo group. Training enhanced communication in the left visuomotor integration system in line with the learned visually steered training. Notably, this pattern was apparent irrespective of the presence of cues, suggesting transfer from cued to uncued handwriting. We conclude that in early PD intensive motor skill learning, which led to clinical improvement, alters cortical network functioning. We showed for the first time in a placebo-controlled design that it remains possible to enhance the drive to the supplementary motor area through motor learning.

Gas Classification Using Deep Convolutional Neural Networks

Science.gov (United States)

Peng, Pai; Zhao, Xiaojin; Pan, Xiaofang; Ye, Wenbin

2018-01-01

In this work, we propose a novel Deep Convolutional Neural Network (DCNN) tailored for gas classification. Inspired by the great success of DCNN in the field of computer vision, we designed a DCNN with up to 38 layers. In general, the proposed gas neural network, named GasNet, consists of: six convolutional blocks, each block consist of six layers; a pooling layer; and a fully-connected layer. Together, these various layers make up a powerful deep model for gas classification. Experimental results show that the proposed DCNN method is an effective technique for classifying electronic nose data. We also demonstrate that the DCNN method can provide higher classification accuracy than comparable Support Vector Machine (SVM) methods and Multiple Layer Perceptron (MLP). PMID:29316723

Gas Classification Using Deep Convolutional Neural Networks.

Science.gov (United States)

Peng, Pai; Zhao, Xiaojin; Pan, Xiaofang; Ye, Wenbin

2018-01-08

In this work, we propose a novel Deep Convolutional Neural Network (DCNN) tailored for gas classification. Inspired by the great success of DCNN in the field of computer vision, we designed a DCNN with up to 38 layers. In general, the proposed gas neural network, named GasNet, consists of: six convolutional blocks, each block consist of six layers; a pooling layer; and a fully-connected layer. Together, these various layers make up a powerful deep model for gas classification. Experimental results show that the proposed DCNN method is an effective technique for classifying electronic nose data. We also demonstrate that the DCNN method can provide higher classification accuracy than comparable Support Vector Machine (SVM) methods and Multiple Layer Perceptron (MLP).

Knowledge engineering tools for reasoning with scientific observations and interpretations: a neural connectivity use case.

Science.gov (United States)

Russ, Thomas A; Ramakrishnan, Cartic; Hovy, Eduard H; Bota, Mihail; Burns, Gully A P C

2011-08-22

We address the goal of curating observations from published experiments in a generalizable form; reasoning over these observations to generate interpretations and then querying this interpreted knowledge to supply the supporting evidence. We present web-application software as part of the 'BioScholar' project (R01-GM083871) that fully instantiates this process for a well-defined domain: using tract-tracing experiments to study the neural connectivity of the rat brain. The main contribution of this work is to provide the first instantiation of a knowledge representation for experimental observations called 'Knowledge Engineering from Experimental Design' (KEfED) based on experimental variables and their interdependencies. The software has three parts: (a) the KEfED model editor - a design editor for creating KEfED models by drawing a flow diagram of an experimental protocol; (b) the KEfED data interface - a spreadsheet-like tool that permits users to enter experimental data pertaining to a specific model; (c) a 'neural connection matrix' interface that presents neural connectivity as a table of ordinal connection strengths representing the interpretations of tract-tracing data. This tool also allows the user to view experimental evidence pertaining to a specific connection. BioScholar is built in Flex 3.5. It uses Persevere (a noSQL database) as a flexible data store and PowerLoom® (a mature First Order Logic reasoning system) to execute queries using spatial reasoning over the BAMS neuroanatomical ontology. We first introduce the KEfED approach as a general approach and describe its possible role as a way of introducing structured reasoning into models of argumentation within new models of scientific publication. We then describe the design and implementation of our example application: the BioScholar software. This is presented as a possible biocuration interface and supplementary reasoning toolkit for a larger, more specialized bioinformatics system: the Brain

Polygenic risk for five psychiatric disorders and cross-disorder and disorder-specific neural connectivity in two independent populations.

Science.gov (United States)

Wang, Tianqi; Zhang, Xiaolong; Li, Ang; Zhu, Meifang; Liu, Shu; Qin, Wen; Li, Jin; Yu, Chunshui; Jiang, Tianzi; Liu, Bing

2017-01-01

Major psychiatric disorders, including attention deficit hyperactivity disorder (ADHD), autism (AUT), bipolar disorder (BD), major depressive disorder (MDD), and schizophrenia (SZ), are highly heritable and polygenic. Evidence suggests that these five disorders have both shared and distinct genetic risks and neural connectivity abnormalities. To measure aggregate genetic risks, the polygenic risk score (PGRS) was computed. Two independent general populations (N = 360 and N = 323) were separately examined to investigate whether the cross-disorder PGRS and PGRS for a specific disorder were associated with individual variability in functional connectivity. Consistent altered functional connectivity was found with the bilateral insula: for the left supplementary motor area and the left superior temporal gyrus with the cross-disorder PGRS, for the left insula and right middle and superior temporal lobe associated with the PGRS for autism, for the bilateral midbrain, posterior cingulate, cuneus, and precuneus associated with the PGRS for BD, and for the left angular gyrus and the left dorsolateral prefrontal cortex associated with the PGRS for schizophrenia. No significant functional connectivity was found associated with the PGRS for ADHD and MDD. Our findings indicated that genetic effects on the cross-disorder and disorder-specific neural connectivity of common genetic risk loci are detectable in the general population. Our findings also indicated that polygenic risk contributes to the main neurobiological phenotypes of psychiatric disorders and that identifying cross-disorder and specific functional connectivity related to polygenic risks may elucidate the neural pathways for these disorders.

Slowly evolving connectivity in recurrent neural networks: I. The extreme dilution regime

International Nuclear Information System (INIS)

Wemmenhove, B; Skantzos, N S; Coolen, A C C

2004-01-01

We study extremely diluted spin models of neural networks in which the connectivity evolves in time, although adiabatically slowly compared to the neurons, according to stochastic equations which on average aim to reduce frustration. The (fast) neurons and (slow) connectivity variables equilibrate separately, but at different temperatures. Our model is exactly solvable in equilibrium. We obtain phase diagrams upon making the condensed ansatz (i.e. recall of one pattern). These show that, as the connectivity temperature is lowered, the volume of the retrieval phase diverges and the fraction of mis-aligned spins is reduced. Still one always retains a region in the retrieval phase where recall states other than the one corresponding to the 'condensed' pattern are locally stable, so the associative memory character of our model is preserved

Convolutional Neural Network for Histopathological Analysis of Osteosarcoma.

Science.gov (United States)

Mishra, Rashika; Daescu, Ovidiu; Leavey, Patrick; Rakheja, Dinesh; Sengupta, Anita

2018-03-01

Pathologists often deal with high complexity and sometimes disagreement over osteosarcoma tumor classification due to cellular heterogeneity in the dataset. Segmentation and classification of histology tissue in H&E stained tumor image datasets is a challenging task because of intra-class variations, inter-class similarity, crowded context, and noisy data. In recent years, deep learning approaches have led to encouraging results in breast cancer and prostate cancer analysis. In this article, we propose convolutional neural network (CNN) as a tool to improve efficiency and accuracy of osteosarcoma tumor classification into tumor classes (viable tumor, necrosis) versus nontumor. The proposed CNN architecture contains eight learned layers: three sets of stacked two convolutional layers interspersed with max pooling layers for feature extraction and two fully connected layers with data augmentation strategies to boost performance. The use of a neural network results in higher accuracy of average 92% for the classification. We compare the proposed architecture with three existing and proven CNN architectures for image classification: AlexNet, LeNet, and VGGNet. We also provide a pipeline to calculate percentage necrosis in a given whole slide image. We conclude that the use of neural networks can assure both high accuracy and efficiency in osteosarcoma classification.

Control of Three-Phase Grid-Connected Microgrids Using Artificial Neural Networks

OpenAIRE

Shuhui, L.; Fu, X.; Jaithwa, I.; Alonso, E.; Fairbank, M.; Wunsch, D. C.

2015-01-01

A microgrid consists of a variety of inverter-interfaced distributed energy resources (DERs). A key issue is how to control DERs within the microgrid and how to connect them to or disconnect them from the microgrid quickly. This paper presents a strategy for controlling inverter-interfaced DERs within a microgrid using an artificial neural network, which implements a dynamic programming algorithm and is trained with a new Levenberg-Marquardt backpropagation algorithm. Compared to conventional...

NetTurnP--neural network prediction of beta-turns by use of evolutionary information and predicted protein sequence features.

Directory of Open Access Journals (Sweden)

Bent Petersen

Full Text Available UNLABELLED: β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino acid sequence. The individual β-turn types I, I', II, II', VIII, VIa1, VIa2, VIba and IV have been predicted based on classifications by PROMOTIF, and the two-class prediction of β-turn or not is a superset comprised of all β-turn types. The performance is evaluated using a golden set of non-homologous sequences known as BT426. Our two-class prediction method achieves a performance of: MCC=0.50, Qtotal=82.1%, sensitivity=75.6%, PPV=68.8% and AUC=0.864. We have compared our performance to eleven other prediction methods that obtain Matthews correlation coefficients in the range of 0.17-0.47. For the type specific β-turn predictions, only type I and II can be predicted with reasonable Matthews correlation coefficients, where we obtain performance values of 0.36 and 0.31, respectively. CONCLUSION: The NetTurnP method has been implemented as a webserver, which is freely available at http://www.cbs.dtu.dk/services/NetTurnP/. NetTurnP is the only available webserver that allows submission of multiple sequences.

NetTurnP--neural network prediction of beta-turns by use of evolutionary information and predicted protein sequence features.

Science.gov (United States)

Petersen, Bent; Lundegaard, Claus; Petersen, Thomas Nordahl

2010-11-30

β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino acid sequence. The individual β-turn types I, I', II, II', VIII, VIa1, VIa2, VIba and IV have been predicted based on classifications by PROMOTIF, and the two-class prediction of β-turn or not is a superset comprised of all β-turn types. The performance is evaluated using a golden set of non-homologous sequences known as BT426. Our two-class prediction method achieves a performance of: MCC=0.50, Qtotal=82.1%, sensitivity=75.6%, PPV=68.8% and AUC=0.864. We have compared our performance to eleven other prediction methods that obtain Matthews correlation coefficients in the range of 0.17-0.47. For the type specific β-turn predictions, only type I and II can be predicted with reasonable Matthews correlation coefficients, where we obtain performance values of 0.36 and 0.31, respectively. The NetTurnP method has been implemented as a webserver, which is freely available at http://www.cbs.dtu.dk/services/NetTurnP/. NetTurnP is the only available webserver that allows submission of multiple sequences.

Neural network signal understanding for instrumentation

DEFF Research Database (Denmark)

Pau, L. F.; Johansen, F. S.

1990-01-01

understanding research is surveyed, and the selected implementation and its performance in terms of correct classification rates and robustness to noise are described. Formal results on neural net training time and sensitivity to weights are given. A theory for neural control using functional link nets is given...

Age-related difference in the effective neural connectivity associated with probabilistic category learning

International Nuclear Information System (INIS)

Yoon, Eun Jin; Cho, Sang Soo; Kim, Hee Jung; Bang, Seong Ae; Park, Hyun Soo; Kim, Yu Kyeong; Kim, Sang Eun

2007-01-01

Although it is well known that explicit memory is affected by the deleterious changes in brain with aging, but effect of aging in implicit memory such as probabilistic category learning (PCL) is not clear. To identify the effect of aging on the neural interaction for successful PCL, we investigated the neural substrates of PCL and the age-related changes of the neural network between these brain regions. 23 young (age, 252 y; 11 males) and 14 elderly (673 y; 7 males) healthy subjects underwent FDG PET during a resting state and 150-trial weather prediction (WP) task. Correlations between the WP hit rates and regional glucose metabolism were assessed using SPM2 (P diff (37) = 142.47, P<0.005), Systematic comparisons of each path revealed that frontal crosscallosal and the frontal to parahippocampal connection were most responsible for the model differences (P<0.05). For the successful PCL, the elderly recruits the basal ganglia implicit memory system but MTL recruitment differs from the young. The inadequate MTL correlation pattern in the elderly is may be caused by the changes of the neural pathway related with explicit memory. These neural changes can explain the decreased performance of PCL in elderly subjects

Knowledge engineering tools for reasoning with scientific observations and interpretations: a neural connectivity use case

Directory of Open Access Journals (Sweden)

Bota Mihail

2011-08-01

Full Text Available Abstract Background We address the goal of curating observations from published experiments in a generalizable form; reasoning over these observations to generate interpretations and then querying this interpreted knowledge to supply the supporting evidence. We present web-application software as part of the 'BioScholar' project (R01-GM083871 that fully instantiates this process for a well-defined domain: using tract-tracing experiments to study the neural connectivity of the rat brain. Results The main contribution of this work is to provide the first instantiation of a knowledge representation for experimental observations called 'Knowledge Engineering from Experimental Design' (KEfED based on experimental variables and their interdependencies. The software has three parts: (a the KEfED model editor - a design editor for creating KEfED models by drawing a flow diagram of an experimental protocol; (b the KEfED data interface - a spreadsheet-like tool that permits users to enter experimental data pertaining to a specific model; (c a 'neural connection matrix' interface that presents neural connectivity as a table of ordinal connection strengths representing the interpretations of tract-tracing data. This tool also allows the user to view experimental evidence pertaining to a specific connection. BioScholar is built in Flex 3.5. It uses Persevere (a noSQL database as a flexible data store and PowerLoom® (a mature First Order Logic reasoning system to execute queries using spatial reasoning over the BAMS neuroanatomical ontology. Conclusions We first introduce the KEfED approach as a general approach and describe its possible role as a way of introducing structured reasoning into models of argumentation within new models of scientific publication. We then describe the design and implementation of our example application: the BioScholar software. This is presented as a possible biocuration interface and supplementary reasoning toolkit for a larger

Knowledge engineering tools for reasoning with scientific observations and interpretations: a neural connectivity use case

Science.gov (United States)

2011-01-01

Background We address the goal of curating observations from published experiments in a generalizable form; reasoning over these observations to generate interpretations and then querying this interpreted knowledge to supply the supporting evidence. We present web-application software as part of the 'BioScholar' project (R01-GM083871) that fully instantiates this process for a well-defined domain: using tract-tracing experiments to study the neural connectivity of the rat brain. Results The main contribution of this work is to provide the first instantiation of a knowledge representation for experimental observations called 'Knowledge Engineering from Experimental Design' (KEfED) based on experimental variables and their interdependencies. The software has three parts: (a) the KEfED model editor - a design editor for creating KEfED models by drawing a flow diagram of an experimental protocol; (b) the KEfED data interface - a spreadsheet-like tool that permits users to enter experimental data pertaining to a specific model; (c) a 'neural connection matrix' interface that presents neural connectivity as a table of ordinal connection strengths representing the interpretations of tract-tracing data. This tool also allows the user to view experimental evidence pertaining to a specific connection. BioScholar is built in Flex 3.5. It uses Persevere (a noSQL database) as a flexible data store and PowerLoom® (a mature First Order Logic reasoning system) to execute queries using spatial reasoning over the BAMS neuroanatomical ontology. Conclusions We first introduce the KEfED approach as a general approach and describe its possible role as a way of introducing structured reasoning into models of argumentation within new models of scientific publication. We then describe the design and implementation of our example application: the BioScholar software. This is presented as a possible biocuration interface and supplementary reasoning toolkit for a larger, more specialized

Identification of neural connectivity signatures of autism using machine learning

Directory of Open Access Journals (Sweden)

Gopikrishna eDeshpande

2013-10-01

Full Text Available Alterations in neural connectivity have been suggested as a signature of the pathobiology of autism. Although disrupted correlation between cortical regions observed from functional MRI is considered to be an explanatory model for autism, the directional causal influence between brain regions is a vital link missing in these studies. The current study focuses on addressing this in an fMRI study of Theory-of-Mind in 15 high-functioning adolescents and adults with autism (ASD and 15 typically developing (TD controls. Participants viewed a series of comic strip vignettes in the MRI scanner and were asked to choose the most logical end to the story from three alternatives, separately for trials involving physical and intentional causality. Causal brain connectivity obtained from a multivariate autoregressive model, along with assessment scores, functional connectivity values, and fractional anisotropy obtained from DTI data for each participant, were submitted to a recursive cluster elimination based support vector machine classifier to determine the accuracy with which the classifier can predict a novel participant’s group membership (ASD or TD. We found a maximum classification accuracy of 95.9 % with 19 features which had the highest discriminative ability between the groups. All of the 19 features were effective connectivity paths, indicating that causal information may be critical in discriminating between ASD and TD groups. These effective connectivity paths were also found to be significantly greater in controls as compared to ASD participants and consisted predominantly of outputs from the fusiform face area and middle temporal gyrus indicating impaired connectivity in ASD participants, particularly in the social brain areas. These findings collectively point towards the fact that alterations in causal brain connectivity in individuals with ASD could serve as a potential non-invasive neuroimaging signature for autism

Identification of Complex Dynamical Systems with Neural Networks (2/2)

CERN Multimedia

CERN. Geneva

2016-01-01

The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...

Identification of Complex Dynamical Systems with Neural Networks (1/2)

CERN Multimedia

CERN. Geneva

2016-01-01

The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...

Motor sequence learning-induced neural efficiency in functional brain connectivity.

Science.gov (United States)

Karim, Helmet T; Huppert, Theodore J; Erickson, Kirk I; Wollam, Mariegold E; Sparto, Patrick J; Sejdić, Ervin; VanSwearingen, Jessie M

2017-02-15

Previous studies have shown the functional neural circuitry differences before and after an explicitly learned motor sequence task, but have not assessed these changes during the process of motor skill learning. Functional magnetic resonance imaging activity was measured while participants (n=13) were asked to tap their fingers to visually presented sequences in blocks that were either the same sequence repeated (learning block) or random sequences (control block). Motor learning was associated with a decrease in brain activity during learning compared to control. Lower brain activation was noted in the posterior parietal association area and bilateral thalamus during the later periods of learning (not during the control). Compared to the control condition, we found the task-related motor learning was associated with decreased connectivity between the putamen and left inferior frontal gyrus and left middle cingulate brain regions. Motor learning was associated with changes in network activity, spatial extent, and connectivity. Copyright © 2016 Elsevier B.V. All rights reserved.

Musical Audio Synthesis Using Autoencoding Neural Nets

OpenAIRE

Sarroff, Andy; Casey, Michael A.

2014-01-01

With an optimal network topology and tuning of hyperpa-\\ud rameters, artificial neural networks (ANNs) may be trained\\ud to learn a mapping from low level audio features to one\\ud or more higher-level representations. Such artificial neu-\\ud ral networks are commonly used in classification and re-\\ud gression settings to perform arbitrary tasks. In this work\\ud we suggest repurposing autoencoding neural networks as\\ud musical audio synthesizers. We offer an interactive musi-\\ud cal audio synt...

Neural correlate of resting-state functional connectivity under α2 adrenergic receptor agonist, medetomidine.

Science.gov (United States)

Nasrallah, Fatima A; Lew, Si Kang; Low, Amanda Si-Min; Chuang, Kai-Hsiang

2014-01-01

Correlative fluctuations in functional MRI (fMRI) signals across the brain at rest have been taken as a measure of functional connectivity, but the neural basis of this resting-state MRI (rsMRI) signal is not clear. Previously, we found that the α2 adrenergic agonist, medetomidine, suppressed the rsMRI correlation dose-dependently but not the stimulus evoked activation. To understand the underlying electrophysiology and neurovascular coupling, which might be altered due to the vasoconstrictive nature of medetomidine, somatosensory evoked potential (SEP) and resting electroencephalography (EEG) were measured and correlated with corresponding BOLD signals in rat brains under three dosages of medetomidine. The SEP elicited by electrical stimulation to both forepaws was unchanged regardless of medetomidine dosage, which was consistent with the BOLD activation. Identical relationship between the SEP and BOLD signal under different medetomidine dosages indicates that the neurovascular coupling was not affected. Under resting state, EEG power was the same but a depression of inter-hemispheric EEG coherence in the gamma band was observed at higher medetomidine dosage. Different from medetomidine, both resting EEG power and BOLD power and coherence were significantly suppressed with increased isoflurane level. Such reduction was likely due to suppressed neural activity as shown by diminished SEP and BOLD activation under isoflurane, suggesting different mechanisms of losing synchrony at resting-state. Even though, similarity between electrophysiology and BOLD under stimulation and resting-state implicates a tight neurovascular coupling in both medetomidine and isoflurane. Our results confirm that medetomidine does not suppress neural activity but dissociates connectivity in the somatosensory cortex. The differential effect of medetomidine and its receptor specific action supports the neuronal origin of functional connectivity and implicates the mechanism of its sedative

Joint multiple fully connected convolutional neural network with extreme learning machine for hepatocellular carcinoma nuclei grading.

Science.gov (United States)

Li, Siqi; Jiang, Huiyan; Pang, Wenbo

2017-05-01

Accurate cell grading of cancerous tissue pathological image is of great importance in medical diagnosis and treatment. This paper proposes a joint multiple fully connected convolutional neural network with extreme learning machine (MFC-CNN-ELM) architecture for hepatocellular carcinoma (HCC) nuclei grading. First, in preprocessing stage, each grayscale image patch with the fixed size is obtained using center-proliferation segmentation (CPS) method and the corresponding labels are marked under the guidance of three pathologists. Next, a multiple fully connected convolutional neural network (MFC-CNN) is designed to extract the multi-form feature vectors of each input image automatically, which considers multi-scale contextual information of deep layer maps sufficiently. After that, a convolutional neural network extreme learning machine (CNN-ELM) model is proposed to grade HCC nuclei. Finally, a back propagation (BP) algorithm, which contains a new up-sample method, is utilized to train MFC-CNN-ELM architecture. The experiment comparison results demonstrate that our proposed MFC-CNN-ELM has superior performance compared with related works for HCC nuclei grading. Meanwhile, external validation using ICPR 2014 HEp-2 cell dataset shows the good generalization of our MFC-CNN-ELM architecture. Copyright © 2017 Elsevier Ltd. All rights reserved.

The gamma model : a new neural network for temporal processing

NARCIS (Netherlands)

Vries, de B.

1992-01-01

In this paper we develop the gamma neural model, a new neural net architecture for processing of temporal patterns. Time varying patterns are normally segmented into a sequence of static patterns that are successively presented to a neural net. In the approach presented here segmentation is avoided.

Quantum net dynamics

International Nuclear Information System (INIS)

Finkelstein, D.

1989-01-01

The quantum net unifies the basic principles of quantum theory and relativity in a quantum spacetime having no ultraviolet infinities, supporting the Dirac equation, and having the usual vacuum as a quantum condensation. A correspondence principle connects nets to Schwinger sources and further unifies the vertical structure of the theory, so that the functions of the many hierarchic levels of quantum field theory (predicate algebra, set theory, topology,hor-ellipsis, quantum dynamics) are served by one in quantum net dynamics

Chimera states in brain networks: Empirical neural vs. modular fractal connectivity

Science.gov (United States)

Chouzouris, Teresa; Omelchenko, Iryna; Zakharova, Anna; Hlinka, Jaroslav; Jiruska, Premysl; Schöll, Eckehard

2018-04-01

Complex spatiotemporal patterns, called chimera states, consist of coexisting coherent and incoherent domains and can be observed in networks of coupled oscillators. The interplay of synchrony and asynchrony in complex brain networks is an important aspect in studies of both the brain function and disease. We analyse the collective dynamics of FitzHugh-Nagumo neurons in complex networks motivated by its potential application to epileptology and epilepsy surgery. We compare two topologies: an empirical structural neural connectivity derived from diffusion-weighted magnetic resonance imaging and a mathematically constructed network with modular fractal connectivity. We analyse the properties of chimeras and partially synchronized states and obtain regions of their stability in the parameter planes. Furthermore, we qualitatively simulate the dynamics of epileptic seizures and study the influence of the removal of nodes on the network synchronizability, which can be useful for applications to epileptic surgery.

ANT Advanced Neural Tool

Energy Technology Data Exchange (ETDEWEB)

Labrador, I.; Carrasco, R.; Martinez, L.

1996-07-01

This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs.

ANT Advanced Neural Tool

International Nuclear Information System (INIS)

Labrador, I.; Carrasco, R.; Martinez, L.

1996-01-01

This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs

Neural networks for aircraft control

Science.gov (United States)

Linse, Dennis

1990-01-01

Current research in Artificial Neural Networks indicates that networks offer some potential advantages in adaptation and fault tolerance. This research is directed at determining the possible applicability of neural networks to aircraft control. The first application will be to aircraft trim. Neural network node characteristics, network topology and operation, neural network learning and example histories using neighboring optimal control with a neural net are discussed.

Computational neuroanatomy: ontology-based representation of neural components and connectivity.

Science.gov (United States)

Rubin, Daniel L; Talos, Ion-Florin; Halle, Michael; Musen, Mark A; Kikinis, Ron

2009-02-05

A critical challenge in neuroscience is organizing, managing, and accessing the explosion in neuroscientific knowledge, particularly anatomic knowledge. We believe that explicit knowledge-based approaches to make neuroscientific knowledge computationally accessible will be helpful in tackling this challenge and will enable a variety of applications exploiting this knowledge, such as surgical planning. We developed ontology-based models of neuroanatomy to enable symbolic lookup, logical inference and mathematical modeling of neural systems. We built a prototype model of the motor system that integrates descriptive anatomic and qualitative functional neuroanatomical knowledge. In addition to modeling normal neuroanatomy, our approach provides an explicit representation of abnormal neural connectivity in disease states, such as common movement disorders. The ontology-based representation encodes both structural and functional aspects of neuroanatomy. The ontology-based models can be evaluated computationally, enabling development of automated computer reasoning applications. Neuroanatomical knowledge can be represented in machine-accessible format using ontologies. Computational neuroanatomical approaches such as described in this work could become a key tool in translational informatics, leading to decision support applications that inform and guide surgical planning and personalized care for neurological disease in the future.

Neural electrical activity and neural network growth.

Science.gov (United States)

Gafarov, F M

2018-05-01

The development of central and peripheral neural system depends in part on the emergence of the correct functional connectivity in its input and output pathways. Now it is generally accepted that molecular factors guide neurons to establish a primary scaffold that undergoes activity-dependent refinement for building a fully functional circuit. However, a number of experimental results obtained recently shows that the neuronal electrical activity plays an important role in the establishing of initial interneuronal connections. Nevertheless, these processes are rather difficult to study experimentally, due to the absence of theoretical description and quantitative parameters for estimation of the neuronal activity influence on growth in neural networks. In this work we propose a general framework for a theoretical description of the activity-dependent neural network growth. The theoretical description incorporates a closed-loop growth model in which the neural activity can affect neurite outgrowth, which in turn can affect neural activity. We carried out the detailed quantitative analysis of spatiotemporal activity patterns and studied the relationship between individual cells and the network as a whole to explore the relationship between developing connectivity and activity patterns. The model, developed in this work will allow us to develop new experimental techniques for studying and quantifying the influence of the neuronal activity on growth processes in neural networks and may lead to a novel techniques for constructing large-scale neural networks by self-organization. Copyright © 2018 Elsevier Ltd. All rights reserved.

Neural network regulation driven by autonomous neural firings

Science.gov (United States)

Cho, Myoung Won

2016-07-01

Biological neurons naturally fire spontaneously due to the existence of a noisy current. Such autonomous firings may provide a driving force for network formation because synaptic connections can be modified due to neural firings. Here, we study the effect of autonomous firings on network formation. For the temporally asymmetric Hebbian learning, bidirectional connections lose their balance easily and become unidirectional ones. Defining the difference between reciprocal connections as new variables, we could express the learning dynamics as if Ising model spins interact with each other in magnetism. We present a theoretical method to estimate the interaction between the new variables in a neural system. We apply the method to some network systems and find some tendencies of autonomous neural network regulation.

NetTurnP – Neural Network Prediction of Beta-turns by Use of Evolutionary Information and Predicted Protein Sequence Features

Science.gov (United States)

Petersen, Bent; Lundegaard, Claus; Petersen, Thomas Nordahl

2010-01-01

β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino acid sequence. The individual β-turn types I, I', II, II', VIII, VIa1, VIa2, VIba and IV have been predicted based on classifications by PROMOTIF, and the two-class prediction of β-turn or not is a superset comprised of all β-turn types. The performance is evaluated using a golden set of non-homologous sequences known as BT426. Our two-class prediction method achieves a performance of: MCC  = 0.50, Qtotal = 82.1%, sensitivity  = 75.6%, PPV  = 68.8% and AUC  = 0.864. We have compared our performance to eleven other prediction methods that obtain Matthews correlation coefficients in the range of 0.17 – 0.47. For the type specific β-turn predictions, only type I and II can be predicted with reasonable Matthews correlation coefficients, where we obtain performance values of 0.36 and 0.31, respectively. Conclusion The NetTurnP method has been implemented as a webserver, which is freely available at http://www.cbs.dtu.dk/services/NetTurnP/. NetTurnP is the only available webserver that allows submission of multiple sequences. PMID:21152409

Schema generation in recurrent neural nets for intercepting a moving target.

Science.gov (United States)

Fleischer, Andreas G

2010-06-01

The grasping of a moving object requires the development of a motor strategy to anticipate the trajectory of the target and to compute an optimal course of interception. During the performance of perception-action cycles, a preprogrammed prototypical movement trajectory, a motor schema, may highly reduce the control load. Subjects were asked to hit a target that was moving along a circular path by means of a cursor. Randomized initial target positions and velocities were detected in the periphery of the eyes, resulting in a saccade toward the target. Even when the target disappeared, the eyes followed the target's anticipated course. The Gestalt of the trajectories was dependent on target velocity. The prediction capability of the motor schema was investigated by varying the visibility range of cursor and target. Motor schemata were determined to be of limited precision, and therefore visual feedback was continuously required to intercept the moving target. To intercept a target, the motor schema caused the hand to aim ahead and to adapt to the target trajectory. The control of cursor velocity determined the point of interception. From a modeling point of view, a neural network was developed that allowed the implementation of a motor schema interacting with feedback control in an iterative manner. The neural net of the Wilson type consists of an excitation-diffusion layer allowing the generation of a moving bubble. This activation bubble runs down an eye-centered motor schema and causes a planar arm model to move toward the target. A bubble provides local integration and straightening of the trajectory during repetitive moves. The schema adapts to task demands by learning and serves as forward controller. On the basis of these model considerations the principal problem of embedding motor schemata in generalized control strategies is discussed.

A Novel Neural Network Vector Control for Single-Phase Grid-Connected Converters with L, LC and LCL Filters

Directory of Open Access Journals (Sweden)

Xingang Fu

2016-04-01

Full Text Available This paper investigates a novel recurrent neural network (NN-based vector control approach for single-phase grid-connected converters (GCCs with L (inductor, LC (inductor-capacitor and LCL (inductor-capacitor-inductor filters and provides their comparison study with the conventional standard vector control method. A single neural network controller replaces two current-loop PI controllers, and the NN training approximates the optimal control for the single-phase GCC system. The Levenberg–Marquardt (LM algorithm was used to train the NN controller based on the complete system equations without any decoupling policies. The proposed NN approach can solve the decoupling problem associated with the conventional vector control methods for L, LC and LCL-filter-based single-phase GCCs. Both simulation study and hardware experiments demonstrate that the neural network vector controller shows much more improved performance than that of conventional vector controllers, including faster response speed and lower overshoot. Especially, NN vector control could achieve very good performance using low switch frequency. More importantly, the neural network vector controller is a damping free controller, which is generally required by a conventional vector controller for an LCL-filter-based single-phase grid-connected converter and, therefore, can overcome the inefficiency problem caused by damping policies.

Larger bases and mixed analog/digital neural nets

Energy Technology Data Exchange (ETDEWEB)

Beiu, V.

1998-12-31

The paper overviews results dealing with the approximation capabilities of neural networks, and bounds on the size of threshold gate circuits. Based on an explicit numerical algorithm for Kolmogorov`s superpositions the authors show that minimum size neural networks--for implementing any Boolean function--have the identity function as the activation function. Conclusions and several comments on the required precision are ending the paper.

Altered neural connectivity during response inhibition in adolescents with attention-deficit/hyperactivity disorder and their unaffected siblings

NARCIS (Netherlands)

van Rooij, Daan; Hartman, Catharina A.; Mennes, Maarten; Oosterlaan, Jaap; Franke, Barbara; Rommelse, Nanda; Heslenfeld, Dirk; Faraone, Stephen V.; Buitelaar, Jan K.; Hoekstra, Pieter J.

2015-01-01

Introduction: Response inhibition is one of the executive functions impaired in attention-deficit/hyperactivity disorder (ADHD). Increasing evidence indicates that altered functional and structural neural connectivity are part of the neurobiological basis of ADHD. Here, we investigated if

2D neural hardware versus 3D biological ones

Energy Technology Data Exchange (ETDEWEB)

Beiu, V.

1998-12-31

This paper will present important limitations of hardware neural nets as opposed to biological neural nets (i.e. the real ones). The author starts by discussing neural structures and their biological inspirations, while mentioning the simplifications leading to artificial neural nets. Going further, the focus will be on hardware constraints. The author will present recent results for three different alternatives of implementing neural networks: digital, threshold gate, and analog, while the area and the delay will be related to neurons' fan-in and weights' precision. Based on all of these, it will be shown why hardware implementations cannot cope with their biological inspiration with respect to their power of computation: the mapping onto silicon lacking the third dimension of biological nets. This translates into reduced fan-in, and leads to reduced precision. The main conclusion is that one is faced with the following alternatives: (1) try to cope with the limitations imposed by silicon, by speeding up the computation of the elementary silicon neurons; (2) investigate solutions which would allow one to use the third dimension, e.g. using optical interconnections.

Do neural nets learn statistical laws behind natural language?

Directory of Open Access Journals (Sweden)

Shuntaro Takahashi

Full Text Available The performance of deep learning in natural language processing has been spectacular, but the reasons for this success remain unclear because of the inherent complexity of deep learning. This paper provides empirical evidence of its effectiveness and of a limitation of neural networks for language engineering. Precisely, we demonstrate that a neural language model based on long short-term memory (LSTM effectively reproduces Zipf's law and Heaps' law, two representative statistical properties underlying natural language. We discuss the quality of reproducibility and the emergence of Zipf's law and Heaps' law as training progresses. We also point out that the neural language model has a limitation in reproducing long-range correlation, another statistical property of natural language. This understanding could provide a direction for improving the architectures of neural networks.

High level cognitive information processing in neural networks

Science.gov (United States)

Barnden, John A.; Fields, Christopher A.

1992-01-01

Two related research efforts were addressed: (1) high-level connectionist cognitive modeling; and (2) local neural circuit modeling. The goals of the first effort were to develop connectionist models of high-level cognitive processes such as problem solving or natural language understanding, and to understand the computational requirements of such models. The goals of the second effort were to develop biologically-realistic model of local neural circuits, and to understand the computational behavior of such models. In keeping with the nature of NASA's Innovative Research Program, all the work conducted under the grant was highly innovative. For instance, the following ideas, all summarized, are contributions to the study of connectionist/neural networks: (1) the temporal-winner-take-all, relative-position encoding, and pattern-similarity association techniques; (2) the importation of logical combinators into connection; (3) the use of analogy-based reasoning as a bridge across the gap between the traditional symbolic paradigm and the connectionist paradigm; and (4) the application of connectionism to the domain of belief representation/reasoning. The work on local neural circuit modeling also departs significantly from the work of related researchers. In particular, its concentration on low-level neural phenomena that could support high-level cognitive processing is unusual within the area of biological local circuit modeling, and also serves to expand the horizons of the artificial neural net field.

Effects of small-world connectivity on noise-induced temporal and spatial order in neural media

International Nuclear Information System (INIS)

Perc, Matjaz

2007-01-01

We present an overview of possible effects of small-world connectivity on noise-induced temporal and spatial order in a two-dimensional network of excitable neural media with FitzHugh-Nagumo local dynamics. Small-world networks are characterized by a given fraction of so-called long-range couplings or shortcut links that connect distant units of the system, while all other units are coupled in a diffusive-like manner. Interestingly, already a small fraction of these long-range couplings can have wide-ranging effects on the temporal as well as spatial noise-induced dynamics of the system. Here we present two main effects. First, we show that the temporal order, characterized by the autocorrelation of a firing-rate function, can be greatly enhanced by the introduction of small-world connectivity, whereby the effect increases with the increasing fraction of introduced shortcut links. Second, we show that the introduction of long-range couplings induces disorder of otherwise ordered, spiral-wave-like, noise-induced patterns that can be observed by exclusive diffusive connectivity of spatial units. Thereby, already a small fraction of shortcut links is sufficient to destroy coherent pattern formation in the media. Although the two results seem contradictive, we provide an explanation considering the inherent scale-free nature of small-world networks, which on one hand, facilitates signal transduction and thus temporal order in the system, whilst on the other hand, disrupts the internal spatial scale of the media thereby hindering the existence of coherent wave-like patterns. Additionally, the importance of spatially versus temporally ordered neural network functioning is discussed

QED representation for the net of causal loops

Science.gov (United States)

Ciolli, Fabio; Ruzzi, Giuseppe; Vasselli, Ezio

2015-06-01

The present work tackles the existence of local gauge symmetries in the setting of Algebraic Quantum Field Theory (AQFT). The net of causal loops, previously introduced by the authors, is a model independent construction of a covariant net of local C*-algebras on any 4-dimensional globally hyperbolic space-time, aimed to capture structural properties of any reasonable quantum gauge theory. Representations of this net can be described by causal and covariant connection systems, and local gauge transformations arise as maps between equivalent connection systems. The present paper completes these abstract results, realizing QED as a representation of the net of causal loops in Minkowski space-time. More precisely, we map the quantum electromagnetic field Fμν, not free in general, into a representation of the net of causal loops and show that the corresponding connection system and the local gauge transformations find a counterpart in terms of Fμν.

IrisDenseNet: Robust Iris Segmentation Using Densely Connected Fully Convolutional Networks in the Images by Visible Light and Near-Infrared Light Camera Sensors.

Science.gov (United States)

Arsalan, Muhammad; Naqvi, Rizwan Ali; Kim, Dong Seop; Nguyen, Phong Ha; Owais, Muhammad; Park, Kang Ryoung

2018-05-10

The recent advancements in computer vision have opened new horizons for deploying biometric recognition algorithms in mobile and handheld devices. Similarly, iris recognition is now much needed in unconstraint scenarios with accuracy. These environments make the acquired iris image exhibit occlusion, low resolution, blur, unusual glint, ghost effect, and off-angles. The prevailing segmentation algorithms cannot cope with these constraints. In addition, owing to the unavailability of near-infrared (NIR) light, iris recognition in visible light environment makes the iris segmentation challenging with the noise of visible light. Deep learning with convolutional neural networks (CNN) has brought a considerable breakthrough in various applications. To address the iris segmentation issues in challenging situations by visible light and near-infrared light camera sensors, this paper proposes a densely connected fully convolutional network (IrisDenseNet), which can determine the true iris boundary even with inferior-quality images by using better information gradient flow between the dense blocks. In the experiments conducted, five datasets of visible light and NIR environments were used. For visible light environment, noisy iris challenge evaluation part-II (NICE-II selected from UBIRIS.v2 database) and mobile iris challenge evaluation (MICHE-I) datasets were used. For NIR environment, the institute of automation, Chinese academy of sciences (CASIA) v4.0 interval, CASIA v4.0 distance, and IIT Delhi v1.0 iris datasets were used. Experimental results showed the optimal segmentation of the proposed IrisDenseNet and its excellent performance over existing algorithms for all five datasets.

IrisDenseNet: Robust Iris Segmentation Using Densely Connected Fully Convolutional Networks in the Images by Visible Light and Near-Infrared Light Camera Sensors

Directory of Open Access Journals (Sweden)

Muhammad Arsalan

2018-05-01

Full Text Available The recent advancements in computer vision have opened new horizons for deploying biometric recognition algorithms in mobile and handheld devices. Similarly, iris recognition is now much needed in unconstraint scenarios with accuracy. These environments make the acquired iris image exhibit occlusion, low resolution, blur, unusual glint, ghost effect, and off-angles. The prevailing segmentation algorithms cannot cope with these constraints. In addition, owing to the unavailability of near-infrared (NIR light, iris recognition in visible light environment makes the iris segmentation challenging with the noise of visible light. Deep learning with convolutional neural networks (CNN has brought a considerable breakthrough in various applications. To address the iris segmentation issues in challenging situations by visible light and near-infrared light camera sensors, this paper proposes a densely connected fully convolutional network (IrisDenseNet, which can determine the true iris boundary even with inferior-quality images by using better information gradient flow between the dense blocks. In the experiments conducted, five datasets of visible light and NIR environments were used. For visible light environment, noisy iris challenge evaluation part-II (NICE-II selected from UBIRIS.v2 database and mobile iris challenge evaluation (MICHE-I datasets were used. For NIR environment, the institute of automation, Chinese academy of sciences (CASIA v4.0 interval, CASIA v4.0 distance, and IIT Delhi v1.0 iris datasets were used. Experimental results showed the optimal segmentation of the proposed IrisDenseNet and its excellent performance over existing algorithms for all five datasets.

Reconstruction of neutron spectra through neural networks

International Nuclear Information System (INIS)

Vega C, H.R.; Hernandez D, V.M.; Manzanares A, E.

2003-01-01

A neural network has been used to reconstruct the neutron spectra starting from the counting rates of the detectors of the Bonner sphere spectrophotometric system. A group of 56 neutron spectra was selected to calculate the counting rates that would produce in a Bonner sphere system, with these data and the spectra it was trained the neural network. To prove the performance of the net, 12 spectra were used, 6 were taken of the group used for the training, 3 were obtained of mathematical functions and those other 3 correspond to real spectra. When comparing the original spectra of those reconstructed by the net we find that our net has a poor performance when reconstructing monoenergetic spectra, this attributes it to those characteristic of the spectra used for the training of the neural network, however for the other groups of spectra the results of the net are appropriate with the prospective ones. (Author)

Tutorial on neural network applications in high energy physics: A 1992 perspective

International Nuclear Information System (INIS)

Denby, B.

1992-04-01

Feed forward and recurrent neural networks are introduced and related to standard data analysis tools. Tips are given on applications of neural nets to various areas of high energy physics. A review of applications within high energy physics and a summary of neural net hardware status are given

The effect of the neural activity on topological properties of growing neural networks.

Science.gov (United States)

Gafarov, F M; Gafarova, V R

2016-09-01

The connectivity structure in cortical networks defines how information is transmitted and processed, and it is a source of the complex spatiotemporal patterns of network's development, and the process of creation and deletion of connections is continuous in the whole life of the organism. In this paper, we study how neural activity influences the growth process in neural networks. By using a two-dimensional activity-dependent growth model we demonstrated the neural network growth process from disconnected neurons to fully connected networks. For making quantitative investigation of the network's activity influence on its topological properties we compared it with the random growth network not depending on network's activity. By using the random graphs theory methods for the analysis of the network's connections structure it is shown that the growth in neural networks results in the formation of a well-known "small-world" network.

Conservatism and the neural circuitry of threat: economic conservatism predicts greater amygdala–BNST connectivity during periods of threat vs safety

Science.gov (United States)

Muftuler, L Tugan; Larson, Christine L

2018-01-01

Abstract Political conservatism is associated with an increased negativity bias, including increased attention and reactivity toward negative and threatening stimuli. Although the human amygdala has been implicated in the response to threatening stimuli, no studies to date have investigated whether conservatism is associated with altered amygdala function toward threat. Furthermore, although an influential theory posits that connectivity between the amygdala and bed nucleus of the stria terminalis (BNST) is important in initiating the response to sustained or uncertain threat, whether individual differences in conservatism modulate this connectivity is unknown. To test whether conservatism is associated with increased reactivity in neural threat circuitry, we measured participants’ self-reported social and economic conservatism and asked them to complete high-resolution fMRI scans while under threat of an unpredictable shock and while safe. We found that economic conservatism predicted greater connectivity between the BNST and a cluster of voxels in the left amygdala during threat vs safety. These results suggest that increased amygdala–BNST connectivity during threat may be a key neural correlate of the enhanced negativity bias found in conservatism. PMID:29126127

Universal approximation in p-mean by neural networks

NARCIS (Netherlands)

Burton, R.M; Dehling, H.G

A feedforward neural net with d input neurons and with a single hidden layer of n neurons is given by [GRAPHICS] where a(j), theta(j), w(ji) is an element of R. In this paper we study the approximation of arbitrary functions f: R-d --> R by a neural net in an L-p(mu) norm for some finite measure mu

Understanding Net Zero Energy Buildings

DEFF Research Database (Denmark)

Salom, Jaume; Widén, Joakim; Candanedo, José

2011-01-01

Although several alternative definitions exist, a Net-Zero Energy Building (Net ZEB) can be succinctly described as a grid-connected building that generates as much energy as it uses over a year. The “net-zero” balance is attained by applying energy conservation and efficiency measures...... and by incorporating renewable energy systems. While based on annual balances, a complete description of a Net ZEB requires examining the system at smaller time-scales. This assessment should address: (a) the relationship between power generation and building loads and (b) the resulting interaction with the power grid...

A bat's ear view of neural nets in physics

International Nuclear Information System (INIS)

Denby, B.

1997-01-01

The use of neural networks in high energy physics has become a field of its own which now has been in existence for ten years. This paper attempts to draw some conclusions on the utility of neural networks for physics applications, and also to make some projections for the future of this line of research. (orig.)

The equilibrium of neural firing: A mathematical theory

Energy Technology Data Exchange (ETDEWEB)

Lan, Sizhong, E-mail: lsz@fuyunresearch.org [Fuyun Research, Beijing, 100055 (China)

2014-12-15

Inspired by statistical thermodynamics, we presume that neuron system has equilibrium condition with respect to neural firing. We show that, even with dynamically changeable neural connections, it is inevitable for neural firing to evolve to equilibrium. To study the dynamics between neural firing and neural connections, we propose an extended communication system where noisy channel has the tendency towards fixed point, implying that neural connections are always attracted into fixed points such that equilibrium can be reached. The extended communication system and its mathematics could be useful back in thermodynamics.

Goal-seeking neural net for recall and recognition

Science.gov (United States)

Omidvar, Omid M.

1990-07-01

Neural networks have been used to mimic cognitive processes which take place in animal brains. The learning capability inherent in neural networks makes them suitable candidates for adaptive tasks such as recall and recognition. The synaptic reinforcements create a proper condition for adaptation, which results in memorization, formation of perception, and higher order information processing activities. In this research a model of a goal seeking neural network is studied and the operation of the network with regard to recall and recognition is analyzed. In these analyses recall is defined as retrieval of stored information where little or no matching is involved. On the other hand recognition is recall with matching; therefore it involves memorizing a piece of information with complete presentation. This research takes the generalized view of reinforcement in which all the signals are potential reinforcers. The neuronal response is considered to be the source of the reinforcement. This local approach to adaptation leads to the goal seeking nature of the neurons as network components. In the proposed model all the synaptic strengths are reinforced in parallel while the reinforcement among the layers is done in a distributed fashion and pipeline mode from the last layer inward. A model of complex neuron with varying threshold is developed to account for inhibitory and excitatory behavior of real neuron. A goal seeking model of a neural network is presented. This network is utilized to perform recall and recognition tasks. The performance of the model with regard to the assigned tasks is presented.

The Uniframe .Net Web Service Discovery Service

National Research Council Canada - National Science Library

Berbeco, Robert W

2003-01-01

Microsoft .NET allows the creation of distributed systems in a seamless manner Within NET small, discrete applications, referred to as Web services, are utilized to connect to each other or larger applications...

Neural correlates and network connectivity underlying narrative production and comprehension: a combined fMRI and PET study.

Science.gov (United States)

AbdulSabur, Nuria Y; Xu, Yisheng; Liu, Siyuan; Chow, Ho Ming; Baxter, Miranda; Carson, Jessica; Braun, Allen R

2014-08-01

The neural correlates of narrative production and comprehension remain poorly understood. Here, using positron emission tomography (PET), functional magnetic resonance imaging (fMRI), contrast and functional network connectivity analyses we comprehensively characterize the neural mechanisms underlying these complex behaviors. Eighteen healthy subjects told and listened to fictional stories during scanning. In addition to traditional language areas (e.g., left inferior frontal and posterior middle temporal gyri), both narrative production and comprehension engaged regions associated with mentalizing and situation model construction (e.g., dorsomedial prefrontal cortex, precuneus and inferior parietal lobules) as well as neocortical premotor areas, such as the pre-supplementary motor area and left dorsal premotor cortex. Narrative comprehension alone showed marked bilaterality, activating right hemisphere homologs of perisylvian language areas. Narrative production remained predominantly left lateralized, uniquely activating executive and motor-related regions essential to language formulation and articulation. Connectivity analyses revealed strong associations between language areas and the superior and middle temporal gyri during both tasks. However, only during storytelling were these same language-related regions connected to cortical and subcortical motor regions. In contrast, during story comprehension alone, they were strongly linked to regions supporting mentalizing. Thus, when employed in a more complex, ecologically-valid context, language production and comprehension show both overlapping and idiosyncratic patterns of activation and functional connectivity. Importantly, in each case the language system is integrated with regions that support other cognitive and sensorimotor domains. Copyright © 2014. Published by Elsevier Ltd.

EnzyNet: enzyme classification using 3D convolutional neural networks on spatial representation.

Science.gov (United States)

Amidi, Afshine; Amidi, Shervine; Vlachakis, Dimitrios; Megalooikonomou, Vasileios; Paragios, Nikos; Zacharaki, Evangelia I

2018-01-01

During the past decade, with the significant progress of computational power as well as ever-rising data availability, deep learning techniques became increasingly popular due to their excellent performance on computer vision problems. The size of the Protein Data Bank (PDB) has increased more than 15-fold since 1999, which enabled the expansion of models that aim at predicting enzymatic function via their amino acid composition. Amino acid sequence, however, is less conserved in nature than protein structure and therefore considered a less reliable predictor of protein function. This paper presents EnzyNet, a novel 3D convolutional neural networks classifier that predicts the Enzyme Commission number of enzymes based only on their voxel-based spatial structure. The spatial distribution of biochemical properties was also examined as complementary information. The two-layer architecture was investigated on a large dataset of 63,558 enzymes from the PDB and achieved an accuracy of 78.4% by exploiting only the binary representation of the protein shape. Code and datasets are available at https://github.com/shervinea/enzynet.

Blanket testing in NET

International Nuclear Information System (INIS)

Chazalon, M.; Daenner, W.; Libin, B.

1989-01-01

The testing stages in NET for the performance assessment of the various breeding blanket concepts developed at the present time in Europe for DEMO (LiPb and ceramic blankets) and the requirements upon NET to perform these tests are reviewed. Typical locations available in NET for blanket testing are the central outboard segments and the horizontal ports of in-vessel sectors. These test positions will be connectable with external test loops. The number of test loops (helium, water, liquid metal) will be such that each major class of blankets can be tested in NET. The test positions, the boundary conditions and the external test loops are identified and the requirements for test blankets are summarized (author). 6

Conservatism and the neural circuitry of threat: economic conservatism predicts greater amygdala-BNST connectivity during periods of threat vs safety.

Science.gov (United States)

Pedersen, Walker S; Muftuler, L Tugan; Larson, Christine L

2018-01-01

Political conservatism is associated with an increased negativity bias, including increased attention and reactivity toward negative and threatening stimuli. Although the human amygdala has been implicated in the response to threatening stimuli, no studies to date have investigated whether conservatism is associated with altered amygdala function toward threat. Furthermore, although an influential theory posits that connectivity between the amygdala and bed nucleus of the stria terminalis (BNST) is important in initiating the response to sustained or uncertain threat, whether individual differences in conservatism modulate this connectivity is unknown. To test whether conservatism is associated with increased reactivity in neural threat circuitry, we measured participants' self-reported social and economic conservatism and asked them to complete high-resolution fMRI scans while under threat of an unpredictable shock and while safe. We found that economic conservatism predicted greater connectivity between the BNST and a cluster of voxels in the left amygdala during threat vs safety. These results suggest that increased amygdala-BNST connectivity during threat may be a key neural correlate of the enhanced negativity bias found in conservatism. © The Author (2017). Published by Oxford University Press.

Building a dynamically ASP.NET 2.0 GridView control

OpenAIRE

Catalin NACHILA

2008-01-01

Microsoft Visual Studio 2005 (based on ASP.NET 2.0), the successor to Visual Studio .NET 2003 has a lot of new features and goodies designed for Web developers. This article show how a ASP.NET 2.0 control can be dynamically connected to Microsoft Access database. The delete and update operation will be implemented using a GridView control and SQL queries. The connection between the database and the .NET application will be made with OleDb Data provider, the new Access Data Source control. The...

Minimal Edge-Transitive Nets for the Design and Construction of Metal-Organic Frameworks

KAUST Repository

Eddaoudi, Mohamed

2017-04-05

Highly-connected and minimal edge-transitive nets (with one or two kinds of edge) can be regarded as ideal blueprints for the rational design and construction of metal-organic frameworks (MOFs). Here we report and affirm the prominence of highly-connected nets as suitable targets in reticular chemistry for the design and synthesis of MOFs. Of special interest are augmented highly-connected binodal edge-transitive nets embedding a unique and precise positioning and connectivity of the net vertex figures, regarded as net-coded building units (net-cBUs). Explicitly, a definite net-cBU encompasses precise geometrical information that codes uniquely and matchlessly a selected net, a compelling perquisite for the rational design of MOFs. Interestingly, the double six-membered ring (d6R) building unit offers great prospective to be deployed as a net-cBU for the deliberate reticulation of the sole two edge-transitive nets with a vertex figure as a d6R, namely the (4,12)-coordinated shp net (square and hexagonal prism) and the (6,12)-coordinated alb net (aluminium diboride, hexagonal prism and trigonal prism). Conceivably, we envisioned and proposed various MOF structures based on the derived shp and alb nets. Gaining access to the requisite net-cBUs is essential for the successful practice of reticular chemistry; correspondingly organic and organic chemistries were deployed to afford concomitant molecular building blocks (MBBs) with the looked-for shape and connectivity. Practically, the combination of the 12-connected (12-c) rare-earth (RE) polynuclear, points of extension matching the 12 vertices of the hexagonal prism (d6R) with a 4-connected tetracarboxylate ligand or a 6-connected hexacarboxylate ligand afforded the targeted shp-MOF or alb-MOF, respectively. Intuitively, a dodecacarboxylate ligand can be conceived and purported as a compatible 12-c MBB, plausibly affording the positioning of the carbon centers of the twelve carboxylate groups on the vertices of the

ROOT.NET: Using ROOT from .NET languages like C# and F#

Science.gov (United States)

Watts, G.

2012-12-01

ROOT.NET provides an interface between Microsoft's Common Language Runtime (CLR) and .NET technology and the ubiquitous particle physics analysis tool, ROOT. ROOT.NET automatically generates a series of efficient wrappers around the ROOT API. Unlike pyROOT, these wrappers are statically typed and so are highly efficient as compared to the Python wrappers. The connection to .NET means that one gains access to the full series of languages developed for the CLR including functional languages like F# (based on OCaml). Many features that make ROOT objects work well in the .NET world are added (properties, IEnumerable interface, LINQ compatibility, etc.). Dynamic languages based on the CLR can be used as well, of course (Python, for example). Additionally it is now possible to access ROOT objects that are unknown to the translation tool. This poster will describe the techniques used to effect this translation, along with performance comparisons, and examples. All described source code is posted on the open source site CodePlex.

ROOT.NET: Using ROOT from .NET languages like C and F

International Nuclear Information System (INIS)

Watts, G

2012-01-01

ROOT.NET provides an interface between Microsoft's Common Language Runtime (CLR) and .NET technology and the ubiquitous particle physics analysis tool, ROOT. ROOT.NET automatically generates a series of efficient wrappers around the ROOT API. Unlike pyROOT, these wrappers are statically typed and so are highly efficient as compared to the Python wrappers. The connection to .NET means that one gains access to the full series of languages developed for the CLR including functional languages like F (based on OCaml). Many features that make ROOT objects work well in the .NET world are added (properties, IEnumerable interface, LINQ compatibility, etc.). Dynamic languages based on the CLR can be used as well, of course (Python, for example). Additionally it is now possible to access ROOT objects that are unknown to the translation tool. This poster will describe the techniques used to effect this translation, along with performance comparisons, and examples. All described source code is posted on the open source site CodePlex.

Transfer Learning with Convolutional Neural Networks for Classification of Abdominal Ultrasound Images.

Science.gov (United States)

Cheng, Phillip M; Malhi, Harshawn S

2017-04-01

The purpose of this study is to evaluate transfer learning with deep convolutional neural networks for the classification of abdominal ultrasound images. Grayscale images from 185 consecutive clinical abdominal ultrasound studies were categorized into 11 categories based on the text annotation specified by the technologist for the image. Cropped images were rescaled to 256 × 256 resolution and randomized, with 4094 images from 136 studies constituting the training set, and 1423 images from 49 studies constituting the test set. The fully connected layers of two convolutional neural networks based on CaffeNet and VGGNet, previously trained on the 2012 Large Scale Visual Recognition Challenge data set, were retrained on the training set. Weights in the convolutional layers of each network were frozen to serve as fixed feature extractors. Accuracy on the test set was evaluated for each network. A radiologist experienced in abdominal ultrasound also independently classified the images in the test set into the same 11 categories. The CaffeNet network classified 77.3% of the test set images accurately (1100/1423 images), with a top-2 accuracy of 90.4% (1287/1423 images). The larger VGGNet network classified 77.9% of the test set accurately (1109/1423 images), with a top-2 accuracy of VGGNet was 89.7% (1276/1423 images). The radiologist classified 71.7% of the test set images correctly (1020/1423 images). The differences in classification accuracies between both neural networks and the radiologist were statistically significant (p convolutional neural networks may be used to construct effective classifiers for abdominal ultrasound images.

Turkey's net energy consumption

International Nuclear Information System (INIS)

Soezen, Adnan; Arcaklioglu, Erol; Oezkaymak, Mehmet

2005-01-01

The main goal of this study is to develop the equations for forecasting net energy consumption (NEC) using an artificial neural-network (ANN) technique in order to determine the future level of energy consumption in Turkey. In this study, two different models were used in order to train the neural network. In one of them, population, gross generation, installed capacity and years are used in the input layer of the network (Model 1). Other energy sources are used in input layer of network (Model 2). The net energy consumption is in the output layer for two models. Data from 1975 to 2003 are used for the training. Three years (1981, 1994 and 2003) are used only as test data to confirm this method. The statistical coefficients of multiple determinations (R 2 -value) for training data are equal to 0.99944 and 0.99913 for Models 1 and 2, respectively. Similarly, R 2 values for testing data are equal to 0.997386 and 0.999558 for Models 1 and 2, respectively. According to the results, the net energy consumption using the ANN technique has been predicted with acceptable accuracy. Apart from reducing the whole time required, with the ANN approach, it is possible to find solutions that make energy applications more viable and thus more attractive to potential users. It is also expected that this study will be helpful in developing highly applicable energy policies

Neural Network for Image-to-Image Control of Optical Tweezers

Science.gov (United States)

Decker, Arthur J.; Anderson, Robert C.; Weiland, Kenneth E.; Wrbanek, Susan Y.

2004-01-01

A method is discussed for using neural networks to control optical tweezers. Neural-net outputs are combined with scaling and tiling to generate 480 by 480-pixel control patterns for a spatial light modulator (SLM). The SLM can be combined in various ways with a microscope to create movable tweezers traps with controllable profiles. The neural nets are intended to respond to scattered light from carbon and silicon carbide nanotube sensors. The nanotube sensors are to be held by the traps for manipulation and calibration. Scaling and tiling allow the 100 by 100-pixel maximum resolution of the neural-net software to be applied in stages to exploit the full 480 by 480-pixel resolution of the SLM. One of these stages is intended to create sensitive null detectors for detecting variations in the scattered light from the nanotube sensors.

An optimally evolved connective ratio of neural networks that maximizes the occurrence of synchronized bursting behavior

Science.gov (United States)

2012-01-01

Background Synchronized bursting activity (SBA) is a remarkable dynamical behavior in both ex vivo and in vivo neural networks. Investigations of the underlying structural characteristics associated with SBA are crucial to understanding the system-level regulatory mechanism of neural network behaviors. Results In this study, artificial pulsed neural networks were established using spike response models to capture fundamental dynamics of large scale ex vivo cortical networks. Network simulations with synaptic parameter perturbations showed the following two findings. (i) In a network with an excitatory ratio (ER) of 80-90%, its connective ratio (CR) was within a range of 10-30% when the occurrence of SBA reached the highest expectation. This result was consistent with the experimental observation in ex vivo neuronal networks, which were reported to possess a matured inhibitory synaptic ratio of 10-20% and a CR of 10-30%. (ii) No SBA occurred when a network does not contain any all-positive-interaction feedback loop (APFL) motif. In a neural network containing APFLs, the number of APFLs presented an optimal range corresponding to the maximal occurrence of SBA, which was very similar to the optimal CR. Conclusions In a neural network, the evolutionarily selected CR (10-30%) optimizes the occurrence of SBA, and APFL serves a pivotal network motif required to maximize the occurrence of SBA. PMID:22462685

MosquitoNet: investigating the use of UAV and artificial neural networks for integrated mosquito management

Science.gov (United States)

Case, E.; Ren, Y.; Shragai, T.; Erickson, D.

2017-12-01

Integrated mosquito control is expensive and resource intensive, and changing climatic factors are predicted to expand the habitable range of disease-carrying mosquitoes into new regions in the United States. Of particular concern in the northeastern United States are aedes albopictus, an aggressive, invasive species of mosquito that can transmit both native and exotic disease. Ae. albopictus prefer to live near human populations and breed in artificial containers with as little as two millimeters of standing water, exponentially increasing the difficulty of source control in suburban and urban areas. However, low-cost unmanned aerial vehicles (UAVs) can be used to photograph large regions at centimeter-resolution, and can image containers of interest in suburban neighborhoods. While proofs-of-concepts have been shown using UAVs to identify naturally occurring bodies of water, they have not been used to identify mosquito habitat in more populated areas. One of the primary challenges is that post-processing high-resolution aerial imagery is still time intensive, often labelled by hand or with programs built for satellite imagery. Artificial neural networks have been highly successful at image recognition tasks; in the past five years, convolutional neural networks (CNN) have surpassed or aided trained humans in identification of skin cancer, agricultural crops, and poverty levels from satellite imagery. MosquitoNet, a dual classifier built from the Single Shot Multibox Detector and VGG16 architectures, was trained on UAV­­­­­ aerial imagery taken during a larval study in Westchester County in southern New York State in July and August 2017. MosquitoNet was designed to assess the habitat risk of suburban properties by automating the identification and counting of containers like tires, toys, garbage bins, flower pots, etc. The SSD-based architecture marked small containers and other habitat indicators while the VGG16-based architecture classified the type of

Topology and computational performance of attractor neural networks

International Nuclear Information System (INIS)

McGraw, Patrick N.; Menzinger, Michael

2003-01-01

To explore the relation between network structure and function, we studied the computational performance of Hopfield-type attractor neural nets with regular lattice, random, small-world, and scale-free topologies. The random configuration is the most efficient for storage and retrieval of patterns by the network as a whole. However, in the scale-free case retrieval errors are not distributed uniformly among the nodes. The portion of a pattern encoded by the subset of highly connected nodes is more robust and efficiently recognized than the rest of the pattern. The scale-free network thus achieves a very strong partial recognition. The implications of these findings for brain function and social dynamics are suggestive

Comparisons of a Quantum Annealing and Classical Computer Neural Net Approach for Inferring Global Annual CO2 Fluxes over Land

Science.gov (United States)

Halem, M.; Radov, A.; Singh, D.

2017-12-01

Investigations of mid to high latitude atmospheric CO2 show growing amplitudes in seasonal variations over the past several decades. Recent high-resolution satellite measurements of CO2 concentration are now available for three years from the Orbiting Carbon Observatory-2. The Atmospheric Radiation Measurement (ARM) program of DOE has been making long-term CO2-flux measurements (in addition to CO2 concentration and an array of other meteorological quantities) at several towers and mobile sites located around the globe at half-hour frequencies. Recent papers have shown CO2 fluxes inferred by assimilating CO2 observations into ecosystem models are largely inconsistent with station observations. An investigation of how the biosphere has reacted to changes in atmospheric CO2 is essential to our understanding of potential climate-vegetation feedbacks. Thus, new approaches for calculating CO2-flux for assimilation into land surface models are necessary for improving the prediction of annual carbon uptake. In this study, we calculate and compare the predicted CO2 fluxes results employing a Feed Forward Backward Propagation Neural Network model on two architectures, (i) an IBM Minsky Computer node and (ii) a hybrid version of the ARC D-Wave quantum annealing computer. We compare the neural net results of predictions of CO2 flux from ARM station data for three different DOE ecosystem sites; an arid plains near Oklahoma City, a northern arctic site at Barrows AL, and a tropical rainforest site in the Amazon. Training times and predictive results for the calculating annual CO2 flux for the two architectures for each of the three sites are presented. Comparative results of predictions as measured by RMSE and MAE are discussed. Plots and correlations of observed vs predicted CO2 flux are also presented for all three sites. We show the estimated training times for quantum and classical calculations when extended to calculating global annual Carbon Uptake over land. We also

Residual Deep Convolutional Neural Network Predicts MGMT Methylation Status.

Science.gov (United States)

Korfiatis, Panagiotis; Kline, Timothy L; Lachance, Daniel H; Parney, Ian F; Buckner, Jan C; Erickson, Bradley J

2017-10-01

Predicting methylation of the O6-methylguanine methyltransferase (MGMT) gene status utilizing MRI imaging is of high importance since it is a predictor of response and prognosis in brain tumors. In this study, we compare three different residual deep neural network (ResNet) architectures to evaluate their ability in predicting MGMT methylation status without the need for a distinct tumor segmentation step. We found that the ResNet50 (50 layers) architecture was the best performing model, achieving an accuracy of 94.90% (+/- 3.92%) for the test set (classification of a slice as no tumor, methylated MGMT, or non-methylated). ResNet34 (34 layers) achieved 80.72% (+/- 13.61%) while ResNet18 (18 layers) accuracy was 76.75% (+/- 20.67%). ResNet50 performance was statistically significantly better than both ResNet18 and ResNet34 architectures (p deep neural architectures can be used to predict molecular biomarkers from routine medical images.

Building a dynamically ASP.NET 2.0 GridView control

Directory of Open Access Journals (Sweden)

Catalin NACHILA

2008-01-01

Full Text Available Microsoft Visual Studio 2005 (based on ASP.NET 2.0, the successor to Visual Studio .NET 2003 has a lot of new features and goodies designed for Web developers. This article show how a ASP.NET 2.0 control can be dynamically connected to Microsoft Access database. The delete and update operation will be implemented using a GridView control and SQL queries. The connection between the database and the .NET application will be made with OleDb Data provider, the new Access Data Source control. The SQL queries will be implemented with OleDbCommand.

On the connection between level of education and the neural circuitry of emotion perception

Directory of Open Access Journals (Sweden)

Liliana Ramona Demenescu

2014-10-01

Full Text Available Through education, a social group transmits accumulated knowledge, skills, customs, and values to its members. So far, to the best of our knowledge, the association between educational attainment and neural correlates of emotion processing has been left unexplored. In a retrospective analysis of the NESDA fMRI study, we compared two groups of fourteen healthy volunteers with intermediate and high educational attainment, matched for age and gender. The data concerned event-related functional magnetic resonance imaging of brain activation during perception of facial emotional expressions. The region of interest analysis showed stronger right amygdala activation to facial expressions in participants with lower relative to higher educational attainment. The psychophysiological interaction analysis revealed that participants with higher educational attainment exhibited stronger right amygdala – right insula connectivity during perception of emotional and neutral facial expressions. This exploratory study suggests the relevance of educational attainment on the neural mechanism of facial expression processing.

Age-related difference in the effective neural connectivity associated with probabilistic category learning

Energy Technology Data Exchange (ETDEWEB)

Yoon, Eun Jin; Cho, Sang Soo; Kim, Hee Jung; Bang, Seong Ae; Park, Hyun Soo; Kim, Yu Kyeong; Kim, Sang Eun [Seoul National Univ. College of Medicine, Seoul (Korea, Republic of)

2007-07-01

Although it is well known that explicit memory is affected by the deleterious changes in brain with aging, but effect of aging in implicit memory such as probabilistic category learning (PCL) is not clear. To identify the effect of aging on the neural interaction for successful PCL, we investigated the neural substrates of PCL and the age-related changes of the neural network between these brain regions. 23 young (age, 252 y; 11 males) and 14 elderly (673 y; 7 males) healthy subjects underwent FDG PET during a resting state and 150-trial weather prediction (WP) task. Correlations between the WP hit rates and regional glucose metabolism were assessed using SPM2 (P<0.05 uncorrected). For path analysis, seven brain regions (bilateral middle frontal gyri and putamen, left fusiform gyrus, anterior cingulate and right parahippocampal gyri) were selected based on the results of the correlation analysis. Model construction and path analysis processing were done by AMOS 5.0. The elderly had significantly lower total hit rates than the young (P<0.005). In the correlation analysis, both groups showed similar metabolic correlation in frontal and striatal area. But correlation in the medial temporal lobe (MTL) was found differently by group. In path analysis, the functional networks for the constructed model was accepted (X(2) =0.80, P=0.67) and it proved to be significantly different between groups (X{sub diff}(37) = 142.47, P<0.005), Systematic comparisons of each path revealed that frontal crosscallosal and the frontal to parahippocampal connection were most responsible for the model differences (P<0.05). For the successful PCL, the elderly recruits the basal ganglia implicit memory system but MTL recruitment differs from the young. The inadequate MTL correlation pattern in the elderly is may be caused by the changes of the neural pathway related with explicit memory. These neural changes can explain the decreased performance of PCL in elderly subjects.

Dynamic Changes in Amygdala Psychophysiological Connectivity Reveal Distinct Neural Networks for Facial Expressions of Basic Emotions.

Science.gov (United States)

Diano, Matteo; Tamietto, Marco; Celeghin, Alessia; Weiskrantz, Lawrence; Tatu, Mona-Karina; Bagnis, Arianna; Duca, Sergio; Geminiani, Giuliano; Cauda, Franco; Costa, Tommaso

2017-03-27

The quest to characterize the neural signature distinctive of different basic emotions has recently come under renewed scrutiny. Here we investigated whether facial expressions of different basic emotions modulate the functional connectivity of the amygdala with the rest of the brain. To this end, we presented seventeen healthy participants (8 females) with facial expressions of anger, disgust, fear, happiness, sadness and emotional neutrality and analyzed amygdala's psychophysiological interaction (PPI). In fact, PPI can reveal how inter-regional amygdala communications change dynamically depending on perception of various emotional expressions to recruit different brain networks, compared to the functional interactions it entertains during perception of neutral expressions. We found that for each emotion the amygdala recruited a distinctive and spatially distributed set of structures to interact with. These changes in amygdala connectional patters characterize the dynamic signature prototypical of individual emotion processing, and seemingly represent a neural mechanism that serves to implement the distinctive influence that each emotion exerts on perceptual, cognitive, and motor responses. Besides these differences, all emotions enhanced amygdala functional integration with premotor cortices compared to neutral faces. The present findings thus concur to reconceptualise the structure-function relation between brain-emotion from the traditional one-to-one mapping toward a network-based and dynamic perspective.

Nonequilibrium landscape theory of neural networks

Science.gov (United States)

Yan, Han; Zhao, Lei; Hu, Liang; Wang, Xidi; Wang, Erkang; Wang, Jin

2013-01-01

The brain map project aims to map out the neuron connections of the human brain. Even with all of the wirings mapped out, the global and physical understandings of the function and behavior are still challenging. Hopfield quantified the learning and memory process of symmetrically connected neural networks globally through equilibrium energy. The energy basins of attractions represent memories, and the memory retrieval dynamics is determined by the energy gradient. However, the realistic neural networks are asymmetrically connected, and oscillations cannot emerge from symmetric neural networks. Here, we developed a nonequilibrium landscape–flux theory for realistic asymmetrically connected neural networks. We uncovered the underlying potential landscape and the associated Lyapunov function for quantifying the global stability and function. We found the dynamics and oscillations in human brains responsible for cognitive processes and physiological rhythm regulations are determined not only by the landscape gradient but also by the flux. We found that the flux is closely related to the degrees of the asymmetric connections in neural networks and is the origin of the neural oscillations. The neural oscillation landscape shows a closed-ring attractor topology. The landscape gradient attracts the network down to the ring. The flux is responsible for coherent oscillations on the ring. We suggest the flux may provide the driving force for associations among memories. We applied our theory to rapid-eye movement sleep cycle. We identified the key regulation factors for function through global sensitivity analysis of landscape topography against wirings, which are in good agreements with experiments. PMID:24145451

Nonequilibrium landscape theory of neural networks.

Science.gov (United States)

Yan, Han; Zhao, Lei; Hu, Liang; Wang, Xidi; Wang, Erkang; Wang, Jin

2013-11-05

The brain map project aims to map out the neuron connections of the human brain. Even with all of the wirings mapped out, the global and physical understandings of the function and behavior are still challenging. Hopfield quantified the learning and memory process of symmetrically connected neural networks globally through equilibrium energy. The energy basins of attractions represent memories, and the memory retrieval dynamics is determined by the energy gradient. However, the realistic neural networks are asymmetrically connected, and oscillations cannot emerge from symmetric neural networks. Here, we developed a nonequilibrium landscape-flux theory for realistic asymmetrically connected neural networks. We uncovered the underlying potential landscape and the associated Lyapunov function for quantifying the global stability and function. We found the dynamics and oscillations in human brains responsible for cognitive processes and physiological rhythm regulations are determined not only by the landscape gradient but also by the flux. We found that the flux is closely related to the degrees of the asymmetric connections in neural networks and is the origin of the neural oscillations. The neural oscillation landscape shows a closed-ring attractor topology. The landscape gradient attracts the network down to the ring. The flux is responsible for coherent oscillations on the ring. We suggest the flux may provide the driving force for associations among memories. We applied our theory to rapid-eye movement sleep cycle. We identified the key regulation factors for function through global sensitivity analysis of landscape topography against wirings, which are in good agreements with experiments.

A Restricted Boltzman Neural Net to Infer Carbon Uptake from OCO-2 Satellite Data

Science.gov (United States)

Halem, M.; Dorband, J. E.; Radov, A.; Barr-Dallas, M.; Gentine, P.

2015-12-01

For several decades, scientists have been using satellite observations to infer climate budgets of terrestrial carbon uptake employing inverse methods in conjunction with ecosystem models and coupled global climate models. This is an extremely important Big Data calculation today since the net annual photosynthetic carbon uptake changes annually over land and removes on average ~20% of the emissions from human contributions to atmospheric loading of CO2 from fossil fuels. Unfortunately, such calculations have large uncertainties validated with in-situ networks of measuring stations across the globe. One difficulty in using satellite data for these budget calculations is that the models need to assimilate surface fluxes of CO2 as well as soil moisture, vegatation cover and the eddy covariance of latent and sensible heat to calculate the carbon fixed in the soil while satellite spectral observations only provide near surface concentrations of CO2. In July 2014, NASA successfully launched OCO-2 which provides 3km surface measurements of CO2 over land and oceans. We have collected nearly one year of Level 2 XCO2 data from the OCO-2 satellite for 3 sites of ~200 km2 at equatorial, temperate and high latitudes. Each selected site was part of the Fluxnet or ARM system with tower stations for measuring and collecting CO2 fluxes on an hourly basis, in addition to eddy transports of the other parameters. We are also planning to acquire the 4km NDVI products from MODIS and registering the data to the 3km XCO2 footprints for the three sites. We have implemented a restricted Boltzman machine on the quantum annealing D-Wave computer, a novel deep learning neural net, to be used for training with station data to infer CO2 fluxes from collocated XCO2, MODIS vegetative land cover and MERRA reanalysis surface exchange products. We will present performance assessments of the D-Wave Boltzman machine for generating XCO2 fluxes from the OCO-2 satellite observations for the 3 sites by

Fuzzy-neural network in the automatic detection and volumetry of the spleen on spiral CT scans

International Nuclear Information System (INIS)

Heitmann, K.R.; Mainz Univ.; Rueckert, S.; Heussel, C.P.; Thelen, M.; Kauczor, H.U.; Uthmann, T.

2000-01-01

Purpose: To assess spleen segmentation and volumetry in spiral CT scans with and without pathological changes of splenic tissue. Methods: The image analysis software HYBRIKON is based on region growing, self-organized neural nets, and fuzzy-anatomic rules. The neural nets were trained with spiral CT data from 10 patients, not used in the following evaluation on spiral CT scans from 19 patients. An experienced radiologist verified the results. The true positive and false positive areas were compared in terms to the areas marked by the radiologist. The results were compared with a standard thresholding method. Results: The neural nets achieved a higher accuracy than the thresholding method. Correlation coefficient of the fuzzy-neural nets: 0.99 (thresholding: 0.63). Mean true positive rate: 90% (thresholding: 75%), mean false positive rate: 5% (thresholding>100%). Pitfalls were caused by accessory spleens, extreme changes in the morphology (tumors, metastases, cysts), and parasplenic masses. Conclusions: Self-organizing neural nets combined with fuzzy rules are ready for use in the automatic detection and volumetry of the spleen in spiral CT scans. (orig.) [de

Tracting the neural basis of music: Deficient structural connectivity underlying acquired amusia.

Science.gov (United States)

Sihvonen, Aleksi J; Ripollés, Pablo; Särkämö, Teppo; Leo, Vera; Rodríguez-Fornells, Antoni; Saunavaara, Jani; Parkkola, Riitta; Soinila, Seppo

2017-12-01

Acquired amusia provides a unique opportunity to investigate the fundamental neural architectures of musical processing due to the transition from a functioning to defective music processing system. Yet, the white matter (WM) deficits in amusia remain systematically unexplored. To evaluate which WM structures form the neural basis for acquired amusia and its recovery, we studied 42 stroke patients longitudinally at acute, 3-month, and 6-month post-stroke stages using DTI [tract-based spatial statistics (TBSS) and deterministic tractography (DT)] and the Scale and Rhythm subtests of the Montreal Battery of Evaluation of Amusia (MBEA). Non-recovered amusia was associated with structural damage and subsequent degeneration in multiple WM tracts including the right inferior fronto-occipital fasciculus (IFOF), arcuate fasciculus (AF), inferior longitudinal fasciculus (ILF), uncinate fasciculus (UF), and frontal aslant tract (FAT), as well as in the corpus callosum (CC) and its posterior part (tapetum). In a linear regression analysis, the volume of the right IFOF was the main predictor of MBEA performance across time. Overall, our results provide a comprehensive picture of the large-scale deficits in intra- and interhemispheric structural connectivity underlying amusia, and conversely highlight which pathways are crucial for normal music perception. Copyright © 2017 Elsevier Ltd. All rights reserved.

Bootstrapped neural nets versus regression kriging in the digital mapping of pedological attributes: the automatic and time-consuming perspectives

Science.gov (United States)

Langella, Giuliano; Basile, Angelo; Bonfante, Antonello; Manna, Piero; Terribile, Fabio

2013-04-01

Digital soil mapping procedures are widespread used to build two-dimensional continuous maps about several pedological attributes. Our work addressed a regression kriging (RK) technique and a bootstrapped artificial neural network approach in order to evaluate and compare (i) the accuracy of prediction, (ii) the susceptibility of being included in automatic engines (e.g. to constitute web processing services), and (iii) the time cost needed for calibrating models and for making predictions. Regression kriging is maybe the most widely used geostatistical technique in the digital soil mapping literature. Here we tried to apply the EBLUP regression kriging as it is deemed to be the most statistically sound RK flavor by pedometricians. An unusual multi-parametric and nonlinear machine learning approach was accomplished, called BAGAP (Bootstrap aggregating Artificial neural networks with Genetic Algorithms and Principal component regression). BAGAP combines a selected set of weighted neural nets having specified characteristics to yield an ensemble response. The purpose of applying these two particular models is to ascertain whether and how much a more cumbersome machine learning method could be much promising in making more accurate/precise predictions. Being aware of the difficulty to handle objects based on EBLUP-RK as well as BAGAP when they are embedded in environmental applications, we explore the susceptibility of them in being wrapped within Web Processing Services. Two further kinds of aspects are faced for an exhaustive evaluation and comparison: automaticity and time of calculation with/without high performance computing leverage.

The principles of artificial neural network information processing

International Nuclear Information System (INIS)

Dai, Ru-Wei

1993-01-01

In this article, the basic structure of an artificial neuron is first introduced. In addition, principles of artificial neural network as well as several important artificial neural models such as Perceptron, Back propagation model, Hopfield net, and ART model are briefly discussed and analyzed. Finally, the application of artificial neural network for Chinese Character Recognition is also given. (author)

The principles of artificial neural network information processing

International Nuclear Information System (INIS)

Dai, Ru-Wei

1993-01-01

In this article, the basic structure of an artificial neuron is first introduced. In addition, principles of artificial neural network as well as several important artificial neural models such as perception, back propagation model, Hopfield net, and ART model are briefly discussed and analyzed. Finally the application of artificial neural network for Chinese character recognition is also given. (author)

Mutual Connectivity Analysis (MCA) Using Generalized Radial Basis Function Neural Networks for Nonlinear Functional Connectivity Network Recovery in Resting-State Functional MRI.

Science.gov (United States)

DSouza, Adora M; Abidin, Anas Zainul; Nagarajan, Mahesh B; Wismüller, Axel

2016-03-29

We investigate the applicability of a computational framework, called mutual connectivity analysis (MCA), for directed functional connectivity analysis in both synthetic and resting-state functional MRI data. This framework comprises of first evaluating non-linear cross-predictability between every pair of time series prior to recovering the underlying network structure using community detection algorithms. We obtain the non-linear cross-prediction score between time series using Generalized Radial Basis Functions (GRBF) neural networks. These cross-prediction scores characterize the underlying functionally connected networks within the resting brain, which can be extracted using non-metric clustering approaches, such as the Louvain method. We first test our approach on synthetic models with known directional influence and network structure. Our method is able to capture the directional relationships between time series (with an area under the ROC curve = 0.92 ± 0.037) as well as the underlying network structure (Rand index = 0.87 ± 0.063) with high accuracy. Furthermore, we test this method for network recovery on resting-state fMRI data, where results are compared to the motor cortex network recovered from a motor stimulation sequence, resulting in a strong agreement between the two (Dice coefficient = 0.45). We conclude that our MCA approach is effective in analyzing non-linear directed functional connectivity and in revealing underlying functional network structure in complex systems.

Optimal multiple-information integration inherent in a ring neural network

International Nuclear Information System (INIS)

Takiyama, Ken

2017-01-01

Although several behavioral experiments have suggested that our neural system integrates multiple sources of information based on the certainty of each type of information in the manner of maximum-likelihood estimation, it is unclear how the maximum-likelihood estimation is implemented in our neural system. Here, I investigate the relationship between maximum-likelihood estimation and a widely used ring-type neural network model that is used as a model of visual, motor, or prefrontal cortices. Without any approximation or ansatz, I analytically demonstrate that the equilibrium of an order parameter in the neural network model exactly corresponds to the maximum-likelihood estimation when the strength of the symmetrical recurrent synaptic connectivity within a neural population is appropriately stronger than that of asymmetrical connectivity, that of local and external inputs, and that of symmetrical or asymmetrical connectivity between different neural populations. In this case, strengths of local and external inputs or those of symmetrical connectivity between different neural populations exactly correspond to the input certainty in maximum-likelihood estimation. Thus, my analysis suggests appropriately strong symmetrical recurrent connectivity as a possible candidate for implementing the maximum-likelihood estimation within our neural system. (paper)

PathNet: a tool for pathway analysis using topological information

Directory of Open Access Journals (Sweden)

Dutta Bhaskar

2012-09-01

Full Text Available Abstract Background Identification of canonical pathways through enrichment of differentially expressed genes in a given pathway is a widely used method for interpreting gene lists generated from high-throughput experimental studies. However, most algorithms treat pathways as sets of genes, disregarding any inter- and intra-pathway connectivity information, and do not provide insights beyond identifying lists of pathways. Results We developed an algorithm (PathNet that utilizes the connectivity information in canonical pathway descriptions to help identify study-relevant pathways and characterize non-obvious dependencies and connections among pathways using gene expression data. PathNet considers both the differential expression of genes and their pathway neighbors to strengthen the evidence that a pathway is implicated in the biological conditions characterizing the experiment. As an adjunct to this analysis, PathNet uses the connectivity of the differentially expressed genes among all pathways to score pathway contextual associations and statistically identify biological relations among pathways. In this study, we used PathNet to identify biologically relevant results in two Alzheimer’s disease microarray datasets, and compared its performance with existing methods. Importantly, PathNet identified de-regulation of the ubiquitin-mediated proteolysis pathway as an important component in Alzheimer’s disease progression, despite the absence of this pathway in the standard enrichment analyses. Conclusions PathNet is a novel method for identifying enrichment and association between canonical pathways in the context of gene expression data. It takes into account topological information present in pathways to reveal biological information. PathNet is available as an R workspace image from http://www.bhsai.org/downloads/pathnet/.

Altered Immune Function Associated with Disordered Neural Connectivity and Executive Dysfunctions: A Neurophysiological Study on Children with Autism Spectrum Disorders

Science.gov (United States)

Han, Yvonne M. Y.; Chan, Agnes S.; Sze, Sophia L.; Cheung, Mei-Chun; Wong, Chun-kwok; Lam, Joseph M. K.; Poon, Priscilla M. K.

2013-01-01

Previous studies have shown that children with autism spectrum disorders (ASDs) have impaired executive function, disordered neural connectivity, and abnormal immunologic function. The present study examined whether these abnormalities were associated. Seventeen high-functioning (HFA) and 17 low-functioning (LFA) children with ASD, aged 8-17…

Neural nets for massively parallel optimization

Science.gov (United States)

Dixon, Laurence C. W.; Mills, David

1992-07-01

To apply massively parallel processing systems to the solution of large scale optimization problems it is desirable to be able to evaluate any function f(z), z (epsilon) Rn in a parallel manner. The theorem of Cybenko, Hecht Nielsen, Hornik, Stinchcombe and White, and Funahasi shows that this can be achieved by a neural network with one hidden layer. In this paper we address the problem of the number of nodes required in the layer to achieve a given accuracy in the function and gradient values at all points within a given n dimensional interval. The type of activation function needed to obtain nonsingular Hessian matrices is described and a strategy for obtaining accurate minimal networks presented.

LOGIC WITH EXCEPTION ON THE ALGEBRA OF FOURIER-DUAL OPERATIONS: NEURAL NET MECHANISM OF COGNITIVE DISSONANCE REDUCING

Directory of Open Access Journals (Sweden)

A. V. Pavlov

2014-01-01

Full Text Available A mechanism of cognitive dissonance reducing is demonstrated with approach for non-monotonic fuzzy-valued logics by Fourier-holography technique implementation developing. Cognitive dissonance occurs under perceiving of new information that contradicts to the existing subjective pattern of the outside world, represented by double Fourier-transform cascade with a hologram – neural layers interconnections matrix of inner information representation and logical conclusion. The hologram implements monotonic logic according to “General Modus Ponens” rule. New information is represented by a hologram of exclusion that implements interconnections of logical conclusion and exclusion for neural layers. The latter are linked by Fourier transform that determines duality of the algebra forming operations of conjunction and disjunction. Hologram of exclusion forms conclusion that is dual to the “General Modus Ponens” conclusion. It is shown, that trained for the main rule and exclusion system can be represented by two-layered neural network with separate interconnection matrixes for direct and inverse iterations. The network energy function is involved determining the cyclic dynamics character; dissipative factor causing convergence type of the dynamics is analyzed. Both “General Modus Ponens” and exclusion holograms recording conditions on the dynamics and convergence of the system are demonstrated. The system converges to a stable status, in which logical conclusion doesn’t depend on the inner information. Such kind of dynamics, leading to tolerance forming, is typical for ordinary kind of thinking, aimed at inner pattern of outside world stability. For scientific kind of thinking, aimed at adequacy of the inner pattern of the world, a mechanism is needed to stop the net relaxation; the mechanism has to be external relative to the model of logic. Computer simulation results for the learning conditions adequate to real holograms recording are

Control of 12-Cylinder Camless Engine with Neural Networks

OpenAIRE

Ashhab Moh’d Sami

2017-01-01

The 12-cyliner camless engine breathing process is modeled with artificial neural networks (ANN’s). The inputs to the net are the intake valve lift (IVL) and intake valve closing timing (IVC) whereas the output of the net is the cylinder air charge (CAC). The ANN is trained with data collected from an engine simulation model which is based on thermodynamics principles and calibrated against real engine data. A method for adapting single-output feed-forward neural networks is proposed and appl...

Competition and Cooperation in Neural Nets : U.S.-Japan Joint Seminar

CERN Document Server

Arbib, Michael

1982-01-01

The human brain, wi th its hundred billion or more neurons, is both one of the most complex systems known to man and one of the most important. The last decade has seen an explosion of experimental research on the brain, but little theory of neural networks beyond the study of electrical properties of membranes and small neural circuits. Nonetheless, a number of workers in Japan, the United States and elsewhere have begun to contribute to a theory which provides techniques of mathematical analysis and computer simulation to explore properties of neural systems containing immense numbers of neurons. Recently, it has been gradually recognized that rather independent studies of the dynamics of pattern recognition, pattern format::ion, motor control, self-organization, etc. , in neural systems do in fact make use of common methods. We find that a "competition and cooperation" type of interaction plays a fundamental role in parallel information processing in the brain. The present volume brings together 23 papers ...

Mode of effective connectivity within a putative neural network differentiates moral cognitions related to care and justice ethics.

Science.gov (United States)

Cáceda, Ricardo; James, G Andrew; Ely, Timothy D; Snarey, John; Kilts, Clinton D

2011-02-25

Moral sensitivity refers to the interpretive awareness of moral conflict and can be justice or care oriented. Justice ethics is associated primarily with human rights and the application of moral rules, whereas care ethics is related to human needs and a situational approach involving social emotions. Among the core brain regions involved in moral issue processing are: medial prefrontal cortex, anterior (ACC) and posterior (PCC) cingulate cortex, posterior superior temporal sulcus (pSTS), insula and amygdala. This study sought to inform the long standing debate of whether care and justice moral ethics represent one or two different forms of cognition. Model-free and model-based connectivity analysis were used to identify functional neural networks underlying care and justice ethics for a moral sensitivity task. In addition to modest differences in patterns of associated neural activity, distinct modes of functional and effective connectivity were observed for moral sensitivity for care and justice issues that were modulated by individual variation in moral ability. These results support a neurobiological differentiation between care and justice ethics and suggest that human moral behavior reflects the outcome of integrating opposing rule-based, self-other perspectives, and emotional responses.

NeMO-Net & Fluid Lensing: The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment Using Fluid Lensing Augmentation of NASA EOS Data

Science.gov (United States)

Chirayath, Ved

2018-01-01

We present preliminary results from NASA NeMO-Net, the first neural multi-modal observation and training network for global coral reef assessment. NeMO-Net is an open-source deep convolutional neural network (CNN) and interactive active learning training software in development which will assess the present and past dynamics of coral reef ecosystems. NeMO-Net exploits active learning and data fusion of mm-scale remotely sensed 3D images of coral reefs captured using fluid lensing with the NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as hyperspectral airborne remote sensing data from the ongoing NASA CORAL mission and lower-resolution satellite data to determine coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. Aquatic ecosystems, particularly coral reefs, remain quantitatively misrepresented by low-resolution remote sensing as a result of refractive distortion from ocean waves, optical attenuation, and remoteness. Machine learning classification of coral reefs using FluidCam mm-scale 3D data show that present satellite and airborne remote sensing techniques poorly characterize coral reef percent living cover, morphology type, and species breakdown at the mm, cm, and meter scales. Indeed, current global assessments of coral reef cover and morphology classification based on km-scale satellite data alone can suffer from segmentation errors greater than 40%, capable of change detection only on yearly temporal scales and decameter spatial scales, significantly hindering our understanding of patterns and processes in marine biodiversity at a time when these ecosystems are experiencing unprecedented anthropogenic pressures, ocean acidification, and sea surface temperature rise. NeMO-Net leverages our augmented machine learning algorithm that demonstrates data fusion of regional FluidCam (mm, cm-scale) airborne remote sensing with

Innervation of Extrahepatic Biliary Tract, With Special Reference to the Direct Bidirectional Neural Connections of the Gall Bladder, Sphincter of Oddi and Duodenum in Suncus murinus, in Whole-Mount Immunohistochemical Study.

Science.gov (United States)

Yi, S-Q; Ren, K; Kinoshita, M; Takano, N; Itoh, M; Ozaki, N

2016-06-01

Sphincter of Oddi dysfunction is one of the most important symptoms in post-cholecystectomy syndrome. Using either electrical or mechanical stimulation and retrogradely transported neuronal dyes, it has been demonstrated that there are direct neural pathways connecting gall bladder and the sphincter of Oddi in the Australian opossum and the golden hamster. In the present study, we employed whole-mount immunohistochemistry staining to observe and verify that there are two different plexuses of the extrahepatic biliary tract in Suncus murinus. One, named Pathway One, showed a fine, irregular but dense network plexus that ran adhesively and resided on/in the extrahepatic biliary tract wall, and the plexus extended into the intrahepatic area. On the other hand, named Pathway Two, exhibiting simple, thicker and straight neural bundles, ran parallel to the surface of the extrahepatic biliary tract and passed between the gall bladder and duodenum, but did not give off any branches to the liver. Pathway Two was considered to involve direct bidirectional neural connections between the duodenum and the biliary tract system. For the first time, morphologically, we demonstrated direct neural connections between gall bladder and duodenum in S. murinus. Malfunction of the sphincter of Oddi may be caused by injury of the direct neural pathways between gall bladder and duodenum by cholecystectomy. From the viewpoint of preserving the function of the major duodenal papilla and common bile duct, we emphasize the importance of avoiding kocherization of the common bile duct so as to preserve the direct neural connections between gall bladder and sphincter of Oddi. © 2015 Blackwell Verlag GmbH.

Results from a MA16-based neural trigger in an experiment looking for beauty

International Nuclear Information System (INIS)

Baldanza, C.; Beichter, J.; Bisi, F.; Bruels, N.; Bruschini, C.; Cotta-Ramusino, A.; D'Antone, I.; Malferrari, L.; Mazzanti, P.; Musico, P.; Novelli, P.; Odorici, F.; Odorico, R.; Passaseo, M.; Zuffa, M.

1996-01-01

Results from a neural-network trigger based on the digital MA16 chip of Siemens are reported. The neural trigger has been applied to data from the WA92 experiment, looking for beauty particles, which have been collected during a run in which a neural trigger module based on Intel's analog neural chip ETANN operated, as already reported. The MA16 board hosting the chip has a 16-bit I/O precision and a 53-bit precision for internal calculations. It operated at 50 MHz, yielding a response time for a 16 input-variable net of 3 μs for a Fisher discriminant (1-layer net) and of 6 μs for a 2-layer net. Results are compared with those previously obtained with the ETANN trigger. (orig.)

Results from a MA16-based neural trigger in an experiment looking for beauty

Energy Technology Data Exchange (ETDEWEB)

Baldanza, C. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Beichter, J. [Siemens AG, ZFE T ME2, 81730 Munich (Germany); Bisi, F. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Bruels, N. [Siemens AG, ZFE T ME2, 81730 Munich (Germany); Bruschini, C. [INFN/Genoa, Via Dodecaneso 33, 16146 Genoa (Italy); Cotta-Ramusino, A. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); D`Antone, I. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Malferrari, L. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Mazzanti, P. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Musico, P. [INFN/Genoa, Via Dodecaneso 33, 16146 Genoa (Italy); Novelli, P. [INFN/Genoa, Via Dodecaneso 33, 16146 Genoa (Italy); Odorici, F. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Odorico, R. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy); Passaseo, M. [CERN, 1211 Geneva 23 (Switzerland); Zuffa, M. [Istituto Nazionale di Fisica Nucleare, Bologna (Italy)

1996-07-11

Results from a neural-network trigger based on the digital MA16 chip of Siemens are reported. The neural trigger has been applied to data from the WA92 experiment, looking for beauty particles, which have been collected during a run in which a neural trigger module based on Intel`s analog neural chip ETANN operated, as already reported. The MA16 board hosting the chip has a 16-bit I/O precision and a 53-bit precision for internal calculations. It operated at 50 MHz, yielding a response time for a 16 input-variable net of 3 {mu}s for a Fisher discriminant (1-layer net) and of 6 {mu}s for a 2-layer net. Results are compared with those previously obtained with the ETANN trigger. (orig.).

Altered neural connectivity during response inhibition in adolescents with attention-deficit/hyperactivity disorder and their unaffected siblings.

Science.gov (United States)

van Rooij, Daan; Hartman, Catharina A; Mennes, Maarten; Oosterlaan, Jaap; Franke, Barbara; Rommelse, Nanda; Heslenfeld, Dirk; Faraone, Stephen V; Buitelaar, Jan K; Hoekstra, Pieter J

2015-01-01

Response inhibition is one of the executive functions impaired in attention-deficit/hyperactivity disorder (ADHD). Increasing evidence indicates that altered functional and structural neural connectivity are part of the neurobiological basis of ADHD. Here, we investigated if adolescents with ADHD show altered functional connectivity during response inhibition compared to their unaffected siblings and healthy controls. Response inhibition was assessed using the stop signal paradigm. Functional connectivity was assessed using psycho-physiological interaction analyses applied to BOLD time courses from seed regions within inferior- and superior frontal nodes of the response inhibition network. Resulting networks were compared between adolescents with ADHD (N = 185), their unaffected siblings (N = 111), and controls (N = 125). Control subjects showed stronger functional connectivity than the other two groups within the response inhibition network, while subjects with ADHD showed relatively stronger connectivity between default mode network (DMN) nodes. Stronger connectivity within the response inhibition network was correlated with lower ADHD severity, while stronger connectivity with the DMN was correlated with increased ADHD severity. Siblings showed connectivity patterns similar to controls during successful inhibition and to ADHD subjects during failed inhibition. Additionally, siblings showed decreased connectivity with the primary motor areas as compared to both participants with ADHD and controls. Subjects with ADHD fail to integrate activation within the response inhibition network and to inhibit connectivity with task-irrelevant regions. Unaffected siblings show similar alterations only during failed stop trials, as well as unique suppression of motor areas, suggesting compensatory strategies. These findings support the role of altered functional connectivity in understanding the neurobiology and familial transmission of ADHD.

A Lightweight TwiddleNet Portal

Science.gov (United States)

2008-03-01

dimensions of 2.8 x 0.7 x 4.6 inches make for a very good tool for TwiddleNet missions. Its Lithium -ion battery with 1200 mAh energy gives approximately...Wireless Connectivity IrDA, Bluetooth, IEEE 802.11b Battery Lithium ion Approximate Dimensions (in) 2.8 x 0.7 x 4.6 Weight (oz) 6.2 ROM 128 MB...designed to exploit the multiple networking modalities available in the current generation of smartphones . TwiddleNet enables well-organized and well

Automatic Railway Traffic Object Detection System Using Feature Fusion Refine Neural Network under Shunting Mode

Directory of Open Access Journals (Sweden)

Tao Ye

2018-06-01

Full Text Available Many accidents happen under shunting mode when the speed of a train is below 45 km/h. In this mode, train attendants observe the railway condition ahead using the traditional manual method and tell the observation results to the driver in order to avoid danger. To address this problem, an automatic object detection system based on convolutional neural network (CNN is proposed to detect objects ahead in shunting mode, which is called Feature Fusion Refine neural network (FR-Net. It consists of three connected modules, i.e., the depthwise-pointwise convolution, the coarse detection module, and the object detection module. Depth-wise-pointwise convolutions are used to improve the detection in real time. The coarse detection module coarsely refine the locations and sizes of prior anchors to provide better initialization for the subsequent module and also reduces search space for the classification, whereas the object detection module aims to regress accurate object locations and predict the class labels for the prior anchors. The experimental results on the railway traffic dataset show that FR-Net achieves 0.8953 mAP with 72.3 FPS performance on a machine with a GeForce GTX1080Ti with the input size of 320 × 320 pixels. The results imply that FR-Net takes a good tradeoff both on effectiveness and real time performance. The proposed method can meet the needs of practical application in shunting mode.

ReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation

OpenAIRE

Visin, Francesco; Ciccone, Marco; Romero, Adriana; Kastner, Kyle; Cho, Kyunghyun; Bengio, Yoshua; Matteucci, Matteo; Courville, Aaron

2015-01-01

We propose a structured prediction architecture, which exploits the local generic features extracted by Convolutional Neural Networks and the capacity of Recurrent Neural Networks (RNN) to retrieve distant dependencies. The proposed architecture, called ReSeg, is based on the recently introduced ReNet model for image classification. We modify and extend it to perform the more challenging task of semantic segmentation. Each ReNet layer is composed of four RNN that sweep the image horizontally ...

Connecting Neural Coding to Number Cognition: A Computational Account

Science.gov (United States)

Prather, Richard W.

2012-01-01

The current study presents a series of computational simulations that demonstrate how the neural coding of numerical magnitude may influence number cognition and development. This includes behavioral phenomena cataloged in cognitive literature such as the development of numerical estimation and operational momentum. Though neural research has…

A realistic neural mass model of the cortex with laminar-specific connections and synaptic plasticity - evaluation with auditory habituation.

Directory of Open Access Journals (Sweden)

Peng Wang

Full Text Available In this work we propose a biologically realistic local cortical circuit model (LCCM, based on neural masses, that incorporates important aspects of the functional organization of the brain that have not been covered by previous models: (1 activity dependent plasticity of excitatory synaptic couplings via depleting and recycling of neurotransmitters and (2 realistic inter-laminar dynamics via laminar-specific distribution of and connections between neural populations. The potential of the LCCM was demonstrated by accounting for the process of auditory habituation. The model parameters were specified using Bayesian inference. It was found that: (1 besides the major serial excitatory information pathway (layer 4 to layer 2/3 to layer 5/6, there exists a parallel "short-cut" pathway (layer 4 to layer 5/6, (2 the excitatory signal flow from the pyramidal cells to the inhibitory interneurons seems to be more intra-laminar while, in contrast, the inhibitory signal flow from inhibitory interneurons to the pyramidal cells seems to be both intra- and inter-laminar, and (3 the habituation rates of the connections are unsymmetrical: forward connections (from layer 4 to layer 2/3 are more strongly habituated than backward connections (from Layer 5/6 to layer 4. Our evaluation demonstrates that the novel features of the LCCM are of crucial importance for mechanistic explanations of brain function. The incorporation of these features into a mass model makes them applicable to modeling based on macroscopic data (like EEG or MEG, which are usually available in human experiments. Our LCCM is therefore a valuable building block for future realistic models of human cognitive function.

Experiments and simulation of a net closing mechanism for tether-net capture of space debris

Science.gov (United States)

Sharf, Inna; Thomsen, Benjamin; Botta, Eleonora M.; Misra, Arun K.

2017-10-01

This research addresses the design and testing of a debris containment system for use in a tether-net approach to space debris removal. The tether-net active debris removal involves the ejection of a net from a spacecraft by applying impulses to masses on the net, subsequent expansion of the net, the envelopment and capture of the debris target, and the de-orbiting of the debris via a tether to the chaser spacecraft. To ensure a debris removal mission's success, it is important that the debris be successfully captured and then, secured within the net. To this end, we present a concept for a net closing mechanism, which we believe will permit consistently successful debris capture via a simple and unobtrusive design. This net closing system functions by extending the main tether connecting the chaser spacecraft and the net vertex to the perimeter and around the perimeter of the net, allowing the tether to actuate closure of the net in a manner similar to a cinch cord. A particular embodiment of the design in a laboratory test-bed is described: the test-bed itself is comprised of a scaled-down tether-net, a supporting frame and a mock-up debris. Experiments conducted with the facility demonstrate the practicality of the net closing system. A model of the net closure concept has been integrated into the previously developed dynamics simulator of the chaser/tether-net/debris system. Simulations under tether tensioning conditions demonstrate the effectiveness of the closure concept for debris containment, in the gravity-free environment of space, for a realistic debris target. The on-ground experimental test-bed is also used to showcase its utility for validating the dynamics simulation of the net deployment, and a full-scale automated setup would make possible a range of validation studies of other aspects of a tether-net debris capture mission.

Mathematics Hiding in the Nets for a Cube

Science.gov (United States)

Jeon, Kyungsoon

2009-01-01

Whether they are third graders or teacher candidates, students can learn about perimeter and area while having fun manipulating two-dimensional figures into three-dimensional objects. In this article, the author describes a common mathematical activity for geometry students by creating nets for a cube. By making connections between nets in two…

Mode of effective connectivity within a putative neural network differentiates moral cognitions related to care and justice ethics.

Directory of Open Access Journals (Sweden)

Ricardo Cáceda

Full Text Available BACKGROUND: Moral sensitivity refers to the interpretive awareness of moral conflict and can be justice or care oriented. Justice ethics is associated primarily with human rights and the application of moral rules, whereas care ethics is related to human needs and a situational approach involving social emotions. Among the core brain regions involved in moral issue processing are: medial prefrontal cortex, anterior (ACC and posterior (PCC cingulate cortex, posterior superior temporal sulcus (pSTS, insula and amygdala. This study sought to inform the long standing debate of whether care and justice moral ethics represent one or two different forms of cognition. METHODOLOGY/PRINCIPAL FINDINGS: Model-free and model-based connectivity analysis were used to identify functional neural networks underlying care and justice ethics for a moral sensitivity task. In addition to modest differences in patterns of associated neural activity, distinct modes of functional and effective connectivity were observed for moral sensitivity for care and justice issues that were modulated by individual variation in moral ability. CONCLUSIONS/SIGNIFICANCE: These results support a neurobiological differentiation between care and justice ethics and suggest that human moral behavior reflects the outcome of integrating opposing rule-based, self-other perspectives, and emotional responses.

Mode of Effective Connectivity within a Putative Neural Network Differentiates Moral Cognitions Related to Care and Justice Ethics

Science.gov (United States)

Cáceda, Ricardo; James, G. Andrew; Ely, Timothy D.; Snarey, John; Kilts, Clinton D.

2011-01-01

Background Moral sensitivity refers to the interpretive awareness of moral conflict and can be justice or care oriented. Justice ethics is associated primarily with human rights and the application of moral rules, whereas care ethics is related to human needs and a situational approach involving social emotions. Among the core brain regions involved in moral issue processing are: medial prefrontal cortex, anterior (ACC) and posterior (PCC) cingulate cortex, posterior superior temporal sulcus (pSTS), insula and amygdala. This study sought to inform the long standing debate of whether care and justice moral ethics represent one or two different forms of cognition. Methodology/Principal Findings Model-free and model-based connectivity analysis were used to identify functional neural networks underlying care and justice ethics for a moral sensitivity task. In addition to modest differences in patterns of associated neural activity, distinct modes of functional and effective connectivity were observed for moral sensitivity for care and justice issues that were modulated by individual variation in moral ability. Conclusions/Significance These results support a neurobiological differentiation between care and justice ethics and suggest that human moral behavior reflects the outcome of integrating opposing rule-based, self-other perspectives, and emotional responses. PMID:21364916

A Configurable Event-Driven Convolutional Node with Rate Saturation Mechanism for Modular ConvNet Systems Implementation

Science.gov (United States)

Camuñas-Mesa, Luis A.; Domínguez-Cordero, Yaisel L.; Linares-Barranco, Alejandro; Serrano-Gotarredona, Teresa; Linares-Barranco, Bernabé

2018-01-01

Convolutional Neural Networks (ConvNets) are a particular type of neural network often used for many applications like image recognition, video analysis or natural language processing. They are inspired by the human brain, following a specific organization of the connectivity pattern between layers of neurons known as receptive field. These networks have been traditionally implemented in software, but they are becoming more computationally expensive as they scale up, having limitations for real-time processing of high-speed stimuli. On the other hand, hardware implementations show difficulties to be used for different applications, due to their reduced flexibility. In this paper, we propose a fully configurable event-driven convolutional node with rate saturation mechanism that can be used to implement arbitrary ConvNets on FPGAs. This node includes a convolutional processing unit and a routing element which allows to build large 2D arrays where any multilayer structure can be implemented. The rate saturation mechanism emulates the refractory behavior in biological neurons, guaranteeing a minimum separation in time between consecutive events. A 4-layer ConvNet with 22 convolutional nodes trained for poker card symbol recognition has been implemented in a Spartan6 FPGA. This network has been tested with a stimulus where 40 poker cards were observed by a Dynamic Vision Sensor (DVS) in 1 s time. Different slow-down factors were applied to characterize the behavior of the system for high speed processing. For slow stimulus play-back, a 96% recognition rate is obtained with a power consumption of 0.85 mW. At maximum play-back speed, a traffic control mechanism downsamples the input stimulus, obtaining a recognition rate above 63% when less than 20% of the input events are processed, demonstrating the robustness of the network. PMID:29515349

A Configurable Event-Driven Convolutional Node with Rate Saturation Mechanism for Modular ConvNet Systems Implementation

Directory of Open Access Journals (Sweden)

Luis A. Camuñas-Mesa

2018-02-01

Full Text Available Convolutional Neural Networks (ConvNets are a particular type of neural network often used for many applications like image recognition, video analysis or natural language processing. They are inspired by the human brain, following a specific organization of the connectivity pattern between layers of neurons known as receptive field. These networks have been traditionally implemented in software, but they are becoming more computationally expensive as they scale up, having limitations for real-time processing of high-speed stimuli. On the other hand, hardware implementations show difficulties to be used for different applications, due to their reduced flexibility. In this paper, we propose a fully configurable event-driven convolutional node with rate saturation mechanism that can be used to implement arbitrary ConvNets on FPGAs. This node includes a convolutional processing unit and a routing element which allows to build large 2D arrays where any multilayer structure can be implemented. The rate saturation mechanism emulates the refractory behavior in biological neurons, guaranteeing a minimum separation in time between consecutive events. A 4-layer ConvNet with 22 convolutional nodes trained for poker card symbol recognition has been implemented in a Spartan6 FPGA. This network has been tested with a stimulus where 40 poker cards were observed by a Dynamic Vision Sensor (DVS in 1 s time. Different slow-down factors were applied to characterize the behavior of the system for high speed processing. For slow stimulus play-back, a 96% recognition rate is obtained with a power consumption of 0.85 mW. At maximum play-back speed, a traffic control mechanism downsamples the input stimulus, obtaining a recognition rate above 63% when less than 20% of the input events are processed, demonstrating the robustness of the network.

A Configurable Event-Driven Convolutional Node with Rate Saturation Mechanism for Modular ConvNet Systems Implementation.

Science.gov (United States)

Camuñas-Mesa, Luis A; Domínguez-Cordero, Yaisel L; Linares-Barranco, Alejandro; Serrano-Gotarredona, Teresa; Linares-Barranco, Bernabé

2018-01-01

Convolutional Neural Networks (ConvNets) are a particular type of neural network often used for many applications like image recognition, video analysis or natural language processing. They are inspired by the human brain, following a specific organization of the connectivity pattern between layers of neurons known as receptive field. These networks have been traditionally implemented in software, but they are becoming more computationally expensive as they scale up, having limitations for real-time processing of high-speed stimuli. On the other hand, hardware implementations show difficulties to be used for different applications, due to their reduced flexibility. In this paper, we propose a fully configurable event-driven convolutional node with rate saturation mechanism that can be used to implement arbitrary ConvNets on FPGAs. This node includes a convolutional processing unit and a routing element which allows to build large 2D arrays where any multilayer structure can be implemented. The rate saturation mechanism emulates the refractory behavior in biological neurons, guaranteeing a minimum separation in time between consecutive events. A 4-layer ConvNet with 22 convolutional nodes trained for poker card symbol recognition has been implemented in a Spartan6 FPGA. This network has been tested with a stimulus where 40 poker cards were observed by a Dynamic Vision Sensor (DVS) in 1 s time. Different slow-down factors were applied to characterize the behavior of the system for high speed processing. For slow stimulus play-back, a 96% recognition rate is obtained with a power consumption of 0.85 mW. At maximum play-back speed, a traffic control mechanism downsamples the input stimulus, obtaining a recognition rate above 63% when less than 20% of the input events are processed, demonstrating the robustness of the network.

Pattern recognition neural-net by spatial mapping of biology visual field

Science.gov (United States)

Lin, Xin; Mori, Masahiko

2000-05-01

The method of spatial mapping in biology vision field is applied to artificial neural networks for pattern recognition. By the coordinate transform that is called the complex-logarithm mapping and Fourier transform, the input images are transformed into scale- rotation- and shift- invariant patterns, and then fed into a multilayer neural network for learning and recognition. The results of computer simulation and an optical experimental system are described.

Evolvable Neural Software System

Science.gov (United States)

Curtis, Steven A.

2009-01-01

The Evolvable Neural Software System (ENSS) is composed of sets of Neural Basis Functions (NBFs), which can be totally autonomously created and removed according to the changing needs and requirements of the software system. The resulting structure is both hierarchical and self-similar in that a given set of NBFs may have a ruler NBF, which in turn communicates with other sets of NBFs. These sets of NBFs may function as nodes to a ruler node, which are also NBF constructs. In this manner, the synthetic neural system can exhibit the complexity, three-dimensional connectivity, and adaptability of biological neural systems. An added advantage of ENSS over a natural neural system is its ability to modify its core genetic code in response to environmental changes as reflected in needs and requirements. The neural system is fully adaptive and evolvable and is trainable before release. It continues to rewire itself while on the job. The NBF is a unique, bilevel intelligence neural system composed of a higher-level heuristic neural system (HNS) and a lower-level, autonomic neural system (ANS). Taken together, the HNS and the ANS give each NBF the complete capabilities of a biological neural system to match sensory inputs to actions. Another feature of the NBF is the Evolvable Neural Interface (ENI), which links the HNS and ANS. The ENI solves the interface problem between these two systems by actively adapting and evolving from a primitive initial state (a Neural Thread) to a complicated, operational ENI and successfully adapting to a training sequence of sensory input. This simulates the adaptation of a biological neural system in a developmental phase. Within the greater multi-NBF and multi-node ENSS, self-similar ENI s provide the basis for inter-NBF and inter-node connectivity.

Visual working memory load-related changes in neural activity and functional connectivity.

Directory of Open Access Journals (Sweden)

Ling Li

Full Text Available BACKGROUND: Visual working memory (VWM helps us store visual information to prepare for subsequent behavior. The neuronal mechanisms for sustaining coherent visual information and the mechanisms for limited VWM capacity have remained uncharacterized. Although numerous studies have utilized behavioral accuracy, neural activity, and connectivity to explore the mechanism of VWM retention, little is known about the load-related changes in functional connectivity for hemi-field VWM retention. METHODOLOGY/PRINCIPAL FINDINGS: In this study, we recorded electroencephalography (EEG from 14 normal young adults while they performed a bilateral visual field memory task. Subjects had more rapid and accurate responses to the left visual field (LVF memory condition. The difference in mean amplitude between the ipsilateral and contralateral event-related potential (ERP at parietal-occipital electrodes in retention interval period was obtained with six different memory loads. Functional connectivity between 128 scalp regions was measured by EEG phase synchronization in the theta- (4-8 Hz, alpha- (8-12 Hz, beta- (12-32 Hz, and gamma- (32-40 Hz frequency bands. The resulting matrices were converted to graphs, and mean degree, clustering coefficient and shortest path length was computed as a function of memory load. The results showed that brain networks of theta-, alpha-, beta-, and gamma- frequency bands were load-dependent and visual-field dependent. The networks of theta- and alpha- bands phase synchrony were most predominant in retention period for right visual field (RVF WM than for LVF WM. Furthermore, only for RVF memory condition, brain network density of theta-band during the retention interval were linked to the delay of behavior reaction time, and the topological property of alpha-band network was negative correlation with behavior accuracy. CONCLUSIONS/SIGNIFICANCE: We suggest that the differences in theta- and alpha- bands between LVF and RVF

Visual Working Memory Load-Related Changes in Neural Activity and Functional Connectivity

Science.gov (United States)

Li, Ling; Zhang, Jin-Xiang; Jiang, Tao

2011-01-01

Background Visual working memory (VWM) helps us store visual information to prepare for subsequent behavior. The neuronal mechanisms for sustaining coherent visual information and the mechanisms for limited VWM capacity have remained uncharacterized. Although numerous studies have utilized behavioral accuracy, neural activity, and connectivity to explore the mechanism of VWM retention, little is known about the load-related changes in functional connectivity for hemi-field VWM retention. Methodology/Principal Findings In this study, we recorded electroencephalography (EEG) from 14 normal young adults while they performed a bilateral visual field memory task. Subjects had more rapid and accurate responses to the left visual field (LVF) memory condition. The difference in mean amplitude between the ipsilateral and contralateral event-related potential (ERP) at parietal-occipital electrodes in retention interval period was obtained with six different memory loads. Functional connectivity between 128 scalp regions was measured by EEG phase synchronization in the theta- (4–8 Hz), alpha- (8–12 Hz), beta- (12–32 Hz), and gamma- (32–40 Hz) frequency bands. The resulting matrices were converted to graphs, and mean degree, clustering coefficient and shortest path length was computed as a function of memory load. The results showed that brain networks of theta-, alpha-, beta-, and gamma- frequency bands were load-dependent and visual-field dependent. The networks of theta- and alpha- bands phase synchrony were most predominant in retention period for right visual field (RVF) WM than for LVF WM. Furthermore, only for RVF memory condition, brain network density of theta-band during the retention interval were linked to the delay of behavior reaction time, and the topological property of alpha-band network was negative correlation with behavior accuracy. Conclusions/Significance We suggest that the differences in theta- and alpha- bands between LVF and RVF conditions in

Functional connectivity and information flow of the respiratory neural network in chronic obstructive pulmonary disease.

Science.gov (United States)

Yu, Lianchun; De Mazancourt, Marine; Hess, Agathe; Ashadi, Fakhrul R; Klein, Isabelle; Mal, Hervé; Courbage, Maurice; Mangin, Laurence

2016-08-01

Breathing involves a complex interplay between the brainstem automatic network and cortical voluntary command. How these brain regions communicate at rest or during inspiratory loading is unknown. This issue is crucial for several reasons: (i) increased respiratory loading is a major feature of several respiratory diseases, (ii) failure of the voluntary motor and cortical sensory processing drives is among the mechanisms that precede acute respiratory failure, (iii) several cerebral structures involved in responding to inspiratory loading participate in the perception of dyspnea, a distressing symptom in many disease. We studied functional connectivity and Granger causality of the respiratory network in controls and patients with chronic obstructive pulmonary disease (COPD), at rest and during inspiratory loading. Compared with those of controls, the motor cortex area of patients exhibited decreased connectivity with their contralateral counterparts and no connectivity with the brainstem. In the patients, the information flow was reversed at rest with the source of the network shifted from the medulla towards the motor cortex. During inspiratory loading, the system was overwhelmed and the motor cortex became the sink of the network. This major finding may help to understand why some patients with COPD are prone to acute respiratory failure. Network connectivity and causality were related to lung function and illness severity. We validated our connectivity and causality results with a mathematical model of neural network. Our findings suggest a new therapeutic strategy involving the modulation of brain activity to increase motor cortex functional connectivity and improve respiratory muscles performance in patients. Hum Brain Mapp 37:2736-2754, 2016. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Neural activation patterns and connectivity in visual attention during Number and Non-number processing: An ERP study using the Ishihara pseudoisochromatic plates.

Science.gov (United States)

Al-Marri, Faraj; Reza, Faruque; Begum, Tahamina; Hitam, Wan Hazabbah Wan; Jin, Goh Khean; Xiang, Jing

2017-10-25

Visual cognitive function is important to build up executive function in daily life. Perception of visual Number form (e.g., Arabic digit) and numerosity (magnitude of the Number) is of interest to cognitive neuroscientists. Neural correlates and the functional measurement of Number representations are complex occurrences when their semantic categories are assimilated with other concepts of shape and colour. Colour perception can be processed further to modulate visual cognition. The Ishihara pseudoisochromatic plates are one of the best and most common screening tools for basic red-green colour vision testing. However, there is a lack of study of visual cognitive function assessment using these pseudoisochromatic plates. We recruited 25 healthy normal trichromat volunteers and extended these studies using a 128-sensor net to record event-related EEG. Subjects were asked to respond by pressing Numbered buttons when they saw the Number and Non-number plates of the Ishihara colour vision test. Amplitudes and latencies of N100 and P300 event related potential (ERP) components were analysed from 19 electrode sites in the international 10-20 system. A brain topographic map, cortical activation patterns and Granger causation (effective connectivity) were analysed from 128 electrode sites. No major significant differences between N100 ERP components in either stimulus indicate early selective attention processing was similar for Number and Non-number plate stimuli, but Non-number plate stimuli evoked significantly higher amplitudes, longer latencies of the P300 ERP component with a slower reaction time compared to Number plate stimuli imply the allocation of attentional load was more in Non-number plate processing. A different pattern of asymmetric scalp voltage map was noticed for P300 components with a higher intensity in the left hemisphere for Number plate tasks and higher intensity in the right hemisphere for Non-number plate tasks. Asymmetric cortical activation

Neural correlates of verbal creativity: Differences in resting-state functional connectivity associated with expertise in creative writing

Directory of Open Access Journals (Sweden)

Martin eLotze

2014-07-01

Full Text Available Neural characteristics of verbal creativity as assessed by word generation tasks have been recently identified, but differences in resting-state functional connectivity (rFC between experts and non-experts in creative writing have not been reported yet. Previous electroencephalography (EEG coherence measures during rest demonstrated a decreased cooperation between brain areas in association with creative thinking ability. Here, we used resting-state functional magnetic resonance imaging to compare 20 experts in creative writing and 23 age-matched non-experts with respect to rFC strengths within a brain network previously found to be associated with creative writing. Decreased rFC for experts was found between areas 44 of both hemispheres. Increased rFC for experts was observed between right hemispheric caudate and intraparietal sulcus. Correlation analysis of verbal creativity indices with rFC values in the expert group revealed predominantly negative associations, particularly of rFC between left area 44 and left temporal pole. Overall, our data support previous findings on reduced connectivity between interhemispheric areas and increased right-hemispheric connectivity during rest in highly verbally creative individuals.

A neural network to identify neutral mesons

International Nuclear Information System (INIS)

Lefevre, F.; Lautridou, P.; Marques, M.; Matulewicz, T.; Ostendorf, R.; Schutz, Y.

1994-01-01

Both π 0 and η mesons decay long before they can reach a detector. They predominantly decay by emission of two photons, and are identified by constructing the invariant mass of the photons. Misidentified mesons result from ambiguity in associating photons. Our work tries to select which pair is the most likely to be a physical one rather than a chance one. We first designed a Hopfield neural net, but all the activities converged rapidly towards zero except the highest one. To improve the solution we slew down the computation in order to let the network explore several states and to impose activities to converge towards one for all selected pairs. This was achieved by adding links connecting each cell to itself. The network performance is all the more interesting that the solid angle covered by the detector is greater than 15%. (D.L.). 5 refs

On the Nature of the Intrinsic Connectivity of the Cat Motor Cortex: Evidence for a Recurrent Neural Network Topology

DEFF Research Database (Denmark)

Capaday, Charles; Ethier, C; Brizzi, L

2009-01-01

and functional significance of the intrinsic horizontal connections between neurons in the motor cortex (MCx) remain to be clarified. To further elucidate the nature of this intracortical connectivity pattern, experiments were done on the MCx of three cats. The anterograde tracer biocytin was ejected......Capaday C, Ethier C, Brizzi L, Sik A, van Vreeswijk C, Gingras D. On the nature of the intrinsic connectivity of the cat motor cortex: evidence for a recurrent neural network topology. J Neurophysiol 102: 2131-2141, 2009. First published July 22, 2009; doi: 10.1152/jn.91319.2008. The details...... iontophoretically in layers II, III, and V. Some 30-50 neurons within a radius of similar to 250 mu m were thus stained. The functional output of the motor cortical point at which biocytin was injected, and of the surrounding points, was identified by microstimulation and electromyographic recordings. The axonal...

Cortical connective field estimates from resting state fMRI activity

NARCIS (Netherlands)

Gravel, Nicolas; Harvey, Ben; Nordhjem, Barbara; Haak, Koen V.; Dumoulin, Serge O.; Renken, Remco; Curcic-Blake, Branisalava; Cornelissen, Frans W.

2014-01-01

One way to study connectivity in visual cortical areas is by examining spontaneous neural activity. In the absence of visual input, such activity remains shaped by the underlying neural architecture and, presumably, may still reflect visuotopic organization. Here, we applied population connective

A neutron spectrum unfolding computer code based on artificial neural networks

International Nuclear Information System (INIS)

Ortiz-Rodríguez, J.M.; Reyes Alfaro, A.; Reyes Haro, A.; Cervantes Viramontes, J.M.; Vega-Carrillo, H.R.

2014-01-01

The Bonner Spheres Spectrometer consists of a thermal neutron sensor placed at the center of a number of moderating polyethylene spheres of different diameters. From the measured readings, information can be derived about the spectrum of the neutron field where measurements were made. Disadvantages of the Bonner system are the weight associated with each sphere and the need to sequentially irradiate the spheres, requiring long exposure periods. Provided a well-established response matrix and adequate irradiation conditions, the most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. The drawbacks associated with traditional unfolding procedures have motivated the need of complementary approaches. Novel methods based on Artificial Intelligence, mainly Artificial Neural Networks, have been widely investigated. In this work, a neutron spectrum unfolding code based on neural nets technology is presented. This code is called Neutron Spectrometry and Dosimetry with Artificial Neural networks unfolding code that was designed in a graphical interface. The core of the code is an embedded neural network architecture previously optimized using the robust design of artificial neural networks methodology. The main features of the code are: easy to use, friendly and intuitive to the user. This code was designed for a Bonner Sphere System based on a 6 LiI(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. The main feature of the code is that as entrance data, for unfolding the neutron spectrum, only seven rate counts measured with seven Bonner spheres are required; simultaneously the code calculates 15 dosimetric quantities as well as the total flux for radiation protection purposes. This code generates a full report with all information of the unfolding

Neural network error correction for solving coupled ordinary differential equations

Science.gov (United States)

Shelton, R. O.; Darsey, J. A.; Sumpter, B. G.; Noid, D. W.

1992-01-01

A neural network is presented to learn errors generated by a numerical algorithm for solving coupled nonlinear differential equations. The method is based on using a neural network to correctly learn the error generated by, for example, Runge-Kutta on a model molecular dynamics (MD) problem. The neural network programs used in this study were developed by NASA. Comparisons are made for training the neural network using backpropagation and a new method which was found to converge with fewer iterations. The neural net programs, the MD model and the calculations are discussed.

Application of a neural network for reflectance spectrum classification

Science.gov (United States)

Yang, Gefei; Gartley, Michael

2017-05-01

Traditional reflectance spectrum classification algorithms are based on comparing spectrum across the electromagnetic spectrum anywhere from the ultra-violet to the thermal infrared regions. These methods analyze reflectance on a pixel by pixel basis. Inspired by high performance that Convolution Neural Networks (CNN) have demonstrated in image classification, we applied a neural network to analyze directional reflectance pattern images. By using the bidirectional reflectance distribution function (BRDF) data, we can reformulate the 4-dimensional into 2 dimensions, namely incident direction × reflected direction × channels. Meanwhile, RIT's micro-DIRSIG model is utilized to simulate additional training samples for improving the robustness of the neural networks training. Unlike traditional classification by using hand-designed feature extraction with a trainable classifier, neural networks create several layers to learn a feature hierarchy from pixels to classifier and all layers are trained jointly. Hence, the our approach of utilizing the angular features are different to traditional methods utilizing spatial features. Although training processing typically has a large computational cost, simple classifiers work well when subsequently using neural network generated features. Currently, most popular neural networks such as VGG, GoogLeNet and AlexNet are trained based on RGB spatial image data. Our approach aims to build a directional reflectance spectrum based neural network to help us to understand from another perspective. At the end of this paper, we compare the difference among several classifiers and analyze the trade-off among neural networks parameters.

Global robust stability of delayed neural networks: Estimating upper limit of norm of delayed connection weight matrix

International Nuclear Information System (INIS)

Singh, Vimal

2007-01-01

The question of estimating the upper limit of -parallel B -parallel 2 , which is a key step in some recently reported global robust stability criteria for delayed neural networks, is revisited ( B denotes the delayed connection weight matrix). Recently, Cao, Huang, and Qu have given an estimate of the upper limit of -parallel B -parallel 2 . In the present paper, an alternative estimate of the upper limit of -parallel B -parallel 2 is highlighted. It is shown that the alternative estimate may yield some new global robust stability results

Neural field theory of perceptual echo and implications for estimating brain connectivity

Science.gov (United States)

Robinson, P. A.; Pagès, J. C.; Gabay, N. C.; Babaie, T.; Mukta, K. N.

2018-04-01

Neural field theory is used to predict and analyze the phenomenon of perceptual echo in which random input stimuli at one location are correlated with electroencephalographic responses at other locations. It is shown that this echo correlation (EC) yields an estimate of the transfer function from the stimulated point to other locations. Modal analysis then explains the observed spatiotemporal structure of visually driven EC and the dominance of the alpha frequency; two eigenmodes of similar amplitude dominate the response, leading to temporal beating and a line of low correlation that runs from the crown of the head toward the ears. These effects result from mode splitting and symmetry breaking caused by interhemispheric coupling and cortical folding. It is shown how eigenmodes obtained from functional magnetic resonance imaging experiments can be combined with temporal dynamics from EC or other evoked responses to estimate the spatiotemporal transfer function between any two points and hence their effective connectivity.

Evaluation and scoring of radiotherapy treatment plans using an artificial neural network

International Nuclear Information System (INIS)

Willoughby, Twyla R.; Starkschall, George; Janjan, Nora A.; Rosen, Isaac I.

1996-01-01

Purpose: The objective of this work was to demonstrate the feasibility of using an artificial neural network to predict the clinical evaluation of radiotherapy treatment plans. Methods and Materials: Approximately 150 treatment plans were developed for 16 patients who received external-beam radiotherapy for soft-tissue sarcomas of the lower extremity. Plans were assigned a figure of merit by a radiation oncologist using a five-point rating scale. Plan scoring was performed by a single physician to ensure consistency in rating. Dose-volume information extracted from a training set of 511 treatment plans on 14 patients was correlated to the physician-generated figure of merit using an artificial neural network. The neural network was tested with a test set of 19 treatment plans on two patients whose plans were not used in the training of the neural net. Results: Physician scoring of treatment plans was consistent to within one point on the rating scale 88% of the time. The neural net reproduced the physician scores in the training set to within one point approximately 90% of the time. It reproduced the physician scores in the test set to within one point approximately 83% of the time. Conclusions: An artificial neural network can be trained to generate a score for a treatment plan that can be correlated to a clinically-based figure of merit. The accuracy of the neural net in scoring plans compares well with the reproducibility of the clinical scoring. The system of radiotherapy treatment plan evaluation using an artificial neural network demonstrates promise as a method for generating a clinically relevant figure of merit

Neural nets for the plausibility check of measured values in the integrated measurement and information system for the surveillance of environmental radioactivity (IMIS)

International Nuclear Information System (INIS)

Haase, G.

2003-01-01

Neural nets to the plausibility check of measured values in the ''integrated measurement and information system for the surveillance of environmental radioactivity, IMIS'' is a research project supported by the Federal Minister for the Environment, Nature Conservation and Nuclear Safety. A goal of this project was the automatic recognition of implausible measured values in the data base ORACLE, which measured values from surveillance of environmental radioactivity of most diverse environmental media contained. The conversion of this project [ 1 ] was realized by institut of logic, complexity and deduction systems of the university Karlsruhe under the direction of Professor Dr. Menzel, Dr. Martin Riedmueller and Martin Lauer. (orig.)

Reconstruction of neutron spectra through neural networks; Reconstruccion de espectros de neutrones mediante redes neuronales

Energy Technology Data Exchange (ETDEWEB)

Vega C, H.R.; Hernandez D, V.M.; Manzanares A, E. [Cuerpo Academico de Radiobiologia, Estudios Nucleares, Universidad Autonoma de Zacatecas, A.P. 336, 98000 Zacatecas (Mexico)] e-mail: rvega@cantera.reduaz.mx [and others

2003-07-01

A neural network has been used to reconstruct the neutron spectra starting from the counting rates of the detectors of the Bonner sphere spectrophotometric system. A group of 56 neutron spectra was selected to calculate the counting rates that would produce in a Bonner sphere system, with these data and the spectra it was trained the neural network. To prove the performance of the net, 12 spectra were used, 6 were taken of the group used for the training, 3 were obtained of mathematical functions and those other 3 correspond to real spectra. When comparing the original spectra of those reconstructed by the net we find that our net has a poor performance when reconstructing monoenergetic spectra, this attributes it to those characteristic of the spectra used for the training of the neural network, however for the other groups of spectra the results of the net are appropriate with the prospective ones. (Author)

Generalized Net Model of the Cognitive and Neural Algorithm for Adaptive Resonance Theory 1

Directory of Open Access Journals (Sweden)

Todor Petkov

2013-12-01

Full Text Available The artificial neural networks are inspired by biological properties of human and animal brains. One of the neural networks type is called ART [4]. The abbreviation of ART stands for Adaptive Resonance Theory that has been invented by Stephen Grossberg in 1976 [5]. ART represents a family of Neural Networks. It is a cognitive and neural theory that describes how the brain autonomously learns to categorize, recognize and predict objects and events in the changing world. In this paper we introduce a GN model that represent ART1 Neural Network learning algorithm [1]. The purpose of this model is to explain when the input vector will be clustered or rejected among all nodes by the network. It can also be used for explanation and optimization of ART1 learning algorithm.

Application of artificial neural nets to Shashlik calorimetry

International Nuclear Information System (INIS)

Bonesini, M.; Paganoni, M.; Terranova, F.

1997-01-01

Artificial neural networks (ANN) are powerful tools widely used in high-energy physics to solve track finding and particle identification problems. An entirely new class of application is related to the problem of recovering the information lost during data taking or signal transmission. Good performances can be reached by ANN when the events are described by quite regular patterns. Such a method was used for the DELPHI luminosity monitor (STIC) to recover calorimeter dead channels. A comparison with more traditional techniques is also given. (orig.)

Analysis of Salinity Intrusion in the San Francisco Bay-Delta Using a GA-Optimized Neural Net, and Application of the Model to Prediction in the Elkhorn Slough Habitat

Science.gov (United States)

Thompson, D. E.; Rajkumar, T.

2002-12-01

The San Francisco Bay Delta is a large hydrodynamic complex that incorporates the Sacramento and San Joaquin Estuaries, the Suisan Marsh, and the San Francisco Bay proper. Competition exists for the use of this extensive water system both from the fisheries industry, the agricultural industry, and from the marine and estuarine animal species within the Delta. As tidal fluctuations occur, more saline water pushes upstream allowing fish to migrate beyond the Suisan Marsh for breeding and habitat occupation. However, the agriculture industry does not want extensive salinity intrusion to impact water quality for human and plant consumption. The balance is regulated by pumping stations located along the estuaries and reservoirs whereby flushing of fresh water keeps the saline intrusion at bay. The pumping schedule is driven by data collected at various locations within the Bay Delta and by numerical models that predict the salinity intrusion as part of a larger model of the system. The Interagency Ecological Program (IEP) for the San Francisco Bay / Sacramento-San Joaquin Estuary collects, monitors, and archives the data, and the Department of Water Resources provides a numerical model simulation (DSM2) from which predictions are made that drive the pumping schedule. A problem with DSM2 is that the numerical simulation takes roughly 16 hours to complete a prediction. We have created a neural net, optimized with a genetic algorithm, that takes as input the archived data from multiple gauging stations and predicts stage, salinity, and flow at the Carquinez Straits (at the downstream end of the Suisan Marsh). This model seems to be robust in its predictions and operates much faster than the current numerical DSM2 model. Because the Bay-Delta is strongly tidally driven, we used both Principal Component Analysis and Fast Fourier Transforms to discover dominant features within the IEP data. We then filtered out the dominant tidal forcing to discover non-primary tidal effects

Yarn-dyed fabric defect classification based on convolutional neural network

Science.gov (United States)

Jing, Junfeng; Dong, Amei; Li, Pengfei; Zhang, Kaibing

2017-09-01

Considering that manual inspection of the yarn-dyed fabric can be time consuming and inefficient, we propose a yarn-dyed fabric defect classification method by using a convolutional neural network (CNN) based on a modified AlexNet. CNN shows powerful ability in performing feature extraction and fusion by simulating the learning mechanism of human brain. The local response normalization layers in AlexNet are replaced by the batch normalization layers, which can enhance both the computational efficiency and classification accuracy. In the training process of the network, the characteristics of the defect are extracted step by step and the essential features of the image can be obtained from the fusion of the edge details with several convolution operations. Then the max-pooling layers, the dropout layers, and the fully connected layers are employed in the classification model to reduce the computation cost and extract more precise features of the defective fabric. Finally, the results of the defect classification are predicted by the softmax function. The experimental results show promising performance with an acceptable average classification rate and strong robustness on yarn-dyed fabric defect classification.

Strabismus Recognition Using Eye-Tracking Data and Convolutional Neural Networks

Directory of Open Access Journals (Sweden)

Zenghai Chen

2018-01-01

Full Text Available Strabismus is one of the most common vision diseases that would cause amblyopia and even permanent vision loss. Timely diagnosis is crucial for well treating strabismus. In contrast to manual diagnosis, automatic recognition can significantly reduce labor cost and increase diagnosis efficiency. In this paper, we propose to recognize strabismus using eye-tracking data and convolutional neural networks. In particular, an eye tracker is first exploited to record a subject’s eye movements. A gaze deviation (GaDe image is then proposed to characterize the subject’s eye-tracking data according to the accuracies of gaze points. The GaDe image is fed to a convolutional neural network (CNN that has been trained on a large image database called ImageNet. The outputs of the full connection layers of the CNN are used as the GaDe image’s features for strabismus recognition. A dataset containing eye-tracking data of both strabismic subjects and normal subjects is established for experiments. Experimental results demonstrate that the natural image features can be well transferred to represent eye-tracking data, and strabismus can be effectively recognized by our proposed method.

Shakeout: A New Approach to Regularized Deep Neural Network Training.

Science.gov (United States)

Kang, Guoliang; Li, Jun; Tao, Dacheng

2018-05-01

Recent years have witnessed the success of deep neural networks in dealing with a plenty of practical problems. Dropout has played an essential role in many successful deep neural networks, by inducing regularization in the model training. In this paper, we present a new regularized training approach: Shakeout. Instead of randomly discarding units as Dropout does at the training stage, Shakeout randomly chooses to enhance or reverse each unit's contribution to the next layer. This minor modification of Dropout has the statistical trait: the regularizer induced by Shakeout adaptively combines , and regularization terms. Our classification experiments with representative deep architectures on image datasets MNIST, CIFAR-10 and ImageNet show that Shakeout deals with over-fitting effectively and outperforms Dropout. We empirically demonstrate that Shakeout leads to sparser weights under both unsupervised and supervised settings. Shakeout also leads to the grouping effect of the input units in a layer. Considering the weights in reflecting the importance of connections, Shakeout is superior to Dropout, which is valuable for the deep model compression. Moreover, we demonstrate that Shakeout can effectively reduce the instability of the training process of the deep architecture.

NeMO-Net - The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment

Science.gov (United States)

Li, A. S. X.; Chirayath, V.; Segal-Rosenhaimer, M.; Das, K.

2017-12-01

In the past decade, coral reefs worldwide have experienced unprecedented stresses due to climate change, ocean acidification, and anthropomorphic pressures, instigating massive bleaching and die-off of these fragile and diverse ecosystems. Furthermore, remote sensing of these shallow marine habitats is hindered by ocean wave distortion, refraction and optical attenuation, leading invariably to data products that are often of low resolution and signal-to-noise (SNR) ratio. However, recent advances in UAV and Fluid Lensing technology have allowed us to capture multispectral 3D imagery of these systems at sub-cm scales from above the water surface, giving us an unprecedented view of their growth and decay. Exploiting the fine-scaled features of these datasets, machine learning methods such as MAP, PCA, and SVM can not only accurately classify the living cover and morphology of these reef systems (below 8% error), but are also able to map the spectral space between airborne and satellite imagery, augmenting and improving the classification accuracy of previously low-resolution datasets.We are currently implementing NeMO-Net, the first open-source deep convolutional neural network (CNN) and interactive active learning and training software to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology. NeMO-Net will be built upon the QGIS platform to ingest UAV, airborne and satellite datasets from various sources and sensor capabilities, and through data-fusion determine the coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. To achieve this, we will exploit virtual data augmentation, the use of semi-supervised learning, and active learning through a tablet platform allowing for users to manually train uncertain or difficult to classify datasets. The project will make use of Python's extensive libraries for machine learning, as well as extending integration to GPU

BioNet Digital Communications Framework

Science.gov (United States)

Gifford, Kevin; Kuzminsky, Sebastian; Williams, Shea

2010-01-01

BioNet v2 is a peer-to-peer middleware that enables digital communication devices to talk to each other. It provides a software development framework, standardized application, network-transparent device integration services, a flexible messaging model, and network communications for distributed applications. BioNet is an implementation of the Constellation Program Command, Control, Communications and Information (C3I) Interoperability specification, given in CxP 70022-01. The system architecture provides the necessary infrastructure for the integration of heterogeneous wired and wireless sensing and control devices into a unified data system with a standardized application interface, providing plug-and-play operation for hardware and software systems. BioNet v2 features a naming schema for mobility and coarse-grained localization information, data normalization within a network-transparent device driver framework, enabling of network communications to non-IP devices, and fine-grained application control of data subscription band width usage. BioNet directly integrates Disruption Tolerant Networking (DTN) as a communications technology, enabling networked communications with assets that are only intermittently connected including orbiting relay satellites and planetary rover vehicles.

Neural net classification of x-ray pistachio nut data

Science.gov (United States)

Casasent, David P.; Sipe, Michael A.; Schatzki, Thomas F.; Keagy, Pamela M.; Le, Lan Chau

1996-12-01

Classification results for agricultural products are presented using a new neural network. This neural network inherently produces higher-order decision surfaces. It achieves this with fewer hidden layer neurons than other classifiers require. This gives better generalization. It uses new techniques to select the number of hidden layer neurons and adaptive algorithms that avoid other such ad hoc parameter selection problems; it allows selection of the best classifier parameters without the need to analyze the test set results. The agriculture case study considered is the inspection and classification of pistachio nuts using x- ray imagery. Present inspection techniques cannot provide good rejection of worm damaged nuts without rejecting too many good nuts. X-ray imagery has the potential to provide 100% inspection of such agricultural products in real time. Only preliminary results are presented, but these indicate the potential to reduce major defects to 2% of the crop with 1% of good nuts rejected. Future image processing techniques that should provide better features to improve performance and allow inspection of a larger variety of nuts are noted. These techniques and variations of them have uses in a number of other agricultural product inspection problems.

Fuzzy Neuroidal Nets and Recurrent Fuzzy Computations

Czech Academy of Sciences Publication Activity Database

Wiedermann, Jiří

2001-01-01

Roč. 11, č. 6 (2001), s. 675-686 ISSN 1210-0552. [SOFSEM 2001 Workshop on Soft Computing. Piešťany, 29.11.2001-30.11.2001] R&D Projects: GA ČR GA201/00/1489; GA AV ČR KSK1019101 Institutional research plan: AV0Z1030915 Keywords : fuzzy computing * fuzzy neural nets * fuzzy Turing machines * non-uniform computational complexity Subject RIV: BA - General Mathematics

Self-organized critical neural networks

International Nuclear Information System (INIS)

Bornholdt, Stefan; Roehl, Torsten

2003-01-01

A mechanism for self-organization of the degree of connectivity in model neural networks is studied. Network connectivity is regulated locally on the basis of an order parameter of the global dynamics, which is estimated from an observable at the single synapse level. This principle is studied in a two-dimensional neural network with randomly wired asymmetric weights. In this class of networks, network connectivity is closely related to a phase transition between ordered and disordered dynamics. A slow topology change is imposed on the network through a local rewiring rule motivated by activity-dependent synaptic development: Neighbor neurons whose activity is correlated, on average develop a new connection while uncorrelated neighbors tend to disconnect. As a result, robust self-organization of the network towards the order disorder transition occurs. Convergence is independent of initial conditions, robust against thermal noise, and does not require fine tuning of parameters

Construction of a Piezoresistive Neural Sensor Array

Science.gov (United States)

Carlson, W. B.; Schulze, W. A.; Pilgrim, P. M.

1996-01-01

The construction of a piezoresistive - piezoelectric sensor (or actuator) array is proposed using 'neural' connectivity for signal recognition and possible actuation functions. A closer integration of the sensor and decision functions is necessary in order to achieve intrinsic identification within the sensor. A neural sensor is the next logical step in development of truly 'intelligent' arrays. This proposal will integrate 1-3 polymer piezoresistors and MLC electroceramic devices for applications involving acoustic identification. The 'intelligent' piezoresistor -piezoelectric system incorporates printed resistors, composite resistors, and a feedback for the resetting of resistances. A model of a design is proposed in order to simulate electromechanical resistor interactions. The goal of optimizing a sensor geometry for improving device reliability, training, & signal identification capabilities is the goal of this work. At present, studies predict performance of a 'smart' device with a significant control of 'effective' compliance over a narrow pressure range due to a piezoresistor percolation threshold. An interesting possibility may be to use an array of control elements to shift the threshold function in order to change the level of resistance in a neural sensor array for identification, or, actuation applications. The proposed design employs elements of: (1) conductor loaded polymers for a 'fast' RC time constant response; and (2) multilayer ceramics for actuation or sensing and shifting of resistance in the polymer. Other material possibilities also exist using magnetoresistive layered systems for shifting the resistance. It is proposed to use a neural net configuration to test and to help study the possible changes required in the materials design of these devices. Numerical design models utilize electromechanical elements, in conjunction with structural elements in order to simulate piezoresistively controlled actuators and changes in resistance of sensors

Effect of neural connectivity on autocovariance and cross covariance estimates

Directory of Open Access Journals (Sweden)

Stecker Mark M

2007-01-01

Full Text Available Abstract Background Measurements of auto and cross covariance functions are frequently used to investigate neural systems. In interpreting this data, it is commonly assumed that the largest contribution to the recordings comes from sources near the electrode. However, the potential recorded at an electrode represents the superimposition of the potentials generated by large numbers of active neural structures. This creates situations under which the measured auto and cross covariance functions are dominated by the activity in structures far from the electrode and in which the distance dependence of the cross-covariance function differs significantly from that describing the activity in the actual neural structures. Methods Direct application of electrostatics to calculate the theoretical auto and cross covariance functions that would be recorded from electrodes immersed in a large volume filled with active neural structures with specific statistical properties. Results It is demonstrated that the potentials recorded from a monopolar electrode surrounded by dipole sources in a uniform medium are predominantly due to activity in neural structures far from the electrode when neuronal correlations drop more slowly than 1/r3 or when the size of the neural system is much smaller than a known correlation distance. Recordings from quadrupolar sources are strongly dependent on distant neurons when correlations drop more slowly than 1/r or the size of the system is much smaller than the correlation distance. Differences between bipolar and monopolar recordings are discussed. It is also demonstrated that the cross covariance of the recorded in two spatially separated electrodes declines as a power-law function of the distance between them even when the electrical activity from different neuronal structures is uncorrelated. Conclusion When extracellular electrophysiologic recordings are made from systems containing large numbers of neural structures, it is

Automated target recognition and tracking using an optical pattern recognition neural network

Science.gov (United States)

Chao, Tien-Hsin

1991-01-01

The on-going development of an automatic target recognition and tracking system at the Jet Propulsion Laboratory is presented. This system is an optical pattern recognition neural network (OPRNN) that is an integration of an innovative optical parallel processor and a feature extraction based neural net training algorithm. The parallel optical processor provides high speed and vast parallelism as well as full shift invariance. The neural network algorithm enables simultaneous discrimination of multiple noisy targets in spite of their scales, rotations, perspectives, and various deformations. This fully developed OPRNN system can be effectively utilized for the automated spacecraft recognition and tracking that will lead to success in the Automated Rendezvous and Capture (AR&C) of the unmanned Cargo Transfer Vehicle (CTV). One of the most powerful optical parallel processors for automatic target recognition is the multichannel correlator. With the inherent advantages of parallel processing capability and shift invariance, multiple objects can be simultaneously recognized and tracked using this multichannel correlator. This target tracking capability can be greatly enhanced by utilizing a powerful feature extraction based neural network training algorithm such as the neocognitron. The OPRNN, currently under investigation at JPL, is constructed with an optical multichannel correlator where holographic filters have been prepared using the neocognitron training algorithm. The computation speed of the neocognitron-type OPRNN is up to 10(exp 14) analog connections/sec that enabling the OPRNN to outperform its state-of-the-art electronics counterpart by at least two orders of magnitude.

Modeling, control, and simulation of grid connected intelligent hybrid battery/photovoltaic system using new hybrid fuzzy-neural method.

Science.gov (United States)

Rezvani, Alireza; Khalili, Abbas; Mazareie, Alireza; Gandomkar, Majid

2016-07-01

Nowadays, photovoltaic (PV) generation is growing increasingly fast as a renewable energy source. Nevertheless, the drawback of the PV system is its dependence on weather conditions. Therefore, battery energy storage (BES) can be considered to assist for a stable and reliable output from PV generation system for loads and improve the dynamic performance of the whole generation system in grid connected mode. In this paper, a novel topology of intelligent hybrid generation systems with PV and BES in a DC-coupled structure is presented. Each photovoltaic cell has a specific point named maximum power point on its operational curve (i.e. current-voltage or power-voltage curve) in which it can generate maximum power. Irradiance and temperature changes affect these operational curves. Therefore, the nonlinear characteristic of maximum power point to environment has caused to development of different maximum power point tracking techniques. In order to capture the maximum power point (MPP), a hybrid fuzzy-neural maximum power point tracking (MPPT) method is applied in the PV system. Obtained results represent the effectiveness and superiority of the proposed method, and the average tracking efficiency of the hybrid fuzzy-neural is incremented by approximately two percentage points in comparison to the conventional methods. It has the advantages of robustness, fast response and good performance. A detailed mathematical model and a control approach of a three-phase grid-connected intelligent hybrid system have been proposed using Matlab/Simulink. Copyright © 2016 ISA. Published by Elsevier Ltd. All rights reserved.

Fully Connected Cascade Artificial Neural Network Architecture for Attention Deficit Hyperactivity Disorder Classification From Functional Magnetic Resonance Imaging Data.

Science.gov (United States)

Deshpande, Gopikrishna; Wang, Peng; Rangaprakash, D; Wilamowski, Bogdan

2015-12-01

Automated recognition and classification of brain diseases are of tremendous value to society. Attention deficit hyperactivity disorder (ADHD) is a diverse spectrum disorder whose diagnosis is based on behavior and hence will benefit from classification utilizing objective neuroimaging measures. Toward this end, an international competition was conducted for classifying ADHD using functional magnetic resonance imaging data acquired from multiple sites worldwide. Here, we consider the data from this competition as an example to illustrate the utility of fully connected cascade (FCC) artificial neural network (ANN) architecture for performing classification. We employed various directional and nondirectional brain connectivity-based methods to extract discriminative features which gave better classification accuracy compared to raw data. Our accuracy for distinguishing ADHD from healthy subjects was close to 90% and between the ADHD subtypes was close to 95%. Further, we show that, if properly used, FCC ANN performs very well compared to other classifiers such as support vector machines in terms of accuracy, irrespective of the feature used. Finally, the most discriminative connectivity features provided insights about the pathophysiology of ADHD and showed reduced and altered connectivity involving the left orbitofrontal cortex and various cerebellar regions in ADHD.

Segmentation of corneal endothelium images using a U-Net-based convolutional neural network.

Science.gov (United States)

Fabijańska, Anna

2018-04-18

Diagnostic information regarding the health status of the corneal endothelium may be obtained by analyzing the size and the shape of the endothelial cells in specular microscopy images. Prior to the analysis, the endothelial cells need to be extracted from the image. Up to today, this has been performed manually or semi-automatically. Several approaches to automatic segmentation of endothelial cells exist; however, none of them is perfect. Therefore this paper proposes to perform cell segmentation using a U-Net-based convolutional neural network. Particularly, the network is trained to discriminate pixels located at the borders between cells. The edge probability map outputted by the network is next binarized and skeletonized in order to obtain one-pixel wide edges. The proposed solution was tested on a dataset consisting of 30 corneal endothelial images presenting cells of different sizes, achieving an AUROC level of 0.92. The resulting DICE is on average equal to 0.86, which is a good result, regarding the thickness of the compared edges. The corresponding mean absolute percentage error of cell number is at the level of 4.5% which confirms the high accuracy of the proposed approach. The resulting cell edges are well aligned to the ground truths and require a limited number of manual corrections. This also results in accurate values of the cell morphometric parameters. The corresponding errors range from 5.2% for endothelial cell density, through 6.2% for cell hexagonality to 11.93% for the coefficient of variation of the cell size. Copyright © 2018 Elsevier B.V. All rights reserved.

State-of-the-art of applications of neural networks in the nuclear industry

International Nuclear Information System (INIS)

Zwingelstein, G.; Masson, M.H.

1990-01-01

Artificial neural net models have been extensively studied for many years in various laboratories to try to simulate with computer programs the human brain performances. The first applications were developed in the fields of speech and image recognition. The aims of these studies were mainly to classify rapidly patterns corrupted by noises or partly missing. Neural networks with the development of new net topologies and algorithms and parallel computing hardwares and softwares are to-day very promising for applications in many industries. In the introduction, this paper presents the anticipated benefits of the uses of neural networks for industrial applications. Then a brief overview of the main neural networks is provided. Finally a short review of neural networks applications in the nuclear industry is given. It covers domains such as: predictive maintenance for vibratory surveillance of rotating machinery, signal processing, operator guidance and eddy current inspection. In conclusion recommendations are made to use with efficiency neural networks for practical applications. In particular the need for supercomputing will be pinpointed. (author)

Connections model for tomographic images reconstruction

International Nuclear Information System (INIS)

Rodrigues, R.G.S.; Pela, C.A.; Roque, S.F. A.C.

1998-01-01

This paper shows an artificial neural network with an adequately topology for tomographic image reconstruction. The associated error function is derived and the learning algorithm is make. The simulated results are presented and demonstrate the existence of a generalized solution for nets with linear activation function. (Author)

Self: an adaptive pressure arising from self-organization, chaotic dynamics, and neural Darwinism.

Science.gov (United States)

Bruzzo, Angela Alessia; Vimal, Ram Lakhan Pandey

2007-12-01

In this article, we establish a model to delineate the emergence of "self" in the brain making recourse to the theory of chaos. Self is considered as the subjective experience of a subject. As essential ingredients of subjective experiences, our model includes wakefulness, re-entry, attention, memory, and proto-experiences. The stability as stated by chaos theory can potentially describe the non-linear function of "self" as sensitive to initial conditions and can characterize it as underlying order from apparently random signals. Self-similarity is discussed as a latent menace of a pathological confusion between "self" and "others". Our test hypothesis is that (1) consciousness might have emerged and evolved from a primordial potential or proto-experience in matter, such as the physical attractions and repulsions experienced by electrons, and (2) "self" arises from chaotic dynamics, self-organization and selective mechanisms during ontogenesis, while emerging post-ontogenically as an adaptive pressure driven by both volume and synaptic-neural transmission and influencing the functional connectivity of neural nets (structure).

Global reinforcement training of CrossNets

Science.gov (United States)

Ma, Xiaolong

2007-10-01

Hybrid "CMOL" integrated circuits, incorporating advanced CMOS devices for neural cell bodies, nanowires as axons and dendrites, and latching switches as synapses, may be used for the hardware implementation of extremely dense (107 cells and 1012 synapses per cm2) neuromorphic networks, operating up to 10 6 times faster than their biological prototypes. We are exploring several "Cross- Net" architectures that accommodate the limitations imposed by CMOL hardware and should allow effective training of the networks without a direct external access to individual synapses. Our studies have show that CrossNets based on simple (two-terminal) crosspoint devices can work well in at least two modes: as Hop-field networks for associative memory and multilayer perceptrons for classification tasks. For more intelligent tasks (such as robot motion control or complex games), which do not have "examples" for supervised learning, more advanced training methods such as the global reinforcement learning are necessary. For application of global reinforcement training algorithms to CrossNets, we have extended Williams's REINFORCE learning principle to a more general framework and derived several learning rules that are more suitable for CrossNet hardware implementation. The results of numerical experiments have shown that these new learning rules can work well for both classification tasks and reinforcement tasks such as the cartpole balancing control problem. Some limitations imposed by the CMOL hardware need to be carefully addressed for the the successful application of in situ reinforcement training to CrossNets.

Using neural networks and extreme value distributions to model electricity pool prices: Evidence from the Australian National Electricity Market 1998–2013

International Nuclear Information System (INIS)

Dev, Priya; Martin, Michael A.

2014-01-01

Highlights: • Neural nets are unable to properly capture spiky price behavior found in the electricity market. • We modeled electricity price data from the Australian National Electricity Market over 15 years. • Neural nets need to be augmented with other modeling techniques to capture price spikes. • We fit a Generalized Pareto Distribution to price spikes using a peaks-over-thresholds approach. - Abstract: Competitors in the electricity supply industry desire accurate predictions of electricity spot prices to hedge against financial risks. Neural networks are commonly used for forecasting such prices, but certain features of spot price series, such as extreme price spikes, present critical challenges for such modeling. We investigate the predictive capacity of neural networks for electricity spot prices using Australian National Electricity Market data. Following neural net modeling of the data, we explore extreme price spikes through extreme value modeling, fitting a Generalized Pareto Distribution to price peaks over an estimated threshold. While neural nets capture the smoother aspects of spot price data, they are unable to capture local, volatile features that characterize electricity spot price data. Price spikes can be modeled successfully through extreme value modeling

Neural Networks and Micromechanics

Science.gov (United States)

Kussul, Ernst; Baidyk, Tatiana; Wunsch, Donald C.

The title of the book, "Neural Networks and Micromechanics," seems artificial. However, the scientific and technological developments in recent decades demonstrate a very close connection between the two different areas of neural networks and micromechanics. The purpose of this book is to demonstrate this connection. Some artificial intelligence (AI) methods, including neural networks, could be used to improve automation system performance in manufacturing processes. However, the implementation of these AI methods within industry is rather slow because of the high cost of conducting experiments using conventional manufacturing and AI systems. To lower the cost, we have developed special micromechanical equipment that is similar to conventional mechanical equipment but of much smaller size and therefore of lower cost. This equipment could be used to evaluate different AI methods in an easy and inexpensive way. The proved methods could be transferred to industry through appropriate scaling. In this book, we describe the prototypes of low cost microequipment for manufacturing processes and the implementation of some AI methods to increase precision, such as computer vision systems based on neural networks for microdevice assembly and genetic algorithms for microequipment characterization and the increase of microequipment precision.

Portable Rule Extraction Method for Neural Network Decisions Reasoning

Directory of Open Access Journals (Sweden)

Darius PLIKYNAS

2005-08-01

Full Text Available Neural network (NN methods are sometimes useless in practical applications, because they are not properly tailored to the particular market's needs. We focus thereinafter specifically on financial market applications. NNs have not gained full acceptance here yet. One of the main reasons is the "Black Box" problem (lack of the NN decisions explanatory power. There are though some NN decisions rule extraction methods like decompositional, pedagogical or eclectic, but they suffer from low portability of the rule extraction technique across various neural net architectures, high level of granularity, algorithmic sophistication of the rule extraction technique etc. The authors propose to eliminate some known drawbacks using an innovative extension of the pedagogical approach. The idea is exposed by the use of a widespread MLP neural net (as a common tool in the financial problems' domain and SOM (input data space clusterization. The feedback of both nets' performance is related and targeted through the iteration cycle by achievement of the best matching between the decision space fragments and input data space clusters. Three sets of rules are generated algorithmically or by fuzzy membership functions. Empirical validation of the common financial benchmark problems is conducted with an appropriately prepared software solution.

Neural Network Approach to Locating Cryptography in Object Code

Energy Technology Data Exchange (ETDEWEB)

Jason L. Wright; Milos Manic

2009-09-01

Finding and identifying cryptography is a growing concern in the malware analysis community. In this paper, artificial neural networks are used to classify functional blocks from a disassembled program as being either cryptography related or not. The resulting system, referred to as NNLC (Neural Net for Locating Cryptography) is presented and results of applying this system to various libraries are described.

A New Light on Nets of C*-Algebras and Their Representations

Science.gov (United States)

Ruzzi, Giuseppe; Vasselli, Ezio

2012-06-01

The present paper deals with the question of representability of nets of C*-algebras whose underlying poset, indexing the net, is not upward directed. A particular class of nets, called C*-net bundles, is classified in terms of C*-dynamical systems having as group the fundamental group of the poset. Any net of C*-algebras has a canonical morphism into a C*-net bundle, the enveloping net bundle, which generalizes the notion of universal C*-algebra given by Fredenhagen to nonsimply connected posets. This allows a classification of nets; in particular, we call injective those nets such that the canonical morphism is faithful. Injectivity turns out to be equivalent to the existence of faithful representations. We further relate injectivity to a generalized Čech cocycle of the net, and this allows us to give examples of nets exhausting the above classification. Using these results we have shown, in another paper, that any conformal net over S 1 is injective.

BDNF genotype modulates resting functional connectivity in children

Directory of Open Access Journals (Sweden)

Moriah E Thomason

2009-11-01

Full Text Available A specific polymorphism of the brain-derived neurotrophic factor (BDNF gene is associated with alterations in brain anatomy and memory; its relevance to the functional connectivity of brain networks, however, is unclear. Given that altered hippocampal function and structure has been found in adults who carry the methionine (met allele of the BDNF gene and the molecular studies elucidating the role of BDNF in neurogenesis and synapse formation, we examined in the association between BDNF gene variants and neural resting connectivity in children and adolescents. We observed a reduction in hippocampal and parahippocampal to cortical connectivity in met-allele carriers within each of three resting networks: the default-mode, executive, and paralimbic networks. In contrast, we observed increased connectivity to amygdala, insula and striatal regions in met-carriers, within the paralimbic network. Because the BDNF met-allele has been linked to increased susceptibility to neuropsychiatric disorders, this latter finding of greater connectivity in circuits important for emotion processing may indicate a new neural mechanism through which these gene-related psychiatric differences are manifest. Here we show that the BDNF gene, known to regulate synaptic plasticity and connectivity in the brain, affects functional connectivity at the neural systems level. Additionally, we provide the first demonstration that the spatial topography of multiple high-level resting state networks in healthy children and adolescents is similar to that observed in adults.

Short-Term Load Forecasting Model Based on Quantum Elman Neural Networks

Directory of Open Access Journals (Sweden)

Zhisheng Zhang

2016-01-01

Full Text Available Short-term load forecasting model based on quantum Elman neural networks was constructed in this paper. The quantum computation and Elman feedback mechanism were integrated into quantum Elman neural networks. Quantum computation can effectively improve the approximation capability and the information processing ability of the neural networks. Quantum Elman neural networks have not only the feedforward connection but also the feedback connection. The feedback connection between the hidden nodes and the context nodes belongs to the state feedback in the internal system, which has formed specific dynamic memory performance. Phase space reconstruction theory is the theoretical basis of constructing the forecasting model. The training samples are formed by means of K-nearest neighbor approach. Through the example simulation, the testing results show that the model based on quantum Elman neural networks is better than the model based on the quantum feedforward neural network, the model based on the conventional Elman neural network, and the model based on the conventional feedforward neural network. So the proposed model can effectively improve the prediction accuracy. The research in the paper makes a theoretical foundation for the practical engineering application of the short-term load forecasting model based on quantum Elman neural networks.

Neural System Prediction and Identification Challenge

Directory of Open Access Journals (Sweden)

Ioannis eVlachos

2013-12-01

Full Text Available Can we infer the function of a biological neural network (BNN if we know the connectivity and activity of all its constituent neurons? This question is at the core of neuroscience and, accordingly, various methods have been developed to record the activity and connectivity of as many neurons as possible. Surprisingly, there is no theoretical or computational demonstration that neuronal activity and connectivity are indeed sufficient to infer the function of a BNN. Therefore, we pose the Neural Systems Identification and Prediction Challenge (nuSPIC. We provide the connectivity and activity of all neurons and invite participants (i to infer the functions implemented (hard-wired in spiking neural networks (SNNs by stimulating and recording the activity of neurons and, (ii to implement predefined mathematical/biological functions using SNNs. The nuSPICs can be accessed via a web-interface to the NEST simulator and the user is not required to know any specific programming language. Furthermore, the nuSPICs can be used as a teaching tool. Finally, nuSPICs use the crowd-sourcing model to address scientific issues. With this computational approach we aim to identify which functions can be inferred by systematic recordings of neuronal activity and connectivity. In addition, nuSPICs will help the design and application of new experimental paradigms based on the structure of the SNN and the presumed function which is to be discovered.

Neural system prediction and identification challenge.

Science.gov (United States)

Vlachos, Ioannis; Zaytsev, Yury V; Spreizer, Sebastian; Aertsen, Ad; Kumar, Arvind

2013-01-01

Can we infer the function of a biological neural network (BNN) if we know the connectivity and activity of all its constituent neurons?This question is at the core of neuroscience and, accordingly, various methods have been developed to record the activity and connectivity of as many neurons as possible. Surprisingly, there is no theoretical or computational demonstration that neuronal activity and connectivity are indeed sufficient to infer the function of a BNN. Therefore, we pose the Neural Systems Identification and Prediction Challenge (nuSPIC). We provide the connectivity and activity of all neurons and invite participants (1) to infer the functions implemented (hard-wired) in spiking neural networks (SNNs) by stimulating and recording the activity of neurons and, (2) to implement predefined mathematical/biological functions using SNNs. The nuSPICs can be accessed via a web-interface to the NEST simulator and the user is not required to know any specific programming language. Furthermore, the nuSPICs can be used as a teaching tool. Finally, nuSPICs use the crowd-sourcing model to address scientific issues. With this computational approach we aim to identify which functions can be inferred by systematic recordings of neuronal activity and connectivity. In addition, nuSPICs will help the design and application of new experimental paradigms based on the structure of the SNN and the presumed function which is to be discovered.

Distinct Neural Signatures Detected for ADHD Subtypes After Controlling for Micro-Movements in Resting State Functional Connectivity MRI Data

Directory of Open Access Journals (Sweden)

Damien eFair

2013-02-01

Full Text Available In recent years, there has been growing enthusiasm that functional MRI could achieve clinical utility for a broad range of neuropsychiatric disorders. However, several barriers remain. For example, the acquisition of large-scale datasets capable of clarifying the marked heterogeneity that exists in psychiatric illnesses will need to be realized. In addition, there continues to be a need for the development of image processing and analysis methods capable of separating signal from artifact. As a prototypical hyperkinetic disorder, and movement related artifact being a significant confound in functional imaging studies, ADHD offers a unique challenge. As part of the ADHD-200 Global Competition and this special edition of Frontiers, the ADHD-200 Consortium demonstrates the utility of an aggregate dataset pooled across five institutions in addressing these challenges. The work aimed to A examine the impact of emerging techniques for controlling for micro-movements, and B provide novel insights into the neural correlates of ADHD subtypes. Using SVM based MVPA we show that functional connectivity patterns in individuals are capable of differentiating the two most prominent ADHD subtypes. The application of graph-theory revealed that the Combined (ADHD-C and Inattentive (ADHD-I subtypes demonstrated some overlapping (particularly sensorimotor systems, but unique patterns of atypical connectivity. For ADHD-C, atypical connectivity was prominent in midline default network components, as well as insular cortex; in contrast, the ADHD-I group exhibited atypical patterns within the dlPFC regions and cerebellum. Systematic motion-related artifact was noted, and highlighted the need for stringent motion correction. Findings reported were robust to the specific motion correction strategy employed. These data suggest that rs-fcMRI data can be used to characterize individual patients with ADHD and to identify neural distinctions underlying the clinical

Markers of neural degeneration and regeneration in Down ...

African Journals Online (AJOL)

Iman Ehsan Abdel-Meguid

2012-11-02

Nov 2, 2012 ... The Egyptian Journal of Medical Human Genetics www.ejmhg.eg.net ... stem cells (TCSCs), including neural TCSCs and endothelial. TCSCs [10,11]. ..... directs human embryonic stem cell proliferation and differentia- tion into.

End-to-end unsupervised deformable image registration with a convolutional neural network

NARCIS (Netherlands)

de Vos, Bob D.; Berendsen, Floris; Viergever, Max A.; Staring, Marius; Išgum, Ivana

2017-01-01

In this work we propose a deep learning network for deformable image registration (DIRNet). The DIRNet consists of a convolutional neural network (ConvNet) regressor, a spatial transformer, and a resampler. The ConvNet analyzes a pair of fixed and moving images and outputs parameters for the spatial

Optical neural network system for pose determination of spinning satellites

Science.gov (United States)

Lee, Andrew; Casasent, David

1990-01-01

An optical neural network architecture and algorithm based on a Hopfield optimization network are presented for multitarget tracking. This tracker utilizes a neuron for every possible target track, and a quadratic energy function of neural activities which is minimized using gradient descent neural evolution. The neural net tracker is demonstrated as part of a system for determining position and orientation (pose) of spinning satellites with respect to a robotic spacecraft. The input to the system is time sequence video from a single camera. Novelty detection and filtering are utilized to locate and segment novel regions from the input images. The neural net multitarget tracker determines the correspondences (or tracks) of the novel regions as a function of time, and hence the paths of object (satellite) parts. The path traced out by a given part or region is approximately elliptical in image space, and the position, shape and orientation of the ellipse are functions of the satellite geometry and its pose. Having a geometric model of the satellite, and the elliptical path of a part in image space, the three-dimensional pose of the satellite is determined. Digital simulation results using this algorithm are presented for various satellite poses and lighting conditions.

A learning algorithm for oscillatory cellular neural networks.

Science.gov (United States)

Ho, C Y.; Kurokawa, H

1999-07-01

We present a cellular type oscillatory neural network for temporal segregation of stationary input patterns. The model comprises an array of locally connected neural oscillators with connections limited to a 4-connected neighborhood. The architecture is reminiscent of the well-known cellular neural network that consists of local connection for feature extraction. By means of a novel learning rule and an initialization scheme, global synchronization can be accomplished without incurring any erroneous synchrony among uncorrelated objects. Each oscillator comprises two mutually coupled neurons, and neurons share a piecewise-linear activation function characteristic. The dynamics of traditional oscillatory models is simplified by using only one plastic synapse, and the overall complexity for hardware implementation is reduced. Based on the connectedness of image segments, it is shown that global synchronization and desynchronization can be achieved by means of locally connected synapses, and this opens up a tremendous application potential for the proposed architecture. Furthermore, by using special grouping synapses it is demonstrated that temporal segregation of overlapping gray-level and color segments can also be achieved. Finally, simulation results show that the learning rule proposed circumvents the problem of component mismatches, and hence facilitates a large-scale integration.

Computer-assisted detection of colonic polyps with CT colonography using neural networks and binary classification trees

International Nuclear Information System (INIS)

Jerebko, Anna K.; Summers, Ronald M.; Malley, James D.; Franaszek, Marek; Johnson, C. Daniel

2003-01-01

Detection of colonic polyps in CT colonography is problematic due to complexities of polyp shape and the surface of the normal colon. Published results indicate the feasibility of computer-aided detection of polyps but better classifiers are needed to improve specificity. In this paper we compare the classification results of two approaches: neural networks and recursive binary trees. As our starting point we collect surface geometry information from three-dimensional reconstruction of the colon, followed by a filter based on selected variables such as region density, Gaussian and average curvature and sphericity. The filter returns sites that are candidate polyps, based on earlier work using detection thresholds, to which the neural nets or the binary trees are applied. A data set of 39 polyps from 3 to 25 mm in size was used in our investigation. For both neural net and binary trees we use tenfold cross-validation to better estimate the true error rates. The backpropagation neural net with one hidden layer trained with Levenberg-Marquardt algorithm achieved the best results: sensitivity 90% and specificity 95% with 16 false positives per study

Processing of chromatic information in a deep convolutional neural network.

Science.gov (United States)

Flachot, Alban; Gegenfurtner, Karl R

2018-04-01

Deep convolutional neural networks are a class of machine-learning algorithms capable of solving non-trivial tasks, such as object recognition, with human-like performance. Little is known about the exact computations that deep neural networks learn, and to what extent these computations are similar to the ones performed by the primate brain. Here, we investigate how color information is processed in the different layers of the AlexNet deep neural network, originally trained on object classification of over 1.2M images of objects in their natural contexts. We found that the color-responsive units in the first layer of AlexNet learned linear features and were broadly tuned to two directions in color space, analogously to what is known of color responsive cells in the primate thalamus. Moreover, these directions are decorrelated and lead to statistically efficient representations, similar to the cardinal directions of the second-stage color mechanisms in primates. We also found, in analogy to the early stages of the primate visual system, that chromatic and achromatic information were segregated in the early layers of the network. Units in the higher layers of AlexNet exhibit on average a lower responsivity for color than units at earlier stages.

Computational modeling of neural plasticity for self-organization of neural networks.

Science.gov (United States)

Chrol-Cannon, Joseph; Jin, Yaochu

2014-11-01

Self-organization in biological nervous systems during the lifetime is known to largely occur through a process of plasticity that is dependent upon the spike-timing activity in connected neurons. In the field of computational neuroscience, much effort has been dedicated to building up computational models of neural plasticity to replicate experimental data. Most recently, increasing attention has been paid to understanding the role of neural plasticity in functional and structural neural self-organization, as well as its influence on the learning performance of neural networks for accomplishing machine learning tasks such as classification and regression. Although many ideas and hypothesis have been suggested, the relationship between the structure, dynamics and learning performance of neural networks remains elusive. The purpose of this article is to review the most important computational models for neural plasticity and discuss various ideas about neural plasticity's role. Finally, we suggest a few promising research directions, in particular those along the line that combines findings in computational neuroscience and systems biology, and their synergetic roles in understanding learning, memory and cognition, thereby bridging the gap between computational neuroscience, systems biology and computational intelligence. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Computation and control with neural nets

Energy Technology Data Exchange (ETDEWEB)

Corneliusen, A.; Terdal, P.; Knight, T.; Spencer, J.

1989-10-04

As energies have increased exponentially with time so have the size and complexity of accelerators and control systems. NN may offer the kinds of improvements in computation and control that are needed to maintain acceptable functionality. For control their associative characteristics could provide signal conversion or data translation. Because they can do any computation such as least squares, they can close feedback loops autonomously to provide intelligent control at the point of action rather than at a central location that requires transfers, conversions, hand-shaking and other costly repetitions like input protection. Both computation and control can be integrated on a single chip, printed circuit or an optical equivalent that is also inherently faster through full parallel operation. For such reasons one expects lower costs and better results. Such systems could be optimized by integrating sensor and signal processing functions. Distributed nets of such hardware could communicate and provide global monitoring and multiprocessing in various ways e.g. via token, slotted or parallel rings (or Steiner trees) for compatibility with existing systems. Problems and advantages of this approach such as an optimal, real-time Turing machine are discussed. Simple examples are simulated and hardware implemented using discrete elements that demonstrate some basic characteristics of learning and parallelism. Future microprocessors' are predicted and requested on this basis. 19 refs., 18 figs.

Computation and control with neural nets

International Nuclear Information System (INIS)

Corneliusen, A.; Terdal, P.; Knight, T.; Spencer, J.

1989-01-01

As energies have increased exponentially with time so have the size and complexity of accelerators and control systems. NN may offer the kinds of improvements in computation and control that are needed to maintain acceptable functionality. For control their associative characteristics could provide signal conversion or data translation. Because they can do any computation such as least squares, they can close feedback loops autonomously to provide intelligent control at the point of action rather than at a central location that requires transfers, conversions, hand-shaking and other costly repetitions like input protection. Both computation and control can be integrated on a single chip, printed circuit or an optical equivalent that is also inherently faster through full parallel operation. For such reasons one expects lower costs and better results. Such systems could be optimized by integrating sensor and signal processing functions. Distributed nets of such hardware could communicate and provide global monitoring and multiprocessing in various ways e.g. via token, slotted or parallel rings (or Steiner trees) for compatibility with existing systems. Problems and advantages of this approach such as an optimal, real-time Turing machine are discussed. Simple examples are simulated and hardware implemented using discrete elements that demonstrate some basic characteristics of learning and parallelism. Future 'microprocessors' are predicted and requested on this basis. 19 refs., 18 figs

An efficient optical architecture for sparsely connected neural networks

Science.gov (United States)

Hine, Butler P., III; Downie, John D.; Reid, Max B.

1990-01-01

An architecture for general-purpose optical neural network processor is presented in which the interconnections and weights are formed by directing coherent beams holographically, thereby making use of the space-bandwidth products of the recording medium for sparsely interconnected networks more efficiently that the commonly used vector-matrix multiplier, since all of the hologram area is in use. An investigation is made of the use of computer-generated holograms recorded on such updatable media as thermoplastic materials, in order to define the interconnections and weights of a neural network processor; attention is given to limits on interconnection densities, diffraction efficiencies, and weighing accuracies possible with such an updatable thin film holographic device.

Modular Neural Tile Architecture for Compact Embedded Hardware Spiking Neural Network

NARCIS (Netherlands)

Pande, Sandeep; Morgan, Fearghal; Cawley, Seamus; Bruintjes, Tom; Smit, Gerardus Johannes Maria; McGinley, Brian; Carrillo, Snaider; Harkin, Jim; McDaid, Liam

2013-01-01

Biologically-inspired packet switched network on chip (NoC) based hardware spiking neural network (SNN) architectures have been proposed as an embedded computing platform for classification, estimation and control applications. Storage of large synaptic connectivity (SNN topology) information in

Identification of electrons in the ZEUS hadron-electron separator with neural networks

International Nuclear Information System (INIS)

Carstens, J.O.

1994-10-01

An electron finder for the ZEUS experiment was constructed, which is specialized to electrons in the momentum range 0.5 to 3.0 GeV/c. For the first time this electron finder connects the informations of the calorimeter with those of the hadron-electron separator (HES). For this purpose the electron finder was equipped with a neural network. The electron finder reached on a data set of photoproduction events with conversion electrons an efficiency and discriminance of E=(62.9±2.2±0.6)% and D=(91.4±0.8±1.1)%. From these two quantities it can be calculated that the electron finder the ratio electrons to background increases by the factoe E/(1-D)=7.4 (Signal amplification). For the comparison: A neural net, to which only calorimeter informations have been made available, reached at the same efficiency a signal amplification of 2.4. A simple cut in the variable HES-signal reaches a signal amplification of 6.3. Hints were given, how training data sets with electrons and hadrons of higher energies can be obtained. With such data sets the working range of the electron finder can be without problems extended to higher momenta. As preparation for the construction of the electron finder an introduction to the foundations of the mathematics and the application of neural networks was given. By means of examples different methods for the convergence improvement have been tested. Numerous representations mediate illustrative imaginations on the mathematical process of the training of neural networks

Forecasting macroeconomic variables using neural network models and three automated model selection techniques

DEFF Research Database (Denmark)

Kock, Anders Bredahl; Teräsvirta, Timo

2016-01-01

When forecasting with neural network models one faces several problems, all of which influence the accuracy of the forecasts. First, neural networks are often hard to estimate due to their highly nonlinear structure. To alleviate the problem, White (2006) presented a solution (QuickNet) that conv...

WATER DEMAND PREDICTION USING ARTIFICIAL NEURAL ...

African Journals Online (AJOL)

This paper presents Hourly water demand prediction at the demand nodes of a water distribution network using NeuNet Pro 2.3 neural network software and the monitoring and control of water distribution using supervisory control. The case study is the Laminga Water Treatment Plant and its water distribution network, Jos.

Towards semen quality assessment using neural networks

DEFF Research Database (Denmark)

Linneberg, Christian; Salamon, P.; Svarer, C.

1994-01-01

The paper presents the methodology and results from a neural net based classification of human sperm head morphology. The methodology uses a preprocessing scheme in which invariant Fourier descriptors are lumped into “energy” bands. The resulting networks are pruned using optimal brain damage. Pe...

Quantitative phase microscopy using deep neural networks

Science.gov (United States)

Li, Shuai; Sinha, Ayan; Lee, Justin; Barbastathis, George

2018-02-01

Deep learning has been proven to achieve ground-breaking accuracy in various tasks. In this paper, we implemented a deep neural network (DNN) to achieve phase retrieval in a wide-field microscope. Our DNN utilized the residual neural network (ResNet) architecture and was trained using the data generated by a phase SLM. The results showed that our DNN was able to reconstruct the profile of the phase target qualitatively. In the meantime, large error still existed, which indicated that our approach still need to be improved.

Neural substrates underlying balanced time perspective: A combined voxel-based morphometry and resting-state functional connectivity study.

Science.gov (United States)

Guo, Yiqun; Chen, Zhiyi; Feng, Tingyong

2017-08-14

Balanced time perspective (BTP), which is defined as a mental ability to switch flexibly among different time perspectives Zimbardo and Boyd (1999), has been suggested to be a central component of positive psychology Boniwell and Zimbardo (2004). BTP reflects individual's cognitive flexibility towards different time frames, which leads to many positive outcomes, including positive mood, subjective wellbeing, emotional intelligence, fluid intelligence, and executive control. However, the neural basis of BTP is still unclear. To address this question, we quantified individual's deviation from the BTP (DBTP), and investigated the neural substrates of DBTP using both voxel-based morphometry (VBM) and resting-state functional connectivity (RSFC) methods VBM analysis found that DBTP scores were positively correlated with gray matter volume (GMV) in the ventral precuneus. We further found that DBTP scores were negatively associated with RSFCs between the ventral precuneus seed region and medial prefrontal cortex (mPFC), bilateral temporoparietal junction (TPJ), parahippocampa gyrus (PHG), and middle frontal gyrus (MFG). These brain regions found in both VBM and RSFC analyses are commonly considered as core nodes of the default mode network (DMN) that is known to be involved in many functions, including episodic and autobiographical memory, self-related processing, theory of mind, and imagining the future. These functions of the DMN are also essential to individuals with BTP. Taken together, we provide the first evidence for the structural and functional neural basis of BTP, and highlight the crucial role of the DMN in cultivating an individual's BTP. Copyright © 2017 Elsevier B.V. All rights reserved.

Control of 12-Cylinder Camless Engine with Neural Networks

Directory of Open Access Journals (Sweden)

Ashhab Moh’d Sami

2017-01-01

Full Text Available The 12-cyliner camless engine breathing process is modeled with artificial neural networks (ANN’s. The inputs to the net are the intake valve lift (IVL and intake valve closing timing (IVC whereas the output of the net is the cylinder air charge (CAC. The ANN is trained with data collected from an engine simulation model which is based on thermodynamics principles and calibrated against real engine data. A method for adapting single-output feed-forward neural networks is proposed and applied to the camless engine ANN model. As a consequence the overall 12-cyliner camless engine feedback controller is upgraded and the necessary changes are implemented in order to contain the adaptive neural network with the objective of tracking the cylinder air charge (driver’s torque demand while minimizing the pumping losses (increasing engine efficiency. All the needed measurements are extracted only from the two conventional and inexpensive sensors, namely, the mass air flow through the throttle body (MAF and the intake manifold absolute pressure (MAP sensors. The feedback controller’s capability is demonstrated through computer simulation.

Hopfield neural network in HEP track reconstruction

International Nuclear Information System (INIS)

Muresan, R.; Pentia, M.

1997-01-01

In experimental particle physics, pattern recognition problems, specifically for neural network methods, occur frequently in track finding or feature extraction. Track finding is a combinatorial optimization problem. Given a set of points in Euclidean space, one tries the reconstruction of particle trajectories, subject to smoothness constraints.The basic ingredients in a neural network are the N binary neurons and the synaptic strengths connecting them. In our case the neurons are the segments connecting all possible point pairs.The dynamics of the neural network is given by a local updating rule wich evaluates for each neuron the sign of the 'upstream activity'. An updating rule in the form of sigmoid function is given. The synaptic strengths are defined in terms of angle between the segments and the lengths of the segments implied in the track reconstruction. An algorithm based on Hopfield neural network has been developed and tested on the track coordinates measured by silicon microstrip tracking system

Rodent Zic Genes in Neural Network Wiring.

Science.gov (United States)

Herrera, Eloísa

2018-01-01

The formation of the nervous system is a multistep process that yields a mature brain. Failure in any of the steps of this process may cause brain malfunction. In the early stages of embryonic development, neural progenitors quickly proliferate and then, at a specific moment, differentiate into neurons or glia. Once they become postmitotic neurons, they migrate to their final destinations and begin to extend their axons to connect with other neurons, sometimes located in quite distant regions, to establish different neural circuits. During the last decade, it has become evident that Zic genes, in addition to playing important roles in early development (e.g., gastrulation and neural tube closure), are involved in different processes of late brain development, such as neuronal migration, axon guidance, and refinement of axon terminals. ZIC proteins are therefore essential for the proper wiring and connectivity of the brain. In this chapter, we review our current knowledge of the role of Zic genes in the late stages of neural circuit formation.

PatterNet: a system to learn compact physical design pattern representations for pattern-based analytics

Science.gov (United States)

Lutich, Andrey

2017-07-01

This research considers the problem of generating compact vector representations of physical design patterns for analytics purposes in semiconductor patterning domain. PatterNet uses a deep artificial neural network to learn mapping of physical design patterns to a compact Euclidean hyperspace. Distances among mapped patterns in this space correspond to dissimilarities among patterns defined at the time of the network training. Once the mapping network has been trained, PatterNet embeddings can be used as feature vectors with standard machine learning algorithms, and pattern search, comparison, and clustering become trivial problems. PatterNet is inspired by the concepts developed within the framework of generative adversarial networks as well as the FaceNet. Our method facilitates a deep neural network (DNN) to learn directly the compact representation by supplying it with pairs of design patterns and dissimilarity among these patterns defined by a user. In the simplest case, the dissimilarity is represented by an area of the XOR of two patterns. Important to realize that our PatterNet approach is very different to the methods developed for deep learning on image data. In contrast to "conventional" pictures, the patterns in the CAD world are the lists of polygon vertex coordinates. The method solely relies on the promise of deep learning to discover internal structure of the incoming data and learn its hierarchical representations. Artificial intelligence arising from the combination of PatterNet and clustering analysis very precisely follows intuition of patterning/optical proximity correction experts paving the way toward human-like and human-friendly engineering tools.

Forecast of TEXT plasma disruptions using soft X-rays as input signal in a neural network

International Nuclear Information System (INIS)

Vannucci, A.; Oliveira, K.A.; Tajima, T.; Tajima, Y.J.

2001-01-01

A feed-forward neural network is used to forecast major and minor disruptions in TEXT tokamak discharges. Using the experimental data of soft X-ray signals as input data, the neural net is trained with one disruptive plasma discharge, while a different disruptive discharge is used for validation. After proper training, the net works with the same set of weights, it is then used to forecast disruptions in two other different plasma discharges. It is observed that the neural net is capable of predicting the onset of a disruption up to 3.12 ms in advance. From what we observe in the predictive behavior of our network, speculations are made whether the disruption triggering mechanism is associated with an increase in the m=2 magnetic island, that disturbs the central part of the plasma column afterwards, or the initial perturbation has first occurred in the central part of the plasma column and then the m=2 MHD mode is destabilized. (author)

Hindcasting of storm waves using neural networks

Digital Repository Service at National Institute of Oceanography (India)

Rao, S.; Mandal, S.

Department NN neural network net i weighted sum of the inputs of neuron i o k network output at kth output node P total number of training pattern s i output of neuron i t k target output at kth output node 1. Introduction Severe storms occur in Bay of Bengal...), forecasting of runoff (Crespo and Mora, 1993), concrete strength (Kasperkiewicz et al., 1995). The uses of neural network in the coastal the wave conditions will change from year to year, thus a proper statistical and climatological treatment requires several...

Optimization of artificial neural networks for the reconstruction of the neutrons spectrum and their equivalent doses

International Nuclear Information System (INIS)

Reyes A, A.; Ortiz R, J. M.; Reyes H, A.; Castaneda M, R.; Solis S, L. O.; Vega C, H. R.

2014-08-01

In this work was used the robust design methodology of artificial neural networks to determine a good topology of net able to solve with efficiency the problems of neutrons spectrometry and dosimetry. For the design of the topology of optimized net 36 different net architectures based on an orthogonal arrangement with a configuration L 9 (3 4 ), L 4 (3 2 ) were trained. For the training of the neural networks, was used a computer code developed in the ambient of Mat lab programming, which automates the process and analysis of the information, reducing the time used in this activity considerably for the investigator. For the training of the propagation nets forward was utilized a neutrons spectrum compendium published by the International Atomic Energy Agency, where of the total 80% was used for the training and 20% for the test, it trained with an inverse propagation algorithm being the entrance data the count rates corresponding to the 7 spheres of the spectrometric system of Bonner spheres, as exit data, the neural network obtains the neutrons spectrum expressed in 60 energy groups and are calculated of simultaneous way 15 dosimetric quantities. (Author)

Bifurcation analysis for a discrete-time Hopfield neural network of two neurons with two delays and self-connections

International Nuclear Information System (INIS)

Kaslik, E.; Balint, St.

2009-01-01

In this paper, a bifurcation analysis is undertaken for a discrete-time Hopfield neural network of two neurons with two different delays and self-connections. Conditions ensuring the asymptotic stability of the null solution are found, with respect to two characteristic parameters of the system. It is shown that for certain values of these parameters, Fold or Neimark-Sacker bifurcations occur, but Flip and codimension 2 (Fold-Neimark-Sacker, double Neimark-Sacker, resonance 1:1 and Flip-Neimark-Sacker) bifurcations may also be present. The direction and the stability of the Neimark-Sacker bifurcations are investigated by applying the center manifold theorem and the normal form theory

A new perspective on behavioral inconsistency and neural noise in aging: Compensatory speeding of neural communication

Directory of Open Access Journals (Sweden)

S. Lee Hong

2012-09-01

Full Text Available This paper seeks to present a new perspective on the aging brain. Here, we make connections between two key phenomena of brain aging: 1 increased neural noise or random background activity; and 2 slowing of brain activity. Our perspective proposes the possibility that the slowing of neural processing due to decreasing nerve conduction velocities leads to a compensatory speeding of neuron firing rates. These increased firing rates lead to a broader distribution of power in the frequency spectrum of neural oscillations, which we propose, can just as easily be interpreted as neural noise. Compensatory speeding of neural activity, as we present, is constrained by the: A availability of metabolic energy sources; and B competition for frequency bandwidth needed for neural communication. We propose that these constraints lead to the eventual inability to compensate for age-related declines in neural function that are manifested clinically as deficits in cognition, affect, and motor behavior.

Pulsed neural networks consisting of single-flux-quantum spiking neurons

International Nuclear Information System (INIS)

Hirose, T.; Asai, T.; Amemiya, Y.

2007-01-01

An inhibitory pulsed neural network was developed for brain-like information processing, by using single-flux-quantum (SFQ) circuits. It consists of spiking neuron devices that are coupled to each other through all-to-all inhibitory connections. The network selects neural activity. The operation of the neural network was confirmed by computer simulation. SFQ neuron devices can imitate the operation of the inhibition phenomenon of neural networks

Competitiveness of grid-connected solar electricity in Sweden - as seen from the perspective of the utilities and the net owners; Konkurrenskraft foer naetansluten solel i Sverige - sett ur kraftfoeretagens och naetaegarnas perspektiv

Energy Technology Data Exchange (ETDEWEB)

Carlstedt, Nils-Eric [Vattenfall Power Consultant AB, Stockholm (Sweden); Karlsson, Bjoern; Kjellsson, Elisabeth; Samuelsson, Olof [Faculty of Engineering (LTH), Lund University, Lund (Sweden); Neij, Lena [International Institute for Industrial Environmental Economics, Lund University, Lund (Sweden)

2006-12-15

The objective of this report was to analyse the competitiveness of grid-connected solar power in Sweden - and specifically the competitiveness for energy companies and net owners. In theory, solar power could to a large extent fulfil the electricity demand in Sweden, especially in the summer. However, the high cost of solar cells is a major barrier to implementation. Future technology development and increased efficiency could, however, lead to important cost reductions. The question is if such expected cost reductions would make grid-connected solar power a preferable investment option for energy companies and an interesting alternative for the net owners. The results of the study show that solar power will not be a competitive alternative for the energy companies in Sweden, not in 2020 and probably not in 2050. Other alternatives such as new investments in wind turbines and bio-mass based technology options will be producing electricity at a lower cost. Moreover, solar power will have an unfavourable production profile, generating power in the summertime when less needed. However, by using the reservoirs of the hydro power systems in Sweden as storage capacity, approximately 5 TWh solar power could be allowed in the Swedish electricity system. The results of the study indicate that solar power could have a positive effect on the electricity distribution system since distributed generation will result in lower losses in the system. Moreover, solar power will be produced during daytime when the electricity demand will peak. One of the main challenges for the net owners would be to design the net in such a way that the net and the solar cells could work together in the best possible way. Another challenge would be the high cost for connecting the solar cells to the grid; this cost needs to be reduced. Looking instead at the house-owners as possible investors, solar cells appear as a much more attractive alternative for the future, the value of the solar power is

Nonlinear signal processing using neural networks: Prediction and system modelling

Energy Technology Data Exchange (ETDEWEB)

Lapedes, A.; Farber, R.

1987-06-01

The backpropagation learning algorithm for neural networks is developed into a formalism for nonlinear signal processing. We illustrate the method by selecting two common topics in signal processing, prediction and system modelling, and show that nonlinear applications can be handled extremely well by using neural networks. The formalism is a natural, nonlinear extension of the linear Least Mean Squares algorithm commonly used in adaptive signal processing. Simulations are presented that document the additional performance achieved by using nonlinear neural networks. First, we demonstrate that the formalism may be used to predict points in a highly chaotic time series with orders of magnitude increase in accuracy over conventional methods including the Linear Predictive Method and the Gabor-Volterra-Weiner Polynomial Method. Deterministic chaos is thought to be involved in many physical situations including the onset of turbulence in fluids, chemical reactions and plasma physics. Secondly, we demonstrate the use of the formalism in nonlinear system modelling by providing a graphic example in which it is clear that the neural network has accurately modelled the nonlinear transfer function. It is interesting to note that the formalism provides explicit, analytic, global, approximations to the nonlinear maps underlying the various time series. Furthermore, the neural net seems to be extremely parsimonious in its requirements for data points from the time series. We show that the neural net is able to perform well because it globally approximates the relevant maps by performing a kind of generalized mode decomposition of the maps. 24 refs., 13 figs.

Bio-inspired Artificial Intelligence: А Generalized Net Model of the Regularization Process in MLP

Directory of Open Access Journals (Sweden)

Stanimir Surchev

2013-10-01

Full Text Available Many objects and processes inspired by the nature have been recreated by the scientists. The inspiration to create a Multilayer Neural Network came from human brain as member of the group. It possesses complicated structure and it is difficult to recreate, because of the existence of too many processes that require different solving methods. The aim of the following paper is to describe one of the methods that improve learning process of Artificial Neural Network. The proposed generalized net method presents Regularization process in Multilayer Neural Network. The purpose of verification is to protect the neural network from overfitting. The regularization is commonly used in neural network training process. Many methods of verification are present, the subject of interest is the one known as Regularization. It contains function in order to set weights and biases with smaller values to protect from overfitting.

Thermal photovoltaic solar integrated system analysis using neural networks

Energy Technology Data Exchange (ETDEWEB)

Ashhab, S. [Hashemite Univ., Zarqa (Jordan). Dept. of Mechanical Engineering

2007-07-01

The energy demand in Jordan is primarily met by petroleum products. As such, the development of renewable energy systems is quite attractive. In particular, solar energy is a promising renewable energy source in Jordan and has been used for food canning, paper production, air-conditioning and sterilization. Artificial neural networks (ANNs) have received significant attention due to their capabilities in forecasting, modelling of complex nonlinear systems and control. ANNs have been used for forecasting solar energy. This paper presented a study that examined a thermal photovoltaic solar integrated system that was built in Jordan. Historical input-output system data that was collected experimentally was used to train an ANN that predicted the collector, PV module, pump and total efficiencies. The model predicted the efficiencies well and can therefore be utilized to find the operating conditions of the system that will produce the maximum system efficiencies. The paper provided a description of the photovoltaic solar system including equations for PV module efficiency; pump efficiency; and total efficiency. The paper also presented data relevant to the system performance and neural networks. The results of a neural net model were also presented based on the thermal PV solar integrated system data that was collected. It was concluded that the neural net model of the thermal photovoltaic solar integrated system set the background for achieving the best system performance. 10 refs., 6 figs.

Automatic slice identification in 3D medical images with a ConvNet regressor

NARCIS (Netherlands)

de Vos, Bob D.; Viergever, Max A.; de Jong, Pim A.; Išgum, Ivana

2016-01-01

Identification of anatomical regions of interest is a prerequisite in many medical image analysis tasks. We propose a method that automatically identifies a slice of interest (SOI) in 3D images with a convolutional neural network (ConvNet) regressor. In 150 chest CT scans two reference slices were

Developing Scene Understanding Neural Software for Realistic Autonomous Outdoor Missions

Science.gov (United States)

2017-09-01

computer using a single graphics processing unit (GPU). To the best of our knowledge, an implementation of the open-source Python -based AlexNet CNN on...1. Introduction Neurons in the brain enable us to understand scenes by assessing the spatial, temporal, and feature relations of objects in the...effort to use computer neural networks to augment human neural intelligence to improve our scene understanding (Krizhevsky et al. 2012; Zhou et al

Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT.

Science.gov (United States)

Han, Yoseob; Ye, Jong Chul

2018-06-01

X-ray computed tomography (CT) using sparse projection views is a recent approach to reduce the radiation dose. However, due to the insufficient projection views, an analytic reconstruction approach using the filtered back projection (FBP) produces severe streaking artifacts. Recently, deep learning approaches using large receptive field neural networks such as U-Net have demonstrated impressive performance for sparse-view CT reconstruction. However, theoretical justification is still lacking. Inspired by the recent theory of deep convolutional framelets, the main goal of this paper is, therefore, to reveal the limitation of U-Net and propose new multi-resolution deep learning schemes. In particular, we show that the alternative U-Net variants such as dual frame and tight frame U-Nets satisfy the so-called frame condition which makes them better for effective recovery of high frequency edges in sparse-view CT. Using extensive experiments with real patient data set, we demonstrate that the new network architectures provide better reconstruction performance.

Identification of phosphorylation sites in protein kinase A substrates using artificial neural networks and mass spectrometry

DEFF Research Database (Denmark)

Hjerrild, M.; Stensballe, A.; Rasmussen, T.E.

2004-01-01

Protein phosphorylation plays a key role in cell regulation and identification of phosphorylation sites is important for understanding their functional significance. Here, we present an artificial neural network algorithm: NetPhosK (http://www.cbs.dtu.dk/services/NetPhosK/) that predicts protein...

Identification of phosphorylation sites in protein kinase A substrates using artificial neural networks and mass spectrometry

DEFF Research Database (Denmark)

Hjerrild, Majbrit; Stensballe, Allan; Rasmussen, Thomas E

2011-01-01

Protein phosphorylation plays a key role in cell regulation and identification of phosphorylation sites is important for understanding their functional significance. Here, we present an artificial neural network algorithm: NetPhosK (http://www.cbs.dtu.dk/services/NetPhosK/) that predicts protein...

A novel low-voltage low-power analogue VLSI implementation of neural networks with on-chip back-propagation learning

Science.gov (United States)

Carrasco, Manuel; Garde, Andres; Murillo, Pilar; Serrano, Luis

2005-06-01

In this paper a novel design and implementation of a VLSI Analogue Neural Net based on Multi-Layer Perceptron (MLP) with on-chip Back Propagation (BP) learning algorithm suitable for the resolution of classification problems is described. In order to implement a general and programmable analogue architecture, the design has been carried out in a hierarchical way. In this way the net has been divided in synapsis-blocks and neuron-blocks providing an easy method for the analysis. These blocks basically consist on simple cells, which are mainly, the activation functions (NAF), derivatives (DNAF), multipliers and weight update circuits. The analogue design is based on current-mode translinear techniques using MOS transistors working in the weak inversion region in order to reduce both the voltage supply and the power consumption. Moreover, with the purpose of minimizing the noise, offset and distortion of even order, the topologies are fully-differential and balanced. The circuit, named ANNE (Analogue Neural NEt), has been prototyped and characterized as a proof of concept on CMOS AMI-0.5A technology occupying a total area of 2.7mm2. The chip includes two versions of neural nets with on-chip BP learning algorithm, which are respectively a 2-1 and a 2-2-1 implementations. The proposed nets have been experimentally tested using supply voltages from 2.5V to 1.8V, which is suitable for single cell lithium-ion battery supply applications. Experimental results of both implementations included in ANNE exhibit a good performance on solving classification problems. These results have been compared with other proposed Analogue VLSI implementations of Neural Nets published in the literature demonstrating that our proposal is very efficient in terms of occupied area and power consumption.

Memristor-based neural networks

International Nuclear Information System (INIS)

Thomas, Andy

2013-01-01

The synapse is a crucial element in biological neural networks, but a simple electronic equivalent has been absent. This complicates the development of hardware that imitates biological architectures in the nervous system. Now, the recent progress in the experimental realization of memristive devices has renewed interest in artificial neural networks. The resistance of a memristive system depends on its past states and exactly this functionality can be used to mimic the synaptic connections in a (human) brain. After a short introduction to memristors, we present and explain the relevant mechanisms in a biological neural network, such as long-term potentiation and spike time-dependent plasticity, and determine the minimal requirements for an artificial neural network. We review the implementations of these processes using basic electric circuits and more complex mechanisms that either imitate biological systems or could act as a model system for them. (topical review)

Classification of behavior using unsupervised temporal neural networks

International Nuclear Information System (INIS)

Adair, K.L.

1998-03-01

Adding recurrent connections to unsupervised neural networks used for clustering creates a temporal neural network which clusters a sequence of inputs as they appear over time. The model presented combines the Jordan architecture with the unsupervised learning technique Adaptive Resonance Theory, Fuzzy ART. The combination yields a neural network capable of quickly clustering sequential pattern sequences as the sequences are generated. The applicability of the architecture is illustrated through a facility monitoring problem

Neural modularity helps organisms evolve to learn new skills without forgetting old skills.

Science.gov (United States)

Ellefsen, Kai Olav; Mouret, Jean-Baptiste; Clune, Jeff

2015-04-01

A long-standing goal in artificial intelligence is creating agents that can learn a variety of different skills for different problems. In the artificial intelligence subfield of neural networks, a barrier to that goal is that when agents learn a new skill they typically do so by losing previously acquired skills, a problem called catastrophic forgetting. That occurs because, to learn the new task, neural learning algorithms change connections that encode previously acquired skills. How networks are organized critically affects their learning dynamics. In this paper, we test whether catastrophic forgetting can be reduced by evolving modular neural networks. Modularity intuitively should reduce learning interference between tasks by separating functionality into physically distinct modules in which learning can be selectively turned on or off. Modularity can further improve learning by having a reinforcement learning module separate from sensory processing modules, allowing learning to happen only in response to a positive or negative reward. In this paper, learning takes place via neuromodulation, which allows agents to selectively change the rate of learning for each neural connection based on environmental stimuli (e.g. to alter learning in specific locations based on the task at hand). To produce modularity, we evolve neural networks with a cost for neural connections. We show that this connection cost technique causes modularity, confirming a previous result, and that such sparsely connected, modular networks have higher overall performance because they learn new skills faster while retaining old skills more and because they have a separate reinforcement learning module. Our results suggest (1) that encouraging modularity in neural networks may help us overcome the long-standing barrier of networks that cannot learn new skills without forgetting old ones, and (2) that one benefit of the modularity ubiquitous in the brains of natural animals might be to

Neural modularity helps organisms evolve to learn new skills without forgetting old skills.

Directory of Open Access Journals (Sweden)

Kai Olav Ellefsen

2015-04-01

Full Text Available A long-standing goal in artificial intelligence is creating agents that can learn a variety of different skills for different problems. In the artificial intelligence subfield of neural networks, a barrier to that goal is that when agents learn a new skill they typically do so by losing previously acquired skills, a problem called catastrophic forgetting. That occurs because, to learn the new task, neural learning algorithms change connections that encode previously acquired skills. How networks are organized critically affects their learning dynamics. In this paper, we test whether catastrophic forgetting can be reduced by evolving modular neural networks. Modularity intuitively should reduce learning interference between tasks by separating functionality into physically distinct modules in which learning can be selectively turned on or off. Modularity can further improve learning by having a reinforcement learning module separate from sensory processing modules, allowing learning to happen only in response to a positive or negative reward. In this paper, learning takes place via neuromodulation, which allows agents to selectively change the rate of learning for each neural connection based on environmental stimuli (e.g. to alter learning in specific locations based on the task at hand. To produce modularity, we evolve neural networks with a cost for neural connections. We show that this connection cost technique causes modularity, confirming a previous result, and that such sparsely connected, modular networks have higher overall performance because they learn new skills faster while retaining old skills more and because they have a separate reinforcement learning module. Our results suggest (1 that encouraging modularity in neural networks may help us overcome the long-standing barrier of networks that cannot learn new skills without forgetting old ones, and (2 that one benefit of the modularity ubiquitous in the brains of natural animals

Neural Modularity Helps Organisms Evolve to Learn New Skills without Forgetting Old Skills

Science.gov (United States)

Ellefsen, Kai Olav; Mouret, Jean-Baptiste; Clune, Jeff

2015-01-01

A long-standing goal in artificial intelligence is creating agents that can learn a variety of different skills for different problems. In the artificial intelligence subfield of neural networks, a barrier to that goal is that when agents learn a new skill they typically do so by losing previously acquired skills, a problem called catastrophic forgetting. That occurs because, to learn the new task, neural learning algorithms change connections that encode previously acquired skills. How networks are organized critically affects their learning dynamics. In this paper, we test whether catastrophic forgetting can be reduced by evolving modular neural networks. Modularity intuitively should reduce learning interference between tasks by separating functionality into physically distinct modules in which learning can be selectively turned on or off. Modularity can further improve learning by having a reinforcement learning module separate from sensory processing modules, allowing learning to happen only in response to a positive or negative reward. In this paper, learning takes place via neuromodulation, which allows agents to selectively change the rate of learning for each neural connection based on environmental stimuli (e.g. to alter learning in specific locations based on the task at hand). To produce modularity, we evolve neural networks with a cost for neural connections. We show that this connection cost technique causes modularity, confirming a previous result, and that such sparsely connected, modular networks have higher overall performance because they learn new skills faster while retaining old skills more and because they have a separate reinforcement learning module. Our results suggest (1) that encouraging modularity in neural networks may help us overcome the long-standing barrier of networks that cannot learn new skills without forgetting old ones, and (2) that one benefit of the modularity ubiquitous in the brains of natural animals might be to

Evaluating the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks

International Nuclear Information System (INIS)

Ortiz-Rodríguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solís Sánches, L. O.; Miranda, R. Castañeda; Cervantes Viramontes, J. M.; Vega-Carrillo, H. R.

2013-01-01

In this work the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks is evaluated. The first one code based on traditional iterative procedures and called Neutron spectrometry and dosimetry from the Universidad Autonoma de Zacatecas (NSDUAZ) use the SPUNIT iterative algorithm and was designed to unfold neutron spectrum and calculate 15 dosimetric quantities and 7 IAEA survey meters. The main feature of this code is the automated selection of the initial guess spectrum trough a compendium of neutron spectrum compiled by the IAEA. The second one code known as Neutron spectrometry and dosimetry with artificial neural networks (NDSann) is a code designed using neural nets technology. The artificial intelligence approach of neural net does not solve mathematical equations. By using the knowledge stored at synaptic weights on a neural net properly trained, the code is capable to unfold neutron spectrum and to simultaneously calculate 15 dosimetric quantities, needing as entrance data, only the rate counts measured with a Bonner spheres system. Similarities of both NSDUAZ and NSDann codes are: they follow the same easy and intuitive user's philosophy and were designed in a graphical interface under the LabVIEW programming environment. Both codes unfold the neutron spectrum expressed in 60 energy bins, calculate 15 dosimetric quantities and generate a full report in HTML format. Differences of these codes are: NSDUAZ code was designed using classical iterative approaches and needs an initial guess spectrum in order to initiate the iterative procedure. In NSDUAZ, a programming routine was designed to calculate 7 IAEA instrument survey meters using the fluence-dose conversion coefficients. NSDann code use artificial neural networks for solving the ill-conditioned equation system of neutron spectrometry problem through synaptic weights of a properly trained neural network. Contrary to iterative procedures, in neural

Evaluating the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks

Science.gov (United States)

Ortiz-Rodríguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solís Sánches, L. O.; Miranda, R. Castañeda; Cervantes Viramontes, J. M.; Vega-Carrillo, H. R.

2013-07-01

In this work the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks is evaluated. The first one code based on traditional iterative procedures and called Neutron spectrometry and dosimetry from the Universidad Autonoma de Zacatecas (NSDUAZ) use the SPUNIT iterative algorithm and was designed to unfold neutron spectrum and calculate 15 dosimetric quantities and 7 IAEA survey meters. The main feature of this code is the automated selection of the initial guess spectrum trough a compendium of neutron spectrum compiled by the IAEA. The second one code known as Neutron spectrometry and dosimetry with artificial neural networks (NDSann) is a code designed using neural nets technology. The artificial intelligence approach of neural net does not solve mathematical equations. By using the knowledge stored at synaptic weights on a neural net properly trained, the code is capable to unfold neutron spectrum and to simultaneously calculate 15 dosimetric quantities, needing as entrance data, only the rate counts measured with a Bonner spheres system. Similarities of both NSDUAZ and NSDann codes are: they follow the same easy and intuitive user's philosophy and were designed in a graphical interface under the LabVIEW programming environment. Both codes unfold the neutron spectrum expressed in 60 energy bins, calculate 15 dosimetric quantities and generate a full report in HTML format. Differences of these codes are: NSDUAZ code was designed using classical iterative approaches and needs an initial guess spectrum in order to initiate the iterative procedure. In NSDUAZ, a programming routine was designed to calculate 7 IAEA instrument survey meters using the fluence-dose conversion coefficients. NSDann code use artificial neural networks for solving the ill-conditioned equation system of neutron spectrometry problem through synaptic weights of a properly trained neural network. Contrary to iterative procedures, in neural

Evaluating the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks

Energy Technology Data Exchange (ETDEWEB)

Ortiz-Rodriguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solis Sanches, L. O.; Miranda, R. Castaneda; Cervantes Viramontes, J. M. [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica. Av. Ramon Lopez Velarde 801. Col. Centro Zacatecas, Zac (Mexico); Vega-Carrillo, H. R. [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica. Av. Ramon Lopez Velarde 801. Col. Centro Zacatecas, Zac., Mexico. and Unidad Academica de Estudios Nucleares. C. Cip (Mexico)

2013-07-03

In this work the performance of two neutron spectrum unfolding codes based on iterative procedures and artificial neural networks is evaluated. The first one code based on traditional iterative procedures and called Neutron spectrometry and dosimetry from the Universidad Autonoma de Zacatecas (NSDUAZ) use the SPUNIT iterative algorithm and was designed to unfold neutron spectrum and calculate 15 dosimetric quantities and 7 IAEA survey meters. The main feature of this code is the automated selection of the initial guess spectrum trough a compendium of neutron spectrum compiled by the IAEA. The second one code known as Neutron spectrometry and dosimetry with artificial neural networks (NDSann) is a code designed using neural nets technology. The artificial intelligence approach of neural net does not solve mathematical equations. By using the knowledge stored at synaptic weights on a neural net properly trained, the code is capable to unfold neutron spectrum and to simultaneously calculate 15 dosimetric quantities, needing as entrance data, only the rate counts measured with a Bonner spheres system. Similarities of both NSDUAZ and NSDann codes are: they follow the same easy and intuitive user's philosophy and were designed in a graphical interface under the LabVIEW programming environment. Both codes unfold the neutron spectrum expressed in 60 energy bins, calculate 15 dosimetric quantities and generate a full report in HTML format. Differences of these codes are: NSDUAZ code was designed using classical iterative approaches and needs an initial guess spectrum in order to initiate the iterative procedure. In NSDUAZ, a programming routine was designed to calculate 7 IAEA instrument survey meters using the fluence-dose conversion coefficients. NSDann code use artificial neural networks for solving the ill-conditioned equation system of neutron spectrometry problem through synaptic weights of a properly trained neural network. Contrary to iterative procedures, in

Visualizing deep neural network by alternately image blurring and deblurring.

Science.gov (United States)

Wang, Feng; Liu, Haijun; Cheng, Jian

2018-01-01

Visualization from trained deep neural networks has drawn massive public attention in recent. One of the visualization approaches is to train images maximizing the activation of specific neurons. However, directly maximizing the activation would lead to unrecognizable images, which cannot provide any meaningful information. In this paper, we introduce a simple but effective technique to constrain the optimization route of the visualization. By adding two totally inverse transformations, image blurring and deblurring, to the optimization procedure, recognizable images can be created. Our algorithm is good at extracting the details in the images, which are usually filtered by previous methods in the visualizations. Extensive experiments on AlexNet, VGGNet and GoogLeNet illustrate that we can better understand the neural networks utilizing the knowledge obtained by the visualization. Copyright © 2017 Elsevier Ltd. All rights reserved.

predicting water levels at kainji dam using artificial neural networks

African Journals Online (AJOL)

2013-03-01

Mar 1, 2013 ... Apart from insufficient number of power generation plants, existing ones are ... ture and/or functional aspects of biological neural net-. Nigerian Journal of ... Their model used the radiosonde-based 700-hPa wind direction and ...

ObamaNet: Photo-realistic lip-sync from text

OpenAIRE

Kumar, Rithesh; Sotelo, Jose; Kumar, Kundan; de Brebisson, Alexandre; Bengio, Yoshua

2017-01-01

We present ObamaNet, the first architecture that generates both audio and synchronized photo-realistic lip-sync videos from any new text. Contrary to other published lip-sync approaches, ours is only composed of fully trainable neural modules and does not rely on any traditional computer graphics methods. More precisely, we use three main modules: a text-to-speech network based on Char2Wav, a time-delayed LSTM to generate mouth-keypoints synced to the audio, and a network based on Pix2Pix to ...

Functional neural networks underlying response inhibition in adolescents and adults.

Science.gov (United States)

Stevens, Michael C; Kiehl, Kent A; Pearlson, Godfrey D; Calhoun, Vince D

2007-07-19

This study provides the first description of neural network dynamics associated with response inhibition in healthy adolescents and adults. Functional and effective connectivity analyses of whole brain hemodynamic activity elicited during performance of a Go/No-Go task were used to identify functionally integrated neural networks and characterize their causal interactions. Three response inhibition circuits formed a hierarchical, inter-dependent system wherein thalamic modulation of input to premotor cortex by fronto-striatal regions led to response suppression. Adolescents differed from adults in the degree of network engagement, regional fronto-striatal-thalamic connectivity, and network dynamics. We identify and characterize several age-related differences in the function of neural circuits that are associated with behavioral performance changes across adolescent development.

Structure-function relationships during segregated and integrated network states of human brain functional connectivity.

Science.gov (United States)

Fukushima, Makoto; Betzel, Richard F; He, Ye; van den Heuvel, Martijn P; Zuo, Xi-Nian; Sporns, Olaf

2018-04-01

Structural white matter connections are thought to facilitate integration of neural information across functionally segregated systems. Recent studies have demonstrated that changes in the balance between segregation and integration in brain networks can be tracked by time-resolved functional connectivity derived from resting-state functional magnetic resonance imaging (rs-fMRI) data and that fluctuations between segregated and integrated network states are related to human behavior. However, how these network states relate to structural connectivity is largely unknown. To obtain a better understanding of structural substrates for these network states, we investigated how the relationship between structural connectivity, derived from diffusion tractography, and functional connectivity, as measured by rs-fMRI, changes with fluctuations between segregated and integrated states in the human brain. We found that the similarity of edge weights between structural and functional connectivity was greater in the integrated state, especially at edges connecting the default mode and the dorsal attention networks. We also demonstrated that the similarity of network partitions, evaluated between structural and functional connectivity, increased and the density of direct structural connections within modules in functional networks was elevated during the integrated state. These results suggest that, when functional connectivity exhibited an integrated network topology, structural connectivity and functional connectivity were more closely linked to each other and direct structural connections mediated a larger proportion of neural communication within functional modules. Our findings point out the possibility of significant contributions of structural connections to integrative neural processes underlying human behavior.

CM Net heterogeneous local network of microcomputers

International Nuclear Information System (INIS)

Gutche, R.Kh.

1988-01-01

Realization of the CM Net heterogeneous local network for the PDP-11 type computers with the RT-11 operational system control is described. The main advantage of the network is the realization of virtual disks in general form including a system unit. the network can be used everywhere, where the problem on computer connection by simple interfaces is stated. 6 refs

Built-in self-repair of VLSI memories employing neural nets

Science.gov (United States)

Mazumder, Pinaki

1998-10-01

The decades of the Eighties and the Nineties have witnessed the spectacular growth of VLSI technology, when the chip size has increased from a few hundred devices to a staggering multi-millon transistors. This trend is expected to continue as the CMOS feature size progresses towards the nanometric dimension of 100 nm and less. SIA roadmap projects that, where as the DRAM chips will integrate over 20 billion devices in the next millennium, the future microprocessors may incorporate over 100 million transistors on a single chip. As the VLSI chip size increase, the limited accessibility of circuit components poses great difficulty for external diagnosis and replacement in the presence of faulty components. For this reason, extensive work has been done in built-in self-test techniques, but little research is known concerning built-in self-repair. Moreover, the extra hardware introduced by conventional fault-tolerance techniques is also likely to become faulty, therefore causing the circuit to be useless. This research demonstrates the feasibility of implementing electronic neural networks as intelligent hardware for memory array repair. Most importantly, we show that the neural network control possesses a robust and degradable computing capability under various fault conditions. Overall, a yield analysis performed on 64K DRAM's shows that the yield can be improved from as low as 20 percent to near 99 percent due to the self-repair design, with overhead no more than 7 percent.

Pulse-coupled neural nets: translation, rotation, scale, distortion, and intensity signal invariance for images.

Science.gov (United States)

Johnson, J L

1994-09-10

The linking-field neural network model of Eckhorn et al. [Neural Comput. 2, 293-307 (1990)] was introduced to explain the experimentally observed synchronous activity among neural assemblies in the cat cortex induced by feature-dependent visual activity. The model produces synchronous bursts of pulses from neurons with similar activity, effectively grouping them by phase and pulse frequency. It gives a basic new function: grouping by similarity. The synchronous bursts are obtained in the limit of strong linking strengths. The linking-field model in the limit of moderate-to-weak linking characterized by few if any multiple bursts is investigated. In this limit dynamic, locally periodic traveling waves exist whose time signal encodes the geometrical structure of a two-dimensional input image. The signal can be made insensitive to translation, scale, rotation, distortion, and intensity. The waves transmit information beyond the physical interconnect distance. The model is implemented in an optical hybrid demonstration system. Results of the simulations and the optical system are presented.

Automatic target recognition using a feature-based optical neural network

Science.gov (United States)

Chao, Tien-Hsin

1992-01-01

An optical neural network based upon the Neocognitron paradigm (K. Fukushima et al. 1983) is introduced. A novel aspect of the architectural design is shift-invariant multichannel Fourier optical correlation within each processing layer. Multilayer processing is achieved by iteratively feeding back the output of the feature correlator to the input spatial light modulator and updating the Fourier filters. By training the neural net with characteristic features extracted from the target images, successful pattern recognition with intra-class fault tolerance and inter-class discrimination is achieved. A detailed system description is provided. Experimental demonstration of a two-layer neural network for space objects discrimination is also presented.

Hybrid discrete-time neural networks.

Science.gov (United States)

Cao, Hongjun; Ibarz, Borja

2010-11-13

Hybrid dynamical systems combine evolution equations with state transitions. When the evolution equations are discrete-time (also called map-based), the result is a hybrid discrete-time system. A class of biological neural network models that has recently received some attention falls within this category: map-based neuron models connected by means of fast threshold modulation (FTM). FTM is a connection scheme that aims to mimic the switching dynamics of a neuron subject to synaptic inputs. The dynamic equations of the neuron adopt different forms according to the state (either firing or not firing) and type (excitatory or inhibitory) of their presynaptic neighbours. Therefore, the mathematical model of one such network is a combination of discrete-time evolution equations with transitions between states, constituting a hybrid discrete-time (map-based) neural network. In this paper, we review previous work within the context of these models, exemplifying useful techniques to analyse them. Typical map-based neuron models are low-dimensional and amenable to phase-plane analysis. In bursting models, fast-slow decomposition can be used to reduce dimensionality further, so that the dynamics of a pair of connected neurons can be easily understood. We also discuss a model that includes electrical synapses in addition to chemical synapses with FTM. Furthermore, we describe how master stability functions can predict the stability of synchronized states in these networks. The main results are extended to larger map-based neural networks.

Handbook of Brain Connectivity

CERN Document Server

Jirsa, Viktor K

2007-01-01

Our contemporary understanding of brain function is deeply rooted in the ideas of the nonlinear dynamics of distributed networks. Cognition and motor coordination seem to arise from the interactions of local neuronal networks, which themselves are connected in large scales across the entire brain. The spatial architectures between various scales inevitably influence the dynamics of the brain and thereby its function. But how can we integrate brain connectivity amongst these structural and functional domains? Our Handbook provides an account of the current knowledge on the measurement, analysis and theory of the anatomical and functional connectivity of the brain. All contributors are leading experts in various fields concerning structural and functional brain connectivity. In the first part of the Handbook, the chapters focus on an introduction and discussion of the principles underlying connected neural systems. The second part introduces the currently available non-invasive technologies for measuring struct...

Neural networks and its application in biomedical engineering

International Nuclear Information System (INIS)

Husnain, S.K.; Bhatti, M.I.

2002-01-01

Artificial network (ANNs) is an information processing system that has certain performance characteristics in common with biological neural networks. A neural network is characterized by connections between the neurons, method of determining the weights on the connections and its activation functions while a biological neuron has three types of components that are of particular interest in understanding an artificial neuron: its dendrites, soma, and axon. The actin of the chemical transmitter modifies the incoming signal. The study of neural networks is an extremely interdisciplinary field. Computer-based diagnosis is an increasingly used method that tries to improve the quality of health care. Systems on Neural Networks have been developed extensively in the last ten years with the hope that medical diagnosis and therefore medical care would improve dramatically. The addition of a symbolic processing layer enhances the ANNs in a number of ways. It is, for instance, possible to supplement a network that is purely diagnostic with a level that recommends or nodes in order to more closely simulate the nervous system. (author)

M&E-NetPay: A Micropayment System for Mobile and Electronic Commerce

Directory of Open Access Journals (Sweden)

Xiaodi Huang

2016-08-01

Full Text Available As an increasing number of people purchase goods and services online, micropayment systems are becoming particularly important for mobile and electronic commerce. We have designed and developed such a system called M&E-NetPay (Mobile and Electronic NetPay. With open interoperability and mobility, M&E-NetPay uses web services to connect brokers and vendors, providing secure, flexible and reliable credit services over the Internet. In particular, M&E-NetPay makes use of a secure, inexpensive and debit-based off-line protocol that allows vendors to interact only with customers, after validating coins. The design of the architecture and protocol of M&E-NetPay are presented, together with the implementation of its prototype in ringtone and wallpaper sites. To validate our system, we have conducted its evaluations on performance, usability and heuristics. Furthermore, we compare our system to the CORBA-based (Common Object Request Broker Architecture off-line micro-payment systems. The results have demonstrated that M&E-NetPay outperforms the .NET-based M&E-NetPay system in terms of performance and user satisfaction.

Neural-net predictor for beta limit disruptions in JT-60U

International Nuclear Information System (INIS)

Yoshino, R.

2005-01-01

Prediction of major disruptions occurring at the β -limit for tokamak plasmas with a normal magnetic shear in JT-60U was conducted using neural networks. Since no clear precursors are generally observed a few tens of milliseconds before the β -limit disruption, a sub-neural network is trained to output the value of the β N limit every 2 ms. The target β N limit is artificially set by the operator in the first step to train a network with non-disruptive shots as well as disruptive shots, and then in the second step the target limit is modified using the β N limit output from the trained network. The adjusted target greatly improves the consistency between the input data and the output. This training, the 'self-teaching method', has greatly reduced the false alarm rate triggered for non-disruptive shots. To improve the prediction performance further, the difference between the output β N limit and the measured β N , and 11 parameters, are inputted to the main neural network to calculate the 'stability level'. The occurrence of a major disruption is predicted when the stability level decreases to the 'alarm level'. Major disruptions at the β -limit have been predicted by the main network with a prediction success rate of 80% at 10 ms prior to the disruption while the false alarm rate is lower than 4% for non-disruptive shots. This 80% value is much higher than that obtained for a network trained with a fixed target β N limit set to be the maximum β N observed at the start of a major disruption, lower than 10%. A prediction success rate of 90% with a false alarm rate of 12% at 10 ms prior to the disruption has also been obtained. This 12% value is about half of that obtained for a network trained with a fixed target β N limit

Neural Networks for Self-tuning Control Systems

Directory of Open Access Journals (Sweden)

A. Noriega Ponce

2004-01-01

Full Text Available In this paper, we presented a self-tuning control algorithm based on a three layers perceptron type neural network. The proposed algorithm is advantageous in the sense that practically a previous training of the net is not required and some changes in the set-point are generally enough to adjust the learning coefficient. Optionally, it is possible to introduce a self-tuning mechanism of the learning coefficient although by the moment it is not possible to give final conclusions about this possibility. The proposed algorithm has the special feature that the regulation error instead of the net output error is retropropagated for the weighting coefficients modifications. 

Diagnosing Autism Spectrum Disorder from Brain Resting-State Functional Connectivity Patterns Using a Deep Neural Network with a Novel Feature Selection Method.

Science.gov (United States)

Guo, Xinyu; Dominick, Kelli C; Minai, Ali A; Li, Hailong; Erickson, Craig A; Lu, Long J

2017-01-01

The whole-brain functional connectivity (FC) pattern obtained from resting-state functional magnetic resonance imaging data are commonly applied to study neuropsychiatric conditions such as autism spectrum disorder (ASD) by using different machine learning models. Recent studies indicate that both hyper- and hypo- aberrant ASD-associated FCs were widely distributed throughout the entire brain rather than only in some specific brain regions. Deep neural networks (DNN) with multiple hidden layers have shown the ability to systematically extract lower-to-higher level information from high dimensional data across a series of neural hidden layers, significantly improving classification accuracy for such data. In this study, a DNN with a novel feature selection method (DNN-FS) is developed for the high dimensional whole-brain resting-state FC pattern classification of ASD patients vs. typical development (TD) controls. The feature selection method is able to help the DNN generate low dimensional high-quality representations of the whole-brain FC patterns by selecting features with high discriminating power from multiple trained sparse auto-encoders. For the comparison, a DNN without the feature selection method (DNN-woFS) is developed, and both of them are tested with different architectures (i.e., with different numbers of hidden layers/nodes). Results show that the best classification accuracy of 86.36% is generated by the DNN-FS approach with 3 hidden layers and 150 hidden nodes (3/150). Remarkably, DNN-FS outperforms DNN-woFS for all architectures studied. The most significant accuracy improvement was 9.09% with the 3/150 architecture. The method also outperforms other feature selection methods, e.g., two sample t -test and elastic net. In addition to improving the classification accuracy, a Fisher's score-based biomarker identification method based on the DNN is also developed, and used to identify 32 FCs related to ASD. These FCs come from or cross different pre

Diagnosing Autism Spectrum Disorder from Brain Resting-State Functional Connectivity Patterns Using a Deep Neural Network with a Novel Feature Selection Method

Directory of Open Access Journals (Sweden)

Xinyu Guo

2017-08-01

Full Text Available The whole-brain functional connectivity (FC pattern obtained from resting-state functional magnetic resonance imaging data are commonly applied to study neuropsychiatric conditions such as autism spectrum disorder (ASD by using different machine learning models. Recent studies indicate that both hyper- and hypo- aberrant ASD-associated FCs were widely distributed throughout the entire brain rather than only in some specific brain regions. Deep neural networks (DNN with multiple hidden layers have shown the ability to systematically extract lower-to-higher level information from high dimensional data across a series of neural hidden layers, significantly improving classification accuracy for such data. In this study, a DNN with a novel feature selection method (DNN-FS is developed for the high dimensional whole-brain resting-state FC pattern classification of ASD patients vs. typical development (TD controls. The feature selection method is able to help the DNN generate low dimensional high-quality representations of the whole-brain FC patterns by selecting features with high discriminating power from multiple trained sparse auto-encoders. For the comparison, a DNN without the feature selection method (DNN-woFS is developed, and both of them are tested with different architectures (i.e., with different numbers of hidden layers/nodes. Results show that the best classification accuracy of 86.36% is generated by the DNN-FS approach with 3 hidden layers and 150 hidden nodes (3/150. Remarkably, DNN-FS outperforms DNN-woFS for all architectures studied. The most significant accuracy improvement was 9.09% with the 3/150 architecture. The method also outperforms other feature selection methods, e.g., two sample t-test and elastic net. In addition to improving the classification accuracy, a Fisher's score-based biomarker identification method based on the DNN is also developed, and used to identify 32 FCs related to ASD. These FCs come from or cross

Anomaly detection in an automated safeguards system using neural networks

International Nuclear Information System (INIS)

Whiteson, R.; Howell, J.A.

1992-01-01

An automated safeguards system must be able to detect an anomalous event, identify the nature of the event, and recommend a corrective action. Neural networks represent a new way of thinking about basic computational mechanisms for intelligent information processing. In this paper, we discuss the issues involved in applying a neural network model to the first step of this process: anomaly detection in materials accounting systems. We extend our previous model to a 3-tank problem and compare different neural network architectures and algorithms. We evaluate the computational difficulties in training neural networks and explore how certain design principles affect the problems. The issues involved in building a neural network architecture include how the information flows, how the network is trained, how the neurons in a network are connected, how the neurons process information, and how the connections between neurons are modified. Our approach is based on the demonstrated ability of neural networks to model complex, nonlinear, real-time processes. By modeling the normal behavior of the processes, we can predict how a system should be behaving and, therefore, detect when an abnormality occurs

Petri neural network model for the effect of controlled thermomechanical process parameters on the mechanical properties of HSLA steels

Energy Technology Data Exchange (ETDEWEB)

Datta, S.

1999-10-01

The effect of composition and controlled thermomechanical process parameters on the mechanical properties of HSLA steels is modelled using the Widrow-Hoff's concept of training a neural net with feed-forward topology by applying Rumelhart's back propagation type algorithm for supervised learning, using a Petri like net structure. The data used are from laboratory experiments as well as from the published literature. The results from the neural network are found to be consistent and in good agreement with the experimented results. (author)

An improved superconducting neural circuit and its application for a neural network solving a combinatorial optimization problem

International Nuclear Information System (INIS)

Onomi, T; Nakajima, K

2014-01-01

We have proposed a superconducting Hopfield-type neural network for solving the N-Queens problem which is one of combinatorial optimization problems. The sigmoid-shape function of a neuron output is represented by the output of coupled SQUIDs gate consisting of a single-junction and a double-junction SQUIDs. One of the important factors for an improvement of the network performance is an improvement of a threshold characteristic of a neuron circuit. In this paper, we report an improved design of coupled SQUID gates for a superconducting neural network. A step-like function with a steep threshold at a rising edge is desirable for a neuron circuit to solve a combinatorial optimization problem. A neuron circuit is composed of two coupled SQUIDs gates with a cascade connection in order to obtain such characteristics. The designed neuron circuit is fabricated by a 2.5 kA/cm 2 Nb/AlOx/Nb process. The operation of a fabricated neuron circuit is experimentally demonstrated. Moreover, we discuss about the performance of the neural network using the improved neuron circuits and delayed negative self-connections.

The neural basis of trait self-esteem revealed by the amplitude of low-frequency fluctuations and resting state functional connectivity.

Science.gov (United States)

Pan, Weigang; Liu, Congcong; Yang, Qian; Gu, Yan; Yin, Shouhang; Chen, Antao

2016-03-01

Self-esteem is an affective, self-evaluation of oneself and has a significant effect on mental and behavioral health. Although research has focused on the neural substrates of self-esteem, little is known about the spontaneous brain activity that is associated with trait self-esteem (TSE) during the resting state. In this study, we used the resting-state functional magnetic resonance imaging (fMRI) signal of the amplitude of low-frequency fluctuations (ALFFs) and resting state functional connectivity (RSFC) to identify TSE-related regions and networks. We found that a higher level of TSE was associated with higher ALFFs in the left ventral medial prefrontal cortex (vmPFC) and lower ALFFs in the left cuneus/lingual gyrus and right lingual gyrus. RSFC analyses revealed that the strengths of functional connectivity between the left vmPFC and bilateral hippocampus were positively correlated with TSE; however, the connections between the left vmPFC and right inferior frontal gyrus and posterior superior temporal sulcus were negatively associated with TSE. Furthermore, the strengths of functional connectivity between the left cuneus/lingual gyrus and right dorsolateral prefrontal cortex and anterior cingulate cortex were positively related to TSE. These findings indicate that TSE is linked to core regions in the default mode network and social cognition network, which is involved in self-referential processing, autobiographical memory and social cognition. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Grid-Connected Distributed Generation: Compensation Mechanism Basics

Energy Technology Data Exchange (ETDEWEB)

Aznar, Alexandra Y [National Renewable Energy Laboratory (NREL), Golden, CO (United States); ; ; ; Zinaman, Owen R [National Renewable Energy Laboratory (NREL), Golden, CO (United States)

2017-10-02

This short report defines compensation mechanisms for grid-connected, behind-the-meter distributed generation (DG) systems as instruments that comprise three core elements: (1) metering and billing arrangements, (2) sell rate design, and (3) retail rate design. This report describes metering and billing arrangements, with some limited discussion of sell rate design. We detail the three possible arrangements for metering and billing of DG: net energy metering (NEM); buy all, sell all; and net billing.

Measuring symmetry, asymmetry and randomness in neural network connectivity.

Directory of Open Access Journals (Sweden)

Umberto Esposito

Full Text Available Cognitive functions are stored in the connectome, the wiring diagram of the brain, which exhibits non-random features, so-called motifs. In this work, we focus on bidirectional, symmetric motifs, i.e. two neurons that project to each other via connections of equal strength, and unidirectional, non-symmetric motifs, i.e. within a pair of neurons only one neuron projects to the other. We hypothesise that such motifs have been shaped via activity dependent synaptic plasticity processes. As a consequence, learning moves the distribution of the synaptic connections away from randomness. Our aim is to provide a global, macroscopic, single parameter characterisation of the statistical occurrence of bidirectional and unidirectional motifs. To this end we define a symmetry measure that does not require any a priori thresholding of the weights or knowledge of their maximal value. We calculate its mean and variance for random uniform or Gaussian distributions, which allows us to introduce a confidence measure of how significantly symmetric or asymmetric a specific configuration is, i.e. how likely it is that the configuration is the result of chance. We demonstrate the discriminatory power of our symmetry measure by inspecting the eigenvalues of different types of connectivity matrices. We show that a Gaussian weight distribution biases the connectivity motifs to more symmetric configurations than a uniform distribution and that introducing a random synaptic pruning, mimicking developmental regulation in synaptogenesis, biases the connectivity motifs to more asymmetric configurations, regardless of the distribution. We expect that our work will benefit the computational modelling community, by providing a systematic way to characterise symmetry and asymmetry in network structures. Further, our symmetry measure will be of use to electrophysiologists that investigate symmetry of network connectivity.

Measuring symmetry, asymmetry and randomness in neural network connectivity.

Science.gov (United States)

Esposito, Umberto; Giugliano, Michele; van Rossum, Mark; Vasilaki, Eleni

2014-01-01

Cognitive functions are stored in the connectome, the wiring diagram of the brain, which exhibits non-random features, so-called motifs. In this work, we focus on bidirectional, symmetric motifs, i.e. two neurons that project to each other via connections of equal strength, and unidirectional, non-symmetric motifs, i.e. within a pair of neurons only one neuron projects to the other. We hypothesise that such motifs have been shaped via activity dependent synaptic plasticity processes. As a consequence, learning moves the distribution of the synaptic connections away from randomness. Our aim is to provide a global, macroscopic, single parameter characterisation of the statistical occurrence of bidirectional and unidirectional motifs. To this end we define a symmetry measure that does not require any a priori thresholding of the weights or knowledge of their maximal value. We calculate its mean and variance for random uniform or Gaussian distributions, which allows us to introduce a confidence measure of how significantly symmetric or asymmetric a specific configuration is, i.e. how likely it is that the configuration is the result of chance. We demonstrate the discriminatory power of our symmetry measure by inspecting the eigenvalues of different types of connectivity matrices. We show that a Gaussian weight distribution biases the connectivity motifs to more symmetric configurations than a uniform distribution and that introducing a random synaptic pruning, mimicking developmental regulation in synaptogenesis, biases the connectivity motifs to more asymmetric configurations, regardless of the distribution. We expect that our work will benefit the computational modelling community, by providing a systematic way to characterise symmetry and asymmetry in network structures. Further, our symmetry measure will be of use to electrophysiologists that investigate symmetry of network connectivity.

Renewal of K-NET (National Strong-motion Observation Network of Japan)

Science.gov (United States)

Kunugi, T.; Fujiwara, H.; Aoi, S.; Adachi, S.

2004-12-01

The National Research Institute for Earth Science and Disaster Prevention (NIED) operates K-NET (Kyoshin Network), the national strong-motion observation network, which evenly covers the whole of Japan at intervals of 25 km on average. K-NET was constructed after the Hyogoken-Nambu (Kobe) earthquake in January 1995, and began operation in June 1996. Thus, eight years have passed since K-NET started, and large amounts of strong-motion records have been obtained. As technology has progressed and new technologies have become available, NIED has developed a new K-NET with improved functionality. New seismographs have been installed at 443 observatories mainly in southwestern Japan where there is a risk of strong-motion due to the Nankai and Tonankai earthquakes. The new system went into operation in June 2004, although seismographs have still to be replaced in other areas. The new seismograph (K-NET02) consists of a sensor module, a measurement module and a communication module. A UPS, a GPS antenna and a dial-up router are also installed together with a K-NET02. A triaxial accelerometer, FBA-ES-DECK (Kinemetrics Inc.) is built into the sensor module. The measurement module functions as a conventional strong-motion seismograph for high-precision observation. The communication module can perform sophisticated processes, such as calculation of the Japan Meteorological Agency (JMA) seismic intensity, continuous recording of data and near real-time data transmission. It connects to the Data Management Center (DMC) using an ISDN line. In case of a power failure, the measurement module can control the power supply to the router and the communication module to conserve battery power. One of the main features of K-NET02 is a function for processing JMA seismic intensity. K-NET02 functions as a proper seismic intensity meter that complies with the official requirements of JMA, although the old strong-motion seismograph (K-NET95) does not calculate seismic intensity. Another

IR wireless cluster synapses of HYDRA very large neural networks

Science.gov (United States)

Jannson, Tomasz; Forrester, Thomas

2008-04-01

RF/IR wireless (virtual) synapses are critical components of HYDRA (Hyper-Distributed Robotic Autonomy) neural networks, already discussed in two earlier papers. The HYDRA network has the potential to be very large, up to 10 11-neurons and 10 18-synapses, based on already established technologies (cellular RF telephony and IR-wireless LANs). It is organized into almost fully connected IR-wireless clusters. The HYDRA neurons and synapses are very flexible, simple, and low-cost. They can be modified into a broad variety of biologically-inspired brain-like computing capabilities. In this third paper, we focus on neural hardware in general, and on IR-wireless synapses in particular. Such synapses, based on LED/LD-connections, dominate the HYDRA neural cluster.

Deep nets vs expert designed features in medical physics: An IMRT QA case study.

Science.gov (United States)

Interian, Yannet; Rideout, Vincent; Kearney, Vasant P; Gennatas, Efstathios; Morin, Olivier; Cheung, Joey; Solberg, Timothy; Valdes, Gilmer

2018-03-30

The purpose of this study was to compare the performance of Deep Neural Networks against a technique designed by domain experts in the prediction of gamma passing rates for Intensity Modulated Radiation Therapy Quality Assurance (IMRT QA). A total of 498 IMRT plans across all treatment sites were planned in Eclipse version 11 and delivered using a dynamic sliding window technique on Clinac iX or TrueBeam Linacs. Measurements were performed using a commercial 2D diode array, and passing rates for 3%/3 mm local dose/distance-to-agreement (DTA) were recorded. Separately, fluence maps calculated for each plan were used as inputs to a convolution neural network (CNN). The CNNs were trained to predict IMRT QA gamma passing rates using TensorFlow and Keras. A set of model architectures, inspired by the convolutional blocks of the VGG-16 ImageNet model, were constructed and implemented. Synthetic data, created by rotating and translating the fluence maps during training, was created to boost the performance of the CNNs. Dropout, batch normalization, and data augmentation were utilized to help train the model. The performance of the CNNs was compared to a generalized Poisson regression model, previously developed for this application, which used 78 expert designed features. Deep Neural Networks without domain knowledge achieved comparable performance to a baseline system designed by domain experts in the prediction of 3%/3 mm Local gamma passing rates. An ensemble of neural nets resulted in a mean absolute error (MAE) of 0.70 ± 0.05 and the domain expert model resulted in a 0.74 ± 0.06. Convolutional neural networks (CNNs) with transfer learning can predict IMRT QA passing rates by automatically designing features from the fluence maps without human expert supervision. Predictions from CNNs are comparable to a system carefully designed by physicist experts. © 2018 American Association of Physicists in Medicine.

Abnormal resting-state connectivity of motor and cognitive networks in early manifest Huntington's disease.

Science.gov (United States)

Wolf, R C; Sambataro, F; Vasic, N; Depping, M S; Thomann, P A; Landwehrmeyer, G B; Süssmuth, S D; Orth, M

2014-11-01

Functional magnetic resonance imaging (fMRI) of multiple neural networks during the brain's 'resting state' could facilitate biomarker development in patients with Huntington's disease (HD) and may provide new insights into the relationship between neural dysfunction and clinical symptoms. To date, however, very few studies have examined the functional integrity of multiple resting state networks (RSNs) in manifest HD, and even less is known about whether concomitant brain atrophy affects neural activity in patients. Using MRI, we investigated brain structure and RSN function in patients with early HD (n = 20) and healthy controls (n = 20). For resting-state fMRI data a group-independent component analysis identified spatiotemporally distinct patterns of motor and prefrontal RSNs of interest. We used voxel-based morphometry to assess regional brain atrophy, and 'biological parametric mapping' analyses to investigate the impact of atrophy on neural activity. Compared with controls, patients showed connectivity changes within distinct neural systems including lateral prefrontal, supplementary motor, thalamic, cingulate, temporal and parietal regions. In patients, supplementary motor area and cingulate cortex connectivity indices were associated with measures of motor function, whereas lateral prefrontal connectivity was associated with cognition. This study provides evidence for aberrant connectivity of RSNs associated with motor function and cognition in early manifest HD when controlling for brain atrophy. This suggests clinically relevant changes of RSN activity in the presence of HD-associated cortical and subcortical structural abnormalities.

Resting-state hemodynamics are spatiotemporally coupled to synchronized and symmetric neural activity in excitatory neurons

Science.gov (United States)

Ma, Ying; Shaik, Mohammed A.; Kozberg, Mariel G.; Portes, Jacob P.; Timerman, Dmitriy

2016-01-01

Brain hemodynamics serve as a proxy for neural activity in a range of noninvasive neuroimaging techniques including functional magnetic resonance imaging (fMRI). In resting-state fMRI, hemodynamic fluctuations have been found to exhibit patterns of bilateral synchrony, with correlated regions inferred to have functional connectivity. However, the relationship between resting-state hemodynamics and underlying neural activity has not been well established, making the neural underpinnings of functional connectivity networks unclear. In this study, neural activity and hemodynamics were recorded simultaneously over the bilateral cortex of awake and anesthetized Thy1-GCaMP mice using wide-field optical mapping. Neural activity was visualized via selective expression of the calcium-sensitive fluorophore GCaMP in layer 2/3 and 5 excitatory neurons. Characteristic patterns of resting-state hemodynamics were accompanied by more rapidly changing bilateral patterns of resting-state neural activity. Spatiotemporal hemodynamics could be modeled by convolving this neural activity with hemodynamic response functions derived through both deconvolution and gamma-variate fitting. Simultaneous imaging and electrophysiology confirmed that Thy1-GCaMP signals are well-predicted by multiunit activity. Neurovascular coupling between resting-state neural activity and hemodynamics was robust and fast in awake animals, whereas coupling in urethane-anesthetized animals was slower, and in some cases included lower-frequency (resting-state hemodynamics in the awake and anesthetized brain are coupled to underlying patterns of excitatory neural activity. The patterns of bilaterally-symmetric spontaneous neural activity revealed by wide-field Thy1-GCaMP imaging may depict the neural foundation of functional connectivity networks detected in resting-state fMRI. PMID:27974609

Experience of a Neural Network Imitator Applied to Diagnosis of Pre-pathological Conditions in Humans

International Nuclear Information System (INIS)

Belyashov, D.N.; Emelyanova, I.V.; Tichshenko, A.V.; Makarenko, N.G.; Sultanova, B.G.

1998-01-01

The Governmental Resolution of the RK 'Program of Medical Rehabilitation for People Influenced by Nuclear Tests at STS in 1949-1990' was published in March 1997. Implementation of the program requires first of all to create the effective methods of operative diagnostics of arid zones' population. To our mind, for this aims systems analysis with elements of neural network classification is more effective. We demonstrate such an approach using the example of the modem diagnostics system creating to detect the pre-pathological states among population by express analysis and personal particulars. The following considerations were used in the base of the training set: 1) any formalism must be based oneself upon wealth of phenomenology (experience, intuition, the presence of symptoms); 2) typical attributes of disease can be divided on 2 groups - subjective and objective. The common state of patient is characterised by the first group and it can have no intercommunication with disease. The second one is obtained by laboratory inspection and it is not connected with patient sensations. Each of the objective at-tributes can be the attribute of several illnesses at once. In this case both the subjective and objective features must be used together; 3) acceptability of any scheme can be substantiated only statistically. The question about justifiability and sufficiency of training set always demands separate discussion. Personal particulars are more available for creating training set. The set must be professionally oriented in order to reduce of selection effects. For our experiment the fully-connected neural network ( computer software, imitating the work of neural computer) 'Multi Neuron' was chosen. Feature space using for the net work was created from the 206 personal particulars. The research aimed to determine pre-pathological states of the urinary system organs among industrial, office and professional workers in the mining industry connected with phosphorus

SCYNet. Testing supersymmetric models at the LHC with neural networks

Energy Technology Data Exchange (ETDEWEB)

Bechtle, Philip; Belkner, Sebastian; Hamer, Matthias [Universitaet Bonn, Bonn (Germany); Dercks, Daniel [Universitaet Hamburg, Hamburg (Germany); Keller, Tim; Kraemer, Michael; Sarrazin, Bjoern; Schuette-Engel, Jan; Tattersall, Jamie [RWTH Aachen University, Institute for Theoretical Particle Physics and Cosmology, Aachen (Germany)

2017-10-15

SCYNet (SUSY Calculating Yield Net) is a tool for testing supersymmetric models against LHC data. It uses neural network regression for a fast evaluation of the profile likelihood ratio. Two neural network approaches have been developed: one network has been trained using the parameters of the 11-dimensional phenomenological Minimal Supersymmetric Standard Model (pMSSM-11) as an input and evaluates the corresponding profile likelihood ratio within milliseconds. It can thus be used in global pMSSM-11 fits without time penalty. In the second approach, the neural network has been trained using model-independent signature-related objects, such as energies and particle multiplicities, which were estimated from the parameters of a given new physics model. (orig.)

The neural cell adhesion molecule

DEFF Research Database (Denmark)

Berezin, V; Bock, E; Poulsen, F M

2000-01-01

During the past year, the understanding of the structure and function of neural cell adhesion has advanced considerably. The three-dimensional structures of several of the individual modules of the neural cell adhesion molecule (NCAM) have been determined, as well as the structure of the complex...... between two identical fragments of the NCAM. Also during the past year, a link between homophilic cell adhesion and several signal transduction pathways has been proposed, connecting the event of cell surface adhesion to cellular responses such as neurite outgrowth. Finally, the stimulation of neurite...

Changes in resting neural connectivity during propofol sedation.

Directory of Open Access Journals (Sweden)

Emmanuel A Stamatakis

2010-12-01

Full Text Available The default mode network consists of a set of functionally connected brain regions (posterior cingulate, medial prefrontal cortex and bilateral parietal cortex maximally active in functional imaging studies under "no task" conditions. It has been argued that the posterior cingulate is important in consciousness/awareness, but previous investigations of resting interactions between the posterior cingulate cortex and other brain regions during sedation and anesthesia have produced inconsistent results.We examined the connectivity of the posterior cingulate at different levels of consciousness. "No task" fMRI (BOLD data were collected from healthy volunteers while awake and at low and moderate levels of sedation, induced by the anesthetic agent propofol. Our data show that connectivity of the posterior cingulate changes during sedation to include areas that are not traditionally considered to be part of the default mode network, such as the motor/somatosensory cortices, the anterior thalamic nuclei, and the reticular activating system.This neuroanatomical signature resembles that of non-REM sleep, and may be evidence for a system that reduces its discriminable states and switches into more stereotypic patterns of firing under sedation.

Neural crest does not contribute to the neck and shoulder in the axolotl (Ambystoma mexicanum).

Science.gov (United States)

Epperlein, Hans-Henning; Khattak, Shahryar; Knapp, Dunja; Tanaka, Elly M; Malashichev, Yegor B

2012-01-01

A major step during the evolution of tetrapods was their transition from water to land. This process involved the reduction or complete loss of the dermal bones that made up connections to the skull and a concomitant enlargement of the endochondral shoulder girdle. In the mouse the latter is derived from three separate embryonic sources: lateral plate mesoderm, somites, and neural crest. The neural crest was suggested to sustain the muscle attachments. How this complex composition of the endochondral shoulder girdle arose during evolution and whether it is shared by all tetrapods is unknown. Salamanders that lack dermal bone within their shoulder girdle were of special interest for a possible contribution of the neural crest to the endochondral elements and muscle attachment sites, and we therefore studied them in this context. We grafted neural crest from GFP+ fluorescent transgenic axolotl (Ambystoma mexicanum) donor embryos into white (d/d) axolotl hosts and followed the presence of neural crest cells within the cartilage of the shoulder girdle and the connective tissue of muscle attachment sites of the neck-shoulder region. Strikingly, neural crest cells did not contribute to any part of the endochondral shoulder girdle or to the connective tissue at muscle attachment sites in axolotl. Our results in axolotl suggest that neural crest does not serve a general function in vertebrate shoulder muscle attachment sites as predicted by the "muscle scaffold theory," and that it is not necessary to maintain connectivity of the endochondral shoulder girdle to the skull. Our data support the possibility that the contribution of the neural crest to the endochondral shoulder girdle, which is observed in the mouse, arose de novo in mammals as a developmental basis for their skeletal synapomorphies. This further supports the hypothesis of an increased neural crest diversification during vertebrate evolution.

Neural crest does not contribute to the neck and shoulder in the axolotl (Ambystoma mexicanum.

Directory of Open Access Journals (Sweden)

Hans-Henning Epperlein

Full Text Available BACKGROUND: A major step during the evolution of tetrapods was their transition from water to land. This process involved the reduction or complete loss of the dermal bones that made up connections to the skull and a concomitant enlargement of the endochondral shoulder girdle. In the mouse the latter is derived from three separate embryonic sources: lateral plate mesoderm, somites, and neural crest. The neural crest was suggested to sustain the muscle attachments. How this complex composition of the endochondral shoulder girdle arose during evolution and whether it is shared by all tetrapods is unknown. Salamanders that lack dermal bone within their shoulder girdle were of special interest for a possible contribution of the neural crest to the endochondral elements and muscle attachment sites, and we therefore studied them in this context. RESULTS: We grafted neural crest from GFP+ fluorescent transgenic axolotl (Ambystoma mexicanum donor embryos into white (d/d axolotl hosts and followed the presence of neural crest cells within the cartilage of the shoulder girdle and the connective tissue of muscle attachment sites of the neck-shoulder region. Strikingly, neural crest cells did not contribute to any part of the endochondral shoulder girdle or to the connective tissue at muscle attachment sites in axolotl. CONCLUSIONS: Our results in axolotl suggest that neural crest does not serve a general function in vertebrate shoulder muscle attachment sites as predicted by the "muscle scaffold theory," and that it is not necessary to maintain connectivity of the endochondral shoulder girdle to the skull. Our data support the possibility that the contribution of the neural crest to the endochondral shoulder girdle, which is observed in the mouse, arose de novo in mammals as a developmental basis for their skeletal synapomorphies. This further supports the hypothesis of an increased neural crest diversification during vertebrate evolution.

Fastest learning in small-world neural networks

International Nuclear Information System (INIS)

Simard, D.; Nadeau, L.; Kroeger, H.

2005-01-01

We investigate supervised learning in neural networks. We consider a multi-layered feed-forward network with back propagation. We find that the network of small-world connectivity reduces the learning error and learning time when compared to the networks of regular or random connectivity. Our study has potential applications in the domain of data-mining, image processing, speech recognition, and pattern recognition

Llgl1 Connects Cell Polarity with Cell-Cell Adhesion in Embryonic Neural Stem Cells.

Science.gov (United States)

Jossin, Yves; Lee, Minhui; Klezovitch, Olga; Kon, Elif; Cossard, Alexia; Lien, Wen-Hui; Fernandez, Tania E; Cooper, Jonathan A; Vasioukhin, Valera

2017-06-05

Malformations of the cerebral cortex (MCCs) are devastating developmental disorders. We report here that mice with embryonic neural stem-cell-specific deletion of Llgl1 (Nestin-Cre/Llgl1 fl/fl ), a mammalian ortholog of the Drosophila cell polarity gene lgl, exhibit MCCs resembling severe periventricular heterotopia (PH). Immunohistochemical analyses and live cortical imaging of PH formation revealed that disruption of apical junctional complexes (AJCs) was responsible for PH in Nestin-Cre/Llgl1 fl/fl brains. While it is well known that cell polarity proteins govern the formation of AJCs, the exact mechanisms remain unclear. We show that LLGL1 directly binds to and promotes internalization of N-cadherin, and N-cadherin/LLGL1 interaction is inhibited by atypical protein kinase C-mediated phosphorylation of LLGL1, restricting the accumulation of AJCs to the basolateral-apical boundary. Disruption of the N-cadherin-LLGL1 interaction during cortical development in vivo is sufficient for PH. These findings reveal a mechanism responsible for the physical and functional connection between cell polarity and cell-cell adhesion machineries in mammalian cells. Copyright © 2017 Elsevier Inc. All rights reserved.

Front Propagation in Stochastic Neural Fields

KAUST Repository

Bressloff, Paul C.; Webber, Matthew A.

2012-01-01

We analyze the effects of extrinsic multiplicative noise on front propagation in a scalar neural field with excitatory connections. Using a separation of time scales, we represent the fluctuating front in terms of a diffusive-like displacement

Automated Understanding of Financial Statements Using Neural Networks and Semantic Grammars

OpenAIRE

Markovitch, J. S.

1995-01-01

This article discusses how neural networks and semantic grammars may be used to locate and understand financial statements embedded in news stories received from on-line news wires. A neural net is used to identify where in the news story a financial statement appears to begin. A grammar then is applied to this text in an effort to extract specific facts from the financial statement. Applying grammars to financial statements presents unique parsing problems since the dollar amounts of financi...

Neural estimation of kinetic rate constants from dynamic PET-scans

DEFF Research Database (Denmark)

Fog, Torben L.; Nielsen, Lars Hupfeldt; Hansen, Lars Kai

1994-01-01

A feedforward neural net is trained to invert a simple three compartment model describing the tracer kinetics involved in the metabolism of [18F]fluorodeoxyglucose in the human brain. The network can estimate rate constants from positron emission tomography sequences and is about 50 times faster ...

Neural substrates of reliability-weighted visual-tactile multisensory integration

Directory of Open Access Journals (Sweden)

Michael S Beauchamp

2010-06-01

Full Text Available As sensory systems deteriorate in aging or disease, the brain must relearn the appropriate weights to assign each modality during multisensory integration. Using blood-oxygen level dependent functional magnetic resonance imaging (BOLD fMRI of human subjects, we tested a model for the neural mechanisms of sensory weighting, termed “weighted connections”. This model holds that the connection weights between early and late areas vary depending on the reliability of the modality, independent of the level of early sensory cortex activity. When subjects detected viewed and felt touches to the hand, a network of brain areas was active, including visual areas in lateral occipital cortex, somatosensory areas in inferior parietal lobe, and multisensory areas in the intraparietal sulcus (IPS. In agreement with the weighted connection model, the connection weight measured with structural equation modeling between somatosensory cortex and IPS increased for somatosensory-reliable stimuli, and the connection weight between visual cortex and IPS increased for visual-reliable stimuli. This double dissociation of connection strengths was similar to the pattern of behavioral responses during incongruent multisensory stimulation, suggesting that weighted connections may be a neural mechanism for behavioral reliability weighting.for behavioral reliability weighting.

Investment Valuation Analysis with Artificial Neural Networks

Directory of Open Access Journals (Sweden)

Hüseyin İNCE

2017-07-01

Full Text Available This paper shows that discounted cash flow and net present value, which are traditional investment valuation models, can be combined with artificial neural network model forecasting. The main inputs for the valuation models, such as revenue, costs, capital expenditure, and their growth rates, are heavily related to sector dynamics and macroeconomics. The growth rates of those inputs are related to inflation and exchange rates. Therefore, predicting inflation and exchange rates is a critical issue for the valuation output. In this paper, the Turkish economy’s inflation rate and the exchange rate of USD/TRY are forecast by artificial neural networks and implemented to the discounted cash flow model. Finally, the results are benchmarked with conventional practices.

Schaffer collateral inputs to CA1 excitatory and inhibitory neurons follow different connectivity rules.

Science.gov (United States)

Kwon, Osung; Feng, Linqing; Druckmann, Shaul; Kim, Jinhyun

2018-05-04

Neural circuits, governed by a complex interplay between excitatory and inhibitory neurons, are the substrate for information processing, and the organization of synaptic connectivity in neural network is an important determinant of circuit function. Here, we analyzed the fine structure of connectivity in hippocampal CA1 excitatory and inhibitory neurons innervated by Schaffer collaterals (SCs) using mGRASP in male mice. Our previous study revealed spatially structured synaptic connectivity between CA3-CA1 pyramidal cells (PCs). Surprisingly, parvalbumin-positive interneurons (PVs) showed a significantly more random pattern spatial structure. Notably, application of Peters' Rule for synapse prediction by random overlap between axons and dendrites enhanced structured connectivity in PCs, but, by contrast, made the connectivity pattern in PVs more random. In addition, PCs in a deep sublayer of striatum pyramidale appeared more highly structured than PCs in superficial layers, and little or no sublayer specificity was found in PVs. Our results show that CA1 excitatory PCs and inhibitory PVs innervated by the same SC inputs follow different connectivity rules. The different organizations of fine scale structured connectivity in hippocampal excitatory and inhibitory neurons provide important insights into the development and functions of neural networks. SIGNIFICANCE STATEMENT Understanding how neural circuits generate behavior is one of the central goals of neuroscience. An important component of this endeavor is the mapping of fine-scale connection patterns that underlie, and help us infer, signal processing in the brain. Here, using our recently developed synapse detection technology (mGRASP and neuTube), we provide detailed profiles of synaptic connectivity in excitatory (CA1 pyramidal) and inhibitory (CA1 parvalbumin-positive) neurons innervated by the same presynaptic inputs (CA3 Schaffer collaterals). Our results reveal that these two types of CA1 neurons follow

Application and Simulation of Fuzzy Neural Network PID Controller in the Aircraft Cabin Temperature

Directory of Open Access Journals (Sweden)

Ding Fang

2013-06-01

Full Text Available Considering complex factors of affecting ambient temperature in Aircraft cabin, and some shortages of traditional PID control like the parameters difficult to be tuned and control ineffective, this paper puts forward the intelligent PID algorithm that makes fuzzy logic method and neural network together, scheming out the fuzzy neural net PID controller. After the correction of the fuzzy inference and dynamic learning of neural network, PID parameters of the controller get the optimal parameters. MATLAB simulation results of the cabin temperature control model show that the performance of the fuzzy neural network PID controller has been greatly improved, with faster response, smaller overshoot and better adaptability.

Synaptic plasticity in a recurrent neural network for versatile and adaptive behaviors of a walking robot

DEFF Research Database (Denmark)

Grinke, Eduard; Tetzlaff, Christian; Wörgötter, Florentin

2015-01-01

correlation-based learning with synaptic scaling is applied to adequately change the connections of the network. By doing so, we can effectively exploit neural dynamics (i.e., hysteresis effects and single attractors) in the network to generate different turning angles with short-term memory for a walking...... dynamics, plasticity, sensory feedback, and biomechanics. Generating such versatile and adaptive behaviors for a many degrees-of-freedom (DOFs) walking robot is a challenging task. Thus, in this study, we present a bio-inspired approach to solve this task. Specifically, the approach combines neural...... mechanisms with plasticity, exteroceptive sensory feedback, and biomechanics. The neural mechanisms consist of adaptive neural sensory processing and modular neural locomotion control. The sensory processing is based on a small recurrent neural network consisting of two fully connected neurons. Online...

Experience with the construction of the cable net cooling tower at Schmehausen

International Nuclear Information System (INIS)

Erdmann, W.

1977-01-01

The static system of the cooling tower consists of a concrete column 181 metres high from which a 145 meter high cable with a base diameter of 141 metres is suspended and tensioned. The cable net is covered on the inside with aluminium sheeting. Banks of tubes, which constitute the actual coding system, are arranged in the form of rings around the column in a self-supporting structure. Of the very wide range of problems which occurred in the construction of this cooling tower, the following are discussed in the paper: 1) Stressing of the concrete column during the construction period. 2) Stiffening the net using separation rings. 3) Net connection points on the ring foundation. 4) Control of the cable forces and the cable net geometry. 5) Start of sheeting erection. (orig.) [de

Classification of breast cancer cytological specimen using convolutional neural network

Science.gov (United States)

Żejmo, Michał; Kowal, Marek; Korbicz, Józef; Monczak, Roman

2017-01-01

The paper presents a deep learning approach for automatic classification of breast tumors based on fine needle cytology. The main aim of the system is to distinguish benign from malignant cases based on microscopic images. Experiment was carried out on cytological samples derived from 50 patients (25 benign cases + 25 malignant cases) diagnosed in Regional Hospital in Zielona Góra. To classify microscopic images, we used convolutional neural networks (CNN) of two types: GoogLeNet and AlexNet. Due to the very large size of images of cytological specimen (on average 200000 × 100000 pixels), they were divided into smaller patches of size 256 × 256 pixels. Breast cancer classification usually is based on morphometric features of nuclei. Therefore, training and validation patches were selected using Support Vector Machine (SVM) so that suitable amount of cell material was depicted. Neural classifiers were tuned using GPU accelerated implementation of gradient descent algorithm. Training error was defined as a cross-entropy classification loss. Classification accuracy was defined as the percentage ratio of successfully classified validation patches to the total number of validation patches. The best accuracy rate of 83% was obtained by GoogLeNet model. We observed that more misclassified patches belong to malignant cases.

Dynamic effective connectivity of inter-areal brain circuits.

Directory of Open Access Journals (Sweden)

Demian Battaglia

Full Text Available Anatomic connections between brain areas affect information flow between neuronal circuits and the synchronization of neuronal activity. However, such structural connectivity does not coincide with effective connectivity (or, more precisely, causal connectivity, related to the elusive question "Which areas cause the present activity of which others?". Effective connectivity is directed and depends flexibly on contexts and tasks. Here we show that dynamic effective connectivity can emerge from transitions in the collective organization of coherent neural activity. Integrating simulation and semi-analytic approaches, we study mesoscale network motifs of interacting cortical areas, modeled as large random networks of spiking neurons or as simple rate units. Through a causal analysis of time-series of model neural activity, we show that different dynamical states generated by a same structural connectivity motif correspond to distinct effective connectivity motifs. Such effective motifs can display a dominant directionality, due to spontaneous symmetry breaking and effective entrainment between local brain rhythms, although all connections in the considered structural motifs are reciprocal. We show then that transitions between effective connectivity configurations (like, for instance, reversal in the direction of inter-areal interactions can be triggered reliably by brief perturbation inputs, properly timed with respect to an ongoing local oscillation, without the need for plastic synaptic changes. Finally, we analyze how the information encoded in spiking patterns of a local neuronal population is propagated across a fixed structural connectivity motif, demonstrating that changes in the active effective connectivity regulate both the efficiency and the directionality of information transfer. Previous studies stressed the role played by coherent oscillations in establishing efficient communication between distant areas. Going beyond these early

Enhancement of signal sensitivity in a heterogeneous neural network refined from synaptic plasticity

Energy Technology Data Exchange (ETDEWEB)

Li Xiumin; Small, Michael, E-mail: ensmall@polyu.edu.h, E-mail: 07901216r@eie.polyu.edu.h [Department of Electronic and Information Engineering, Hong Kong Polytechnic University, Hung Hom, Kowloon (Hong Kong)

2010-08-15

Long-term synaptic plasticity induced by neural activity is of great importance in informing the formation of neural connectivity and the development of the nervous system. It is reasonable to consider self-organized neural networks instead of prior imposition of a specific topology. In this paper, we propose a novel network evolved from two stages of the learning process, which are respectively guided by two experimentally observed synaptic plasticity rules, i.e. the spike-timing-dependent plasticity (STDP) mechanism and the burst-timing-dependent plasticity (BTDP) mechanism. Due to the existence of heterogeneity in neurons that exhibit different degrees of excitability, a two-level hierarchical structure is obtained after the synaptic refinement. This self-organized network shows higher sensitivity to afferent current injection compared with alternative archetypal networks with different neural connectivity. Statistical analysis also demonstrates that it has the small-world properties of small shortest path length and high clustering coefficients. Thus the selectively refined connectivity enhances the ability of neuronal communications and improves the efficiency of signal transmission in the network.

Enhancement of signal sensitivity in a heterogeneous neural network refined from synaptic plasticity

International Nuclear Information System (INIS)

Li Xiumin; Small, Michael

2010-01-01

Long-term synaptic plasticity induced by neural activity is of great importance in informing the formation of neural connectivity and the development of the nervous system. It is reasonable to consider self-organized neural networks instead of prior imposition of a specific topology. In this paper, we propose a novel network evolved from two stages of the learning process, which are respectively guided by two experimentally observed synaptic plasticity rules, i.e. the spike-timing-dependent plasticity (STDP) mechanism and the burst-timing-dependent plasticity (BTDP) mechanism. Due to the existence of heterogeneity in neurons that exhibit different degrees of excitability, a two-level hierarchical structure is obtained after the synaptic refinement. This self-organized network shows higher sensitivity to afferent current injection compared with alternative archetypal networks with different neural connectivity. Statistical analysis also demonstrates that it has the small-world properties of small shortest path length and high clustering coefficients. Thus the selectively refined connectivity enhances the ability of neuronal communications and improves the efficiency of signal transmission in the network.

Model for neural signaling leap statistics

International Nuclear Information System (INIS)

Chevrollier, Martine; Oria, Marcos

2011-01-01

We present a simple model for neural signaling leaps in the brain considering only the thermodynamic (Nernst) potential in neuron cells and brain temperature. We numerically simulated connections between arbitrarily localized neurons and analyzed the frequency distribution of the distances reached. We observed qualitative change between Normal statistics (with T 37.5 0 C, awaken regime) and Levy statistics (T = 35.5 0 C, sleeping period), characterized by rare events of long range connections.

Model for neural signaling leap statistics

Science.gov (United States)

Chevrollier, Martine; Oriá, Marcos

2011-03-01

We present a simple model for neural signaling leaps in the brain considering only the thermodynamic (Nernst) potential in neuron cells and brain temperature. We numerically simulated connections between arbitrarily localized neurons and analyzed the frequency distribution of the distances reached. We observed qualitative change between Normal statistics (with T = 37.5°C, awaken regime) and Lévy statistics (T = 35.5°C, sleeping period), characterized by rare events of long range connections.

The present condition and projection of construction of railway net of the Danube-Morava corridor

Directory of Open Access Journals (Sweden)

Vemić Mirčeta

2005-01-01

Full Text Available The railway net of the Danube-Morava corridor, together with the road net represent the central section of the Pan-European transport corridor X. According to the traffic and economic standards, the railway net represents the second main traffic direction of this corridor as the area-functioning system of the territory of Serbia. Main railway lines have favourable positions as they are located along prominent geographical features, namely river valleys thus enabling considerable flow of goods, passengers and information. The paper presents some characteristics of the present condition of the railway net, its functioning and safety, with certain ideas of its future construction and expected exploitation till 2015. Traffic infrastructure represents the initial factor of overall development of a state and its connection with the surrounding countries. It is considered to be of strategic importance for a country to built railway net. Improvement and additional construction of railway lines is of the greatest priority for the purpose of enlargement of overall mobility and quality of life of population, to make urban areas closer, to improve connections, functions efficiency and level of services of railway system, reduction of negative influence on other economic systems and human environment, better safety etc.

Resting-State Connectivity Predicts Levodopa-Induced Dyskinesias in Parkinson's Disease

DEFF Research Database (Denmark)

Herz, Damian M.; Haagensen, Brian N.; Nielsen, Silas H.

2016-01-01

Background: Levodopa-induced dyskinesias are a common side effect of dopaminergic therapy in PD, but their neural correlates remain poorly understood. Objectives: This study examines whether dyskinesias are associated with abnormal dopaminergic modulation of resting-state cortico-striatal connect......Background: Levodopa-induced dyskinesias are a common side effect of dopaminergic therapy in PD, but their neural correlates remain poorly understood. Objectives: This study examines whether dyskinesias are associated with abnormal dopaminergic modulation of resting-state cortico......-striatal connectivity. Methods: Twelve PD patients with peak-of-dose dyskinesias and 12 patients without dyskinesias were withdrawn from dopaminergic medication. All patients received a single dose of fast-acting soluble levodopa and then underwent resting-state functional magnetic resonance imaging before any...... dyskinesias emerged. Levodopa-induced modulation of cortico-striatal resting-state connectivity was assessed between the putamen and the following 3 cortical regions of interest: supplementary motor area, primary sensorimotor cortex, and right inferior frontal gyrus. These functional connectivity measures...

Radio frequency interference mitigation using deep convolutional neural networks

Science.gov (United States)

Akeret, J.; Chang, C.; Lucchi, A.; Refregier, A.

2017-01-01

We propose a novel approach for mitigating radio frequency interference (RFI) signals in radio data using the latest advances in deep learning. We employ a special type of Convolutional Neural Network, the U-Net, that enables the classification of clean signal and RFI signatures in 2D time-ordered data acquired from a radio telescope. We train and assess the performance of this network using the HIDE &SEEK radio data simulation and processing packages, as well as early Science Verification data acquired with the 7m single-dish telescope at the Bleien Observatory. We find that our U-Net implementation is showing competitive accuracy to classical RFI mitigation algorithms such as SEEK's SUMTHRESHOLD implementation. We publish our U-Net software package on GitHub under GPLv3 license.

Recurrent Convolutional Neural Networks: A Better Model of Biological Object Recognition.

Science.gov (United States)

Spoerer, Courtney J; McClure, Patrick; Kriegeskorte, Nikolaus

2017-01-01

Feedforward neural networks provide the dominant model of how the brain performs visual object recognition. However, these networks lack the lateral and feedback connections, and the resulting recurrent neuronal dynamics, of the ventral visual pathway in the human and non-human primate brain. Here we investigate recurrent convolutional neural networks with bottom-up (B), lateral (L), and top-down (T) connections. Combining these types of connections yields four architectures (B, BT, BL, and BLT), which we systematically test and compare. We hypothesized that recurrent dynamics might improve recognition performance in the challenging scenario of partial occlusion. We introduce two novel occluded object recognition tasks to test the efficacy of the models, digit clutter (where multiple target digits occlude one another) and digit debris (where target digits are occluded by digit fragments). We find that recurrent neural networks outperform feedforward control models (approximately matched in parametric complexity) at recognizing objects, both in the absence of occlusion and in all occlusion conditions. Recurrent networks were also found to be more robust to the inclusion of additive Gaussian noise. Recurrent neural networks are better in two respects: (1) they are more neurobiologically realistic than their feedforward counterparts; (2) they are better in terms of their ability to recognize objects, especially under challenging conditions. This work shows that computer vision can benefit from using recurrent convolutional architectures and suggests that the ubiquitous recurrent connections in biological brains are essential for task performance.

ISTA-Net: Iterative Shrinkage-Thresholding Algorithm Inspired Deep Network for Image Compressive Sensing

KAUST Repository

Zhang, Jian

2017-06-24

Traditional methods for image compressive sensing (CS) reconstruction solve a well-defined inverse problem that is based on a predefined CS model, which defines the underlying structure of the problem and is generally solved by employing convergent iterative solvers. These optimization-based CS methods face the challenge of choosing optimal transforms and tuning parameters in their solvers, while also suffering from high computational complexity in most cases. Recently, some deep network based CS algorithms have been proposed to improve CS reconstruction performance, while dramatically reducing time complexity as compared to optimization-based methods. Despite their impressive results, the proposed networks (either with fully-connected or repetitive convolutional layers) lack any structural diversity and they are trained as a black box, void of any insights from the CS domain. In this paper, we combine the merits of both types of CS methods: the structure insights of optimization-based method and the performance/speed of network-based ones. We propose a novel structured deep network, dubbed ISTA-Net, which is inspired by the Iterative Shrinkage-Thresholding Algorithm (ISTA) for optimizing a general $l_1$ norm CS reconstruction model. ISTA-Net essentially implements a truncated form of ISTA, where all ISTA-Net parameters are learned end-to-end to minimize a reconstruction error in training. Borrowing more insights from the optimization realm, we propose an accelerated version of ISTA-Net, dubbed FISTA-Net, which is inspired by the fast iterative shrinkage-thresholding algorithm (FISTA). Interestingly, this acceleration naturally leads to skip connections in the underlying network design. Extensive CS experiments demonstrate that the proposed ISTA-Net and FISTA-Net outperform existing optimization-based and network-based CS methods by large margins, while maintaining a fast runtime.

Durable superhydrophobic surfaces made by intensely connecting a bipolar top layer to the substrate with a middle connecting layer.

Science.gov (United States)

Zhi, Jinghui; Zhang, Li-Zhi

2017-08-30

This study reported a simple fabrication method for a durable superhydrophobic surface. The superhydrophobic top layer of the durable superhydrophobic surface was connected intensely to the substrate through a middle connecting layer. Glycidoxypropyltrimethoxysilane (KH-560) after hydrolysis was used to obtain a hydrophilic middle connecting layer. It could be adhered to the hydrophilic substrate by covalent bonds. Ring-open reaction with octadecylamine let the KH-560 middle layer form a net-like structure. The net-like sturcture would then encompass and station the silica particles that were used to form the coarse micro structures, intensely to increase the durability. The top hydrophobic layer with nano-structures was formed on the KH-560 middle layer. It was obtained by a bipolar nano-silica solution modified by hexamethyldisilazane (HMDS). This layer was connected to the middle layer intensely by the polar Si hydroxy groups, while the non-polar methyl groups on the surface, accompanied by the micro and nano structures, made the surface rather hydrophobic. The covalently interfacial interactions between the substrate and the middle layer, and between the middle layer and the top layer, strengthened the durability of the superhydrophobic surface. The abrasion test results showed that the superhydrophobic surface could bear 180 abrasion cycles on 1200 CW sandpaper under 2 kPa applied pressure.

Detection and diagnosis of colitis on computed tomography using deep convolutional neural networks.

Science.gov (United States)

Liu, Jiamin; Wang, David; Lu, Le; Wei, Zhuoshi; Kim, Lauren; Turkbey, Evrim B; Sahiner, Berkman; Petrick, Nicholas A; Summers, Ronald M

2017-09-01

Colitis refers to inflammation of the inner lining of the colon that is frequently associated with infection and allergic reactions. In this paper, we propose deep convolutional neural networks methods for lesion-level colitis detection and a support vector machine (SVM) classifier for patient-level colitis diagnosis on routine abdominal CT scans. The recently developed Faster Region-based Convolutional Neural Network (Faster RCNN) is utilized for lesion-level colitis detection. For each 2D slice, rectangular region proposals are generated by region proposal networks (RPN). Then, each region proposal is jointly classified and refined by a softmax classifier and bounding-box regressor. Two convolutional neural networks, eight layers of ZF net and 16 layers of VGG net are compared for colitis detection. Finally, for each patient, the detections on all 2D slices are collected and a SVM classifier is applied to develop a patient-level diagnosis. We trained and evaluated our method with 80 colitis patients and 80 normal cases using 4 × 4-fold cross validation. For lesion-level colitis detection, with ZF net, the mean of average precisions (mAP) were 48.7% and 50.9% for RCNN and Faster RCNN, respectively. The detection system achieved sensitivities of 51.4% and 54.0% at two false positives per patient for RCNN and Faster RCNN, respectively. With VGG net, Faster RCNN increased the mAP to 56.9% and increased the sensitivity to 58.4% at two false positive per patient. For patient-level colitis diagnosis, with ZF net, the average areas under the ROC curve (AUC) were 0.978 ± 0.009 and 0.984 ± 0.008 for RCNN and Faster RCNN method, respectively. The difference was not statistically significant with P = 0.18. At the optimal operating point, the RCNN method correctly identified 90.4% (72.3/80) of the colitis patients and 94.0% (75.2/80) of normal cases. The sensitivity improved to 91.6% (73.3/80) and the specificity improved to 95.0% (76.0/80) for the Faster RCNN

Cultured Neural Networks: Optimization of Patterned Network Adhesiveness and Characterization of their Neural Activity

Directory of Open Access Journals (Sweden)

W. L. C. Rutten

2006-01-01

Full Text Available One type of future, improved neural interface is the “cultured probe”. It is a hybrid type of neural information transducer or prosthesis, for stimulation and/or recording of neural activity. It would consist of a microelectrode array (MEA on a planar substrate, each electrode being covered and surrounded by a local circularly confined network (“island” of cultured neurons. The main purpose of the local networks is that they act as biofriendly intermediates for collateral sprouts from the in vivo system, thus allowing for an effective and selective neuron–electrode interface. As a secondary purpose, one may envisage future information processing applications of these intermediary networks. In this paper, first, progress is shown on how substrates can be chemically modified to confine developing networks, cultured from dissociated rat cortex cells, to “islands” surrounding an electrode site. Additional coating of neurophobic, polyimide-coated substrate by triblock-copolymer coating enhances neurophilic-neurophobic adhesion contrast. Secondly, results are given on neuronal activity in patterned, unconnected and connected, circular “island” networks. For connected islands, the larger the island diameter (50, 100 or 150 μm, the more spontaneous activity is seen. Also, activity may show a very high degree of synchronization between two islands. For unconnected islands, activity may start at 22 days in vitro (DIV, which is two weeks later than in unpatterned networks.

Knowledge Access in Rural Inter-connected Areas Network ...

International Development Research Centre (IDRC) Digital Library (Canada)

Knowledge Access in Rural Inter-connected Areas Network (KariaNet) - Phase II ... the existing network to include two thematic networks on food security and rural ... Woman conquering male business in Yemen : Waleya's micro-enterprise.

Knowledge Access in Rural Inter-connected Areas Network ...

International Development Research Centre (IDRC) Digital Library (Canada)

Knowledge Access in Rural Inter-connected Areas Network (KariaNet) - Phase II ... poor by sharing innovations, best practices and indigenous knowledge using ... A third thematic network - on knowledge management strategies - will play an ...

Model for neural signaling leap statistics

Energy Technology Data Exchange (ETDEWEB)

Chevrollier, Martine; Oria, Marcos, E-mail: oria@otica.ufpb.br [Laboratorio de Fisica Atomica e Lasers Departamento de Fisica, Universidade Federal da ParaIba Caixa Postal 5086 58051-900 Joao Pessoa, Paraiba (Brazil)

2011-03-01

We present a simple model for neural signaling leaps in the brain considering only the thermodynamic (Nernst) potential in neuron cells and brain temperature. We numerically simulated connections between arbitrarily localized neurons and analyzed the frequency distribution of the distances reached. We observed qualitative change between Normal statistics (with T 37.5{sup 0}C, awaken regime) and Levy statistics (T = 35.5{sup 0}C, sleeping period), characterized by rare events of long range connections.

Applying the Power of Reticular Chemistry to Finding the Missing alb-MOF Platform Based on the (6,12)-Coordinated Edge-Transitive Net

KAUST Repository

Chen, Zhijie

2017-02-05

Highly connected and edge-transitive nets are of prime importance in crystal chemistry and are regarded as ideal blueprints for the rational design and construction of metal-organic frameworks (MOFs). We report the design and synthesis of highly connected MOFs based on reticulation of the sole two edge-transitive nets with a vertex figure as double six-membered-ring (d6R) building unit, namely the (4,12)-coordinated shp net (square and hexagonal-prism) and the (6,12)-coordinated alb net (aluminum diboride, hexagonal-prism and trigonal-prism). Decidedly, the combination of our recently isolated 12-connected (12-c) rare-earth (RE) nonanuclear [RE(μ-OH)(μ-O)(OC-)] carboxylate-based cluster, points of extension matching the 12 vertices of hexagonal-prism d6R, with 4-connected (4-c) square porphyrinic tetracarboxylate ligand led to the formation of the targeted RE-shp-MOF. This is the first time that RE-MOFs based on 12-c molecular building blocks (MBBs), d6R building units, have been deliberately targeted and successfully isolated, paving the way for the long-awaited (6,12)-c MOF with alb topology. Indeed, combination of a custom-designed hexacarboxylate ligand with RE salts led to the formation of the first related alb-MOF, RE-alb-MOF. Intuitively, we successfully transplanted the alb topology to another chemical system and constructed the first indium-based alb-MOF, In-alb-MOF, by employing trinuclear [In(μ-O)(OC-)] as the requisite 6-connected trigonal-prism and purposely made a dodecacarboxylate ligand as a compatible 12-c MBB. Prominently, the dodecacarboxylate ligand was employed to transplant shp topology into copper-based MOFs by employing the copper paddlewheel [Cu(OC-)] as the complementary square building unit, affording the first Cu-shp-MOF. We revealed that highly connected edge-transitive nets such shp and alb are ideal for topological transplantation and deliberate construction of related MOFs based on minimal edge-transitive nets.

Applying the Power of Reticular Chemistry to Finding the Missing alb-MOF Platform Based on the (6,12)-Coordinated Edge-Transitive Net

KAUST Repository

Chen, Zhijie; Weselinski, Lukasz Jan; Adil, Karim; Belmabkhout, Youssef; Shkurenko, Aleksander; Jiang, Hao; Bhatt, Prashant; Guillerm, Vincent; Dauzon, Emilie; Xue, Dongxu; O’ Keeffe, Michael; Eddaoudi, Mohamed

2017-01-01

Highly connected and edge-transitive nets are of prime importance in crystal chemistry and are regarded as ideal blueprints for the rational design and construction of metal-organic frameworks (MOFs). We report the design and synthesis of highly connected MOFs based on reticulation of the sole two edge-transitive nets with a vertex figure as double six-membered-ring (d6R) building unit, namely the (4,12)-coordinated shp net (square and hexagonal-prism) and the (6,12)-coordinated alb net (aluminum diboride, hexagonal-prism and trigonal-prism). Decidedly, the combination of our recently isolated 12-connected (12-c) rare-earth (RE) nonanuclear [RE(μ-OH)(μ-O)(OC-)] carboxylate-based cluster, points of extension matching the 12 vertices of hexagonal-prism d6R, with 4-connected (4-c) square porphyrinic tetracarboxylate ligand led to the formation of the targeted RE-shp-MOF. This is the first time that RE-MOFs based on 12-c molecular building blocks (MBBs), d6R building units, have been deliberately targeted and successfully isolated, paving the way for the long-awaited (6,12)-c MOF with alb topology. Indeed, combination of a custom-designed hexacarboxylate ligand with RE salts led to the formation of the first related alb-MOF, RE-alb-MOF. Intuitively, we successfully transplanted the alb topology to another chemical system and constructed the first indium-based alb-MOF, In-alb-MOF, by employing trinuclear [In(μ-O)(OC-)] as the requisite 6-connected trigonal-prism and purposely made a dodecacarboxylate ligand as a compatible 12-c MBB. Prominently, the dodecacarboxylate ligand was employed to transplant shp topology into copper-based MOFs by employing the copper paddlewheel [Cu(OC-)] as the complementary square building unit, affording the first Cu-shp-MOF. We revealed that highly connected edge-transitive nets such shp and alb are ideal for topological transplantation and deliberate construction of related MOFs based on minimal edge-transitive nets.

Horizontal ichthyoplankton tow-net system with unobstructed net opening

Science.gov (United States)

Nester, Robert T.

1987-01-01

The larval fish sampler described here consists of a modified bridle, frame, and net system with an obstruction-free net opening and is small enough for use on boats 10 m or less in length. The tow net features a square net frame attached to a 0.5-m-diameter cylinder-on-cone plankton net with a bridle designed to eliminate all obstructions forward of the net opening, significantly reducing currents and vibrations in the water directly preceding the net. This system was effective in collecting larvae representing more than 25 species of fish at sampling depths ranging from surface to 10 m and could easily be used at greater depths.

Google matrix analysis of C.elegans neural network

Energy Technology Data Exchange (ETDEWEB)

Kandiah, V., E-mail: kandiah@irsamc.ups-tlse.fr; Shepelyansky, D.L., E-mail: dima@irsamc.ups-tlse.fr

2014-05-01

We study the structural properties of the neural network of the C.elegans (worm) from a directed graph point of view. The Google matrix analysis is used to characterize the neuron connectivity structure and node classifications are discussed and compared with physiological properties of the cells. Our results are obtained by a proper definition of neural directed network and subsequent eigenvector analysis which recovers some results of previous studies. Our analysis highlights particular sets of important neurons constituting the core of the neural system. The applications of PageRank, CheiRank and ImpactRank to characterization of interdependency of neurons are discussed.

Google matrix analysis of C.elegans neural network

International Nuclear Information System (INIS)

Kandiah, V.; Shepelyansky, D.L.

2014-01-01

We study the structural properties of the neural network of the C.elegans (worm) from a directed graph point of view. The Google matrix analysis is used to characterize the neuron connectivity structure and node classifications are discussed and compared with physiological properties of the cells. Our results are obtained by a proper definition of neural directed network and subsequent eigenvector analysis which recovers some results of previous studies. Our analysis highlights particular sets of important neurons constituting the core of the neural system. The applications of PageRank, CheiRank and ImpactRank to characterization of interdependency of neurons are discussed.

Higher-moment measurements of net-kaon, net-charge and net-proton multiplicity distributions at STAR

International Nuclear Information System (INIS)

Sarkar, Amal

2014-01-01

In this paper, we report the measurements of the various moments, such as mean, standard deviation (σ), skewness (S) and kurtosis (κ) of the net-kaon, net-charge and net-proton multiplicity distributions at mid-rapidity in Au + Au collisions from √(s NN )=7.7 to 200 GeV with the STAR experiment at RHIC. This work has been done with the aim to locate the critical point on the QCD phase diagram. These moments and their products are related to the thermodynamic susceptibilities of conserved quantities such as net baryon number, net charge, and net strangeness as well as to the correlation length of the system which diverges in an ideal infinite thermodynamic system at the critical point. For a finite system, existing for a finite time, a non-monotonic behavior of these variables would indicate the presence of the critical point. Furthermore, we also present the moment products Sσ, κσ 2 of net-kaon, net-charge and net-proton multiplicity distributions as a function of collision centrality and energy. The energy and the centrality dependence of higher moments and their products have been compared with different models

The Laplacian spectrum of neural networks

Science.gov (United States)

de Lange, Siemon C.; de Reus, Marcel A.; van den Heuvel, Martijn P.

2014-01-01

The brain is a complex network of neural interactions, both at the microscopic and macroscopic level. Graph theory is well suited to examine the global network architecture of these neural networks. Many popular graph metrics, however, encode average properties of individual network elements. Complementing these “conventional” graph metrics, the eigenvalue spectrum of the normalized Laplacian describes a network's structure directly at a systems level, without referring to individual nodes or connections. In this paper, the Laplacian spectra of the macroscopic anatomical neuronal networks of the macaque and cat, and the microscopic network of the Caenorhabditis elegans were examined. Consistent with conventional graph metrics, analysis of the Laplacian spectra revealed an integrative community structure in neural brain networks. Extending previous findings of overlap of network attributes across species, similarity of the Laplacian spectra across the cat, macaque and C. elegans neural networks suggests a certain level of consistency in the overall architecture of the anatomical neural networks of these species. Our results further suggest a specific network class for neural networks, distinct from conceptual small-world and scale-free models as well as several empirical networks. PMID:24454286

Net metering study of switching effects on electromechanical meters[Report prepared for the Measurement Canada Electricity Net Metering Project

Energy Technology Data Exchange (ETDEWEB)

Van Overberghe, L. [Measurement Canada, London, ON (Canada)

2006-03-03

The feasibility of introducing net metering in the electricity sector was evaluated with particular reference to a project administered by Measurement Canada and Electro-Federation Canada (MicroPower Connect) in collaboration with Natural Resources Canada. The objective of the Measurement Canada Electricity Net Metering Project is to identify and eliminate the barriers introduced by the Electricity and Gas Inspection Act regarding the introduction of net metering. The purpose was to design a device that would allow rotation reversal in a residential electromechanical single phase meter. The device should approximate any fluctuations found in a typical net metering system. A series of tests were conducted to understand the influences, on errors, of forward-to-reverse and reverse-to-forward transitions, specifically to find evidence of error migration and mechanical stress. The project was designed to find and measure the effects of forward reverse switching on an electromechanical meter resulting from a change in energy flow. Twenty metres were calibrated in the forward direction in series from light load to high load. Power factor was not adjustable. Test points were then applied in both the forward and reverse directions. The exercise yielded individual errors which were aggregated to show average found errors after 3,000 transitions. Small shifts in errors were apparent and there was no evidence to support a disk flutter theory. refs., tabs., figs.

Jet flavor tagging with Deep Learning using Python

CERN Multimedia

CERN. Geneva

2016-01-01

Besides the part that implements the resulting deep neural net in the ATLAS C++ software framework, a Python framework has been developed to connect HEP data to standard Data Science Python based libraries for Machine Learning. It makes use of HDF5, JSON and Pickle as intermediate data storage format, pandas and numpy for data handling and calculations, Keras for neural net construction and training as well as testing and matplotlib for plotting. It can be seen as an example of taking advantage of outside-HEP software developments without relying on the HEP standard ROOT.

Adaptive Learning Rule for Hardware-based Deep Neural Networks Using Electronic Synapse Devices

OpenAIRE

Lim, Suhwan; Bae, Jong-Ho; Eum, Jai-Ho; Lee, Sungtae; Kim, Chul-Heung; Kwon, Dongseok; Park, Byung-Gook; Lee, Jong-Ho

2017-01-01

In this paper, we propose a learning rule based on a back-propagation (BP) algorithm that can be applied to a hardware-based deep neural network (HW-DNN) using electronic devices that exhibit discrete and limited conductance characteristics. This adaptive learning rule, which enables forward, backward propagation, as well as weight updates in hardware, is helpful during the implementation of power-efficient and high-speed deep neural networks. In simulations using a three-layer perceptron net...

Feature to prototype transition in neural networks

Science.gov (United States)

Krotov, Dmitry; Hopfield, John

Models of associative memory with higher order (higher than quadratic) interactions, and their relationship to neural networks used in deep learning are discussed. Associative memory is conventionally described by recurrent neural networks with dynamical convergence to stable points. Deep learning typically uses feedforward neural nets without dynamics. However, a simple duality relates these two different views when applied to problems of pattern classification. From the perspective of associative memory such models deserve attention because they make it possible to store a much larger number of memories, compared to the quadratic case. In the dual description, these models correspond to feedforward neural networks with one hidden layer and unusual activation functions transmitting the activities of the visible neurons to the hidden layer. These activation functions are rectified polynomials of a higher degree rather than the rectified linear functions used in deep learning. The network learns representations of the data in terms of features for rectified linear functions, but as the power in the activation function is increased there is a gradual shift to a prototype-based representation, the two extreme regimes of pattern recognition known in cognitive psychology. Simons Center for Systems Biology.

Developmental changes in brain connectivity assessed using the sleep EEG.

OpenAIRE

Tarokh L; Carskadon M A; Achermann P

2010-01-01

Adolescence represents a time of significant cortical restructuring. Current theories posit that during this period connections between frequently utilized neural networks are strengthened while underutilized synaptic connections are discarded. The aim of the present study was to examine the developmental evolution of connectivity between brain regions using the sleep EEG. All night sleep EEG recordings in two longitudinal cohorts (children and teens) followed at 1.5 3 year intervals and one ...

Spike Neural Models Part II: Abstract Neural Models

Directory of Open Access Journals (Sweden)

Johnson, Melissa G.

2018-02-01

Full Text Available Neurons are complex cells that require a lot of time and resources to model completely. In spiking neural networks (SNN though, not all that complexity is required. Therefore simple, abstract models are often used. These models save time, use less computer resources, and are easier to understand. This tutorial presents two such models: Izhikevich's model, which is biologically realistic in the resulting spike trains but not in the parameters, and the Leaky Integrate and Fire (LIF model which is not biologically realistic but does quickly and easily integrate input to produce spikes. Izhikevich's model is based on Hodgkin-Huxley's model but simplified such that it uses only two differentiation equations and four parameters to produce various realistic spike patterns. LIF is based on a standard electrical circuit and contains one equation. Either of these two models, or any of the many other models in literature can be used in a SNN. Choosing a neural model is an important task that depends on the goal of the research and the resources available. Once a model is chosen, network decisions such as connectivity, delay, and sparseness, need to be made. Understanding neural models and how they are incorporated into the network is the first step in creating a SNN.

Neural activity when people solve verbal problems with insight.

Directory of Open Access Journals (Sweden)

Mark Jung-Beeman

2004-04-01

Full Text Available People sometimes solve problems with a unique process called insight, accompanied by an "Aha!" experience. It has long been unclear whether different cognitive and neural processes lead to insight versus noninsight solutions, or if solutions differ only in subsequent subjective feeling. Recent behavioral studies indicate distinct patterns of performance and suggest differential hemispheric involvement for insight and noninsight solutions. Subjects solved verbal problems, and after each correct solution indicated whether they solved with or without insight. We observed two objective neural correlates of insight. Functional magnetic resonance imaging (Experiment 1 revealed increased activity in the right hemisphere anterior superior temporal gyrus for insight relative to noninsight solutions. The same region was active during initial solving efforts. Scalp electroencephalogram recordings (Experiment 2 revealed a sudden burst of high-frequency (gamma-band neural activity in the same area beginning 0.3 s prior to insight solutions. This right anterior temporal area is associated with making connections across distantly related information during comprehension. Although all problem solving relies on a largely shared cortical network, the sudden flash of insight occurs when solvers engage distinct neural and cognitive processes that allow them to see connections that previously eluded them.

Theory of Mind and the Whole Brain Functional Connectivity: Behavioral and Neural Evidences with the Amsterdam Resting State Questionnaire.

Science.gov (United States)

Marchetti, Antonella; Baglio, Francesca; Costantini, Isa; Dipasquale, Ottavia; Savazzi, Federica; Nemni, Raffaello; Sangiuliano Intra, Francesca; Tagliabue, Semira; Valle, Annalisa; Massaro, Davide; Castelli, Ilaria

2015-01-01

A topic of common interest to psychologists and philosophers is the spontaneous flow of thoughts when the individual is awake but not involved in cognitive demands. This argument, classically referred to as the "stream of consciousness" of James, is now known in the psychological literature as "Mind-Wandering." Although of great interest, this construct has been scarcely investigated so far. Diaz et al. (2013) created the Amsterdam Resting State Questionnaire (ARSQ), composed of 27 items, distributed in seven factors: discontinuity of mind, theory of mind (ToM), self, planning, sleepiness, comfort, and somatic awareness. The present study aims at: testing psychometric properties of the ARSQ in a sample of 670 Italian subjects; exploring the neural correlates of a subsample of participants (N = 28) divided into two groups on the basis of the scores obtained in the ToM factor. Results show a satisfactory reliability of the original factional structure in the Italian sample. In the subjects with a high mean in the ToM factor compared to low mean subjects, functional MRI revealed: a network (48 nodes) with higher functional connectivity (FC) with a dominance of the left hemisphere; an increased within-lobe FC in frontal and insular lobes. In both neural and behavioral terms, our results support the idea that the mind, which does not rest even when explicitly asked to do so, has various and interesting mentalistic-like contents.

Working Memory Modulation of Frontoparietal Network Connectivity in First-Episode Schizophrenia

DEFF Research Database (Denmark)

Nielsen, Jesper Duemose; Madsen, Kristoffer Hougaard; Wang, Zheng

2017-01-01

Working memory (WM) impairment is regarded as a core aspect of schizophrenia. However, the neural mechanisms behind this cognitive deficit remain unclear. The connectivity of a frontoparietal network is known to be important for subserving WM. Using functional magnetic resonance imaging, the curr......Working memory (WM) impairment is regarded as a core aspect of schizophrenia. However, the neural mechanisms behind this cognitive deficit remain unclear. The connectivity of a frontoparietal network is known to be important for subserving WM. Using functional magnetic resonance imaging......, the current study investigated whether WM-dependent modulation of effective connectivity in this network is affected in a group of first-episode schizophrenia (FES) patients compared with similarly performing healthy participants during a verbal n-back task. Dynamic causal modeling (DCM) of the coupling...... between regions (left inferior frontal gyrus (IFG), left inferior parietal lobe (IPL), and primary visual area) identified in a psychophysiological interaction (PPI) analysis was performed to characterize effective connectivity during the n-back task. The PPI analysis revealed that the connectivity...

Optical implementation of a feature-based neural network with application to automatic target recognition

Science.gov (United States)

Chao, Tien-Hsin; Stoner, William W.

1993-01-01

An optical neural network based on the neocognitron paradigm is introduced. A novel aspect of the architecture design is shift-invariant multichannel Fourier optical correlation within each processing layer. Multilayer processing is achieved by feeding back the ouput of the feature correlator interatively to the input spatial light modulator and by updating the Fourier filters. By training the neural net with characteristic features extracted from the target images, successful pattern recognition with intraclass fault tolerance and interclass discrimination is achieved. A detailed system description is provided. Experimental demonstrations of a two-layer neural network for space-object discrimination is also presented.

DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs.

Science.gov (United States)

Chen, Liang-Chieh; Papandreou, George; Kokkinos, Iasonas; Murphy, Kevin; Yuille, Alan L

2018-04-01

In this work we address the task of semantic image segmentation with Deep Learning and make three main contributions that are experimentally shown to have substantial practical merit. First, we highlight convolution with upsampled filters, or 'atrous convolution', as a powerful tool in dense prediction tasks. Atrous convolution allows us to explicitly control the resolution at which feature responses are computed within Deep Convolutional Neural Networks. It also allows us to effectively enlarge the field of view of filters to incorporate larger context without increasing the number of parameters or the amount of computation. Second, we propose atrous spatial pyramid pooling (ASPP) to robustly segment objects at multiple scales. ASPP probes an incoming convolutional feature layer with filters at multiple sampling rates and effective fields-of-views, thus capturing objects as well as image context at multiple scales. Third, we improve the localization of object boundaries by combining methods from DCNNs and probabilistic graphical models. The commonly deployed combination of max-pooling and downsampling in DCNNs achieves invariance but has a toll on localization accuracy. We overcome this by combining the responses at the final DCNN layer with a fully connected Conditional Random Field (CRF), which is shown both qualitatively and quantitatively to improve localization performance. Our proposed "DeepLab" system sets the new state-of-art at the PASCAL VOC-2012 semantic image segmentation task, reaching 79.7 percent mIOU in the test set, and advances the results on three other datasets: PASCAL-Context, PASCAL-Person-Part, and Cityscapes. All of our code is made publicly available online.

Neural networks within multi-core optic fibers.

Science.gov (United States)

Cohen, Eyal; Malka, Dror; Shemer, Amir; Shahmoon, Asaf; Zalevsky, Zeev; London, Michael

2016-07-07

Hardware implementation of artificial neural networks facilitates real-time parallel processing of massive data sets. Optical neural networks offer low-volume 3D connectivity together with large bandwidth and minimal heat production in contrast to electronic implementation. Here, we present a conceptual design for in-fiber optical neural networks. Neurons and synapses are realized as individual silica cores in a multi-core fiber. Optical signals are transferred transversely between cores by means of optical coupling. Pump driven amplification in erbium-doped cores mimics synaptic interactions. We simulated three-layered feed-forward neural networks and explored their capabilities. Simulations suggest that networks can differentiate between given inputs depending on specific configurations of amplification; this implies classification and learning capabilities. Finally, we tested experimentally our basic neuronal elements using fibers, couplers, and amplifiers, and demonstrated that this configuration implements a neuron-like function. Therefore, devices similar to our proposed multi-core fiber could potentially serve as building blocks for future large-scale small-volume optical artificial neural networks.

The NetQuakes Project - Seeking a Balance Between Science and Citizens.

Science.gov (United States)

Luetgert, J. H.; Oppenheimer, D. H.

2012-12-01

The challenge for any system that uses volunteer help to do science is to dependably acquire quality data without unduly burdening the volunteer. The NetQuakes accelerograph and its data acquisition system were created to address the recognized need for more densely sampled strong ground motion recordings in urban areas to provide more accurate ShakeMaps for post-earthquake disaster assessment and to provide data for structural engineers to improve design standards. The recorder has 18 bit resolution with ±3g internal tri-axial MEMS accelerometers. Data are continuously recorded at 200 sps into a 1-2 week ringbuffer. When triggered, a miniSEED file is sent to USGS servers via the Internet. Data can also be recovered from the ringbuffer by a remote request through the NetQuakes servers. Following a power failure, the instrument can run for 36 hours using its internal battery. We rely upon cooperative citizens to host the dataloggers, provide power and Internet connectivity and perform minor servicing. Instrument and battery replacement are simple tasks that can be performed by hosts, thus reducing maintenance costs. Communication with the instrument to acquire data or deliver firmware is accomplished by file transfers using NetQuakes servers. The client instrument initiates all client-server interactions, so it safely resides behind a host's firewall. A connection to the host's LAN, and from there to the public Internet, can be made using WiFi to minimize cabling. Although timing using a cable to an external GPS antenna is possible, it is simpler to use the Network Time Protocol (NTP) to discipline the internal clock. This approach achieves timing accuracy substantially better than a sample interval. Since 2009, we have installed more than 140 NetQuakes instruments in the San Francisco Bay Area and have successfully integrated their data into the near real time data stream of the Northern California Seismic System. An additional 235 NetQuakes instruments have been

Neural coding in graphs of bidirectional associative memories.

Science.gov (United States)

Bouchain, A David; Palm, Günther

2012-01-24

In the last years we have developed large neural network models for the realization of complex cognitive tasks in a neural network architecture that resembles the network of the cerebral cortex. We have used networks of several cortical modules that contain two populations of neurons (one excitatory, one inhibitory). The excitatory populations in these so-called "cortical networks" are organized as a graph of Bidirectional Associative Memories (BAMs), where edges of the graph correspond to BAMs connecting two neural modules and nodes of the graph correspond to excitatory populations with associative feedback connections (and inhibitory interneurons). The neural code in each of these modules consists essentially of the firing pattern of the excitatory population, where mainly it is the subset of active neurons that codes the contents to be represented. The overall activity can be used to distinguish different properties of the patterns that are represented which we need to distinguish and control when performing complex tasks like language understanding with these cortical networks. The most important pattern properties or situations are: exactly fitting or matching input, incomplete information or partially matching pattern, superposition of several patterns, conflicting information, and new information that is to be learned. We show simple simulations of these situations in one area or module and discuss how to distinguish these situations based on the overall internal activation of the module. This article is part of a Special Issue entitled "Neural Coding". Copyright © 2011 Elsevier B.V. All rights reserved.

On optical detection of densely labeled synapses in neuropil and mapping connectivity with combinatorially multiplexed fluorescent synaptic markers.

Directory of Open Access Journals (Sweden)

Yuriy Mishchenko

Full Text Available We propose a new method for mapping neural connectivity optically, by utilizing Cre/Lox system Brainbow to tag synapses of different neurons with random mixtures of different fluorophores, such as GFP, YFP, etc., and then detecting patterns of fluorophores at different synapses using light microscopy (LM. Such patterns will immediately report the pre- and post-synaptic cells at each synaptic connection, without tracing neural projections from individual synapses to corresponding cell bodies. We simulate fluorescence from a population of densely labeled synapses in a block of hippocampal neuropil, completely reconstructed from electron microscopy data, and show that high-end LM is able to detect such patterns with over 95% accuracy. We conclude, therefore, that with the described approach neural connectivity in macroscopically large neural circuits can be mapped with great accuracy, in scalable manner, using fast optical tools, and straightforward image processing. Relying on an electron microscopy dataset, we also derive and explicitly enumerate the conditions that should be met to allow synaptic connectivity studies with high-resolution optical tools.

Microbial activity in district cooling nets; Mikrobiell Aktivitet i Fjaerrkylenaet

Energy Technology Data Exchange (ETDEWEB)

Nordling, Magnus [Swedish Corrosion Inst., Stockholm (Sweden)

2004-07-01

Four district cooling nets with varying water quality have been investigated according to presence of microbially related problems. The aim has been to formulate recommendations regarding the water quality and regarding other procedures that might reduce the risk for biofilm formation and microbial corrosion. The method has consisted of using so called exposure containers, connected to each net. The water has been allowed to flow through the exposure containers where coupons of carbon steel have been exposed. The coupons have been withdrawn at different times, and analysed regarding the presence of biofilm and corrosion attack. Analyses have also been made regarding the amount of a number of different types of micro-organisms in the biofilm and in the district cooling water. The project has been divided in two phases. During the first phase of the project only two nets were investigated, one with municipal water and one with water of district heating quality, i.e. degassed and deionised. Biofilms could be seen on the coupons from both nets, even though the exposure time only had been 1.5 month. Considerable concentrations of micro-organisms were found in the biofilms and in the water for both nets, however much larger amounts for the net with municipal water. During the second phase of the project four nets were investigated, two with mainly municipal water and two with water of district heating quality. Here, on the other hand, it could be seen that the two nets with municipal water had micro-organisms of equivalent or lower concentrations compared to the two nets with water of district heating quality. One explanation to this is that the colouring substance pyranine is added to these two nets. Pyranine is added for the purpose of easily detecting a leakage but is at the same time a carbon compound, and as such a possible nutrient for the micro-organisms. This illustrates the importance of having the district cooling water as free from additives as possible. Other

Additive Feed Forward Control with Neural Networks

DEFF Research Database (Denmark)

Sørensen, O.

1999-01-01

This paper demonstrates a method to control a non-linear, multivariable, noisy process using trained neural networks. The basis for the method is a trained neural network controller acting as the inverse process model. A training method for obtaining such an inverse process model is applied....... A suitable 'shaped' (low-pass filtered) reference is used to overcome problems with excessive control action when using a controller acting as the inverse process model. The control concept is Additive Feed Forward Control, where the trained neural network controller, acting as the inverse process model......, is placed in a supplementary pure feed-forward path to an existing feedback controller. This concept benefits from the fact, that an existing, traditional designed, feedback controller can be retained without any modifications, and after training the connection of the neural network feed-forward controller...

Intelligent neural network diagnostic system

International Nuclear Information System (INIS)

Mohamed, A.H.

2010-01-01

Recently, artificial neural network (ANN) has made a significant mark in the domain of diagnostic applications. Neural networks are used to implement complex non-linear mappings (functions) using simple elementary units interrelated through connections with adaptive weights. The performance of the ANN is mainly depending on their topology structure and weights. Some systems have been developed using genetic algorithm (GA) to optimize the topology of the ANN. But, they suffer from some limitations. They are : (1) The computation time requires for training the ANN several time reaching for the average weight required, (2) Slowness of GA for optimization process and (3) Fitness noise appeared in the optimization of ANN. This research suggests new issues to overcome these limitations for finding optimal neural network architectures to learn particular problems. This proposed methodology is used to develop a diagnostic neural network system. It has been applied for a 600 MW turbo-generator as a case of real complex systems. The proposed system has proved its significant performance compared to two common methods used in the diagnostic applications.

Functional connectivity mapping of regions associated with self- and other-processing.

Science.gov (United States)

Murray, Ryan J; Debbané, Martin; Fox, Peter T; Bzdok, Danilo; Eickhoff, Simon B

2015-04-01

Neuroscience literature increasingly suggests a conceptual self composed of interacting neural regions, rather than independent local activations, yet such claims have yet to be investigated. We, thus, combined task-dependent meta-analytic connectivity modeling (MACM) with task-independent resting-state (RS) connectivity analysis to delineate the neural network of the self, across both states. Given psychological evidence implicating the self's interdependence on social information, we also delineated the neural network underlying conceptual other-processing. To elucidate the relation between the self-/other-networks and their function, we mined the MACM metadata to generate a cognitive-behavioral profile for an empirically identified region specific to conceptual self, the pregenual anterior cingulate (pACC), and conceptual other, posterior cingulate/precuneus (PCC/PC). Mining of 7,200 published, task-dependent, neuroimaging studies, using healthy human subjects, yielded 193 studies activating the self-related seed and were conjoined with RS connectivity analysis to delineate a differentiated self-network composed of the pACC (seed) and anterior insula, relative to other functional connectivity. Additionally, 106 studies activating the other-related seed were conjoined with RS connectivity analysis to delineate a differentiated other-network of PCC/PC (seed) and angular gyrus/temporoparietal junction, relative to self-functional connectivity. The self-network seed related to emotional conflict resolution and motivational processing, whereas the other-network seed related to socially oriented processing and contextual information integration. Notably, our findings revealed shared RS connectivity between ensuing self-/other-networks within the ventromedial prefrontal cortex and medial orbitofrontal cortex, suggesting self-updating via integration of self-relevant social information. We, therefore, present initial neurobiological evidence corroborating the increasing

Application of neural networks to connectional expert system for identification of transients in nuclear power plants

International Nuclear Information System (INIS)

Cheon, Se Woo; Kim, Wan Joo; Chang, Soon Heung; Roh, Myung Sub

1991-01-01

The Back-propagation Neural Network (BPN) algorithm is applied to connectionist expert system for the identification of BWR transients. Several powerful features of neural network-based expert systems over traditional rule-based expert systems are described. The general mapping capability of the neural networks enables to identify transients easily. A number of case studies were performed with emphasis on the applicability of the neural networks to the diagnostic domain. It is revealed that the BPN algorithm can identify transients properly, even when incomplete or untrained symptoms are given. It is also shown that multiple transients are easily identified

Extrinsic and Intrinsic Brain Network Connectivity Maintains Cognition across the Lifespan Despite Accelerated Decay of Regional Brain Activation.

Science.gov (United States)

Tsvetanov, Kamen A; Henson, Richard N A; Tyler, Lorraine K; Razi, Adeel; Geerligs, Linda; Ham, Timothy E; Rowe, James B

2016-03-16

The maintenance of wellbeing across the lifespan depends on the preservation of cognitive function. We propose that successful cognitive aging is determined by interactions both within and between large-scale functional brain networks. Such connectivity can be estimated from task-free functional magnetic resonance imaging (fMRI), also known as resting-state fMRI (rs-fMRI). However, common correlational methods are confounded by age-related changes in the neurovascular signaling. To estimate network interactions at the neuronal rather than vascular level, we used generative models that specified both the neural interactions and a flexible neurovascular forward model. The networks' parameters were optimized to explain the spectral dynamics of rs-fMRI data in 602 healthy human adults from population-based cohorts who were approximately uniformly distributed between 18 and 88 years (www.cam-can.com). We assessed directed connectivity within and between three key large-scale networks: the salience network, dorsal attention network, and default mode network. We found that age influences connectivity both within and between these networks, over and above the effects on neurovascular coupling. Canonical correlation analysis revealed that the relationship between network connectivity and cognitive function was age-dependent: cognitive performance relied on neural dynamics more strongly in older adults. These effects were driven partly by reduced stability of neural activity within all networks, as expressed by an accelerated decay of neural information. Our findings suggest that the balance of excitatory connectivity between networks, and the stability of intrinsic neural representations within networks, changes with age. The cognitive function of older adults becomes increasingly dependent on these factors. Maintaining cognitive function is critical to successful aging. To study the neural basis of cognitive function across the lifespan, we studied a large population

Neural network models: from biology to many - body phenomenology

International Nuclear Information System (INIS)

Clark, J.W.

1993-01-01

The current surge of research on practical side of neural networks and their utility in memory storage/recall, pattern recognition and classification is given in this article. The initial attraction of neural networks as dynamical and statistical system has been investigated. From the view of many-body theorist, the neurons may be thought of as particles, and the weighted connection between the units, as the interaction between these particles. Finally, the author has seen the impressive capabilities of artificial neural networks in pattern recognition and classification may be exploited to solve data management problems in experimental physics and the discovery of radically new theoretically description of physical problems and neural networks can be used in physics. (A.B.)

Energy management for vehicle power net with flexible electric load demand

NARCIS (Netherlands)

Kessels, J.T.B.A.; Bosch, van den P.P.J.; Koot, M.W.T.; Jager, de A.G.

2005-01-01

The electric power demand in road vehicles increases rapidly and to supply all electric loads efficiently, energy management (EM) turns out to be a necessity. In general, EM exploits the storage capacity of a buffer connected to the vehicle's power net, such that energy is stored or retrieved at

Hardware Acceleration of Adaptive Neural Algorithms.

Energy Technology Data Exchange (ETDEWEB)

James, Conrad D. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2017-11-01

As tradit ional numerical computing has faced challenges, researchers have turned towards alternative computing approaches to reduce power - per - computation metrics and improve algorithm performance. Here, we describe an approach towards non - conventional computing that strengthens the connection between machine learning and neuroscience concepts. The Hardware Acceleration of Adaptive Neural Algorithms (HAANA) project ha s develop ed neural machine learning algorithms and hardware for applications in image processing and cybersecurity. While machine learning methods are effective at extracting relevant features from many types of data, the effectiveness of these algorithms degrades when subjected to real - world conditions. Our team has generated novel neural - inspired approa ches to improve the resiliency and adaptability of machine learning algorithms. In addition, we have also designed and fabricated hardware architectures and microelectronic devices specifically tuned towards the training and inference operations of neural - inspired algorithms. Finally, our multi - scale simulation framework allows us to assess the impact of microelectronic device properties on algorithm performance.

Invariant Visual Object and Face Recognition: Neural and Computational Bases, and a Model, VisNet.

Science.gov (United States)

Rolls, Edmund T

2012-01-01

Neurophysiological evidence for invariant representations of objects and faces in the primate inferior temporal visual cortex is described. Then a computational approach to how invariant representations are formed in the brain is described that builds on the neurophysiology. A feature hierarchy model in which invariant representations can be built by self-organizing learning based on the temporal and spatial statistics of the visual input produced by objects as they transform in the world is described. VisNet can use temporal continuity in an associative synaptic learning rule with a short-term memory trace, and/or it can use spatial continuity in continuous spatial transformation learning which does not require a temporal trace. The model of visual processing in the ventral cortical stream can build representations of objects that are invariant with respect to translation, view, size, and also lighting. The model has been extended to provide an account of invariant representations in the dorsal visual system of the global motion produced by objects such as looming, rotation, and object-based movement. The model has been extended to incorporate top-down feedback connections to model the control of attention by biased competition in, for example, spatial and object search tasks. The approach has also been extended to account for how the visual system can select single objects in complex visual scenes, and how multiple objects can be represented in a scene. The approach has also been extended to provide, with an additional layer, for the development of representations of spatial scenes of the type found in the hippocampus.

WaterNet: The NASA water cycle solutions network - Danubian regional applications

International Nuclear Information System (INIS)

Matthews, Dave; Brilly, Mitja; Kobold, Mira; Zagar, Mark; Houser, Paul

2008-01-01

WaterNet is a new international network of researchers, stakeholders, and end-users of remote sensing tools that will benefit the water resources management community. This paper provides an overview and it discusses the concept of solutions networks focusing on the WaterNet. It invites Danubian research and applications teams to join our WaterNet network. The NASA Water cycle Solutions Network's goal is to improve and optimize the sustained ability of water cycle researchers, stakeholders, organizations and networks to interact, identify, harness, and extend NASA research results to augment decision support tools and meet national needs. Our team will develop WaterNet by engaging relevant NASA water cycle research resources and community-of-practice organizations, to develop what we term an 'actionable database' that can be used to communicate and connect NASA Water cycle research Results (NWRs) towards the improvement of water-related Decision Support Tools (DSTs). Recognizing that the European Commission and European Space Agency have also developed many related Water Research products (EWRs), we seek to learn about these and network with the EU teams to include their information in the WaterNet actionable data base and Community of Practice. WaterNet will then develop strategies to connect researchers and decision-makers via innovative communication strategies, improved user access to NASA and EU - Danubian resources, improved water cycle research community appreciation for user requirements, improved policymaker, management and stakeholder knowledge of research and application products, and improved identification of pathways for progress. Finally, WaterNet will develop relevant benchmarking and metrics, to understand the network's characteristics, to optimize its performance, and to establish sustainability. This paper provides examples of several NASA products based on remote sensing and land data assimilation systems that integrate remotely sensed and in

Axial design of fuel for BWRs using neural networks

International Nuclear Information System (INIS)

Ortiz, J.J.; Castillo, A.; Montes, J.L.; Perusquia, R.

2007-01-01

In this work a new system of axial optimization of fuel is presented based on a recurrent multi state neural net called RENODC. They are described with detail the main characteristics of this type of neural net (architecture, energy function and actualization of neural states) and like was adapted to the assemble design of nuclear fuel. The fuel design is proven by means of a fuel recharge and pre determined control rod patterns. By this way a good axial fuel design one has, when the thermal limits are fulfilled along the cycle, the reactor stays critic and at least the wanted longitude of the cycle is reached; also the margin of in cold turned off is verified. The assemble of fuel created with RENODC it is substituted by a recharge assemble and it is sought to verify that the energy requirements and aspects of safety are completed. The used cycle corresponds to a balance cycle of 18 months that it can be applied to the Laguna Verde Nucleo electric Central. The tests demonstrate the effectiveness of the system to reach satisfactory results in times of CPU of around 4 hours. This way, it could be proven that the design proposed with a lightly superior enrichment to that of the substituted design, fulfills the energy requirements. In later stages of this project this system will be coupled to the other optimization modules that are already had. (Author)

Neural network tagging in a toy model

International Nuclear Information System (INIS)

Milek, Marko; Patel, Popat

1999-01-01

The purpose of this study is a comparison of Artificial Neural Network approach to HEP analysis against the traditional methods. A toy model used in this analysis consists of two types of particles defined by four generic properties. A number of 'events' was created according to the model using standard Monte Carlo techniques. Several fully connected, feed forward multi layered Artificial Neural Networks were trained to tag the model events. The performance of each network was compared to the standard analysis mechanisms and significant improvement was observed

NSDann2BS, a neutron spectrum unfolding code based on neural networks technology and two bonner spheres

Energy Technology Data Exchange (ETDEWEB)

Ortiz-Rodriguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solis Sanches, L. O.; Miranda, R. Castaneda; Cervantes Viramontes, J. M. [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica. Av. Ramon Lopez Velarde 801. Col. Centro Zacatecas, Zac (Mexico); Vega-Carrillo, H. R. [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica. Av. Ramon Lopez Velarde 801. Col. Centro Zacatecas, Zac., Mexico. and Unidad Academica de Estudios Nucleares. C. Cip (Mexico)

2013-07-03

In this work a neutron spectrum unfolding code, based on artificial intelligence technology is presented. The code called ''Neutron Spectrometry and Dosimetry with Artificial Neural Networks and two Bonner spheres'', (NSDann2BS), was designed in a graphical user interface under the LabVIEW programming environment. The main features of this code are to use an embedded artificial neural network architecture optimized with the ''Robust design of artificial neural networks methodology'' and to use two Bonner spheres as the only piece of information. In order to build the code here presented, once the net topology was optimized and properly trained, knowledge stored at synaptic weights was extracted and using a graphical framework build on the LabVIEW programming environment, the NSDann2BS code was designed. This code is friendly, intuitive and easy to use for the end user. The code is freely available upon request to authors. To demonstrate the use of the neural net embedded in the NSDann2BS code, the rate counts of {sup 252}Cf, {sup 241}AmBe and {sup 239}PuBe neutron sources measured with a Bonner spheres system.

NSDann2BS, a neutron spectrum unfolding code based on neural networks technology and two bonner spheres

International Nuclear Information System (INIS)

Ortiz-Rodríguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solís Sánches, L. O.; Miranda, R. Castañeda; Cervantes Viramontes, J. M.; Vega-Carrillo, H. R.

2013-01-01

In this work a neutron spectrum unfolding code, based on artificial intelligence technology is presented. The code called ''Neutron Spectrometry and Dosimetry with Artificial Neural Networks and two Bonner spheres'', (NSDann2BS), was designed in a graphical user interface under the LabVIEW programming environment. The main features of this code are to use an embedded artificial neural network architecture optimized with the ''Robust design of artificial neural networks methodology'' and to use two Bonner spheres as the only piece of information. In order to build the code here presented, once the net topology was optimized and properly trained, knowledge stored at synaptic weights was extracted and using a graphical framework build on the LabVIEW programming environment, the NSDann2BS code was designed. This code is friendly, intuitive and easy to use for the end user. The code is freely available upon request to authors. To demonstrate the use of the neural net embedded in the NSDann2BS code, the rate counts of 252 Cf, 241 AmBe and 239 PuBe neutron sources measured with a Bonner spheres system

NSDann2BS, a neutron spectrum unfolding code based on neural networks technology and two bonner spheres

Science.gov (United States)

Ortiz-Rodríguez, J. M.; Reyes Alfaro, A.; Reyes Haro, A.; Solís Sánches, L. O.; Miranda, R. Castañeda; Cervantes Viramontes, J. M.; Vega-Carrillo, H. R.

2013-07-01

In this work a neutron spectrum unfolding code, based on artificial intelligence technology is presented. The code called "Neutron Spectrometry and Dosimetry with Artificial Neural Networks and two Bonner spheres", (NSDann2BS), was designed in a graphical user interface under the LabVIEW programming environment. The main features of this code are to use an embedded artificial neural network architecture optimized with the "Robust design of artificial neural networks methodology" and to use two Bonner spheres as the only piece of information. In order to build the code here presented, once the net topology was optimized and properly trained, knowledge stored at synaptic weights was extracted and using a graphical framework build on the LabVIEW programming environment, the NSDann2BS code was designed. This code is friendly, intuitive and easy to use for the end user. The code is freely available upon request to authors. To demonstrate the use of the neural net embedded in the NSDann2BS code, the rate counts of 252Cf, 241AmBe and 239PuBe neutron sources measured with a Bonner spheres system.

Classification of polycystic ovary based on ultrasound images using competitive neural network

Science.gov (United States)

Dewi, R. M.; Adiwijaya; Wisesty, U. N.; Jondri

2018-03-01

Infertility in the women reproduction system due to inhibition of follicles maturation process causing the number of follicles which is called polycystic ovaries (PCO). PCO detection is still operated manually by a gynecologist by counting the number and size of follicles in the ovaries, so it takes a long time and needs high accuracy. In general, PCO can be detected by calculating stereology or feature extraction and classification. In this paper, we designed a system to classify PCO by using the feature extraction (Gabor Wavelet method) and Competitive Neural Network (CNN). CNN was selected because this method is the combination between Hemming Net and The Max Net so that the data classification can be performed based on the specific characteristics of ultrasound data. Based on the result of system testing, Competitive Neural Network obtained the highest accuracy is 80.84% and the time process is 60.64 seconds (when using 32 feature vectors as well as weight and bias values respectively of 0.03 and 0.002).

Lyapunov Functions to Caputo Fractional Neural Networks with Time-Varying Delays

Directory of Open Access Journals (Sweden)

Ravi Agarwal

2018-05-01

Full Text Available One of the main properties of solutions of nonlinear Caputo fractional neural networks is stability and often the direct Lyapunov method is used to study stability properties (usually these Lyapunov functions do not depend on the time variable. In connection with the Lyapunov fractional method we present a brief overview of the most popular fractional order derivatives of Lyapunov functions among Caputo fractional delay differential equations. These derivatives are applied to various types of neural networks with variable coefficients and time-varying delays. We show that quadratic Lyapunov functions and their Caputo fractional derivatives are not applicable in some cases when one studies stability properties. Some sufficient conditions for stability of equilibrium of nonlinear Caputo fractional neural networks with time dependent transmission delays, time varying self-regulating parameters of all units and time varying functions of the connection between two neurons in the network are obtained. The cases of time varying Lipschitz coefficients as well as nonLipschitz activation functions are studied. We illustrate our theory on particular nonlinear Caputo fractional neural networks.

SpectralNET – an application for spectral graph analysis and visualization

Directory of Open Access Journals (Sweden)

Schreiber Stuart L

2005-10-01

Full Text Available Abstract Background Graph theory provides a computational framework for modeling a variety of datasets including those emerging from genomics, proteomics, and chemical genetics. Networks of genes, proteins, small molecules, or other objects of study can be represented as graphs of nodes (vertices and interactions (edges that can carry different weights. SpectralNET is a flexible application for analyzing and visualizing these biological and chemical networks. Results Available both as a standalone .NET executable and as an ASP.NET web application, SpectralNET was designed specifically with the analysis of graph-theoretic metrics in mind, a computational task not easily accessible using currently available applications. Users can choose either to upload a network for analysis using a variety of input formats, or to have SpectralNET generate an idealized random network for comparison to a real-world dataset. Whichever graph-generation method is used, SpectralNET displays detailed information about each connected component of the graph, including graphs of degree distribution, clustering coefficient by degree, and average distance by degree. In addition, extensive information about the selected vertex is shown, including degree, clustering coefficient, various distance metrics, and the corresponding components of the adjacency, Laplacian, and normalized Laplacian eigenvectors. SpectralNET also displays several graph visualizations, including a linear dimensionality reduction for uploaded datasets (Principal Components Analysis and a non-linear dimensionality reduction that provides an elegant view of global graph structure (Laplacian eigenvectors. Conclusion SpectralNET provides an easily accessible means of analyzing graph-theoretic metrics for data modeling and dimensionality reduction. SpectralNET is publicly available as both a .NET application and an ASP.NET web application from http://chembank.broad.harvard.edu/resources/. Source code is

Knowledge Access in Rural Inter-connected Areas Network ...

International Development Research Centre (IDRC) Digital Library (Canada)

Knowledge Access in Rural Inter-connected Areas Network (KariaNet) - Phase II ... and indigenous knowledge using information and communication technologies (ICTs) ... for research proposals on the aforementioned topics, action-research projects, ... Evaluating knowledge-sharing methods to improve land utilization and ...

Decreased functional connectivity and disrupted neural network in the prefrontal cortex of affective disorders: A resting-state fNIRS study.

Science.gov (United States)

Zhu, Huilin; Xu, Jie; Li, Jiangxue; Peng, Hongjun; Cai, Tingting; Li, Xinge; Wu, Shijing; Cao, Wei; He, Sailing

2017-10-15

Affective disorders (AD) have been conceptualized as neural network-level diseases. In this study, we utilized functional near infrared spectroscopy (fNIRS) to investigate the spontaneous hemodynamic activities in the prefrontal cortex (PFC) of the AD patients with or without medications. 42 optical channels were applied to cover the superior frontal gyrus (SFG), middle frontal gyrus (MFG), and inferior frontal gyrus (IFG), which constitute one of the most important affective networks of the brain. We performed resting-state measurements on 28 patients who were diagnosed as having AD and 30 healthy controls (HC). Raw fNIRS data were preprocessed with independent component analysis (ICA) and a band-pass filter to remove artifacts and physiological noise. By systematically analyzing the intra-regional, intrahemispheric, and interhemispheric connectivities based on the spontaneous oscillations of Δ[HbO], our results indicated that patients with AD exhibited significantly reduced intra-regional and symmetrically interhemispheric connectivities in the PFC when compared to HC. More specifically, relative to HC, AD patients showed significantly lower locally functional connectivity in the right IFG, and poor long-distance connectivity between bilateral IFG. In addition, AD patients without medication presented more disrupted cortical organizations in the PFC, and the severity of self-reported symptoms of depression was negatively correlated with the strength of intra-regional and symmetrically interhemispheric connectivity in the PFC. Regarding the measuring technique, fNIRS has restricted measurement depth and spatial resolution. During the study, the subgroups of AD, such as major depressive disorder, bipolar, comorbidity, or non-comorbidity, dosage of psychotropic drugs, as well as different types of pharmacological responses were not distinguished and systematically compared. Furthermore, due to the limitation of the research design, it was still not very clear how

How synapses can enhance sensibility of a neural network

Science.gov (United States)

Protachevicz, P. R.; Borges, F. S.; Iarosz, K. C.; Caldas, I. L.; Baptista, M. S.; Viana, R. L.; Lameu, E. L.; Macau, E. E. N.; Batista, A. M.

2018-02-01

In this work, we study the dynamic range in a neural network modelled by cellular automaton. We consider deterministic and non-deterministic rules to simulate electrical and chemical synapses. Chemical synapses have an intrinsic time-delay and are susceptible to parameter variations guided by learning Hebbian rules of behaviour. The learning rules are related to neuroplasticity that describes change to the neural connections in the brain. Our results show that chemical synapses can abruptly enhance sensibility of the neural network, a manifestation that can become even more predominant if learning rules of evolution are applied to the chemical synapses.

Connections model for tomographic images reconstruction; Modelo conexionista para reconstrucao de imagens tomograficas

Energy Technology Data Exchange (ETDEWEB)

Rodrigues, R.G.S.; Pela, C.A.; Roque, S.F. A.C. [Departamento de Fisica e Matematica (FFCLRP) USP. Av. Bandeirantes, 3900- 14040- 901- Ribeirao Preto, Sao Paulo (Brazil)

1998-12-31

This paper shows an artificial neural network with an adequately topology for tomographic image reconstruction. The associated error function is derived and the learning algorithm is make. The simulated results are presented and demonstrate the existence of a generalized solution for nets with linear activation function. (Author)

Modular representation of layered neural networks.

Science.gov (United States)

Watanabe, Chihiro; Hiramatsu, Kaoru; Kashino, Kunio

2018-01-01

Layered neural networks have greatly improved the performance of various applications including image processing, speech recognition, natural language processing, and bioinformatics. However, it is still difficult to discover or interpret knowledge from the inference provided by a layered neural network, since its internal representation has many nonlinear and complex parameters embedded in hierarchical layers. Therefore, it becomes important to establish a new methodology by which layered neural networks can be understood. In this paper, we propose a new method for extracting a global and simplified structure from a layered neural network. Based on network analysis, the proposed method detects communities or clusters of units with similar connection patterns. We show its effectiveness by applying it to three use cases. (1) Network decomposition: it can decompose a trained neural network into multiple small independent networks thus dividing the problem and reducing the computation time. (2) Training assessment: the appropriateness of a trained result with a given hyperparameter or randomly chosen initial parameters can be evaluated by using a modularity index. And (3) data analysis: in practical data it reveals the community structure in the input, hidden, and output layers, which serves as a clue for discovering knowledge from a trained neural network. Copyright © 2017 Elsevier Ltd. All rights reserved.

Net-baryon-, net-proton-, and net-charge kurtosis in heavy-ion collisions within a relativistic transport approach

International Nuclear Information System (INIS)

Nahrgang, Marlene; Schuster, Tim; Stock, Reinhard; Mitrovski, Michael; Bleicher, Marcus

2012-01-01

We explore the potential of net-baryon, net-proton and net-charge kurtosis measurements to investigate the properties of hot and dense matter created in relativistic heavy-ion collisions. Contrary to calculations in a grand-canonical ensemble we explicitly take into account exact electric and baryon charge conservation on an event-by-event basis. This drastically limits the width of baryon fluctuations. A simple model to account for this is to assume a grand-canonical distribution with a sharp cut-off at the tails. We present baseline predictions of the energy dependence of the net-baryon, net-proton and net-charge kurtosis for central (b≤2.75 fm) Pb+Pb/Au+Au collisions from E lab =2A GeV to √(s NN )=200 GeV from the UrQMD model. While the net-charge kurtosis is compatible with values around zero, the net-baryon number decreases to large negative values with decreasing beam energy. The net-proton kurtosis becomes only slightly negative for low √(s NN ). (orig.)

Fast neural-net based fake track rejection in the LHCb reconstruction

CERN Document Server

De Cian, Michel; Seyfert, Paul; Stahl, Sascha

2017-01-01

A neural-network based algorithm to identify fake tracks in the LHCb pattern recognition is presented. This algorithm, called ghost probability, retains more than 99 % of well reconstructed tracks while reducing the number of fake tracks by 60 %. It is fast enough to fit into the CPU time budget of the software trigger farm and thus reduces the combinatorics of the decay reconstructions, as well as the number of tracks that need to be processed by the particle identification algorithms. As a result, it strongly contributes to the achievement of having the same reconstruction online and offline in the LHCb experiment in Run II of the LHC.

An Overview of Bayesian Methods for Neural Spike Train Analysis

Directory of Open Access Journals (Sweden)

Zhe Chen

2013-01-01

Full Text Available Neural spike train analysis is an important task in computational neuroscience which aims to understand neural mechanisms and gain insights into neural circuits. With the advancement of multielectrode recording and imaging technologies, it has become increasingly demanding to develop statistical tools for analyzing large neuronal ensemble spike activity. Here we present a tutorial overview of Bayesian methods and their representative applications in neural spike train analysis, at both single neuron and population levels. On the theoretical side, we focus on various approximate Bayesian inference techniques as applied to latent state and parameter estimation. On the application side, the topics include spike sorting, tuning curve estimation, neural encoding and decoding, deconvolution of spike trains from calcium imaging signals, and inference of neuronal functional connectivity and synchrony. Some research challenges and opportunities for neural spike train analysis are discussed.

Spatiotemporal discrimination in neural networks with short-term synaptic plasticity

Science.gov (United States)

Shlaer, Benjamin; Miller, Paul

2015-03-01

Cells in recurrently connected neural networks exhibit bistability, which allows for stimulus information to persist in a circuit even after stimulus offset, i.e. short-term memory. However, such a system does not have enough hysteresis to encode temporal information about the stimuli. The biophysically described phenomenon of synaptic depression decreases synaptic transmission strengths due to increased presynaptic activity. This short-term reduction in synaptic strengths can destabilize attractor states in excitatory recurrent neural networks, causing the network to move along stimulus dependent dynamical trajectories. Such a network can successfully separate amplitudes and durations of stimuli from the number of successive stimuli. Stimulus number, duration and intensity encoding in randomly connected attractor networks with synaptic depression. Front. Comput. Neurosci. 7:59., and so provides a strong candidate network for the encoding of spatiotemporal information. Here we explicitly demonstrate the capability of a recurrent neural network with short-term synaptic depression to discriminate between the temporal sequences in which spatial stimuli are presented.

Local Dynamics in Trained Recurrent Neural Networks.

Science.gov (United States)

Rivkind, Alexander; Barak, Omri

2017-06-23

Learning a task induces connectivity changes in neural circuits, thereby changing their dynamics. To elucidate task-related neural dynamics, we study trained recurrent neural networks. We develop a mean field theory for reservoir computing networks trained to have multiple fixed point attractors. Our main result is that the dynamics of the network's output in the vicinity of attractors is governed by a low-order linear ordinary differential equation. The stability of the resulting equation can be assessed, predicting training success or failure. As a consequence, networks of rectified linear units and of sigmoidal nonlinearities are shown to have diametrically different properties when it comes to learning attractors. Furthermore, a characteristic time constant, which remains finite at the edge of chaos, offers an explanation of the network's output robustness in the presence of variability of the internal neural dynamics. Finally, the proposed theory predicts state-dependent frequency selectivity in the network response.

Local Dynamics in Trained Recurrent Neural Networks

Science.gov (United States)

Rivkind, Alexander; Barak, Omri

2017-06-01

Learning a task induces connectivity changes in neural circuits, thereby changing their dynamics. To elucidate task-related neural dynamics, we study trained recurrent neural networks. We develop a mean field theory for reservoir computing networks trained to have multiple fixed point attractors. Our main result is that the dynamics of the network's output in the vicinity of attractors is governed by a low-order linear ordinary differential equation. The stability of the resulting equation can be assessed, predicting training success or failure. As a consequence, networks of rectified linear units and of sigmoidal nonlinearities are shown to have diametrically different properties when it comes to learning attractors. Furthermore, a characteristic time constant, which remains finite at the edge of chaos, offers an explanation of the network's output robustness in the presence of variability of the internal neural dynamics. Finally, the proposed theory predicts state-dependent frequency selectivity in the network response.

Deep Neural Yodelling

OpenAIRE

Pfäffli, Daniel (Autor/in)

2018-01-01

Yodel music differs from most other genres by exercising the transition from chest voice to falsetto with an audible glottal stop which is recognised even by laymen. Yodel often consists of a yodeller with a choir accompaniment. In Switzerland, it is differentiated between the natural yodel and yodel songs. Today's approaches to music generation with machine learning algorithms are based on neural networks, which are best described by stacked layers of neurons which are connected with neurons...

A neural network approach to job-shop scheduling.

Science.gov (United States)

Zhou, D N; Cherkassky, V; Baldwin, T R; Olson, D E

1991-01-01

A novel analog computational network is presented for solving NP-complete constraint satisfaction problems, i.e. job-shop scheduling. In contrast to most neural approaches to combinatorial optimization based on quadratic energy cost function, the authors propose to use linear cost functions. As a result, the network complexity (number of neurons and the number of resistive interconnections) grows only linearly with problem size, and large-scale implementations become possible. The proposed approach is related to the linear programming network described by D.W. Tank and J.J. Hopfield (1985), which also uses a linear cost function for a simple optimization problem. It is shown how to map a difficult constraint-satisfaction problem onto a simple neural net in which the number of neural processors equals the number of subjobs (operations) and the number of interconnections grows linearly with the total number of operations. Simulations show that the authors' approach produces better solutions than existing neural approaches to job-shop scheduling, i.e. the traveling salesman problem-type Hopfield approach and integer linear programming approach of J.P.S. Foo and Y. Takefuji (1988), in terms of the quality of the solution and the network complexity.

Synchronization and Inter-Layer Interactions of Noise-Driven Neural Networks.

Science.gov (United States)

Yuniati, Anis; Mai, Te-Lun; Chen, Chi-Ming

2017-01-01

In this study, we used the Hodgkin-Huxley (HH) model of neurons to investigate the phase diagram of a developing single-layer neural network and that of a network consisting of two weakly coupled neural layers. These networks are noise driven and learn through the spike-timing-dependent plasticity (STDP) or the inverse STDP rules. We described how these networks transited from a non-synchronous background activity state (BAS) to a synchronous firing state (SFS) by varying the network connectivity and the learning efficacy. In particular, we studied the interaction between a SFS layer and a BAS layer, and investigated how synchronous firing dynamics was induced in the BAS layer. We further investigated the effect of the inter-layer interaction on a BAS to SFS repair mechanism by considering three types of neuron positioning (random, grid, and lognormal distributions) and two types of inter-layer connections (random and preferential connections). Among these scenarios, we concluded that the repair mechanism has the largest effect for a network with the lognormal neuron positioning and the preferential inter-layer connections.

Salient regions detection using convolutional neural networks and color volume

Science.gov (United States)

Liu, Guang-Hai; Hou, Yingkun

2018-03-01

Convolutional neural network is an important technique in machine learning, pattern recognition and image processing. In order to reduce the computational burden and extend the classical LeNet-5 model to the field of saliency detection, we propose a simple and novel computing model based on LeNet-5 network. In the proposed model, hue, saturation and intensity are utilized to extract depth cues, and then we integrate depth cues and color volume to saliency detection following the basic structure of the feature integration theory. Experimental results show that the proposed computing model outperforms some existing state-of-the-art methods on MSRA1000 and ECSSD datasets.

Self-esteem modulates amygdala-ventrolateral prefrontal cortex connectivity in response to mortality threats.

Science.gov (United States)

Yanagisawa, Kuniaki; Abe, Nobuhito; Kashima, Emiko S; Nomura, Michio

2016-03-01

Reminders of death often elicit defensive responses in individuals, especially among those with low self-esteem. Although empirical evidence indicates that self-esteem serves as a buffer against mortality threats, the precise neural mechanism underlying this effect remains unknown. We used functional magnetic resonance imaging (fMRI) to test the hypothesis that self-esteem modulates neural responses to death-related stimuli, especially functional connectivity within the limbic-frontal circuitry, thereby affecting subsequent defensive reactions. As predicted, individuals with high self-esteem subjected to a mortality threat exhibited increased amygdala-ventrolateral prefrontal cortex (VLPFC) connectivity during the processing of death-related stimuli compared with individuals who have low self-esteem. Further analysis revealed that stronger functional connectivity between the amygdala and the VLPFC predicted a subsequent decline in responding defensively to those who threaten one's beliefs. These results suggest that the amygdala-VLPFC interaction, which is modulated by self-esteem, can reduce the defensiveness caused by death-related stimuli, thereby providing a neural explanation for why individuals with high self-esteem exhibit less defensive reactions to mortality threats. (c) 2016 APA, all rights reserved).

Associative memory model with spontaneous neural activity

Science.gov (United States)

Kurikawa, Tomoki; Kaneko, Kunihiko

2012-05-01

We propose a novel associative memory model wherein the neural activity without an input (i.e., spontaneous activity) is modified by an input to generate a target response that is memorized for recall upon the same input. Suitable design of synaptic connections enables the model to memorize input/output (I/O) mappings equaling 70% of the total number of neurons, where the evoked activity distinguishes a target pattern from others. Spontaneous neural activity without an input shows chaotic dynamics but keeps some similarity with evoked activities, as reported in recent experimental studies.

Auto-Context Convolutional Neural Network (Auto-Net) for Brain Extraction in Magnetic Resonance Imaging.

Science.gov (United States)

Mohseni Salehi, Seyed Sadegh; Erdogmus, Deniz; Gholipour, Ali

2017-11-01

Brain extraction or whole brain segmentation is an important first step in many of the neuroimage analysis pipelines. The accuracy and the robustness of brain extraction, therefore, are crucial for the accuracy of the entire brain analysis process. The state-of-the-art brain extraction techniques rely heavily on the accuracy of alignment or registration between brain atlases and query brain anatomy, and/or make assumptions about the image geometry, and therefore have limited success when these assumptions do not hold or image registration fails. With the aim of designing an accurate, learning-based, geometry-independent, and registration-free brain extraction tool, in this paper, we present a technique based on an auto-context convolutional neural network (CNN), in which intrinsic local and global image features are learned through 2-D patches of different window sizes. We consider two different architectures: 1) a voxelwise approach based on three parallel 2-D convolutional pathways for three different directions (axial, coronal, and sagittal) that implicitly learn 3-D image information without the need for computationally expensive 3-D convolutions and 2) a fully convolutional network based on the U-net architecture. Posterior probability maps generated by the networks are used iteratively as context information along with the original image patches to learn the local shape and connectedness of the brain to extract it from non-brain tissue. The brain extraction results we have obtained from our CNNs are superior to the recently reported results in the literature on two publicly available benchmark data sets, namely, LPBA40 and OASIS, in which we obtained the Dice overlap coefficients of 97.73% and 97.62%, respectively. Significant improvement was achieved via our auto-context algorithm. Furthermore, we evaluated the performance of our algorithm in the challenging problem of extracting arbitrarily oriented fetal brains in reconstructed fetal brain magnetic

Neural network segmentation of magnetic resonance images

International Nuclear Information System (INIS)

Frederick, B.

1990-01-01

Neural networks are well adapted to the task of grouping input patterns into subsets which share some similarity. Moreover, once trained, they can generalize their classification rules to classify new data sets. Sets of pixel intensities from magnetic resonance (MR) images provide a natural input to a neural network; by varying imaging parameters, MR images can reflect various independent physical parameters of tissues in their pixel intensities. A neural net can then be trained to classify physically similar tissue types based on sets of pixel intensities resulting from different imaging studies on the same subject. This paper reports that a neural network classifier for image segmentation was implanted on a Sun 4/60, and was tested on the task of classifying tissues of canine head MR images. Four images of a transaxial slice with different imaging sequences were taken as input to the network (three spin-echo images and an inversion recovery image). The training set consisted of 691 representative samples of gray matter, white matter, cerebrospinal fluid, bone, and muscle preclassified by a neuroscientist. The network was trained using a fast backpropagation algorithm to derive the decision criteria to classify any location in the image by its pixel intensities, and the image was subsequently segmented by the classifier

Petri Nets

Indian Academy of Sciences (India)

In a computer system, for example, typical discrete events ... This project brought out a series of influential reports on Petri net theory in the mid and late ... Technology became a leading centre for Petri net research and from then on, Petri nets ...

Fine-grained vehicle type recognition based on deep convolution neural networks

Directory of Open Access Journals (Sweden)

Hongcai CHEN

2017-12-01

Full Text Available Public security and traffic department put forward higher requirements for real-time performance and accuracy of vehicle type recognition in complex traffic scenes. Aiming at the problems of great plice forces occupation, low retrieval efficiency, and lacking of intelligence for dealing with false license, fake plate vehicles and vehicles without plates, this paper proposes a vehicle type fine-grained recognition method based GoogleNet deep convolution neural networks. The filter size and numbers of convolution neural network are designed, the activation function and vehicle type classifier are optimally selected, and a new network framework is constructed for vehicle type fine-grained recognition. The experimental results show that the proposed method has 97% accuracy for vehicle type fine-grained recognition and has greater improvement than the original GoogleNet model. Moreover, the new model effectively reduces the number of training parameters, and saves computer memory. Fine-grained vehicle type recognition can be used in intelligent traffic management area, and has important theoretical research value and practical significance.

Investigation of efficient features for image recognition by neural networks.

Science.gov (United States)

Goltsev, Alexander; Gritsenko, Vladimir

2012-04-01

In the paper, effective and simple features for image recognition (named LiRA-features) are investigated in the task of handwritten digit recognition. Two neural network classifiers are considered-a modified 3-layer perceptron LiRA and a modular assembly neural network. A method of feature selection is proposed that analyses connection weights formed in the preliminary learning process of a neural network classifier. In the experiments using the MNIST database of handwritten digits, the feature selection procedure allows reduction of feature number (from 60 000 to 7000) preserving comparable recognition capability while accelerating computations. Experimental comparison between the LiRA perceptron and the modular assembly neural network is accomplished, which shows that recognition capability of the modular assembly neural network is somewhat better. Copyright © 2011 Elsevier Ltd. All rights reserved.

A Science Cloud: OneSpaceNet

Science.gov (United States)

Morikawa, Y.; Murata, K. T.; Watari, S.; Kato, H.; Yamamoto, K.; Inoue, S.; Tsubouchi, K.; Fukazawa, K.; Kimura, E.; Tatebe, O.; Shimojo, S.

2010-12-01

Main methodologies of Solar-Terrestrial Physics (STP) so far are theoretical, experimental and observational, and computer simulation approaches. Recently "informatics" is expected as a new (fourth) approach to the STP studies. Informatics is a methodology to analyze large-scale data (observation data and computer simulation data) to obtain new findings using a variety of data processing techniques. At NICT (National Institute of Information and Communications Technology, Japan) we are now developing a new research environment named "OneSpaceNet". The OneSpaceNet is a cloud-computing environment specialized for science works, which connects many researchers with high-speed network (JGN: Japan Gigabit Network). The JGN is a wide-area back-born network operated by NICT; it provides 10G network and many access points (AP) over Japan. The OneSpaceNet also provides with rich computer resources for research studies, such as super-computers, large-scale data storage area, licensed applications, visualization devices (like tiled display wall: TDW), database/DBMS, cluster computers (4-8 nodes) for data processing and communication devices. What is amazing in use of the science cloud is that a user simply prepares a terminal (low-cost PC). Once connecting the PC to JGN2plus, the user can make full use of the rich resources of the science cloud. Using communication devices, such as video-conference system, streaming and reflector servers, and media-players, the users on the OneSpaceNet can make research communications as if they belong to a same (one) laboratory: they are members of a virtual laboratory. The specification of the computer resources on the OneSpaceNet is as follows: The size of data storage we have developed so far is almost 1PB. The number of the data files managed on the cloud storage is getting larger and now more than 40,000,000. What is notable is that the disks forming the large-scale storage are distributed to 5 data centers over Japan (but the storage

Connectivities and synchronous firing in cortical neuronal networks

International Nuclear Information System (INIS)

Jia, L.C.; Sano, M.; Lai, P.-Y.; Chan, C.K.

2004-01-01

Network connectivities (k-bar) of cortical neural cultures are studied by synchronized firing and determined from measured correlations between fluorescence intensities of firing neurons. The bursting frequency (f) during synchronized firing of the networks is found to be an increasing function of k-bar. With f taken to be proportional to k-bar, a simple random model with a k-bar dependent connection probability p(k-bar) has been constructed to explain our experimental findings successfully

Cross-hemispheric functional connectivity in the human fetal brain.

Science.gov (United States)

Thomason, Moriah E; Dassanayake, Maya T; Shen, Stephen; Katkuri, Yashwanth; Alexis, Mitchell; Anderson, Amy L; Yeo, Lami; Mody, Swati; Hernandez-Andrade, Edgar; Hassan, Sonia S; Studholme, Colin; Jeong, Jeong-Won; Romero, Roberto

2013-02-20

Compelling evidence indicates that psychiatric and developmental disorders are generally caused by disruptions in the functional connectivity (FC) of brain networks. Events occurring during development, and in particular during fetal life, have been implicated in the genesis of such disorders. However, the developmental timetable for the emergence of neural FC during human fetal life is unknown. We present the results of resting-state functional magnetic resonance imaging performed in 25 healthy human fetuses in the second and third trimesters of pregnancy (24 to 38 weeks of gestation). We report the presence of bilateral fetal brain FC and regional and age-related variation in FC. Significant bilateral connectivity was evident in half of the 42 areas tested, and the strength of FC between homologous cortical brain regions increased with advancing gestational age. We also observed medial to lateral gradients in fetal functional brain connectivity. These findings improve understanding of human fetal central nervous system development and provide a basis for examining the role of insults during fetal life in the subsequent development of disorders in neural FC.

Semantic Segmentation of Convolutional Neural Network for Supervised Classification of Multispectral Remote Sensing

Science.gov (United States)

Xue, L.; Liu, C.; Wu, Y.; Li, H.

2018-04-01

Semantic segmentation is a fundamental research in remote sensing image processing. Because of the complex maritime environment, the classification of roads, vegetation, buildings and water from remote Sensing Imagery is a challenging task. Although the neural network has achieved excellent performance in semantic segmentation in the last years, there are a few of works using CNN for ground object segmentation and the results could be further improved. This paper used convolution neural network named U-Net, its structure has a contracting path and an expansive path to get high resolution output. In the network , We added BN layers, which is more conducive to the reverse pass. Moreover, after upsampling convolution , we add dropout layers to prevent overfitting. They are promoted to get more precise segmentation results. To verify this network architecture, we used a Kaggle dataset. Experimental results show that U-Net achieved good performance compared with other architectures, especially in high-resolution remote sensing imagery.

High-Performance Neural Networks for Visual Object Classification

OpenAIRE

Cireşan, Dan C.; Meier, Ueli; Masci, Jonathan; Gambardella, Luca M.; Schmidhuber, Jürgen

2011-01-01

We present a fast, fully parameterizable GPU implementation of Convolutional Neural Network variants. Our feature extractors are neither carefully designed nor pre-wired, but rather learned in a supervised way. Our deep hierarchical architectures achieve the best published results on benchmarks for object classification (NORB, CIFAR10) and handwritten digit recognition (MNIST), with error rates of 2.53%, 19.51%, 0.35%, respectively. Deep nets trained by simple back-propagation perform better ...

Evaluation of 604 Connect

OpenAIRE

Ladner, S.; Ihnat, M.

2000-01-01

The Vancouver Community Network (VCN) is a not-for-profit Internet Service Provider (ISP), based on the “freenet” model of public Internet access. As a VolNet delivery agency, VCN committed to providing participating organizations with the following: (1) A communications protocol, (2) Internet Access, (3) Computer Equipment, (4) Training, and (5) Technical Support. In April 1999, VCN began receiving applications from non-profit organizations for its 604 Connect program, so named for the 604 t...

Changes in the interaction of resting-state neural networks from adolescence to adulthood.

Science.gov (United States)

Stevens, Michael C; Pearlson, Godfrey D; Calhoun, Vince D

2009-08-01

This study examined how the mutual interactions of functionally integrated neural networks during resting-state fMRI differed between adolescence and adulthood. Independent component analysis (ICA) was used to identify functionally connected neural networks in 100 healthy participants aged 12-30 years. Hemodynamic timecourses that represented integrated neural network activity were analyzed with tools that quantified system "causal density" estimates, which indexed the proportion of significant Granger causality relationships among system nodes. Mutual influences among networks decreased with age, likely reflecting stronger within-network connectivity and more efficient between-network influences with greater development. Supplemental tests showed that this normative age-related reduction in causal density was accompanied by fewer significant connections to and from each network, regional increases in the strength of functional integration within networks, and age-related reductions in the strength of numerous specific system interactions. The latter included paths between lateral prefrontal-parietal circuits and "default mode" networks. These results contribute to an emerging understanding that activity in widely distributed networks thought to underlie complex cognition influences activity in other networks. (c) 2009 Wiley-Liss, Inc.

The equivalency between logic Petri workflow nets and workflow nets.

Science.gov (United States)

Wang, Jing; Yu, ShuXia; Du, YuYue

2015-01-01

Logic Petri nets (LPNs) can describe and analyze batch processing functions and passing value indeterminacy in cooperative systems. Logic Petri workflow nets (LPWNs) are proposed based on LPNs in this paper. Process mining is regarded as an important bridge between modeling and analysis of data mining and business process. Workflow nets (WF-nets) are the extension to Petri nets (PNs), and have successfully been used to process mining. Some shortcomings cannot be avoided in process mining, such as duplicate tasks, invisible tasks, and the noise of logs. The online shop in electronic commerce in this paper is modeled to prove the equivalence between LPWNs and WF-nets, and advantages of LPWNs are presented.

The Equivalency between Logic Petri Workflow Nets and Workflow Nets

Science.gov (United States)

Wang, Jing; Yu, ShuXia; Du, YuYue

2015-01-01

Logic Petri nets (LPNs) can describe and analyze batch processing functions and passing value indeterminacy in cooperative systems. Logic Petri workflow nets (LPWNs) are proposed based on LPNs in this paper. Process mining is regarded as an important bridge between modeling and analysis of data mining and business process. Workflow nets (WF-nets) are the extension to Petri nets (PNs), and have successfully been used to process mining. Some shortcomings cannot be avoided in process mining, such as duplicate tasks, invisible tasks, and the noise of logs. The online shop in electronic commerce in this paper is modeled to prove the equivalence between LPWNs and WF-nets, and advantages of LPWNs are presented. PMID:25821845

Ontology Mapping Neural Network: An Approach to Learning and Inferring Correspondences among Ontologies

Science.gov (United States)

Peng, Yefei

2010-01-01

An ontology mapping neural network (OMNN) is proposed in order to learn and infer correspondences among ontologies. It extends the Identical Elements Neural Network (IENN)'s ability to represent and map complex relationships. The learning dynamics of simultaneous (interlaced) training of similar tasks interact at the shared connections of the…

Online fouling detection in electrical circulation heaters using neural networks

Energy Technology Data Exchange (ETDEWEB)

Lalot, S. [M.E.T.I.E.R., Longuenesse Cedex (France); Universite de Valenciennes (France). LME; Lecoeuche, S. [M.E.T.I.E.R., Longuenesse Cedex (France); Universite de Lille (France). Laboratoire 13D

2003-06-01

Here is presented a method that is able to detect fouling during the service of a circulation electrical heater. The neural based technique is divided in two major steps: identification and classification. Each step uses a neural network, the connection weights of the first one being the inputs of the second network. Each step is detailed and the main characteristics and abilities of the two neural networks are given. It is shown that the method is able to discriminate fouling from viscosity modification that would lead to the same type of effect on the total heat transfer coefficient. (author)

Statistical mechanics of attractor neural network models with synaptic depression

International Nuclear Information System (INIS)

Igarashi, Yasuhiko; Oizumi, Masafumi; Otsubo, Yosuke; Nagata, Kenji; Okada, Masato

2009-01-01

Synaptic depression is known to control gain for presynaptic inputs. Since cortical neurons receive thousands of presynaptic inputs, and their outputs are fed into thousands of other neurons, the synaptic depression should influence macroscopic properties of neural networks. We employ simple neural network models to explore the macroscopic effects of synaptic depression. Systems with the synaptic depression cannot be analyzed due to asymmetry of connections with the conventional equilibrium statistical-mechanical approach. Thus, we first propose a microscopic dynamical mean field theory. Next, we derive macroscopic steady state equations and discuss the stabilities of steady states for various types of neural network models.

Neural substrates of decision-making.

Science.gov (United States)

Broche-Pérez, Y; Herrera Jiménez, L F; Omar-Martínez, E

2016-06-01

Decision-making is the process of selecting a course of action from among 2 or more alternatives by considering the potential outcomes of selecting each option and estimating its consequences in the short, medium and long term. The prefrontal cortex (PFC) has traditionally been considered the key neural structure in decision-making process. However, new studies support the hypothesis that describes a complex neural network including both cortical and subcortical structures. The aim of this review is to summarise evidence on the anatomical structures underlying the decision-making process, considering new findings that support the existence of a complex neural network that gives rise to this complex neuropsychological process. Current evidence shows that the cortical structures involved in decision-making include the orbitofrontal cortex (OFC), anterior cingulate cortex (ACC), and dorsolateral prefrontal cortex (DLPFC). This process is assisted by subcortical structures including the amygdala, thalamus, and cerebellum. Findings to date show that both cortical and subcortical brain regions contribute to the decision-making process. The neural basis of decision-making is a complex neural network of cortico-cortical and cortico-subcortical connections which includes subareas of the PFC, limbic structures, and the cerebellum. Copyright © 2014 Sociedad Española de Neurología. Published by Elsevier España, S.L.U. All rights reserved.

Markov models for fMRI correlation structure: Is brain functional connectivity small world, or decomposable into networks?

Science.gov (United States)

Varoquaux, G; Gramfort, A; Poline, J B; Thirion, B

2012-01-01

Correlations in the signal observed via functional Magnetic Resonance Imaging (fMRI), are expected to reveal the interactions in the underlying neural populations through hemodynamic response. In particular, they highlight distributed set of mutually correlated regions that correspond to brain networks related to different cognitive functions. Yet graph-theoretical studies of neural connections give a different picture: that of a highly integrated system with small-world properties: local clustering but with short pathways across the complete structure. We examine the conditional independence properties of the fMRI signal, i.e. its Markov structure, to find realistic assumptions on the connectivity structure that are required to explain the observed functional connectivity. In particular we seek a decomposition of the Markov structure into segregated functional networks using decomposable graphs: a set of strongly-connected and partially overlapping cliques. We introduce a new method to efficiently extract such cliques on a large, strongly-connected graph. We compare methods learning different graph structures from functional connectivity by testing the goodness of fit of the model they learn on new data. We find that summarizing the structure as strongly-connected networks can give a good description only for very large and overlapping networks. These results highlight that Markov models are good tools to identify the structure of brain connectivity from fMRI signals, but for this purpose they must reflect the small-world properties of the underlying neural systems. Copyright © 2012 Elsevier Ltd. All rights reserved.

Phase Diagram of Spiking Neural Networks

Directory of Open Access Journals (Sweden)

Hamed eSeyed-Allaei

2015-03-01

Full Text Available In computer simulations of spiking neural networks, often it is assumed that every two neurons of the network are connected by a probablilty of 2%, 20% of neurons are inhibitory and 80% are excitatory. These common values are based on experiments, observations. but here, I take a different perspective, inspired by evolution. I simulate many networks, each with a different set of parameters, and then I try to figure out what makes the common values desirable by nature. Networks which are configured according to the common values, have the best dynamic range in response to an impulse and their dynamic range is more robust in respect to synaptic weights. In fact, evolution has favored networks of best dynamic range. I present a phase diagram that shows the dynamic ranges of different networks of different parameteres. This phase diagram gives an insight into the space of parameters -- excitatory to inhibitory ratio, sparseness of connections and synaptic weights. It may serve as a guideline to decide about the values of parameters in a simulation of spiking neural network.

Multiscale neural connectivity during human sensory processing in the brain

Science.gov (United States)

Maksimenko, Vladimir A.; Runnova, Anastasia E.; Frolov, Nikita S.; Makarov, Vladimir V.; Nedaivozov, Vladimir; Koronovskii, Alexey A.; Pisarchik, Alexander; Hramov, Alexander E.

2018-05-01

Stimulus-related brain activity is considered using wavelet-based analysis of neural interactions between occipital and parietal brain areas in alpha (8-12 Hz) and beta (15-30 Hz) frequency bands. We show that human sensory processing related to the visual stimuli perception induces brain response resulted in different ways of parieto-occipital interactions in these bands. In the alpha frequency band the parieto-occipital neuronal network is characterized by homogeneous increase of the interaction between all interconnected areas both within occipital and parietal lobes and between them. In the beta frequency band the occipital lobe starts to play a leading role in the dynamics of the occipital-parietal network: The perception of visual stimuli excites the visual center in the occipital area and then, due to the increase of parieto-occipital interactions, such excitation is transferred to the parietal area, where the attentional center takes place. In the case when stimuli are characterized by a high degree of ambiguity, we find greater increase of the interaction between interconnected areas in the parietal lobe due to the increase of human attention. Based on revealed mechanisms, we describe the complex response of the parieto-occipital brain neuronal network during the perception and primary processing of the visual stimuli. The results can serve as an essential complement to the existing theory of neural aspects of visual stimuli processing.

Knowledge Management for Shared Awareness

Science.gov (United States)

2013-05-01

knowledge derived from experiences that can be communicated through mechanisms such as storytelling , debriefing etc., or summarized in databases...patterned on the neural architecture of the brain . Neural nets often consist of a large number of nodes connected by links that transmit signals...that allow speech generation by a computer. Storytelling : The use of stories in organizations as a way of sharing knowledge and helping learning

The relationship between structural and functional connectivity: graph theoretical analysis of an EEG neural mass model

NARCIS (Netherlands)

Ponten, S.C.; Daffertshofer, A.; Hillebrand, A.; Stam, C.J.

2010-01-01

We investigated the relationship between structural network properties and both synchronization strength and functional characteristics in a combined neural mass and graph theoretical model of the electroencephalogram (EEG). Thirty-two neural mass models (NMMs), each representing the lump activity

Connecting to create: expertise in musical improvisation is associated with increased functional connectivity between premotor and prefrontal areas.

Science.gov (United States)

Pinho, Ana Luísa; de Manzano, Örjan; Fransson, Peter; Eriksson, Helene; Ullén, Fredrik

2014-04-30

Musicians have been used extensively to study neural correlates of long-term practice, but no studies have investigated the specific effects of training musical creativity. Here, we used human functional MRI to measure brain activity during improvisation in a sample of 39 professional pianists with varying backgrounds in classical and jazz piano playing. We found total hours of improvisation experience to be negatively associated with activity in frontoparietal executive cortical areas. In contrast, improvisation training was positively associated with functional connectivity of the bilateral dorsolateral prefrontal cortices, dorsal premotor cortices, and presupplementary areas. The effects were significant when controlling for hours of classical piano practice and age. These results indicate that even neural mechanisms involved in creative behaviors, which require a flexible online generation of novel and meaningful output, can be automated by training. Second, improvisational musical training can influence functional brain properties at a network level. We show that the greater functional connectivity seen in experienced improvisers may reflect a more efficient exchange of information within associative networks of importance for musical creativity.

Altered resting-state network connectivity in stroke patients with and without apraxia of speech.

Science.gov (United States)

New, Anneliese B; Robin, Donald A; Parkinson, Amy L; Duffy, Joseph R; McNeil, Malcom R; Piguet, Olivier; Hornberger, Michael; Price, Cathy J; Eickhoff, Simon B; Ballard, Kirrie J

2015-01-01

Motor speech disorders, including apraxia of speech (AOS), account for over 50% of the communication disorders following stroke. Given its prevalence and impact, and the need to understand its neural mechanisms, we used resting state functional MRI to examine functional connectivity within a network of regions previously hypothesized as being associated with AOS (bilateral anterior insula (aINS), inferior frontal gyrus (IFG), and ventral premotor cortex (PM)) in a group of 32 left hemisphere stroke patients and 18 healthy, age-matched controls. Two expert clinicians rated severity of AOS, dysarthria and nonverbal oral apraxia of the patients. Fifteen individuals were categorized as AOS and 17 were AOS-absent. Comparison of connectivity in patients with and without AOS demonstrated that AOS patients had reduced connectivity between bilateral PM, and this reduction correlated with the severity of AOS impairment. In addition, AOS patients had negative connectivity between the left PM and right aINS and this effect decreased with increasing severity of non-verbal oral apraxia. These results highlight left PM involvement in AOS, begin to differentiate its neural mechanisms from those of other motor impairments following stroke, and help inform us of the neural mechanisms driving differences in speech motor planning and programming impairment following stroke.

Altered resting-state network connectivity in stroke patients with and without apraxia of speech

Directory of Open Access Journals (Sweden)

Anneliese B. New

2015-01-01

Full Text Available Motor speech disorders, including apraxia of speech (AOS, account for over 50% of the communication disorders following stroke. Given its prevalence and impact, and the need to understand its neural mechanisms, we used resting state functional MRI to examine functional connectivity within a network of regions previously hypothesized as being associated with AOS (bilateral anterior insula (aINS, inferior frontal gyrus (IFG, and ventral premotor cortex (PM in a group of 32 left hemisphere stroke patients and 18 healthy, age-matched controls. Two expert clinicians rated severity of AOS, dysarthria and nonverbal oral apraxia of the patients. Fifteen individuals were categorized as AOS and 17 were AOS-absent. Comparison of connectivity in patients with and without AOS demonstrated that AOS patients had reduced connectivity between bilateral PM, and this reduction correlated with the severity of AOS impairment. In addition, AOS patients had negative connectivity between the left PM and right aINS and this effect decreased with increasing severity of non-verbal oral apraxia. These results highlight left PM involvement in AOS, begin to differentiate its neural mechanisms from those of other motor impairments following stroke, and help inform us of the neural mechanisms driving differences in speech motor planning and programming impairment following stroke.

Improving VANETs Connectivity with a Totally Ad Hoc Living Mobile Backbone

Directory of Open Access Journals (Sweden)

Joilson Alves Junior

2015-01-01

Full Text Available The vehicular ad hoc network (VANET for intelligent transportation systems is an emerging concept to improve transportation security, reliability, and management. The network behavior can be totally different in topological aspects because of the mobility of vehicular nodes. The topology can be fully connected when the flow of vehicles is high and may have low connectivity or be invalid when the flow of vehicles is low or unbalanced. In big cities, the metropolitan buses that travel on exclusive lanes may be used to set up a metropolitan vehicular data network (backbone, raising the connectivity among the vehicles. Therefore, this paper proposes the implementation of a living mobile backbone, totally ad hoc (MOB-NET, which will provide infrastructure and raise the network connectivity. In order to show the viability of MOB-NET, statistical analyses were made with real data of express buses that travel through exclusive lanes, besides evaluations through simulations and analytic models. The statistic, analytic, and simulation results prove that the buses that travel through exclusive lanes can be used to build a communication network totally ad hoc and provide connectivity in more than 99% of the time, besides raising the delivery rate up to 95%.

Figure-Ground Organization Emerges in a Deep Net with a Feedback Loop