WorldWideScience

Sample records for model-view-controller based multi-modal

  1. Feature-based Alignment of Volumetric Multi-modal Images

    Science.gov (United States)

    Toews, Matthew; Zöllei, Lilla; Wells, William M.

    2014-01-01

    This paper proposes a method for aligning image volumes acquired from different imaging modalities (e.g. MR, CT) based on 3D scale-invariant image features. A novel method for encoding invariant feature geometry and appearance is developed, based on the assumption of locally linear intensity relationships, providing a solution to poor repeatability of feature detection in different image modalities. The encoding method is incorporated into a probabilistic feature-based model for multi-modal image alignment. The model parameters are estimated via a group-wise alignment algorithm, that iteratively alternates between estimating a feature-based model from feature data, then realigning feature data to the model, converging to a stable alignment solution with few pre-processing or pre-alignment requirements. The resulting model can be used to align multi-modal image data with the benefits of invariant feature correspondence: globally optimal solutions, high efficiency and low memory usage. The method is tested on the difficult RIRE data set of CT, T1, T2, PD and MP-RAGE brain images of subjects exhibiting significant inter-subject variability due to pathology. PMID:24683955

  2. Bi-objective optimization for multi-modal transportation routing planning problem based on Pareto optimality

    Directory of Open Access Journals (Sweden)

    Yan Sun

    2015-09-01

    Full Text Available Purpose: The purpose of study is to solve the multi-modal transportation routing planning problem that aims to select an optimal route to move a consignment of goods from its origin to its destination through the multi-modal transportation network. And the optimization is from two viewpoints including cost and time. Design/methodology/approach: In this study, a bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. Minimizing the total transportation cost and the total transportation time are set as the optimization objectives of the model. In order to balance the benefit between the two objectives, Pareto optimality is utilized to solve the model by gaining its Pareto frontier. The Pareto frontier of the model can provide the multi-modal transportation operator (MTO and customers with better decision support and it is gained by the normalized normal constraint method. Then, an experimental case study is designed to verify the feasibility of the model and Pareto optimality by using the mathematical programming software Lingo. Finally, the sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case. Findings: The calculation results indicate that the proposed model and Pareto optimality have good performance in dealing with the bi-objective optimization. The sensitivity analysis also shows the influence of the variation of the demand and supply on the multi-modal transportation organization clearly. Therefore, this method can be further promoted to the practice. Originality/value: A bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. The Pareto frontier based sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case.

  3. Predicting the Attitude Flow in Dialogue Based on Multi-Modal Speech Cues

    DEFF Research Database (Denmark)

    Juel Henrichsen, Peter; Allwood, Jens

    2013-01-01

    We present our experiments on attitude detection based on annotated multi-modal dialogue data1. Our long-term goal is to establish a computational model able to predict the attitudinal patterns in humanhuman dialogue. We believe, such prediction algorithms are useful tools in the pursuit of reali......We present our experiments on attitude detection based on annotated multi-modal dialogue data1. Our long-term goal is to establish a computational model able to predict the attitudinal patterns in humanhuman dialogue. We believe, such prediction algorithms are useful tools in the pursuit...

  4. Manifold-based feature point matching for multi-modal image registration.

    Science.gov (United States)

    Hu, Liang; Wang, Manning; Song, Zhijian

    2013-03-01

    Images captured using different modalities usually have significant variations in their intensities, which makes it difficult to reveal their internal structural similarities and achieve accurate registration. Most conventional feature-based image registration techniques are fast and efficient, but they cannot be used directly for the registration of multi-modal images because of these intensity variations. This paper introduces the theory of manifold learning to transform the original images into mono-modal modalities, which is a feature-based method that is applicable to multi-modal image registration. Subsequently, scale-invariant feature transform is used to detect highly distinctive local descriptors and matches between corresponding images, and a point-based registration is executed. The algorithm was tested with T1- and T2-weighted magnetic resonance (MR) images obtained from BrainWeb. Both qualitative and quantitative evaluations of the method were performed and the results compared with those produced previously. The experiments showed that feature point matching after manifold learning achieved more accurate results than did the similarity measure for multi-modal image registration. This study provides a new manifold-based feature point matching method for multi-modal medical image registration, especially for MR images. The proposed method performs better than do conventional intensity-based techniques in terms of its registration accuracy and is suitable for clinical procedures. Copyright © 2012 John Wiley & Sons, Ltd.

  5. Multi-Modal Clique-Graph Matching for View-Based 3D Model Retrieval.

    Science.gov (United States)

    Liu, An-An; Nie, Wei-Zhi; Gao, Yue; Su, Yu-Ting

    2016-05-01

    Multi-view matching is an important but a challenging task in view-based 3D model retrieval. To address this challenge, we propose an original multi-modal clique graph (MCG) matching method in this paper. We systematically present a method for MCG generation that is composed of cliques, which consist of neighbor nodes in multi-modal feature space and hyper-edges that link pairwise cliques. Moreover, we propose an image set-based clique/edgewise similarity measure to address the issue of the set-to-set distance measure, which is the core problem in MCG matching. The proposed MCG provides the following benefits: 1) preserves the local and global attributes of a graph with the designed structure; 2) eliminates redundant and noisy information by strengthening inliers while suppressing outliers; and 3) avoids the difficulty of defining high-order attributes and solving hyper-graph matching. We validate the MCG-based 3D model retrieval using three popular single-modal data sets and one novel multi-modal data set. Extensive experiments show the superiority of the proposed method through comparisons. Moreover, we contribute a novel real-world 3D object data set, the multi-view RGB-D object data set. To the best of our knowledge, it is the largest real-world 3D object data set containing multi-modal and multi-view information.

  6. Outcome of transarterial chemoembolization-based multi-modal treatment in patients with unresectable hepatocellular carcinoma.

    Science.gov (United States)

    Song, Do Seon; Nam, Soon Woo; Bae, Si Hyun; Kim, Jin Dong; Jang, Jeong Won; Song, Myeong Jun; Lee, Sung Won; Kim, Hee Yeon; Lee, Young Joon; Chun, Ho Jong; You, Young Kyoung; Choi, Jong Young; Yoon, Seung Kew

    2015-02-28

    To investigate the efficacy and safety of transarterial chemoembolization (TACE)-based multimodal treatment in patients with large hepatocellular carcinoma (HCC). A total of 146 consecutive patients were included in the analysis, and their medical records and radiological data were reviewed retrospectively. In total, 119 patients received TACE-based multi-modal treatments, and the remaining 27 received conservative management. Overall survival (Pmulti-modal treatment group compared with the TACE-only group (P=0.002) but also in the surgical treatment group compared with the loco-regional treatment-only group (Pmulti-modal treatment (P=0.002) were identified as independent post-treatment prognostic factors. TACE-based multi-modal treatments were safe and more beneficial than conservative management. Salvage surgery after successful downstaging resulted in long-term survival in patients with large, unresectable HCC.

  7. Multi-modal image registration based on gradient orientations of minimal uncertainty.

    Science.gov (United States)

    De Nigris, Dante; Collins, D Louis; Arbel, Tal

    2012-12-01

    In this paper, we propose a new multi-scale technique for multi-modal image registration based on the alignment of selected gradient orientations of reduced uncertainty. We show how the registration robustness and accuracy can be improved by restricting the evaluation of gradient orientation alignment to locations where the uncertainty of fixed image gradient orientations is minimal, which we formally demonstrate correspond to locations of high gradient magnitude. We also embed a computationally efficient technique for estimating the gradient orientations of the transformed moving image (rather than resampling pixel intensities and recomputing image gradients). We have applied our method to different rigid multi-modal registration contexts. Our approach outperforms mutual information and other competing metrics in the context of rigid multi-modal brain registration, where we show sub-millimeter accuracy with cases obtained from the retrospective image registration evaluation project. Furthermore, our approach shows significant improvements over standard methods in the highly challenging clinical context of image guided neurosurgery, where we demonstrate misregistration of less than 2 mm with relation to expert selected landmarks for the registration of pre-operative brain magnetic resonance images to intra-operative ultrasound images.

  8. EVolution: an edge-based variational method for non-rigid multi-modal image registration.

    Science.gov (United States)

    Denis de Senneville, B; Zachiu, C; Ries, M; Moonen, C

    2016-10-21

    Image registration is part of a large variety of medical applications including diagnosis, monitoring disease progression and/or treatment effectiveness and, more recently, therapy guidance. Such applications usually involve several imaging modalities such as ultrasound, computed tomography, positron emission tomography, x-ray or magnetic resonance imaging, either separately or combined. In the current work, we propose a non-rigid multi-modal registration method (namely EVolution: an edge-based variational method for non-rigid multi-modal image registration) that aims at maximizing edge alignment between the images being registered. The proposed algorithm requires only contrasts between physiological tissues, preferably present in both image modalities, and assumes deformable/elastic tissues. Given both is shown to be well suitable for non-rigid co-registration across different image types/contrasts (T1/T2) as well as different modalities (CT/MRI). This is achieved using a variational scheme that provides a fast algorithm with a low number of control parameters. Results obtained on an annotated CT data set were comparable to the ones provided by state-of-the-art multi-modal image registration algorithms, for all tested experimental conditions (image pre-filtering, image intensity variation, noise perturbation). Moreover, we demonstrate that, compared to existing approaches, our method possesses increased robustness to transient structures (i.e. that are only present in some of the images).

  9. EVolution: an edge-based variational method for non-rigid multi-modal image registration

    Science.gov (United States)

    de Senneville, B. Denis; Zachiu, C.; Ries, M.; Moonen, C.

    2016-10-01

    Image registration is part of a large variety of medical applications including diagnosis, monitoring disease progression and/or treatment effectiveness and, more recently, therapy guidance. Such applications usually involve several imaging modalities such as ultrasound, computed tomography, positron emission tomography, x-ray or magnetic resonance imaging, either separately or combined. In the current work, we propose a non-rigid multi-modal registration method (namely EVolution: an edge-based variational method for non-rigid multi-modal image registration) that aims at maximizing edge alignment between the images being registered. The proposed algorithm requires only contrasts between physiological tissues, preferably present in both image modalities, and assumes deformable/elastic tissues. Given both is shown to be well suitable for non-rigid co-registration across different image types/contrasts (T1/T2) as well as different modalities (CT/MRI). This is achieved using a variational scheme that provides a fast algorithm with a low number of control parameters. Results obtained on an annotated CT data set were comparable to the ones provided by state-of-the-art multi-modal image registration algorithms, for all tested experimental conditions (image pre-filtering, image intensity variation, noise perturbation). Moreover, we demonstrate that, compared to existing approaches, our method possesses increased robustness to transient structures (i.e. that are only present in some of the images).

  10. A Multi-Modality CMOS Sensor Array for Cell-Based Assay and Drug Screening.

    Science.gov (United States)

    Chi, Taiyun; Park, Jong Seok; Butts, Jessica C; Hookway, Tracy A; Su, Amy; Zhu, Chengjie; Styczynski, Mark P; McDevitt, Todd C; Wang, Hua

    2015-12-01

    In this paper, we present a fully integrated multi-modality CMOS cellular sensor array with four sensing modalities to characterize different cell physiological responses, including extracellular voltage recording, cellular impedance mapping, optical detection with shadow imaging and bioluminescence sensing, and thermal monitoring. The sensor array consists of nine parallel pixel groups and nine corresponding signal conditioning blocks. Each pixel group comprises one temperature sensor and 16 tri-modality sensor pixels, while each tri-modality sensor pixel can be independently configured for extracellular voltage recording, cellular impedance measurement (voltage excitation/current sensing), and optical detection. This sensor array supports multi-modality cellular sensing at the pixel level, which enables holistic cell characterization and joint-modality physiological monitoring on the same cellular sample with a pixel resolution of 80 μm × 100 μm. Comprehensive biological experiments with different living cell samples demonstrate the functionality and benefit of the proposed multi-modality sensing in cell-based assay and drug screening.

  11. Multi-modal face parts fusion based on Gabor feature for face recognition

    Institute of Scientific and Technical Information of China (English)

    Xiang Yan; Su Guangda; Shang Yan; Li Congcong

    2009-01-01

    A novel face recognition method, which is a fusion of multi-modal face parts based on Gabor feature (MMP-GF), is proposed in this paper. Firstly, the bare face image detached from the normalized image was convolved with a family of Gabor kernels, and then according to the face structure and the key-points locations, the calculated Gabor images were divided into five parts: Gabor face, Gabor eyebrow, Gabor eye, Gabor nose and Gabor mouth. After that multi-modal Gabor features were spatially partitioned into non-overlapping regions and the averages of regions were concatenated to be a low dimension feature vector, whose dimension was further reduced by principal component analysis (PCA). In the decision level fusion, match results respectively calculated based on the five parts were combined according to linear discriminant analysis (LDA) and a normalized matching algorithm was used to improve the performance. Experiments on FERET database show that the proposed MMP-GF method achieves good robustness to the expression and age variations.

  12. Progressive Graph-Based Transductive Learning for Multi-modal Classification of Brain Disorder Disease.

    Science.gov (United States)

    Wang, Zhengxia; Zhu, Xiaofeng; Adeli, Ehsan; Zhu, Yingying; Zu, Chen; Nie, Feiping; Shen, Dinggang; Wu, Guorong

    2016-10-01

    Graph-based Transductive Learning (GTL) is a powerful tool in computer-assisted diagnosis, especially when the training data is not sufficient to build reliable classifiers. Conventional GTL approaches first construct a fixed subject-wise graph based on the similarities of observed features (i.e., extracted from imaging data) in the feature domain, and then follow the established graph to propagate the existing labels from training to testing data in the label domain. However, such a graph is exclusively learned in the feature domain and may not be necessarily optimal in the label domain. This may eventually undermine the classification accuracy. To address this issue, we propose a progressive GTL (pGTL) method to progressively find an intrinsic data representation. To achieve this, our pGTL method iteratively (1) refines the subject-wise relationships observed in the feature domain using the learned intrinsic data representation in the label domain, (2) updates the intrinsic data representation from the refined subject-wise relationships, and (3) verifies the intrinsic data representation on the training data, in order to guarantee an optimal classification on the new testing data. Furthermore, we extend our pGTL to incorporate multi-modal imaging data, to improve the classification accuracy and robustness as multi-modal imaging data can provide complementary information. Promising classification results in identifying Alzheimer's disease (AD), Mild Cognitive Impairment (MCI), and Normal Control (NC) subjects are achieved using MRI and PET data.

  13. SU-E-I-83: Error Analysis of Multi-Modality Image-Based Volumes of Rodent Solid Tumors Using a Preclinical Multi-Modality QA Phantom

    Energy Technology Data Exchange (ETDEWEB)

    Lee, Y [University of Kansas Hospital, Kansas City, KS (United States); Fullerton, G; Goins, B [University of Texas Health Science Center at San Antonio, San Antonio, TX (United States)

    2015-06-15

    Purpose: In our previous study a preclinical multi-modality quality assurance (QA) phantom that contains five tumor-simulating test objects with 2, 4, 7, 10 and 14 mm diameters was developed for accurate tumor size measurement by researchers during cancer drug development and testing. This study analyzed the errors during tumor volume measurement from preclinical magnetic resonance (MR), micro-computed tomography (micro- CT) and ultrasound (US) images acquired in a rodent tumor model using the preclinical multi-modality QA phantom. Methods: Using preclinical 7-Tesla MR, US and micro-CT scanners, images were acquired of subcutaneous SCC4 tumor xenografts in nude rats (3–4 rats per group; 5 groups) along with the QA phantom using the same imaging protocols. After tumors were excised, in-air micro-CT imaging was performed to determine reference tumor volume. Volumes measured for the rat tumors and phantom test objects were calculated using formula V = (π/6)*a*b*c where a, b and c are the maximum diameters in three perpendicular dimensions determined by the three imaging modalities. Then linear regression analysis was performed to compare image-based tumor volumes with the reference tumor volume and known test object volume for the rats and the phantom respectively. Results: The slopes of regression lines for in-vivo tumor volumes measured by three imaging modalities were 1.021, 1.101 and 0.862 for MRI, micro-CT and US respectively. For phantom, the slopes were 0.9485, 0.9971 and 0.9734 for MRI, micro-CT and US respectively. Conclusion: For both animal and phantom studies, random and systematic errors were observed. Random errors were observer-dependent and systematic errors were mainly due to selected imaging protocols and/or measurement method. In the animal study, there were additional systematic errors attributed to ellipsoidal assumption for tumor shape. The systematic errors measured using the QA phantom need to be taken into account to reduce measurement

  14. The evolution of gadolinium based contrast agents: from single-modality to multi-modality

    Science.gov (United States)

    Zhang, Li; Liu, Ruiqing; Peng, Hui; Li, Penghui; Xu, Zushun; Whittaker, Andrew K.

    2016-05-01

    Gadolinium-based contrast agents are extensively used as magnetic resonance imaging (MRI) contrast agents due to their outstanding signal enhancement and ease of chemical modification. However, it is increasingly recognized that information obtained from single modal molecular imaging cannot satisfy the higher requirements on the efficiency and accuracy for clinical diagnosis and medical research, due to its limitation and default rooted in single molecular imaging technique itself. To compensate for the deficiencies of single function magnetic resonance imaging contrast agents, the combination of multi-modality imaging has turned to be the research hotpot in recent years. This review presents an overview on the recent developments of the functionalization of gadolinium-based contrast agents, and their application in biomedicine applications.

  15. The evolution of gadolinium based contrast agents: from single-modality to multi-modality.

    Science.gov (United States)

    Zhang, Li; Liu, Ruiqing; Peng, Hui; Li, Penghui; Xu, Zushun; Whittaker, Andrew K

    2016-05-19

    Gadolinium-based contrast agents are extensively used as magnetic resonance imaging (MRI) contrast agents due to their outstanding signal enhancement and ease of chemical modification. However, it is increasingly recognized that information obtained from single modal molecular imaging cannot satisfy the higher requirements on the efficiency and accuracy for clinical diagnosis and medical research, due to its limitation and default rooted in single molecular imaging technique itself. To compensate for the deficiencies of single function magnetic resonance imaging contrast agents, the combination of multi-modality imaging has turned to be the research hotpot in recent years. This review presents an overview on the recent developments of the functionalization of gadolinium-based contrast agents, and their application in biomedicine applications.

  16. Multi-modal vibration energy harvesting approach based on nonlinear oscillator arrays under magnetic levitation

    Science.gov (United States)

    Abed, I.; Kacem, N.; Bouhaddi, N.; Bouazizi, M. L.

    2016-02-01

    We propose a multi-modal vibration energy harvesting approach based on arrays of coupled levitated magnets. The equations of motion which include the magnetic nonlinearity and the electromagnetic damping are solved using the harmonic balance method coupled with the asymptotic numerical method. A multi-objective optimization procedure is introduced and performed using a non-dominated sorting genetic algorithm for the cases of small magnet arrays in order to select the optimal solutions in term of performances by bringing the eigenmodes close to each other in terms of frequencies and amplitudes. Thanks to the nonlinear coupling and the modal interactions even for only three coupled magnets, the proposed method enable harvesting the vibration energy in the operating frequency range of 4.6-14.5 Hz, with a bandwidth of 190% and a normalized power of 20.2 {mW} {{cm}}-3 {{{g}}}-2.

  17. Real-time multi-modal rigid registration based on a novel symmetric-SIFT descriptor

    Institute of Scientific and Technical Information of China (English)

    Jian Chen; Jie Tian

    2009-01-01

    The purpose of image registration is to spatially align two or more single-modality images taken at different times,or several images acquired by multiple imaging modalities.Intensity-based registration usually requires optimization of the similarity metric between the images.However,global optimization techniques are too time-consuming,and local optimization techniques frequently fail to search the global transformation space because of the large initial misalignment of the two images.Moreover,for large non-overlapping area registration,the similarity metric cannot reach its optimum value when the two images are properly registered.In order to solve these problems,we propose a novel Symmetric Scale Invariant Feature Transform (symmetric-SIFT) descriptor and develop a fast multi-modal image registration technique.The proposed technique automatically generates a lot of highly distinctive symmetric-SIFT descriptors for two images,and the registration is performed by matching the corresponding descriptors over two images.These descriptors are invariant to image scale and rotation,and are partially invariant to affine transformation.Moreover,these descriptors are symmetric to contrast,which makes it suitable for multi-modal image registration.The proposed technique abandons the optimization and similarity metric strategy.It works with near real-time performance,and can deal with the large non-overlapping and large initial misalignment situations.Test cases involving scale change,large non-overlapping,and large initial misalignment on computed tomography (CT) and magnetic resonance (MR) datasets show that it needs much less runtime and achieves better accuracy when compared to other algorithms.(C) 2009 National Natural Science Foundation of China and Chinese Academy of Sciences.Published by Elsevier Limited and Science in China Press.All rights reserved.

  18. Multi-modal sensor based weight drop spinal cord impact system for large animals.

    Science.gov (United States)

    Kim, Hyeongbeom; Kim, Jong-Wan; Hyun, Jung-Keun; Park, Ilyong

    2017-08-23

    A conventional weight drop spinal cord (SC) impact system for large animals is composed of a high-speed video camera, a vision system, and other things. However, a camera with high speed at over 5,000 frames per second (FPS) is very expensive. In addition, the utilization of the vision system involves complex pattern recognition algorithms and accurate arrangement of the camera and the target. The purpose of this study was to develop a large animal spinal cord injury modeling system using a multi-modal sensor instead of a high-speed video camera and vision system. Another objective of this study was to demonstrate the possibility of the developed system to measure the impact parameters in the experiments using different stiffness materials and an in-vivo porcine SC. A multi-modal sensor based spinal cord injury impact system was developed for large animals. The experiments to measure SC impact parameters were then performed using three different stiffness materials and a Yucatan miniature pig to verify the performance of system developed. A comparative experiment was performed using three different stiffness materials such as high density (HD) sponge, rubber, and clay to demonstrate the system and perform measurement for impact parameters such as impact velocity, impulsive force, and maximally compressed displacement reflecting physical properties of materials. In the animal experiment, a female Yucatan miniature pig of 60 kg weight was used. Impact conditions for all experiments were fixed at freefalling object mass of 50 g and height of 20 cm. In the impact test, measured impact velocities were almost the same for the three different stiffness materials at 1.84 ± 0.0153 m/s. Impulsive forces for the three materials of rubber, HD sponge, and clay were 50.88 N, 32.35 N, and 6.68 N, respectively. Maximally compressed displacements for rubber, HD sponge, and clay were 1.93 mm, 3.35 mm, and 15.01 mm, respectively. In the pig experiment, impact velocity, impulsive

  19. Seizure Onset Detection based on a Uni- or Multi-modal Intelligent Seizure Acquisition (UISA/MISA) System

    DEFF Research Database (Denmark)

    Conradsen, Isa; Beniczky, Sándor; Wolf, Peter

    2010-01-01

    An automatic Uni- or Multi-modal Inteligent Seizure Acquisition (UISA/MISA) system is highly applicable for onset detection of epileptic seizures based on motion data. The modalities used are surface electromyography (sEMG), acceleration (ACC) and angular velocity (ANG). The new proposed automatic...... algorithm on motion data is extracting features as “log-sum” measures of discrete wavelet components. Classification into the two groups “seizure” versus “nonseizure” is made based on the support vector machine (SVM) algorithm. The algorithm performs with a sensitivity of 91-100%, a median latency of 1...... second and a specificity of 100% on multi-modal data from five healthy subjects simulating seizures. The uni-modal algorithm based on sEMG data from the subjects and patients performs satisfactorily in some cases. As expected, our results clearly show superiority of the multimodal approach, as compared...

  20. Multi-modal classification of neurodegenerative disease by progressive graph-based transductive learning.

    Science.gov (United States)

    Wang, Zhengxia; Zhu, Xiaofeng; Adeli, Ehsan; Zhu, Yingying; Nie, Feiping; Munsell, Brent; Wu, Guorong

    2017-07-01

    Graph-based transductive learning (GTL) is a powerful machine learning technique that is used when sufficient training data is not available. In particular, conventional GTL approaches first construct a fixed inter-subject relation graph that is based on similarities in voxel intensity values in the feature domain, which can then be used to propagate the known phenotype data (i.e., clinical scores and labels) from the training data to the testing data in the label domain. However, this type of graph is exclusively learned in the feature domain, and primarily due to outliers in the observed features, may not be optimal for label propagation in the label domain. To address this limitation, a progressive GTL (pGTL) method is proposed that gradually finds an intrinsic data representation that more accurately aligns imaging features with the phenotype data. In general, optimal feature-to-phenotype alignment is achieved using an iterative approach that: (1) refines inter-subject relationships observed in the feature domain by using the learned intrinsic data representation in the label domain, (2) updates the intrinsic data representation from the refined inter-subject relationships, and (3) verifies the intrinsic data representation on the training data to guarantee an optimal classification when applied to testing data. Additionally, the iterative approach is extended to multi-modal imaging data to further improve pGTL classification accuracy. Using Alzheimer's disease and Parkinson's disease study data, the classification accuracy of the proposed pGTL method is compared to several state-of-the-art classification methods, and the results show pGTL can more accurately identify subjects, even at different progression stages, in these two study data sets. Copyright © 2017 Elsevier B.V. All rights reserved.

  1. Imaging Neurodegeneration: Steps Toward Brain Network-Based Pathophysiology and Its Potential for Multi-modal Imaging Diagnostics.

    Science.gov (United States)

    Sorg, C; Göttler, J; Zimmer, C

    2015-10-01

    Multi-modal brain imaging provides different in vivo windows into the human brain and thereby different ways to characterize brain disorders. Particularly, resting-state functional magnetic resonance imaging facilitates the study of macroscopic intrinsic brain networks, which are critical for development and spread of neurodegenerative processes in different neurodegenerative diseases. The aim of the current study is to present and highlight some paradigmatic findings in intrinsic network-based pathophysiology of neurodegenerative diseases and its potential for new network-based multimodal tools in imaging diagnostics. Qualitative review of selected multi-modal imaging studies in neurodegenerative diseases particularly in Alzheimer's disease (AD). Functional connectivity of intrinsic brain networks is selectively and progressively impaired in AD, with changes likely starting before the onset of symptoms in fronto-parietal key networks such as default mode or attention networks. Patterns of distribution and development of both amyloid-β plaques and atrophy are linked with network connectivity changes, suggesting that start and spread of pathology interacts with network connectivity. Qualitatively similar findings have been observed in other neurodegenerative disorders, suggesting shared mechanisms of network-based pathophysiology across diseases. Spread of neurodegeneration is intimately linked with the functional connectivity of intrinsic brain networks. These pathophysiological insights pave the way for new multi-modal network-based tools to detect and characterize neurodegeneration in individual patients.

  2. Medical case-based retrieval: integrating query MeSH terms for query-adaptive multi-modal fusion

    Science.gov (United States)

    Seco de Herrera, Alba G.; Foncubierta-Rodríguez, Antonio; Müller, Henning

    2015-03-01

    Advances in medical knowledge give clinicians more objective information for a diagnosis. Therefore, there is an increasing need for bibliographic search engines that can provide services helping to facilitate faster information search. The ImageCLEFmed benchmark proposes a medical case-based retrieval task. This task aims at retrieving articles from the biomedical literature that are relevant for differential diagnosis of query cases including a textual description and several images. In the context of this campaign many approaches have been investigated showing that the fusion of visual and text information can improve the precision of the retrieval. However, fusion does not always lead to better results. In this paper, a new query-adaptive fusion criterion to decide when to use multi-modal (text and visual) or only text approaches is presented. The proposed method integrates text information contained in MeSH (Medical Subject Headings) terms extracted and visual features of the images to find synonym relations between them. Given a text query, the query-adaptive fusion criterion decides when it is suitable to also use visual information for the retrieval. Results show that this approach can decide if a text or multi{modal approach should be used with 77.15% of accuracy.

  3. Analysis of Predictive Values Based on Individual Risk Factors in Multi-Modality Trials

    Directory of Open Access Journals (Sweden)

    Katharina Lange

    2013-03-01

    Full Text Available The accuracy of diagnostic tests with binary end-points is most frequently measured by sensitivity and specificity. However, from the clinical perspective, the main purpose of a diagnostic agent is to assess the probability of a patient actually being diseased and hence predictive values are more suitable here. As predictive values depend on the pre-test probability of disease, we provide a method to take risk factors influencing the patient’s prior probability of disease into account, when calculating predictive values. Furthermore, approaches to assess confidence intervals and a methodology to compare predictive values by statistical tests are presented. Hereby the methods can be used to analyze predictive values of factorial diagnostic trials, such as multi-modality, multi-reader-trials. We further performed a simulation study assessing length and coverage probability for different types of confidence intervals, and we present the R-Package facROC that can be used to analyze predictive values in factorial diagnostic trials in particular. The methods are applied to a study evaluating CT-angiography as a noninvasive alternative to coronary angiography for diagnosing coronary artery disease. Hereby the patients’ symptoms are considered as risk factors influencing the respective predictive values.

  4. Analysis of Predictive Values Based on Individual Risk Factors in Multi-Modality Trials.

    Science.gov (United States)

    Lange, Katharina; Brunner, Edgar

    2013-03-15

    The accuracy of diagnostic tests with binary end-points is most frequently measured by sensitivity and specificity. However, from the clinical perspective, the main purpose of a diagnostic agent is to assess the probability of a patient actually being diseased and hence predictive values are more suitable here. As predictive values depend on the pre-test probability of disease, we provide a method to take risk factors influencing the patient's prior probability of disease into account, when calculating predictive values. Furthermore, approaches to assess confidence intervals and a methodology to compare predictive values by statistical tests are presented. Hereby the methods can be used to analyze predictive values of factorial diagnostic trials, such as multi-modality, multi-reader-trials. We further performed a simulation study assessing length and coverage probability for different types of confidence intervals, and we present the R-Package facROC that can be used to analyze predictive values in factorial diagnostic trials in particular. The methods are applied to a study evaluating CT-angiography as a noninvasive alternative to coronary angiography for diagnosing coronary artery disease. Hereby the patients' symptoms are considered as risk factors influencing the respective predictive values.

  5. Advances in longitudinal studies of amnestic mild cognitive impairment and Alzheimer's disease based on multi-modal MRI techniques.

    Science.gov (United States)

    Hu, Zhongjie; Wu, Liyong; Jia, Jianping; Han, Ying

    2014-04-01

    Amnestic mild cognitive impairment (aMCI) is a prodromal stage of Alzheimer's disease (AD), and 75%-80% of aMCI patients finally develop AD. So, early identification of patients with aMCI or AD is of great significance for prevention and intervention. According to cross-sectional studies, it is known that the hippocampus, posterior cingulate cortex, and corpus callosum are key areas in studies based on structural MRI (sMRI), functional MRI (fMRI), and diffusion tensor imaging (DTI) respectively. Recently, longitudinal studies using each MRI modality have demonstrated that the neuroimaging abnormalities generally involve the posterior brain regions at the very beginning and then gradually affect the anterior areas during the progression of aMCI to AD. However, it is not known whether follow-up studies based on multi-modal neuroimaging techniques (e.g., sMRI, fMRI, and DTI) can help build effective MRI models that can be directly applied to the screening and diagnosis of aMCI and AD. Thus, in the future, large-scale multi-center follow-up studies are urgently needed, not only to build an MRI diagnostic model that can be used on a single person, but also to evaluate the variability and stability of the model in the general population. In this review, we present longitudinal studies using each MRI modality separately, and then discuss the future directions in this field.

  6. An efficient nano-based theranostic system for multi-modal imaging-guided photothermal sterilization in gastrointestinal tract.

    Science.gov (United States)

    Liu, Zhen; Liu, Jianhua; Wang, Rui; Du, Yingda; Ren, Jinsong; Qu, Xiaogang

    2015-07-01

    Since understanding the healthy status of gastrointestinal tract (GI tract) is of vital importance, clinical implementation for GI tract-related disease have attracted much more attention along with the rapid development of modern medicine. Here, a multifunctional theranostic system combining X-rays/CT/photothermal/photoacoustic mapping of GI tract and imaging-guided photothermal anti-bacterial treatment is designed and constructed. PEGylated W18O49 nanosheets (PEG-W18O49) are created via a facile solvothermal method and an in situ probe-sonication approach. In terms of excellent colloidal stability, low cytotoxicity, and neglectable hemolysis of PEG-W18O49, we demonstrate the first example of high-performance four-modal imaging of GI tract by using these nanosheets as contrast agents. More importantly, due to their intrinsic absorption of NIR light, glutaraldehyde-modified PEG-W18O49 are successfully applied as fault-free targeted photothermal agents for imaging-guided killing of bacteria on a mouse infection model. Critical to pre-clinical and clinical prospects, long-term toxicity is further investigated after oral administration of these theranostic agents. These kinds of tungsten-based nanomaterials exhibit great potential as multi-modal contrast agents for directed visualization of GI tract and anti-bacterial agents for phothothermal sterilization.

  7. A Multi-Modal Digital Game-Based Learning Environment for Hospitalized Children with Chronic Illnesses.

    Science.gov (United States)

    Chin, Jui-Chih; Tsuei, Mengping

    2014-01-01

    The aim of this study was to explore the digital game-based learning for children with chronic illnesses in the hospital settings. The design-based research and qualitative methods were applied. Three eight-year-old children with leukemia participated in this study. In the first phase, the multi-user game-based learning system was developed and…

  8. A Multi-Modal Digital Game-Based Learning Environment for Hospitalized Children with Chronic Illnesses.

    Science.gov (United States)

    Chin, Jui-Chih; Tsuei, Mengping

    2014-01-01

    The aim of this study was to explore the digital game-based learning for children with chronic illnesses in the hospital settings. The design-based research and qualitative methods were applied. Three eight-year-old children with leukemia participated in this study. In the first phase, the multi-user game-based learning system was developed and…

  9. WE-D-9A-04: Improving Multi-Modality Image Registration Using Edge-Based Transformations

    Energy Technology Data Exchange (ETDEWEB)

    Wang, Y; Tyagi, N; Veeraraghavan, H; Deasy, J [Medical Physics Department, Memorial Sloan-Kettering Cancer Center, New York, NY (United States)

    2014-06-15

    Purpose: Multi-modality deformable image registration (DIR) for head and neck (HN) radiotherapy is difficult, particularly when matching computed tomography (CT) scans with magnetic resonance imaging (MRI) scans. We hypothesized that the ‘shared information’ between images of different modalities was to be found in some form of edge-based transformation, and that novel edge-based DIR methods might outperform standard DIR methods. Methods: We propose a novel method that combines gray-scale edge-based morphology and mutual information (MI) in two stages. In the first step, we applied a modification of a previously published mathematical morphology method as an efficient gray scale edge estimator, with denoising function. The results were fed into a MI-based solver (plastimatch). The method was tested on 5 HN patients with pretreatment CT and MR datasets and associated follow-up weekly MR scans. The followup MRs showed significant regression in tumor and normal structure volumes as compared to the pretreatment MRs. The MR images used in this study were obtained using fast spin echo based T2w images with a 1 mm isotropic resolution and FOV matching the CT scan. Results: In all cases, the novel edge-based registration method provided better registration quality than MI-based DIR using the original CT and MRI images. For example, the mismatch in carotid arteries was reduced from 3–5 mm to within 2 mm. The novel edge-based method with different registration regulation parameters did not show any distorted deformations as compared to the non-realistic deformations resulting from MI on the original images. Processing time was 1.3 to 2 times shorter (edge vs. non-edge). In general, we observed quality improvement and significant calculation time reduction with the new method. Conclusion: Transforming images to an ‘edge-space,’ if designed appropriately, greatly increases the speed and accuracy of DIR.

  10. A Multi-modal Digital Game-based Learning Environment for Hospitalized Children with Chronic Illnesses

    National Research Council Canada - National Science Library

    Jui-Chih Chin; Mengping Tsuei

    2014-01-01

    .... Children showed highly motivation to engage in learning activities. A list of key design features related to the digital game-based learning for children with chronic illnesses emerged from the data...

  11. Observing Coaching and Reflecting: A Multi-modal Natural Language-based Dialogue System in a Learning Context

    NARCIS (Netherlands)

    Van Helvert, Joy; Van Rosmalen, Peter; Börner, Dirk; Petukhova, Volha; Alexandersson, Jan

    2016-01-01

    The Metalogue project aims to develop a multi-modal, multi-party dialogue system with metacognitive abilities that will advance our understanding of natural conversational human-machine interaction and dialogue interfaces. This paper introduces the vision for the system and discusses its application

  12. Hopc: a Novel Similarity Metric Based on Geometric Structural Properties for Multi-Modal Remote Sensing Image Matching

    Science.gov (United States)

    Ye, Yuanxin; Shen, Li

    2016-06-01

    Automatic matching of multi-modal remote sensing images (e.g., optical, LiDAR, SAR and maps) remains a challenging task in remote sensing image analysis due to significant non-linear radiometric differences between these images. This paper addresses this problem and proposes a novel similarity metric for multi-modal matching using geometric structural properties of images. We first extend the phase congruency model with illumination and contrast invariance, and then use the extended model to build a dense descriptor called the Histogram of Orientated Phase Congruency (HOPC) that captures geometric structure or shape features of images. Finally, HOPC is integrated as the similarity metric to detect tie-points between images by designing a fast template matching scheme. This novel metric aims to represent geometric structural similarities between multi-modal remote sensing datasets and is robust against significant non-linear radiometric changes. HOPC has been evaluated with a variety of multi-modal images including optical, LiDAR, SAR and map data. Experimental results show its superiority to the recent state-of-the-art similarity metrics (e.g., NCC, MI, etc.), and demonstrate its improved matching performance.

  13. Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

    Directory of Open Access Journals (Sweden)

    Jing-Yu Yang

    2012-04-01

    Full Text Available When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person’s overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA. Specifically, one person’s different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

  14. Nonparametric Feature Matching Based Conditional Random Fields for Gesture Recognition from Multi-Modal Video.

    Science.gov (United States)

    Chang, Ju Yong

    2016-08-01

    We present a new gesture recognition method that is based on the conditional random field (CRF) model using multiple feature matching. Our approach solves the labeling problem, determining gesture categories and their temporal ranges at the same time. A generative probabilistic model is formalized and probability densities are nonparametrically estimated by matching input features with a training dataset. In addition to the conventional skeletal joint-based features, the appearance information near the active hand in an RGB image is exploited to capture the detailed motion of fingers. The estimated likelihood function is then used as the unary term for our CRF model. The smoothness term is also incorporated to enforce the temporal coherence of our solution. Frame-wise recognition results can then be obtained by applying an efficient dynamic programming technique. To estimate the parameters of the proposed CRF model, we incorporate the structured support vector machine (SSVM) framework that can perform efficient structured learning by using large-scale datasets. Experimental results demonstrate that our method provides effective gesture recognition results for challenging real gesture datasets. By scoring 0.8563 in the mean Jaccard index, our method has obtained the state-of-the-art results for the gesture recognition track of the 2014 ChaLearn Looking at People (LAP) Challenge.

  15. Novel Methods for Surface EMG Analysis and Exploration Based on Multi-Modal Gaussian Mixture Models.

    Directory of Open Access Journals (Sweden)

    Anna Magdalena Vögele

    Full Text Available This paper introduces a new method for data analysis of animal muscle activation during locomotion. It is based on fitting Gaussian mixture models (GMMs to surface EMG data (sEMG. This approach enables researchers/users to isolate parts of the overall muscle activation within locomotion EMG data. Furthermore, it provides new opportunities for analysis and exploration of sEMG data by using the resulting Gaussian modes as atomic building blocks for a hierarchical clustering. In our experiments, composite peak models representing the general activation pattern per sensor location (one sensor on the long back muscle, three sensors on the gluteus muscle on each body side were identified per individual for all 14 horses during walk and trot in the present study. Hereby we show the applicability of the method to identify composite peak models, which describe activation of different muscles throughout cycles of locomotion.

  16. Multi-modal image fusion based on ROI and Laplacian Pyramid

    Science.gov (United States)

    Gao, Xiong; Zhang, Hong; Chen, Hao; Li, Jiafeng

    2015-03-01

    In this paper, we propose a region of interest-based (ROI-adaptive) fusion algorithm of infrared and visible images by using the Laplacian Pyramid method. Firstly, we estimate the saliency map of infrared images, and then divide the infrared image into two parts: the regions of interest (RoI) and the regions of non-interest (nRoI), by normalizing the saliency map. Visible images are also segmented into two parts by using the Gauss High-pass filter: the regions of high frequency (RoH) and the regions of low frequency (RoL). Secondly, we down-sampled both the nRoI of infrared image and the RoL of visible image as the input of next level processing. Finally, we use normalized saliency map of infrared images as the weighted coefficient to get the basic image on the top level and choose max gray value of the RoI of infrared image and the RoH of visible image to get the detail image. In this way, our method can keep target feature of infrared image and texture detail information of visual image at the same time. Experiment results show that such fusion scheme performs better than the other fusion algorithms both on human visual system and quantitative metrics.

  17. Multi-modal data fusion using source separation: Two effective models based on ICA and IVA and their properties

    Science.gov (United States)

    Adali, Tülay; Levin-Schwartz, Yuri; Calhoun, Vince D.

    2015-01-01

    Fusion of information from multiple sets of data in order to extract a set of features that are most useful and relevant for the given task is inherent to many problems we deal with today. Since, usually, very little is known about the actual interaction among the datasets, it is highly desirable to minimize the underlying assumptions. This has been the main reason for the growing importance of data-driven methods, and in particular of independent component analysis (ICA) as it provides useful decompositions with a simple generative model and using only the assumption of statistical independence. A recent extension of ICA, independent vector analysis (IVA) generalizes ICA to multiple datasets by exploiting the statistical dependence across the datasets, and hence, as we discuss in this paper, provides an attractive solution to fusion of data from multiple datasets along with ICA. In this paper, we focus on two multivariate solutions for multi-modal data fusion that let multiple modalities fully interact for the estimation of underlying features that jointly report on all modalities. One solution is the Joint ICA model that has found wide application in medical imaging, and the second one is the the Transposed IVA model introduced here as a generalization of an approach based on multi-set canonical correlation analysis. In the discussion, we emphasize the role of diversity in the decompositions achieved by these two models, present their properties and implementation details to enable the user make informed decisions on the selection of a model along with its associated parameters. Discussions are supported by simulation results to help highlight the main issues in the implementation of these methods. PMID:26525830

  18. 基于Model/View/Controller的电子商务研究%The Research of E-commerce Based on Model/View/Controller

    Institute of Scientific and Technical Information of China (English)

    许文韬; 顾君忠

    2002-01-01

    分析了传统电子商务系统的缺陷,电子商务发展趋势,分析了M/V/C(Model/View/Controller)技术,提出了基于M/V/C电子商务并且分析了其体系结构及框架结构,以及在此框架之上构建电子商务的方法.

  19. A connectivity-based test-retest dataset of multi-modal magnetic resonance imaging in young healthy adults.

    Science.gov (United States)

    Lin, Qixiang; Dai, Zhengjia; Xia, Mingrui; Han, Zaizhu; Huang, Ruiwang; Gong, Gaolang; Liu, Chao; Bi, Yanchao; He, Yong

    2015-01-01

    Recently, magnetic resonance imaging (MRI) has been widely used to investigate the structures and functions of the human brain in health and disease in vivo. However, there are growing concerns about the test-retest reliability of structural and functional measurements derived from MRI data. Here, we present a test-retest dataset of multi-modal MRI including structural MRI (S-MRI), diffusion MRI (D-MRI) and resting-state functional MRI (R-fMRI). Fifty-seven healthy young adults (age range: 19-30 years) were recruited and completed two multi-modal MRI scan sessions at an interval of approximately 6 weeks. Each scan session included R-fMRI, S-MRI and D-MRI data. Additionally, there were two separated R-fMRI scans at the beginning and at the end of the first session (approximately 20 min apart). This multi-modal MRI dataset not only provides excellent opportunities to investigate the short- and long-term test-retest reliability of the brain's structural and functional measurements at the regional, connectional and network levels, but also allows probing the test-retest reliability of structural-functional couplings in the human brain.

  20. On the Struts Frame Based on Model View Controller%基于MVC设计模式的Struts框架的研究

    Institute of Scientific and Technical Information of China (English)

    石磊; 陈朔鹰

    2005-01-01

    Struts开始于2000年3月,目前已发展到2003年6月发布的1.1版本.采用Struts能开发出基于MVC(Model-View -Controller)设计模式的应用构架.本文就将对MVC设计模式以及在此基础之上的struts框架进行研究,并对struts的配置文件、表单验证、自建标签和国际化等特性进行了详细的描述.

  1. Two Phase Non-Rigid Multi-Modal Image Registration Using Weber Local Descriptor-Based Similarity Metrics and Normalized Mutual Information

    Science.gov (United States)

    Yang, Feng; Ding, Mingyue; Zhang, Xuming; Wu, Yi; Hu, Jiani

    2013-01-01

    Non-rigid multi-modal image registration plays an important role in medical image processing and analysis. Existing image registration methods based on similarity metrics such as mutual information (MI) and sum of squared differences (SSD) cannot achieve either high registration accuracy or high registration efficiency. To address this problem, we propose a novel two phase non-rigid multi-modal image registration method by combining Weber local descriptor (WLD) based similarity metrics with the normalized mutual information (NMI) using the diffeomorphic free-form deformation (FFD) model. The first phase aims at recovering the large deformation component using the WLD based non-local SSD (wldNSSD) or weighted structural similarity (wldWSSIM). Based on the output of the former phase, the second phase is focused on getting accurate transformation parameters related to the small deformation using the NMI. Extensive experiments on T1, T2 and PD weighted MR images demonstrate that the proposed wldNSSD-NMI or wldWSSIM-NMI method outperforms the registration methods based on the NMI, the conditional mutual information (CMI), the SSD on entropy images (ESSD) and the ESSD-NMI in terms of registration accuracy and computation efficiency. PMID:23765270

  2. Multi-Modality Phantom Development

    Energy Technology Data Exchange (ETDEWEB)

    Huber, Jennifer S.; Peng, Qiyu; Moses, William W.

    2009-03-20

    Multi-modality imaging has an increasing role in the diagnosis and treatment of a large number of diseases, particularly if both functional and anatomical information are acquired and accurately co-registered. Hence, there is a resulting need for multi modality phantoms in order to validate image co-registration and calibrate the imaging systems. We present our PET-ultrasound phantom development, including PET and ultrasound images of a simple prostate phantom. We use agar and gelatin mixed with a radioactive solution. We also present our development of custom multi-modality phantoms that are compatible with PET, transrectal ultrasound (TRUS), MRI and CT imaging. We describe both our selection of tissue mimicking materials and phantom construction procedures. These custom PET-TRUS-CT-MRI prostate phantoms use agargelatin radioactive mixtures with additional contrast agents and preservatives. We show multi-modality images of these custom prostate phantoms, as well as discuss phantom construction alternatives. Although we are currently focused on prostate imaging, this phantom development is applicable to many multi-modality imaging applications.

  3. An Empiric Evaluation of a Real-Time Robot Dancing Framework based on Multi-Modal Events

    Directory of Open Access Journals (Sweden)

    Luis Paulo Reis

    2012-12-01

    Full Text Available Musical robots have already inspired the creation of worldwide robotic dancing contests, as RoboCup-Junior's Dance, where school teams, formed by children aged eight to eighteen, put their robots in action, performing dance to music in a display that emphasizes creativity of costumes and movement. This paper describes and assesses a framework for robot dancing edutainment applications. The proposed architecture enables the definition of choreographic compositions, which result on a conjunction of reactive dancing motions in real-time response to multi-modal inputs. These inputs are shaped by three rhythmic events (representing soft, medium, and strong musical note-onsets, different dance floor colors, and the awareness of the surrounding obstacles. This layout was applied to a Lego-NXT humanoid robot, built with two Lego-NXT kits, and running on a hand-made dance stage. We report on an empirical evaluation over the overall robot dancing performance made to a group of students after a set of live demonstrations. This evaluation validated the framework's potential application in edutainment and its ability to sustain the interest of the general audience by offering a reasonable compromise between musical-synchrony, animacy and dance performance’s variability.

  4. Elitism-based immune genetic algorithm and its application to optimization of complex multi-modal functions

    Institute of Scientific and Technical Information of China (English)

    2008-01-01

    A novel immune genetic algorithm with the elitist selection and elitist crossover was proposed,which is called the immune genetic algorithm with the elitism (IGAE).In IGAE,the new methods for computing antibody similarity,expected reproduction probability,and clonal selection probability were given.IGAE has three features.The first is that the similarities of two antibodies in structure and quality are all defined in the form of percentage,which helps to describe the similarity of two antibodies more accurately and to reduce the computational burden effectively.The second is that with the elitist selection and elitist crossover strategy IGAE is able to find the globally optimal solution of a given problem.The third is that the formula of expected reproduction probability of antibody can be adjusted through a parameter β,which helps to balance the population diversity and the convergence speed of IGAE so that IGAE can find the globally optimal solution of a given problem more rapidly.Two different complex multi-modal functions were selected to test the validity of IGAE.The experimental results show that IGAE can find the globally maximum/minimum values of the two functions rapidly.The experimental results also confirm that IGAE is of better performance in convergence speed,solution variation behavior,and computational efficiency compared with the canonical genetic algorithm with the elitism and the immune genetic algorithm with the information entropy and elitism.

  5. 基于移动平台的多重生物识别系统%MULTI-MODAL BIOMETRIC AUTHENTICATION SYSTEM BASED ON MOBILE PLATFORM

    Institute of Scientific and Technical Information of China (English)

    黄轩; 范京晔

    2015-01-01

    随着智能手机在人们日常生活中的广泛使用,移动端的信息安全问题已经不容忽视. 提出一套基于移动端的多重生物特征识别系统,定义多重安全等级,并使用输入习惯识别、脸部识别、说话人身份识别三种生物识别技术取代传统的密码技术来识别手机用户的身份. 实验表明该系统在面对低安全需求时可以提供方便快捷的识别服务;而在高安全等级时,可以实现良好的安全性(最高安全等级错误接受率为0.014%). 相比传统的移动识别模式,该系统不仅更加智能,而且提高了移动身份识别的安全性和实用性.%With the extensive use of smartphones in people's daily life, the information security problem in mobile terminals should no lon-ger be overlooked.This paper presents a mobile terminals-based multi-modal biometric authentication system, it defines multi-level security grade and uses three kinds of biometric recognition technologies, the typing behaviour recognition, the face recognition and the speaker identity recognition, to replace traditional cryptography to authenticate the identity of mobile phone users.Experiments show that the multi-modal authentication system is able to provide convenient and rapid authentication services at low security level.While the security level is high, the system can realise good security performance (with highest security grade of false acceptance rate 0.014%).Compared with tradi-tional mobile authentication model, the proposed multi-modal system is more intelligent, and raises the security and practicability of mobile identity authentication.

  6. Evidence-based development and first usability testing of a social serious game based multi-modal system for early screening for atypical socio-cognitive development.

    Science.gov (United States)

    Gyori, Miklos; Borsos, Zsófia; Stefanik, Krisztina

    2015-01-01

    At current, screening for, and diagnosis of, autism spectrum disorders (ASD) are based on purely behavioral data; established screening tools rely on human observation and ratings of relevant behaviors. The research and development project in the focus of this paper is aimed at designing, creating and evaluating a social serious game based multi-modal, interactive software system for screening for high functioning cases of ASD at kindergarten age. The aims of this paper are (1) to summarize the evidence-based design process and (2) to present results from the first usability test of the system. Game topic, candidate responses, and candidate game contents were identified via an iterative literature review. On this basis, the 1st partial prototype of the fully playable game has been created, with complete data recording functionality but without the decision making component. A first usability test was carried out on this prototype (n=13). Overall results were unambiguously promising. Although sporadic difficulties in, and slightly negative attitudes towards, using the game occasionally arose, these were confined to non-target-group children only. The next steps of development include (1) completing the game design; (2) carrying out first large-n field test; (3) creating the first prototype of the decision making component.

  7. Single-subject independent component analysis-based intensity normalization in non-quantitative multi-modal structural MRI.

    Science.gov (United States)

    Papazoglou, Sebastian; Würfel, Jens; Paul, Friedemann; Brandt, Alexander U; Scheel, Michael

    2017-04-22

    Non-quantitative MRI is prone to intersubject intensity variation rendering signal intensity level based analyses limited. Here, we propose a method that fuses non-quantitative routine T1-weighted (T1w), T2w, and T2w fluid-saturated inversion recovery sequences using independent component analysis and validate it on age and sex matched healthy controls. The proposed method leads to consistent and independent components with a significantly reduced coefficient-of-variation across subjects, suggesting potential to serve as automatic intensity normalization and thus to enhance the power of intensity based statistical analyses. To exemplify this, we show that voxelwise statistical testing on single-subject independent components reveals in particular a widespread sex difference in white matter, which was previously shown using, for example, diffusion tensor imaging but unobservable in the native MRI contrasts. In conclusion, our study shows that single-subject independent component analysis can be applied to routine sequences, thereby enhancing comparability in-between subjects. Unlike quantitative MRI, which requires specific sequences during acquisition, our method is applicable to existing MRI data. Hum Brain Mapp, 2017. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

  8. Randomized controlled trial of a web-based multi-modal therapy program for executive functioning in children and adolescents with unilateral cerebral palsy.

    Science.gov (United States)

    M Piovesana, Adina; Ross, Stephanie; Lloyd, Owen; Whittingham, Koa; Ziviani, Jenny; Ware, Robert S; Boyd, Roslyn N

    2017-10-01

    Purpose state: Determine the efficacy of Move-it-to-improve-it (Mitii™), a multi-modal web-based program, in improving Executive Function (EF) in children with unilateral cerebral palsy (UCP). Participants (n = 102) were matched in pairs then randomized to: intervention (Mitii™ for 20 weeks; n = 51; 26 males; mean age = 11 years 8 months (SD = 2 years 4 months); Full Scale IQ = 84.65 (SD = 15.19); 28 left UCP; GMFCS-E&R (I = 20, II = 31) or waitlist control (n = 50; 25 males; mean age = 11 years 10 months (SD = 2 years 5 months); Full Scale IQ = 80.75 (SD = 19.81); 20 left UCP; GMFCS-E&R (I = 25, II = 25). Mitii™ targeted working memory (WM), visual processing (VP), upper limb co-ordination and physical activity. EF capacity was assessed: attentional control (DSB; WISC-IV); cognitive flexibility (inhibition and number-letter sequencing DKEFS); goal setting (D-KEFs Tower Test); and information processing (WISC-IV Symbol Search and Coding). EF performance was assessed via parent report (BRIEF). Groups were compared at 20 weeks using linear regression (SPSS 21). There were no significant between group differences in attentional control (DSB; p = 0.20;CI= -0.40,1.87); cognitive flexibility (Inhibition, p = 0.34; CI= -0.73,2.11; number/letter sequencing, p = 0.17; CI= -0.55,2.94); problem solving (Tower; p = 0.28; CI= -0.61,2.09), information processing (Symbol; p = 0.08; CI= -0.16, 2.75; Coding; p = 0.07; CI= -0.12,2.52) or EF performance (p = 0.13; CI= -10.04,1.38). In a large RCT, Mitii(TM) did not lead to significant improvements on measures of EF or parent ratings of EF performance in children with UCP. Implications for rehabilitation A large RCT of the multi-modal web based training; Move It to Improve It (Mitii(TM)) improves motor processing, visual perception, and physical capacity but does demonstrate statistically significant improvements or clinical

  9. 机器海豚多模态游动CPG控制%CPG-based Multi-modal Swimming Control for Robotic Dolphin

    Institute of Scientific and Technical Information of China (English)

    汪明; 喻俊志; 谭民; 王会东; 李成栋

    2014-01-01

    Inspired by the extraordinary swimming skills of dolphins in the nature, robotic dolphin, which has potentially wide applications in military and civil domains, has attracted increased attention recently. However, it must have a special locomotion controller for a robotic dolphin to achieve abundant swimming modes. To solve this problem, a central pattern generation (CPG)-based locomotion controller has been proposed in this paper. The CPG locomotion model was set up by modeling weakly coupled oscillators, which well match between the CPGs and the joint configuration of the robotic dolphin. In addition, the development of a robotic prototype, the controller design, as well as the aquatic tests are detailed. The multi-modal control experiments, such as swimming forward, turning, and heaving, verify the effectiveness and practicality of the proposed CPG-based locomotion control method for the multi-joint robotic dolphin.%受自然界海豚超凡的水中游动技能启发,机器海豚在军事和民用上具有潜在的广泛应用前景,因此受到研究人员的极大关注。然而,要实现机器海豚在水中自如地机动游动,必须为机器海豚设计一个具有丰富游动技能的多模态控制器。为此,通过振荡器建模与分析、中枢模式发生器(Central pattern generation, CPG)与机器海豚关节配对、CPG 单元间耦合等环节建立了机器海豚的链式弱耦合CPG 运动控制模型,提出一种基于CPG 激发产生多模态振荡波形控制机器海豚运动的方法。详细阐述了机器海豚样机研制、控制器设计、运动控制实现与实验测试等内容。向前直游、转弯、浮潜等游动实验结果验证了所提出的机器海豚CPG运动控制方法的有效性和实用性。

  10. Multi-modal image registration using structural features.

    Science.gov (United States)

    Kasiri, Keyvan; Clausi, David A; Fieguth, Paul

    2014-01-01

    Multi-modal image registration has been a challenging task in medical images because of the complex intensity relationship between images to be aligned. Registration methods often rely on the statistical intensity relationship between the images which suffers from problems such as statistical insufficiency. The proposed registration method works based on extracting structural features by utilizing the complex phase and gradient-based information. By employing structural relationships between different modalities instead of complex similarity measures, the multi-modal registration problem is converted into a mono-modal one. Therefore, conventional mono-modal similarity measures can be utilized to evaluate the registration results. This new registration paradigm has been tested on magnetic resonance (MR) brain images of different modes. The method has been evaluated based on target registration error (TRE) to determine alignment accuracy. Quantitative results demonstrate that the proposed method is capable of achieving comparable registration accuracy compared to the conventional mutual information.

  11. On the Bicriterion Multi Modal Assignment Problem

    DEFF Research Database (Denmark)

    Pedersen, Christian Roed; Nielsen, L.R.; Andersen, K.A.

    2005-01-01

    We consider the bicriterion multi modal assignment problem which is a new generalization of the classical linear assignment problem. A two-phase solution method using an effective ranking scheme is presented. The algorithm is valid for generating all nondominated criterion points...

  12. Multi modal child-to-child interaction

    DEFF Research Database (Denmark)

    Fisker, Tine Basse

    In this presentation the interaction and relation of three boys is analyzed using multi modal analysis. The analysis clearly, and surprisingly demonstrates that the boys interact via different modes and that they are able to handle several interaction partners at the same time. They co-construct ...

  13. Multi modal child-to-child interaction

    DEFF Research Database (Denmark)

    Fisker, Tine Basse

    In this presentation the interaction and relation of three boys is analyzed using multi modal analysis. The analysis clearly, and surprisingly demonstrates that the boys interact via different modes and that they are able to handle several interaction partners at the same time. They co-construct ...

  14. A new region descriptor for multi-modal medical image registration and region detection.

    Science.gov (United States)

    Xiaonan Wan; Dongdong Yu; Feng Yang; Caiyun Yang; Chengcai Leng; Min Xu; Jie Tian

    2015-08-01

    Establishing accurate anatomical correspondences plays a critical role in multi-modal medical image registration and region detection. Although many features based registration methods have been proposed to detect these correspondences, they are mostly based on the point descriptor which leads to high memory cost and could not represent local region information. In this paper, we propose a new region descriptor which depicts the features in each region, instead of in each point, as a vector. First, feature attributes of each point are extracted by a Gabor filter bank combined with a gradient filter. Then, the region descriptor is defined as the covariance of feature attributes of each point inside the region, based on which a cost function is constructed for multi-modal image registration. Finally, our proposed region descriptor is applied to both multi-modal region detection and similarity metric measurement in multi-modal image registration. Experiments demonstrate the feasibility and effectiveness of our proposed region descriptor.

  15. Learning Multi-modal Similarity

    CERN Document Server

    McFee, Brian

    2010-01-01

    In many applications involving multi-media data, the definition of similarity between items is integral to several key tasks, e.g., nearest-neighbor retrieval, classification, and recommendation. Data in such regimes typically exhibits multiple modalities, such as acoustic and visual content of video. Integrating such heterogeneous data to form a holistic similarity space is therefore a key challenge to be overcome in many real-world applications. We present a novel multiple kernel learning technique for integrating heterogeneous data into a single, unified similarity space. Our algorithm learns an optimal ensemble of kernel transfor- mations which conform to measurements of human perceptual similarity, as expressed by relative comparisons. To cope with the ubiquitous problems of subjectivity and inconsistency in multi- media similarity, we develop graph-based techniques to filter similarity measurements, resulting in a simplified and robust training procedure.

  16. Multi-Modal Interaction for Robotic Mules

    Science.gov (United States)

    2014-02-26

    Multi-Modal Interaction for Robotic Mules Glenn Taylor, Mike Quist , Matt Lanting, Cory Dunham, Patrick Theisen, Paul Muench Abstract...Taylor, Mike Quist , Matt Lanting, Cory Dunham, and Patrick Theisen are with Soar Technology, Inc. (corresponding author: 734-887- 7620; email: glenn...soartech.com; quist @soartech.com; matt.lanting@soartech.com; dunham@soartech.com; patrick.theisen@soartech.com Paul Muench is with US Army TARDEC

  17. 基于免疫量子遗传算法的多峰函数寻优%Multi-modal function optimization based on immune quantum genetic algorithm

    Institute of Scientific and Technical Information of China (English)

    徐雪松; 王四春

    2012-01-01

    针对多峰函数优化中的全局及局部寻优问题,提出了一种结合免疫克隆算子的量子遗传算法,给出了实现流程.该方法针对量子遗传算法在复杂连续函数优化中收敛速度慢、易陷入局部极值等缺点,采用免疫克隆操作及交叉策略提高抗体成熟力及亲和性,增强抗体群分布的多样性及稳定性,有效克服了量子遗传算法容易陷于局部最优及计算缓慢的不足.通过对多峰函数的全局寻优仿真实验,并与基本遗传算法、量子遗传算法的计算结果进行比较,结果表明在相同条件下,所提算法所需循环代数少,并且其鲁棒性高于普通量子遗传算法和遗传算法.%In order to balance the global optimization and local optimization in multi-modal function, an improved quantum genetic algorithm with immune operator was introduced. This algorithm included the idea of immune clonal, operation and cross strategy. Through this operator, the diversity of antibody and affinity maturation rate got enhanced. It not only overcame the flaw of the common quantum genetic algorithm which relapsed into local optimum result but also avoided the flaw of the common immune clone algorithm which calculated slowly. Having done the global optimization experiment on the multimodal function in the same condition, the result indicates that this algorithm can settle the problem of searching the global optimization result with less iteration, and is of more robust stability compared to common genetic algorithm and common quantum genetic algorithm.

  18. A model-view-controller approach to object persistence

    Energy Technology Data Exchange (ETDEWEB)

    Heinckiens, P.; Tromp, H.; Hoffman, G. [Univ. of Ghent, Gent (Belgium)

    1995-12-31

    The model-view-controller framework (MVC) is discussed to some extent, first within the context of a user interface to a business model. After a new, generic definition of object persistence is presented, it is shown that the concept of persistence, according to that definition, can also be fitted within a model-view-controller scheme. That will lead to a unified MVC concept, which can easily be further generalized to other related issues, such as interprocess communication and other forms of communications with the outside world. SCOOP (Scalable Object Oriented Persistence), a set of C++ classes which support object persistence, is presented. It is shown how it offers a seamless migration path from more traditional to fall blown object-oriented database systems. The position of SCOOP within the MVC architecture is discussed.

  19. A comparison of model view controller and model view presenter

    OpenAIRE

    Qureshi, M. Rizwan Jameel; Sabir, Fatima

    2014-01-01

    Web application frameworks are managed by using different design strategies. Design strategies are applied by using different design processes. In each design process, requirement specifications are changed in to different design model that describe the detail of different data structure, system architecture, interface and components. Web application frame work is implemented by using Model View Controller (MVC) and Model View Presenter (MVP). These web application models are used to provide ...

  20. On the Bicriterion Multi Modal Assignment Problem

    DEFF Research Database (Denmark)

    Pedersen, Christian Roed; Nielsen, L.R.; Andersen, K.A.

    2005-01-01

    We consider the bicriterion multi modal assignment problem which is a new generalization of the classical linear assignment problem. A two-phase solution method using an effective ranking scheme is presented. The algorithm is valid for generating all nondominated criterion points...... or an approximation. Extensive computational results are conducted on a large library of test instances to test the performance of the algorithm and to identify hard test instances. Also, test results of the algorithm applied to the bicriterion assignment problem is given. Here our algorithm outperforms all...

  1. Model-View-Controller-arkkitehtuuri JavaScriptissa

    OpenAIRE

    Salo, Antti

    2015-01-01

    Insinöörityössä tehtiin Model-View-Controller-arkkitehtuuria noudattava sovellus, joka suoritetaan selaimessa. Toteutus tehtiin käyttäen JavaScript-ohjelmointikieltä ja sovelluskehystä nimeltä AngularJS. Työssä ei käyty läpi muita samaan suunnittelumalliin nojaavia sovelluskehyksiä. Työssä perehdyttiin MVC-arkkitehtuurin historiaan ja valotettiin sen teoreettisia toimintaperiaatteita. Tutustumalla suunnittelumallin periaatteisiin palvelinkehityksen maailmassa luotiin pohja haasteista, jo...

  2. Osteo-cise: Strong Bones for Life: Protocol for a community-based randomised controlled trial of a multi-modal exercise and osteoporosis education program for older adults at risk of falls and fractures

    Directory of Open Access Journals (Sweden)

    Gianoudis Jenny

    2012-05-01

    Full Text Available Abstract Background Osteoporosis affects over 220 million people worldwide, and currently there is no ‘cure’ for the disease. Thus, there is a need to develop evidence-based, safe and acceptable prevention strategies at the population level that target multiple risk factors for fragility fractures to reduce the health and economic burden of the condition. Methods/design The Osteo-cise: Strong Bones for Life study will investigate the effectiveness and feasibility of a multi-component targeted exercise, osteoporosis education/awareness and behavioural change program for improving bone health and muscle function and reducing falls risk in community-dwelling older adults at an increased risk of fracture. Men and women aged ≥60 years will participate in an 18-month randomised controlled trial comprising a 12-month structured and supervised community-based program and a 6-month ‘research to practise’ translational phase. Participants will be randomly assigned to either the Osteo-cise intervention or a self-management control group. The intervention will comprise a multi-modal exercise program incorporating high velocity progressive resistance training, moderate impact weight-bearing exercise and high challenging balance exercises performed three times weekly at local community-based fitness centres. A behavioural change program will be used to enhance exercise adoption and adherence to the program. Community-based osteoporosis education seminars will be conducted to improve participant knowledge and understanding of the risk factors and preventative measures for osteoporosis, falls and fractures. The primary outcomes measures, to be collected at baseline, 6, 12, and 18 months, will include DXA-derived hip and spine bone mineral density measurements and functional muscle power (timed stair-climb test. Secondary outcomes measures include: MRI-assessed distal femur and proximal tibia trabecular bone micro-architecture, lower limb and back

  3. Low-Rank and Joint Sparse Representations for Multi-Modal Recognition.

    Science.gov (United States)

    Zhang, Heng; Patel, Vishal M; Chellappa, Rama

    2017-10-01

    We propose multi-task and multivariate methods for multi-modal recognition based on low-rank and joint sparse representations. Our formulations can be viewed as generalized versions of multivariate low-rank and sparse regression, where sparse and low-rank representations across all modalities are imposed. One of our methods simultaneously couples information within different modalities by enforcing the common low-rank and joint sparse constraints among multi-modal observations. We also modify our formulations by including an occlusion term that is assumed to be sparse. The alternating direction method of multipliers is proposed to efficiently solve the resulting optimization problems. Extensive experiments on three publicly available multi-modal biometrics and object recognition data sets show that our methods compare favorably with other feature-level fusion methods.

  4. Clustered iterative stochastic ensemble method for multi-modal calibration of subsurface flow models

    KAUST Repository

    Elsheikh, Ahmed H.

    2013-05-01

    A novel multi-modal parameter estimation algorithm is introduced. Parameter estimation is an ill-posed inverse problem that might admit many different solutions. This is attributed to the limited amount of measured data used to constrain the inverse problem. The proposed multi-modal model calibration algorithm uses an iterative stochastic ensemble method (ISEM) for parameter estimation. ISEM employs an ensemble of directional derivatives within a Gauss-Newton iteration for nonlinear parameter estimation. ISEM is augmented with a clustering step based on k-means algorithm to form sub-ensembles. These sub-ensembles are used to explore different parts of the search space. Clusters are updated at regular intervals of the algorithm to allow merging of close clusters approaching the same local minima. Numerical testing demonstrates the potential of the proposed algorithm in dealing with multi-modal nonlinear parameter estimation for subsurface flow models. © 2013 Elsevier B.V.

  5. An In vivo Multi-Modal Structural Template for Neonatal Piglets Using High Angular Resolution and Population-Based Whole-Brain Tractography.

    Science.gov (United States)

    Zhong, Jidan; Chen, David Q; Walker, Matthew; Waspe, Adam; Looi, Thomas; Piorkowska, Karolina; Drake, James M; Hodaie, Mojgan

    2016-01-01

    An increasing number of applications use the postnatal piglet model in neuroimaging studies, however, these are based primarily on T1 weighted image templates. There is a growing need for a multimodal structural brain template for a comprehensive depiction of the piglet brain, particularly given the growing applications of diffusion weighted imaging for characterizing tissue microstructures and white matter organization. In this study, we present the first multimodal piglet structural brain template which includes a T1 weighted image with tissue segmentation probability maps, diffusion weighted metric templates with multiple diffusivity maps, and population-based whole-brain fiber tracts for postnatal piglets. These maps provide information about the integrity of white matter that is not available in T1 images alone. The availability of this diffusion weighted metric template will contribute to the structural imaging analysis of the postnatal piglet brain, especially models that are designed for the study of white matter diseases. Furthermore, the population-based whole-brain fiber tracts permit researchers to visualize the white matter connections in the piglet brain across subjects, guiding the delineation of a specific white matter region for structural analysis where current diffusion data is lacking. Researchers are able to augment the tracts by merging tracts from their own data to the population-based fiber tracts and thus improve the confidence of the population-wise fiber distribution.

  6. An In vivo Multi-Modal Structural Template for Neonatal Piglets Using High Angular Resolution and Population-Based Whole-Brain Tractography

    Science.gov (United States)

    Zhong, Jidan; Chen, David Q.; Walker, Matthew; Waspe, Adam; Looi, Thomas; Piorkowska, Karolina; Drake, James M.; Hodaie, Mojgan

    2016-01-01

    An increasing number of applications use the postnatal piglet model in neuroimaging studies, however, these are based primarily on T1 weighted image templates. There is a growing need for a multimodal structural brain template for a comprehensive depiction of the piglet brain, particularly given the growing applications of diffusion weighted imaging for characterizing tissue microstructures and white matter organization. In this study, we present the first multimodal piglet structural brain template which includes a T1 weighted image with tissue segmentation probability maps, diffusion weighted metric templates with multiple diffusivity maps, and population-based whole-brain fiber tracts for postnatal piglets. These maps provide information about the integrity of white matter that is not available in T1 images alone. The availability of this diffusion weighted metric template will contribute to the structural imaging analysis of the postnatal piglet brain, especially models that are designed for the study of white matter diseases. Furthermore, the population-based whole-brain fiber tracts permit researchers to visualize the white matter connections in the piglet brain across subjects, guiding the delineation of a specific white matter region for structural analysis where current diffusion data is lacking. Researchers are able to augment the tracts by merging tracts from their own data to the population-based fiber tracts and thus improve the confidence of the population-wise fiber distribution. PMID:27729850

  7. Predicting the multi-modal binding propensity of small molecules: towards an understanding of drug promiscuity.

    Science.gov (United States)

    Park, Keunwan; Lee, Soyoung; Ahn, Hee-Sung; Kim, Dongsup

    2009-08-01

    Drug promiscuity is one of the key issues in current drug development. Many famous drugs have turned out to behave unexpectedly due to their propensity to bind to multiple targets. One of the primary reasons for this promiscuity is that drugs bind to multiple distinctive target environments, a feature that we call multi-modal binding. Accordingly, investigations into whether multi-modal binding propensities can be predicted, and if so, whether the features determining this behavior can be found, would be an important advance. In this study, we have developed a structure-based classifier that predicts whether small molecules will bind to multiple distinct binding sites. The binding sites for all ligands in the Protein Data Bank (PDB) were clustered by binding site similarity, and the ligands that bind to many dissimilar binding sites were identified as multi-modal binding ligands. The mono-binding ligands were also collected, and the classifiers were built using various machine-learning algorithms. A 10-fold cross-validation procedure showed 70-85% accuracy depending on the choice of machine-learning algorithm, and the different definitions used to identify multi-modal binding ligands. In addition, a quantified importance measurement for global and local descriptors was also provided, which suggests that the local features are more likely to have an effect on multi-modal binding than the global ones. The interpretable global and local descriptors were also ranked by their importance. To test the classifier on real examples, several test sets including well-known promiscuous drugs were collected by a literature and database search. Despite the difficulty in constructing appropriate testable sets, the classifier showed reasonable results that were consistent with existing information on drug behavior. Finally, a test on natural enzyme substrates and artificial drugs suggests that the natural compounds tend to exhibit a broader range of multi-modal binding than the

  8. A multi-modal approach to perceptual tone mapping

    Directory of Open Access Journals (Sweden)

    Vicent Caselles

    2013-06-01

    Full Text Available We present an improvement of TSTM, a recently proposed tone mapping operator for High Dynamic Range (HDR images, based on a multi-modal analysis. One of the key features of TSTM is a suitable implementation of the Naka-Rushton equation that mimics the visual adaptation performed by the human visual system coherently with Weber-Fechner's law of contrast perception. In the present paper we use the Gaussian Mixture Model (GMM in order to detect the modes of the log-scale luminance histogram of a given HDR image and then we use the information provided by GMM to properly devise a Naka-Rushton equation for each mode. Finally, we properly select the parameters in order to merge those equations into a continuous function. Tests and comparisons to show how this new method is capable of improving the performances of TSTM are provided and commented, as well as comparisons with state of the art methods.

  9. Multi-modality molecular imaging for gastric cancer research

    Science.gov (United States)

    Liang, Jimin; Chen, Xueli; Liu, Junting; Hu, Hao; Qu, Xiaochao; Wang, Fu; Nie, Yongzhan

    2011-12-01

    Because of the ability of integrating the strengths of different modalities and providing fully integrated information, multi-modality molecular imaging techniques provide an excellent solution to detecting and diagnosing earlier cancer, which remains difficult to achieve by using the existing techniques. In this paper, we present an overview of our research efforts on the development of the optical imaging-centric multi-modality molecular imaging platform, including the development of the imaging system, reconstruction algorithms and preclinical biomedical applications. Primary biomedical results show that the developed optical imaging-centric multi-modality molecular imaging platform may provide great potential in the preclinical biomedical applications and future clinical translation.

  10. Multi-Modal Intelligent Traffic Signal Systems GPS

    Data.gov (United States)

    Department of Transportation — Data were collected during the Multi-Modal Intelligent Transportation Signal Systems (MMITSS) study. MMITSS is a next-generation traffic signal system that seeks to...

  11. Multi-Modal Intelligent Traffic Signal Systems Basic Safety Message

    Data.gov (United States)

    Department of Transportation — Data were collected during the Multi-Modal Intelligent Transportation Signal Systems (MMITSS) study. MMITSS is a next-generation traffic signal system that seeks to...

  12. 基于多模态话语分析的英语写作教学模式研究%Research on English Writing Teaching Model based Multi-modal Discourse Analysis

    Institute of Scientific and Technical Information of China (English)

    张萍; 吴利琴

    2014-01-01

    Multi-modal discourses, such as pictures, sounds, are widely applied in modern society. How to interpret and utilize the multi-modal discourses in various ifelds has come into focus. This paper ifrstly introduces the origin and development of multi-modal discourse theory, and then describes its application in English writing teaching class in an attempt to improve students’ writing skill.%在传统写作中,教师更多注重培养学生的文章组织结构及语言表达能力,而随着社会信息化水平的不断提高,多模态话语逐渐被现代社会的人们有效应用。首先介绍多模态话语分析理论的内容与研究现状,接着描述其在英语写作课堂教学中的应用,以期改善英语写作课堂效果。

  13. DASC: Robust Dense Descriptor for Multi-Modal and Multi-Spectral Correspondence Estimation.

    Science.gov (United States)

    Kim, Seungryong; Min, Dongbo; Ham, Bumsub; Do, Minh N; Sohn, Kwanghoon

    2017-09-01

    Establishing dense correspondences between multiple images is a fundamental task in many applications. However, finding a reliable correspondence between multi-modal or multi-spectral images still remains unsolved due to their challenging photometric and geometric variations. In this paper, we propose a novel dense descriptor, called dense adaptive self-correlation (DASC), to estimate dense multi-modal and multi-spectral correspondences. Based on an observation that self-similarity existing within images is robust to imaging modality variations, we define the descriptor with a series of an adaptive self-correlation similarity measure between patches sampled by a randomized receptive field pooling, in which a sampling pattern is obtained using a discriminative learning. The computational redundancy of dense descriptors is dramatically reduced by applying fast edge-aware filtering. Furthermore, in order to address geometric variations including scale and rotation, we propose a geometry-invariant DASC (GI-DASC) descriptor that effectively leverages the DASC through a superpixel-based representation. For a quantitative evaluation of the GI-DASC, we build a novel multi-modal benchmark as varying photometric and geometric conditions. Experimental results demonstrate the outstanding performance of the DASC and GI-DASC in many cases of dense multi-modal and multi-spectral correspondences.

  14. Information content and analysis methods for multi-modal high-throughput biomedical data.

    Science.gov (United States)

    Ray, Bisakha; Henaff, Mikael; Ma, Sisi; Efstathiadis, Efstratios; Peskin, Eric R; Picone, Marco; Poli, Tito; Aliferis, Constantin F; Statnikov, Alexander

    2014-03-21

    The spectrum of modern molecular high-throughput assaying includes diverse technologies such as microarray gene expression, miRNA expression, proteomics, DNA methylation, among many others. Now that these technologies have matured and become increasingly accessible, the next frontier is to collect "multi-modal" data for the same set of subjects and conduct integrative, multi-level analyses. While multi-modal data does contain distinct biological information that can be useful for answering complex biology questions, its value for predicting clinical phenotypes and contributions of each type of input remain unknown. We obtained 47 datasets/predictive tasks that in total span over 9 data modalities and executed analytic experiments for predicting various clinical phenotypes and outcomes. First, we analyzed each modality separately using uni-modal approaches based on several state-of-the-art supervised classification and feature selection methods. Then, we applied integrative multi-modal classification techniques. We have found that gene expression is the most predictively informative modality. Other modalities such as protein expression, miRNA expression, and DNA methylation also provide highly predictive results, which are often statistically comparable but not superior to gene expression data. Integrative multi-modal analyses generally do not increase predictive signal compared to gene expression data.

  15. Application of Multi-modal Transportation in U.S.Military Delivery-based Logistics%美军配送式物流中应用多式联运的研究

    Institute of Scientific and Technical Information of China (English)

    齐玉梅

    2012-01-01

    The paper first analyzes the application of multi-modal transportation in the distribution system of the U.S. army and then discusses the experience accumulated by the U.S. army in this practice from five aspects.%美军作为配送式后勤的先行者,在多式联运方面积累了丰富经验.首先分析了多式联运在美军配送体系中的作用,接着从5个方面论述了美军运用多式联运的实践经验.

  16. Making Faces - State-Space Models Applied to Multi-Modal Signal Processing

    DEFF Research Database (Denmark)

    Lehn-Schiøler, Tue

    2005-01-01

    The two main focus areas of this thesis are State-Space Models and multi modal signal processing. The general State-Space Model is investigated and an addition to the class of sequential sampling methods is proposed. This new algorithm is denoted as the Parzen Particle Filter. Furthermore, the Ma...... application an information theoretic vector quantizer is also proposed. Based on interactions between particles, it is shown how a quantizing scheme based on an analytic cost function can be derived....

  17. Research on Multi-Modal Data based Event Model in Cyber-Physical Systems%信息物理融合系统中基于多模态数据的事件模型研究

    Institute of Scientific and Technical Information of China (English)

    高静; 李建中

    2015-01-01

    在信息物理融合系统中,通过部署在系统区域内的传感器节点来获得物理世界的信息。信息物理融合系统通常包含若干个异构的无线传感器网络。这些异构网络包含不同类型的传感器节点,这些节点具有不同的感知、计算和通信能力。将异构的传感器节点获得的不同类型的感知数据融合是一个十分重要并亟待解决的问题。在本文中,提出了基于多模态数据的事件模型,以事件为载体将多种不同模态的数据融合计算。文中描述并定义了信息物理融合系统中的事件,给出了基本事件和复合事件的定义,并提出了事件的合成规则。%In Cyber-Physical Systems( CPS),the information about physical world is obtained by sensors deployed in the system area. Generally,a CPS is composed by several heterogeneous wireless sensor networks. Heterogeneous sensor nodes in these networks have different capabilities in terms of sensing,computing and communication. Jointly processing the multi-modal data generated by heterogeneous sensors is an important problem. This paper proposes multi-modal event model, which interstates multi-modal data by events. The definitions and descriptions of atomic event and complex event,the composition rules of the event are proposed in this paper.

  18. Distributed Detection in Sensor Networks with Limited Range Multi-Modal Sensors

    CERN Document Server

    Ermis, E

    2008-01-01

    We consider a multi-object detection problem over a sensor network (SNET) with limited range multi-modal sensors. Limited range sensing environment arises in a sensing field prone to signal attenuation and path losses. The general problem complements the widely considered decentralized detection problem where all sensors observe the same object. In this paper we develop a distributed detection approach based on recent development of the false discovery rate (FDR) and the associated BH test procedure. The BH procedure is based on rank ordering of scalar test statistics. We first develop scalar test statistics for multidimensional data to handle multi-modal sensor observations and establish its optimality in terms of the BH procedure. We then propose a distributed algorithm in the ideal case of infinite attenuation for identification of sensors that are in the immediate vicinity of an object. We demonstrate communication message scalability to large SNETs by showing that the upper bound on the communication mes...

  19. Design and experimental study of a multi-modal piezoelectric energy harvester

    Energy Technology Data Exchange (ETDEWEB)

    Xiong, Xing Yu [School of Energy, Power and Mechanical Engineering, North China Electric Power University, Beijing (China); Oyadiji, S. Olutunde [School of Mechanical, Aerospace and Civil Engineering, The University of Manchester, Manchester (United States)

    2017-01-15

    A multi-modal piezoelectric vibration energy harvester is designed in this article. It consists of a cantilevered base beam and some upper and lower layer beams with rigid masses bonded between the beams as spacers. For a four-layer harvester subjected to random base excitations, relocating the mass positions leads to the generation of up to four close resonance frequencies over the frequency range from 10 Hz to 100 Hz with relative large power output. The harvesters are connected with a resistance decade box and the frequency response functions of the voltage and power on resistive loads are determined. The experimental results are validated with the simulation results using the finite element method. On a certain level of power output, the experimental results show that the multi-modal harvesters can generate a frequency band that is more than two times greater than the frequency band produced by a cantilevered beam harvester.

  20. Discriminative multi-task feature selection for multi-modality classification of Alzheimer's disease.

    Science.gov (United States)

    Ye, Tingting; Zu, Chen; Jie, Biao; Shen, Dinggang; Zhang, Daoqiang

    2016-09-01

    Recently, multi-task based feature selection methods have been used in multi-modality based classification of Alzheimer's disease (AD) and its prodromal stage, i.e., mild cognitive impairment (MCI). However, in traditional multi-task feature selection methods, some useful discriminative information among subjects is usually not well mined for further improving the subsequent classification performance. Accordingly, in this paper, we propose a discriminative multi-task feature selection method to select the most discriminative features for multi-modality based classification of AD/MCI. Specifically, for each modality, we train a linear regression model using the corresponding modality of data, and further enforce the group-sparsity regularization on weights of those regression models for joint selection of common features across multiple modalities. Furthermore, we propose a discriminative regularization term based on the intra-class and inter-class Laplacian matrices to better use the discriminative information among subjects. To evaluate our proposed method, we perform extensive experiments on 202 subjects, including 51 AD patients, 99 MCI patients, and 52 healthy controls (HC), from the baseline MRI and FDG-PET image data of the Alzheimer's Disease Neuroimaging Initiative (ADNI). The experimental results show that our proposed method not only improves the classification performance, but also has potential to discover the disease-related biomarkers useful for diagnosis of disease, along with the comparison to several state-of-the-art methods for multi-modality based AD/MCI classification.

  1. Spatio-temporal multi-modality ontology for indexing and retrieving satellite images

    OpenAIRE

    MESSOUDI, Wassim; FARAH, Imed Riadh; SAHEB ETTABAA, Karim; Ben Ghezala, Henda; SOLAIMAN, Basel

    2009-01-01

    International audience; This paper presents spatio-temporal multi-modality ontology for indexing and retrieving satellite images in the high level to improve the quality of the system retrieval and to perform semantic in the retrieval process.Our approach is based on three modules: (1) regions and features extraction, (2) ontological indexing and (3) semantic image retrieval. The first module allows extracting regions from the satellite image using the fuzzy c-means FCM) segmentation algorith...

  2. Automatic extraction of geometric lip features with application to multi-modal speaker identification

    OpenAIRE

    Arsic, I.; Vilagut Abad, R.; Thiran, J.

    2006-01-01

    In this paper we consider the problem of automatic extraction of the geometric lip features for the purposes of multi-modal speaker identification. The use of visual information from the mouth region can be of great importance for improving the speaker identification system performance in noisy conditions. We propose a novel method for automated lip features extraction that utilizes color space transformation and a fuzzy-based c-means clustering technique. Using the obtained visual cues close...

  3. Increasing the Efficiency of 6-DoF Visual Localization Using Multi-Modal Sensory Data

    OpenAIRE

    Clark, Ronald; Wang, Sen; Wen, Hongkai; Trigoni, Niki; Markham, Andrew

    2016-01-01

    Localization is a key requirement for mobile robot autonomy and human-robot interaction. Vision-based localization is accurate and flexible, however, it incurs a high computational burden which limits its application on many resource-constrained platforms. In this paper, we address the problem of performing real-time localization in large-scale 3D point cloud maps of ever-growing size. While most systems using multi-modal information reduce localization time by employing side-channel informat...

  4. A transformation approach to modelling multi-modal diffusions

    DEFF Research Database (Denmark)

    Forman, Julie Lyng; Sørensen, Michael

    2014-01-01

    This paper demonstrates that flexible and statistically tractable multi-modal diffusion models can be attained by transformation of simple well-known diffusion models such as the Ornstein–Uhlenbeck model, or more generally a Pearson diffusion. The transformed diffusion inherits many properties...

  5. Choice set generation in multi-modal transportation networks

    NARCIS (Netherlands)

    Fiorenzo-Catalano, M.S.

    2007-01-01

    Multi-modal transport relates to trips for which travellers use two or more transport modes, for example bicycle and train, train and bus, or private car and metro. The main theme in this dissertation is to establish a choice set generation model and algorithm, and demonstrate its validity and

  6. Utilizing Multi-Modal Literacies in Middle Grades Science

    Science.gov (United States)

    Saurino, Dan; Ogletree, Tamra; Saurino, Penelope

    2010-01-01

    The nature of literacy is changing. Increased student use of computer-mediated, digital, and visual communication spans our understanding of adolescent multi-modal capabilities that reach beyond the traditional conventions of linear speech and written text in the science curriculum. Advancing technology opens doors to learning that involve…

  7. Reference Resolution in Multi-modal Interaction: Position paper

    NARCIS (Netherlands)

    Fernando, T.; Nijholt, Antinus

    2002-01-01

    In this position paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can

  8. Reference resolution in multi-modal interaction: Preliminary observations

    NARCIS (Netherlands)

    González González, G.R.; Nijholt, Antinus

    2002-01-01

    In this paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can apply

  9. Multi-modal locomotion: from animal to application.

    Science.gov (United States)

    Lock, R J; Burgess, S C; Vaidyanathan, R

    2014-03-01

    The majority of robotic vehicles that can be found today are bound to operations within a single media (i.e. land, air or water). This is very rarely the case when considering locomotive capabilities in natural systems. Utility for small robots often reflects the exact same problem domain as small animals, hence providing numerous avenues for biological inspiration. This paper begins to investigate the various modes of locomotion adopted by different genus groups in multiple media as an initial attempt to determine the compromise in ability adopted by the animals when achieving multi-modal locomotion. A review of current biologically inspired multi-modal robots is also presented. The primary aim of this research is to lay the foundation for a generation of vehicles capable of multi-modal locomotion, allowing ambulatory abilities in more than one media, surpassing current capabilities. By identifying and understanding when natural systems use specific locomotion mechanisms, when they opt for disparate mechanisms for each mode of locomotion rather than using a synergized singular mechanism, and how this affects their capability in each medium, similar combinations can be used as inspiration for future multi-modal biologically inspired robotic platforms.

  10. Reference resolution in multi-modal interaction: Preliminary observations

    NARCIS (Netherlands)

    Nijholt, A.; González González, G.R.

    2002-01-01

    In this paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can apply mo

  11. mDCC_tools: characterizing multi-modal atomic motions in molecular dynamics trajectories.

    Science.gov (United States)

    Kasahara, Kota; Mohan, Neetha; Fukuda, Ikuo; Nakamura, Haruki

    2016-08-15

    We previously reported the multi-modal Dynamic Cross Correlation (mDCC) method for analyzing molecular dynamics trajectories. This method quantifies the correlation coefficients of atomic motions with complex multi-modal behaviors by using a Bayesian-based pattern recognition technique that can effectively capture transiently formed, unstable interactions. Here, we present an open source toolkit for performing the mDCC analysis, including pattern recognitions, complex network analyses and visualizations. We include a tutorial document that thoroughly explains how to apply this toolkit for an analysis, using the example trajectory of the 100 ns simulation of an engineered endothelin-1 peptide dimer. The source code is available for free at http://www.protein.osaka-u.ac.jp/rcsfp/pi/mdcctools/, implemented in C ++ and Python, and supported on Linux. kota.kasahara@protein.osaka-u.ac.jp Supplementary data are available at Bioinformatics online. © The Author 2016. Published by Oxford University Press.

  12. A flexible graphical model for multi-modal parcellation of the cortex.

    Science.gov (United States)

    Parisot, Sarah; Glocker, Ben; Ktena, Sofia Ira; Arslan, Salim; Schirmer, Markus D; Rueckert, Daniel

    2017-09-06

    Advances in neuroimaging have provided a tremendous amount of in-vivo information on the brain's organisation. Its anatomy and cortical organisation can be investigated from the point of view of several imaging modalities, many of which have been studied for mapping functionally specialised cortical areas. There is strong evidence that a single modality is not sufficient to fully identify the brain's cortical organisation. Combining multiple modalities in the same parcellation task has the potential to provide more accurate and robust subdivisions of the cortex. Nonetheless, existing brain parcellation methods are typically developed and tested on single modalities using a specific type of information. In this paper, we propose Graph-based Multi-modal Parcellation (GraMPa), an iterative framework designed to handle the large variety of available input modalities to tackle the multi-modal parcellation task. At each iteration, we compute a set of parcellations from different modalities and fuse them based on their local reliabilities. The fused parcellation is used to initialise the next iteration, forcing the parcellations to converge towards a set of mutually informed modality specific parcellations, where correspondences are established. We explore two different multi-modal configurations for group-wise parcellation using resting-state fMRI, diffusion MRI tractography, myelin maps and task fMRI. Quantitative and qualitative results on the Human Connectome Project database show that integrating multi-modal information yields a stronger agreement with well established atlases and more robust connectivity networks that provide a better representation of the population. Copyright © 2017 Elsevier Inc. All rights reserved.

  13. Importance of multi-modal approaches to effectively identify cataract cases from electronic health records.

    Science.gov (United States)

    Peissig, Peggy L; Rasmussen, Luke V; Berg, Richard L; Linneman, James G; McCarty, Catherine A; Waudby, Carol; Chen, Lin; Denny, Joshua C; Wilke, Russell A; Pathak, Jyotishman; Carrell, David; Kho, Abel N; Starren, Justin B

    2012-01-01

    There is increasing interest in using electronic health records (EHRs) to identify subjects for genomic association studies, due in part to the availability of large amounts of clinical data and the expected cost efficiencies of subject identification. We describe the construction and validation of an EHR-based algorithm to identify subjects with age-related cataracts. We used a multi-modal strategy consisting of structured database querying, natural language processing on free-text documents, and optical character recognition on scanned clinical images to identify cataract subjects and related cataract attributes. Extensive validation on 3657 subjects compared the multi-modal results to manual chart review. The algorithm was also implemented at participating electronic MEdical Records and GEnomics (eMERGE) institutions. An EHR-based cataract phenotyping algorithm was successfully developed and validated, resulting in positive predictive values (PPVs) >95%. The multi-modal approach increased the identification of cataract subject attributes by a factor of three compared to single-mode approaches while maintaining high PPV. Components of the cataract algorithm were successfully deployed at three other institutions with similar accuracy. A multi-modal strategy incorporating optical character recognition and natural language processing may increase the number of cases identified while maintaining similar PPVs. Such algorithms, however, require that the needed information be embedded within clinical documents. We have demonstrated that algorithms to identify and characterize cataracts can be developed utilizing data collected via the EHR. These algorithms provide a high level of accuracy even when implemented across multiple EHRs and institutional boundaries.

  14. A multi-modal face recognition method using complete local derivative patterns and depth maps.

    Science.gov (United States)

    Yin, Shouyi; Dai, Xu; Ouyang, Peng; Liu, Leibo; Wei, Shaojun

    2014-10-20

    In this paper, we propose a multi-modal 2D + 3D face recognition method for a smart city application based on a Wireless Sensor Network (WSN) and various kinds of sensors. Depth maps are exploited for the 3D face representation. As for feature extraction, we propose a new feature called Complete Local Derivative Pattern (CLDP). It adopts the idea of layering and has four layers. In the whole system, we apply CLDP separately on Gabor features extracted from a 2D image and depth map. Then, we obtain two features: CLDP-Gabor and CLDP-Depth. The two features weighted by the corresponding coefficients are combined together in the decision level to compute the total classification distance. At last, the probe face is assigned the identity with the smallest classification distance. Extensive experiments are conducted on three different databases. The results demonstrate the robustness and superiority of the new approach. The experimental results also prove that the proposed multi-modal 2D + 3D method is superior to other multi-modal ones and CLDP performs better than other Local Binary Pattern (LBP) based features.

  15. A Multi-Modal Face Recognition Method Using Complete Local Derivative Patterns and Depth Maps

    Directory of Open Access Journals (Sweden)

    Shouyi Yin

    2014-10-01

    Full Text Available In this paper, we propose a multi-modal 2D + 3D face recognition method for a smart city application based on a Wireless Sensor Network (WSN and various kinds of sensors. Depth maps are exploited for the 3D face representation. As for feature extraction, we propose a new feature called Complete Local Derivative Pattern (CLDP. It adopts the idea of layering and has four layers. In the whole system, we apply CLDP separately on Gabor features extracted from a 2D image and depth map. Then, we obtain two features: CLDP-Gabor and CLDP-Depth. The two features weighted by the corresponding coefficients are combined together in the decision level to compute the total classification distance. At last, the probe face is assigned the identity with the smallest classification distance. Extensive experiments are conducted on three different databases. The results demonstrate the robustness and superiority of the new approach. The experimental results also prove that the proposed multi-modal 2D + 3D method is superior to other multi-modal ones and CLDP performs better than other Local Binary Pattern (LBP based features.

  16. Multi-modal discriminative dictionary learning for Alzheimer's disease and mild cognitive impairment.

    Science.gov (United States)

    Li, Qing; Wu, Xia; Xu, Lele; Chen, Kewei; Yao, Li; Li, Rui

    2017-10-01

    The differentiation of mild cognitive impairment (MCI), which is the prodromal stage of Alzheimer's disease (AD), from normal control (NC) is important as the recent research emphasis on early pre-clinical stage for possible disease abnormality identification, intervention and even possible prevention. The current study puts forward a multi-modal supervised within-class-similarity discriminative dictionary learning algorithm (SCDDL) we introduced previously for distinguishing MCI from NC. The proposed new algorithm was based on weighted combination and named as multi-modality SCDDL (mSCDDL). Structural magnetic resonance imaging (sMRI), fluorodeoxyglucose (FDG) positron emission tomography (PET) and florbetapir PET data of 113 AD patients, 110 MCI patients and 117 NC subjects from the Alzheimer's disease Neuroimaging Initiative database were adopted for classification between MCI and NC, as well as between AD and NC. Adopting mSCDDL, the classification accuracy achieved 98.5% for AD vs. NC and 82.8% for MCI vs. NC, which were superior to or comparable with the results of some other state-of-the-art approaches as reported in recent multi-modality publications. The mSCDDL procedure was a promising tool in assisting early diseases diagnosis using neuroimaging data. Copyright © 2017 Elsevier B.V. All rights reserved.

  17. Multi-modal hard x-ray imaging with a laboratory source using selective reflection from a mirror.

    Science.gov (United States)

    Pelliccia, Daniele; Paganin, David M

    2014-04-01

    Multi-modal hard x-ray imaging sensitive to absorption, refraction, phase and scattering contrast is demonstrated using a simple setup implemented with a laboratory source. The method is based on selective reflection at the edge of a mirror, aligned to partially reflect a pencil x-ray beam after its interaction with a sample. Quantitative scattering contrast from a test sample is experimentally demonstrated using this method. Multi-modal imaging of a house fly (Musca domestica) is shown as proof of principle of the technique for biological samples.

  18. Development of a Dynamically Configurable, Object-Oriented Framework for Distributed, Multi-modal Computational Aerospace Systems Simulation

    Science.gov (United States)

    Afjeh, Abdollah A.; Reed, John A.

    2003-01-01

    The following reports are presented on this project:A first year progress report on: Development of a Dynamically Configurable,Object-Oriented Framework for Distributed, Multi-modal Computational Aerospace Systems Simulation; A second year progress report on: Development of a Dynamically Configurable, Object-Oriented Framework for Distributed, Multi-modal Computational Aerospace Systems Simulation; An Extensible, Interchangeable and Sharable Database Model for Improving Multidisciplinary Aircraft Design; Interactive, Secure Web-enabled Aircraft Engine Simulation Using XML Databinding Integration; and Improving the Aircraft Design Process Using Web-based Modeling and Simulation.

  19. Instrumentation challenges in multi-modality imaging

    Energy Technology Data Exchange (ETDEWEB)

    Brasse, D., E-mail: david.brasse@iphc.cnrs.fr [Institut Pluridisciplinaire Hubert Curien, Université de Strasbourg, 23 rue du Loess 67037 Strasbourg (France); CNRS, UMR7178, 67037 Strasbourg (France); Boisson, F. [Institut Pluridisciplinaire Hubert Curien, Université de Strasbourg, 23 rue du Loess 67037 Strasbourg (France); CNRS, UMR7178, 67037 Strasbourg (France)

    2016-02-11

    Based on different physical principles, imaging procedures currently used in both clinical and preclinical applications present different performance that allow researchers to achieve a large number of studies. However, the relevance of obtaining a maximum of information relating to the same subject is undeniable. The last two decades have thus seen the advent of a full-fledged research axis, the multimodal in vivo imaging. Whether from an instrumentation point of view, for medical research or the development of new probes, all these research works illustrate the growing interest of the scientific community for multimodal imaging, which can be approached with different backgrounds and perspectives from engineers to end-users point of views. In the present review, we discuss the multimodal imaging concept, which focuses not only on PET/CT and PET/MRI instrumentation but also on recent investigations of what could become a possible future in the field.

  20. MINERVA - A Multi-Modal Radiation Treatment Planning System

    Energy Technology Data Exchange (ETDEWEB)

    D. E. Wessol; C. A. Wemple; D. W. Nigg; J. J. Cogliati; M. L. Milvich; C. Frederickson; M. Perkins; G. A. Harkin

    2004-10-01

    Recently, research efforts have begun to examine the combination of BNCT with external beam photon radiotherapy (Barth et al. 2004). In order to properly prepare treatment plans for patients being treated with combinations of radiation modalities, appropriate planning tools must be available. To facilitiate this, researchers at the Idaho National Engineering and Environmental Laboratory (INEEL)and Montana State University (MSU) have undertaken development of a fully multi-modal radiation treatment planning system.

  1. MULTI MODAL ONTOLOGY SEARCH FOR SEMANTIC IMAGE RETRIEVAL

    Directory of Open Access Journals (Sweden)

    R.I. Minu

    2012-08-01

    Full Text Available In this world of fast computing, automation plays an important role. In image retrieval technique automation is a great quest. Giving an image as a query and retrieving relevant images is a challenging research area. In this paper we are proposing a research of using Multi-Modality Ontology integration for image retrieval concept. The core strategy in multimodal information retrieval is the combination or fusion of different data modalities to expand and complement information. Here we use both visual and textual ontology contents to provide search functionalities. Both images and texts are complimentary information units as the human perspective will be different. So, the computational linguistic of images will lead to disambiguate text meaning when it is not quite clear in right sense of several words. That’s why the Multi-Modal information retrieval may lead to an improved operation of information retrieval system. If we go for automation we are in need of a fuzzy technique to predicate the result. So in this paper we using Support Vector Machine classifier to classify the image automatically by using the general feature such as color, texture and texton of an image , then by using this result we can create both feature and domain ontology for an particular image. Using this Multi-Modality Ontology we can refine our image searching system.

  2. Multi-modality image registration using the decomposition model

    Science.gov (United States)

    Ibrahim, Mazlinda; Chen, Ke

    2017-04-01

    In medical image analysis, image registration is one of the crucial steps required to facilitate automatic segmentation, treatment planning and other application involving imaging machines. Image registration, also known as image matching, aims to align two or more images so that information obtained can be compared and combined. Different imaging modalities and their characteristics make the task more challenging. We propose a decomposition model combining parametric and non-parametric deformation for multi-modality image registration. Numerical results show that the normalised gradient field perform better than the mutual information with the decomposition model.

  3. Coercive Region-level Registration for Multi-modal Images

    CERN Document Server

    Chen, Yu-Hui; Newstadt, Gregory; Simmons, Jeffrey; hero, Alfred

    2015-01-01

    We propose a coercive approach to simultaneously register and segment multi-modal images which share similar spatial structure. Registration is done at the region level to facilitate data fusion while avoiding the need for interpolation. The algorithm performs alternating minimization of an objective function informed by statistical models for pixel values in different modalities. Hypothesis tests are developed to determine whether to refine segmentations by splitting regions. We demonstrate that our approach has significantly better performance than the state-of-the-art registration and segmentation methods on microscopy images.

  4. Multi-modal intervention improved oral intake in hospitalized patients

    DEFF Research Database (Denmark)

    Holst, M; Beermann, T; Mortensen, M N

    2015-01-01

    : A 12-months observational multi-modal intervention study was done, using the top-down and bottom-up principle. All hospitalized patients (>3 days) were included. Setting: A university hospital with 758 beds and all specialities. Measurements: Record audit of GNP, energy- and protein-intake by 24-h......BACKGROUND: Good nutritional practice (GNP) includes screening, nutrition plan and monitoring, and is mandatory for targeted treatment of malnourished patients in hospital. AIMS: To optimize energy- and protein-intake in patients at nutritional risk and to improve GNP in a hospital setting. METHODS...

  5. Using Multi-Modal 3D Contours and Their Relations for Vision and Robotics

    DEFF Research Database (Denmark)

    Baseski, Emre; Pugeault, Nicolas; Kalkan, Sinan

    2010-01-01

    In this work, we make use of 3D contours and relations between them (namely, coplanarity, cocolority, distance and angle) for four different applications in the area of computer vision and vision-based robotics. Our multi-modal contour representation covers both geometric and appearance information....... We show the potential of reasoning with global entities in the context of visual scene analysis for driver assistance, depth prediction, robotic grasping and grasp learning. We argue that, such 3D global reasoning processes complement widely-used 2D local approaches such as bag-of-features since 3D...

  6. Research on Satellite Fault Diagnosis and Prediction Using Multi-modal Reasoning

    Institute of Scientific and Technical Information of China (English)

    YangTianshe; SunYanhong; CaoYuping

    2004-01-01

    Diagnosis and prediction of satellite fault are more difficult than that of other equipment due to the complex structure of satellites and the presence of muhi-excite sources of satellite faults. Generally, one kind of reasoning model can only diagnose and predict one kind of satellite faults. In this paper the author introduces an application of a new method using multi-modal reasoning to diagnose and predict satellite faults. The method has been used in the development of knowledge-based satellite fault diagnosis and recovery system (KSFDRS) successfully. It is shown that the method is effective.

  7. Multi-modal 2D-3D non-rigid registration

    Science.gov (United States)

    Prümmer, M.; Hornegger, J.; Pfister, M.; Dörfler, A.

    2006-03-01

    In this paper, we propose a multi-modal non-rigid 2D-3D registration technique. This method allows a non-rigid alignment of a patient pre-operatively computed tomography (CT) to few intra operatively acquired fluoroscopic X-ray images obtained with a C-arm system. This multi-modal approach is especially focused on the 3D alignment of high contrast reconstructed volumes with intra-interventional low contrast X-ray images in order to make use of up-to-date information for surgical guidance and other interventions. The key issue of non-rigid 2D-3D registration is how to define the distance measure between high contrast 3D data and low contrast 2D projections. In this work, we use algebraic reconstruction theory to handle this problem. We modify the Euler-Lagrange equation by introducing a new 3D force. This external force term is computed from the residual of the algebraic reconstruction procedures. In the multi-modal case we replace the residual between the digitally reconstructed radiographs (DRR) and observed X-ray images with a statistical based distance measure. We integrate the algebraic reconstruction technique into a variational registration framework, so that the 3D displacement field is driven to minimize the reconstruction distance between the volumetric data and its 2D projections using mutual information (MI). The benefits of this 2D-3D registration approach are its scalability in the number of used X-ray reference images and the proposed distance that can handle low contrast fluoroscopies as well. Experimental results are presented on both artificial phantom and 3D C-arm CT images.

  8. A multi-modal parcellation of human cerebral cortex.

    Science.gov (United States)

    Glasser, Matthew F; Coalson, Timothy S; Robinson, Emma C; Hacker, Carl D; Harwell, John; Yacoub, Essa; Ugurbil, Kamil; Andersson, Jesper; Beckmann, Christian F; Jenkinson, Mark; Smith, Stephen M; Van Essen, David C

    2016-08-11

    Understanding the amazingly complex human cerebral cortex requires a map (or parcellation) of its major subdivisions, known as cortical areas. Making an accurate areal map has been a century-old objective in neuroscience. Using multi-modal magnetic resonance images from the Human Connectome Project (HCP) and an objective semi-automated neuroanatomical approach, we delineated 180 areas per hemisphere bounded by sharp changes in cortical architecture, function, connectivity, and/or topography in a precisely aligned group average of 210 healthy young adults. We characterized 97 new areas and 83 areas previously reported using post-mortem microscopy or other specialized study-specific approaches. To enable automated delineation and identification of these areas in new HCP subjects and in future studies, we trained a machine-learning classifier to recognize the multi-modal 'fingerprint' of each cortical area. This classifier detected the presence of 96.6% of the cortical areas in new subjects, replicated the group parcellation, and could correctly locate areas in individuals with atypical parcellations. The freely available parcellation and classifier will enable substantially improved neuroanatomical precision for studies of the structural and functional organization of human cerebral cortex and its variation across individuals and in development, aging, and disease.

  9. MINERVA - a multi-modal radiation treatment planning system

    Energy Technology Data Exchange (ETDEWEB)

    Wemple, C.A. E-mail: cew@enel.gov; Wessol, D.E.; Nigg, D.W.; Cogliati, J.J.; Milvich, M.L.; Frederickson, C.; Perkins, M.; Harkin, G.J

    2004-11-01

    Researchers at the Idaho National Engineering and Environmental Laboratory and Montana State University have undertaken development of MINERVA, a patient-centric, multi-modal, radiation treatment planning system. This system can be used for planning and analyzing several radiotherapy modalities, either singly or combined, using common modality independent image and geometry construction and dose reporting and guiding. It employs an integrated, lightweight plugin architecture to accommodate multi-modal treatment planning using standard interface components. The MINERVA design also facilitates the future integration of improved planning technologies. The code is being developed with the Java Virtual Machine for interoperability. A full computation path has been established for molecular targeted radiotherapy treatment planning, with the associated transport plugin developed by researchers at the Lawrence Livermore National Laboratory. Development of the neutron transport plugin module is proceeding rapidly, with completion expected later this year. Future development efforts will include development of deformable registration methods, improved segmentation methods for patient model definition, and three-dimensional visualization of the patient images, geometry, and dose data. Transport and source plugins will be created for additional treatment modalities, including brachytherapy, external beam proton radiotherapy, and the EGSnrc/BEAMnrc codes for external beam photon and electron radiotherapy.

  10. An arbitrary boundary triangle mesh generation method for multi-modality imaging

    Science.gov (United States)

    Zhang, Xuanxuan; Deng, Yong; Gong, Hui; Meng, Yuanzheng; Yang, Xiaoquan; Luo, Qingming

    2012-03-01

    Low-resolution and ill-posedness are the major challenges in diffuse optical tomography(DOT)/fluorescence molecular tomography(FMT). Recently, the multi-modality imaging technology that combines micro-computed tomography (micro-CT) with DOT/FMT is developed to improve resolution and ill-posedness. To take advantage of the fine priori anatomical maps obtained from micro-CT, we present an arbitrary boundary triangle mesh generation method for FMT/DOT/micro-CT multi-modality imaging. A planar straight line graph (PSLG) based on the image of micro-CT is obtained by an adaptive boundary sampling algorithm. The subregions of mesh are accurately matched with anatomical structures by a two-step solution, firstly, the triangles and nodes during mesh refinement are labeled respectively, and then a revising algorithm is used to modifying meshes of each subregion. The triangle meshes based on a regular model and a micro-CT image are generated respectively. The results show that the subregions of triangle meshes can match with anatomical structures accurately and triangle meshes have good quality. This provides an arbitrary boundaries triangle mesh generation method with the ability to incorporate the fine priori anatomical information into DOT/FMT reconstructions.

  11. Multi-modal cockpit interface for improved airport surface operations

    Science.gov (United States)

    Arthur, Jarvis J. (Inventor); Bailey, Randall E. (Inventor); Prinzel, III, Lawrence J. (Inventor); Kramer, Lynda J. (Inventor); Williams, Steven P. (Inventor)

    2010-01-01

    A system for multi-modal cockpit interface during surface operation of an aircraft comprises a head tracking device, a processing element, and a full-color head worn display. The processing element is configured to receive head position information from the head tracking device, to receive current location information of the aircraft, and to render a virtual airport scene corresponding to the head position information and the current aircraft location. The full-color head worn display is configured to receive the virtual airport scene from the processing element and to display the virtual airport scene. The current location information may be received from one of a global positioning system or an inertial navigation system.

  12. Exploring Multi-Modal Distributions with Nested Sampling

    CERN Document Server

    Feroz, F

    2013-01-01

    In performing a Bayesian analysis, two difficult problems often emerge. First, in estimating the parameters of some model for the data, the resulting posterior distribution may be multi-modal or exhibit pronounced (curving) degeneracies. Secondly, in selecting between a set of competing models, calculation of the Bayesian evidence for each model is computationally expensive using existing methods such as thermodynamic integration. Nested Sampling is a Monte Carlo method targeted at the efficient calculation of the evidence, but also produces posterior inferences as a by-product and therefore provides means to carry out parameter estimation as well as model selection. The main challenge in implementing Nested Sampling is to sample from a constrained probability distribution. One possible solution to this problem is provided by the Galilean Monte Carlo (GMC) algorithm. We show results of applying Nested Sampling with GMC to some problems which have proven very difficult for standard Markov Chain Monte Carlo (MC...

  13. Discovering Knowledge from Multi-modal Lecture Recordings

    CERN Document Server

    Kannan, Rajkumar

    2010-01-01

    Educational media mining is the process of converting raw media data from educational systems to useful information that can be used to design learning systems, answer research questions and allow personalized learning experiences. Knowledge discovery encompasses a wide range of techniques ranging from database queries to more recent developments in machine learning and language technology. Educational media mining techniques are now being used in IT Services research worldwide. Multi-modal Lecture Recordings is one of the important types of educational media and this paper explores the research challenges for mining lecture recordings for the efficient personalized learning experiences. Keywords: Educational Media Mining; Lecture Recordings, Multimodal Information System, Personalized Learning; Online Course Ware; Skills and Competences;

  14. Game of Objects: vicarious causation and multi-modal media

    Directory of Open Access Journals (Sweden)

    Aaron Pedinotti

    2013-09-01

    Full Text Available This paper applies philosopher Graham Harman's object-oriented theory of "vicarious causation" to an analysis of the multi-modal media phenomenon known as "Game of Thrones." Examining the manner in which George R.R. Martin's best-selling series of fantasy novels has been adapted into a board game, a video game, and a hit HBO television series, it uses the changes entailed by these processes to trace the contours of vicariously generative relations. In the course of the resulting analysis, it provides new suggestions concerning the eidetic dimensions of Harman's causal model, particularly with regard to causation in linear networks and in differing types of game systems.

  15. Online multi-modal robust non-negative dictionary learning for visual tracking.

    Science.gov (United States)

    Zhang, Xiang; Guan, Naiyang; Tao, Dacheng; Qiu, Xiaogang; Luo, Zhigang

    2015-01-01

    Dictionary learning is a method of acquiring a collection of atoms for subsequent signal representation. Due to its excellent representation ability, dictionary learning has been widely applied in multimedia and computer vision. However, conventional dictionary learning algorithms fail to deal with multi-modal datasets. In this paper, we propose an online multi-modal robust non-negative dictionary learning (OMRNDL) algorithm to overcome this deficiency. Notably, OMRNDL casts visual tracking as a dictionary learning problem under the particle filter framework and captures the intrinsic knowledge about the target from multiple visual modalities, e.g., pixel intensity and texture information. To this end, OMRNDL adaptively learns an individual dictionary, i.e., template, for each modality from available frames, and then represents new particles over all the learned dictionaries by minimizing the fitting loss of data based on M-estimation. The resultant representation coefficient can be viewed as the common semantic representation of particles across multiple modalities, and can be utilized to track the target. OMRNDL incrementally learns the dictionary and the coefficient of each particle by using multiplicative update rules to respectively guarantee their non-negativity constraints. Experimental results on a popular challenging video benchmark validate the effectiveness of OMRNDL for visual tracking in both quantity and quality.

  16. Online multi-modal robust non-negative dictionary learning for visual tracking.

    Directory of Open Access Journals (Sweden)

    Xiang Zhang

    Full Text Available Dictionary learning is a method of acquiring a collection of atoms for subsequent signal representation. Due to its excellent representation ability, dictionary learning has been widely applied in multimedia and computer vision. However, conventional dictionary learning algorithms fail to deal with multi-modal datasets. In this paper, we propose an online multi-modal robust non-negative dictionary learning (OMRNDL algorithm to overcome this deficiency. Notably, OMRNDL casts visual tracking as a dictionary learning problem under the particle filter framework and captures the intrinsic knowledge about the target from multiple visual modalities, e.g., pixel intensity and texture information. To this end, OMRNDL adaptively learns an individual dictionary, i.e., template, for each modality from available frames, and then represents new particles over all the learned dictionaries by minimizing the fitting loss of data based on M-estimation. The resultant representation coefficient can be viewed as the common semantic representation of particles across multiple modalities, and can be utilized to track the target. OMRNDL incrementally learns the dictionary and the coefficient of each particle by using multiplicative update rules to respectively guarantee their non-negativity constraints. Experimental results on a popular challenging video benchmark validate the effectiveness of OMRNDL for visual tracking in both quantity and quality.

  17. Large Margin Multi-Modal Multi-Task Feature Extraction for Image Classification.

    Science.gov (United States)

    Yong Luo; Yonggang Wen; Dacheng Tao; Jie Gui; Chao Xu

    2016-01-01

    The features used in many image analysis-based applications are frequently of very high dimension. Feature extraction offers several advantages in high-dimensional cases, and many recent studies have used multi-task feature extraction approaches, which often outperform single-task feature extraction approaches. However, most of these methods are limited in that they only consider data represented by a single type of feature, even though features usually represent images from multiple modalities. We, therefore, propose a novel large margin multi-modal multi-task feature extraction (LM3FE) framework for handling multi-modal features for image classification. In particular, LM3FE simultaneously learns the feature extraction matrix for each modality and the modality combination coefficients. In this way, LM3FE not only handles correlated and noisy features, but also utilizes the complementarity of different modalities to further help reduce feature redundancy in each modality. The large margin principle employed also helps to extract strongly predictive features, so that they are more suitable for prediction (e.g., classification). An alternating algorithm is developed for problem optimization, and each subproblem can be efficiently solved. Experiments on two challenging real-world image data sets demonstrate the effectiveness and superiority of the proposed method.

  18. Aggregation for Computing Multi-Modal Stationary Distributions in 1-D Gene Regulatory Networks.

    Science.gov (United States)

    Avcu, Neslihan; Pekergin, Nihal; Pekergin, Ferhan; Guzelis, Cuneyt

    2017-04-27

    This paper proposes aggregation-based, three-stage algorithms to overcome the numerical problems encountered in computing stationary distributions and mean first passage times for multi-modal birth-death processes of large state space sizes. The considered birth-death processes which are defined by Chemical Master Equations are used in modeling stochastic behavior of gene regulatory networks. Computing stationary probabilities for a multi-modal distribution from Chemical Master Equations is subject to have numerical problems due to the probability values running out of the representation range of the standard programming languages with the increasing size of the state space. The aggregation is shown to provide a solution to this problem by analyzing first reduced size subsystems in isolation and then considering the transitions between these subsystems. The proposed algorithms are applied to study the bimodal behavior of the lac operon of E. coli described with a one-dimensional birth-death model. Thus the determination of the entire parameter range of bimodality for the stochastic model of lac operon is achieved.

  19. Multi-modal signal acquisition using a synchronized wireless body sensor network in geriatric patients.

    Science.gov (United States)

    Pflugradt, Maik; Mann, Steffen; Tigges, Timo; Görnig, Matthias; Orglmeister, Reinhold

    2016-02-01

    Wearable home-monitoring devices acquiring various biosignals such as the electrocardiogram, photoplethysmogram, electromyogram, respirational activity and movements have become popular in many fields of research, medical diagnostics and commercial applications. Especially ambulatory settings introduce still unsolved challenges to the development of sensor hardware and smart signal processing approaches. This work gives a detailed insight into a novel wireless body sensor network and addresses critical aspects such as signal quality, synchronicity among multiple devices as well as the system's overall capabilities and limitations in cardiovascular monitoring. An early sign of typical cardiovascular diseases is often shown by disturbed autonomic regulations such as orthostatic intolerance. In that context, blood pressure measurements play an important role to observe abnormalities like hypo- or hypertensions. Non-invasive and unobtrusive blood pressure monitoring still poses a significant challenge, promoting alternative approaches including pulse wave velocity considerations. In the scope of this work, the presented hardware is applied to demonstrate the continuous extraction of multi modal parameters like pulse arrival time within a preliminary clinical study. A Schellong test to diagnose orthostatic hypotension which is typically based on blood pressure cuff measurements has been conducted, serving as an application that might significantly benefit from novel multi-modal measurement principles. It is further shown that the system's synchronicity is as precise as 30 μs and that the integrated analog preprocessing circuits and additional accelerometer data provide significant advantages in ambulatory measurement environments.

  20. Treating psychological trauma in first responders: a multi-modal paradigm.

    Science.gov (United States)

    Flannery, Raymond B

    2015-06-01

    Responding to critical incidents may result in 5.9-22% of first responders developing psychological trauma and posttraumatic stress disorder. These impacts may be physical, mental, and/or behavioral. This population remains at risk, given the daily occurrence of critical incidents. Current treatments, primarily focused on combat and rape victims, have included single and double interventions, which have proven helpful to some but not all victims and one standard of care has remained elusive. However, even though the need is established, research on the treatment interventions of first responders has been limited. Given the multiplicity of impacts from psychological trauma and the inadequacies of responder treatment intervention research thus far, this paper proposes a paradigmatic shift from single/double treatment interventions to a multi-modal approach to first responder victim needs. A conceptual framework based on psychological trauma is presented and possible multi-modal interventions selected from the limited, extant first responder research are utilized to illustrate how the approach would work and to encourage clinical and experimental research into first responder treatment needs.

  1. Online Multi-Modal Robust Non-Negative Dictionary Learning for Visual Tracking

    Science.gov (United States)

    Zhang, Xiang; Guan, Naiyang; Tao, Dacheng; Qiu, Xiaogang; Luo, Zhigang

    2015-01-01

    Dictionary learning is a method of acquiring a collection of atoms for subsequent signal representation. Due to its excellent representation ability, dictionary learning has been widely applied in multimedia and computer vision. However, conventional dictionary learning algorithms fail to deal with multi-modal datasets. In this paper, we propose an online multi-modal robust non-negative dictionary learning (OMRNDL) algorithm to overcome this deficiency. Notably, OMRNDL casts visual tracking as a dictionary learning problem under the particle filter framework and captures the intrinsic knowledge about the target from multiple visual modalities, e.g., pixel intensity and texture information. To this end, OMRNDL adaptively learns an individual dictionary, i.e., template, for each modality from available frames, and then represents new particles over all the learned dictionaries by minimizing the fitting loss of data based on M-estimation. The resultant representation coefficient can be viewed as the common semantic representation of particles across multiple modalities, and can be utilized to track the target. OMRNDL incrementally learns the dictionary and the coefficient of each particle by using multiplicative update rules to respectively guarantee their non-negativity constraints. Experimental results on a popular challenging video benchmark validate the effectiveness of OMRNDL for visual tracking in both quantity and quality. PMID:25961715

  2. Eigenanatomy: sparse dimensionality reduction for multi-modal medical image analysis.

    Science.gov (United States)

    Kandel, Benjamin M; Wang, Danny J J; Gee, James C; Avants, Brian B

    2015-02-01

    Rigorous statistical analysis of multimodal imaging datasets is challenging. Mass-univariate methods for extracting correlations between image voxels and outcome measurements are not ideal for multimodal datasets, as they do not account for interactions between the different modalities. The extremely high dimensionality of medical images necessitates dimensionality reduction, such as principal component analysis (PCA) or independent component analysis (ICA). These dimensionality reduction techniques, however, consist of contributions from every region in the brain and are therefore difficult to interpret. Recent advances in sparse dimensionality reduction have enabled construction of a set of image regions that explain the variance of the images while still maintaining anatomical interpretability. The projections of the original data on the sparse eigenvectors, however, are highly collinear and therefore difficult to incorporate into multi-modal image analysis pipelines. We propose here a method for clustering sparse eigenvectors and selecting a subset of the eigenvectors to make interpretable predictions from a multi-modal dataset. Evaluation on a publicly available dataset shows that the proposed method outperforms PCA and ICA-based regressions while still maintaining anatomical meaning. To facilitate reproducibility, the complete dataset used and all source code is publicly available. Copyright © 2014 Elsevier Inc. All rights reserved.

  3. Visual tracking for multi-modality computer-assisted image guidance

    Science.gov (United States)

    Basafa, Ehsan; Foroughi, Pezhman; Hossbach, Martin; Bhanushali, Jasmine; Stolka, Philipp

    2017-03-01

    With optical cameras, many interventional navigation tasks previously relying on EM, optical, or mechanical guidance can be performed robustly, quickly, and conveniently. We developed a family of novel guidance systems based on wide-spectrum cameras and vision algorithms for real-time tracking of interventional instruments and multi-modality markers. These navigation systems support the localization of anatomical targets, support placement of imaging probe and instruments, and provide fusion imaging. The unique architecture - low-cost, miniature, in-hand stereo vision cameras fitted directly to imaging probes - allows for an intuitive workflow that fits a wide variety of specialties such as anesthesiology, interventional radiology, interventional oncology, emergency medicine, urology, and others, many of which see increasing pressure to utilize medical imaging and especially ultrasound, but have yet to develop the requisite skills for reliable success. We developed a modular system, consisting of hardware (the Optical Head containing the mini cameras) and software (components for visual instrument tracking with or without specialized visual features, fully automated marker segmentation from a variety of 3D imaging modalities, visual observation of meshes of widely separated markers, instant automatic registration, and target tracking and guidance on real-time multi-modality fusion views). From these components, we implemented a family of distinct clinical and pre-clinical systems (for combinations of ultrasound, CT, CBCT, and MRI), most of which have international regulatory clearance for clinical use. We present technical and clinical results on phantoms, ex- and in-vivo animals, and patients.

  4. Wearable Brain Imaging with Multi-Modal Physiological Recording.

    Science.gov (United States)

    Strangman, Gary E; Ivkovic, Vladimir; Zhang, Quan

    2017-07-13

    The brain is a central component of cognitive and physical human performance. Measures including functional brain activation, cerebral perfusion, cerebral oxygenation, evoked electrical responses, and resting hemodynamic and electrical activity are all related to, or can predict health status or performance decrements. However, measuring brain physiology typically requires large, stationary machines that are not suitable for mobile or self-monitoring. Moreover, when individuals are ambulatory, systemic physiological fluctuations-e.g., in heart rate, blood pressure, skin perfusion and more-can interfere with non-invasive brain measurements. In efforts to address the physiological monitoring and performance assessment needs for astronauts during spaceflight, we have developed easy-to-use, wearable prototypes- NINscan, for near-infrared scanning-that can collect synchronized multi-modal physiology data, including hemodynamic deep-tissue imaging (including brain and muscles), electroencephalography, electrocardiography, electromyography, electrooculography, accelerometry, gyroscopy, pressure, respiration and temperature measurements. Given their self-contained and portable nature, these devices can be deployed in a much broader range of settings-including austere environments-thereby enabling a wider range of novel medical and research physiology applications. We review these, including high-altitude assessments, self-deployable multi-modal e.g., (polysomnographic) recordings in remote or low-resource environments, fluid shifts in variable-gravity or spaceflight analog environments, intra-cranial brain motion during high-impact sports, and long-duration monitoring for clinical symptom-capture in various clinical conditions. In addition to further enhancing sensitivity and miniaturization, advanced computational algorithms could help support real-time feedback and alerts regarding performance and health. Copyright © 2017, Journal of Applied Physiology.

  5. Multi-modal myocontrol: Testing combined force- and electromyography.

    Science.gov (United States)

    Nowak, Markus; Eiband, Thomas; Castellini, Claudio

    2017-07-01

    Myocontrol, that is control of prostheses using bodily signals, has proved in the decades to be a surprisingly hard problem for the scientific community of assistive and rehabilitation robotics. In particular, traditional surface electromyography (sEMG) seems to be no longer enough to guarantee dexterity (i.e., control over several degrees of freedom) and, most importantly, reliability. Multi-modal myocontrol is concerned with the idea of using novel signal gathering techniques as a replacement of, or alongside, sEMG, to provide high-density and diverse signals to improve dexterity and make the control more reliable. In this paper we present an offline and online assessment of multi-modal sEMG and force myography (FMG) targeted at hand and wrist myocontrol. A total number of twenty sEMG and FMG sensors were used simultaneously, in several combined configurations, to predict opening/closing of the hand and activation of two degrees of freedom of the wrist of ten intact subjects. The analysis was targeted at determining the optimal sensor combination and control parameters; the experimental results indicate that sEMG sensors alone perform worst, yielding a nRMSE of 9.1%, while mixing FMG and sEMG or using FMG only reduces the nRMSE to 5.2-6.6%. To validate these results, we engaged the subject with median performance in an online goal-reaching task. Analysis of this further experiment reveals that the online behaviour is similar to the offline one.

  6. Automatic multi-modal intelligent seizure acquisition (MISA) system for detection of motor seizures from electromyographic data and motion data

    DEFF Research Database (Denmark)

    Conradsen, Isa; Beniczky, Sándor; Wolf, Peter

    2012-01-01

    measures of reconstructed sub-bands from the discrete wavelet transformation (DWT) and the wavelet packet transformation (WPT). Based on the extracted features all data segments were classified using a support vector machine (SVM) algorithm as simulated seizure or normal activity. A case study...... system compared to the uni-modal one. The presented system has a promising potential for seizure detection based on multi-modal data....

  7. Automatic quantification of multi-modal rigid registration accuracy using feature detectors.

    Science.gov (United States)

    Hauler, F; Furtado, H; Jurisic, M; Polanec, S H; Spick, C; Laprie, A; Nestle, U; Sabatini, U; Birkfellner, W

    2016-07-21

    In radiotherapy, the use of multi-modal images can improve tumor and target volume delineation. Images acquired at different times by different modalities need to be aligned into a single coordinate system by 3D/3D registration. State of the art methods for validation of registration are visual inspection by experts and fiducial-based evaluation. Visual inspection is a qualitative, subjective measure, while fiducial markers sometimes suffer from limited clinical acceptance. In this paper we present an automatic, non-invasive method for assessing the quality of intensity-based multi-modal rigid registration using feature detectors. After registration, interest points are identified on both image data sets using either speeded-up robust features or Harris feature detectors. The quality of the registration is defined by the mean Euclidean distance between matching interest point pairs. The method was evaluated on three multi-modal datasets: an ex vivo porcine skull (CT, CBCT, MR), seven in vivo brain cases (CT, MR) and 25 in vivo lung cases (CT, CBCT). Both a qualitative (visual inspection by radiation oncologist) and a quantitative (mean target registration error-mTRE-based on selected markers) method were employed. In the porcine skull dataset, the manual and Harris detectors give comparable results but both overestimated the gold standard mTRE based on fiducial markers. For instance, for CT-MR-T1 registration, the mTREman (based on manually annotated landmarks) was 2.2 mm whereas mTREHarris (based on landmarks found by the Harris detector) was 4.1 mm, and mTRESURF (based on landmarks found by the SURF detector) was 8 mm. In lung cases, the difference between mTREman and mTREHarris was less than 1 mm, while the difference between mTREman and mTRESURF was up to 3 mm. The Harris detector performed better than the SURF detector with a resulting estimated registration error close to the gold standard. Therefore the Harris detector was shown to be the more suitable

  8. Automatic quantification of multi-modal rigid registration accuracy using feature detectors

    Science.gov (United States)

    Hauler, F.; Furtado, H.; Jurisic, M.; Polanec, S. H.; Spick, C.; Laprie, A.; Nestle, U.; Sabatini, U.; Birkfellner, W.

    2016-07-01

    In radiotherapy, the use of multi-modal images can improve tumor and target volume delineation. Images acquired at different times by different modalities need to be aligned into a single coordinate system by 3D/3D registration. State of the art methods for validation of registration are visual inspection by experts and fiducial-based evaluation. Visual inspection is a qualitative, subjective measure, while fiducial markers sometimes suffer from limited clinical acceptance. In this paper we present an automatic, non-invasive method for assessing the quality of intensity-based multi-modal rigid registration using feature detectors. After registration, interest points are identified on both image data sets using either speeded-up robust features or Harris feature detectors. The quality of the registration is defined by the mean Euclidean distance between matching interest point pairs. The method was evaluated on three multi-modal datasets: an ex vivo porcine skull (CT, CBCT, MR), seven in vivo brain cases (CT, MR) and 25 in vivo lung cases (CT, CBCT). Both a qualitative (visual inspection by radiation oncologist) and a quantitative (mean target registration error—mTRE—based on selected markers) method were employed. In the porcine skull dataset, the manual and Harris detectors give comparable results but both overestimated the gold standard mTRE based on fiducial markers. For instance, for CT-MR-T1 registration, the mTREman (based on manually annotated landmarks) was 2.2 mm whereas mTREHarris (based on landmarks found by the Harris detector) was 4.1 mm, and mTRESURF (based on landmarks found by the SURF detector) was 8 mm. In lung cases, the difference between mTREman and mTREHarris was less than 1 mm, while the difference between mTREman and mTRESURF was up to 3 mm. The Harris detector performed better than the SURF detector with a resulting estimated registration error close to the gold standard. Therefore the Harris detector was shown to be the more suitable

  9. Development of Convergence Nanoparticles for Multi-Modal Bio-Medical Imaging

    Science.gov (United States)

    2008-09-18

    Multi-Modal Bio- Medical Imaging Key researchers: Jinwoo Cheon Affiliation: Department of Chemistry, Yonsei University Address: 134 Shinchon...01-02-2008 4. TITLE AND SUBTITLE Development of Convergence Nanoparticles for Multi-Modal Bio- Medical Imaging 5a. CONTRACT NUMBER FA48690714016

  10. Multi-Modal Reasoning Medical Diagnosis System Integrated With Probabilistic Reasoning

    Institute of Scientific and Technical Information of China (English)

    Jia Tian; Xun Chen; Sheng-Ping Dong

    2005-01-01

    In this paper, a Multi Modal Reasoning (MMR) method integrated with probabilistic reasoning is proposed for the diagnosis support module of the open eHealth platform. MMR is based on both Rule Based Reasoning (RBR) and Case Based Reasoning (CBR). It is not only applied to the identification of diseases and syndromes based on medical guidelines,but also deals with exceptional cases and individual therapies in order to improve diagnostic accuracy. Moreover, a new rule expression frame is introduced to deal with uncertainty, which can represent and process vague, imprecise, and incomplete information. Furthermore, this system is capable of updating the attributes of rules and inducing rules with a small data sample.

  11. Classification of first-episode psychosis: a multi-modal multi-feature approach integrating structural and diffusion imaging.

    Science.gov (United States)

    Peruzzo, Denis; Castellani, Umberto; Perlini, Cinzia; Bellani, Marcella; Marinelli, Veronica; Rambaldelli, Gianluca; Lasalvia, Antonio; Tosato, Sarah; De Santi, Katia; Murino, Vittorio; Ruggeri, Mirella; Brambilla, Paolo

    2015-06-01

    Currently, most of the classification studies of psychosis focused on chronic patients and employed single machine learning approaches. To overcome these limitations, we here compare, to our best knowledge for the first time, different classification methods of first-episode psychosis (FEP) using multi-modal imaging data exploited on several cortical and subcortical structures and white matter fiber bundles. 23 FEP patients and 23 age-, gender-, and race-matched healthy participants were included in the study. An innovative multivariate approach based on multiple kernel learning (MKL) methods was implemented on structural MRI and diffusion tensor imaging. MKL provides the best classification performances in comparison with the more widely used support vector machine, enabling the definition of a reliable automatic decisional system based on the integration of multi-modal imaging information. Our results show a discrimination accuracy greater than 90 % between healthy subjects and patients with FEP. Regions with an accuracy greater than 70 % on different imaging sources and measures were middle and superior frontal gyrus, parahippocampal gyrus, uncinate fascicles, and cingulum. This study shows that multivariate machine learning approaches integrating multi-modal and multisource imaging data can classify FEP patients with high accuracy. Interestingly, specific grey matter structures and white matter bundles reach high classification reliability when using different imaging modalities and indices, potentially outlining a prefronto-limbic network impaired in FEP with particular regard to the right hemisphere.

  12. Automatic multi-modal intelligent seizure acquisition (MISA) system for detection of motor seizures from electromyographic data and motion data.

    Science.gov (United States)

    Conradsen, Isa; Beniczky, Sándor; Wolf, Peter; Kjaer, Troels W; Sams, Thomas; Sorensen, Helge B D

    2012-08-01

    The objective is to develop a non-invasive automatic method for detection of epileptic seizures with motor manifestations. Ten healthy subjects who simulated seizures and one patient participated in the study. Surface electromyography (sEMG) and motion sensor features were extracted as energy measures of reconstructed sub-bands from the discrete wavelet transformation (DWT) and the wavelet packet transformation (WPT). Based on the extracted features all data segments were classified using a support vector machine (SVM) algorithm as simulated seizure or normal activity. A case study of the seizure from the patient showed that the simulated seizures were visually similar to the epileptic one. The multi-modal intelligent seizure acquisition (MISA) system showed high sensitivity, short detection latency and low false detection rate. The results showed superiority of the multi-modal detection system compared to the uni-modal one. The presented system has a promising potential for seizure detection based on multi-modal data. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

  13. Assessment of a multi-modal intervention for the prevention of catheter-associated urinary tract infections.

    Science.gov (United States)

    Ternavasio-de la Vega, H G; Barbosa Ventura, A; Castaño-Romero, F; Sauchelli, F D; Prolo Acosta, A; Rodríguez Alcázar, F J; Vicente Sánchez, A; Ruiz Antúnez, E; Marcos, M; Laso, J

    2016-10-01

    Catheter-associated urinary tract infections (CAUTIs) represent an important healthcare burden. To assess the effectiveness of an evidence-based multi-modal, multi-disciplinary intervention intended to improve outcomes by reducing the use of urinary catheters (UCs) and minimizing the incidence of CAUTIs in the internal medicine department of a university hospital. A multi-modal intervention was developed, including training sessions, urinary catheterization reminders, surveillance systems, and mechanisms for staff feedback of results. The frequency of UC use and incidence of CAUTIs were recorded in three-month periods before (P1) and during the intervention (P2). The catheterization rate decreased significantly during P2 [27.8% vs 16.9%; relative risk (RR): 0.61; 95% confidence interval (CI): 0.57-0.65]. We also observed a reduction in CAUTI risk (18.3 vs 9.8%; RR: 0.53; 95% CI: 0.30-0.93), a reduction in the CAUTI rate per 1000 patient-days [5.5 vs 2.8; incidence ratio (IR): 0.52; 95% CI: 0.28-0.94], and a non-significant decrease in the CAUTI rate per 1000 catheter-days (19.3 vs 16.9; IR: 0.85; 95% CI: 0.46-1.55). The multi-modal intervention was effective in reducing the catheterization rate and the frequency of CAUTIs. Copyright © 2016 The Healthcare Infection Society. Published by Elsevier Ltd. All rights reserved.

  14. The effectiveness of multi modal representation text books to improve student's scientific literacy of senior high school students

    Science.gov (United States)

    Zakiya, Hanifah; Sinaga, Parlindungan; Hamidah, Ida

    2017-05-01

    The results of field studies showed the ability of science literacy of students was still low. One root of the problem lies in the books used in learning is not oriented toward science literacy component. This study focused on the effectiveness of the use of textbook-oriented provisioning capability science literacy by using multi modal representation. The text books development method used Design Representational Approach Learning to Write (DRALW). Textbook design which was applied to the topic of "Kinetic Theory of Gases" is implemented in XI grade students of high school learning. Effectiveness is determined by consideration of the effect and the normalized percentage gain value, while the hypothesis was tested using Independent T-test. The results showed that the textbooks which were developed using multi-mode representation science can improve the literacy skills of students. Based on the size of the effect size textbooks developed with representation multi modal was found effective in improving students' science literacy skills. The improvement was occurred in all the competence and knowledge of scientific literacy. The hypothesis testing showed that there was a significant difference on the ability of science literacy between class that uses textbooks with multi modal representation and the class that uses the regular textbook used in schools.

  15. Tumor Lysing Genetically Engineered T Cells Loaded with Multi-Modal Imaging Agents

    Science.gov (United States)

    Bhatnagar, Parijat; Alauddin, Mian; Bankson, James A.; Kirui, Dickson; Seifi, Payam; Huls, Helen; Lee, Dean A.; Babakhani, Aydin; Ferrari, Mauro; Li, King C.; Cooper, Laurence J. N.

    2014-03-01

    Genetically-modified T cells expressing chimeric antigen receptors (CAR) exert anti-tumor effect by identifying tumor-associated antigen (TAA), independent of major histocompatibility complex. For maximal efficacy and safety of adoptively transferred cells, imaging their biodistribution is critical. This will determine if cells home to the tumor and assist in moderating cell dose. Here, T cells are modified to express CAR. An efficient, non-toxic process with potential for cGMP compliance is developed for loading high cell number with multi-modal (PET-MRI) contrast agents (Super Paramagnetic Iron Oxide Nanoparticles - Copper-64; SPION-64Cu). This can now be potentially used for 64Cu-based whole-body PET to detect T cell accumulation region with high-sensitivity, followed by SPION-based MRI of these regions for high-resolution anatomically correlated images of T cells. CD19-specific-CAR+SPIONpos T cells effectively target in vitro CD19+ lymphoma.

  16. The origin of human multi-modal communication.

    Science.gov (United States)

    Levinson, Stephen C; Holler, Judith

    2014-09-19

    One reason for the apparent gulf between animal and human communication systems is that the focus has been on the presence or the absence of language as a complex expressive system built on speech. But language normally occurs embedded within an interactional exchange of multi-modal signals. If this larger perspective takes central focus, then it becomes apparent that human communication has a layered structure, where the layers may be plausibly assigned different phylogenetic and evolutionary origins--especially in the light of recent thoughts on the emergence of voluntary breathing and spoken language. This perspective helps us to appreciate the different roles that the different modalities play in human communication, as well as how they function as one integrated system despite their different roles and origins. It also offers possibilities for reconciling the 'gesture-first hypothesis' with that of gesture and speech having evolved together, hand in hand--or hand in mouth, rather--as one system. © 2014 The Author(s) Published by the Royal Society. All rights reserved.

  17. Multi-modal vertebrae recognition using Transformed Deep Convolution Network.

    Science.gov (United States)

    Cai, Yunliang; Landis, Mark; Laidley, David T; Kornecki, Anat; Lum, Andrea; Li, Shuo

    2016-07-01

    Automatic vertebra recognition, including the identification of vertebra locations and naming in multiple image modalities, are highly demanded in spinal clinical diagnoses where large amount of imaging data from various of modalities are frequently and interchangeably used. However, the recognition is challenging due to the variations of MR/CT appearances or shape/pose of the vertebrae. In this paper, we propose a method for multi-modal vertebra recognition using a novel deep learning architecture called Transformed Deep Convolution Network (TDCN). This new architecture can unsupervisely fuse image features from different modalities and automatically rectify the pose of vertebra. The fusion of MR and CT image features improves the discriminativity of feature representation and enhances the invariance of the vertebra pattern, which allows us to automatically process images from different contrast, resolution, protocols, even with different sizes and orientations. The feature fusion and pose rectification are naturally incorporated in a multi-layer deep learning network. Experiment results show that our method outperforms existing detection methods and provides a fully automatic location+naming+pose recognition for routine clinical practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

  18. Multi-Modal Inference in Animacy Perception for Artificial Object

    Directory of Open Access Journals (Sweden)

    Kohske Takahashi

    2011-10-01

    Full Text Available Sometimes we feel animacy for artificial objects and their motion. Animals usually interact with environments through multiple sensory modalities. Here we investigated how the sensory responsiveness of artificial objects to the environment would contribute to animacy judgment for them. In a 90-s trial, observers freely viewed four objects moving in a virtual 3D space. The objects, whose position and motion were determined following Perlin-noise series, kept drifting independently in the space. Visual flashes, auditory bursts, or synchronous flashes and bursts appeared with 1–2 s intervals. The first object abruptly accelerated their motion just after visual flashes, giving an impression of responding to the flash. The second object responded to bursts. The third object responded to synchronous flashes and bursts. The forth object accelerated at a random timing independent of flashes and bursts. The observers rated how strongly they felt animacy for each object. The results showed that the object responding to the auditory bursts was rated as having weaker animacy compared to the other objects. This implies that sensory modality through which an object interacts with the environment may be a factor for animacy perception in the object and may serve as the basis of multi-modal and cross-modal inference of animacy.

  19. Creating multi-modal logistics centers: Prospect for development in Central Asia

    Directory of Open Access Journals (Sweden)

    Nodir Jumaniyazov

    2010-10-01

    Full Text Available All we have witnessed several summits of the so-called G-20 to overcome the crisis and attempt to delineate the ”look” of new rules of the emerging new world economic system. However, according to many experts, these rules will not be able to radically change the current system of economic relations, which is based on the processes of globalization and economic interpenetration of the world. One can list the many elements of the system. Among them, as a manifestation of a growing specialization of production, and deepening of cooperative relations in the world the special role is played by multi-modal logistics centers (MLC, of both regional and global concern. If stock and commodity exchanges are the link in the global economy, meanwhile a multimodal logistics centers serve as their practical and technical support.

  20. Using Multi-Modal 3D Contours and Their Relations for Vision and Robotics

    DEFF Research Database (Denmark)

    Baseski, Emre; Pugeault, Nicolas; Kalkan, Sinan

    2010-01-01

    In this work, we make use of 3D contours and relations between them (namely, coplanarity, cocolority, distance and angle) for four different applications in the area of computer vision and vision-based robotics. Our multi-modal contour representation covers both geometric and appearance information....... We show the potential of reasoning with global entities in the context of visual scene analysis for driver assistance, depth prediction, robotic grasping and grasp learning. We argue that, such 3D global reasoning processes complement widely-used 2D local approaches such as bag-of-features since 3D...... relations are invariant under camera transformations and 3D information can be directly linked to actions. We therefore stress the necessity of including both global and local features with different spatial dimensions within a representation. We also discuss the importance of an efficient use...

  1. A Distance Measure Comparison to Improve Crowding in Multi-Modal Problems.

    Energy Technology Data Exchange (ETDEWEB)

    D. Todd VOllmer; Terence Soule; Milos Manic

    2010-08-01

    Solving multi-modal optimization problems are of interest to researchers solving real world problems in areas such as control systems and power engineering tasks. Extensions of simple Genetic Algorithms, particularly types of crowding, have been developed to help solve these types of problems. This paper examines the performance of two distance measures, Mahalanobis and Euclidean, exercised in the processing of two different crowding type implementations against five minimization functions. Within the context of the experiments, empirical evidence shows that the statistical based Mahalanobis distance measure when used in Deterministic Crowding produces equivalent results to a Euclidean measure. In the case of Restricted Tournament selection, use of Mahalanobis found on average 40% more of the global optimum, maintained a 35% higher peak count and produced an average final best fitness value that is 3 times better.

  2. Multi-modal Person Localization And Emergency Detection Using The Kinect

    Directory of Open Access Journals (Sweden)

    Georgios Galatas

    2013-01-01

    Full Text Available Person localization is of paramount importance in an ambient intelligence environment since it is the first step towards context-awareness. In this work, we present the development of a novel system for multi-modal person localization and emergency detection in an assistive ambient intelligence environment for the elderly. Our system is based on the depth sensor and microphone array of 2 Kinect devices. We use skeletal tracking conducted on the depth images and sound source localization conducted on the captured audio signal to estimate the location of a person. In conjunction with the location information, automatic speech recognition is used as a natural and intuitive means of communication in order to detect emergencies and accidents, such as falls. Our system attained high accuracy for both the localization and speech recognition tasks, verifying its effectiveness.

  3. Development of Advanced Multi-Modality Radiation Treatment Planning Software for Neutron Radiotherapy and Beyond

    Energy Technology Data Exchange (ETDEWEB)

    Nigg, D; Wessol, D; Wemple, C; Harkin, G; Hartmann-Siantar, C

    2002-08-20

    The Idaho National Engineering and Environmental Laboratory (INEEL) has long been active in development of advanced Monte-Carlo based computational dosimetry and treatment planning methods and software for advanced radiotherapy, with a particular focus on Neutron Capture Therapy (NCT) and, to a somewhat lesser extent, Fast-Neutron Therapy. The most recent INEEL software system of this type is known as SERA, Simulation Environment for Radiotherapy Applications. As a logical next step in the development of modern radiotherapy planning tools to support the most advanced research, INEEL and Lawrence Livermore National Laboratory (LLNL), the developers of the PEREGRTNE computational engine for radiotherapy treatment planning applications, have recently launched a new project to collaborate in the development of a ''next-generation'' multi-modality treatment planning software system that will be useful for all modern forms of radiotherapy.

  4. 77 FR 20097 - Intent To Prepare an Environmental Impact Statement for the Georgia Multi-Modal Passenger Terminal

    Science.gov (United States)

    2012-04-03

    ... surrounding destinations and districts from one another. The purpose of the Georgia Multi-modal Passenger... environment. 4. Alternatives FTA and GDOT will consider all reasonable alternatives to provide a multi-modal... horizon. The Build alternatives will involve construction of a new multi-modal transit terminal and...

  5. Deformable registration of multi-modal data including rigid structures

    Energy Technology Data Exchange (ETDEWEB)

    Huesman, Ronald H.; Klein, Gregory J.; Kimdon, Joey A.; Kuo, Chaincy; Majumdar, Sharmila

    2003-05-02

    Multi-modality imaging studies are becoming more widely utilized in the analysis of medical data. Anatomical data from CT and MRI are useful for analyzing or further processing functional data from techniques such as PET and SPECT. When data are not acquired simultaneously, even when these data are acquired on a dual-imaging device using the same bed, motion can occur that requires registration between the reconstructed image volumes. As the human torso can allow non-rigid motion, this type of motion should be estimated and corrected. We report a deformation registration technique that utilizes rigid registration for bony structures, while allowing elastic transformation of soft tissue to more accurately register the entire image volume. The technique is applied to the registration of CT and MR images of the lumbar spine. First a global rigid registration is performed to approximately align features. Bony structures are then segmented from the CT data using semi-automated process, and bounding boxes for each vertebra are established. Each CT subvolume is then individually registered to the MRI data using a piece-wise rigid registration algorithm and a mutual information image similarity measure. The resulting set of rigid transformations allows for accurate registration of the parts of the CT and MRI data representing the vertebrae, but not the adjacent soft tissue. To align the soft tissue, a smoothly-varying deformation is computed using a thin platespline(TPS) algorithm. The TPS technique requires a sparse set of landmarks that are to be brought into correspondence. These landmarks are automatically obtained from the segmented data using simple edge-detection techniques and random sampling from the edge candidates. A smoothness parameter is also included in the TPS formulation for characterization of the stiffness of the soft tissue. Estimation of an appropriate stiffness factor is obtained iteratively by using the mutual information cost function on the result

  6. Multi-modal ECG Holter system for sleep-disordered breathing screening: a validation study.

    Science.gov (United States)

    Poupard, Laurent; Mathieu, Marc; Goldman, Michael; Chouchou, Florian; Roche, Frédéric

    2012-09-01

    The high prevalence of sleep disordered breathing (SDB) among heart diseases patients becomes increasingly recognized. A reliable exploring tool of SDB well adapted to cardiologists practice would be very useful for the management of these patients. We assessed a novel multi-modal electrocardiogram (ECG) Holter which incorporated both thoracic impedance and pulse oximetry signals. We compared in a home setting, a standard condition for Holter recordings, results from the novel device to a classical ambulatory polygraph in subjects with suspected SDB. The analysis of cardiac arrhythmias in relationship with SDB is also presented. A total of 118 patients clinically suspected of having SDB were evaluated (mean age 57 ± 14 years, mean body mass index [BMI] 32 ± 6 kg/m(2)). The new device allows calculating a new index called thoracic impedance (TI) disturbance index (TIDI+) evaluated from TI and SpO(2) signals recorded from a Holter monitor. In the population under study, 93% had more than 70% of usable TI signal and 95% had more than 90% for SpO(2) during sleep time recording. Screening performance results based on automatic analysis is accurate: TIDI + demonstrates a high level of sensitivity (96.8%), specificity (72.3%) as well as positive (82.4%) and negative (94.4%) predictive value for the detection of SDB. Moreover, detection of SDB periods permits us to observe a possible respiratory association of several nocturnal arrhythmias. The multi-modal Holter should be considered as a valuable evaluating tool for SDB screening and as a case selection technique for facilitating access to a full polysomnography for severe cases. Moreover, it offers a unique opportunity to study arrhythmia consequences with both respiratory and hypoxia disturbances.

  7. FULLY CONVOLUTIONAL NETWORKS FOR MULTI-MODALITY ISOINTENSE INFANT BRAIN IMAGE SEGMENTATION.

    Science.gov (United States)

    Nie, Dong; Wang, Li; Gao, Yaozong; Shen, Dinggang

    The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development. In the isointense phase (approximately 6-8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, resulting in extremely low tissue contrast and thus making the tissue segmentation very challenging. The existing methods for tissue segmentation in this isointense phase usually employ patch-based sparse labeling on single T1, T2 or fractional anisotropy (FA) modality or their simply-stacked combinations without fully exploring the multi-modality information. To address the challenge, in this paper, we propose to use fully convolutional networks (FCNs) for the segmentation of isointense phase brain MR images. Instead of simply stacking the three modalities, we train one network for each modality image, and then fuse their high-layer features together for final segmentation. Specifically, we conduct a convolution-pooling stream for multimodality information from T1, T2, and FA images separately, and then combine them in high-layer for finally generating the segmentation maps as the outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense phase brain images. Results showed that our proposed model significantly outperformed previous methods in terms of accuracy. In addition, our results also indicated a better way of integrating multi-modality images, which leads to performance improvement.

  8. A New Multi-Robot Task Allocation Algorithm Based on Multi-Modality Synthesis%多模态融合的多机器人任务分配算法研究

    Institute of Scientific and Technical Information of China (English)

    段俊花; 朱怡安; 黄姝娟; 陆伟

    2013-01-01

    In distributed task allocation , it is hard to balance three problems:conflict, solution quality and solving price .Multimodal synthesis method is put forward for multi-robot distributed and self-organized task allocation . Three models of cooperation mechanism are combined; these three models are conflict problem , which is implicit cooperation mechanism based on pheromone , implicit task allocation realized by threshold method based on robot visual sense , and explicit task allocation based on improved contract net mechanism .The experiment results and their analysis show preliminarily that multimodal synthesis method can expand the scope of the robot perception , improve the system reliability , resolve the conflict problem by less communication , and improve the task execution efficiency .%针对分布式任务分配中的资源竞争冲突问题以及解的质量和求解代价难以协调的问题,提出了一种基于多模态融合的多机器人分布式自组织任务分配算法。它将基于信息素的隐式交互机制、基于视觉的阈值模型任务分配机制和基于通信的显式协商协调机制等相结合,实现了未知环境下多机器人系统的多模态分布式自组织任务分配。仿真实验结果表明,多模态融合技术扩大了机器人的感知范围,提高了系统可靠性,而且在较少通信的情况下,有效解决了任务分配冲突问题,提高了任务执行效率。

  9. Traffic sign recognition algorithm design based on multi-modal representation%基于多模型表示的交通标志识别算法设计

    Institute of Scientific and Technical Information of China (English)

    谷明琴; 蔡自兴; 李仪; 任孝平

    2013-01-01

    The image segmentation based on transforming RGB color space and the shape classifier based on signature feature are used to detect traffic signs in urban scenes. For improving recognition accuracy, two modal representations are presented to classify the traffic sign. 1) The feature of traffic sign is extracted by dual-tree complex wavelet transform(DT-CWT) and 2D independent component analysis(2DICA), then sent to the nearest neighbor classifier to classify traffic sign. 2) The template matching based on intra pictograms of traffic sign is applied to recognition. The recognition results are fused by some decision rules. Experimental results show that, the overall recognition rate of the proposed algorithm is more than 91% and the average frame rate is up to 6.6fps, which indicates that the system is robust, effective and accurate to classify traffic signs.%  通过变换 RGB 空间颜色值并分割图像,利用标记图为特征的形状分类器检测城市环境中的交通标志.为了提高分类准确度,用两种模型表示方法分类交通标志:1)结合二元树复小波变换和二维独立分量分析提取特征,送入最近邻分类器中分类交通标志;2)提取交通标志的内部图形,利用模板匹配进行分类.最后,将两种分类结果融合输出.实验结果表明,所提出算法的整体识别率超过91%,平均处理帧率达到6.6帧/s,系统能够鲁棒、有效和实时地识别交通标志.

  10. Multi-Modal Intelligent Traffic Signal Systems Vehicle Trajectories for Roadside Equipment

    Data.gov (United States)

    Department of Transportation — Data were collected during the Multi-Modal Intelligent Transportation Signal Systems (MMITSS) study. MMITSS is a next-generation traffic signal system that seeks to...

  11. Multi-Modal Intelligent Traffic Signal Systems Signal Plans for Roadside Equipment

    Data.gov (United States)

    Department of Transportation — Data were collected during the Multi-Modal Intelligent Transportation Signal Systems (MMITSS) study. MMITSS is a next-generation traffic signal system that seeks to...

  12. Computer Based Behavioral Biometric Authentication via Multi-Modal Fusion

    Science.gov (United States)

    2013-03-01

    Time (ms) X Y Event file:///I|/My%20Documents/My%20Pictures/New%20Text%20Document%20(2).txt[1/28/2013 10:32:16 AM] INWORD.EXE Micr soft Word...Document 842991521 Keydown m INWORD.EXE Micr soft Word Document 842991599 Keyup m INWORD.EXE Microsoft Word Document 1842991630

  13. Rapid multi-modality preregistration based on SIFT descriptor.

    Science.gov (United States)

    Chen, Jian; Tian, Jie

    2006-01-01

    This paper describes the scale invariant feature transform (SIFT) method for rapid preregistration of medical image. This technique originates from Lowe's method wherein preregistration is achieved by matching the corresponding keypoints between two images. The computational complexity has been reduced when we applied SIFT preregistration method before refined registration due to its O(n) exponential calculations. The features of SIFT are highly distinctive and invariant to image scaling and rotation, and partially invariant to change in illumination and contrast, it is robust and repeatable for cursorily matching two images. We also altered the descriptor so our method can deal with multimodality preregistration.

  14. Android Based Behavioral Biometric Authentication via Multi-Modal Fusion

    Science.gov (United States)

    2014-06-12

    gesture detector constructor . The Android framework is written in Java and all parts of the gesture collection used Java PrintWriters. An example of...and FRR values less than 2%, would maintain authentication with minimal requests for the user to manually authenticate 5.1 Final Thoughts Previous...Gesture Constructor , Time, currSpanX, currSpanY, FocusX,FocusY 43 Appendix B: Tasks Given to Participants 44 Samsung Galaxy S4 Usage Collection (Warning

  15. Multi-modal Virtual Scenario Enhances Neurofeedback Learning

    Directory of Open Access Journals (Sweden)

    Avihay Cohen

    2016-08-01

    Full Text Available In the past decade neurofeedback has become the focus of a growing body of research. With real-time fMRI enabling on-line monitoring of emotion related areas such as the amygdala, many have begun testing its therapeutic benefits. However most existing neurofeedback procedures still use monotonic uni-modal interfaces, thus possibly limiting user engagement and weakening learning efficiency. The current study tested a novel multi-sensory neurofeedback animated scenario aimed at enhancing user experience and improving learning. We examined whether relative to a simple uni-modal 2D interface, learning via an interface of complex multi-modal 3D scenario will result in improved neurofeedback learning. As a neural-probe, we used the recently developed fMRI-inspired EEG model of amygdala activity (amygdala-EEG finger print; amygdala-EFP, enabling low-cost and mobile limbic neurofeedback training. Amygdala-EFP was reflected in the animated scenario by the unrest level of a hospital waiting-room in which virtual characters become impatient, approach the admission-desk and complain loudly. Successful down-regulation was reflected as an ease in the room unrest-level. We tested whether relative to a standard uni-modal 2D graphic thermometer interface, this animated scenario could facilitate more effective learning and improve the training experience. Thirty participants underwent two separated neurofeedback sessions (one-week apart practicing down-regulation of the amygdala-EFP signal. In the first session, half trained via the animated scenario and half via a thermometer interface. Learning efficiency was tested by three parameters: (a effect-size of the change in amygdala-EFP following training, (b sustainability of the learned down-regulation in the absence of online feedback, and (c transferability to an unfamiliar context. Comparing amygdala-EFP signal amplitude between the last and the first neurofeedback trials revealed that the animated scenario

  16. A step-wise approach to define binding mechanisms of surrogate viral particles to multi-modal anion exchange resin in a single solute system.

    Science.gov (United States)

    Brown, Matthew R; Johnson, Sarah A; Brorson, Kurt A; Lute, Scott C; Roush, David J

    2017-07-01

    Multi-modal anion exchange resins combine properties of both anion exchange and hydrophobic interaction chromatography for commercial protein polishing and may provide some viral clearance as well. From a regulatory viral clearance claim standpoint, it is unclear if multi-modal resins are truly orthogonal to either single-mode anion exchange or hydrophobic interaction columns. To answer this, a strategy of solute surface assays and High Throughput Screening of resin in concert with a scale-down model of large scale chromatography purification was employed to determine the predominant binding mechanisms of a panel of bacteriophage (i.e., PR772, PP7, and ϕX174) to multi-modal and single mode resins under various buffer conditions. The buffer conditions were restricted to buffer environments suggested by the manufacturer for the multi-modal resin. Each phage was examined for estimated net charge expression and relative hydrophobicity using chromatographic based methods. Overall, PP7 and PR772 bound to the multimodal resin via both anionic and hydrophobic moieties, while ϕX174 bound predominantly by the anionic moiety. Biotechnol. Bioeng. 2017;114: 1487-1494. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

  17. Nano-sensitizers for multi-modality optical diagnostic imaging and therapy of cancer

    Science.gov (United States)

    Olivo, Malini; Lucky, Sasidharan S.; Bhuvaneswari, Ramaswamy; Dendukuri, Nagamani

    2011-07-01

    We report novel bioconjugated nanosensitizers as optical and therapeutic probes for the detection, monitoring and treatment of cancer. These nanosensitisers, consisting of hypericin loaded bioconjugated gold nanoparticles, can act as tumor cell specific therapeutic photosensitizers for photodynamic therapy coupled with additional photothermal effects rendered by plasmonic heating effects of gold nanoparticles. In addition to the therapeutic effects, the nanosensitizer can be developed as optical probes for state-of-the-art multi-modality in-vivo optical imaging technology such as in-vivo 3D confocal fluorescence endomicroscopic imaging, optical coherence tomography (OCT) with improved optical contrast using nano-gold and Surface Enhanced Raman Scattering (SERS) based imaging and bio-sensing. These techniques can be used in tandem or independently as in-vivo optical biopsy techniques to specifically detect and monitor specific cancer cells in-vivo. Such novel nanosensitizer based optical biopsy imaging technique has the potential to provide an alternative to tissue biopsy and will enable clinicians to make real-time diagnosis, determine surgical margins during operative procedures and perform targeted treatment of cancers.

  18. Modeling a Multi-modal Distribution of Wind Direction Data in Kudat, Malaysia

    Directory of Open Access Journals (Sweden)

    Nurulkamal Masseran

    2015-08-01

    Full Text Available Wind direction is the direction from which the wind is blowing. It is expressed in terms of degrees measured clockwise from geographical direction. The knowledge of the wind direction can be used to obtain information about the wind energy potential, dispersion of particulate matter in the air, the effects of engineering structures on the building, maritime study, and etc. This study provides a suitable model for the wind direction that indicates multi-modal distributional properties. A case study involves with a data from Kudat, Malaysia has been analysed. The statistical models known as a Finite Mixture of von Mises Fisher (mvMF and Circular Distribution based on Nonnegative Trigonometric Sums (NNTS has been fitted to the data. Then, the suitability of mvMF and NNTS models were judged based on a graphical representation and goodness-of-fit statistics. The results found that the mvMF model with  components is sufficient to provide a best model. 

  19. Structured and Sparse Canonical Correlation Analysis as a Brain-Wide Multi-Modal Data Fusion Approach.

    Science.gov (United States)

    Mohammadi-Nejad, Ali-Reza; Hossein-Zadeh, Gholam-Ali; Soltanian-Zadeh, Hamid

    2017-07-01

    Multi-modal data fusion has recently emerged as a comprehensive neuroimaging analysis approach, which usually uses canonical correlation analysis (CCA). However, the current CCA-based fusion approaches face problems like high-dimensionality, multi-collinearity, unimodal feature selection, asymmetry, and loss of spatial information in reshaping the imaging data into vectors. This paper proposes a structured and sparse CCA (ssCCA) technique as a novel CCA method to overcome the above problems. To investigate the performance of the proposed algorithm, we have compared three data fusion techniques: standard CCA, regularized CCA, and ssCCA, and evaluated their ability to detect multi-modal data associations. We have used simulations to compare the performance of these approaches and probe the effects of non-negativity constraint, the dimensionality of features, sample size, and noise power. The results demonstrate that ssCCA outperforms the existing standard and regularized CCA-based fusion approaches. We have also applied the methods to real functional magnetic resonance imaging (fMRI) and structural MRI data of Alzheimer's disease (AD) patients (n = 34) and healthy control (HC) subjects (n = 42) from the ADNI database. The results illustrate that the proposed unsupervised technique differentiates the transition pattern between the subject-course of AD patients and HC subjects with a p-value of less than 1×10(-6) . Furthermore, we have depicted the brain mapping of functional areas that are most correlated with the anatomical changes in AD patients relative to HC subjects.

  20. Anticipation by multi-modal association through an artificial mental imagery process

    Science.gov (United States)

    Gaona, Wilmer; Escobar, Esaú; Hermosillo, Jorge; Lara, Bruno

    2015-01-01

    Mental imagery has become a central issue in research laboratories seeking to emulate basic cognitive abilities in artificial agents. In this work, we propose a computational model to produce an anticipatory behaviour by means of a multi-modal off-line hebbian association. Unlike the current state of the art, we propose to apply hebbian learning during an internal sensorimotor simulation, emulating a process of mental imagery. We associate visual and tactile stimuli re-enacted by a long-term predictive simulation chain motivated by covert actions. As a result, we obtain a neural network which provides a robot with a mechanism to produce a visually conditioned obstacle avoidance behaviour. We developed our system in a physical Pioneer 3-DX robot and realised two experiments. In the first experiment we test our model on one individual navigating in two different mazes. In the second experiment we assess the robustness of the model by testing in a single environment five individuals trained under different conditions. We believe that our work offers an underpinning mechanism in cognitive robotics for the study of motor control strategies based on internal simulations. These strategies can be seen analogous to the mental imagery process known in humans, opening thus interesting pathways to the construction of upper-level grounded cognitive abilities.

  1. Interactive Feature Space Explorer© for multi-modal magnetic resonance imaging.

    Science.gov (United States)

    Özcan, Alpay; Türkbey, Barış; Choyke, Peter L; Akin, Oguz; Aras, Ömer; Mun, Seong K

    2015-07-01

    Wider information content of multi-modal biomedical imaging is advantageous for detection, diagnosis and prognosis of various pathologies. However, the necessity to evaluate a large number images might hinder these advantages and reduce the efficiency. Herein, a new computer aided approach based on the utilization of feature space (FS) with reduced reliance on multiple image evaluations is proposed for research and routine clinical use. The method introduces the physician experience into the discovery process of FS biomarkers for addressing biological complexity, e.g., disease heterogeneity. This, in turn, elucidates relevant biophysical information which would not be available when automated algorithms are utilized. Accordingly, the prototype platform was designed and built for interactively investigating the features and their corresponding anatomic loci in order to identify pathologic FS regions. While the platform might be potentially beneficial in decision support generally and specifically for evaluating outlier cases, it is also potentially suitable for accurate ground truth determination in FS for algorithm development. Initial assessments conducted on two different pathologies from two different institutions provided valuable biophysical perspective. Investigations of the prostate magnetic resonance imaging data resulted in locating a potential aggressiveness biomarker in prostate cancer. Preliminary findings on renal cell carcinoma imaging data demonstrated potential for characterization of disease subtypes in the FS. Copyright © 2015 Elsevier Inc. All rights reserved.

  2. Multi-scale patch and multi-modality atlases for whole heart segmentation of MRI.

    Science.gov (United States)

    Zhuang, Xiahai; Shen, Juan

    2016-07-01

    A whole heart segmentation (WHS) method is presented for cardiac MRI. This segmentation method employs multi-modality atlases from MRI and CT and adopts a new label fusion algorithm which is based on the proposed multi-scale patch (MSP) strategy and a new global atlas ranking scheme. MSP, developed from the scale-space theory, uses the information of multi-scale images and provides different levels of the structural information of images for multi-level local atlas ranking. Both the local and global atlas ranking steps use the information theoretic measures to compute the similarity between the target image and the atlases from multiple modalities. The proposed segmentation scheme was evaluated on a set of data involving 20 cardiac MRI and 20 CT images. Our proposed algorithm demonstrated a promising performance, yielding a mean WHS Dice score of 0.899 ± 0.0340, Jaccard index of 0.818 ± 0.0549, and surface distance error of 1.09 ± 1.11 mm for the 20 MRI data. The average runtime for the proposed label fusion was 12.58 min.

  3. Multi-modal, ultrasensitive detection of trace explosives using MEMS devices with quantum cascade lasers

    Science.gov (United States)

    Zandieh, Omid; Kim, Seonghwan

    2016-05-01

    Multi-modal chemical sensors based on microelectromechanical systems (MEMS) have been developed with an electrical readout. Opto-calorimetric infrared (IR) spectroscopy, capable of obtaining molecular signatures of extremely small quantities of adsorbed explosive molecules, has been realized with a microthermometer/microheater device using a widely tunable quantum cascade laser. A microthermometer/microheater device responds to the heat generated by nonradiative decay process when the adsorbed explosive molecules are resonantly excited with IR light. Monitoring the variation in microthermometer signal as a function of illuminating IR wavelength corresponds to the conventional IR absorption spectrum of the adsorbed molecules. Moreover, the mass of the adsorbed molecules is determined by measuring the resonance frequency shift of the cantilever shape microthermometer for the quantitative opto-calorimetric IR spectroscopy. In addition, micro-differential thermal analysis, which can be used to differentiate exothermic or endothermic reaction of heated molecules, has been performed with the same device to provide additional orthogonal signal for trace explosive detection and sensor surface regeneration. In summary, we have designed, fabricated and tested microcantilever shape devices integrated with a microthermometer/microheater which can provide electrical responses used to acquire both opto-calorimetric IR spectra and microcalorimetric thermal responses. We have demonstrated the successful detection, differentiation, and quantification of trace amounts of explosive molecules and their mixtures (cyclotrimethylene trinitramine (RDX) and pentaerythritol tetranitrate (PETN)) using three orthogonal sensing signals which improve chemical selectivity.

  4. A software framework for real-time multi-modal detection of microsleeps.

    Science.gov (United States)

    Knopp, Simon J; Bones, Philip J; Weddell, Stephen J; Jones, Richard D

    2017-06-01

    A software framework is described which was designed to process EEG, video of one eye, and head movement in real time, towards achieving early detection of microsleeps for prevention of fatal accidents, particularly in transport sectors. The framework is based around a pipeline structure with user-replaceable signal processing modules. This structure can encapsulate a wide variety of feature extraction and classification techniques and can be applied to detecting a variety of aspects of cognitive state. Users of the framework can implement signal processing plugins in C++ or Python. The framework also provides a graphical user interface and the ability to save and load data to and from arbitrary file formats. Two small studies are reported which demonstrate the capabilities of the framework in typical applications: monitoring eye closure and detecting simulated microsleeps. While specifically designed for microsleep detection/prediction, the software framework can be just as appropriately applied to (i) other measures of cognitive state and (ii) development of biomedical instruments for multi-modal real-time physiological monitoring and event detection in intensive care, anaesthesiology, cardiology, neurosurgery, etc. The software framework has been made freely available for researchers to use and modify under an open source licence.

  5. Multi-modality image reconstruction for dual-head small-animal PET

    Energy Technology Data Exchange (ETDEWEB)

    Huang, Chang-Han; Chou, Cheng-Ying [National Taiwan University, Taipei, Taiwan (China)

    2015-05-18

    The hybrid positron emission tomography/computed tomography (PET/CT) or positron emission tomography/magnetic resonance imaging (PET/MRI) has become routine practice in clinics. The applications of multi-modality imaging can also benefit research advances. Consequently, dedicated small-imaging system like dual-head small-animal PET (DHAPET) that possesses the advantages of high detection sensitivity and high resolution can exploit the structural information from CT or MRI. It should be noted that the special detector arrangement in DHAPET leads to severe data truncation, thereby degrading the image quality. We proposed to take advantage of anatomical priors and total variation (TV) minimization methods to reconstruct PET activity distribution form incomplete measurement data. The objective is to solve the penalized least-squares function consisted of data fidelity term, TV norm and medium root priors. In this work, we employed the splitting-based fast iterative shrinkage/thresholding algorithm to split smooth and non-smooth functions in the convex optimization problems. Our simulations studies validated that the images reconstructed by use of the proposed method can outperform those obtained by use of conventional expectation maximization algorithms or that without considering the anatomical prior information. Additionally, the convergence rate is also accelerated.

  6. Common and uncommon vascular rings and slings: a multi-modality review

    Energy Technology Data Exchange (ETDEWEB)

    Dillman, Jonathan R.; Agarwal, Prachi P.; Hernandez, Ramiro J.; Strouse, Peter J. [University of Michigan Health System, C.S. Mott Children' s Hospital, Department of Radiology, Section of Pediatric Radiology, Ann Arbor, MI (United States); Attili, Anil K. [University of Kentucky College of Medicine, Department of Radiology, Lexington, KY (United States); Dorfman, Adam L. [University of Michigan Health System, C.S. Mott Children' s Hospital, Department of Radiology, Section of Pediatric Radiology, Ann Arbor, MI (United States); University of Michigan Health System, C.S. Mott Children' s Hospital, Department of Pediatrics and Communicable Diseases, Division of Pediatric Cardiology, Ann Arbor, MI (United States)

    2011-11-15

    Vascular rings and pulmonary slings are congenital anomalies of the aortic arch/great vessels and pulmonary arteries, respectively, that commonly present early during infancy and childhood with respiratory and/or feeding difficulties. The diagnosis of these conditions frequently utilizes a multi-modality radiological approach, commonly utilizing some combination of radiography, esophagography, CT angiography and MR angiography. The purpose of this pictorial review is to illustrate the radiological findings of common and uncommon vascular rings and pulmonary slings in children using a state-of-the-art multi-modality imaging approach. (orig.)

  7. Multi-modal intervention improved oral intake in hospitalized patients. A one year follow-up study.

    Science.gov (United States)

    Holst, M; Beermann, T; Mortensen, M N; Skadhauge, L B; Lindorff-Larsen, K; Rasmussen, H H

    2015-04-01

    Good nutritional practice (GNP) includes screening, nutrition plan and monitoring, and is mandatory for targeted treatment of malnourished patients in hospital. To optimize energy- and protein-intake in patients at nutritional risk and to improve GNP in a hospital setting. A 12-months observational multi-modal intervention study was done, using the top-down and bottom-up principle. All hospitalized patients (>3 days) were included. A university hospital with 758 beds and all specialities. Record audit of GNP, energy- and protein-intake by 24-h recall, patient interviews and staff questionnaire before and after the intervention. Based on pre-measurements, nutrition support teams in each department made targeted action plans, supervised by an expert team. Education, diagnose-specific nutrition plans, improved menus and eating environment, and awareness were initiated. Mann-Whitney and Kruskal-Wallis test was used for ordinal data, and Pearson Chi square test for nominative data. Overall 545 patients participated (287 before/258 after) from 26/22 departments. There were no significant differences regarding sex, age, BMI or previous weight loss before and after the intervention. Result-indicators: Energy intake improved from 52% to 68% (p 75% of requirements). Intake of less than 50% of requirements decreased with 50%. Process-indicators: Screening improved from 56% to 77% (p multi-modal top-down and bottom-up approach. Copyright © 2014 Elsevier Ltd and European Society for Clinical Nutrition and Metabolism. All rights reserved.

  8. Non-invasive image-guided laser microsurgery by a dual-wavelength fiber laser and an integrated fiber-optic multi-modal system.

    Science.gov (United States)

    Tsai, Meng-Tsan; Li, Dean-Ru; Chan, Ming-Che

    2016-10-15

    A new approach to non-invasive image-guided laser micro-treatment is demonstrated by a dual-wavelength fiber laser source and an integrated fiber-based multi-modal system. The fiber-based source, operated in 1.55 and 1.2 μm simultaneously, was directly connected to an integrated fiber-based multi-modal system for imaging and laser micro-treatment at the same time. The 1.2 μm radiations, within the 1.2-1.35 μm bio-penetration window of skin, were utilized for spectral domain optical coherence tomography imaging. The 1.55 μm radiations, highly absorptive to waters, were utilized for laser microsurgery. The new approach, which is simple in configuration and accurately controls the positions and exposure time of the laser microsurgery, shows great promises for future clinical applications.

  9. Use of different exposure metrics for understanding multi-modal travel injury risk

    Directory of Open Access Journals (Sweden)

    S. Ilgin Guler

    2016-08-01

    Full Text Available The objective of this work is to identify characteristics of different metrics of exposure for quantifying multi-modal travel injury risk. First, a discussion on the use of time-based and trip-based metrics for road user exposure to injury risk, considering multiple travel modes, is presented. The main difference between a time-based and trip-based metric is argued to be that a time-based metric reflects the actual duration of time spent on the road exposed to the travel risks. This can be proven to be important when considering multiple modes since different modes typically different speeds and average travel distances. Next, the use of total number of trips, total time traveled, and mode share (time-based or trip-based is considered to compare the injury risk of a given mode at different locations. It is argued that using mode share the safety concept which focuses on absolute numbers can be generalized. Quantitative results are also obtained from combining travel survey data with police collision reports for ten counties in California. The data are aggregated for five modes: (i cars, (ii SUVs, (iii transit riders, (iv bicyclists, and (v pedestrians. These aggregated data are used to compare travel risk of different modes with time-based or trip-based exposure metrics. These quantitative results confirm the initial qualitative discussions. As the penetration of mobile probes for transportation data collection increases, the insights of this study can provide guidance on how to best utilize the added value of such data to better quantify travel injury risk, and improve safety.

  10. (In)Flexibility of Constituency in Japanese in Multi-Modal Categorial Grammar with Structured Phonology

    Science.gov (United States)

    Kubota, Yusuke

    2010-01-01

    This dissertation proposes a theory of categorial grammar called Multi-Modal Categorial Grammar with Structured Phonology. The central feature that distinguishes this theory from the majority of contemporary syntactic theories is that it decouples (without completely segregating) two aspects of syntax--hierarchical organization (reflecting…

  11. A Multi-Modal Active Learning Experience for Teaching Social Categorization

    Science.gov (United States)

    Schwarzmueller, April

    2011-01-01

    This article details a multi-modal active learning experience to help students understand elements of social categorization. Each student in a group dynamics course observed two groups in conflict and identified examples of in-group bias, double-standard thinking, out-group homogeneity bias, law of small numbers, group attribution error, ultimate…

  12. Multi-criteria appraisal of multi-modal urban public transport systems

    NARCIS (Netherlands)

    Keyvan Ekbatani, M.; Cats, O.

    2015-01-01

    This study proposes a multi-criteria decision making (MCDM) modelling framework for the appraisal of multi-modal urban public transportation services. MCDM is commonly used to obtain choice alternatives that satisfy a range of performance indicators. The framework embraces both compensatory and

  13. Conceptual Coherence Revealed in Multi-Modal Representations of Astronomy Knowledge

    Science.gov (United States)

    Blown, Eric; Bryce, Tom G. K.

    2010-01-01

    The astronomy concepts of 345 young people were studied over a 10-year period using a multi-media, multi-modal methodology in a research design where survey participants were interviewed three times and control subjects were interviewed twice. The purpose of the research was to search for evidence to clarify competing theories on "conceptual…

  14. Dispersive multi-modal mud-roll estimation and removal using feedback-loop approach

    NARCIS (Netherlands)

    Ishiyama, T.; Blacquiere, G.

    2013-01-01

    In a shallow water environment, mud-rolls are often dominant and appear as a prevailing coherent linear noise in OBC seismic data. Their complex properties make the noise removal notably challenging in seismic processing. To address the challenges, we propose a method of dispersive multi-modal

  15. A Hybrid FPGA/Coarse Parallel Processing Architecture for Multi-modal Visual Feature Descriptors

    DEFF Research Database (Denmark)

    Jensen, Lars Baunegaard With; Kjær-Nielsen, Anders; Alonso, Javier Díaz

    2008-01-01

    This paper describes the hybrid architecture developed for speeding up the processing of so-called multi-modal visual primitives which are sparse image descriptors extracted along contours. In the system, the first stages of visual processing are implemented on FPGAs due to their highly parallel...

  16. A Multi-Modal Active Learning Experience for Teaching Social Categorization

    Science.gov (United States)

    Schwarzmueller, April

    2011-01-01

    This article details a multi-modal active learning experience to help students understand elements of social categorization. Each student in a group dynamics course observed two groups in conflict and identified examples of in-group bias, double-standard thinking, out-group homogeneity bias, law of small numbers, group attribution error, ultimate…

  17. Ultrasmall Biocompatible WO3- x Nanodots for Multi-Modality Imaging and Combined Therapy of Cancers.

    Science.gov (United States)

    Wen, Ling; Chen, Ling; Zheng, Shimin; Zeng, Jianfeng; Duan, Guangxin; Wang, Yong; Wang, Guanglin; Chai, Zhifang; Li, Zhen; Gao, Mingyuan

    2016-07-01

    Ultrasmall biocompatible WO3 - x nanodots with an outstanding X-ray radiation sensitization effect are prepared, and demonstrated to be applicable for multi-modality tumor imaging through computed tomography and photoacoustic imaging (PAI), and effective cancer treatment combining both photothermal therapy and radiation therapy.

  18. Multi-modal Discourse Analysis of Peng Liyuan’s Dress

    Institute of Scientific and Technical Information of China (English)

    顾伟红

    2016-01-01

    Traditional discourse analysis basically focuses on language rather than non-linguistic symbol resources in terms of meaning construction. The latter emerging multi-modal discourse analysis breaks this limitation into a large extent. This paper analyzed Peng Liyuan’s dress with semiotics of Saussure and visual grammar of Kress and Van Ixeuwen as theoretical framework.

  19. Multi-modal affect induction for affective brain-computer interfaces

    NARCIS (Netherlands)

    Mühl, C.; Broek, E.L. van den; Brouwer, A.M.; Nijboer, F.; Wouwe, N.C. van; Heylen, D.

    2011-01-01

    Reliable applications of affective brain-computer interfaces (aBCI) in realistic, multi-modal environments require a detailed understanding of the processes involved in emotions. To explore the modalityspecific nature of affective responses, we studied neurophysiological responses (i.e., EEG) of 24

  20. Multi-modal affect induction for affective brain-computer interfaces

    NARCIS (Netherlands)

    Mühl, C.; Broek, E.L. van den; Brouwer, A.M.; Nijboer, F.; Wouwe, N.C. van; Heylen, D.

    2011-01-01

    Reliable applications of affective brain-computer interfaces (aBCI) in realistic, multi-modal environments require a detailed understanding of the processes involved in emotions. To explore the modalityspecific nature of affective responses, we studied neurophysiological responses (i.e., EEG) of 24

  1. Multi-criteria appraisal of multi-modal urban public transport systems

    NARCIS (Netherlands)

    Keyvan Ekbatani, M.; Cats, O.

    2015-01-01

    This study proposes a multi-criteria decision making (MCDM) modelling framework for the appraisal of multi-modal urban public transportation services. MCDM is commonly used to obtain choice alternatives that satisfy a range of performance indicators. The framework embraces both compensatory and non-

  2. Distributed Network Control for Mobile Multi-Modal Wireless Sensor Networks

    Science.gov (United States)

    2010-08-19

    Distributed Network Control for Mobile Multi-Modal Wireless Sensor Networks Doina Bein , Yicheng Wen, Shashi Phoha1, Bharat B. Madan, and Asok Ray The...Journal of High Perfor- mance Computing Applications, Special Issue on Sensor Networks 16 (3) (2002) 235–241. [30] Y. Wen, D. Bein , S. Phoha

  3. Multi-Modal Obstacle Detection in Unstructured Environments with Conditional Random Fields

    DEFF Research Database (Denmark)

    Kragh, Mikkel; Underwood, James

    2017-01-01

    explicitly handling sparse point cloud data and exploiting both spatial, temporal, and multi-modal links between corresponding 2D and 3D regions. The proposed method is evaluated on a diverse dataset, comprising a dairy paddock and a number of different orchards gathered with a perception research robot...

  4. Integration of Fiber-Optic Sensor Arrays into a Multi-Modal Tactile Sensor Processing System for Robotic End-Effectors

    Science.gov (United States)

    Kampmann, Peter; Kirchner, Frank

    2014-01-01

    With the increasing complexity of robotic missions and the development towards long-term autonomous systems, the need for multi-modal sensing of the environment increases. Until now, the use of tactile sensor systems has been mostly based on sensing one modality of forces in the robotic end-effector. The use of a multi-modal tactile sensory system is motivated, which combines static and dynamic force sensor arrays together with an absolute force measurement system. This publication is focused on the development of a compact sensor interface for a fiber-optic sensor array, as optic measurement principles tend to have a bulky interface. Mechanical, electrical and software approaches are combined to realize an integrated structure that provides decentralized data pre-processing of the tactile measurements. Local behaviors are implemented using this setup to show the effectiveness of this approach. PMID:24743158

  5. Integration of Fiber-Optic Sensor Arrays into a Multi-Modal Tactile Sensor Processing System for Robotic End-Effectors

    Directory of Open Access Journals (Sweden)

    Peter Kampmann

    2014-04-01

    Full Text Available With the increasing complexity of robotic missions and the development towards long-term autonomous systems, the need for multi-modal sensing of the environment increases. Until now, the use of tactile sensor systems has been mostly based on sensing one modality of forces in the robotic end-effector. The use of a multi-modal tactile sensory system is motivated, which combines static and dynamic force sensor arrays together with an absolute force measurement system. This publication is focused on the development of a compact sensor interface for a fiber-optic sensor array, as optic measurement principles tend to have a bulky interface. Mechanical, electrical and software approaches are combined to realize an integrated structure that provides decentralized data pre-processing of the tactile measurements. Local behaviors are implemented using this setup to show the effectiveness of this approach.

  6. Use of Multi-Modal Media and Tools in an Online Information Literacy Course: College Students' Attitudes and Perceptions

    Science.gov (United States)

    Chen, Hsin-Liang; Williams, James Patrick

    2009-01-01

    This project studies the use of multi-modal media objects in an online information literacy class. One hundred sixty-two undergraduate students answered seven surveys. Significant relationships are found among computer skills, teaching materials, communication tools and learning experience. Multi-modal media objects and communication tools are…

  7. Embedded security system for multi-modal surveillance in a railway carriage

    Science.gov (United States)

    Zouaoui, Rhalem; Audigier, Romaric; Ambellouis, Sébastien; Capman, François; Benhadda, Hamid; Joudrier, Stéphanie; Sodoyer, David; Lamarque, Thierry

    2015-10-01

    Public transport security is one of the main priorities of the public authorities when fighting against crime and terrorism. In this context, there is a great demand for autonomous systems able to detect abnormal events such as violent acts aboard passenger cars and intrusions when the train is parked at the depot. To this end, we present an innovative approach which aims at providing efficient automatic event detection by fusing video and audio analytics and reducing the false alarm rate compared to classical stand-alone video detection. The multi-modal system is composed of two microphones and one camera and integrates onboard video and audio analytics and fusion capabilities. On the one hand, for detecting intrusion, the system relies on the fusion of "unusual" audio events detection with intrusion detections from video processing. The audio analysis consists in modeling the normal ambience and detecting deviation from the trained models during testing. This unsupervised approach is based on clustering of automatically extracted segments of acoustic features and statistical Gaussian Mixture Model (GMM) modeling of each cluster. The intrusion detection is based on the three-dimensional (3D) detection and tracking of individuals in the videos. On the other hand, for violent events detection, the system fuses unsupervised and supervised audio algorithms with video event detection. The supervised audio technique detects specific events such as shouts. A GMM is used to catch the formant structure of a shout signal. Video analytics use an original approach for detecting aggressive motion by focusing on erratic motion patterns specific to violent events. As data with violent events is not easily available, a normality model with structured motions from non-violent videos is learned for one-class classification. A fusion algorithm based on Dempster-Shafer's theory analyses the asynchronous detection outputs and computes the degree of belief of each probable event.

  8. Multi-Modal, Multi-Touch Interaction with Maps in Disaster Management Applications

    Directory of Open Access Journals (Sweden)

    V. Paelke

    2012-07-01

    Full Text Available Multi-touch interaction has become popular in recent years and impressive advances in technology have been demonstrated, with the presentation of digital maps as a common presentation scenario. However, most existing systems are really technology demonstrators and have not been designed with real applications in mind. A critical factor in the management of disaster situations is the access to current and reliable data. New sensors and data acquisition platforms (e.g. satellites, UAVs, mobile sensor networks have improved the supply of spatial data tremendously. However, in many cases this data is not well integrated into current crisis management systems and the capabilities to analyze and use it lag behind sensor capabilities. Therefore, it is essential to develop techniques that allow the effective organization, use and management of heterogeneous data from a wide variety of data sources. Standard user interfaces are not well suited to provide this information to crisis managers. Especially in dynamic situations conventional cartographic displays and mouse based interaction techniques fail to address the need to review a situation rapidly and act on it as a team. The development of novel interaction techniques like multi-touch and tangible interaction in combination with large displays provides a promising base technology to provide crisis managers with an adequate overview of the situation and to share relevant information with other stakeholders in a collaborative setting. However, design expertise on the use of such techniques in interfaces for real-world applications is still very sparse. In this paper we report on interdisciplinary research with a user and application centric focus to establish real-world requirements, to design new multi-modal mapping interfaces, and to validate them in disaster management applications. Initial results show that tangible and pen-based interaction are well suited to provide an intuitive and visible way to

  9. Multi-Source Learning for Joint Analysis of Incomplete Multi-Modality Neuroimaging Data.

    Science.gov (United States)

    Yuan, Lei; Wang, Yalin; Thompson, Paul M; Narayan, Vaibhav A; Ye, Jieping

    2012-01-01

    Incomplete data present serious problems when integrating largescale brain imaging data sets from different imaging modalities. In the Alzheimer's Disease Neuroimaging Initiative (ADNI), for example, over half of the subjects lack cerebrospinal fluid (CSF) measurements; an independent half of the subjects do not have fluorodeoxyglucose positron emission tomography (FDG-PET) scans; many lack proteomics measurements. Traditionally, subjects with missing measures are discarded, resulting in a severe loss of available information. We address this problem by proposing two novel learning methods where all the samples (with at least one available data source) can be used. In the first method, we divide our samples according to the availability of data sources, and we learn shared sets of features with state-of-the-art sparse learning methods. Our second method learns a base classifier for each data source independently, based on which we represent each source using a single column of prediction scores; we then estimate the missing prediction scores, which, combined with the existing prediction scores, are used to build a multi-source fusion model. To illustrate the proposed approaches, we classify patients from the ADNI study into groups with Alzheimer's disease (AD), mild cognitive impairment (MCI) and normal controls, based on the multi-modality data. At baseline, ADNI's 780 participants (172 AD, 397 MCI, 211 Normal), have at least one of four data types: magnetic resonance imaging (MRI), FDG-PET, CSF and proteomics. These data are used to test our algorithms. Comprehensive experiments show that our proposed methods yield stable and promising results.

  10. Design and Implementation of a Multi-Modal Biometric System for Company Access Control

    Directory of Open Access Journals (Sweden)

    Elisabetta Stefani

    2017-05-01

    Full Text Available This paper is about the design, implementation, and deployment of a multi-modal biometric system to grant access to a company structure and to internal zones in the company itself. Face and iris have been chosen as biometric traits. Face is feasible for non-intrusive checking with a minimum cooperation from the subject, while iris supports very accurate recognition procedure at a higher grade of invasivity. The recognition of the face trait is based on the Local Binary Patterns histograms, and the Daughman’s method is implemented for the analysis of the iris data. The recognition process may require either the acquisition of the user’s face only or the serial acquisition of both the user’s face and iris, depending on the confidence level of the decision with respect to the set of security levels and requirements, stated in a formal way in the Service Level Agreement at a negotiation phase. The quality of the decision depends on the setting of proper different thresholds in the decision modules for the two biometric traits. Any time the quality of the decision is not good enough, the system activates proper rules, which ask for new acquisitions (and decisions, possibly with different threshold values, resulting in a system not with a fixed and predefined behaviour, but one which complies with the actual acquisition context. Rules are formalized as deduction rules and grouped together to represent “response behaviors” according to the previous analysis. Therefore, there are different possible working flows, since the actual response of the recognition process depends on the output of the decision making modules that compose the system. Finally, the deployment phase is described, together with the results from the testing, based on the AT&T Face Database and the UBIRIS database.

  11. Efficacy and safety of a modular multi-modal exercise program in prostate cancer patients with bone metastases: a randomized controlled trial.

    Science.gov (United States)

    Galvão, Daniel A; Taaffe, Dennis R; Cormie, Prue; Spry, Nigel; Chambers, Suzanne K; Peddle-McIntyre, Carolyn; Baker, Michael; Denham, James; Joseph, David; Groom, Geoff; Newton, Robert U

    2011-12-13

    The presence of bone metastases has excluded participation of prostate cancer patients in exercise intervention studies to date and is also a relative contraindication to supervised exercise in the community setting because of concerns of fragility fracture. However, this group of patients often have developed significant muscle atrophy and functional impairments from prior and continuing androgen deprivation that is exacerbated by subsequent and more intensive interventions such as chemotherapy. The aim of this study is to determine the efficacy and safety of a modular multi-modal exercise program in prostate cancer patients with bone metastases. Multi-site randomized controlled trial in Western Australia and New South Wales to examine the efficacy and safety of a modular multi-modal physical exercise program in 90 prostate cancer survivors with bone metastases. Participants will be randomized to (1) modular multi-modal exercise intervention group or (2) usual medical care group. The modular multi-modal exercise group will receive a 3-month supervised exercise program based on bone lesion location/extent. Measurements for primary and secondary endpoints will take place at baseline, 3 months (end of the intervention) and 6 months follow-up. Delaying or preventing skeletal complication and improving physical function for men with bone metastases would provide clinically meaningful benefits to patients. However, exercise programs must be designed and executed with careful consideration of the skeletal complications associated with bone metastatic disease and cumulative toxicities from androgen deprivation such as osteoporosis and increased risk of fractures. The results from this study will form the basis for the development of a specific exercise prescription in this patient group in order to alleviate disease burden, counteract the adverse treatment related side-effects and enhance quality of life. ACTRN: ACTRN12611001158954.

  12. 大学英语课堂中PPT课件的多模态性研究%Multi -modal Analysis of Power Point in the College English Class

    Institute of Scientific and Technical Information of China (English)

    王馨

    2012-01-01

    以系统功能语言学为基础的多模态理论是语言学家在长期的外语研究中创立的全新理念,图像、颜色和动作等非语言形式在多模态理论的发展中得到重新认可和重视。PPT课件通过声音、图像、文字、动画等非语言形式成为高校英语重要的多媒体教学手段。本文通过视觉模态、听觉模态和视听模态分析了PPT课件在大学英语课堂中的多模态应用。%Based on the system functional linguistics multi modal is a new concept created by the lin guist in the long term of the foreign language analysis. Nonlinguistic such as pictures, colors and animations gain attention and recognition again with the development of multi modal. PPT becomes an important multi media tool by means of sound, picture, word and animation in English teaching. The paper analyzes the appli cation of PPT in multi modal through the visual modal, acoustical modal and audio visual modal in the col lege English class.

  13. Virtual reality testing of multi-modal integration in schizophrenic patients.

    Science.gov (United States)

    Sorkin, Anna; Peled, Avi; Weinshall, Daphna

    2005-01-01

    Our goal is to develop a new family of automatic tools for the diagnosis of schizophrenia, using Virtual Reality Technology (VRT). VRT is specifically suitable for this purpose, because it allows for multi-modal stimulation in a complex setup, and the simultaneous measurement of multiple parameters. In this work we studied sensory integration within working memory, in a navigation task through a VR maze. Along the way subjects pass through multiple rooms that include three doors each, only one of which can be used to legally exit the room. Specifically, each door is characterized by three features (color, shape and sound), and only one combination of features -- as determined by a transient opening rule -- is legal. The opening rule changes over time. Subjects must learn the rule and use it for successful navigation throughout the maze. 39 schizophrenic patients and 21 healthy controls participated in this study. Upon completion, each subject was assigned a performance profile, including various error scores, response time, navigation ability and strategy. We developed a classification procedure based on the subjects' performance profile, which correctly predicted 85% of the schizophrenic patients (and all the controls). We observed that a number of parameters showed significant correlation with standard diagnosis scores (PANSS), suggesting the potential use of our measurements for future diagnosis of schizophrenia. On the other hand, our patients did not show unusual repetition of response despite stimulus cessation (called perseveration in classical studies of schizophrenia), which is usually considered a robust marker of the disease. Interestingly, this deficit only appeared in our study when subjects did not receive proper explanation of the task.

  14. Multi-modal distraction. Using technology to combat pain in young children with burn injuries.

    Science.gov (United States)

    Miller, Kate; Rodger, Sylvia; Bucolo, Sam; Greer, Ristan; Kimble, Roy M

    2010-08-01

    The use of non-pharmacological pain management remains adhoc within acute paediatric burns pain management protocols despite ongoing acknowledgement of its role. Advancements in adult based pain services including the integration of virtual reality has been adapted to meet the needs of children in pain, as exemplified by the development of multi-modal distraction (MMD). This easy to use, hand held interactive device uses customized programs designed to inform the child about the procedure he/she is about to experience and to distract the child during dressing changes. (1) To investigate if either MMD procedural preparation (MMD-PP) or distraction (MMD-D) has a greater impact on child pain reduction compared to standard distraction (SD) or hand held video game distraction (VG), (2) to understand the impact of MMD-PP and MMD-D on clinic efficiency by measuring length of treatment across groups, and lastly, (3) to assess the efficacy of distraction techniques over three dressing change procedures. A prospective randomised control trial was completed in a paediatric tertiary hospital Burns Outpatient Clinic. Eighty participants were recruited and studied over their first three dressing changes. Pain was assessed using validated child report, caregiver report, nursing observation and physiological measures. MMD-D and MMD-PP were both shown to significantly relieve reported pain (peffects of both MMD-D and MMD-PP were sustained with subsequent dressing changes. The use of MMD as a preparatory or a distraction tool in an outpatient burns clinic offered superior pain reduction across three dressing changes to children when compared to standard practices or hand held video games. This device has the potential to improve clinic efficiency with reductions in treatment lengths.

  15. A novel technique to incorporate structural prior information into multi-modal tomographic reconstruction

    Science.gov (United States)

    Kazantsev, Daniil; Ourselin, Sébastien; Hutton, Brian F.; Dobson, Katherine J.; Kaestner, Anders P.; Lionheart, William R. B.; Withers, Philip J.; Lee, Peter D.; Arridge, Simon R.

    2014-06-01

    There has been a rapid expansion of multi-modal imaging techniques in tomography. In biomedical imaging, patients are now regularly imaged using both single photon emission computed tomography (SPECT) and x-ray computed tomography (CT), or using both positron emission tomography and magnetic resonance imaging (MRI). In non-destructive testing of materials both neutron CT (NCT) and x-ray CT are widely applied to investigate the inner structure of material or track the dynamics of physical processes. The potential benefits from combining modalities has led to increased interest in iterative reconstruction algorithms that can utilize the data from more than one imaging mode simultaneously. We present a new regularization term in iterative reconstruction that enables information from one imaging modality to be used as a structural prior to improve resolution of the second modality. The regularization term is based on a modified anisotropic tensor diffusion filter, that has shape-adapted smoothing properties. By considering the underlying orientations of normal and tangential vector fields for two co-registered images, the diffusion flux is rotated and scaled adaptively to image features. The images can have different greyscale values and different spatial resolutions. The proposed approach is particularly good at isolating oriented features in images which are important for medical and materials science applications. By enhancing the edges it enables both easy identification and volume fraction measurements aiding segmentation algorithms used for quantification. The approach is tested on a standard denoising and deblurring image recovery problem, and then applied to 2D and 3D reconstruction problems; thereby highlighting the capabilities of the algorithm. Using synthetic data from SPECT co-registered with MRI, and real NCT data co-registered with x-ray CT, we show how the method can be used across a range of imaging modalities.

  16. A Hybrid Algorithm for Optimizing Multi- Modal Functions

    Institute of Scientific and Technical Information of China (English)

    Li Qinghua; Yang Shida; Ruan Youlin

    2006-01-01

    A new genetic algorithm is presented based on the musical performance. The novelty of this algorithm is that a new genetic algorithm, mimicking the musical process of searching for a perfect state of harmony, which increases the robustness of it greatly and gives a new meaning of it in the meantime, has been developed. Combining the advantages of the new genetic algorithm, simplex algorithm and tabu search, a hybrid algorithm is proposed. In order to verify the effectiveness of the hybrid algorithm, it is applied to solving some typical numerical function optimization problems which are poorly solved by traditional genetic algorithms. The experimental results show that the hybrid algorithm is fast and reliable.

  17. Histopathology in 3D: From three-dimensional reconstruction to multi-stain and multi-modal analysis

    Directory of Open Access Journals (Sweden)

    Derek Magee

    2015-01-01

    Full Text Available Light microscopy applied to the domain of histopathology has traditionally been a two-dimensional imaging modality. Several authors, including the authors of this work, have extended the use of digital microscopy to three dimensions by stacking digital images of serial sections using image-based registration. In this paper, we give an overview of our approach, and of extensions to the approach to register multi-modal data sets such as sets of interleaved histopathology sections with different stains, and sets of histopathology images to radiology volumes with very different appearance. Our approach involves transforming dissimilar images into a multi-channel representation derived from co-occurrence statistics between roughly aligned images.

  18. Bayesian vector autoregressive model for multi-subject effective connectivity inference using multi-modal neuroimaging data.

    Science.gov (United States)

    Chiang, Sharon; Guindani, Michele; Yeh, Hsiang J; Haneef, Zulfi; Stern, John M; Vannucci, Marina

    2017-03-01

    In this article a multi-subject vector autoregressive (VAR) modeling approach was proposed for inference on effective connectivity based on resting-state functional MRI data. Their framework uses a Bayesian variable selection approach to allow for simultaneous inference on effective connectivity at both the subject- and group-level. Furthermore, it accounts for multi-modal data by integrating structural imaging information into the prior model, encouraging effective connectivity between structurally connected regions. They demonstrated through simulation studies that their approach resulted in improved inference on effective connectivity at both the subject- and group-level, compared with currently used methods. It was concluded by illustrating the method on temporal lobe epilepsy data, where resting-state functional MRI and structural MRI were used. Hum Brain Mapp 38:1311-1332, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

  19. Histopathology in 3D: From three-dimensional reconstruction to multi-stain and multi-modal analysis.

    Science.gov (United States)

    Magee, Derek; Song, Yi; Gilbert, Stephen; Roberts, Nicholas; Wijayathunga, Nagitha; Wilcox, Ruth; Bulpitt, Andrew; Treanor, Darren

    2015-01-01

    Light microscopy applied to the domain of histopathology has traditionally been a two-dimensional imaging modality. Several authors, including the authors of this work, have extended the use of digital microscopy to three dimensions by stacking digital images of serial sections using image-based registration. In this paper, we give an overview of our approach, and of extensions to the approach to register multi-modal data sets such as sets of interleaved histopathology sections with different stains, and sets of histopathology images to radiology volumes with very different appearance. Our approach involves transforming dissimilar images into a multi-channel representation derived from co-occurrence statistics between roughly aligned images.

  20. Techniques for efficient, real-time, 3D visualization of multi-modality cardiac data using consumer graphics hardware.

    Science.gov (United States)

    Levin, David; Aladl, Usaf; Germano, Guido; Slomka, Piotr

    2005-09-01

    We exploit consumer graphics hardware to perform real-time processing and visualization of high-resolution, 4D cardiac data. We have implemented real-time, realistic volume rendering, interactive 4D motion segmentation of cardiac data, visualization of multi-modality cardiac data and 3D display of multiple series cardiac MRI. We show that an ATI Radeon 9700 Pro can render a 512x512x128 cardiac Computed Tomography (CT) study at 0.9 to 60 frames per second (fps) depending on rendering parameters and that 4D motion based segmentation can be performed in real-time. We conclude that real-time rendering and processing of cardiac data can be implemented on consumer graphics cards.

  1. Multi-modal virtual environment research at Armstrong Laboratory

    Science.gov (United States)

    Eggleston, Robert G.

    1995-01-01

    One mission of the Paul M. Fitts Human Engineering Division of Armstrong Laboratory is to improve the user interface for complex systems through user-centered exploratory development and research activities. In support of this goal, many current projects attempt to advance and exploit user-interface concepts made possible by virtual reality (VR) technologies. Virtual environments may be used as a general purpose interface medium, an alternative display/control method, a data visualization and analysis tool, or a graphically based performance assessment tool. An overview is given of research projects within the division on prototype interface hardware/software development, integrated interface concept development, interface design and evaluation tool development, and user and mission performance evaluation tool development.

  2. Ultrathin SWCNT Films Enabled Multi-modal Fiber Sensors

    Science.gov (United States)

    2014-09-30

    derived by  Mason  et al. [46] and  Shiragami et al. [47], the experimentally acquired sedimentation function was then numerically  fitted to extract the...A,  Linderman  R,  Obergfell  D,  Roth   S,  Hierold  C.  Nano‐ electromechanical displacement sensing based on single‐walled carbon nanotubes. Nano...Visible Absorption Spectroscopy.  Anal. Chem., 2006; 78:8098‐8104.  [46]  Mason  M, Weaver W. The settling of small particles in a fluid. Phys. Rev., 1924

  3. Optimized Radial Basis Function Classifier for Multi Modal Biometrics

    Directory of Open Access Journals (Sweden)

    Anand Viswanathan

    2014-07-01

    Full Text Available Biometric systems can be used for the identification or verification of humans based on their physiological or behavioral features. In these systems the biometric characteristics such as fingerprints, palm-print, iris or speech can be recorded and are compared with the samples for the identification or verification. Multimodal biometrics is more accurate and solves spoof attacks than the single modal bio metrics systems. In this study, a multimodal biometric system using fingerprint images and finger-vein patterns is proposed and also an optimized Radial Basis Function (RBF kernel classifier is proposed to identify the authorized users. The extracted features from these modalities are selected by PCA and kernel PCA and combined to classify by RBF classifier. The parameters of RBF classifier is optimized by using BAT algorithm with local search. The performance of the proposed classifier is compared with the KNN classifier, Naïve Bayesian classifier and non-optimized RBF classifier.

  4. A hybrid genetic algorithm for multi-modal image registration

    Institute of Scientific and Technical Information of China (English)

    2006-01-01

    This paper describes a new method for three-dimensional medical image registration. In the interactive image-guided HIFU (High Intensity Focused Ultrasound) therapy system, a fast and precise localization of the tumor is very important. An automatic system is developed for registering pre-operative MR images with intra-operative ultrasound images based on the vessels visible in both of the modalities. When the MR and the ultrasound images are aligned, the centerline points of the vessels in the MR image will align with bright intensities in the ultrasound image. The method applies an optimization strategy combining the genetic algorithm with the conjugated gradients algorithm to minimize the objective function. It provides a feasible way of determining the global solution and makes the method robust to local maximum and insensitive to initial position. Two experiments were designed to evaluate the method, and the results show that our method has better registration accuracy and convergence rate than the other two classic algorithms.

  5. Multi-modal registration for correlative microscopy using image analogies.

    Science.gov (United States)

    Cao, Tian; Zach, Christopher; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

    2014-08-01

    Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies for the same biological specimen. In this paper, we propose an image registration method for correlative microscopy, which is challenging due to the distinct appearance of biological structures when imaged with different modalities. Our method is based on image analogies and allows to transform images of a given modality into the appearance-space of another modality. Hence, the registration between two different types of microscopy images can be transformed to a mono-modality image registration. We use a sparse representation model to obtain image analogies. The method makes use of corresponding image training patches of two different imaging modalities to learn a dictionary capturing appearance relations. We test our approach on backscattered electron (BSE) scanning electron microscopy (SEM)/confocal and transmission electron microscopy (TEM)/confocal images. We perform rigid, affine, and deformable registration via B-splines and show improvements over direct registration using both mutual information and sum of squared differences similarity measures to account for differences in image appearance. Copyright © 2013 Elsevier B.V. All rights reserved.

  6. Automatic multi-modal MR tissue classification for the assessment of response to bevacizumab in patients with glioblastoma

    Energy Technology Data Exchange (ETDEWEB)

    Liberman, Gilad [The Functional Brain Center, The Wohl Institute for Advanced Imaging, Tel Aviv Sourasky Medical Center, Tel Aviv (Israel); Gonda Multidisciplinary Brain Research Center, Bar Ilan University, Ramat-Gan (Israel); Louzoun, Yoram [Mathematics Department, Bar-Ilan University, Ramat-Gan (Israel); Aizenstein, Orna [The Functional Brain Center, The Wohl Institute for Advanced Imaging, Tel Aviv Sourasky Medical Center, Tel Aviv (Israel); Blumenthal, Deborah T.; Bokstein, Felix [Neuro-Oncology Service, Tel Aviv Sourasky Medical Center, Tel Aviv (Israel); Palmon, Mika [The Functional Brain Center, The Wohl Institute for Advanced Imaging, Tel Aviv Sourasky Medical Center, Tel Aviv (Israel); Corn, Benjamin W. [Institute of Radiotherapy, Tel Aviv Sourasky Medical Center, Tel Aviv (Israel); Ben Bashat, Dafna, E-mail: dafnab@tlvmc.gov.il [The Functional Brain Center, The Wohl Institute for Advanced Imaging, Tel Aviv Sourasky Medical Center, Tel Aviv (Israel)

    2013-02-15

    Background: Current methods for evaluation of treatment response in glioblastoma are inaccurate, limited and time-consuming. This study aimed to develop a multi-modal MRI automatic classification method to improve accuracy and efficiency of treatment response assessment in patients with recurrent glioblastoma (GB). Materials and methods: A modification of the k-Nearest-Neighbors (kNN) classification method was developed and applied to 59 longitudinal MR data sets of 13 patients with recurrent GB undergoing bevacizumab (anti-angiogenic) therapy. Changes in the enhancing tumor volume were assessed using the proposed method and compared with Macdonald's criteria and with manual volumetric measurements. The edema-like area was further subclassified into peri- and non-peri-tumoral edema, using both the kNN method and an unsupervised method, to monitor longitudinal changes. Results: Automatic classification using the modified kNN method was applicable in all scans, even when the tumors were infiltrative with unclear borders. The enhancing tumor volume obtained using the automatic method was highly correlated with manual measurements (N = 33, r = 0.96, p < 0.0001), while standard radiographic assessment based on Macdonald's criteria matched manual delineation and automatic results in only 68% of cases. A graded pattern of tumor infiltration within the edema-like area was revealed by both automatic methods, showing high agreement. All classification results were confirmed by a senior neuro-radiologist and validated using MR spectroscopy. Conclusion: This study emphasizes the important role of automatic tools based on a multi-modal view of the tissue in monitoring therapy response in patients with high grade gliomas specifically under anti-angiogenic therapy.

  7. The Stability of Multi-modal Traffic Network

    Institute of Scientific and Technical Information of China (English)

    HAN Ling-Hui; Sun Hui-Jun; ZHU Cheng-Juan; WU Jian-Jun; JIA Bin

    2013-01-01

    There is an explicit and implicit assumption in multimodal traffic equilibrium models,that is,if the equilibrium exists,then it will also occur.The assumption is very idealized; in fact,it may be shown that the quite contrary could happen,because in multimodal traffic network,especially in mixed traffic conditions the interaction among traffic modes is asymmetric and the asymmetric interaction may result in the instability of traffic system.In this paper,to study the stability of multimodal traffic system,we respectively present the travel cost function in mixed traffic conditions and in traffic network with dedicated bus lanes.Based on a day-to-day dynamical model,we study the evolution of daily route choice of travelers in multimodal traffic network using 10000 random initial values for different cases.From the results of simulation,it can be concluded that the asymmetric interaction between the cars and buses in mixed traffic conditions can lead the traffic system to instability when traffic demand is larger.We also study the effect of travelers' perception error on the stability of multimodal traffic network.Although the larger perception error can alleviate the effect of interaction between cars and buses and improve the stability of traffic system in mixed traffic conditions,the traffic system also become instable when the traffic demand is larger than a number.For all cases simulated in this study,with the same parameters,traffic system with dedicated bus lane has better stability for traffic demand than that in mixed traffic conditions.We also find that the network with dedicated bus lane has higher portion of travelers by bus than it of mixed traffic network.So it can be concluded that building dedicated bus lane can improve the stability of traffic system and attract more travelers to choose bus reducing the traffic congestion.

  8. Multi-modal glioblastoma segmentation: man versus machine.

    Directory of Open Access Journals (Sweden)

    Nicole Porz

    Full Text Available BACKGROUND AND PURPOSE: Reproducible segmentation of brain tumors on magnetic resonance images is an important clinical need. This study was designed to evaluate the reliability of a novel fully automated segmentation tool for brain tumor image analysis in comparison to manually defined tumor segmentations. METHODS: We prospectively evaluated preoperative MR Images from 25 glioblastoma patients. Two independent expert raters performed manual segmentations. Automatic segmentations were performed using the Brain Tumor Image Analysis software (BraTumIA. In order to study the different tumor compartments, the complete tumor volume TV (enhancing part plus non-enhancing part plus necrotic core of the tumor, the TV+ (TV plus edema and the contrast enhancing tumor volume CETV were identified. We quantified the overlap between manual and automated segmentation by calculation of diameter measurements as well as the Dice coefficients, the positive predictive values, sensitivity, relative volume error and absolute volume error. RESULTS: Comparison of automated versus manual extraction of 2-dimensional diameter measurements showed no significant difference (p = 0.29. Comparison of automated versus manual segmentation of volumetric segmentations showed significant differences for TV+ and TV (p0.05 with regard to the Dice overlap coefficients. Spearman's rank correlation coefficients (ρ of TV+, TV and CETV showed highly significant correlations between automatic and manual segmentations. Tumor localization did not influence the accuracy of segmentation. CONCLUSIONS: In summary, we demonstrated that BraTumIA supports radiologists and clinicians by providing accurate measures of cross-sectional diameter-based tumor extensions. The automated volume measurements were comparable to manual tumor delineation for CETV tumor volumes, and outperformed inter-rater variability for overlap and sensitivity.

  9. Integration of Multi-Modal Biomedical Data to Predict Cancer Grade and Patient Survival.

    Science.gov (United States)

    Phan, John H; Hoffman, Ryan; Kothari, Sonal; Wu, Po-Yen; Wang, May D

    2016-02-01

    The Big Data era in Biomedical research has resulted in large-cohort data repositories such as The Cancer Genome Atlas (TCGA). These repositories routinely contain hundreds of matched patient samples for genomic, proteomic, imaging, and clinical data modalities, enabling holistic and multi-modal integrative analysis of human disease. Using TCGA renal and ovarian cancer data, we conducted a novel investigation of multi-modal data integration by combining histopathological image and RNA-seq data. We compared the performances of two integrative prediction methods: majority vote and stacked generalization. Results indicate that integration of multiple data modalities improves prediction of cancer grade and outcome. Specifically, stacked generalization, a method that integrates multiple data modalities to produce a single prediction result, outperforms both single-data-modality prediction and majority vote. Moreover, stacked generalization reveals the contribution of each data modality (and specific features within each data modality) to the final prediction result and may provide biological insights to explain prediction performance.

  10. Multi-modal gesture recognition using integrated model of motion, audio and video

    Science.gov (United States)

    Goutsu, Yusuke; Kobayashi, Takaki; Obara, Junya; Kusajima, Ikuo; Takeichi, Kazunari; Takano, Wataru; Nakamura, Yoshihiko

    2015-07-01

    Gesture recognition is used in many practical applications such as human-robot interaction, medical rehabilitation and sign language. With increasing motion sensor development, multiple data sources have become available, which leads to the rise of multi-modal gesture recognition. Since our previous approach to gesture recognition depends on a unimodal system, it is difficult to classify similar motion patterns. In order to solve this problem, a novel approach which integrates motion, audio and video models is proposed by using dataset captured by Kinect. The proposed system can recognize observed gestures by using three models. Recognition results of three models are integrated by using the proposed framework and the output becomes the final result. The motion and audio models are learned by using Hidden Markov Model. Random Forest which is the video classifier is used to learn the video model. In the experiments to test the performances of the proposed system, the motion and audio models most suitable for gesture recognition are chosen by varying feature vectors and learning methods. Additionally, the unimodal and multi-modal models are compared with respect to recognition accuracy. All the experiments are conducted on dataset provided by the competition organizer of MMGRC, which is a workshop for Multi-Modal Gesture Recognition Challenge. The comparison results show that the multi-modal model composed of three models scores the highest recognition rate. This improvement of recognition accuracy means that the complementary relationship among three models improves the accuracy of gesture recognition. The proposed system provides the application technology to understand human actions of daily life more precisely.

  11. A computer vision integration model for a multi-modal cognitive system

    OpenAIRE

    Vrecko A.; Skocaj D.; Hawes N.; Leonardis A.

    2009-01-01

    We present a general method for integrating visual components into a multi-modal cognitive system. The integration is very generic and can combine an arbitrary set of modalities. We illustrate our integration approach with a specific instantiation of the architecture schema that focuses on integration of vision and language: a cognitive system able to collaborate with a human, learn and display some understanding of its surroundings. As examples of cross-modal interaction we describe mechanis...

  12. Multi-modal Gesture Recognition using Integrated Model of Motion, Audio and Video

    Institute of Scientific and Technical Information of China (English)

    GOUTSU Yusuke; KOBAYASHI Takaki; OBARA Junya; KUSAJIMAIkuo; TAKEICHI Kazunari; TAKANO Wataru; NAKAMURA Yoshihiko

    2015-01-01

    Gesture recognition is used in many practical applications such as human-robot interaction, medical rehabilitation and sign language. With increasing motion sensor development, multiple data sources have become available, which leads to the rise of multi-modal gesture recognition. Since our previous approach to gesture recognition depends on a unimodal system, it is difficult to classify similar motion patterns. In order to solve this problem, a novel approach which integrates motion, audio and video models is proposed by using dataset captured by Kinect. The proposed system can recognize observed gestures by using three models. Recognition results of three models are integrated by using the proposed framework and the output becomes the final result. The motion and audio models are learned by using Hidden Markov Model. Random Forest which is the video classifier is used to learn the video model. In the experiments to test the performances of the proposed system, the motion and audio models most suitable for gesture recognition are chosen by varying feature vectors and learning methods. Additionally, the unimodal and multi-modal models are compared with respect to recognition accuracy. All the experiments are conducted on dataset provided by the competition organizer of MMGRC, which is a workshop for Multi-Modal Gesture Recognition Challenge. The comparison results show that the multi-modal model composed of three models scores the highest recognition rate. This improvement of recognition accuracy means that the complementary relationship among three models improves the accuracy of gesture recognition. The proposed system provides the application technology to understand human actions of daily life more precisely.

  13. Adaptive Multi-Modal Data Mining and Fusion for Autonomous Intelligence Discovery

    Science.gov (United States)

    2009-03-01

    Final DATES COVERED (From To) From 15-12-2006 to 15-12-2007 4. TITLE AND SUBTITLE Adaptive Multi-Modal Data Mining and Fusion For Autonomous...well as geospatial mapping of documents and images. 15. SUBJECT TERMS automated data mining , streaming data, geospatial Internet localization, Arabic...streaming text data mining . 1.1 Mixed Language Text Database Search A particularly useful component that was under development was on a mixed language

  14. Head movement compensation and multi-modal event detection in eye-tracking data for unconstrained head movements.

    Science.gov (United States)

    Larsson, Linnéa; Schwaller, Andrea; Nyström, Marcus; Stridh, Martin

    2016-12-01

    The complexity of analyzing eye-tracking signals increases as eye-trackers become more mobile. The signals from a mobile eye-tracker are recorded in relation to the head coordinate system and when the head and body move, the recorded eye-tracking signal is influenced by these movements, which render the subsequent event detection difficult. The purpose of the present paper is to develop a method that performs robust event detection in signals recorded using a mobile eye-tracker. The proposed method performs compensation of head movements recorded using an inertial measurement unit and employs a multi-modal event detection algorithm. The event detection algorithm is based on the head compensated eye-tracking signal combined with information about detected objects extracted from the scene camera of the mobile eye-tracker. The method is evaluated when participants are seated 2.6m in front of a big screen, and is therefore only valid for distant targets. The proposed method for head compensation decreases the standard deviation during intervals of fixations from 8° to 3.3° for eye-tracking signals recorded during large head movements. The multi-modal event detection algorithm outperforms both an existing algorithm (I-VDT) and the built-in-algorithm of the mobile eye-tracker with an average balanced accuracy, calculated over all types of eye movements, of 0.90, compared to 0.85 and 0.75, respectively for the compared algorithms. The proposed event detector that combines head movement compensation and information regarding detected objects in the scene video enables for improved classification of events in mobile eye-tracking data. Copyright © 2016 Elsevier B.V. All rights reserved.

  15. Optimizing boundary detection via Simulated Search with applications to multi-modal heart segmentation.

    Science.gov (United States)

    Peters, J; Ecabert, O; Meyer, C; Kneser, R; Weese, J

    2010-02-01

    Segmentation of medical images can be achieved with the help of model-based algorithms. Reliable boundary detection is a crucial component to obtain robust and accurate segmentation results and to enable full automation. This is especially important if the anatomy being segmented is too variable to initialize a mean shape model such that all surface regions are close to the desired contours. Several boundary detection algorithms are widely used in the literature. Most use some trained image appearance model to characterize and detect the desired boundaries. Although parameters of the boundary detection can vary over the model surface and are trained on images, their performance (i.e., accuracy and reliability of boundary detection) can only be assessed as an integral part of the entire segmentation algorithm. In particular, assessment of boundary detection cannot be done locally and independently on model parameterization and internal energies controlling geometric model properties. In this paper, we propose a new method for the local assessment of boundary detection called Simulated Search. This method takes any boundary detection function and evaluates its performance for a single model landmark in terms of an estimated geometric boundary detection error. In consequence, boundary detection can be optimized per landmark during model training. We demonstrate the success of the method for cardiac image segmentation. In particular we show that the Simulated Search improves the capture range and the accuracy of the boundary detection compared to a traditional training scheme. We also illustrate how the Simulated Search can be used to identify suitable classes of features when addressing a new segmentation task. Finally, we show that the Simulated Search enables multi-modal heart segmentation using a single algorithmic framework. On computed tomography and magnetic resonance images, average segmentation errors (surface-to-surface distances) for the four chambers and

  16. A hypo-status in drug-dependent brain revealed by multi-modal MRI.

    Science.gov (United States)

    Wang, Ze; Suh, Jesse; Duan, Dingna; Darnley, Stefanie; Jing, Ying; Zhang, Jian; O'Brien, Charles; Childress, Anna Rose

    2016-09-22

    Drug addiction is a chronic brain disorder with no proven effective cure. Assessing both structural and functional brain alterations by using multi-modal, rather than purely unimodal imaging techniques, may provide a more comprehensive understanding of the brain mechanisms underlying addiction, which in turn may facilitate future treatment strategies. However, this type of research remains scarce in the literature. We acquired multi-modal magnetic resonance imaging from 20 cocaine-addicted individuals and 19 age-matched controls. Compared with controls, cocaine addicts showed a multi-modal hypo-status with (1) decreased brain tissue volume in the medial and lateral orbitofrontal cortex (OFC); (2) hypo-perfusion in the prefrontal cortex, anterior cingulate cortex, insula, right temporal cortex and dorsolateral prefrontal cortex and (3) reduced irregularity of resting state activity in the OFC and limbic areas, as well as the cingulate, visual and parietal cortices. In the cocaine-addicted brain, larger tissue volume in the medial OFC, anterior cingulate cortex and ventral striatum and smaller insular tissue volume were associated with higher cocaine dependence levels. Decreased perfusion in the amygdala and insula was also correlated with higher cocaine dependence levels. Tissue volume, perfusion, and brain entropy in the insula and prefrontal cortex, all showed a trend of negative correlation with drug craving scores. The three modalities showed voxel-wise correlation in various brain regions, and combining them improved patient versus control brain classification accuracy. These results, for the first time, demonstrate a comprehensive cocaine-dependence and craving-related hypo-status regarding the tissue volume, perfusion and resting brain irregularity in the cocaine-addicted brain. © 2016 Society for the Study of Addiction.

  17. Multi-modal imaging and cancer therapy using lanthanide oxide nanoparticles: current status and perspectives.

    Science.gov (United States)

    Park, J Y; Chang, Y; Lee, G H

    2015-01-01

    Biomedical imaging is an essential tool for diagnosis and therapy of diseases such as cancers. It is likely true that medicine has developed with biomedical imaging methods. Sensitivity and resolution of biomedical imaging methods can be improved with imaging agents. Furthermore, it will be ideal if imaging agents could be also used as therapeutic agents. Therefore, one dose can be used for both diagnosis and therapy of diseases (i.e., theragnosis). This will simplify medical treatment of diseases, and will be also a benefit to patients. Mixed (Ln(1x)Ln(2y)O3, x + y = 2) or unmixed (Ln2O3) lanthanide (Ln) oxide nanoparticles (Ln = Eu, Gd, Dy, Tb, Ho, Er) are potential multi-modal imaging and cancer therapeutic agents. The lanthanides have a variety of magnetic and optical properties, useful for magnetic resonance imaging (MRI) and fluorescent imaging (FI), respectively. They also highly attenuate X-ray beam, useful for X-ray computed tomography (CT). In addition gadolinium-157 ((157)Gd) has the highest thermal neutron capture cross section among stable radionuclides, useful for gadolinium neutron capture therapy (GdNCT). Therefore, mixed or unmixed lanthanide oxide nanoparticles can be used for multi-modal imaging methods (i.e., MRI-FI, MRI-CT, CT-FI, and MRICT- FI) and cancer therapy (i.e., GdNCT). Since mixed or unmixed lanthanide oxide nanoparticles are single-phase and solid-state, they can be easily synthesized, and are compact and robust, which will be beneficial to biomedical applications. In this review physical properties of the lanthanides, synthesis, characterizations, multi-modal imagings, and cancer therapy of mixed and unmixed lanthanide oxide nanoparticles are discussed.

  18. Deep convolutional neural networks for multi-modality isointense infant brain image segmentation.

    Science.gov (United States)

    Zhang, Wenlu; Li, Rongjian; Deng, Houtao; Wang, Li; Lin, Weili; Ji, Shuiwang; Shen, Dinggang

    2015-03-01

    The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development in health and disease. In the isointense stage (approximately 6-8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, making the tissue segmentation very challenging. Only a small number of existing methods have been designed for tissue segmentation in this isointense stage; however, they only used a single T1 or T2 images, or the combination of T1 and T2 images. In this paper, we propose to use deep convolutional neural networks (CNNs) for segmenting isointense stage brain tissues using multi-modality MR images. CNNs are a type of deep models in which trainable filters and local neighborhood pooling operations are applied alternatingly on the raw input images, resulting in a hierarchy of increasingly complex features. Specifically, we used multi-modality information from T1, T2, and fractional anisotropy (FA) images as inputs and then generated the segmentation maps as outputs. The multiple intermediate layers applied convolution, pooling, normalization, and other operations to capture the highly nonlinear mappings between inputs and outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense stage brain images. Results showed that our proposed model significantly outperformed prior methods on infant brain tissue segmentation. In addition, our results indicated that integration of multi-modality images led to significant performance improvement. Copyright © 2014 Elsevier Inc. All rights reserved.

  19. Sustainable Multi-Modal Sensing by a Single Sensor Utilizing the Passivity of an Elastic Actuator

    Directory of Open Access Journals (Sweden)

    Takashi Takuma

    2014-05-01

    Full Text Available When a robot equipped with compliant joints driven by elastic actuators contacts an object and its joints are deformed, multi-modal information, including the magnitude and direction of the applied force and the deformation of the joint, is used to enhance the performance of the robot such as dexterous manipulation. In conventional approaches, some types of sensors used to obtain the multi-modal information are attached to the point of contact where the force is applied and at the joint. However, this approach is not sustainable for daily use in robots, i.e., not durable or robust, because the sensors can undergo damage due to the application of excessive force and wear due to repeated contacts. Further, multiple types of sensors are required to measure such physical values, which add to the complexity of the device system of the robot. In our approach, a single type of sensor is used and it is located at a point distant from the contact point and the joint, and the information is obtained indirectly by the measurement of certain physical parameters that are influenced by the applied force and the joint deformation. In this study, we employ the McKibben pneumatic actuator whose inner pressure changes passively when a force is applied to the actuator. We derive the relationships between information and the pressures of a two-degrees-of-freedom (2-DoF joint mechanism driven by four pneumatic actuators. Experimental results show that the multi-modal information can be obtained by using the set of pressures measured before and after the force is applied. Further, we apply our principle to obtain the stiffness values of certain contacting objects that can subsequently be categorized by using the aforementioned relationships.

  20. Multi-modal, Multi-measure, and Multi-class Discrimination of ADHD with Hierarchical Feature Extraction and Extreme Learning Machine Using Structural and Functional Brain MRI.

    Science.gov (United States)

    Qureshi, Muhammad Naveed Iqbal; Oh, Jooyoung; Min, Beomjun; Jo, Hang Joon; Lee, Boreom

    2017-01-01

    Structural and functional MRI unveil many hidden properties of the human brain. We performed this multi-class classification study on selected subjects from the publically available attention deficit hyperactivity disorder ADHD-200 dataset of patients and healthy children. The dataset has three groups, namely, ADHD inattentive, ADHD combined, and typically developing. We calculated the global averaged functional connectivity maps across the whole cortex to extract anatomical atlas parcellation based features from the resting-state fMRI (rs-fMRI) data and cortical parcellation based features from the structural MRI (sMRI) data. In addition, the preprocessed image volumes from both of these modalities followed an ANOVA analysis separately using all the voxels. This study utilized the average measure from the most significant regions acquired from ANOVA as features for classification in addition to the multi-modal and multi-measure features of structural and functional MRI data. We extracted most discriminative features by hierarchical sparse feature elimination and selection algorithm. These features include cortical thickness, image intensity, volume, cortical thickness standard deviation, surface area, and ANOVA based features respectively. An extreme learning machine performed both the binary and multi-class classifications in comparison with support vector machines. This article reports prediction accuracy of both unimodal and multi-modal features from test data. We achieved 76.190% (p multi-class settings as well as 92.857% (p multi-modal group analysis approach with multi-measure features may improve the accuracy of the ADHD differential diagnosis.

  1. Multi-modal spectroscopic imaging with synchrotron light to study mechanisms of brain disease

    Science.gov (United States)

    Summers, Kelly L.; Fimognari, Nicholas; Hollings, Ashley; Kiernan, Mitchell; Lam, Virginie; Tidy, Rebecca J.; Takechi, Ryu; George, Graham N.; Pickering, Ingrid J.; Mamo, John C.; Harris, Hugh H.; Hackett, Mark J.

    2017-04-01

    The international health care costs associated with Alzheimer's disease (AD) and dementia have been predicted to reach $2 trillion USD by 2030. As such, there is urgent need to develop new treatments and diagnostic methods to stem an international health crisis. A major limitation to therapy and diagnostic development is the lack of complete understanding about the disease mechanisms. Spectroscopic methods at synchrotron light sources, such as FTIR, XRF, and XAS, offer a "multi-modal imaging platform" to reveal a wealth of important biochemical information in situ within ex vivo tissue sections, to increase our understanding of disease mechanisms.

  2. Multi-Modal Imaging with a Toolbox of Influenza A Reporter Viruses.

    Science.gov (United States)

    Tran, Vy; Poole, Daniel S; Jeffery, Justin J; Sheahan, Timothy P; Creech, Donald; Yevtodiyenko, Aleksey; Peat, Andrew J; Francis, Kevin P; You, Shihyun; Mehle, Andrew

    2015-10-13

    Reporter viruses are useful probes for studying multiple stages of the viral life cycle. Here we describe an expanded toolbox of fluorescent and bioluminescent influenza A reporter viruses. The enhanced utility of these tools enabled kinetic studies of viral attachment, infection, and co-infection. Multi-modal bioluminescence and positron emission tomography-computed tomography (PET/CT) imaging of infected animals revealed that antiviral treatment reduced viral load, dissemination, and inflammation. These new technologies and applications will dramatically accelerate in vitro and in vivo influenza virus studies.

  3. A low-power multi-modal body sensor network with application to epileptic seizure monitoring.

    Science.gov (United States)

    Altini, Marco; Del Din, Silvia; Patel, Shyamal; Schachter, Steven; Penders, Julien; Bonato, Paolo

    2011-01-01

    Monitoring patients' physiological signals during their daily activities in the home environment is one of the challenge of the health care. New ultra-low-power wireless technologies could help to achieve this goal. In this paper we present a low-power, multi-modal, wearable sensor platform for the simultaneous recording of activity and physiological data. First we provide a description of the wearable sensor platform, and its characteristics with respect to power consumption. Second we present the preliminary results of the comparison between our sensors and a reference system, on healthy subjects, to test the reliability of the detected physiological (electrocardiogram and respiration) and electromyography signals.

  4. Data Processing And Machine Learning Methods For Multi-Modal Operator State Classification Systems

    Science.gov (United States)

    Hearn, Tristan A.

    2015-01-01

    This document is intended as an introduction to a set of common signal processing learning methods that may be used in the software portion of a functional crew state monitoring system. This includes overviews of both the theory of the methods involved, as well as examples of implementation. Practical considerations are discussed for implementing modular, flexible, and scalable processing and classification software for a multi-modal, multi-channel monitoring system. Example source code is also given for all of the discussed processing and classification methods.

  5. Multi-Modal Imaging with a Toolbox of Influenza AReporter Viruses

    Directory of Open Access Journals (Sweden)

    Vy Tran

    2015-10-01

    Full Text Available Reporter viruses are useful probes for studying multiple stages of the viral life cycle. Here we describe an expanded toolbox of fluorescent and bioluminescent influenza A reporter viruses. The enhanced utility of these tools enabled kinetic studies of viral attachment, infection, and co-infection. Multi-modal bioluminescence and positron emission tomography–computed tomography (PET/CT imaging of infected animals revealed that antiviral treatment reduced viral load, dissemination, and inflammation. These new technologies and applications will dramatically accelerate in vitro and in vivo influenza virus studies.

  6. Searching for success: Development of a combined patient-reported-outcome ("PRO") criterion for operationalizing success in multi-modal pain therapy.

    Science.gov (United States)

    Donath, Carolin; Dorscht, Lisa; Graessel, Elmar; Sittl, Reinhard; Schoen, Christoph

    2015-07-17

    There is a need for a way to measure success in multi-modal pain therapy that researchers and clinicians can agree upon. According to developments in health services research, operationalizing success should take patient-reported outcomes into account. We will present a success criterion for pain therapy that combines different patient-reported variables and includes validity measures. The usable criterion should be part of a statistically significant and satisfactory model identifying predictors of successful pain therapy. Routine data from 375 patients treated with multi-modal pain therapy from 2008 to 2013 were used. The change scores of five constructs were used for the combined success criterion: pain severity, disability due to pain, depressiveness, and physical- and mental-health-related quality of life. According to the literature, an improvement of at least ½ standard deviation was required on at least four of the five constructs to count as successful. A three-step analytical approach including multiple binary logistic regression analysis was chosen to identify the predictors of therapy success with the success criterion as the dependent variable. A total of 58.1% of the patients were classified as successful. Convergent and predictive validity data show significant correlations between the criterion and established instruments, while discriminative validity could also be shown. A multiple binary logistic regression analysis confirmed the feasibility; a significant model (Chi(2) (8) = 52.585; p multi-modal pain therapy. The criterion was based on basic constructs used in pain therapy and used widespread validated self-rating instruments. Thus, it should be easy to transfer this criterion to other institutions.

  7. Multi-Modal Curriculum Learning for Semi-Supervised Image Classification.

    Science.gov (United States)

    Gong, Chen; Tao, Dacheng; Maybank, Stephen J; Liu, Wei; Kang, Guoliang; Yang, Jie

    2016-07-01

    Semi-supervised image classification aims to classify a large quantity of unlabeled images by typically harnessing scarce labeled images. Existing semi-supervised methods often suffer from inadequate classification accuracy when encountering difficult yet critical images, such as outliers, because they treat all unlabeled images equally and conduct classifications in an imperfectly ordered sequence. In this paper, we employ the curriculum learning methodology by investigating the difficulty of classifying every unlabeled image. The reliability and the discriminability of these unlabeled images are particularly investigated for evaluating their difficulty. As a result, an optimized image sequence is generated during the iterative propagations, and the unlabeled images are logically classified from simple to difficult. Furthermore, since images are usually characterized by multiple visual feature descriptors, we associate each kind of features with a teacher, and design a multi-modal curriculum learning (MMCL) strategy to integrate the information from different feature modalities. In each propagation, each teacher analyzes the difficulties of the currently unlabeled images from its own modality viewpoint. A consensus is subsequently reached among all the teachers, determining the currently simplest images (i.e., a curriculum), which are to be reliably classified by the multi-modal learner. This well-organized propagation process leveraging multiple teachers and one learner enables our MMCL to outperform five state-of-the-art methods on eight popular image data sets.

  8. Multi-modal use of a socially directed call in bonobos.

    Directory of Open Access Journals (Sweden)

    Emilie Genty

    Full Text Available 'Contest hoots' are acoustically complex vocalisations produced by adult and subadult male bonobos (Pan paniscus. These calls are often directed at specific individuals and regularly combined with gestures and other body signals. The aim of our study was to describe the multi-modal use of this call type and to clarify its communicative and social function. To this end, we observed two large groups of bonobos, which generated a sample of 585 communicative interactions initiated by 10 different males. We found that contest hooting, with or without other associated signals, was produced to challenge and provoke a social reaction in the targeted individual, usually agonistic chase. Interestingly, 'contest hoots' were sometimes also used during friendly play. In both contexts, males were highly selective in whom they targeted by preferentially choosing individuals of equal or higher social rank, suggesting that the calls functioned to assert social status. Multi-modal sequences were not more successful in eliciting reactions than contest hoots given alone, but we found a significant difference in the choice of associated gestures between playful and agonistic contexts. During friendly play, contest hoots were significantly more often combined with soft than rough gestures compared to agonistic challenges, while the calls' acoustic structure remained the same. We conclude that contest hoots indicate the signaller's intention to interact socially with important group members, while the gestures provide additional cues concerning the nature of the desired interaction.

  9. Multi-Modal Use of a Socially Directed Call in Bonobos

    Science.gov (United States)

    Genty, Emilie; Clay, Zanna; Hobaiter, Catherine; Zuberbühler, Klaus

    2014-01-01

    ‘Contest hoots’ are acoustically complex vocalisations produced by adult and subadult male bonobos (Pan paniscus). These calls are often directed at specific individuals and regularly combined with gestures and other body signals. The aim of our study was to describe the multi-modal use of this call type and to clarify its communicative and social function. To this end, we observed two large groups of bonobos, which generated a sample of 585 communicative interactions initiated by 10 different males. We found that contest hooting, with or without other associated signals, was produced to challenge and provoke a social reaction in the targeted individual, usually agonistic chase. Interestingly, ‘contest hoots’ were sometimes also used during friendly play. In both contexts, males were highly selective in whom they targeted by preferentially choosing individuals of equal or higher social rank, suggesting that the calls functioned to assert social status. Multi-modal sequences were not more successful in eliciting reactions than contest hoots given alone, but we found a significant difference in the choice of associated gestures between playful and agonistic contexts. During friendly play, contest hoots were significantly more often combined with soft than rough gestures compared to agonistic challenges, while the calls' acoustic structure remained the same. We conclude that contest hoots indicate the signaller's intention to interact socially with important group members, while the gestures provide additional cues concerning the nature of the desired interaction. PMID:24454745

  10. An Evaluation of the Pedestrian Classification in a Multi-Domain Multi-Modality Setup

    Directory of Open Access Journals (Sweden)

    Alina Miron

    2015-06-01

    Full Text Available The objective of this article is to study the problem of pedestrian classification across different light spectrum domains (visible and far-infrared (FIR and modalities (intensity, depth and motion. In recent years, there has been a number of approaches for classifying and detecting pedestrians in both FIR and visible images, but the methods are difficult to compare, because either the datasets are not publicly available or they do not offer a comparison between the two domains. Our two primary contributions are the following: (1 we propose a public dataset, named RIFIR , containing both FIR and visible images collected in an urban environment from a moving vehicle during daytime; and (2 we compare the state-of-the-art features in a multi-modality setup: intensity, depth and flow, in far-infrared over visible domains. The experiments show that features families, intensity self-similarity (ISS, local binary patterns (LBP, local gradient patterns (LGP and histogram of oriented gradients (HOG, computed from FIR and visible domains are highly complementary, but their relative performance varies across different modalities. In our experiments, the FIR domain has proven superior to the visible one for the task of pedestrian classification, but the overall best results are obtained by a multi-domain multi-modality multi-feature fusion.

  11. Coronary plaque morphology on multi-modality imagining and periprocedural myocardial infarction after percutaneous coronary intervention

    Directory of Open Access Journals (Sweden)

    Akira Sato

    2016-06-01

    Full Text Available Percutaneous coronary intervention (PCI may be complicated by periprocedural myocardial infarction (PMI as manifested by elevated cardiac biomarkers such as creatine kinase (CK-MB or troponin T. The occurrence of PMI has been shown to be associated with worse short- and long-term clinical outcome. However, recent studies suggest that PMI defined by biomarker levels alone is a marker of atherosclerosis burden and procedural complexity but in most cases does not have independent prognostic significance. Diagnostic multi-modality imaging such as intravascular ultrasound, optical coherence tomography, coronary angioscopy, near-infrared spectroscopy, multidetector computed tomography, and magnetic resonance imaging can be used to closely investigate the atherosclerotic lesion in order to detect morphological markers of unstable and vulnerable plaques in the patients undergoing PCI. With the improvement of technical aspects of multimodality coronary imaging, clinical practice and research are increasingly shifting toward defining the clinical implication of plaque morphology and patients outcomes. There were numerous published data regarding the relationship between pre-PCI lesion subsets on multi-modality imaging and post-PCI biomarker levels. In this review, we discuss the relationship between coronary plaque morphology estimated by invasive or noninvasive coronary imaging and the occurrence of PMI. Furthermore, this review underlies that the value of the multimodality coronary imaging approach will become the gold standard for invasive or noninvasive prediction of PMI in clinical practice.

  12. Exogenous Molecular Probes for Targeted Imaging in Cancer: Focus on Multi-modal Imaging

    Directory of Open Access Journals (Sweden)

    Bishnu P. Joshi

    2010-06-01

    Full Text Available Cancer is one of the major causes of mortality and morbidity in our healthcare system. Molecular imaging is an emerging methodology for the early detection of cancer, guidance of therapy, and monitoring of response. The development of new instruments and exogenous molecular probes that can be labeled for multi-modality imaging is critical to this process. Today, molecular imaging is at a crossroad, and new targeted imaging agents are expected to broadly expand our ability to detect and manage cancer. This integrated imaging strategy will permit clinicians to not only localize lesions within the body but also to manage their therapy by visualizing the expression and activity of specific molecules. This information is expected to have a major impact on drug development and understanding of basic cancer biology. At this time, a number of molecular probes have been developed by conjugating various labels to affinity ligands for targeting in different imaging modalities. This review will describe the current status of exogenous molecular probes for optical, scintigraphic, MRI and ultrasound imaging platforms. Furthermore, we will also shed light on how these techniques can be used synergistically in multi-modal platforms and how these techniques are being employed in current research.

  13. 基于多模图像融合理论的人眼球及眼眶肿瘤的三维重建与显示%Three-dimensional reconstruction and display of intraocular and orbital tumors based on multi-modality image fusion theory

    Institute of Scientific and Technical Information of China (English)

    管宇峰; 叶强; 宋志坚

    2005-01-01

    Objective: To study the application of CT and MRI fusion technique in the diagnosis and treatment of intraocular and orbital tumors. Methods: 2D-images of 13 patients with intraocular and orbital tumors were fused by special-point registration and Iterative Local Closest Point(ILCP) method; 3D-fusion images were reconstructed by Ray Tracing method. Results: A 3D-CT-MRI fusion images of intraocular and orbital tumors were reconstructed and displayed. The CT and MRI data of intraocular and orbital tumors were displayed on the same image as a comprehensive whole,which provided a stereogram of 3D-structure of the normal and abnormal orbital tissues. Anatomical structure of the orbit was clearly visualized by 3D-CT-MRI image. Conclusion: The multi-modality fusion technique can provide more accurate and comprehensive information for clinical diagnosis of intraocular and orbital tumors, which is helpful for doctors' planning of surgical operations,clinical education and doctor-patient communication.%目的:研究CT和MRI融合技术在眼球及眼眶肿瘤中的应用.方法:对13例眼球及眼眶肿瘤的CT和MRI的二维图像通过特征点配准结合ILCP法(Iterative Local Closest Point)进行融合,运用Ray Tracing法进行三维融合图像的重建.结果:实现了人眼球及眼眶肿瘤CT和MRI三维融合图像的重建与显示,眼球及眼眶肿瘤的CT和MRI信息综合起来作为一个整体成像在同一幅图像上,立体显示了眼部正常与病变组织的三维结构,提供了眼眶的三维立体视觉,使眼眶的结构便于理解.结论:多模图像融合能使临床获取更准确和全面的诊断信息.它能帮助医师制订周密的手术方案,并且对临床教学及加强医患沟通有重要指导意义.

  14. Composite multi-modal vibration control for a stiffened plate using non-collocated acceleration sensor and piezoelectric actuator

    Science.gov (United States)

    Li, Shengquan; Li, Juan; Mo, Yueping; Zhao, Rong

    2014-01-01

    A novel active method for multi-mode vibration control of an all-clamped stiffened plate (ACSP) is proposed in this paper, using the extended-state-observer (ESO) approach based on non-collocated acceleration sensors and piezoelectric actuators. Considering the estimated capacity of ESO for system state variables, output superposition and control coupling of other modes, external excitation, and model uncertainties simultaneously, a composite control method, i.e., the ESO based vibration control scheme, is employed to ensure the lumped disturbances and uncertainty rejection of the closed-loop system. The phenomenon of phase hysteresis and time delay, caused by non-collocated sensor/actuator pairs, degrades the performance of the control system, even inducing instability. To solve this problem, a simple proportional differential (PD) controller and acceleration feed-forward with an output predictor design produce the control law for each vibration mode. The modal frequencies, phase hysteresis loops and phase lag values due to non-collocated placement of the acceleration sensor and piezoelectric patch actuator are experimentally obtained, and the phase lag is compensated by using the Smith Predictor technology. In order to improve the vibration control performance, the chaos optimization method based on logistic mapping is employed to auto-tune the parameters of the feedback channel. The experimental control system for the ACSP is tested using the dSPACE real-time simulation platform. Experimental results demonstrate that the proposed composite active control algorithm is an effective approach for suppressing multi-modal vibrations.

  15. A Multi-Modal Control Using a Hybrid Pole-Placement-Integral Resonant Controller (PPIR) with Experimental Investigations

    DEFF Research Database (Denmark)

    Nielsen, Søren R.K.; Basu, Biswajit

    2011-01-01

    Control of multi-modal structural vibrations has been an important and challenging problem in flexible structural systems. This paper proposes a new vibration control algorithm for multi-modal structural control. The proposed algorithm combines a pole-placement controller with an integral resonant...... controller. The pole-placement controller is used to achieve a target equivalent modal viscous damping in the system and helps in the suppression of higher modes, which contribute to the vibration response of flexible structures. The integral resonant controller successfully reduces the low frequency...... vibrations e.g. caused by broad-band turbulent wind excitations. Hence, the proposed hybrid controller can effectively suppress complex multi-modal vibrations in flexible systems. Both numerical and experimental studies have been carried out to demonstrate the effectiveness of the proposed algorithm using...

  16. Active vibration control of structure by Active Mass Damper and Multi-Modal Negative Acceleration Feedback control algorithm

    Science.gov (United States)

    Yang, Don-Ho; Shin, Ji-Hwan; Lee, HyunWook; Kim, Seoug-Ki; Kwak, Moon K.

    2017-03-01

    In this study, an Active Mass Damper (AMD) consisting of an AC servo motor, a movable mass connected to the AC servo motor by a ball-screw mechanism, and an accelerometer as a sensor for vibration measurement were considered. Considering the capability of the AC servo motor which can follow the desired displacement accurately, the Negative Acceleration Feedback (NAF) control algorithm which uses the acceleration signal directly and produces the desired displacement for the active mass was proposed. The effectiveness of the NAF control was proved theoretically using a single-degree-of-freedom (SDOF) system. It was found that the stability condition for the NAF control is static and it can effectively increase the damping of the target natural mode without causing instability in the low frequency region. Based on the theoretical results of the SDOF system, the Multi-Modal NAF (MMNAF) control is proposed to suppress the many natural modes of multi-degree-of-freedom (MDOF) systems using a single AMD. It was proved both theoretically and experimentally that the MMNAF control can suppress vibrations of the MDOF system.

  17. A multi-biometric feature-fusion framework for improved uni-modal and multi-modal human identification

    CSIR Research Space (South Africa)

    Brown, K

    2016-05-01

    Full Text Available provide important guidelines that enable the sys- tematic implementation of multi-modal biometric systems for future research and applications. Feature-level fusion is in particular need of these guidelines because of the ”curse of dimensionality” problem.... The training samples were sequentially chosen from one to five and the rest were used for testing. To the best of our knowledge there are no studies that fuse face and fingerprint data acquired from the SDUMLA multi-modal database. B. Pre-processing Pixel...

  18. Development of internal solitary waves in various thermocline regimes - a multi-modal approach

    Directory of Open Access Journals (Sweden)

    T. Gerkema

    2003-01-01

    Full Text Available A numerical analysis is made on the appearance of oceanic internal solitary waves in a multi-modal setting. This is done for observed profiles of stratification from the Sulu Sea and the Bay of Biscay, in which thermocline motion is dominated by the first and third mode, respectively. The results show that persistent solitary waves occur only in the former case, in accordance with the observations. In the Bay of Biscay much energy is transferred from the third mode to lower modes, implying that a uni-modal approach would not have been appropriate. To elaborate on these results in a systematic way, a simple model for the stratification is used; an interpretation is given in terms of regimes of thermocline strength.

  19. Multi-modal human-machine interface of a telerobotic system for remote arc welding

    Institute of Scientific and Technical Information of China (English)

    Li Haichao; Gao Hongming; Wu Lin; Zhang Guangjun

    2008-01-01

    In telerobotic system for remote welding, human-machine interface is one of the most important factor for enhancing capability and efftciency. This paper presents an architecture design of human-machine interface for welding telerobotic system: welding multi-modal human-machine interface. The human-machine interface integrated several control modes, which are namely shared control, teleteaching, supervisory control and local autonomous control. Space mouse, panoramic vision camera and graphics simulation system are also integrated into the human-machine interface for welding teleoperation. Finally, weld seam tracing and welding experiments of U-shape seam are performed by these control modes respectively. The results show that the system has better performance of human-machine interaction and complexity environment welding.

  20. Exploiting Higher Order and Multi-modal Features for 3D Object Detection

    DEFF Research Database (Denmark)

    Kiforenko, Lilita

    2017-01-01

    . The initial work introduces a feature descriptor that uses edge categorisation in combination with a local multi-modal histogram descriptor in order to detect objects with little or no texture or surface variation. The comparison is performed with a state-of-the-art method, which is outperformed...... by the presented edge descriptor. The second work presents an approach for robust detection of multiple objects by combining feature descriptors that capture both surface and edge information. This work presents quantitative results, where the performance of the developed feature descriptor combination is compared......-of-the-art descriptor and to this date, constant improvements of it are presented. The evaluation of PPFs is performed on seven publicly available datasets and it presents not only the performance comparison towards other popularly used methods, but also investigations of the space of possible point pair relations...

  1. Incidental acquisition of foreign language vocabulary through brief multi-modal exposure.

    Science.gov (United States)

    Bisson, Marie-Josée; van Heuven, Walter J B; Conklin, Kathy; Tunney, Richard J

    2013-01-01

    First language acquisition requires relatively little effort compared to foreign language acquisition and happens more naturally through informal learning. Informal exposure can also benefit foreign language learning, although evidence for this has been limited to speech perception and production. An important question is whether informal exposure to spoken foreign language also leads to vocabulary learning through the creation of form-meaning links. Here we tested the impact of exposure to foreign language words presented with pictures in an incidental learning phase on subsequent explicit foreign language learning. In the explicit learning phase, we asked adults to learn translation equivalents of foreign language words, some of which had appeared in the incidental learning phase. Results revealed rapid learning of the foreign language words in the incidental learning phase showing that informal exposure to multi-modal foreign language leads to foreign language vocabulary acquisition. The creation of form-meaning links during the incidental learning phase is discussed.

  2. Incidental acquisition of foreign language vocabulary through brief multi-modal exposure.

    Directory of Open Access Journals (Sweden)

    Marie-Josée Bisson

    Full Text Available First language acquisition requires relatively little effort compared to foreign language acquisition and happens more naturally through informal learning. Informal exposure can also benefit foreign language learning, although evidence for this has been limited to speech perception and production. An important question is whether informal exposure to spoken foreign language also leads to vocabulary learning through the creation of form-meaning links. Here we tested the impact of exposure to foreign language words presented with pictures in an incidental learning phase on subsequent explicit foreign language learning. In the explicit learning phase, we asked adults to learn translation equivalents of foreign language words, some of which had appeared in the incidental learning phase. Results revealed rapid learning of the foreign language words in the incidental learning phase showing that informal exposure to multi-modal foreign language leads to foreign language vocabulary acquisition. The creation of form-meaning links during the incidental learning phase is discussed.

  3. Multi-Modal Ultra-Widefield Imaging Features in Waardenburg Syndrome

    Science.gov (United States)

    Choudhry, Netan; Rao, Rajesh C.

    2015-01-01

    Background Waardenburg syndrome is characterized by a group of features including; telecanthus, a broad nasal root, synophrys of the eyebrows, piedbaldism, heterochromia irides, and deaf-mutism. Hypopigmentation of the choroid is a unique feature of this condition examined with multi-modal Ultra-Widefield Imaging in this report. Material/Methods Report of a single case. Results Bilateral symmetric choroidal hypopigmentation was observed with hypoautofluorescence in the region of hypopigmentation. Fluorescein angiography revealed a normal vasculature, however a thickened choroid was seen on Enhanced-Depth Imaging Spectral-Domain OCT (EDI SD-OCT). Conclusion(s) Choroidal hypopigmentation is a unique feature of Waardenburg syndrome, which can be visualized with ultra-widefield fundus autofluorescence. The choroid may also be thickened in this condition and its thickness measured with EDI SD-OCT. PMID:26114849

  4. Programmable aperture microscopy: A computational method for multi-modal phase contrast and light field imaging

    Science.gov (United States)

    Zuo, Chao; Sun, Jiasong; Feng, Shijie; Zhang, Minliang; Chen, Qian

    2016-05-01

    We demonstrate a simple and cost-effective programmable aperture microscope to realize multi-modal computational imaging by integrating a programmable liquid crystal display (LCD) into a conventional wide-field microscope. The LCD selectively modulates the light distribution at the rear aperture of the microscope objective, allowing numerous imaging modalities, such as bright field, dark field, differential phase contrast, quantitative phase imaging, multi-perspective imaging, and full resolution light field imaging to be achieved and switched rapidly in the same setup, without requiring specialized hardwares and any moving parts. We experimentally demonstrate the success of our method by imaging unstained cheek cells, profiling microlens array, and changing perspective views of thick biological specimens. The post-exposure refocusing of a butterfly mouthpart and RFP-labeled dicot stem cross-section is also presented to demonstrate the full resolution light field imaging capability of our system for both translucent and fluorescent specimens.

  5. Stability, structure and scale: improvements in multi-modal vessel extraction for SEEG trajectory planning.

    Science.gov (United States)

    Zuluaga, Maria A; Rodionov, Roman; Nowell, Mark; Achhala, Sufyan; Zombori, Gergely; Mendelson, Alex F; Cardoso, M Jorge; Miserocchi, Anna; McEvoy, Andrew W; Duncan, John S; Ourselin, Sébastien

    2015-08-01

    Brain vessels are among the most critical landmarks that need to be assessed for mitigating surgical risks in stereo-electroencephalography (SEEG) implantation. Intracranial haemorrhage is the most common complication associated with implantation, carrying significantly associated morbidity. SEEG planning is done pre-operatively to identify avascular trajectories for the electrodes. In current practice, neurosurgeons have no assistance in the planning of electrode trajectories. There is great interest in developing computer-assisted planning systems that can optimise the safety profile of electrode trajectories, maximising the distance to critical structures. This paper presents a method that integrates the concepts of scale, neighbourhood structure and feature stability with the aim of improving robustness and accuracy of vessel extraction within a SEEG planning system. The developed method accounts for scale and vicinity of a voxel by formulating the problem within a multi-scale tensor voting framework. Feature stability is achieved through a similarity measure that evaluates the multi-modal consistency in vesselness responses. The proposed measurement allows the combination of multiple images modalities into a single image that is used within the planning system to visualise critical vessels. Twelve paired data sets from two image modalities available within the planning system were used for evaluation. The mean Dice similarity coefficient was 0.89 ± 0.04, representing a statistically significantly improvement when compared to a semi-automated single human rater, single-modality segmentation protocol used in clinical practice (0.80 ± 0.03). Multi-modal vessel extraction is superior to semi-automated single-modality segmentation, indicating the possibility of safer SEEG planning, with reduced patient morbidity.

  6. Classification algorithms with multi-modal data fusion could accurately distinguish neuromyelitis optica from multiple sclerosis.

    Science.gov (United States)

    Eshaghi, Arman; Riyahi-Alam, Sadjad; Saeedi, Roghayyeh; Roostaei, Tina; Nazeri, Arash; Aghsaei, Aida; Doosti, Rozita; Ganjgahi, Habib; Bodini, Benedetta; Shakourirad, Ali; Pakravan, Manijeh; Ghana'ati, Hossein; Firouznia, Kavous; Zarei, Mojtaba; Azimi, Amir Reza; Sahraian, Mohammad Ali

    2015-01-01

    Neuromyelitis optica (NMO) exhibits substantial similarities to multiple sclerosis (MS) in clinical manifestations and imaging results and has long been considered a variant of MS. With the advent of a specific biomarker in NMO, known as anti-aquaporin 4, this assumption has changed; however, the differential diagnosis remains challenging and it is still not clear whether a combination of neuroimaging and clinical data could be used to aid clinical decision-making. Computer-aided diagnosis is a rapidly evolving process that holds great promise to facilitate objective differential diagnoses of disorders that show similar presentations. In this study, we aimed to use a powerful method for multi-modal data fusion, known as a multi-kernel learning and performed automatic diagnosis of subjects. We included 30 patients with NMO, 25 patients with MS and 35 healthy volunteers and performed multi-modal imaging with T1-weighted high resolution scans, diffusion tensor imaging (DTI) and resting-state functional MRI (fMRI). In addition, subjects underwent clinical examinations and cognitive assessments. We included 18 a priori predictors from neuroimaging, clinical and cognitive measures in the initial model. We used 10-fold cross-validation to learn the importance of each modality, train and finally test the model performance. The mean accuracy in differentiating between MS and NMO was 88%, where visible white matter lesion load, normal appearing white matter (DTI) and functional connectivity had the most important contributions to the final classification. In a multi-class classification problem we distinguished between all of 3 groups (MS, NMO and healthy controls) with an average accuracy of 84%. In this classification, visible white matter lesion load, functional connectivity, and cognitive scores were the 3 most important modalities. Our work provides preliminary evidence that computational tools can be used to help make an objective differential diagnosis of NMO and MS.

  7. Multi-Modal Treatment Approach to Painful Rib Syndrome: Case Series and Review of the Literature.

    Science.gov (United States)

    Germanovich, Andrew; Ferrante, Francis Michael

    2016-03-01

    Mechanical chest wall pain is a common presenting complaint in the primary care office, emergency room, and specialty clinic. Diagnostic testing is often expensive due to similar presenting symptoms that may involve the heart or lungs. Since the chest wall biomechanics are poorly understood by many clinicians, few effective treatments are offered to patients with rib-related acute pain, which may lead to chronic pain. This case series and literature review illustrates biomechanics involved in the pathogenesis of rib-related chest wall pain and suggests an effective multi-modal treatment plan using interventional techniques with emphasis on manual manipulative techniques. Case series and literature review. Pain clinic in an academic medical center. This is a case series of 3 patients diagnosed with painful rib syndrome using osteopathic palpatory physical examination techniques. Ultrasound-guided intercostal nerve blocks were followed by manual manipulation of mechanically displaced ribs as a part of our multi-modal treatment plan. A review of the literature was undertaken to clarify nomenclature used in the description of rib-related pain, to describe the biomechanics involved in the pathogenesis of mechanical rib pain, and to illustrate the use of effective manual manipulation techniques. This review is introductory and not a complete review of all manual or interventional pain management techniques applicable to the treatment of mechanical rib-related pain. Manual diagnostic and therapeutic skills can be learned by physicians to treat biomechanically complex rib-related chest wall pain in combination with interventional image-guided techniques. Pain physicians should learn certain basic manual manipulation skills both for diagnostic and therapeutic purposes.

  8. Classification algorithms with multi-modal data fusion could accurately distinguish neuromyelitis optica from multiple sclerosis

    Directory of Open Access Journals (Sweden)

    Arman Eshaghi

    2015-01-01

    Full Text Available Neuromyelitis optica (NMO exhibits substantial similarities to multiple sclerosis (MS in clinical manifestations and imaging results and has long been considered a variant of MS. With the advent of a specific biomarker in NMO, known as anti-aquaporin 4, this assumption has changed; however, the differential diagnosis remains challenging and it is still not clear whether a combination of neuroimaging and clinical data could be used to aid clinical decision-making. Computer-aided diagnosis is a rapidly evolving process that holds great promise to facilitate objective differential diagnoses of disorders that show similar presentations. In this study, we aimed to use a powerful method for multi-modal data fusion, known as a multi-kernel learning and performed automatic diagnosis of subjects. We included 30 patients with NMO, 25 patients with MS and 35 healthy volunteers and performed multi-modal imaging with T1-weighted high resolution scans, diffusion tensor imaging (DTI and resting-state functional MRI (fMRI. In addition, subjects underwent clinical examinations and cognitive assessments. We included 18 a priori predictors from neuroimaging, clinical and cognitive measures in the initial model. We used 10-fold cross-validation to learn the importance of each modality, train and finally test the model performance. The mean accuracy in differentiating between MS and NMO was 88%, where visible white matter lesion load, normal appearing white matter (DTI and functional connectivity had the most important contributions to the final classification. In a multi-class classification problem we distinguished between all of 3 groups (MS, NMO and healthy controls with an average accuracy of 84%. In this classification, visible white matter lesion load, functional connectivity, and cognitive scores were the 3 most important modalities. Our work provides preliminary evidence that computational tools can be used to help make an objective differential diagnosis

  9. Architecture of the Multi-Modal Organizational Research and Production Heterogeneous Network (MORPHnet)

    Energy Technology Data Exchange (ETDEWEB)

    Aiken, R.J.; Carlson, R.A.; Foster, I.T. [and others

    1997-01-01

    The research and education (R&E) community requires persistent and scaleable network infrastructure to concurrently support production and research applications as well as network research. In the past, the R&E community has relied on supporting parallel network and end-node infrastructures, which can be very expensive and inefficient for network service managers and application programmers. The grand challenge in networking is to provide support for multiple, concurrent, multi-layer views of the network for the applications and the network researchers, and to satisfy the sometimes conflicting requirements of both while ensuring one type of traffic does not adversely affect the other. Internet and telecommunications service providers will also benefit from a multi-modal infrastructure, which can provide smoother transitions to new technologies and allow for testing of these technologies with real user traffic while they are still in the pre-production mode. The authors proposed approach requires the use of as much of the same network and end system infrastructure as possible to reduce the costs needed to support both classes of activities (i.e., production and research). Breaking the infrastructure into segments and objects (e.g., routers, switches, multiplexors, circuits, paths, etc.) gives the capability to dynamically construct and configure the virtual active networks to address these requirements. These capabilities must be supported at the campus, regional, and wide-area network levels to allow for collaboration by geographically dispersed groups. The Multi-Modal Organizational Research and Production Heterogeneous Network (MORPHnet) described in this report is an initial architecture and framework designed to identify and support the capabilities needed for the proposed combined infrastructure and to address related research issues.

  10. Providing University Education in Physical Geography across the South Pacific Islands: Multi-Modal Course Delivery and Student Grade Performance

    Science.gov (United States)

    Terry, James P.; Poole, Brian

    2012-01-01

    Enormous distances across the vast South Pacific hinder student access to the main Fiji campus of the regional tertiary education provider, the University of the South Pacific (USP). Fortunately, USP has been a pioneer in distance education (DE) and promotes multi-modal delivery of programmes. Geography has embraced DE, but doubts remain about…

  11. Multi-modal assessment of neurovascular coupling during cerebral ischaemia and reperfusion using remote middle cerebral artery occlusion

    DEFF Research Database (Denmark)

    Sutherland, Brad A; Fordsmann, Jonas C; Martin, Chris

    2017-01-01

    how neurovascular coupling is affected hyperacutely during cerebral ischaemia and reperfusion. We have developed a remote middle cerebral artery occlusion model in the rat, which enables multi-modal assessment of neurovascular coupling immediately prior to, during and immediately following reperfusion...

  12. Effective Beginning Handwriting Instruction: Multi-Modal, Consistent Format for 2 Years, and Linked to Spelling and Composing

    Science.gov (United States)

    Wolf, Beverly; Abbott, Robert D.; Berninger, Virginia W.

    2017-01-01

    In Study 1, the treatment group (N = 33 first graders, M = 6 years 10 months, 16 girls) received Slingerland multi-modal (auditory, visual, tactile, motor through hand, and motor through mouth) manuscript (unjoined) handwriting instruction embedded in systematic spelling, reading, and composing lessons; and the control group (N = 16 first graders,…

  13. Sex in the Curriculum: The Effect of a Multi-Modal Sexual History-Taking Module on Medical Student Skills

    Science.gov (United States)

    Lindau, Stacy Tessler; Goodrich, Katie G.; Leitsch, Sara A.; Cook, Sandy

    2008-01-01

    Purpose: The objective of this study was to determine the effect of a multi-modal curricular intervention designed to teach sexual history-taking skills to medical students. The Association of Professors of Gynecology and Obstetrics, the National Board of Medical Examiners, and others, have identified sexual history-taking as a learning objective…

  14. Sex in the Curriculum: The Effect of a Multi-Modal Sexual History-Taking Module on Medical Student Skills

    Science.gov (United States)

    Lindau, Stacy Tessler; Goodrich, Katie G.; Leitsch, Sara A.; Cook, Sandy

    2008-01-01

    Purpose: The objective of this study was to determine the effect of a multi-modal curricular intervention designed to teach sexual history-taking skills to medical students. The Association of Professors of Gynecology and Obstetrics, the National Board of Medical Examiners, and others, have identified sexual history-taking as a learning objective…

  15. Risk factors for insufficient perioperative oral nutrition after hip fracture surgery within a multi-modal rehabilitation programme

    DEFF Research Database (Denmark)

    Foss, Nicolai B; Jensen, Pia S; Kehlet, Henrik

    2007-01-01

    To examine oral nutritional intake in the perioperative phase in elderly hip fracture patients treated according to a well-defined multi-modal rehabilitation program, including unselected oral nutritional supplementation, and to identify independent risk factors for insufficient nutritional intake....

  16. DIAGNOSIS-GUIDED METHOD FOR IDENTIFYING MULTI-MODALITY NEUROIMAGING BIOMARKERS ASSOCIATED WITH GENETIC RISK FACTORS IN ALZHEIMER'S DISEASE.

    Science.gov (United States)

    Hao, Xiaoke; Yan, Jingwen; Yao, Xiaohui; Risacher, Shannon L; Saykin, Andrew J; Zhang, Daoqiang; Shen, Li

    2016-01-01

    Many recent imaging genetic studies focus on detecting the associations between genetic markers such as single nucleotide polymorphisms (SNPs) and quantitative traits (QTs). Although there exist a large number of generalized multivariate regression analysis methods, few of them have used diagnosis information in subjects to enhance the analysis performance. In addition, few of models have investigated the identification of multi-modality phenotypic patterns associated with interesting genotype groups in traditional methods. To reveal disease-relevant imaging genetic associations, we propose a novel diagnosis-guided multi-modality (DGMM) framework to discover multi-modality imaging QTs that are associated with both Alzheimer's disease (AD) and its top genetic risk factor (i.e., APOE SNP rs429358). The strength of our proposed method is that it explicitly models the priori diagnosis information among subjects in the objective function for selecting the disease-relevant and robust multi-modality QTs associated with the SNP. We evaluate our method on two modalities of imaging phenotypes, i.e., those extracted from structural magnetic resonance imaging (MRI) data and fluorodeoxyglucose positron emission tomography (FDG-PET) data in the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. The experimental results demonstrate that our proposed method not only achieves better performances under the metrics of root mean squared error and correlation coefficient but also can identify common informative regions of interests (ROIs) across multiple modalities to guide the disease-induced biological interpretation, compared with other reference methods.

  17. A novel automated method for doing registration and 3D reconstruction from multi-modal RGB/IR image sequences

    Science.gov (United States)

    Kirby, Richard; Whitaker, Ross

    2016-09-01

    In recent years, the use of multi-modal camera rigs consisting of an RGB sensor and an infrared (IR) sensor have become increasingly popular for use in surveillance and robotics applications. The advantages of using multi-modal camera rigs include improved foreground/background segmentation, wider range of lighting conditions under which the system works, and richer information (e.g. visible light and heat signature) for target identification. However, the traditional computer vision method of mapping pairs of images using pixel intensities or image features is often not possible with an RGB/IR image pair. We introduce a novel method to overcome the lack of common features in RGB/IR image pairs by using a variational methods optimization algorithm to map the optical flow fields computed from different wavelength images. This results in the alignment of the flow fields, which in turn produce correspondences similar to those found in a stereo RGB/RGB camera rig using pixel intensities or image features. In addition to aligning the different wavelength images, these correspondences are used to generate dense disparity and depth maps. We obtain accuracies similar to other multi-modal image alignment methodologies as long as the scene contains sufficient depth variations, although a direct comparison is not possible because of the lack of standard image sets from moving multi-modal camera rigs. We test our method on synthetic optical flow fields and on real image sequences that we created with a multi-modal binocular stereo RGB/IR camera rig. We determine our method's accuracy by comparing against a ground truth.

  18. Building an EEG-fMRI Multi-Modal Brain Graph: A Concurrent EEG-fMRI Study.

    Science.gov (United States)

    Yu, Qingbao; Wu, Lei; Bridwell, David A; Erhardt, Erik B; Du, Yuhui; He, Hao; Chen, Jiayu; Liu, Peng; Sui, Jing; Pearlson, Godfrey; Calhoun, Vince D

    2016-01-01

    The topological architecture of brain connectivity has been well-characterized by graph theory based analysis. However, previous studies have primarily built brain graphs based on a single modality of brain imaging data. Here we develop a framework to construct multi-modal brain graphs using concurrent EEG-fMRI data which are simultaneously collected during eyes open (EO) and eyes closed (EC) resting states. FMRI data are decomposed into independent components with associated time courses by group independent component analysis (ICA). EEG time series are segmented, and then spectral power time courses are computed and averaged within 5 frequency bands (delta; theta; alpha; beta; low gamma). EEG-fMRI brain graphs, with EEG electrodes and fMRI brain components serving as nodes, are built by computing correlations within and between fMRI ICA time courses and EEG spectral power time courses. Dynamic EEG-fMRI graphs are built using a sliding window method, versus static ones treating the entire time course as stationary. In global level, static graph measures and properties of dynamic graph measures are different across frequency bands and are mainly showing higher values in eyes closed than eyes open. Nodal level graph measures of a few brain components are also showing higher values during eyes closed in specific frequency bands. Overall, these findings incorporate fMRI spatial localization and EEG frequency information which could not be obtained by examining only one modality. This work provides a new approach to examine EEG-fMRI associations within a graph theoretic framework with potential application to many topics.

  19. Building an EEG-fMRI multi-modal brain graph: a concurrent EEG-fMRI study

    Directory of Open Access Journals (Sweden)

    Qingbao Yu

    2016-09-01

    Full Text Available The topological architecture of brain connectivity has been well characterized by graph theory based analysis. However, previous studies have primarily built brain graphs based on a single modality of brain imaging data. Here we develop a framework to construct multi-modal brain graphs using concurrent EEG-fMRI data which are simultaneously collected during eyes open (EO and eyes closed (EC resting states. FMRI data are decomposed into independent components with associated time courses by group independent component analysis (ICA. EEG time series are segmented, and then spectral power time courses are computed and averaged within 5 frequency bands (delta; theta; alpha; beta; low gamma. EEG-fMRI brain graphs, with EEG electrodes and fMRI brain components serving as nodes, are built by computing correlations within and between fMRI ICA time courses and EEG spectral power time courses. Dynamic EEG-fMRI graphs are built using a sliding window method, versus static ones treating the entire time course as stationary. In global level, static graph measures and properties of dynamic graph measures are different across frequency bands and are mainly showing higher values in eyes closed than eyes open. Nodal level graph measures of a few brain components are also showing higher values during eyes closed in specific frequency bands. Overall, these findings incorporate fMRI spatial localization and EEG frequency information which could not be obtained by examining only one modality. This work provides a new approach to examine EEG-fMRI associations within a graph theoretic framework with potential application to many topics.

  20. Building an EEG-fMRI Multi-Modal Brain Graph: A Concurrent EEG-fMRI Study

    Science.gov (United States)

    Yu, Qingbao; Wu, Lei; Bridwell, David A.; Erhardt, Erik B.; Du, Yuhui; He, Hao; Chen, Jiayu; Liu, Peng; Sui, Jing; Pearlson, Godfrey; Calhoun, Vince D.

    2016-01-01

    The topological architecture of brain connectivity has been well-characterized by graph theory based analysis. However, previous studies have primarily built brain graphs based on a single modality of brain imaging data. Here we develop a framework to construct multi-modal brain graphs using concurrent EEG-fMRI data which are simultaneously collected during eyes open (EO) and eyes closed (EC) resting states. FMRI data are decomposed into independent components with associated time courses by group independent component analysis (ICA). EEG time series are segmented, and then spectral power time courses are computed and averaged within 5 frequency bands (delta; theta; alpha; beta; low gamma). EEG-fMRI brain graphs, with EEG electrodes and fMRI brain components serving as nodes, are built by computing correlations within and between fMRI ICA time courses and EEG spectral power time courses. Dynamic EEG-fMRI graphs are built using a sliding window method, versus static ones treating the entire time course as stationary. In global level, static graph measures and properties of dynamic graph measures are different across frequency bands and are mainly showing higher values in eyes closed than eyes open. Nodal level graph measures of a few brain components are also showing higher values during eyes closed in specific frequency bands. Overall, these findings incorporate fMRI spatial localization and EEG frequency information which could not be obtained by examining only one modality. This work provides a new approach to examine EEG-fMRI associations within a graph theoretic framework with potential application to many topics. PMID:27733821

  1. Experimental verification of a novel MEMS multi-modal vibration energy harvester for ultra-low power remote sensing nodes

    Science.gov (United States)

    Iannacci, J.; Sordo, G.; Serra, E.; Kucera, M.; Schmid, U.

    2015-05-01

    In this work, we discuss the verification and preliminary experimental characterization of a MEMS-based vibration Energy Harvester (EH) design. The device, named Four-Leaf Clover (FLC), is based on a circular-shaped mechanical resonator with four petal-like mass-spring cascaded systems. This solution introduces several mechanical Degrees of Freedom (DOFs), and therefore enables multiple resonant modes and deformation shapes in the vibrations frequency range of interest. The target is to realize a wideband multi-modal EH-MEMS device, that overcomes the typical narrowband working characteristics of standard cantilevered EHs, by ensuring flexible and adaptable power source to ultra-low power electronics for integrated remote sensing nodes (e.g. Wireless Sensor Networks - WSNs) in the Internet of Things (IoT) scenario, aiming to self-powered and energy autonomous smart systems. Finite Element Method simulations of the FLC EH-MEMS show the presence of several resonant modes for vibrations up to 4-5 kHz, and level of converted power up to a few μW at resonance and in closed-loop conditions (i.e. with resistive load). On the other hand, the first experimental tests of FLC fabricated samples, conducted with a Laser Doppler Vibrometer (LDV), proved the presence of several resonant modes, and allowed to validate the accuracy of the FEM modeling method. Such a good accordance holds validity for what concerns the coupled field behavior of the FLC EH-MEMS, as well. Both measurements and simulations performed at 190 Hz (i.e. out of resonance) showed the generation of power in the range of nW (Root Mean Square - RMS values). Further steps of this work will include the experimental characterization in a full range of vibrations, aiming to prove the whole functionality of the FLC EH-MEMS proposed design concept.

  2. Multi-modal proteomic analysis of retinal protein expression alterations in a rat model of diabetic retinopathy.

    Directory of Open Access Journals (Sweden)

    Heather D VanGuilder

    Full Text Available BACKGROUND: As a leading cause of adult blindness, diabetic retinopathy is a prevalent and profound complication of diabetes. We have previously reported duration-dependent changes in retinal vascular permeability, apoptosis, and mRNA expression with diabetes in a rat model system. The aim of this study was to identify retinal proteomic alterations associated with functional dysregulation of the diabetic retina to better understand diabetic retinopathy pathogenesis and that could be used as surrogate endpoints in preclinical drug testing studies. METHODOLOGY/PRINCIPAL FINDINGS: A multi-modal proteomic approach of antibody (Luminex-, electrophoresis (DIGE-, and LC-MS (iTRAQ-based quantitation methods was used to maximize coverage of the retinal proteome. Transcriptomic profiling through microarray analysis was included to identify additional targets and assess potential regulation of protein expression changes at the mRNA level. The proteomic approaches proved complementary, with limited overlap in proteomic coverage. Alterations in pro-inflammatory, signaling and crystallin family proteins were confirmed by orthogonal methods in multiple independent animal cohorts. In an independent experiment, insulin replacement therapy normalized the expression of some proteins (Dbi, Anxa5 while other proteins (Cp, Cryba3, Lgals3, Stat3 were only partially normalized and Fgf2 and Crybb2 expression remained elevated. CONCLUSIONS/SIGNIFICANCE: These results expand the understanding of the changes in retinal protein expression occurring with diabetes and their responsiveness to normalization of blood glucose through insulin therapy. These proteins, especially those not normalized by insulin therapy, may also be useful in preclinical drug development studies.

  3. Multi-modal Bio-metrics Evaluation for Non-destructive Age States Determination of Tomato Plants (Solanum lycopersicum

    Directory of Open Access Journals (Sweden)

    Muhammad Makky

    2016-06-01

    Full Text Available Every plant has unique morphological features, and can be used for its characteristics identity, such as age. When the plants grow, their morphological features may change, observable visually or by optical equipment. These various morphology transformations were categorized as multi-modal Bio-metrics. In this study, tomatoes from local cultivar were grown in a net house, in west Sumatra. The growth medium comprised of soil, husk, and manures with the composition of 1: 1: 1 respectively. For best growth, plants were watered regularly, and protect from pests and weeds. The observations were performed on 21st, 42nd, and 63rd day after sowing (DAS. The samples were the leaflets of the primary compound leaves of the plants. The leaflets were cut and digitized using a high-resolution colour scanner. The imaging performed at 300 dpi resolution, and the recorded image subsequently processed by the image processing software. Image segmentation performed to remove background from the object. Furthermore, the greenish of leaf object in the image were measured in RGB colour space. The leaf dimensions and area were quantified by the software, as well as the length of the leaflet main vein at central axis.  Two secondary leaflet’s blades were selected manually, and the angle formed between the blades and the main vein was measured. A Statistical engineering program was used to identify the principal morphology characteristics of the leaf, by means of Principal component analysis (PCA. Mathematical models were developed based on the principal component values and leaflets position to determine the plants age and state. Results showed all model have coefficient of correlation higher than 0.99 indicating acceptable accuracy.

  4. An interactive, multi-modal Anatomy workshop improves academic performance in the health sciences: a cohort study.

    Science.gov (United States)

    Nicholson, Leslie L; Reed, Darren; Chan, Cliffton

    2016-01-12

    Students often strategically adopt surface approaches to learning anatomy in order to pass this necessarily content-heavy subject. The consequence of this approach, without understanding and contextualisation, limits transfer of anatomical knowledge to clinical applications. Encouraging deep approaches to learning is challenging in the current environment of lectures and laboratory-based practica. A novel interactive anatomy workshop was proposed in an attempt to address this issue. This workshop comprised of body painting, clay modelling, white-boarding and quizzes, and was undertaken by 66 health science students utilising their preferred learning styles. Performance was measured prior to the workshop at the mid-semester examination and after the workshop at the end-semester examination. Differences between mid- and end-semester performances were calculated and compared between workshop attendees and non-attendees. Baseline, post-workshop and follow-up surveys were administered to identify learning styles, goals for attendance, useful aspects of the workshop and self-confidence ratings. Workshop attendees significantly improved their performance compared to non-attendees (p = 0.001) despite a difference at baseline (p = 0.05). Increased self-confidence was reported by the attendees (p learning, 97% of attendees reported utilising multi-modal learning styles. Five main goals for participating in the workshop included: understanding, strategic engagement, examination preparation, memorisation and increasing self-confidence. All attendees reported achieving these goals. The most useful components of the workshop were body painting and clay modelling. This interactive workshop improved attendees' examination performance and promoted engaged-enquiry and deeper learning. This tool accommodates varied learning styles and improves self-confidence, which may be a valuable supplement to traditional anatomy teaching.

  5. Multi-modal target detection for autonomous wide area search and surveillance

    Science.gov (United States)

    Breckon, Toby P.; Gaszczak, Anna; Han, Jiwan; Eichner, Marcin L.; Barnes, Stuart E.

    2013-10-01

    Generalised wide are search and surveillance is a common-place tasking for multi-sensory equipped autonomous systems. Here we present on a key supporting topic to this task - the automatic interpretation, fusion and detected target reporting from multi-modal sensor information received from multiple autonomous platforms deployed for wide-area environment search. We detail the realization of a real-time methodology for the automated detection of people and vehicles using combined visible-band (EO), thermal-band (IR) and radar sensing from a deployed network of multiple autonomous platforms (ground and aerial). This facilities real-time target detection, reported with varying levels of confidence, using information from both multiple sensors and multiple sensor platforms to provide environment-wide situational awareness. A range of automatic classification approaches are proposed, driven by underlying machine learning techniques, that facilitate the automatic detection of either target type with cross-modal target confirmation. Extended results are presented that show both the detection of people and vehicles under varying conditions in both isolated rural and cluttered urban environments with minimal false positive detection. Performance evaluation is presented at an episodic level with individual classifiers optimized for maximal each object of interest (vehicle/person) detection over a given search path/pattern of the environment, across all sensors and modalities, rather than on a per sensor sample basis. Episodic target detection, evaluated over a number of wide-area environment search and reporting tasks, generally exceeds 90%+ for the targets considered here.

  6. Registration strategies for multi-modal whole-body MRI mosaicing.

    Science.gov (United States)

    Ceranka, Jakub; Polfliet, Mathias; Lecouvet, Frédéric; Michoux, Nicolas; de Mey, Johan; Vandemeulebroucke, Jef

    2017-06-21

    To test and compare different registration approaches for performing whole-body diffusion-weighted (wbDWI) image station mosaicing, and its alignment to corresponding anatomical T1 whole-body image. Four different registration strategies aiming at mosaicing of diffusion-weighted image stations, and their alignment to the corresponding whole-body anatomical image, were proposed and evaluated. These included two-step approaches, where diffusion-weighted stations are first combined in a pairwise (Strategy 1) or groupwise (Strategy 2) manner and later non-rigidly aligned to the anatomical image; a direct pairwise mapping of DWI stations onto the anatomical image (Strategy 3); and simultaneous mosaicing of DWI and alignment to the anatomical image (Strategy 4). Additionally, different images driving the registration were investigated. Experiments were performed for 20 whole-body images of patients with bone metastases. Strategies 1 and 2 showed significant improvement in mosaicing accuracy with respect to the non-registered images (P multi-modal alignment. Magn Reson Med, 2017. © 2017 International Society for Magnetic Resonance in Medicine. © 2017 International Society for Magnetic Resonance in Medicine.

  7. Multi-Modal Neuroimaging Feature Learning for Multi-Class Diagnosis of Alzheimer’s Disease

    Science.gov (United States)

    Liu, Siqi; Liu, Sidong; Cai, Weidong; Che, Hangyu; Pujol, Sonia; Kikinis, Ron; Feng, Dagan; Fulham, Michael J.

    2015-01-01

    The accurate diagnosis of Alzheimers disease (AD) is essential for patient care and will be increasingly important as disease modifying agents become available, early in the course of the disease. Although studies have applied machine learning methods for the computer aided diagnosis (CAD) of AD, a bottleneck in the diagnostic performance was shown in previous methods, due to the lacking of efficient strategies for representing neuroimaging biomarkers. In this study, we designed a novel diagnostic framework with deep learning architecture to aid the diagnosis of AD. This framework uses a zero-masking strategy for data fusion to extract complementary information from multiple data modalities. Compared to the previous state-of-the-art workflows, our method is capable of fusing multi-modal neuroimaging features in one setting and has the potential to require less labelled data. A performance gain was achieved in both binary classification and multi-class classification of AD. The advantages and limitations of the proposed framework are discussed. PMID:25423647

  8. Holographic Raman tweezers controlled by multi-modal natural user interface

    Science.gov (United States)

    Tomori, Zoltán; Keša, Peter; Nikorovič, Matej; Kaňka, Jan; Jákl, Petr; Šerý, Mojmír; Bernatová, Silvie; Valušová, Eva; Antalík, Marián; Zemánek, Pavel

    2016-01-01

    Holographic optical tweezers provide a contactless way to trap and manipulate several microobjects independently in space using focused laser beams. Although the methods of fast and efficient generation of optical traps are well developed, their user friendly control still lags behind. Even though several attempts have appeared recently to exploit touch tablets, 2D cameras, or Kinect game consoles, they have not yet reached the level of natural human interface. Here we demonstrate a multi-modal ‘natural user interface’ approach that combines finger and gaze tracking with gesture and speech recognition. This allows us to select objects with an operator’s gaze and voice, to trap the objects and control their positions via tracking of finger movement in space and to run semi-automatic procedures such as acquisition of Raman spectra from preselected objects. This approach takes advantage of the power of human processing of images together with smooth control of human fingertips and downscales these skills to control remotely the motion of microobjects at microscale in a natural way for the human operator.

  9. MINC 2.0: A Flexible Format for Multi-Modal Images

    Science.gov (United States)

    Vincent, Robert D.; Neelin, Peter; Khalili-Mahani, Najmeh; Janke, Andrew L.; Fonov, Vladimir S.; Robbins, Steven M.; Baghdadi, Leila; Lerch, Jason; Sled, John G.; Adalat, Reza; MacDonald, David; Zijdenbos, Alex P.; Collins, D. Louis; Evans, Alan C.

    2016-01-01

    It is often useful that an imaging data format can afford rich metadata, be flexible, scale to very large file sizes, support multi-modal data, and have strong inbuilt mechanisms for data provenance. Beginning in 1992, MINC was developed as a system for flexible, self-documenting representation of neuroscientific imaging data with arbitrary orientation and dimensionality. The MINC system incorporates three broad components: a file format specification, a programming library, and a growing set of tools. In the early 2000's the MINC developers created MINC 2.0, which added support for 64-bit file sizes, internal compression, and a number of other modern features. Because of its extensible design, it has been easy to incorporate details of provenance in the header metadata, including an explicit processing history, unique identifiers, and vendor-specific scanner settings. This makes MINC ideal for use in large scale imaging studies and databases. It also makes it easy to adapt to new scanning sequences and modalities. PMID:27563289

  10. Multi-modal Patient Cohort Identification from EEG Report and Signal Data

    Science.gov (United States)

    Goodwin, Travis R.; Harabagiu, Sanda M.

    2016-01-01

    Clinical electroencephalography (EEG) is the most important investigation in the diagnosis and management of epilepsies. An EEG records the electrical activity along the scalp and measures spontaneous electrical activity of the brain. Because the EEG signal is complex, its interpretation is known to produce moderate inter-observer agreement among neurologists. This problem can be addressed by providing clinical experts with the ability to automatically retrieve similar EEG signals and EEG reports through a patient cohort retrieval system operating on a vast archive of EEG data. In this paper, we present a multi-modal EEG patient cohort retrieval system called MERCuRY which leverages the heterogeneous nature of EEG data by processing both the clinical narratives from EEG reports as well as the raw electrode potentials derived from the recorded EEG signal data. At the core of MERCuRY is a novel multimodal clinical indexing scheme which relies on EEG data representations obtained through deep learning. The index is used by two clinical relevance models that we have generated for identifying patient cohorts satisfying the inclusion and exclusion criteria expressed in natural language queries. Evaluations of the MERCuRY system measured the relevance of the patient cohorts, obtaining MAP scores of 69.87% and a NDCG of 83.21%. PMID:28269938

  11. Multi-Modal Dictionary Learning for Image Separation With Application in Art Investigation

    Science.gov (United States)

    Deligiannis, Nikos; Mota, Joao F. C.; Cornelis, Bruno; Rodrigues, Miguel R. D.; Daubechies, Ingrid

    2017-02-01

    In support of art investigation, we propose a new source separation method that unmixes a single X-ray scan acquired from double-sided paintings. In this problem, the X-ray signals to be separated have similar morphological characteristics, which brings previous source separation methods to their limits. Our solution is to use photographs taken from the front and back-side of the panel to drive the separation process. The crux of our approach relies on the coupling of the two imaging modalities (photographs and X-rays) using a novel coupled dictionary learning framework able to capture both common and disparate features across the modalities using parsimonious representations; the common component models features shared by the multi-modal images, whereas the innovation component captures modality-specific information. As such, our model enables the formulation of appropriately regularized convex optimization procedures that lead to the accurate separation of the X-rays. Our dictionary learning framework can be tailored both to a single- and a multi-scale framework, with the latter leading to a significant performance improvement. Moreover, to improve further on the visual quality of the separated images, we propose to train coupled dictionaries that ignore certain parts of the painting corresponding to craquelure. Experimentation on synthetic and real data - taken from digital acquisition of the Ghent Altarpiece (1432) - confirms the superiority of our method against the state-of-the-art morphological component analysis technique that uses either fixed or trained dictionaries to perform image separation.

  12. A multi-modal treatment approach for the shoulder: A 4 patient case series

    Directory of Open Access Journals (Sweden)

    Pollard Henry

    2005-09-01

    Full Text Available Abstract Background This paper describes the clinical management of four cases of shoulder impingement syndrome using a conservative multimodal treatment approach. Clinical Features Four patients presented to a chiropractic clinic with chronic shoulder pain, tenderness in the shoulder region and a limited range of motion with pain and catching. After physical and orthopaedic examination a clinical diagnosis of shoulder impingement syndrome was reached. The four patients were admitted to a multi-modal treatment protocol including soft tissue therapy (ischaemic pressure and cross-friction massage, 7 minutes of phonophoresis (driving of medication into tissue with ultrasound with 1% cortisone cream, diversified spinal and peripheral joint manipulation and rotator cuff and shoulder girdle muscle exercises. The outcome measures for the study were subjective/objective visual analogue pain scales (VAS, range of motion (goniometer and return to normal daily, work and sporting activities. All four subjects at the end of the treatment protocol were symptom free with all outcome measures being normal. At 1 month follow up all patients continued to be symptom free with full range of motion and complete return to normal daily activities. Conclusion This case series demonstrates the potential benefit of a multimodal chiropractic protocol in resolving symptoms associated with a suspected clinical diagnosis of shoulder impingement syndrome.

  13. Calculation of Prompt Fission Neutron from 233U(n, f) Reaction by Multi-Modal Los Alamos Model%Calculation of Prompt Fission Neutron from 233U(n, f) Reaction by Multi-Modal Los Alamos Model

    Institute of Scientific and Technical Information of China (English)

    郑娜; 钟春来; 樊铁栓

    2012-01-01

    An attempt is made to improve the evaluation of the prompt fission neutron emis- sion from 233U(n, f) reaction for incident neutron energies below 6 MeV. The multi-modal fission approach is applied to the improved version of Los Alamos model and the point by point model. The prompt fission neutron spectra and the prompt fission neutron as a function of fragment mass (usually named "sawtooth" data) v(A) are calculated independently for the three most dominant fission modes (standard I, standard II and superlong), and the total spectra and v(A) are syn- thesized. The multi-modal parameters are determined on the basis of experimental data of fission fragment mass distributions. The present calculation results can describe the experimental data very well, and the proposed treatment is thus a useful tool for prompt fission neutron emission prediction.

  14. Automatic Classification on Multi-Modal MRI Data for Diagnosis of the Postural Instability and Gait Difficulty Subtype of Parkinson's Disease.

    Science.gov (United States)

    Gu, Quanquan; Zhang, Huan; Xuan, Min; Luo, Wei; Huang, Peiyu; Xia, Shunren; Zhang, Minming

    2016-05-11

    Patients with the postural instability and gait difficulty subtype (PIGD) of Parkinson's disease (PD) are a refractory challenge in clinical practice. Despite previous attempts that have been made at studying subtype-specific brain alterations across PD population, conclusive neuroimaging biomarkers on patients with the PIGD subtype are still lacking. Machine learning-based classifications are a promising tool for differential diagnosis that effectively integrate complex and multivariate data. Our present study aimed to introduce the machine learning-based automatic classification for the first time to distinguish patients with the PIGD subtype from those with the non-PIGD subtype of PD at the individual level. Fifty-two PD patients and forty-five normal controls (NCs) were recruited and underwent multi-modal MRI scans including a set of resting-state functional, 3D T1-weighted and diffusion tensor imaging sequences. By comparing the PD patients with the NCs, features that were not conducive to the subtype-specific classification were ruled out from massive brain features. We applied a support vector machine classifier with the recursive feature elimination method to multi-modal MRI data for selecting features with the best discriminating power, and evaluated the proposed classifier with the leave-one-out cross-validation. Using this classifier, we obtained satisfactory diagnostic rates (accuracy = 92.31%, specificity = 96.97%, sensitivity = 84.21% and AUCmax  = 0.9585). The diagnostic agreement evaluated by the Kappa test showed an almost perfect agreement with the existing clinical categorization (Kappa value = 0.83). With these favorable results, our findings suggested the machine learning-based classification as an alternative technique to classifying clinical subtypes in PD.

  15. Multi-modal MRI analysis with disease-specific spatial filtering: initial testing to predict mild cognitive impairment patients who convert to Alzheimer’s disease

    Directory of Open Access Journals (Sweden)

    Kenichi eOishi

    2011-08-01

    Full Text Available Background: Alterations of the gray and white matter have been identified in Alzheimer’s disease (AD by structural MRI and diffusion tensor imaging (DTI. However, whether the combination of these modalities could increase the diagnostic performance is unknown.Methods: Participants included 19 AD patients, 22 amnestic mild cognitive impairment (aMCI patients, and 22 cognitively normal elderly (NC. The aMCI group was further divided into an aMCI-converter group (converted to AD dementia within three years, and an aMCI-stable group who did not convert in this time period. A T1-weighted image, a T2 map, and a DTI of each participant were normalized, and voxel-based comparisons between AD and NC groups were performed. Regions-of-interest, which defined the areas with significant differences between AD and NC, were created for each modality and named disease-specific spatial filters (DSF. Linear discriminant analysis was used to optimize the combination of multiple MRI measurements extracted by DSF to effectively differentiate AD from NC. The resultant DSF and the discriminant function were applied to the aMCI group to investigate the power to differentiate the aMCI-converters from the aMCI-stable patients. Results: The multi-modal approach with AD-specific filters led to a predictive model with an area under the receiver operating characteristic curve (AUC of 0.93, in differentiating aMCI-converters from aMCI-stable patients. This AUC was better than that of a single-contrast-based approach, such as T1-based morphometry or diffusion anisotropy analysis. Conclusion: The multi-modal approach has the potential to increase the value of MRI in predicting conversion from aMCI to AD.

  16. Greater default-mode network abnormalities compared to high order visual processing systems in amnestic mild cognitive impairment: an integrated multi-modal MRI study.

    Science.gov (United States)

    Sala-Llonch, Roser; Bosch, Beatriz; Arenaza-Urquijo, Eider M; Rami, Lorena; Bargalló, Núria; Junqué, Carme; Molinuevo, José-Luis; Bartrés-Faz, David

    2010-01-01

    We conducted an integrated multi-modal magnetic resonance imaging (MRI) study based on functional MRI (fMRI) data during a complex but cognitively preserved visual task in 15 amnestic mild cognitive impairment (a-MCI) patients and 15 Healthy Elders (HE). Independent Component Analysis of fMRI data identified a functional network containing an Activation Task Related Pattern (ATRP), including regions of the dorsal and ventral visual stream, and a Deactivation Task Related Pattern network (DTRP), with high spatial correspondence with the default-mode network (DMN). Gray matter (GM) volumes of the underlying ATRP and DTRP cortical areas were measured, and probabilistic tractography (based on diffusion MRI) identified fiber pathways within each functional network. For the ATRP network, a-MCI patients exhibited increased fMRI responses in inferior-ventral visual areas, possibly reflecting compensatory activations for more compromised dorsal regions. However, no significant GM or white matter group differences were observed within the ATRP network. For the DTRP/DMN, a-MCI showed deactivation deficits and reduced GM volumes in the posterior cingulate/precuneus, excessive deactivations in the inferior parietal lobe, and less fiber tract integrity in the cingulate bundles. Task performance correlated with DTRP-functionality in the HE group. Besides allowing the identification of functional reorganizations in the cortical network directly processing the task-stimuli, these findings highlight the importance of conducting integrated multi-modal MRI studies in MCI based on spared cognitive domains in order to identify functional abnormalities in critical areas of the DMN and their precise anatomical substrates. These latter findings may reflect early neuroimaging biomarkers in dementia.

  17. Simulation of the expected performance of INSERT: A new multi-modality SPECT/MRI system for preclinical and clinical imaging

    Energy Technology Data Exchange (ETDEWEB)

    Busca, P., E-mail: busca@elet.polimi.it [Politecnico di Milano, Dipartimento di Elettronica, Informazione e Bioingegneria, 20133 Milano (Italy); Istituto Nazionale di Fisica Nucleare, Sezione di Milano, 20133 Milano (Italy); Fiorini, C., E-mail: carlo.fiorini@polimi.it [Politecnico di Milano, Dipartimento di Elettronica, Informazione e Bioingegneria, 20133 Milano (Italy); Istituto Nazionale di Fisica Nucleare, Sezione di Milano, 20133 Milano (Italy); Butt, A.D.; Occhipinti, M.; Peloso, R.; Quaglia, R.; Schembari, F.; Trigilio, P. [Politecnico di Milano, Dipartimento di Elettronica, Informazione e Bioingegneria, 20133 Milano (Italy); Istituto Nazionale di Fisica Nucleare, Sezione di Milano, 20133 Milano (Italy); Nemeth, G.; Major, P. [Mediso Medical Imaging Systems, Alsotorokvesz 14, H-1022 Budapest (Hungary); Erlandsson, K. [University College London, Gower Street, WC1E 6BT London (United Kingdom); Hutton, B.F. [University College London, Gower Street, WC1E 6BT London (United Kingdom); Centre for Medical Radiation Physics, University of Wollongong, NSW 2522 (Australia)

    2014-01-11

    A new multi-modality imaging tool is under development in the framework of the INSERT (INtegrated SPECT/MRI for Enhanced Stratification in Radio-chemo Therapy) project, supported by the European Community. The final goal is to develop a custom SPECT apparatus, that can be used as an insert for commercially available MRI systems such as 3 T MRI with 59 cm bore diameter. INSERT is expected to offer more effective and earlier diagnosis with potentially better outcome in survival for the treatment of brain tumors, primarily glioma. Two SPECT prototypes will be developed, one dedicated to preclinical imaging, the second one dedicated to clinical imaging. The basic building block of the SPECT detector ring is a small 5 cm×5 cm gamma camera, based on the well-established Anger architecture with a continuous scintillator readout by an array of silicon photodetectors. Silicon Drift Detectors (SDDs) and Silicon PhotoMultipliers (SiPM) are being considered as possible scintillator readout, considering that the detector choice plays a predominant role for the final performance of the system, such as energy and spatial resolution, as well as the useful field of view of the camera. Both solutions are therefore under study to evaluate their performances in terms of field of view (FOV), spatial and energy resolution. Preliminary simulations for both the preclinical and clinical systems have been carried out to evaluate resolution and sensitivity. -- Highlights: • We introduce INSERT, a new multi-modality SPECT/MRI instrument. • We propose two possible photodetectors (SDD, SiPM) for the scintillators readout. • We show possible results for INSERT, based on simulations.

  18. Comparison of Sleep-Wake Classification using Electroencephalogram and Wrist-worn Multi-modal Sensor Data

    OpenAIRE

    Sano, Akane; Picard, Rosalind W.

    2014-01-01

    This paper presents the comparison of sleep-wake classification using electroencephalogram (EEG) and multi-modal data from a wrist wearable sensor. We collected physiological data while participants were in bed: EEG, skin conductance (SC), skin temperature (ST), and acceleration (ACC) data, from 15 college students, computed the features and compared the intra-/inter-subject classification results. As results, EEG features showed 83% while features from a wrist wearable sensor showed 74% and ...

  19. Female preference for multi-modal courtship: multiple signals are important for male mating success in peacock spiders.

    Science.gov (United States)

    Girard, Madeline B; Elias, Damian O; Kasumovic, Michael M

    2015-12-07

    A long-standing goal for biologists has been to understand how female preferences operate in systems where males have evolved numerous sexually selected traits. Jumping spiders of the Maratus genus are exceptionally sexually dimorphic in appearance and signalling behaviour. Presumably, strong sexual selection by females has played an important role in the evolution of complex signals displayed by males of this group; however, this has not yet been demonstrated. In fact, despite apparent widespread examples of sexual selection in nature, empirical evidence is relatively sparse, especially for species employing multiple modalities for intersexual communication. In order to elucidate whether female preference can explain the evolution of multi-modal signalling traits, we ran a series of mating trials using Maratus volans. We used video recordings and laser vibrometry to characterize, quantify and examine which male courtship traits predict various metrics of mating success. We found evidence for strong sexual selection on males in this system, with success contingent upon a combination of visual and vibratory displays. Additionally, independently produced, yet correlated suites of multi-modal male signals are linked to other aspects of female peacock spider behaviour. Lastly, our data provide some support for both the redundant signal and multiple messages hypotheses for the evolution of multi-modal signalling. © 2015 The Author(s).

  20. Comparing uni-modal and multi-modal therapies for improving writing in acquired dysgraphia after stroke.

    Science.gov (United States)

    Thiel, Lindsey; Sage, Karen; Conroy, Paul

    2016-01-01

    Writing therapy studies have been predominantly uni-modal in nature; i.e., their central therapy task has typically been either writing to dictation or copying and recalling words. There has not yet been a study that has compared the effects of a uni-modal to a multi-modal writing therapy in terms of improvements to spelling accuracy. A multiple-case study with eight participants aimed to compare the effects of a uni-modal and a multi-modal therapy on the spelling accuracy of treated and untreated target words at immediate and follow-up assessment points. A cross-over design was used and within each therapy a matched set of words was targeted. These words and a matched control set were assessed before as well as immediately after each therapy and six weeks following therapy. The two approaches did not differ in their effects on spelling accuracy of treated or untreated items or degree of maintenance. All participants made significant improvements on treated and control items; however, not all improvements were maintained at follow-up. The findings suggested that multi-modal therapy did not have an advantage over uni-modal therapy for the participants in this study. Performance differences were instead driven by participant variables.

  1. Fatal pulmonary embolism following elective total knee replacement using aspirin in multi-modal prophylaxis - A 12year study.

    Science.gov (United States)

    Quah, C; Bayley, E; Bhamber, N; Howard, P

    2017-06-13

    The National Institute for Health and Clinical Excellence (NICE) has issued guidelines on which thromboprophylaxis regimens are suitable following lower limb arthroplasty. Aspirin is not a recommended agent despite being accepted in orthopaedic guidelines elsewhere. We assessed the incidence of fatal pulmonary embolism (PE) and all-cause mortality following elective primary total knee replacement (TKR) with a standardised multi-modal prophylaxis regime in a large teaching district general hospital. We utilised a prospective audit database to identify those that had died within 42 and 90days postoperatively. Data from April 2000 to 2012 were analysed for 42 and 90day mortality rates. There were a total of 8277 elective primary TKR performed over the 12year period. The multi-modal prophylaxis regimen used unless contraindicated for all patients included 75mg aspirin once daily for four weeks. Case note review ascertained the causes of death. Where a patient had been referred to the coroner, they were contacted for post mortem results. The mortality rates at 42 and 90days were 0.36 and 0.46%. There was one fatal PE within 42days of surgery (0.01%) who was taking enoxaparin because of aspirin intolerance. Two fatal PE's occurred at 48 and 57days post-operatively (0.02%). The leading cause of death was myocardial infarction (0.13%). Fatal PE following elective TKR with a multi-modal prophylaxis regime is a very rare cause of mortality. Copyright © 2017 Elsevier B.V. All rights reserved.

  2. The sweet spot: FDG and other 2-carbon glucose analogs for multi-modal metabolic imaging of tumor metabolism.

    Science.gov (United States)

    Cox, Benjamin L; Mackie, Thomas R; Eliceiri, Kevin W

    2015-01-01

    Multi-modal imaging approaches of tumor metabolism that provide improved specificity, physiological relevance and spatial resolution would improve diagnosing of tumors and evaluation of tumor progression. Currently, the molecular probe FDG, glucose fluorinated with (18)F at the 2-carbon, is the primary metabolic approach for clinical diagnostics with PET imaging. However, PET lacks the resolution necessary to yield intratumoral distributions of deoxyglucose, on the cellular level. Multi-modal imaging could elucidate this problem, but requires the development of new glucose analogs that are better suited for other imaging modalities. Several such analogs have been created and are reviewed here. Also reviewed are several multi-modal imaging studies that have been performed that attempt to shed light on the cellular distribution of glucose analogs within tumors. Some of these studies are performed in vitro, while others are performed in vivo, in an animal model. The results from these studies introduce a visualization gap between the in vitro and in vivo studies that, if solved, could enable the early detection of tumors, the high resolution monitoring of tumors during treatment, and the greater accuracy in assessment of different imaging agents.

  3. Obstacle traversal and self-righting of bio-inspired robots reveal the physics of multi-modal locomotion

    Science.gov (United States)

    Li, Chen; Fearing, Ronald; Full, Robert

    Most animals move in nature in a variety of locomotor modes. For example, to traverse obstacles like dense vegetation, cockroaches can climb over, push across, reorient their bodies to maneuver through slits, or even transition among these modes forming diverse locomotor pathways; if flipped over, they can also self-right using wings or legs to generate body pitch or roll. By contrast, most locomotion studies have focused on a single mode such as running, walking, or jumping, and robots are still far from capable of life-like, robust, multi-modal locomotion in the real world. Here, we present two recent studies using bio-inspired robots, together with new locomotion energy landscapes derived from locomotor-environment interaction physics, to begin to understand the physics of multi-modal locomotion. (1) Our experiment of a cockroach-inspired legged robot traversing grass-like beam obstacles reveals that, with a terradynamically ``streamlined'' rounded body like that of the insect, robot traversal becomes more probable by accessing locomotor pathways that overcome lower potential energy barriers. (2) Our experiment of a cockroach-inspired self-righting robot further suggests that body vibrations are crucial for exploring locomotion energy landscapes and reaching lower barrier pathways. Finally, we posit that our new framework of locomotion energy landscapes holds promise to better understand and predict multi-modal biological and robotic movement.

  4. Multi-modal MRI classifiers identify excessive alcohol consumption and treatment effects in the brain.

    Science.gov (United States)

    Cosa, Alejandro; Moreno, Andrea; Pacheco-Torres, Jesús; Ciccocioppo, Roberto; Hyytiä, Petri; Sommer, Wolfgang H; Moratal, David; Canals, Santiago

    2017-09-01

    Robust neuroimaging markers of neuropsychiatric disorders have proven difficult to obtain. In alcohol use disorders, profound brain structural deficits can be found in severe alcoholic patients, but the heterogeneity of unimodal MRI measurements has so far precluded the identification of selective biomarkers, especially for early diagnosis. In the present work we used a combination of multiple MRI modalities to provide comprehensive and insightful descriptions of brain tissue microstructure. We performed a longitudinal experiment using Marchigian-Sardinian (msP) rats, an established model of chronic excessive alcohol consumption, and acquired multi-modal images before and after 1 month of alcohol consumption (6.8 ± 1.4 g/kg/day, mean ± SD), as well as after 1 week of abstinence with or without concomitant treatment with the antirelapse opioid antagonist naltrexone (2.5 mg/kg/day). We found remarkable sensitivity and selectivity to accurately classify brains affected by alcohol even after the relative short exposure period. One month drinking was enough to imprint a highly specific signature of alcohol consumption. Brain alterations were regionally specific and affected both gray and white matter and persisted into the early abstinence state without any detectable recovery. Interestingly, naltrexone treatment during early abstinence resulted in subtle brain changes that could be distinguished from non-treated abstinent brains, suggesting the existence of an intermediate state associated with brain recovery from alcohol exposure induced by medication. The presented framework is a promising tool for the development of biomarkers for clinical diagnosis of alcohol use disorders, with capacity to further inform about its progression and response to treatment. © 2016 Society for the Study of Addiction.

  5. A Prototype Multi-Modality Picture Archive And Communication System At Victoria General Hospital

    Science.gov (United States)

    Nosil, J.; Justice, G.; Fisher, P.; Ritchie, G.; Weigl, W. J.; Gnoyke, H.

    1988-06-01

    The Medical Imaging Department at Victoria General Hospital is the first in Canada to implement an integrated multi-modality picture archive and communication system for clinical use. The aim of this paper is to present the current status of the picture archive and communication system components and to describe its function. This system was installed in April of 1987, and upgraded in November of 1987. A picture archive and communication system includes image sources, an image management system, and image display and reporting facilities. The installed image sources (digital radiography, digital fluoroscopy, computed tomography, and digital subtraction angiography) provide digital data for the image management system. The image management system provides facilities for receiving, storing, retrieving, and transmitting images using conventional computers and networks. There are two display stations, a viewing console and an image processing workstation, which provide various image display and manipulation functions. In parallel with the implementation of the picture archive and communication system there are clinical, physical, and economic evaluations being pursued. An initial examination of digital image transfer rates indicate that users will experience similar image availability times as with conventional film imaging. Clinical experience to date with the picture archive and communication system has been limited to that required to evaluate digital imaging as a diagnostic tool, using digital radiography and digital fluoroscopy studies. Computed tomography and digital subtraction angiography have only recently been connected to the picture archive and communication system. Clinical experience with these modalities is limited to several cases, but image fidelity appears to be well above clinically acceptable levels.

  6. A multi-modal prostate segmentation scheme by combining spectral clustering and active shape models

    Science.gov (United States)

    Toth, Robert; Tiwari, Pallavi; Rosen, Mark; Kalyanpur, Arjun; Pungavkar, Sona; Madabhushi, Anant

    2008-03-01

    Segmentation of the prostate boundary on clinical images is useful in a large number of applications including calculating prostate volume during biopsy, tumor estimation, and treatment planning. Manual segmentation of the prostate boundary is, however, time consuming and subject to inter- and intra-reader variability. Magnetic Resonance (MR) imaging (MRI) and MR Spectroscopy (MRS) have recently emerged as promising modalities for detection of prostate cancer in vivo. In this paper we present a novel scheme for accurate and automated prostate segmentation on in vivo 1.5 Tesla multi-modal MRI studies. The segmentation algorithm comprises two steps: (1) A hierarchical unsupervised spectral clustering scheme using MRS data to isolate the region of interest (ROI) corresponding to the prostate, and (2) an Active Shape Model (ASM) segmentation scheme where the ASM is initialized within the ROI obtained in the previous step. The hierarchical MRS clustering scheme in step 1 identifies spectra corresponding to locations within the prostate in an iterative fashion by discriminating between potential prostate and non-prostate spectra in a lower dimensional embedding space. The spatial locations of the prostate spectra so identified are used as the initial ROI for the ASM. The ASM is trained by identifying user-selected landmarks on the prostate boundary on T2 MRI images. Boundary points on the prostate are identified using mutual information (MI) as opposed to the traditional Mahalanobis distance, and the trained ASM is deformed to fit the boundary points so identified. Cross validation on 150 prostate MRI slices yields an average segmentation sensitivity, specificity, overlap, and positive predictive value of 89, 86, 83, and 93% respectively. We demonstrate that the accurate initialization of the ASM via the spectral clustering scheme is necessary for automated boundary extraction. Our method is fully automated, robust to system parameters, and computationally efficient.

  7. A custom multi-modal sensor suite and data analysis pipeline for aerial field phenotyping

    Science.gov (United States)

    Bartlett, Paul W.; Coblenz, Lauren; Sherwin, Gary; Stambler, Adam; van der Meer, Andries

    2017-05-01

    Our group has developed a custom, multi-modal sensor suite and data analysis pipeline to phenotype crops in the field using unpiloted aircraft systems (UAS). This approach to high-throughput field phenotyping is part of a research initiative intending to markedly accelerate the breeding process for refined energy sorghum varieties. To date, single rotor and multirotor helicopters, roughly 14 kg in total weight, are being employed to provide sensor coverage over multiple hectaresized fields in tens of minutes. The quick, autonomous operations allow for complete field coverage at consistent plant and lighting conditions, with low operating costs. The sensor suite collects data simultaneously from six sensors and registers it for fusion and analysis. High resolution color imagery targets color and geometric phenotypes, along with lidar measurements. Long-wave infrared imagery targets temperature phenomena and plant stress. Hyperspectral visible and near-infrared imagery targets phenotypes such as biomass and chlorophyll content, as well as novel, predictive spectral signatures. Onboard spectrometers and careful laboratory and in-field calibration techniques aim to increase the physical validity of the sensor data throughout and across growing seasons. Off-line processing of data creates basic products such as image maps and digital elevation models. Derived data products include phenotype charts, statistics, and trends. The outcome of this work is a set of commercially available phenotyping technologies, including sensor suites, a fully integrated phenotyping UAS, and data analysis software. Effort is also underway to transition these technologies to farm management users by way of streamlined, lower cost sensor packages and intuitive software interfaces.

  8. Combining Passive Polarimetric and Lidar Observations from TCAP to Vertically Partition a Multi-Modal Aerosol Model

    Science.gov (United States)

    Cairns, B.; Ottaviani, M.; Knobelspiesse, K. D.; Chowdhary, J.; Hostetler, C. A.; Ferrare, R. A.; Hair, J. W.; Cook, A. L.; Harper, D. B.; Mack, T. L.; Hare, R. J.; Cleckner, C. S.; Rogers, R.; Mueller, D.; Burton, S. P.; Obland, M. D.; Scarino, A. J.; Redemann, J.; Schmid, B.; Fast, J. D.; Berg, L. K.

    2012-12-01

    The first airborne deployment associated with the Two-Column Aerosol Project (TCAP) field campaign was carried out on Cape Cod, Massachusetts during July 2012 using the DOE Gulfstream 1 (G-1) and the NASA Langley B200. The first column located on Cape Cod has the surface based ARM Mobile Facility, which measures aerosol properties, radiation, and cloud characteristics, as its anchor point. The second column, 200 km to the East, was chosen to facilitate characterization of the large gradient of AOD near the coast of New England. The G-1 was equipped with a suite of in situ instrumentation to measure the size, composition and optics of aerosols, together with spectral Aerosol Optical Depth (AOD) above the aircraft using the Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research. The G1 generally flew at low altitude except when profiling the two columns. The B200, flew at ~ 9 km, above the G1, and operated the world's first airborne three backscatter (355, 532 and 1064 nm) and two extinction (355 and 532 nm) channel high-spectral-resolution lidar, HSRL-2 and the Research Scanning Polarimeter (RSP), which provides multi-angle multi-spectral observations of the intensity and polarization over a spectral range from 410 to 2260 nm. The TCAP measurements are ideal for remote sensing of aerosols since a dark ocean allows the full power of the passive intensity and polarization observations to be explored. RSP observations over the ocean have previously been used to retrieve the AOD, particle size and complex refractive index of aerosols, but it was noted that the vertical distribution of the aerosols could affect the accuracy of the retrieval. In this paper we combine HSRL-2 and RSP data to retrieve and partition a multi-modal aerosol model through the column. The lidar intensive variables (ratios of the lidar observations) that do not depend on aerosol load are used to constrain the microphysics of the aerosol modes. Where the classification technique presented

  9. Pre-emptive and multi-modal perioperative pain management may improve quality of life in patients undergoing spinal surgery.

    Science.gov (United States)

    Lee, Byung Ho; Park, Jin-Oh; Suk, Kyung-Soo; Kim, Tae-Hwan; Lee, Hwan-Mo; Park, Moon-Soo; Lee, Seung-Hwan; Park, Sangun; Lee, Ju-Yeon; Ko, Su-Kyoung; Moon, Seong-Hwan

    2013-01-01

    Compared to an abundance of data on surgical techniques for degenerative spine conditions and the outcomes thereof, little is available to guide optimal perioperative pain management after spinal surgery. The aim of this study was to survey patterns of perioperative pain management after spinal surgery and to investigate the effects of perioperative pain management, such as pre-emptive analgesia and multi-modal postoperative pain management, on acute postoperative satisfaction, pain reduction, and health-related quality of life in patients undergoing spinal surgery. Non-blind multicenter prospective observational clinical series. Seventeen tertiary hospitals (14 hospitals attached to medical colleges and 3 general hospitals). Pain management protocols of 393 patients (153 men, 240 women; mean age of 67 years, ranging from 21 to 91 years) from 17 tertiary hospitals after spinal surgery for degenerative spine disease were evaluated using a self-administered questionnaire. A total of 79 (20%) patients received pre-emptive analgesics, which included cyclooxygenase-2 (COX-2) inhibitors, with or without administration of anticonvulsants, immediately before surgery at the time of antibiotic prophylaxis. Postoperative pain was managed mainly by multi-modal therapy (363 cases, 92%), along with various combinations of patient controlled anesthesia (PCA), conventional nonsteroidal anti-inflammatory drugs (NSAIDs), COX-2 inhibitors, and narcotics. Self-reported levels of pain were not significantly different among postoperative multiple modalities of pain management, but were different significantly for pre-emptive pain management regimens (P multi-modal pain management after spinal surgery may lead to better health-related quality of life, greater patient satisfaction, and less postoperative pain.

  10. Development of a Multi-modal Tissue Diagnostic System Combining High Frequency Ultrasound and Photoacoustic Imaging with Lifetime Fluorescence Spectroscopy

    Science.gov (United States)

    Sun, Yang; Stephens, Douglas N.; Park, Jesung; Sun, Yinghua; Marcu, Laura; Cannata, Jonathan M.; Shung, K. Kirk

    2010-01-01

    We report the development and validate a multi-modal tissue diagnostic technology, which combines three complementary techniques into one system including ultrasound backscatter microscopy (UBM), photoacoustic imaging (PAI), and time-resolved laser-induced fluorescence spectroscopy (TR-LIFS). UBM enables the reconstruction of the tissue microanatomy. PAI maps the optical absorption heterogeneity of the tissue associated with structure information and has the potential to provide functional imaging of the tissue. Examination of the UBM and PAI images allows for localization of regions of interest for TR-LIFS evaluation of the tissue composition. The hybrid probe consists of a single element ring transducer with concentric fiber optics for multi-modal data acquisition. Validation and characterization of the multi-modal system and ultrasonic, photoacoustic, and spectroscopic data coregistration were conducted in a physical phantom with properties of ultrasound scattering, optical absorption, and fluorescence. The UBM system with the 41 MHz ring transducer can reach the axial and lateral resolution of 30 and 65 μm, respectively. The PAI system with 532 nm excitation light from a Nd:YAG laser shows great contrast for the distribution of optical absorbers. The TR-LIFS system records the fluorescence decay with the time resolution of ~300 ps and a high sensitivity of nM concentration range. Biological phantom constructed with different types of tissues (tendon and fat) was used to demonstrate the complementary information provided by the three modalities. Fluorescence spectra and lifetimes were compared to differentiate chemical composition of tissues at the regions of interest determined by the coregistered high resolution UBM and PAI image. Current results demonstrate that the fusion of these techniques enables sequentially detection of functional, morphological, and compositional features of biological tissue, suggesting potential applications in diagnosis of tumors

  11. Microfluidic electro-sonoporation: a multi-modal cell poration methodology through simultaneous application of electric field and ultrasonic wave.

    Science.gov (United States)

    Longsine-Parker, Whitney; Wang, Han; Koo, Chiwan; Kim, Jeongyun; Kim, Beomjoon; Jayaraman, Arul; Han, Arum

    2013-06-07

    A microfluidic device that simultaneously applies the conditions required for microelectroporation and microsonoporation in a flow-through scheme toward high-efficiency and high-throughput molecular delivery into mammalian cells is presented. This multi-modal poration microdevice using simultaneous application of electric field and ultrasonic wave was realized by a three-dimensional (3D) microelectrode scheme where the electrodes function as both electroporation electrodes and cell flow channel so that acoustic wave can be applied perpendicular to the electric field simultaneously to cells flowing through the microfluidic channel. This 3D microelectrode configuration also allows a uniform electric field to be applied while making the device compatible with fluorescent microscopy. It is hypothesized that the simultaneous application of two different fields (electric field and acoustic wave) in perpendicular directions allows formation of transient pores along two axes of the cell membrane at reduced poration intensities, hence maximizing the delivery efficiency while minimizing cell death. The microfluidic electro-sonoporation system was characterized by delivering small molecules into mammalian cells, and showed average poration efficiency of 95.6% and cell viability of 97.3%. This proof of concept result shows that by combining electroporation and sonoporation together, significant improvement in molecule delivery efficiency could be achieved while maintaining high cell viability compared to electroporation or sonoporation alone. The microfluidic electro-sonoporation device presented here is, to the best of our knowledge, the first multi-modal cell poration device using simultaneous application of electric field and ultrasonic wave. This new multi-modal cell poration strategy and system is expected to have broad applications in delivery of small molecule therapeutics and ultimately in large molecule delivery such as gene transfection applications where high

  12. Comparison of sleep-wake classification using electroencephalogram and wrist-worn multi-modal sensor data.

    Science.gov (United States)

    Sano, Akane; Picard, Rosalind W

    2014-01-01

    This paper presents the comparison of sleep-wake classification using electroencephalogram (EEG) and multi-modal data from a wrist wearable sensor. We collected physiological data while participants were in bed: EEG, skin conductance (SC), skin temperature (ST), and acceleration (ACC) data, from 15 college students, computed the features and compared the intra-/inter-subject classification results. As results, EEG features showed 83% while features from a wrist wearable sensor showed 74% and the combination of ACC and ST played more important roles in sleep/wake classification.

  13. Development and calibration of a microfluidic biofilm growth cell with flow-templating and multi-modal characterization.

    Science.gov (United States)

    Paquet-Mercier, Francois; Karas, Adnane; Safdar, Muhammad; Aznaveh, Nahid Babaei; Zarabadi, Mirpouyan; Greener, Jesse

    2014-01-01

    We report the development of a microfluidic flow-templating platform with multi-modal characterization for studies of biofilms and their precursor materials. A key feature is a special three inlet flow-template compartment, which confines and controls the location of biofilm growth against a template wall. Characterization compartments include Raman imaging to study the localization of the nutrient solutions, optical microscopy to quantify biofilm biomass and localization, and cyclic voltammetry for flow velocity measurements. Each compartment is tested and then utilized to make preliminary measurements.

  14. Multi-modal calculations of prompt fission neutrons from 238U(n, f) at low induced energy

    Institute of Scientific and Technical Information of China (English)

    ZHENG Na; ZHONG Chun-Lai; FAN Tie-Shuan

    2011-01-01

    Properties of prompt fission neutrons from 238U(n,f) are calculated for incident neutron energies below 6 MeV using the multi-modal model,including the prompt fission neutron spectrum,the average prompt fission neutron multiplicity,and the prompt fission neutron multiplicity as a function of the fission fragment mass v(A) (usually named “sawtooth” data) The three most dominant fission modes are taken into account.The model parameters are determined on the basis of experimental fission fragment data.The predicted results are in good agreement with the experimental data.

  15. Results from the commissioning of a multi-modal endoscope for ultrasound and time of flight PET

    Energy Technology Data Exchange (ETDEWEB)

    Bugalho, Ricardo [LIP, Lisbon, (Portugal)

    2015-07-01

    The EndoTOFPET-US collaboration has developed a multi-modal imaging system combining Ultrasound with Time-of-Flight Positron Emission Tomography into an endoscopic imaging device. The objective of the project is to obtain a coincidence time resolution of about 200 ps FWHM and to achieve about 1 mm spatial resolution of the PET system, while integrating all the components in a very compact detector suitable for endoscopic use. This scanner aims to be exploited for diagnostic and surgical oncology, as well as being instrumental in the clinical test of new biomarkers especially targeted for prostate and pancreatic cancer. (authors)

  16. EVolution : an edge-based variational method for non-rigid multi-modal image registration

    NARCIS (Netherlands)

    Denis de Senneville, B; Zachiu, C; Ries, M; Moonen, C

    2016-01-01

    Image registration is part of a large variety of medical applications including diagnosis, monitoring disease progression and/or treatment effectiveness and, more recently, therapy guidance. Such applications usually involve several imaging modalities such as ultrasound, computed tomography,

  17. Extended feature-fusion guidelines to improve image-based multi-modal biometrics

    CSIR Research Space (South Africa)

    Brown, Dane

    2016-09-01

    Full Text Available and rotation invariant tex- ture classification compared with Eigen and Fisher [2]. Training the advanced histogram model is also signifi- cantly faster than the former two methods. Furthermore, the training time is independent of the image resolution... at the feature-level compared to the matching score-level. Other face, fingerprint and palmprint studies include [13] and [23], which both use a Curvelet transform followed by SVM classification. However, these studies were tested using datasets...

  18. Predicting the Attitude Flow in Dialogue Based on Multi-Modal Speech Cues

    DEFF Research Database (Denmark)

    Juel Henrichsen, Peter; Allwood, Jens

    2013-01-01

    of realistic discourse behavior in conversational agents and other intelligent man-machine interfaces. The present paper deals with two important subgoals in particular: How to establish a meaningful and consistent set of annotation categories for attitude annotation, and how to relate the annotation data...... to the recorded data (audio and video) in computational models of attitude prediction. We present our current results including a recommended set of analytical annotation labels and a recommended setup for extracting linguistically meaningful data even from noisy audio and video signals....

  19. Model based estimation for multi-modal user interface component selection

    CSIR Research Space (South Africa)

    Coetzee, L

    2009-12-01

    Full Text Available the use of their five senses. The five senses namely sight, hear- ing, touch, smell and taste can be translated into different per- ceptual pathways (or modalities). The perceptual learning styles model developed by Russell French, Daryl Gilley, and Ed... elements such as mu- sic, sounds and Text-To-Speech as audible output can be impor- tant, while these might not be important to an individual with a visual preference. Helper applications can be used to trans- form content from one format to another e...

  20. Multi-modal Mn-Zn ferrite nanocrystals for magnetically-induced cancer targeted hyperthermia: a comparison of passive and active targeting effects.

    Science.gov (United States)

    Xie, Jun; Yan, Caiyun; Yan, Yu; Chen, Ling; Song, Lina; Zang, Fengchao; An, Yanli; Teng, Gaojun; Gu, Ning; Zhang, Yu

    2016-10-14

    The high performance and increased tumor-targeting accumulation of magnetic nanocrystals (MNCs) are the most important considerations in cancer targeted magnetic hyperthermia (TMH). To achieve these goals, our study was firstly done using well-established fluorescence/magnetic Mn-Zn ferrite MNCs (core size: 14 nm) as multi-modal imaging contrast agents and highly-efficient "heat generators", which were coated with a biocompatible PEG-phospholipid (DSPE-PEG2000) and further modified by a cyclic tripeptide of arginine-glycine-aspartic acid (RGD). By using a mouse model bearing breast carcinoma (4T1), we then systematically compared PEGylated MNCs (MNCs@PEG)- and RGD-PEGylated MNCs (MNCs@RGD)-mediated tumor targeting abilities by intravenous administration. The MNCs@PEG-based passive targeting could successfully accumulate at the tumor due to the enhanced permeability and retention (EPR) effects, but the non-targeted localization might make the MNCs@PEG "leaking" from larger pores of tumor fenestrated vascular networks. Our designed MNCs@RGD, simultaneously functionalized with PEG and RGD ligands, might promote a synergistic effect including efficient tumor vasculature active targeting and EPR-mediated passive targeting, improving total MNC concentration and retention time in tumor tissues. By combining fluorescence/magnetic resonance (MR)/thermal multi-modal imaging-guided diagnostics and continuous TMH treatment under an alternating current magnetic field (ACMF, 2.58 kA m(-1), 390 kHz), the tumor surface could be heated to approximately 43-44 °C based on the MNC-mediated repeated injections. Sufficient temperature elevation induced the apoptosis of tumor cells, and inhibited the tumor angiogenesis. Compared with MNCs@PEG, the active MNCs@RGD-based tumor targeting MR image was significantly more efficient due to both the higher and long-lasting tumor accumulation, but its antitumor efficacy was not obviously improved in the TMH treatments. To achieve a singularly

  1. Multi-Modal Imaging Including Optical Coherence Tomography Angiography in Patients With Posterior Multifocal Placoid Pigment Epitheliopathy.

    Science.gov (United States)

    Werner, Jens Ulrich; Enders, Christian; Lang, Gerhard Klaus; Lang, Gabriele Elisabeth

    2017-09-01

    New imaging methods provide novel insights into the pathogenesis of acute posterior multifocal placoid pigment epitheliopathy (APMPPE). Four patients (eight eyes) in acute, subacute, and late phases of the disease were analyzed with multi-modal imaging methods including optical coherence tomography angiography (OCTA), structural OCT, fundus photography, and fundus autofluorescence. One patient was observed during the entire disease course. In acute and subacute phases of the disease, an early blockage in fluorescein angiography was found. OCTA showed perfusion defects in choriocapillaris and choroid slabs. During the course of disease, perfusion deficits observed in OCTA imaging resolved first in the choroid and then in the choriocapillaris slab. Multi-modal imaging including OCTA supports the thesis that the underlying pathology of APMPPE is an inflammatory impairment of the choroidal circulation with secondary damage to the outer retina. OCTA might be able to replace fluorescein and indocyanine angiography in the diagnostic work-up of APMPPE. [Ophthalmic Surg Lasers Imaging Retina. 2017;48:727-733.]. Copyright 2017, SLACK Incorporated.

  2. Differences in Multi-Modal Ultrasound Imaging between Triple Negative and Non-Triple Negative Breast Cancer.

    Science.gov (United States)

    Li, Ziyao; Tian, Jiawei; Wang, Xiaowei; Wang, Ying; Wang, Zhenzhen; Zhang, Lei; Jing, Hui; Wu, Tong

    2016-04-01

    The objective of this study was to identify multi-modal ultrasound imaging parameters that could potentially help to differentiate between triple negative breast cancer (TNBC) and non-TNBC. Conventional ultrasonography, ultrasound strain elastography and 3-D ultrasound (3-D-US) findings from 50 TNBC and 179 non-TNBC patients were retrospectively reviewed. Immunohistochemical examination was used as the reference gold standard for cancer subtyping. Different ultrasound modalities were initially analyzed to define TNBC-related features. Subsequently, logistic regression analysis was applied to TNBC-related features to establish models for predicting TNBC. TNBCs often presented as micro-lobulated, markedly hypo-echoic masses with an abrupt interface (p = 0.015, 0.0015 and 0.004, compared with non-TNBCs, respectively) on conventional ultrasound, and showed a diminished retraction pattern phenomenon in the coronal plane (p = 0.035) on 3-D-US. Our findings suggest that B-mode ultrasound and 3-D-US in multi-modality ultrasonography could be a useful non-invasive technique for differentiating TNBCs from non-TNBCs.

  3. A Robust and Accurate Two-Step Auto-Labeling Conditional Iterative Closest Points (TACICP Algorithm for Three-Dimensional Multi-Modal Carotid Image Registration.

    Directory of Open Access Journals (Sweden)

    Hengkai Guo

    Full Text Available Atherosclerosis is among the leading causes of death and disability. Combining information from multi-modal vascular images is an effective and efficient way to diagnose and monitor atherosclerosis, in which image registration is a key technique. In this paper a feature-based registration algorithm, Two-step Auto-labeling Conditional Iterative Closed Points (TACICP algorithm, is proposed to align three-dimensional carotid image datasets from ultrasound (US and magnetic resonance (MR. Based on 2D segmented contours, a coarse-to-fine strategy is employed with two steps: rigid initialization step and non-rigid refinement step. Conditional Iterative Closest Points (CICP algorithm is given in rigid initialization step to obtain the robust rigid transformation and label configurations. Then the labels and CICP algorithm with non-rigid thin-plate-spline (TPS transformation model is introduced to solve non-rigid carotid deformation between different body positions. The results demonstrate that proposed TACICP algorithm has achieved an average registration error of less than 0.2mm with no failure case, which is superior to the state-of-the-art feature-based methods.

  4. Využití návrhového vzoru Model-View-Controller ve webových aplikacích

    OpenAIRE

    Margai, Ladislav

    2013-01-01

    Obsah práce je zameraný na využitie návrhového vzoru Model-View-Controller vo webových aplikáciach. Práca je rozdelená do niekoľkých kapitol. V prvej kapitole je vysvetlený model MVC ako taký a nutné úpravy interpretácie pre použitie vo webových aplikáciach. V druhej kapitole je popísaný vývoj od konceptu webových formulárov až po MVC a porovnanie týchto dvoch technológií. Tretia kapitola sa zameriava na prácu s Razor engine. Posledné tri kapitoly popisujú samostatný vývoj aplikácie. Conte...

  5. Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease.

    Science.gov (United States)

    Zhang, Daoqiang; Shen, Dinggang

    2012-01-16

    Many machine learning and pattern classification methods have been applied to the diagnosis of Alzheimer's disease (AD) and its prodromal stage, i.e., mild cognitive impairment (MCI). Recently, rather than predicting categorical variables as in classification, several pattern regression methods have also been used to estimate continuous clinical variables from brain images. However, most existing regression methods focus on estimating multiple clinical variables separately and thus cannot utilize the intrinsic useful correlation information among different clinical variables. On the other hand, in those regression methods, only a single modality of data (usually only the structural MRI) is often used, without considering the complementary information that can be provided by different modalities. In this paper, we propose a general methodology, namely multi-modal multi-task (M3T) learning, to jointly predict multiple variables from multi-modal data. Here, the variables include not only the clinical variables used for regression but also the categorical variable used for classification, with different tasks corresponding to prediction of different variables. Specifically, our method contains two key components, i.e., (1) a multi-task feature selection which selects the common subset of relevant features for multiple variables from each modality, and (2) a multi-modal support vector machine which fuses the above-selected features from all modalities to predict multiple (regression and classification) variables. To validate our method, we perform two sets of experiments on ADNI baseline MRI, FDG-PET, and cerebrospinal fluid (CSF) data from 45 AD patients, 91 MCI patients, and 50 healthy controls (HC). In the first set of experiments, we estimate two clinical variables such as Mini Mental State Examination (MMSE) and Alzheimer's Disease Assessment Scale-Cognitive Subscale (ADAS-Cog), as well as one categorical variable (with value of 'AD', 'MCI' or 'HC'), from the

  6. The Multi-modal Australian ScienceS Imaging and Visualisation Environment (MASSIVE high performance computing infrastructure: applications in neuroscience and neuroinformatics research

    Directory of Open Access Journals (Sweden)

    Wojtek James eGoscinski

    2014-03-01

    Full Text Available The Multi-modal Australian ScienceS Imaging and Visualisation Environment (MASSIVE is a national imaging and visualisation facility established by Monash University, the Australian Synchrotron, the Commonwealth Scientific Industrial Research Organisation (CSIRO, and the Victorian Partnership for Advanced Computing (VPAC, with funding from the National Computational Infrastructure and the Victorian Government. The MASSIVE facility provides hardware, software and expertise to drive research in the biomedical sciences, particularly advanced brain imaging research using synchrotron x-ray and infrared imaging, functional and structural magnetic resonance imaging (MRI, x-ray computer tomography (CT, electron microscopy and optical microscopy. The development of MASSIVE has been based on best practice in system integration methodologies, frameworks, and architectures. The facility has: (i integrated multiple different neuroimaging analysis software components, (ii enabled cross-platform and cross-modality integration of neuroinformatics tools, and (iii brought together neuroimaging databases and analysis workflows. MASSIVE is now operational as a nationally distributed and integrated facility for neuroinfomatics and brain imaging research.

  7. Simulation of the expected performance of INSERT: A new multi-modality SPECT/MRI system for preclinical and clinical imaging

    Science.gov (United States)

    Busca, P.; Fiorini, C.; Butt, A. D.; Occhipinti, M.; Peloso, R.; Quaglia, R.; Schembari, F.; Trigilio, P.; Nemeth, G.; Major, P.; Erlandsson, K.; Hutton, B. F.

    2014-01-01

    A new multi-modality imaging tool is under development in the framework of the INSERT (INtegrated SPECT/MRI for Enhanced Stratification in Radio-chemo Therapy) project, supported by the European Community. The final goal is to develop a custom SPECT apparatus, that can be used as an insert for commercially available MRI systems such as 3 T MRI with 59 cm bore diameter. INSERT is expected to offer more effective and earlier diagnosis with potentially better outcome in survival for the treatment of brain tumors, primarily glioma. Two SPECT prototypes will be developed, one dedicated to preclinical imaging, the second one dedicated to clinical imaging. The basic building block of the SPECT detector ring is a small 5 cm×5 cm gamma camera, based on the well-established Anger architecture with a continuous scintillator readout by an array of silicon photodetectors. Silicon Drift Detectors (SDDs) and Silicon PhotoMultipliers (SiPM) are being considered as possible scintillator readout, considering that the detector choice plays a predominant role for the final performance of the system, such as energy and spatial resolution, as well as the useful field of view of the camera. Both solutions are therefore under study to evaluate their performances in terms of field of view (FOV), spatial and energy resolution. Preliminary simulations for both the preclinical and clinical systems have been carried out to evaluate resolution and sensitivity.

  8. Multi-regional local anesthetic infiltration during laparoscopic cholecystectomy in patients receiving prophylactic multi-modal analgesia: a randomized, double-blinded, placebo-controlled study

    DEFF Research Database (Denmark)

    Bisgaard, T; Klarskov, B; Kristiansen, V B

    1999-01-01

    undergoing elective laparoscopic cholecystectomy. In addition, all patients received multi-modal prophylactic analgesic treatment. Fifty-eight patients were randomized to receive a total of 286 mg (66 mL) ropivacaine or 66 mL saline via periportal and intraperitoneal infiltration. During the first 3...... receiving prophylactic multi-modal analgesic treatment. IMPLICATIONS: A combination of incisional and intraabdominal local anesthetic treatment reduced incisional pain but had no effect on deep intraabdominal pain or shoulder pain in patients receiving multimodal prophylactic analgesia after laparoscopic...

  9. A weakly nonlinear model for multi-modal evolution of wind-generated long internal waves in a closed basin

    Directory of Open Access Journals (Sweden)

    T. Sakai

    2009-07-01

    Full Text Available A weakly nonlinear evolution model that accounts for multi-modal interaction in a small, continuously stratified lake of variable depth is derived. In particular, an evolution model for the first two vertical modes in a lake that is subject to wind stress forcing is numerically simulated. Defining modal energies, energy transfer between the first and the second vertical modes is calculated for several different forms of the density stratification. Modal energy transfer mainly occurs during reflection of mode-one waves at the vertical end walls, and it is shown that the amount of energy transfer from the first to the second mode is greatly dependent on the shape of the stratification profile. Also, the initial modal energy partition at the wind setup is shown to depend significantly on the penetration depth of the internal shear stress induced by the wind stress, especially if the stress distribution extends into the upper levels of the metalimnion.

  10. Multi-Modal presentation of Works of Art in Virtual Reality with Simulation of Multi-Mirror Reflections

    DEFF Research Database (Denmark)

    Livatino, Salvatore

    2006-01-01

    of functionalities presentation becomes much more demanding. The possibility offered by latest graphics machines has attracted the interest of researchers to investigate this new area. The goal of the presented work is the creation of a multi-modal presentation of a piece of contemporary art, tightening the relation......The use of different media such as photography and virtual reality combined with different presentation modalities may provide a user with an extraordinary tool for exploration and appreciation of real work of art. This is especially important in case of time-spatial works-of-art where the problem...... between computer graphics and arts. The focus is on an application that it is capable to cope in real-time with simulation of mirror reflections including multi reflections. The results were very encouraging which led to optimistic conclusions with a wide range of options for future works....

  11. Modeling most likely pathways for smuggling radioactive and special nuclear materials on a worldwide multi-modal transportation network

    Energy Technology Data Exchange (ETDEWEB)

    Saeger, Kevin J [Los Alamos National Laboratory; Cuellar, Leticia [Los Alamos National Laboratory

    2010-10-28

    Nuclear weapons proliferation is an existing and growing worldwide problem. To help with devising strategies and supporting decisions to interdict the transport of nuclear material, we developed the Pathway Analysis, Threat Response and Interdiction Options Tool (PATRIOT) that provides an analytical approach for evaluating the probability that an adversary smuggling radioactive or special nuclear material will be detected during transit. We incorporate a global, multi-modal transportation network, explicit representation of designed and serendipitous detection opportunities, and multiple threat devices, material types, and shielding levels. This paper presents the general structure of PATRIOT, all focuses on the theoretical framework used to model the reliabilities of all network components that are used to predict the most likely pathways to the target.

  12. Long-term outcomes of myopic choroidal neovascularisation treated with combined ranibizumab and dexamethasone characterised by multi-modal imaging.

    Science.gov (United States)

    Tan, Anna C S; Teo, Kelvin; Guan, Ong Sze; Koh, Adrian

    2016-10-01

    To characterise the long-term outcomes of myopic choroidal neovascularisation (mCNV) treated with combined ranibizumab and dexamethasone, with the use of multi-modal imaging. A retrospective study of 20 eyes with mCNV treated with intra-vitreal ranibizumab and dexamethasone on a treat-as-needed basis were followed up for a mean period of 47 months (range 19-81 months). The mean age was 55 ± 16 years, with mean refractive error of -9.0 diopters. Subfoveal mCNV was seen in 11 eyes (52 %) and the others were juxtafoveal. At the final visit, 13 patients (65 %) had improvement, while four patients (20 %) had worsening in vision. The average number of ranibizumab and dexamethasone injections required was 3 ± 1.7. There was a significant improvement in the mean visual acuity, reduction of the central retinal thickness, and an enlargement of the area of chorioretinal atrophy. The mean rate of increase in chorioretinal atrophy area was 0.05 ± 0.09 mm(2)/month. Disruption of the photoreceptor layer, fragmentation of the retinal pigment epithelium, and breaks in the Bruch's membrane with a hyper-reflective lesion causing separation of the outer retinal layers were changes associated with active mCNV seen on optical coherence tomography (OCT). Visual outcomes of mCNV treated with ranibizumab and dexamethasone on a treat-as-needed basis have favourable visual acuity outcomes. Using multi-modal imaging to monitor treatment response, chorioretinal atrophy, which may be related to visual function, should be used as an additional outcome measure to study the effect of combination treatment versus monotherapy.

  13. Validation of a multi-modal treatment protocol for Ewing sarcoma--a report from the polish pediatric oncology group.

    Science.gov (United States)

    Raciborska, Anna; Bilska, Katarzyna; Drabko, Katarzyna; Chaber, Radosław; Sobol, Grażyna; Pogorzała, Monika; Wyrobek, Elżbieta; Połczyńska, Katarzyna; Rogowska, Elżbieta; Rodriguez-Galindo, Carlos; Wożniak, Wojciech

    2014-12-01

    Ewing sarcoma (ES) is the second most common paediatric malignant bone tumor. Advances in multi-disciplinary care have resulted in significant improvement in cure rates over the last decades. However, the generalization of those results in countries traditionally excluded from large cooperative trials has yet to be demonstrated. We report the results of modern multi-disciplinary care for patients with ES in Poland. One hundred and thirty-two patients with ES were treated using modern multi-modal therapy during the period 2000-2009. Overall survival was estimated by Kaplan-Meier methods and compared using long-rank test and Cox models. Factors predictive of outcome in our setting were analyzed to identify distinct risk groups that could help identify areas for improvement. The median age at the time of diagnosis was 12.3 years. With a median follow-up of 5.0 years, the 5-year event-free survival (EFS) and OS estimates for localized disease were 54.88% and 68.29%, respectively. For patients with metastatic disease, 5-year EFS and OS estimates were 36% and 42%, respectively. There was no correlation between age and stage or site. Patients with localized, non-pelvic disease had better outcome than patients with axial tumors (71% vs. 44%, respectively, P = 0.00073). Treatment failure was associated with stage, pelvic primary, poor histological response, and type of local control. Successful treatment of ES requires optimal systemic and local therapy. We were able to replicate the results of modern multi-modal protocols. Validation of current treatment protocols in countries with more limited cancer treatment resources is required. © 2014 Wiley Periodicals, Inc.

  14. Collaboration of Miniature Multi-Modal Mobile Smart Robots over a Network

    Science.gov (United States)

    2015-08-14

    independently evolving research directions based on physics -based models of mechanical, electromechanical and electronic devices, operational constraints...interactions between independently evolving research directions based on physics -based models of mechanical, electromechanical and electronic devices...theoretical research on mathematics of failures in sensor-network-based miniature multimodal mobile robots and electromechanical systems. The views

  15. Characterization of cervical lymph-nodes using a multi-parametric and multi-modal approach for an early prediction of tumor response to chemo-radiotherapy.

    Science.gov (United States)

    Scalco, Elisa; Marzi, Simona; Sanguineti, Giuseppe; Vidiri, Antonello; Rizzo, Giovanna

    2016-12-01

    In the treatment of Head-and-Neck Squamous Cell Carcinoma (HNSCC), the early prediction of residual malignant lymph nodes (LNs) is currently required. Here, we investigated the potential of a multi-modal characterization (combination of CT, T2w-MRI and DW-MRI) at baseline and at mid-treatment, based on texture analysis (TA), for the early prediction of LNs response to chemo-radiotherapy (CRT). 30 patients with pathologically confirmed HNSCC treated with CRT were considered. All patients underwent a planning CT and two serial MR examinations (including T2w and DW images), one before and one at mid-CRT. For each patient the largest malignant LN was selected and within each LN, morphological and textural features were estimated from T2w-MRI and CT, besides a quantification of the apparent diffusion coefficient (ADC) from DW-MRI. After a median follow-up time of 26.6months, 19 LNs showed regional control, while 11 LNs showedregional failure at a median time of 4.6months. Linear discriminant analysis was used to test the accuracy of the image-based features in predicting the final response. Pre-treatment features showed higher predictive power than mid-CRT features, the ADC having the highest accuracy (80%); CT-based indices were found not predictive. When ADC was combined with TA, the classification performance increased (accuracy=82.8%). If only T2w-MRI features were considered, the best combination of pre-CRT indices and their variation reached an equivalent accuracy (81.8%). Our results may suggest that TA on T2w-MRI and ADC can be combined together to obtain a more accurate prediction of response to CRT. Copyright © 2016 Associazione Italiana di Fisica Medica. Published by Elsevier Ltd. All rights reserved.

  16. Specification Techniques for Multi-Modal Dialogues in the U-Wish Project

    NARCIS (Netherlands)

    Nijholt, A.; Dijk, van E.M.A.G.; Donk, O.; Sanchez, B.; Nada, N.; Rashid, A.; Arndt, T.; Sanchez, M.

    2000-01-01

    In this paper we describe the development of a specification technique for specifying interactive web-based services. We wanted to design a language that can be a means of communication between designers and developers of interactive services, that makes it easier to develop web-based services fitte

  17. Specification Techniques for Multi-Modal Dialogues in the U-Wish Project

    NARCIS (Netherlands)

    Nijholt, Antinus; Donk, O.A.; van Dijk, Elisabeth M.A.G.; Donk, O.; Sanchez, B.; Nada, N.; Rashid, A.; Arndt, T.; Sanchez, M.

    2000-01-01

    In this paper we describe the development of a specification technique for specifying interactive web-based services. We wanted to design a language that can be a means of communication between designers and developers of interactive services, that makes it easier to develop web-based services

  18. Superparamagnetic iron oxide nanoparticles function as a long-term, multi-modal imaging label for non-invasive tracking of implanted progenitor cells.

    Directory of Open Access Journals (Sweden)

    Christina A Pacak

    Full Text Available The purpose of this study was to determine the ability of superparamagnetic iron oxide (SPIO nanoparticles to function as a long-term tracking label for multi-modal imaging of implanted engineered tissues containing muscle-derived progenitor cells using magnetic resonance imaging (MRI and X-ray micro-computed tomography (μCT. SPIO-labeled primary myoblasts were embedded in fibrin sealant and imaged to obtain intensity data by MRI or radio-opacity information by μCT. Each imaging modality displayed a detection gradient that matched increasing SPIO concentrations. Labeled cells were then incorporated in fibrin sealant, injected into the atrioventricular groove of rat hearts, and imaged in vivo and ex vivo for up to 1 year. Transplanted cells were identified in intact animals and isolated hearts using both imaging modalities. MRI was better able to detect minuscule amounts of SPIO nanoparticles, while μCT more precisely identified the location of heavily-labeled cells. Histological analyses confirmed that iron oxide particles were confined to viable, skeletal muscle-derived cells in the implant at the expected location based on MRI and μCT. These analyses showed no evidence of phagocytosis of labeled cells by macrophages or release of nanoparticles from transplanted cells. In conclusion, we established that SPIO nanoparticles function as a sensitive and specific long-term label for MRI and μCT, respectively. Our findings will enable investigators interested in regenerative therapies to non-invasively and serially acquire complementary, high-resolution images of transplanted cells for one year using a single label.

  19. Superparamagnetic iron oxide nanoparticles function as a long-term, multi-modal imaging label for non-invasive tracking of implanted progenitor cells.

    Science.gov (United States)

    Pacak, Christina A; Hammer, Peter E; MacKay, Allison A; Dowd, Rory P; Wang, Kai-Roy; Masuzawa, Akihiro; Sill, Bjoern; McCully, James D; Cowan, Douglas B

    2014-01-01

    The purpose of this study was to determine the ability of superparamagnetic iron oxide (SPIO) nanoparticles to function as a long-term tracking label for multi-modal imaging of implanted engineered tissues containing muscle-derived progenitor cells using magnetic resonance imaging (MRI) and X-ray micro-computed tomography (μCT). SPIO-labeled primary myoblasts were embedded in fibrin sealant and imaged to obtain intensity data by MRI or radio-opacity information by μCT. Each imaging modality displayed a detection gradient that matched increasing SPIO concentrations. Labeled cells were then incorporated in fibrin sealant, injected into the atrioventricular groove of rat hearts, and imaged in vivo and ex vivo for up to 1 year. Transplanted cells were identified in intact animals and isolated hearts using both imaging modalities. MRI was better able to detect minuscule amounts of SPIO nanoparticles, while μCT more precisely identified the location of heavily-labeled cells. Histological analyses confirmed that iron oxide particles were confined to viable, skeletal muscle-derived cells in the implant at the expected location based on MRI and μCT. These analyses showed no evidence of phagocytosis of labeled cells by macrophages or release of nanoparticles from transplanted cells. In conclusion, we established that SPIO nanoparticles function as a sensitive and specific long-term label for MRI and μCT, respectively. Our findings will enable investigators interested in regenerative therapies to non-invasively and serially acquire complementary, high-resolution images of transplanted cells for one year using a single label.

  20. Multi-modal magnetic resonance imaging and histology of vascular function in xenografts using macromolecular contrast agent hyperbranched polyglycerol (HPG-GdF).

    Science.gov (United States)

    Baker, Jennifer H E; McPhee, Kelly C; Moosvi, Firas; Saatchi, Katayoun; Häfeli, Urs O; Minchinton, Andrew I; Reinsberg, Stefan A

    2016-01-01

    Macromolecular gadolinium (Gd)-based contrast agents are in development as blood pool markers for MRI. HPG-GdF is a 583 kDa hyperbranched polyglycerol doubly tagged with Gd and Alexa 647 nm dye, making it both MR and histologically visible. In this study we examined the location of HPG-GdF in whole-tumor xenograft sections matched to in vivo DCE-MR images of both HPG-GdF and Gadovist. Despite its large size, we have shown that HPG-GdF extravasates from some tumor vessels and accumulates over time, but does not distribute beyond a few cell diameters from vessels. Fractional plasma volume (fPV) and apparent permeability-surface area product (aPS) parameters were derived from the MR concentration-time curves of HPG-GdF. Non-viable necrotic tumor tissue was excluded from the analysis by applying a novel bolus arrival time (BAT) algorithm to all voxels. aPS derived from HPG-GdF was the only MR parameter to identify a difference in vascular function between HCT116 and HT29 colorectal tumors. This study is the first to relate low and high molecular weight contrast agents with matched whole-tumor histological sections. These detailed comparisons identified tumor regions that appear distinct from each other using the HPG-GdF biomarkers related to perfusion and vessel leakiness, while Gadovist-imaged parameter measures in the same regions were unable to detect variation in vascular function. We have established HPG-GdF as a biocompatible multi-modal high molecular weight contrast agent with application for examining vascular function in both MR and histological modalities. Copyright © 2015 John Wiley & Sons, Ltd.

  1. Soft, fortified ice-cream for head and neck cancer patients: a useful first step in nutritional and swallowing difficulties associated with multi-modal management.

    Science.gov (United States)

    Trinidade, Aaron; Martinelli, Katrina; Andreou, Zenon; Kothari, Prasad

    2012-04-01

    Patients with head and neck cancer have complex swallowing and nutritional concerns. Most patients are malnourished, and treatment modalities within the aerodigestive tract have profound effects on future swallowing and nutrition. The objective of this study is to investigate whether the introduction of fortified soft ice-cream to post-operative head and neck cancer patients would increase compliance with oral-feeding regimes. Using a questionnaire study, an ice-cream machine that produces fortified soft ice-cream was introduced onto our ward, and 30 patients were asked to fill out questionnaires based on their experience in addition to their oral-feeding regime. Results indicate that overall patient satisfaction and compliance with oral-feeding regimes increased: 77% felt that the taste was excellent and also felt that it was easy to eat; 60% felt that it eased the symptoms associated with their symptoms, in particular its cold temperature. We conclude from the results that the inability of patients undergoing multi-modal treatment for upper aerodigestive tract cancer to enjoy normal foods and its effects on their quality of life is underestimated. Providing a food to that is palatable, familiar and acceptable as it is safe and nutritionally sound can increase compliance with oral-feeding regimes. The ice-cream was safe to use in the early post-operative period, especially soothing in patients undergoing upper aerodigestive radiotherapy and high in protein and calorific content. Our practice may have wider benefits, including patients with oral and oropharyngeal infections, the elderly and patients with neurological dysphagia resulting from stroke.

  2. Synthesis and characterization of high-surface-area millimeter-sized silica beads with hierarchical multi-modal pore structure by the addition of agar

    Energy Technology Data Exchange (ETDEWEB)

    Han, Yosep; Choi, Junhyun [Department of Mineral Resources and Energy Engineering, Chonbuk National University, 567 Baekje-daero, Deokjin-gu, Jeonju-si, Jeollabuk-do 561–756 (Korea, Republic of); Tong, Meiping, E-mail: tongmeiping@iee.pku.edu.cn [The Key Laboratory of Water and Sediment Sciences, Ministry of Education, College of Environmental Sciences and Engineering, Peking University, Beijing 100871 (China); Kim, Hyunjung, E-mail: kshjkim@jbnu.ac.kr [Department of Mineral Resources and Energy Engineering, Chonbuk National University, 567 Baekje-daero, Deokjin-gu, Jeonju-si, Jeollabuk-do 561–756 (Korea, Republic of)

    2014-04-01

    Millimeter-sized spherical silica foams (SSFs) with hierarchical multi-modal pore structure featuring high specific surface area and ordered mesoporous frameworks were successfully prepared using aqueous agar addition, foaming and drop-in-oil processes. The pore-related properties of the prepared spherical silica (SSs) and SSFs were systematically characterized by field emission-scanning electron microscopy (FE-SEM), transmission electron microscopy (TEM), small-angle X-ray diffraction (SAXRD), Hg intrusion porosimetry, and N{sub 2} adsorption–desorption isotherm measurements. Improvements in the BET surface area and total pore volume were observed at 504 m{sup 2} g{sup −1} and 5.45 cm{sup 3} g{sup −1}, respectively, after an agar addition and foaming process. Despite the increase in the BET surface area, the mesopore wall thickness and the pore size of the mesopores generated from the block copolymer with agar addition were unchanged based on the SAXRD, TEM, and BJH methods. The SSFs prepared in the present study were confirmed to have improved BET surface area and micropore volume through the agar loading, and to exhibit interconnected 3-dimensional network macropore structure leading to the enhancement of total porosity and BET surface area via the foaming process. - Highlights: • Millimeter-sized spherical silica foams (SSFs) are successfully prepared. • SSFs exhibit high BET surface area and ordered hierarchical pore structure. • Agar addition improves BET surface area and micropore volume of SSFs. • Foaming process generates interconnected 3-D network macropore structure of SSFs.

  3. Multi-modality analysis of glucose aqueous solution using photoacoustic and dielectric spectroscopy for non-invasive glucose monitoring

    Science.gov (United States)

    Tajima, Takuro; Tanaka, Yujiro; Nakamura, Masahito; Seyama, Michiko

    2017-03-01

    Quantitative analysis of glucose using conventional optical spectroscopy suffers from a lack of repeatability due to high optical scattering in skin tissue. Here we present a multi-modality analysis of glucose aqueous solution using photoacoustic spectroscopy (PAS) and broadband dielectric spectroscopy (BDS). These techniques involve the direct detection of the acoustic and electromagnetic waves propagating through or reflecting from tissue without their being scattered. They therefore have potential for better tolerance to the variation of scattering. For PAS, to differentiate signals induced by water absorption, we select another laser wavelength (1.38 μm) that exhibits the same absorbance for water at 1.61 μm. Furthermore, one of the two photoacoustic signals is used to normalize the variations of acoustic properties in differential signal. Measured results for glucose solutions (0-2 g/dL) showed that the differential signal has a sensitivity of 1.61%/g·dL-1 and a detection limit of 120 mg/dL. We also tested glucose detection with BDS (500 MHz to 50 GHz) by detecting glucose hydration bonding at around 10-20 GHz. Using a partial least square analysis and first derivation on broadband spectra, we obtained an RMS error 19 mg/dL and a detection limit of 59 mg/dL. Using both the low-scattering ultrasonic and microwave detection techniques, we successfully captured the glucose footprint in the physiological range.

  4. "Combo" nanomedicine: Co-delivery of multi-modal therapeutics for efficient, targeted, and safe cancer therapy.

    Science.gov (United States)

    Kemp, Jessica A; Shim, Min Suk; Heo, Chan Yeong; Kwon, Young Jik

    2016-03-01

    The dynamic and versatile nature of diseases such as cancer has been a pivotal challenge for developing efficient and safe therapies. Cancer treatments using a single therapeutic agent often result in limited clinical outcomes due to tumor heterogeneity and drug resistance. Combination therapies using multiple therapeutic modalities can synergistically elevate anti-cancer activity while lowering doses of each agent, hence, reducing side effects. Co-administration of multiple therapeutic agents requires a delivery platform that can normalize pharmacokinetics and pharmacodynamics of the agents, prolong circulation, selectively accumulate, specifically bind to the target, and enable controlled release in target site. Nanomaterials, such as polymeric nanoparticles, gold nanoparticles/cages/shells, and carbon nanomaterials, have the desired properties, and they can mediate therapeutic effects different from those generated by small molecule drugs (e.g., gene therapy, photothermal therapy, photodynamic therapy, and radiotherapy). This review aims to provide an overview of developing multi-modal therapies using nanomaterials ("combo" nanomedicine) along with the rationale, up-to-date progress, further considerations, and the crucial roles of interdisciplinary approaches. Copyright © 2015 Elsevier B.V. All rights reserved.

  5. Broad-spectrum multi-modality image registration: from PET, CT, and MRI to autoradiography, microscopy, and beyond.

    Science.gov (United States)

    Zanzonico, P B

    2006-01-01

    Image registration and fusion are increasingly important components of both clinical and small-animal imaging and have lead to the development of a variety of pertinent hardware and software tools, including multi-modality, e.g. PET-CT, devices. At the same time, advances in microscopic imaging, including phosphor-plate digital autoradiography and immunohistochemistry, now allow ultra-high (sub-100 microm)-resolution molecular characterization of tissue sections. To date, however, in vivo imaging of intact subjects and ex vivo imaging of harvested tissues sections have remained separate and distinct, making it difficult to reliably inter-compare the former and the latter. The Department of Medical Physics and the Radiation Biophysics Laboratory at Memorial Sloan-Kettering Cancer Center, under the direction of Dr. Clifton Ling, has now designed, fabricated, and tested a stereotactic imaging system for so-called "broad-spectrum" image registration, from coarser-resolution in vivo imaging modalities such as PET, CT, and MRI to ultra-high-resolution ex vivo imaging techniques such as histology, autoradiography, and immunohistochemistry.

  6. Expanding neurochemical investigations with multi-modal recording: simultaneous fast-scan cyclic voltammetry, iontophoresis, and patch clamp measurements.

    Science.gov (United States)

    Kirkpatrick, D C; McKinney, C J; Manis, P B; Wightman, R M

    2016-08-02

    Multi-modal recording describes the simultaneous collection of information across distinct domains. Compared to isolated measurements, such studies can more easily determine relationships between varieties of phenomena. This is useful for neurochemical investigations which examine cellular activity in response to changes in the local chemical environment. In this study, we demonstrate a method to perform simultaneous patch clamp measurements with fast-scan cyclic voltammetry (FSCV) using optically isolated instrumentation. A model circuit simulating concurrent measurements was used to predict the electrical interference between instruments. No significant impact was anticipated between methods, and predictions were largely confirmed experimentally. One exception was due to capacitive coupling of the FSCV potential waveform into the patch clamp amplifier. However, capacitive transients measured in whole-cell current clamp recordings were well below the level of biological signals, which allowed the activity of cells to be easily determined. Next, the activity of medium spiny neurons (MSNs) was examined in the presence of an FSCV electrode to determine how the exogenous potential impacted nearby cells. The activities of both resting and active MSNs were unaffected by the FSCV waveform. Additionally, application of an iontophoretic current, used to locally deliver drugs and other neurochemicals, did not affect neighboring cells. Finally, MSN activity was monitored during iontophoretic delivery of glutamate, an excitatory neurotransmitter. Membrane depolarization and cell firing were observed concurrently with chemical changes around the cell resulting from delivery. In all, we show how combined electrophysiological and electrochemical measurements can relate information between domains and increase the power of neurochemical investigations.

  7. Multi-modal adaptive optics system including fundus photography and optical coherence tomography for the clinical setting.

    Science.gov (United States)

    Salas, Matthias; Drexler, Wolfgang; Levecq, Xavier; Lamory, Barbara; Ritter, Markus; Prager, Sonja; Hafner, Julia; Schmidt-Erfurth, Ursula; Pircher, Michael

    2016-05-01

    We present a new compact multi-modal imaging prototype that combines an adaptive optics (AO) fundus camera with AO-optical coherence tomography (OCT) in a single instrument. The prototype allows acquiring AO fundus images with a field of view of 4°x4° and with a frame rate of 10fps. The exposure time of a single image is 10 ms. The short exposure time results in nearly motion artifact-free high resolution images of the retina. The AO-OCT mode allows acquiring volumetric data of the retina at 200kHz A-scan rate with a transverse resolution of ~4 µm and an axial resolution of ~5 µm. OCT imaging is acquired within a field of view of 2°x2° located at the central part of the AO fundus image. Recording of OCT volume data takes 0.8 seconds. The performance of the new system is tested in healthy volunteers and patients with retinal diseases.

  8. Multi-modal causality analysis of eyes-open and eyes-closed data from simultaneously recorded EEG and MEG.

    Science.gov (United States)

    Anwar, Abdul Rauf; Mideska, Kidist Gebremariam; Hellriegel, Helge; Hoogenboom, Nienke; Krause, Holger; Schnitzler, Alfons; Deuschl, Günther; Raethjen, Jan; Heute, Ulrich; Muthuraman, Muthuraman

    2014-01-01

    Owing to the recent advances in multi-modal data analysis, the aim of the present study was to analyze the functional network of the brain which remained the same during the eyes-open (EO) and eyes-closed (EC) resting task. The simultaneously recorded electroencephalogram (EEG) and magnetoencephalogram (MEG) were used for this study, recorded from five distinct cortical regions of the brain. We focused on the 'alpha' functional network, corresponding to the individual peak frequency in the alpha band. The total data set of 120 seconds was divided into three segments of 18 seconds each, taken from start, middle, and end of the recording. This segmentation allowed us to analyze the evolution of the underlying functional network. The method of time-resolved partial directed coherence (tPDC) was used to assess the causality. This method allowed us to focus on the individual peak frequency in the 'alpha' band (7-13 Hz). Because of the significantly higher power in the recorded EEG in comparison to MEG, at the individual peak frequency of the alpha band, results rely only on EEG. The MEG was used only for comparison. Our results show that different regions of the brain start to `disconnect' from one another over the course of time. The driving signals, along with the feedback signals between different cortical regions start to recede over time. This shows that, with the course of rest, brain regions reduce communication with each another.

  9. Multi-Modal Treatment Of Calciphylaxis With Sodium-Thiosulfate, Cinacalcet And Sevelamer Including Long-Term Data

    Directory of Open Access Journals (Sweden)

    Hermann Salmhofer

    2013-09-01

    Full Text Available Background: Calciphylaxis is a rare, yet life-threatening disease mainly occurring in dialysis patients. Traditional options of treatment remain unsatisfactory. Methods: Here we present a novel, combined approach, treating calciphylaxis with IV sodium thiosulfate, cinacalcet and sevelamer. In a case series five hemodialysis patients, have been successfully treated with this regimen. Treatment and survival data were analyzed using descriptive statistics. Results: In all patients, a rapid decrease in pain, improvement of general condition and wound healing within six months occurred. Side effects were low. Drug dosages: IV sodium thiosulfate initial dose 119.4 +/- 84.9 g/m2/week, maintenance dose 40.6 +/- 9 g/m2/week; cinacalcet: maintenance dose 36 +/- 32.9 mg/d and sevelamer maintenance dose 3320 +/-1671 mg/d. One and two year survivals were 100 % and 80 %, respectively. We also report on long-term application of IV sodium thiosulfate of up to 52 months. Patient survival after diagnosis was 52, 84, 21, 36 and 30 months, respectively. Survival since initiation of hemodialysis was 76, 136, 89, 36 and 35 months, respectively. Conclusion: This novel combined approach, a multi-modal treatment of calciphylaxis with persistent hyperparathyroidism, using IV sodium thiosulfate, cinacalcet and sevelamer seems to improve the outcome of this devastating disease.

  10. Business Intelligence Basics: Multi-Modal Means of Analyzing Data Can Produce Actionable Results

    Science.gov (United States)

    Mills, Lane

    2008-01-01

    School systems face many decisions in developing and maintaining learning environments that create success for all students. From district operations to the classroom, district leaders implement solutions and take action based on the information they have at hand. While there is no shortage of data, turning that data into useful information is as…

  11. Business Intelligence Basics: Multi-Modal Means of Analyzing Data Can Produce Actionable Results

    Science.gov (United States)

    Mills, Lane

    2008-01-01

    School systems face many decisions in developing and maintaining learning environments that create success for all students. From district operations to the classroom, district leaders implement solutions and take action based on the information they have at hand. While there is no shortage of data, turning that data into useful information is as…

  12. Study on the recommendations of multi-modal and multi-level resources in social media%社会媒体多模态、多层次资源推荐技术研究

    Institute of Scientific and Technical Information of China (English)

    王大玲; 冯时; 张一飞; 于戈

    2014-01-01

    社会媒体中多模态和多层次的信息资源和基于各种关系构建的用户社群为推荐系统提供了更广阔的分析和选择空间,同时也带来了更多的问题与挑战。分析了当前社会媒体中用户与资源的关系以及社会媒体资源推荐的特点,分别从社会媒体资源推荐策略和相关支撑技术两方面综述了相关工作,将其概括为“社会媒体中用户角色的变化构成了更加复杂的用户关系”、“社会媒体资源表示形式呈现多模态特点”以及“社会媒体资源推荐应该满足多层次的用户需求”,并从多模态、多层次资源推荐方面提出进一步的研究方向。%The multi-modal and multi-level information resources and user communities based on various relation-ships in social media provide a broader space for recommenders to analyze and select the resources , but at the same time more problems and challenges develop .In this paper , the relationships between users and resources , and the characteristics of resource recommendations in current social media are analyzed .Related work is surveyed from so-cial media resource recommendations as well as its corresponding support techniques , which can be summarized as follows:more complex relationships among users formed by changes of user roles , multi-modal social media re-source expressions , and social media resource recommendations that satisfy the requirements of multi -level users . Finally, further research directions in multi-modal and multi-level resource recommendations are proposed .

  13. Effects of a Network-Centric Multi-Modal Communication Tool on a Communication Monitoring Task

    Science.gov (United States)

    2012-03-01

    their headphones. Digital filters, called head-related transfer functions, take advantage of binaural cues that normally occur when competing talkers...are spatially separated, and display the sounds over headphones in a similar manner. These types of auditory displays can produce virtual sounds that...are as localizable as sounds produced in the free field and have been shown to increase speaker intelligibility by 30-40% for headphone-based multi

  14. A new, open-source, multi-modality digital breast phantom

    Science.gov (United States)

    Graff, Christian G.

    2016-03-01

    An anthropomorphic digital breast phantom has been developed with the goal of generating random voxelized breast models that capture the anatomic variability observed in vivo. This is a new phantom and is not based on existing digital breast phantoms or segmentation of patient images. It has been designed at the outset to be modality agnostic (i.e., suitable for use in modeling x-ray based imaging systems, magnetic resonance imaging, and potentially other imaging systems) and open source so that users may freely modify the phantom to suit a particular study. In this work we describe the modeling techniques that have been developed, the capabilities and novel features of this phantom, and study simulated images produced from it. Starting from a base quadric, a series of deformations are performed to create a breast with a particular volume and shape. Initial glandular compartments are generated using a Voronoi technique and a ductal tree structure with terminal duct lobular units is grown from the nipple into each compartment. An additional step involving the creation of fat and glandular lobules using a Perlin noise function is performed to create more realistic glandular/fat tissue interfaces and generate a Cooper's ligament network. A vascular tree is grown from the chest muscle into the breast tissue. Breast compression is performed using a neo-Hookean elasticity model. We show simulated mammographic and T1-weighted MRI images and study properties of these images.

  15. Novelty detection of foreign objects in food using multi-modal X-ray imaging

    DEFF Research Database (Denmark)

    Einarsdottir, Hildur; Emerson, Monica Jane; Clemmensen, Line Katrine Harder

    2016-01-01

    In this paper we demonstrate a method for novelty detection of foreign objects in food products using grating-based multimodal X-ray imaging. With this imaging technique three modalities are available with pixel correspondence, enhancing organic materials such as wood chips, insects and soft...... plastics not detectable by conventional X-ray absorption radiography. We conduct experiments, where several food products are imaged with common foreign objects typically found in the food processing industry. To evaluate the benefit from using this multi-contrast X-ray technique over conventional X...

  16. Ontology-aided feature correlation for multi-modal urban sensing

    Science.gov (United States)

    Misra, Archan; Lantra, Zaman; Jayarajah, Kasthuri

    2016-05-01

    The paper explores the use of correlation across features extracted from different sensing channels to help in urban situational understanding. We use real-world datasets to show how such correlation can improve the accuracy of detection of city-wide events by combining metadata analysis with image analysis of Instagram content. We demonstrate this through a case study on the Singapore Haze. We show that simple ontological relationships and reasoning can significantly help in automating such correlation-based understanding of transient urban events.

  17. Automatic Image Registration of Multi-Modal Remotely Sensed Data with Global Shearlet Features

    Science.gov (United States)

    Murphy, James M.; Le Moigne, Jacqueline; Harding, David J.

    2016-01-01

    Automatic image registration is the process of aligning two or more images of approximately the same scene with minimal human assistance. Wavelet-based automatic registration methods are standard, but sometimes are not robust to the choice of initial conditions. That is, if the images to be registered are too far apart relative to the initial guess of the algorithm, the registration algorithm does not converge or has poor accuracy, and is thus not robust. These problems occur because wavelet techniques primarily identify isotropic textural features and are less effective at identifying linear and curvilinear edge features. We integrate the recently developed mathematical construction of shearlets, which is more effective at identifying sparse anisotropic edges, with an existing automatic wavelet-based registration algorithm. Our shearlet features algorithm produces more distinct features than wavelet features algorithms; the separation of edges from textures is even stronger than with wavelets. Our algorithm computes shearlet and wavelet features for the images to be registered, then performs least squares minimization on these features to compute a registration transformation. Our algorithm is two-staged and multiresolution in nature. First, a cascade of shearlet features is used to provide a robust, though approximate, registration. This is then refined by registering with a cascade of wavelet features. Experiments across a variety of image classes show an improved robustness to initial conditions, when compared to wavelet features alone.

  18. Expert consensus for multi-modality imaging evaluation of cardiovascular complications of radiotherapy in adults

    DEFF Research Database (Denmark)

    Lancellotti, Patrizio; Nkomo, Vuyisile T; Badano, Luigi P;

    2013-01-01

    recognized only in the early 1970s, the heart is regarded in the current era as one of the most critical dose-limiting organs in radiotherapy. Several clinical studies have identified adverse clinical consequences of radiation-induced heart disease (RIHD) on the outcome of long-term cancer survivors......Cardiac toxicity is one of the most concerning side effects of anti-cancer therapy. The gain in life expectancy obtained with anti-cancer therapy can be compromised by increased morbidity and mortality associated with its cardiac complications. While radiosensitivity of the heart was initially....... A comprehensive review of potential cardiac complications related to radiotherapy is warranted. An evidence-based review of several imaging approaches used to detect, evaluate, and monitor RIHD is discussed. Recommendations for the early identification and monitoring of cardiovascular complications...

  19. SITUATION ASSESSMENT THROUGH MULTI-MODAL SENSING OF DYNAMIC ENVIRONMENTS TO SUPPORT COGNITIVE ROBOT CONTROL

    Directory of Open Access Journals (Sweden)

    Atta Badii

    2014-12-01

    Full Text Available Awareness of emerging situations in a dynamic operational environment of a robotic assistive device is an essential capability of such a cognitive system, based on its effective and efficient assessment of the prevailing situation. This allows the system to interact with the environment in a sensible (semiautonomous / pro-active manner without the need for frequent interventions from a supervisor.  In this paper, we report a novel generic Situation Assessment Architecture for robotic systems directly assisting humans as developed in the CORBYS project. This paper presents the overall architecture for situation assessment and its application in proof-of-concept Demonstrators as developed and validated within the CORBYS project. These include a robotic human follower and a mobile gait rehabilitation robotic system. We present an overview of the structure and functionality of the Situation Assessment Architecture for robotic systems with results and observations as collected from initial validation on the two CORBYS Demonstrators.

  20. A multi-modal fusion scheme for the enhancement of PET/MR viewing

    Energy Technology Data Exchange (ETDEWEB)

    Aiello, Marco [IRCCS SDN, Naples (Italy); Monti, Serena [IRCCS SDN, Naples (Italy); Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Politecnico di Milano (Italy); Inglese, Marianna; Forte, Ernest; Cavaliere, Carlo [IRCCS SDN, Naples (Italy); Catalano, Onofrio Antonio [IRCCS SDN, Naples (Italy); Università degli studi di Napoli, Parthenope (Italy); Nicolai, Emanuele; Salvatore, Marco [IRCCS SDN, Naples (Italy)

    2015-05-18

    PET/MR imaging offers the possibility to achieve in one-shot both functional information provided by PET imaging and morpho-functional information with excellent soft tissue contrast provided by MRI. As a result of a typical PET/MR acquisition, each voxel carries a large amount of multivariate information that can be combined into a single image for a synthetic multi-parametric viewing (image fusion). This work is aimed to explore and introduce a reliable fusion scheme able to blend the useful information carried out from each modality into a single meaningful image. The proposed approach consists of a transformation of the source images followed by a blending and a consecutive reconstruction of fused image into the original domain. Following this scheme, three different transformations of source images (wavelet domain, Fourier domain and identity) and two blending procedures (alpha-blending and gamma-blending) were considered. For a comprehensive assessment of the fusion schemes under investigation, the results were evaluated both qualitatively and quantitatively on a dataset of 60 naturally coregistered. FDG-PET/MR studies of different anatomical districts in presence of neurological as well as oncological findings. The quality of fused images was assessed by experts who visually evaluated the loss of useful information with respect to the original modalities. Quantitatively, the information loss was estimated by means of a boundaries-preservation based metric as well as a metric based on mutual information. Preliminary results show that the fusion scheme composed by a wavelet-domain transform and a gamma-blending better depicts useful information of the original modalities. In particular, the proposed approach allows to better unveil the MR signal underlying PET signal in fused images in oncological as well as neurological studies. Furthermore, the use of a gamma-blending procedure ensures the best performances in a fully automated manner.

  1. Continuous Autoregulatory Indices Derived from Multi-Modal Monitoring: Each One Is Not Like the Other.

    Science.gov (United States)

    Zeiler, Frederick A; Donnelly, Joseph; Menon, David K; Smielewski, Peter; Zweifel, Christian; Brady, Ken; Czosnyka, Marek

    2017-07-21

    We assess the relationships between various continuous measures of autoregulatory capacity in a cohort of adults with traumatic brain injury (TBI). We assessed relationships between autoregulatory indices derived from intracranial pressure (ICP: PRx, PAx, RAC), transcranial Doppler (TCD: Mx, Sx, Dx), brain tissue-oxygenation (ORx), and spatially resolved near infrared spectroscopy (NIRS resolved: TOx, THx). Relationships between indices were assessed using Pearson correlation coefficient, Friedman test, principal component analysis (PCA), agglomerative hierarchal clustering (AHC) and k-means cluster analysis (KMCA). All analytic techniques were repeated for a range of temporal resolutions of data, including minute-by-minute averages, moving means of 30 samples, and grand mean for each patient. Thirty-seven patients were studied. The PRx displayed strong association with PAx/RAC across all the analytical techniques: Pearson correlation (r = 0.682/r = 0.677, p < 0.0001), PCA, AHC, and KMCA in the grand mean data sheet. Most TCD-based indices (Mx, Dx) were correlated and co-clustered on PCA, AHC, and KMCA. The Sx was found to be more closely associated with ICP-derived indices on Pearson correlation, PCA, AHC, and KMCA. The NIRS indices displayed variable correlation with each other and with indices derived from ICP and TCD signals. Of interest, TOx and THx co-cluster with ICP-based indices on PCA and AHC. The ORx failed to display any meaningful correlations with other indices in neither of the analytical method used. Thirty-minute moving average and minute-by-minute data set displayed similar results across all the methods. The RAC, Mx, and Sx were the strongest predictors of outcome at six months. Continuously updating autoregulatory indices are not all correlated with one another. Caution must be advised when utilizing less commonly described autoregulation indices (i.e., ORx) for the clinical assessment of autoregulatory capacity, because they appear

  2. A queuing model for designing multi-modality buried target detection systems: preliminary results

    Science.gov (United States)

    Malof, Jordan M.; Morton, Kenneth D.; Collins, Leslie M.; Torrione, Peter A.

    2015-05-01

    Many remote sensing modalities have been developed for buried target detection, each one offering its own relative advantages over the others. As a result there has been interest in combining several modalities into a single detection platform that benefits from the advantages of each constituent sensor, without suffering from their weaknesses. Traditionally this involves collecting data continuously on all sensors and then performing data, feature, or decision level fusion. While this is effective for lowering false alarm rates, this strategy neglects the potential benefits of a more general system-level fusion architecture. Such an architecture can involve dynamically changing which modalities are in operation. For example, a large standoff modality such as a forward-looking infrared (FLIR) camera can be employed until an alarm is encountered, at which point a high performance (but short standoff) sensor, such as ground penetrating radar (GPR), is employed. Because the system is dynamically changing its rate of advance and sensors, it becomes difficult to evaluate the expected false alarm rate and advance rate. In this work, a probabilistic model is proposed that can be used to estimate these quantities based on a provided operating policy. In this model the system consists of a set of states (e.g., sensors employed) and conditions encountered (e.g., alarm locations). The predictive accuracy of the model is evaluated using a collection of collocated FLIR and GPR data and the results indicate that the model is effective at predicting the desired system metrics.

  3. A multi-modality segmentation framework: application to fully automatic heart segmentation

    Science.gov (United States)

    Meyer, Carsten; Ecabert, Olivier; Peters, Jochen; Kneser, Reinhard; Manzke, Robert; Chan, Raymond C.; Weese, Jürgen

    2009-02-01

    Automatic segmentation is a prerequisite to efficiently analyze the large amount of image data produced by modern imaging modalities, e.g., computed tomography (CT), magnetic resonance (MR) and rotational X-ray volume imaging. While many segmentation approaches exist, most of them are developed for a single, specific imaging modality and a single organ. In clinical practice, however, it is becoming increasingly important to handle multiple modalities: First due to a case-specific choice of the most suitable imaging modality (e.g. CT versus MR), and second in order to integrate complementary data from multiple modalities. In this paper, we present a single, integrated segmentation framework which can easily be adapted to a range of imaging modalities and organs. Our algorithm is based on shape-constrained deformable models. Key elements are (1) a shape model representing the geometry and variability of the target organ of interest, (2) spatially varying boundary detection functions representing the gray value appearance of the organ boundaries for the specific imaging modality or protocol, and (3) a multi-stage segmentation approach. Focussing on fully automatic heart segmentation, we present evaluation results for CT,MR (contrast enhanced and non-contrasted), and rotational X-ray angiography (3-D RA). We achieved a mean segmentation error of about 0.8mm for CT and (non-contrasted) MR, 1.0mm for contrast-enhanced MR and 1.3mm for 3-D RA, demonstrating the success of our segmentation framework across modalities.

  4. Unimodal and Multi-Modal Perception of Cellular Phones: A Multidimensional Scaling Study

    Directory of Open Access Journals (Sweden)

    Yusuke Yamani

    2011-10-01

    Full Text Available Previous studies suggest that subjects gain modality-specific information across vision and tactile (Newell, Ernst, Tjan, & Bülthoff, 2001 and form a coherent percept (Ernst & Bülthoff, 2004. This study explored potential difference in perceiving real-world objects (cellular phones uni-modally (visual or haptic and bimodally. In phase 1, subjects provided verbal descriptions of 9 different phones while interacting in a visual, haptic, or cross-modal manner. In phase 2, a new group of subjects performed a card-sorting task using on the descriptions obtained in phase 1, with the instructions to sort descriptions based on similarity. A multidimensional scaling (MDS analysis was applied to similarity matrices produced in phase 2. Stress values for MDS fits of varying dimensionality were similar for haptic, visual, and bimodal conditions, suggesting that different inspection conditions produced mental representations of similar complexity. Inspection of 2D plots of descriptors across the three condition suggests that dimensions of usability and style. Results imply that people extract largely redundant information across different sensory modalities while evaluating cellular phones.

  5. Benefits of multi-modal fusion analysis on a large-scale dataset: life-span patterns of inter-subject variability in cortical morphometry and white matter microstructure.

    Science.gov (United States)

    Groves, Adrian R; Smith, Stephen M; Fjell, Anders M; Tamnes, Christian K; Walhovd, Kristine B; Douaud, Gwenaëlle; Woolrich, Mark W; Westlye, Lars T

    2012-10-15

    Neuroimaging studies have become increasingly multimodal in recent years, with researchers typically acquiring several different types of MRI data and processing them along separate pipelines that provide a set of complementary windows into each subject's brain. However, few attempts have been made to integrate the various modalities in the same analysis. Linked ICA is a robust data fusion model that takes multi-modal data and characterizes inter-subject variability in terms of a set of multi-modal components. This paper examines the types of components found when running Linked ICA on a large magnetic resonance imaging (MRI) morphometric and diffusion tensor imaging (DTI) data set comprising 484 healthy subjects ranging from 8 to 85 years of age. We find several strong global features related to age, sex, and intracranial volume; in particular, one component predicts age to a high accuracy (r=0.95). Most of the remaining components describe spatially localized modes of variability in white or gray matter, with many components including both tissue types. The multimodal components tend to be located in anatomically-related brain areas, suggesting a morphological and possibly functional relationship. The local components show relationships between surface-based cortical thickness and arealization, voxel-based morphometry (VBM), and between three different DTI measures. Further, we report components related to artifacts (e.g. scanner software upgrades) which would be expected in a dataset of this size. Most of the 100 extracted components showed interpretable spatial patterns and were found to be reliable using split-half validation. This work provides novel information about normal inter-subject variability in brain structure, and demonstrates the potential of Linked ICA as a feature-extracting data fusion approach across modalities. This exploratory approach automatically generates models to explain structure in the data, and may prove especially powerful for large

  6. Hierarchical Multi-modal Image Registration by Learning Common Feature Representations.

    Science.gov (United States)

    Ge, Hongkun; Wu, Guorong; Wang, Li; Gao, Yaozong; Shen, Dinggang

    2015-10-05

    Mutual information (MI) has been widely used for registering images with different modalities. Since most inter-modality registration methods simply estimate deformations in a local scale, but optimizing MI from the entire image, the estimated deformations for certain structures could be dominated by the surrounding unrelated structures. Also, since there often exist multiple structures in each image, the intensity correlation between two images could be complex and highly nonlinear, which makes global MI unable to precisely guide local image deformation. To solve these issues, we propose a hierarchical inter-modality registration method by robust feature matching. Specifically, we first select a small set of key points at salient image locations to drive the entire image registration. Since the original image features computed from different modalities are often difficult for direct comparison, we propose to learn their common feature representations by projecting them from their native feature spaces to a common space, where the correlations between corresponding features are maximized. Due to the large heterogeneity between two high-dimension feature distributions, we employ Kernel CCA (Canonical Correlation Analysis) to reveal such non-linear feature mappings. Then, our registration method can take advantage of the learned common features to reliably establish correspondences for key points from different modality images by robust feature matching. As more and more key points take part in the registration, our hierarchical feature-based image registration method can efficiently estimate the deformation pathway between two inter-modality images in a global to local manner. We have applied our proposed registration method to prostate CT and MR images, as well as the infant MR brain images in the first year of life. Experimental results show that our method can achieve more accurate registration results, compared to other state-of-the-art image registration

  7. Combined multi-modal photoacoustic tomography, optical coherence tomography (OCT) and OCT angiography system with an articulated probe for in vivo human skin structure and vasculature imaging.

    Science.gov (United States)

    Liu, Mengyang; Chen, Zhe; Zabihian, Behrooz; Sinz, Christoph; Zhang, Edward; Beard, Paul C; Ginner, Laurin; Hoover, Erich; Minneman, Micheal P; Leitgeb, Rainer A; Kittler, Harald; Drexler, Wolfgang

    2016-09-01

    Cutaneous blood flow accounts for approximately 5% of cardiac output in human and plays a key role in a number of a physiological and pathological processes. We show for the first time a multi-modal photoacoustic tomography (PAT), optical coherence tomography (OCT) and OCT angiography system with an articulated probe to extract human cutaneous vasculature in vivo in various skin regions. OCT angiography supplements the microvasculature which PAT alone is unable to provide. Co-registered volumes for vessel network is further embedded in the morphologic image provided by OCT. This multi-modal system is therefore demonstrated as a valuable tool for comprehensive non-invasive human skin vasculature and morphology imaging in vivo.

  8. Combined multi-modal photoacoustic tomography, optical coherence tomography (OCT) and OCT angiography system with an articulated probe for in vivo human skin structure and vasculature imaging

    Science.gov (United States)

    Liu, Mengyang; Chen, Zhe; Zabihian, Behrooz; Sinz, Christoph; Zhang, Edward; Beard, Paul C.; Ginner, Laurin; Hoover, Erich; Minneman, Micheal P.; Leitgeb, Rainer A.; Kittler, Harald; Drexler, Wolfgang

    2016-01-01

    Cutaneous blood flow accounts for approximately 5% of cardiac output in human and plays a key role in a number of a physiological and pathological processes. We show for the first time a multi-modal photoacoustic tomography (PAT), optical coherence tomography (OCT) and OCT angiography system with an articulated probe to extract human cutaneous vasculature in vivo in various skin regions. OCT angiography supplements the microvasculature which PAT alone is unable to provide. Co-registered volumes for vessel network is further embedded in the morphologic image provided by OCT. This multi-modal system is therefore demonstrated as a valuable tool for comprehensive non-invasive human skin vasculature and morphology imaging in vivo. PMID:27699106

  9. Evaluation of a multi-modal grounded theory approach to explore patients’ daily coping with breathlessness due to chronic obstructive pulmonary disease

    DEFF Research Database (Denmark)

    Bastrup, Lene; Dahl, Ronald; Pedersen, Preben Ulrich

    2013-01-01

    Conventional methods have not yet succeeded in capturing the complexity of how people with chronic obstructive pulmonary disease (COPD) cope with breathlessness during daily living. We used a multi-modal grounded theory (GT) approach to investigate coping. In this paper, we describe and evaluate ...... the potential to generate new knowledge and may become an important methodological contribution towards understanding the multidimensionality of coping with breathlessness.......; and be ethically justifiable. The approach should also be consistent with the GT methodology of generating a theory. Striving to develop and perfect the multi-modal GT approach was time-consuming. Apart from this practical challenge, the multimodal GT approach met all evaluation criteria. This approach has...... the participants’ ability to remember and narrate how they cope with breathlessness; capture the multidimensional aspects involved in coping with breathlessness; encompass tools for collecting both qualitative and quantitative data, providing the opportunity to generate, synchronize, and combine data...

  10. Effect of a multi-modal intervention on immunization rates in obstetrics and gynecology clinics.

    Science.gov (United States)

    Mazzoni, Sara E; Brewer, Sarah E; Pyrzanowski, Jennifer L; Durfee, M Josh; Dickinson, L Miriam; Barnard, Juliana G; Dempsey, Amanda F; O'Leary, Sean T

    2016-05-01

    the Tdap cohort (1248 pre- and 1493 post-intervention), and 12,443 in the HPV cohort (7966 pre- and 4477 post-intervention). Our population was largely Hispanic, English-speaking, and publicly insured. The rate of influenza vaccination increased from 35.4% pre-intervention to 46.0% post-intervention (P obstetrics and gynecology clinics. Integrating such evidence-based practices into routine obstetrics and gynecology care could positively impact preventive health for many women. Copyright © 2016 Elsevier Inc. All rights reserved.

  11. CoSMoMVPA: multi-modal multivariate pattern analysis of neuroimaging datain Matlab / GNU Octave

    Directory of Open Access Journals (Sweden)

    Nikolaas N Oosterhof

    2016-07-01

    Full Text Available Recent years have seen an increase in the popularity of multivariate pattern (MVP analysis of functional magnetic resonance (fMRI data, and, to a much lesser extent, magneto- and electro-encephalography (M/EEG data. We present CoSMoMVPA, a lightweight MVPA (MVP analysis toolbox implemented in the intersection of the Matlab and GNU Octave languages, that treats both fMRI and M/EEG data as first-class citizens.CoSMoMVPA supports all state-of-the-art MVP analysis techniques, including searchlight analyses, classification, correlations, representational similarity analysis, and the time generalization method. These can be used to address both data-driven and hypothesis-driven questions about neural organization and representations, both within and across: space, time, frequency bands, neuroimaging modalities, individuals, and species.It uses a uniform data representation of fMRI data in the volume or on the surface, and of M/EEG data at the sensor and source level. Through various external toolboxes, it directly supports reading and writing a variety of fMRI and M/EEG neuroimaging formats, and, where applicable, can convert between them. As a result, it can be integrated readily in existing pipelines and used with existing preprocessed datasets. CoSMoMVPA overloads the traditional volumetric searchlight concept to support neighborhoods for M/EEG and surface-based fMRI data, which supports localization of multivariate effects of interest across space, time, and frequency dimensions. CoSMoMVPA also provides a generalized approach to multiple comparison correction across these dimensions using Threshold-Free Cluster Enhancement with state-of-the-art clustering and permutation techniques.CoSMoMVPA is highly modular and uses abstractions to provide a uniform interface for a variety of MVP measures. Typical analyses require a few lines of code, making it accessible to beginner users. At the same time, expert programmers can easily extend its functionality

  12. A Single Session of rTMS Enhances Small-Worldness in Writer’s Cramp: Evidence from Simultaneous EEG-fMRI Multi-Modal Brain Graph

    Directory of Open Access Journals (Sweden)

    Rose D. Bharath

    2017-09-01

    Full Text Available Background and Purpose: Repetitive transcranial magnetic stimulation (rTMS induces widespread changes in brain connectivity. As the network topology differences induced by a single session of rTMS are less known we undertook this study to ascertain whether the network alterations had a small-world morphology using multi-modal graph theory analysis of simultaneous EEG-fMRI.Method: Simultaneous EEG-fMRI was acquired in duplicate before (R1 and after (R2 a single session of rTMS in 14 patients with Writer’s Cramp (WC. Whole brain neuronal and hemodynamic network connectivity were explored using the graph theory measures and clustering coefficient, path length and small-world index were calculated for EEG and resting state fMRI (rsfMRI. Multi-modal graph theory analysis was used to evaluate the correlation of EEG and fMRI clustering coefficients.Result: A single session of rTMS was found to increase the clustering coefficient and small-worldness significantly in both EEG and fMRI (p < 0.05. Multi-modal graph theory analysis revealed significant modulations in the fronto-parietal regions immediately after rTMS. The rsfMRI revealed additional modulations in several deep brain regions including cerebellum, insula and medial frontal lobe.Conclusion: Multi-modal graph theory analysis of simultaneous EEG-fMRI can supplement motor physiology methods in understanding the neurobiology of rTMS in vivo. Coinciding evidence from EEG and rsfMRI reports small-world morphology for the acute phase network hyper-connectivity indicating changes ensuing low-frequency rTMS is probably not “noise”.

  13. Evaluation of a multi-modal grounded theory approach to explore patients’ daily coping with breathlessness due to chronic obstructive pulmonary disease

    DEFF Research Database (Denmark)

    Bastrup, Lene; Dahl, Ronald; Pedersen, Preben Ulrich;

    2013-01-01

    the participants’ ability to remember and narrate how they cope with breathlessness; capture the multidimensional aspects involved in coping with breathlessness; encompass tools for collecting both qualitative and quantitative data, providing the opportunity to generate, synchronize, and combine data...... the multi-modal GT approach, which encompasses videos of daily life activity, interviews, medical history, demographics, self-rated sensation of breathlessness, and physiological measurements. A formative evaluation was conducted according to the criteria that the data collection should strengthen...

  14. 多模态教学在商务英语实训中的运用%Multi-modality Application in Business English Practical Training

    Institute of Scientific and Technical Information of China (English)

    刘国明

    2012-01-01

    Applying Multi-modality teaching method in Business English Practical Training can help teachers create real business scenarios and stimulate students' various modalities that students can practice effectively all the skills needed in work,eventually achieve practical training aims.%运用多模态教学,创造真实的商务场景,刺激学生的多种模态,可以提高教学效果。

  15. Comparison of multi-modal early oral nutrition for the tolerance of oral nutrition with conventional care after major abdominal surgery: a prospective, randomized, single-blind trial.

    Science.gov (United States)

    Sun, Da-Li; Li, Wei-Ming; Li, Shu-Min; Cen, Yun-Yun; Xu, Qing-Wen; Li, Yi-Jun; Sun, Yan-Bo; Qi, Yu-Xing; Lin, Yue-Ying; Yang, Ting; Lu, Qi-Ping; Xu, Peng-Yuan

    2017-02-10

    Early oral nutrition (EON) has been shown to improve recovery of gastrointestinal function, length of stay and mortality after abdominal surgery; however, early oral nutrition often fails during the first week after surgery. Here, a multi-modal early oral nutrition program is introduced to promote recovery of gastrointestinal function and tolerance of oral nutrition. Consecutive patients scheduled for abdominal surgery were randomized to the multimodal EON group or a group receiving conventional care. The primary endpoint was the time of first defecation. The secondary endpoints were outcomes and the cost-effectiveness ratio in treating infectious complications. The rate of infectious-free patients was regarded as the index of effectiveness. One hundred seven patients were randomly assigned to groups. Baseline characteristics were similar for both groups. In intention-to-treat analysis, the success rate of oral nutrition during the first week after surgery in the multimodal EON group was 44 (83.0%) versus 31 (57.4%) in the conventional care group (P = 0.004). Time to first defecation, time to flatus, recovery time of bowel sounds, and prolonged postoperative ileus were all less in the multimodal EON group (P multi-modal early oral nutrition group (P multi-modal early oral nutrition program was an effective way to improve tolerance of oral nutrition during the first week after surgery, decrease the length of stay and improve cost-effectiveness after abdominal surgery. Registration number: ChiCTR-TRC-14004395 . Registered 15 March 2014.

  16. Benefits of multi-session balance and gait training with multi-modal biofeedback in healthy older adults.

    Science.gov (United States)

    Lim, Shannon B; Horslen, Brian C; Davis, Justin R; Allum, John H J; Carpenter, Mark G

    2016-06-01

    Real-time balance-relevant biofeedback from a wearable sensor can improve balance in many patient populations, however, it is unknown if balance training with biofeedback has lasting benefits for healthy older adults once training is completed and biofeedback removed. This study was designed to determine if multi-session balance training with and without biofeedback leads to changes in balance performance in healthy older adults; and if changes persist after training. 36 participants (age 60-88) were randomly divided into two groups. Both groups trained on seven stance and gait tasks for 2 consecutive weeks (3×/week) while trunk angular sway and task duration were monitored. One group received real-time multi-modal biofeedback of trunk sway and a control group trained without biofeedback. Training effects were assessed at the last training session, with biofeedback available to the feedback group. Post-training effects (without biofeedback) were assessed immediately after, 1-week, and 1-month post-training. Both groups demonstrated training effects; participants swayed less when standing on foam with eyes closed (EC), maintained tandem-stance EC longer, and completed 8 tandem-steps EC faster and with less sway at the last training session. Changes in sway and duration, indicative of faster walking, were also observed after training for other gait tasks. While changes in walking speed persisted post-training, few other post-training effects were observed. These data suggest there is little added benefit to balance training with biofeedback, beyond training without, in healthy older adults. However, transient use of wearable balance biofeedback systems as balance aides remains beneficial for challenging balance situations and some clinical populations. Copyright © 2016 Elsevier B.V. All rights reserved.

  17. Multi-Modal Homing in Sea Turtles: Modeling Dual Use of Geomagnetic and Chemical Cues in Island-Finding.

    Science.gov (United States)

    Endres, Courtney S; Putman, Nathan F; Ernst, David A; Kurth, Jessica A; Lohmann, Catherine M F; Lohmann, Kenneth J

    2016-01-01

    Sea turtles are capable of navigating across large expanses of ocean to arrive at remote islands for nesting, but how they do so has remained enigmatic. An interesting example involves green turtles (Chelonia mydas) that nest on Ascension Island, a tiny land mass located approximately 2000 km from the turtles' foraging grounds along the coast of Brazil. Sensory cues that turtles are known to detect, and which might hypothetically be used to help locate Ascension Island, include the geomagnetic field, airborne odorants, and waterborne odorants. One possibility is that turtles use magnetic cues to arrive in the vicinity of the island, then use chemical cues to pinpoint its location. As a first step toward investigating this hypothesis, we used oceanic, atmospheric, and geomagnetic models to assess whether magnetic and chemical cues might plausibly be used by turtles to locate Ascension Island. Results suggest that waterborne and airborne odorants alone are insufficient to guide turtles from Brazil to Ascension, but might permit localization of the island once turtles arrive in its vicinity. By contrast, magnetic cues might lead turtles into the vicinity of the island, but would not typically permit its localization because the field shifts gradually over time. Simulations reveal, however, that the sequential use of magnetic and chemical cues can potentially provide a robust navigational strategy for locating Ascension Island. Specifically, one strategy that appears viable is following a magnetic isoline into the vicinity of Ascension Island until an odor plume emanating from the island is encountered, after which turtles might either: (1) initiate a search strategy; or (2) follow the plume to its island source. These findings are consistent with the hypothesis that sea turtles, and perhaps other marine animals, use a multi-modal navigational strategy for locating remote islands.

  18. DataViewer3D: An open-source, cross-platform multi-modal neuroimaging data visualization tool

    Directory of Open Access Journals (Sweden)

    Andre D Gouws

    2009-03-01

    Full Text Available Integration and display of results from multiple neuroimaging modalities (e.g. MRI, MEG, EEG relies on display of a diverse range of data within a common, defined coordinate frame. DataViewer3D (DV3D is a multi-modal imaging data visualization tool offering a cross-platform, open-source solution to simultaneous data overlay visualization requirements of imaging studies. While DV3D is primarily a visualization tool, the package allows an analysis approach where results from one imaging modality can guide comparative analysis of another modality in a single coordinate space. DV3D is built on Python, a dynamic object-oriented programming language with support for integration of modular toolkits, and development of cross-platform software for neuroimaging. DV3D harnesses the power of the Visualization Toolkit (VTK for 2D and 3D rendering, calling VTK's low level C++ functions from Python. Users interact with data via an intuitive interface that uses Python to bind wxWidgets, which in turn calls the user's operating system dialogs and graphical user interface tools. DV3D currently supports NIfTI-1, ANALYZE™ and DICOM formats for MRI data display (including statistical data overlay. Formats for other data types are supported. The modularity of DV3D and ease of use of Python allows rapid integration of additonal format support and user development. DV3D has been tested on Mac OSX, RedHat Linux and Microsoft Windows XP. DV3D is offered for free download with an extensive set of tutorial resources and example data.

  19. Multi-modal homing in sea turtles: modeling dual use of geomagnetic and chemical cues in island-finding

    Directory of Open Access Journals (Sweden)

    Courtney S Endres

    2016-02-01

    Full Text Available Sea turtles are capable of navigating across large expanses of ocean to arrive at remote islands for nesting, but how they do so has remained enigmatic. An interesting example involves green turtles (Chelonia mydas that nest on Ascension Island, a tiny land mass located approximately 2000 km from the turtles' foraging grounds along the coast of Brazil. Sensory cues that turtles are known to detect, and which might hypothetically be used to help locate Ascension Island, include the geomagnetic field, airborne odorants, and waterborne odorants. One possibility is that turtles use magnetic cues to arrive in the vicinity of the island, then use chemical cues to pinpoint its location. As a first step toward investigating this hypothesis, we used oceanic, atmospheric, and geomagnetic models to assess whether magnetic and chemical cues might plausibly be used by turtles to locate Ascension Island. Results suggest that waterborne and airborne odorants alone are insufficient to guide turtles from Brazil to Ascension, but might permit localization of the island once turtles arrive in its vicinity. By contrast, magnetic cues might lead turtles into the vicinity of the island, but would not typically permit its localization because the field shifts gradually over time. Simulations reveal, however, that the sequential use of magnetic and chemical cues can potentially provide a robust navigational strategy for locating Ascension Island. Specifically, one strategy that appears viable is following a magnetic isoline into the vicinity of Ascension Island until an odor plume emanating from the island is encountered, after which turtles might either: (1 initiate a search strategy; or (2 follow the plume to its island source. These findings are consistent with the hypothesis that sea turtles, and perhaps other marine animals, use a multi-modal navigational strategy for locating remote islands.

  20. Effective Beginning Handwriting Instruction: Multi-modal, Consistent Format for 2 Years, and Linked to Spelling and Composing.

    Science.gov (United States)

    Wolf, Beverly; Abbott, Robert D; Berninger, Virginia W

    2017-02-01

    In Study 1, the treatment group (N = 33 first graders, M = 6 years 10 months, 16 girls) received Slingerland multi-modal (auditory, visual, tactile, motor through hand, and motor through mouth) manuscript (unjoined) handwriting instruction embedded in systematic spelling, reading, and composing lessons; and the control group (N =16 first graders, M = 7 years 1 month, 7 girls) received manuscript handwriting instruction not systematically related to the other literacy activities. ANOVA showed both groups improved on automatic alphabet writing from memory; but ANCOVA with the automatic alphabet writing task as covariate showed that the treatment group improved significantly more than control group from the second to ninth month of first grade on dictated spelling and recognition of word-specific spellings among phonological foils. In Study 2 new groups received either a second year of manuscript (N = 29, M = 7 years 8 months, 16 girls) or introduction to cursive (joined) instruction in second grade (N = 24, M = 8 years 0 months, 11 girls) embedded in the Slingerland literacy program. ANCOVA with automatic alphabet writing as covariate showed that those who received a second year of manuscript handwriting instruction improved more on sustained handwriting over 30, 60, and 90 seconds than those who had had only one year of manuscript instruction; both groups improved in spelling and composing from the second to ninth month of second grade. Results are discussed in reference to mastering one handwriting format before introducing another format at a higher grade level and always embedding handwriting instruction in writing and reading instruction aimed at all levels of language.

  1. Immediate effects and short-term retention of multi-modal instruction compared to written only on muscle activity during the prone horizontal abduction exercise in individuals with shoulder pain.

    Science.gov (United States)

    Seitz, Amee L; Kocher, Jordan H; Uhl, Timothy L

    2014-10-01

    In rehabilitation, exercise instructions are multi-modal and can include a focus of increasing mean activity of a target muscle and inhibiting aberrant synergistic muscle activity, particularly during shoulder exercises, such as the prone horizontal abduction (PHA). The objective was to compare the immediate effects and short-term retention of multi-modal exercise instruction by a physical therapist written only instruction on normalized mean upper and lower trapezius muscle activity during three phases (concentric/isometric/eccentric) versus of an isotonic PHA exercise between participants with and without shoulder pain. Surface electromyography (EMG) was recorded from fourteen healthy participants and twelve participants with shoulder pain during the PHA exercise under two conditions: (1) written only instructions and (2) multi-modal instruction. Retention of multi-modal instruction on muscle activity was assessed one week later. Results demonstrate 12.8-16.0% increase in lower trapezius muscle activity during the concentric and isometric phases with multi-modal instructions in both groups. Inhibition of the upper trapezius did not occur in either group. Facilitation effects were maintained in short-term follow-up. Findings suggest that regardless of shoulder pain, multi-modal instruction by a physical therapist facilitates greater neuromuscular activity of a targeted muscle compared to written instructions alone and these effects are retained. Copyright © 2014 Elsevier Ltd. All rights reserved.

  2. Overview of multi-modal imaging technology and its development%多模式成像技术概述以及研究进展

    Institute of Scientific and Technical Information of China (English)

    王鑫; 刘飞; 李明泽; 刘欣; 白净

    2010-01-01

    Over the past several decades, medical imaging technology has developed rapidly and got wide applications. However, there is no one single imaging model suitable for all the clinical applications in the existing imaging technologies, such as X-CT, PET, SPECT, MRI, ultrasound, optical imaging and so on. Each one of them has its advantage and they can complement others, which brings on the development of the multi-modal imaging technology. This review gives introduction of the development of multi-modal imaging technology. Then,developments of systems, details of techniques and clinical applications are introduced in different terms including PET/CT, SPECT/CT, PET/MRI and so on. In the end, issues which should be considered, as well as the prospect of multi-modal imaging technology, are discussed.%在过去的几十年里,医学成像技术得到了迅速的发展以及广泛的应用.但目前存在的成像技术,如X-CT、PET、SPECT、MRI、超声以及光学成像等,没有一种成像方式能适用于所有方面的临床应用.不同成像技术各有所长,互相补充,这为多模式成像技术的发展提供了契机.首先介绍了多模式成像的历史和现状,然后介绍了PET/CT、SPECT/CT以及PET/MRI等系统的发展情况、技术细节以及临床应用,最后讨论了多模式成像过程中需要注意的问题,并展望了多模式成像技术的前景.

  3. Association between Gene Polymorphisms and Pain Sensitivity Assessed in a Multi-Modal Multi-Tissue Human Experimental Model - An Explorative Study

    DEFF Research Database (Denmark)

    Nielsen, Lecia Møller; Olesen, Anne Estrup; Sato, Hiroe;

    2016-01-01

    The genetic influence on sensitivity to noxious stimuli (pain sensitivity) remains controversial and needs further investigation. In the present study, the possible influence of polymorphisms in three opioid receptor (OPRM, OPRD and OPRK) genes and the catechol-O-methyltransferase (COMT) gene...... on pain sensitivity in healthy participants was investigated. Catechol-O-methyltransferase has an indirect effect on the mu opioid receptor by changing its activity through an altered endogenous ligand effect. Blood samples for genetic analysis were withdrawn in a multi-modal and multi-tissue experimental...

  4. Optimized Strategies for Model-View-Controller (MVC) Based on .Net Framework%一种基于.Net框架的MVC模式优化策略

    Institute of Scientific and Technical Information of China (English)

    李忠猛; 彭鹏菲

    2005-01-01

    对应于软件系统架构模式集群中MVC模式的设计思想,给出了在.Net框架中的Web实现方法,并着重提出了复杂系统中MVC模式的一种优化策略,创建了前端控制器的结构.具体的Web实现表明该方法在软件设计与集成中具有广泛的适用性.

  5. Multi-modal MRI investigation of volumetric and microstructural changes in the hippocampus and its subfields in mild cognitive impairment, Alzheimer's disease, and dementia with Lewy bodies.

    Science.gov (United States)

    Mak, Elijah; Gabel, Silvy; Su, Li; Williams, Guy B; Arnold, Robert; Passamonti, Luca; Vazquez Rodríguez, Patricia; Surendranathan, Ajenthan; Bevan-Jones, W Richard; Rowe, James B; O'Brien, John T

    2017-04-01

    Volumetric atrophy and microstructural alterations in diffusion tensor imaging (DTI) measures of the hippocampus have been reported in people with Alzheimer's disease (AD) and mild cognitive impairment (MCI). However, no study to date has jointly investigated concomitant microstructural and volumetric changes of the hippocampus in dementia with Lewy bodies (DLB). A total of 84 subjects (23 MCI, 17 DLB, 14 AD, and 30 healthy controls) were recruited for a multi-modal imaging (3T MRI and DTI) study that included neuropsychological evaluation. Freesurfer was used to segment the total hippocampus and delineate its subfields. The hippocampal segmentations were co-registered to the mean diffusivity (MD) and fractional anisotropy (FA) maps obtained from the DTI images. Both AD and MCI groups showed significantly smaller hippocampal volumes compared to DLB and controls, predominantly in the CA1 and subiculum subfields. Compared to controls, hippocampal MD was elevated in AD, but not in MCI. DLB was characterized by both volumetric and microstructural preservation of the hippocampus. In MCI, higher hippocampal MD was associated with greater atrophy of the hippocampus and CA1 region. Hippocampal volume was a stronger predictor of memory scores compared to MD within the MCI group. Through a multi-modal integration, we report novel evidence that the hippocampus in DLB is characterized by both macrostructural and microstructural preservation. Contrary to recent suggestions, our findings do not support the view that DTI measurements of the hippocampus are superior to volumetric changes in characterizing group differences, particularly between MCI and controls.

  6. Multi-modal Intelligent Seizure Acquisition (MISA) system - A new approach towards seizure detection based on full body motion measures

    DEFF Research Database (Denmark)

    Conradsen, Isa; Beniczky, Sándor; Wolf, Peter

    2009-01-01

    Many epilepsy patients cannot call for help during a seizure, because they are unconscious or because of the affection of their motor system or speech function. This can lead to injuries, medical complications and at worst death. An alarm system setting off at seizure onset could help to avoid...

  7. Multi-modal low cost mobile indoor surveillance system on the Robust Artificial Intelligence-based Defense Electro Robot (RAIDER)

    Science.gov (United States)

    Nair, Binu M.; Diskin, Yakov; Asari, Vijayan K.

    2012-10-01

    We present an autonomous system capable of performing security check routines. The surveillance machine, the Clearpath Husky robotic platform, is equipped with three IP cameras with different orientations for the surveillance tasks of face recognition, human activity recognition, autonomous navigation and 3D reconstruction of its environment. Combining the computer vision algorithms onto a robotic machine has given birth to the Robust Artificial Intelligencebased Defense Electro-Robot (RAIDER). The end purpose of the RAIDER is to conduct a patrolling routine on a single floor of a building several times a day. As the RAIDER travels down the corridors off-line algorithms use two of the RAIDER's side mounted cameras to perform a 3D reconstruction from monocular vision technique that updates a 3D model to the most current state of the indoor environment. Using frames from the front mounted camera, positioned at the human eye level, the system performs face recognition with real time training of unknown subjects. Human activity recognition algorithm will also be implemented in which each detected person is assigned to a set of action classes picked to classify ordinary and harmful student activities in a hallway setting.The system is designed to detect changes and irregularities within an environment as well as familiarize with regular faces and actions to distinguish potentially dangerous behavior. In this paper, we present the various algorithms and their modifications which when implemented on the RAIDER serves the purpose of indoor surveillance.

  8. Decreasing menopausal symptoms in women undertaking a web-based multi-modal lifestyle intervention: The Women's Wellness Program.

    Science.gov (United States)

    Anderson, Debra; Seib, Charrlotte; McGuire, Amanda; Porter-Steele, Janine

    2015-05-01

    Menopausal transition can be challenging for many women. This study tested the effectiveness of an intervention delivered in different modes in decreasing menopausal symptoms in midlife women. The Women's Wellness Program (WWP) intervention was delivered to 225 Australian women aged between 40 and 65 years through three modes (i.e., on-line independent, face-to-face with nurse consultations, and on-line with virtual nurse consultations). All women in the study were provided with a 12-week Program Book outlining healthy lifestyle behaviors while women in the consultation groups were supported by a registered nurse who provide tailored health education and assisted with individual goal setting for exercise, healthy eating, smoking and alcohol consumption. Pre- and post-intervention data were collected on menopausal symptoms (Greene Climacteric Scale), health related quality of life (SF12), and modifiable lifestyle factors. Linear mixed-effect models showed an average 0.87 and 1.23 point reduction in anxiety (plifestyle intervention embedded within a wellness framework has the potential to reduce menopausal symptoms and improve quality of life in midlife women thus potentially enhancing health and well-being in women as they age. Of course, study replication is needed to confirm the intervention effects.

  9. Multi-Modal Multi-Task Learning for Joint Prediction of Multiple Regression and Classification Variables in Alzheimer’s Disease

    Science.gov (United States)

    Zhang, Daoqiang; Shen, Dinggang

    2011-01-01

    Many machine learning and pattern classification methods have been applied to the diagnosis of Alzheimer’s disease (AD) and its prodromal stage, i.e., mild cognitive impairment (MCI). Recently, rather than predicting categorical variables as in classification, several pattern regression methods have also been used to estimate continuous clinical variables from brain images. However, most existing regression methods focus on estimating multiple clinical variables separately and thus cannot utilize the intrinsic useful correlation information among different clinical variables. On the other hand, in those regression methods, only a single modality of data (usually only the structural MRI) is often used, without considering the complementary information that can be provided by different modalities. In this paper, we propose a general methodology, namely Multi-Modal Multi-Task (M3T) learning, to jointly predict multiple variables from multi-modal data. Here, the variables include not only the clinical variables used for regression but also the categorical variable used for classification, with different tasks corresponding to prediction of different variables. Specifically, our method contains two key components, i.e., (1) a multi-task feature selection which selects the common subset of relevant features for multiple variables from each modality, and (2) a multi-modal support vector machine which fuses the above-selected features from all modalities to predict multiple (regression and classification) variables. To validate our method, we perform two sets of experiments on ADNI baseline MRI, FDG-PET, and cerebrospinal fluid (CSF) data from 45 AD patients, 91 MCI patients, and 50 healthy controls (HC). In the first set of experiments, we estimate two clinical variables such as Mini Mental State Examination (MMSE) and Alzheimer’s Disease Assessment Scale - Cognitive Subscale (ADAS-Cog), as well as one categorical variable (with value of ‘AD’, ‘MCI’ or

  10. Influence of English Video's Multi Modal Features on College English Listening Teaching%英文影视多模态特征对大学英语听力教学的影响研究

    Institute of Scientific and Technical Information of China (English)

    代启英

    2012-01-01

    One of the key steps on arousing students' interest in learning English listening and improving their disposable decoding ability is by multi-modal English video teaching, which encourages playfulness in learning, decreases the affective filter to the lowest. In this way, students can construct listening knowledge by themselves based on their knowledge and experience.%听力的教与学一直以来是教师和学生难以逾越的鸿沟,如何激发学生的听力学习兴趣来提高学生的一次性解码能力,关键之一就是通过多模态的英语影视教学,寓学于乐,将情感过滤降至最低点,学生可以在自己已有的知识和经验的基础上自主地建构听力知识。

  11. A combined salt-hard templating approach for synthesis of multi-modal porous carbons used for probing the simultaneous effects of porosity and electrode engineering on EDLC performance

    KAUST Repository

    Bhandari, Nidhi

    2015-06-01

    A new approach, based on a combination of salt and hard templating for producing multi-modal porous carbons is demonstrated. The hard template, silica nanoparticles, generate mesopores (∼22 nm), and in some cases borderline-macropores (∼64 nm), resulting in high pore volume (∼3.9 cm3/g) while the salt template, zinc chloride, generates borderline-mesopores (∼2 nm), thus imparting high surface area (∼2100 m2/g). The versatility of the proposed synthesis technique is demonstrated using: (i) dual salt templates with hard template resulting in magnetic, nanostructured-clay embedded (∼27% clay content), high surface area (∼1527 m2/g) bimodal carbons (∼2 and 70 nm pores), (ii) multiple hard templates with salt template resulting in tri-modal carbons (∼2, 12 and 28 nm pores), (iii) low temperature (450 °C) synthesis of bimodal carbons afforded by the presence of hygroscopic salt template, (iv) easy coupling with physical activation approaches. A selected set of thus synthesized carbons were used to evaluate, for the first time, the simultaneous effects of carbon porosity and pressure applied during electrode fabrication on EDLC performance. Electrode pressing was found to be more favorable for carbons containing hard-templated mesopores (∼87% capacitance retention at current density of 40 A/g) as compared to those without (∼54% capacitance retention). © 2015 Elsevier Ltd. All rights reserved.

  12. Diagnostic role of (99)Tc(m)-MDP SPECT/CT combined SPECT/MRI Multi modality imaging for early and atypical bone metastases.

    Science.gov (United States)

    Chen, Xiao-Liang; Li, Qian; Cao, Lin; Jiang, Shi-Xi

    2014-01-01

    The bone metastasis appeared early before the bone imaging for most of the above patients. (99)Tc(m)-MDP ((99)Tc(m) marked methylene diphosphonate) bone imaging could diagnosis the bone metastasis with highly sensitivity, but with lower specificity. The aim of this study is to explore the diagnostic value of (99)Tc(m)-MDP SPECT/CT combined SPECT/MRI Multi modality imaging for the early period atypical bone metastases. 15 to 30 mCi (99)Tc(m)-MDP was intravenously injected to the 34 malignant patients diagnosed as doubtful early bone metastases. SPECT, CT and SPECT/CT images were captured and analyzed consequently. For the patients diagnosed as early period atypical bone metastases by SPECT/CT, combining the SPECT/CT and MRI together as the SPECT/MRI integrated image. The obtained SPECT/MRI image was analyzed and compared with the pathogenic results of patients. The results indicated that 34 early period doubtful metastatic focus, including 34 SPECT positive focus, 17 focus without special changes by using CT method, 11 bone metastases focus by using SPECT/CT method, 23 doubtful bone metastases focus, 8 doubtful bone metastases focus, 14 doubtful bone metastases focus and 2 focus without clear image. Totally, SPECT/CT combined with SPECT/MRI method diagnosed 30 bone metastatic focus and 4 doubtfully metastatic focus. In conclusion, (99)Tc(m)-MDP SPECT/CT combined SPECT/MRI Multi modality imaging shows a higher diagnostic value for the early period bone metastases, which also enhances the diagnostic accuracy rate.

  13. Study protocol: a randomised controlled trial of the effects of a multi-modal exercise program on cognition and physical functioning in older women

    Directory of Open Access Journals (Sweden)

    Vaughan Sue

    2012-09-01

    Full Text Available Abstract Background Intervention studies testing the efficacy of cardiorespiratory exercise have shown some promise in terms of improving cognitive function in later life. Recent developments suggest that a multi-modal exercise intervention that includes motor as well as physical training and requires sustained attention and concentration, may better elicit the actual potency of exercise to enhance cognitive performance. This study will test the effect of a multi-modal exercise program, for older women, on cognitive and physical functioning. Methods/design This randomised controlled trial involves community dwelling women, without cognitive impairment, aged 65–75 years. Participants are randomised to exercise intervention or non-exercise control groups, for 16 weeks. The intervention consists of twice weekly, 60 minute, exercise classes incorporating aerobic, strength, balance, flexibility, co-ordination and agility training. Primary outcomes are measures of cognitive function and secondary outcomes include physical functioning and a neurocognitive biomarker (brain derived neurotrophic factor. Measures are taken at baseline and 16 weeks later and qualitative data related to the experience and acceptability of the program are collected from a sub-sample of the intervention group. Discussion If this randomised controlled trial demonstrates that multimodal exercise (that includes motor fitness training can improve cognitive performance in later life, the benefits will be two-fold. First, an inexpensive, effective strategy will have been developed that could ameliorate the increased prevalence of age-related cognitive impairment predicted to accompany population ageing. Second, more robust evidence will have been provided about the mechanisms that link exercise to cognitive improvement allowing future research to be better focused and potentially more productive. Trial registration Australian and New Zealand Clinical Trial Registration Number

  14. 轻度认知障碍患者多模态磁共振特征%Multi-modality magnetic resonance imaging features of cognitive function in mild cognitive impairment

    Institute of Scientific and Technical Information of China (English)

    王华丽; 袁慧书; 苏敏莹; 朱玥; 廖晶; 张关燕; 李涛; 于欣

    2010-01-01

    目的 探讨轻度认知损害者(MCI)和阿尔茨海默病(AD)患者多模态磁共振成像特征与认知功能的关系.方法 共纳入9例遗忘型MCI,15例轻度AD及11例正常对照,以简明精神状况检查(MMSE)和认知功能筛查测验(CASI)评估总体认知功能,对高分辨率结构像进行基于体素形态学分析(VBM),测量扩散张量成像(DTI)图像、各脑区白质各向异性比值(FA)和平均表观弥散系数(ADC),分析脑结构萎缩及白质DTI指标与认知评分的相关性.结果 MMSE和CASI评分与颞、额、顶、扣带回、海马旁回等结构灰质体积改变呈正相关(P<0.001),MMSE和CASI总分与颞、顶叶以及海马旁回的FA值呈正相关,与ADC值呈负相关(P<0.05).结论 MCI和AD患者认知功能与颞、顶、海马旁回等脑区萎缩及白质微观结构损伤密切相关,多模态影像技术可作为认知损害脑机制研究的重要技术手段.%Objective To investigate the association of multi-modality neuroimaging features and cognitive function in mild cognitive impairment (MCI) and Alzheimer's disease (AD).Methods Nine individuals with amnestic MCI (aMCI), fifteen patients with mild probable AD, and eleven age-controlled cognitively normal controls (NC) were recruited.All participants were administered with mini-mental status examination (MMSE) and Cognitive assessment screening instrument (CASI) to assess general cognitive function.Optimized voxel-based morphometry ( VBM ) was used for the analysis with 3-D high resolution anatomical images.Values of fractional anisotropy (FA) and mean apparent diffusivity coefficient (ADC) were measured from different brain regions on diffusion-tensor images ( DTI) .The relationship between structural atrophy and DTI-based measurements in the selected brain regions was examined.Results The scores of MMSE and CASI were correlated with the volumetric changes in such areas as temporal, frontal and parietal lobes, and cingulate gyrus and hippocampal

  15. Propagation in waveguides with varying cross section and curvature: a new light on the role of supplementary modes in multi-modal methods.

    Science.gov (United States)

    Maurel, Agnès; Mercier, Jean-François; Félix, Simon

    2014-06-08

    We present an efficient multi-modal method to describe the acoustic propagation in waveguides with varying curvature and cross section. A key feature is the use of a flexible geometrical transformation to a virtual space in which the waveguide is straight and has unitary cross section. In this new space, the pressure field has to satisfy a modified wave equation and associated modified boundary conditions. These boundary conditions are in general not satisfied by the Neumann modes, used for the series representation of the field. Following previous work, an improved modal method (MM) is presented, by means of the use of two supplementary modes. Resulting increased convergences are exemplified by comparison with the classical MM. Next, the following question is addressed: when the boundary conditions are verified by the Neumann modes, does the use of supplementary modes improve or degrade the convergence of the computed solution? Surprisingly, although the supplementary modes degrade the behaviour of the solution at the walls, they improve the convergence of the wavefield and of the scattering coefficients. This sheds a new light on the role of the supplementary modes and opens the way for their use in a wide range of scattering problems.

  16. Association between Gene Polymorphisms and Pain Sensitivity Assessed in a Multi-Modal Multi-Tissue Human Experimental Model - An Explorative Study.

    Science.gov (United States)

    Nielsen, Lecia Møller; Olesen, Anne Estrup; Sato, Hiroe; Christrup, Lona Louring; Drewes, Asbjørn Mohr

    2016-10-01

    The genetic influence on sensitivity to noxious stimuli (pain sensitivity) remains controversial and needs further investigation. In the present study, the possible influence of polymorphisms in three opioid receptor (OPRM, OPRD and OPRK) genes and the catechol-O-methyltransferase (COMT) gene on pain sensitivity in healthy participants was investigated. Catechol-O-methyltransferase has an indirect effect on the mu opioid receptor by changing its activity through an altered endogenous ligand effect. Blood samples for genetic analysis were withdrawn in a multi-modal and multi-tissue experimental pain model in 40 healthy participants aged 20-65. Seventeen different single nucleotide polymorphisms in different genes (OPRM, OPRK, OPRD and COMT) were included in the analysis. Experimental pain tests included thermal skin stimulation, mechanical muscle and bone stimulation and mechanical, electrical and thermal visceral stimulations. A cold pressor test was also conducted. DNA was available from 38 of 40 participants. Compared to non-carriers of the COMT rs4680A allele, carriers reported higher bone pressure pain tolerance threshold (i.e. less pain) by up to 23.8% (p 0.05). In conclusion, COMT rs4680 and OPRK rs6473799 polymorphisms seem to be associated with pain sensitivity. Thus, the findings support a possible genetic influence on pain sensitivity. © 2016 Nordic Association for the Publication of BCPT (former Nordic Pharmacological Society).

  17. Final report for LDRD project 11-0029 : high-interest event detection in large-scale multi-modal data sets : proof of concept.

    Energy Technology Data Exchange (ETDEWEB)

    Rohrer, Brandon Robinson

    2011-09-01

    Events of interest to data analysts are sometimes difficult to characterize in detail. Rather, they consist of anomalies, events that are unpredicted, unusual, or otherwise incongruent. The purpose of this LDRD was to test the hypothesis that a biologically-inspired anomaly detection algorithm could be used to detect contextual, multi-modal anomalies. There currently is no other solution to this problem, but the existence of a solution would have a great national security impact. The technical focus of this research was the application of a brain-emulating cognition and control architecture (BECCA) to the problem of anomaly detection. One aspect of BECCA in particular was discovered to be critical to improved anomaly detection capabilities: it's feature creator. During the course of this project the feature creator was developed and tested against multiple data types. Development direction was drawn from psychological and neurophysiological measurements. Major technical achievements include the creation of hierarchical feature sets created from both audio and imagery data.

  18. Sulfur-infiltrated porous carbon microspheres with controllable multi-modal pore size distribution for high energy lithium-sulfur batteries.

    Science.gov (United States)

    Zhao, Cunyu; Liu, Lianjun; Zhao, Huilei; Krall, Andy; Wen, Zhenhai; Chen, Junhong; Hurley, Patrick; Jiang, Junwei; Li, Ying

    2014-01-21

    Sulfur has received increasing attention as a cathode material for lithium-sulfur (Li-S) batteries due to its high theoretical specific capacity. However, the commercialization of Li-S batteries is limited by the challenges of poor electrical conductivity of sulfur, dissolution of the polysulfide intermediates into the electrolyte, and volume expansion of sulfur during cycling. Herein, we report the fabrication of novel-structured porous carbon microspheres with a controllable multi-modal pore size distribution, i.e., a combination of interconnected micropores, mesopores and macropores. Cathodes made of sulfur infiltrated in such a hierarchical carbon framework provide several advantages: (1) a continuous and high surface area carbon network for enhanced electrical conductivity and high sulfur loading; (2) macropores and large mesopores bridged by small mesopores to provide good electrolyte accessibility and fast Li ion transport and to accommodate volume expansion of sulfur; and (3) small mesopores and micropores to improve carbon/sulfur interaction and to help trap polysulfides. An initial discharge capacity at 1278 mA h g(-1) and capacity retention at 70.7% (904 mA h g(-1)) after 100 cycles at a high rate (1 C) were achieved. The material fabrication process is relatively simple and easily scalable.

  19. Multi-modal assessment of on-road demand of voice and manual phone calling and voice navigation entry across two embedded vehicle systems.

    Science.gov (United States)

    Mehler, Bruce; Kidd, David; Reimer, Bryan; Reagan, Ian; Dobres, Jonathan; McCartt, Anne

    2016-03-01

    One purpose of integrating voice interfaces into embedded vehicle systems is to reduce drivers' visual and manual distractions with 'infotainment' technologies. However, there is scant research on actual benefits in production vehicles or how different interface designs affect attentional demands. Driving performance, visual engagement, and indices of workload (heart rate, skin conductance, subjective ratings) were assessed in 80 drivers randomly assigned to drive a 2013 Chevrolet Equinox or Volvo XC60. The Chevrolet MyLink system allowed completing tasks with one voice command, while the Volvo Sensus required multiple commands to navigate the menu structure. When calling a phone contact, both voice systems reduced visual demand relative to the visual-manual interfaces, with reductions for drivers in the Equinox being greater. The Equinox 'one-shot' voice command showed advantages during contact calling but had significantly higher error rates than Sensus during destination address entry. For both secondary tasks, neither voice interface entirely eliminated visual demand. Practitioner Summary: The findings reinforce the observation that most, if not all, automotive auditory-vocal interfaces are multi-modal interfaces in which the full range of potential demands (auditory, vocal, visual, manipulative, cognitive, tactile, etc.) need to be considered in developing optimal implementations and evaluating drivers' interaction with the systems. Social Media: In-vehicle voice-interfaces can reduce visual demand but do not eliminate it and all types of demand need to be taken into account in a comprehensive evaluation.

  20. Integration of multi-modality imaging for accurate 3D reconstruction of human coronary arteries in vivo

    Science.gov (United States)

    Giannoglou, George D.; Chatzizisis, Yiannis S.; Sianos, George; Tsikaderis, Dimitrios; Matakos, Antonis; Koutkias, Vassilios; Diamantopoulos, Panagiotis; Maglaveras, Nicos; Parcharidis, George E.; Louridas, George E.

    2006-12-01

    In conventional intravascular ultrasound (IVUS)-based three-dimensional (3D) reconstruction of human coronary arteries, IVUS images are arranged linearly generating a straight vessel volume. However, with this approach real vessel curvature is neglected. To overcome this limitation an imaging method was developed based on integration of IVUS and biplane coronary angiography (BCA). In 17 coronary arteries from nine patients, IVUS and BCA were performed. From each angiographic projection, a single end-diastolic frame was selected and in each frame the IVUS catheter was interactively detected for the extraction of 3D catheter path. Ultrasound data was obtained with a sheath-based catheter and recorded on S-VHS videotape. S-VHS data was digitized and lumen and media-adventitia contours were semi-automatically detected in end-diastolic IVUS images. Each pair of contours was aligned perpendicularly to the catheter path and rotated in space by implementing an algorithm based on Frenet-Serret rules. Lumen and media-adventitia contours were interpolated through generation of intermediate contours creating a real 3D lumen and vessel volume, respectively. The absolute orientation of the reconstructed lumen was determined by back-projecting it onto both angiographic planes and comparing the projected lumen with the actual angiographic lumen. In conclusion, our method is capable of performing rapid and accurate 3D reconstruction of human coronary arteries in vivo. This technique can be utilized for reliable plaque morphometric, geometrical and hemodynamic analyses.

  1. Aberrant brain network efficiency in Parkinson’s disease patients with tremor: a multi-modality study

    Directory of Open Access Journals (Sweden)

    Delong eZhang

    2015-08-01

    Full Text Available The coordination of spontaneous brain activity is widely enhanced relative to compensation activity in Parkinson’s disease (PD with tremor; however, the associated topological organization remains unclear. Here, we collected magnetic resonance imaging (MRI data from 16 patients and 20 matched normal controls (NCs and constructed wavelet-based functional and morphological brain networks for individual participants. Graph-based network analysis indicated that the information translation efficiency in the functional brain network was disrupted within the wavelet scale 2 (i.e., .063–.125 Hz in PD patients. Compared with the NCs, the network local efficiency was decreased and the network global efficiency was increased in PD patients. Network local efficiency could effectively discriminate PD patients from the NCs using multivariate pattern analysis (MVPA, and could also describe the variability of tremor based on a multiple linear regression model (MLRM. However, these observations were not identified in the network global efficiency. Notably, the global and local efficiency were both significantly increased in the morphological brain network of PD patients. Further analysis showed that the global and local network efficiency both performed well in PD classifications (i.e., using MVPA and clinical performance descriptions (i.e., using MLRM. More importantly, functional and morphological brain networks were highly associated in terms of network local efficiency in PD patients. These findings provide a comprehensive view of network disorganization in PD with tremor and have important implications for understanding the neural substrates underlying this specific type of PD.

  2. Upconverting nanoparticles: a versatile platform for wide-field two-photon microscopy and multi-modal in vivo imaging.

    Science.gov (United States)

    Park, Yong Il; Lee, Kang Taek; Suh, Yung Doug; Hyeon, Taeghwan

    2015-03-21

    Lanthanide-doped upconverting nanoparticles (UCNPs) have recently attracted enormous attention in the field of biological imaging owing to their unique optical properties: (1) efficient upconversion photoluminescence, which is intense enough to be detected at the single-particle level with a (nonscanning) wide-field microscope setup equipped with a continuous wave (CW) near-infrared (NIR) laser (980 nm), and (2) resistance to photoblinking and photobleaching. Moreover, the use of NIR excitation minimizes adverse photoinduced effects such as cellular photodamage and the autofluorescence background. Finally, the cytotoxicity of UCNPs is much lower than that of other nanoparticle systems. All these advantages can be exploited simultaneously without any conflicts, which enables the establishment of a novel UCNP-based platform for wide-field two-photon microscopy. UCNPs are also useful for multimodal in vivo imaging because simple variations in the composition of the lattice atoms and dopant ions integrated into the particles can be easily implemented, yielding various distinct biomedical activities relevant to magnetic resonance imaging (MRI), computed tomography (CT), and positron emission tomography (PET). These multiple functions embedded in a single type of UCNPs play a crucial role in precise disease diagnosis. The application of UCNPs is extended to therapeutic fields such as photodynamic and photothermal cancer therapies through advanced surface conjugation schemes.

  3. An Analysis of Public Transit Connectivity Index in Tehran. The Case Study: Tehran Multi-Modal Transit Network

    Directory of Open Access Journals (Sweden)

    Amir Reza Mamdoohi

    2016-10-01

    Full Text Available Public transit is a major priority in modern management of large cities and metropolitan areas in particular. Public transit systems in such cities consist of a large number of nodes and lines which are represented by a complex network. A station for public transit is a bridge between the people and public transit network, based on which, the concept of input and output power for each station can be defined. The objective of this study is the application of the transit connectivity indices to the multimodal transit network in the city of Tehran. The public transit network data employed in this study is taken from Tehran Traffic Control Company, and Tehran Urban and Suburban Railway Operation Company. The methodology for measuring transit connectivity consists of three measures: Node connectivity, Line connectivity and Regional connectivity, where activity density is applied to these measures. The results of node connectivity analysis shows that most of the node connectivity in concentrated in the city center with many nodes in the center along routes going north and south. The line connectivity analysis shows that there is a concentration of highly connected lines that are near Tehran municipality region 12 and 16. Finally, we find that areas with more metro and bus facilities with respect to the other areas, have a better regional connectivity. One of these areas includes Sadeghiyeh Metro Station which is the junction of Tehran Metro Line 2 and Tehran Metro Line 5 which have a high connectivity power. Results of this study can be used to suggest some ideas on how future investments in rail and bus should be prioritized. Particularly in Transit Oriented Development (TOD and sustainble development projects, urban planners can design transit stations with high performance to access the crucial services in poor areas.

  4. Diagnosis and multi-modality treatment of adult pulmonary plastoma:Analysis of 18 cases and review of literature

    Institute of Scientific and Technical Information of China (English)

    Yun-Xi Wang; Jing Zhang; Xiang-Yang Chu; Yi Liu; Fang Li; Zhan-Bo Wang; Li-Xin Wei

    2014-01-01

    The clinical data of18 patients withPB fromApril1989 toApril2013 was analyzed retrospectively, including11 men and7 women, aged45 and76 years old(mean53 years).There were12 cases of PB occurring in right lung and other cases in left lung.Among them,3 patients had no symptoms, and15 patients displayed symptoms of cough, chest pain, asthenia or minor haemoptysis. Overall,11 patients had a preoperative diagnosis of lung cancer,7 patients were preoperatively diagnosed as the other diseases, which included lung benign tumor(n=5) and mediastinal mass (n=2).All patients received a radical resection.Six patients received postoperative cisplatin-based chemotherapy, and two patients received postoperative irradiation with the dose of55Gy. Histologically,14 cases of18 patients had biphasic pulmonary blastoma and four cases had well differentiated fetal adenocarcinoma.A total of12 patients died in a period of6-36 months after operation, and1 case was lost after2 years of follow up.The median survival time was19 months. PB is a rare primary lung malignant embryonal neoplasm.Despite its assumed embyonal origin, the tumor has a predilection for adults.A preoperative correct diagnosis is very difficult in spite of modern diagnostic imaging and biopsy techniques.Surgical resection is the main method for diagnosis and treatment.Postoperative chemotherapy or irradiation can help eliminate tumor remnants.Its prognosis is very poor, especially for the biphasic type.

  5. Multi-modal vibration amplitudes of taut inclined cables due to direct and/or parametric excitation

    Science.gov (United States)

    Macdonald, J. H. G.

    2016-02-01

    Cables are often prone to potentially damaging large amplitude vibrations. The dynamic excitation may be from external loading or motion of the cable ends, the latter including direct excitation, normally from components of end motion transverse to the cable, and parametric excitation induced by axial components of end motion causing dynamic tension variations. Geometric nonlinearity can be important, causing stiffening behaviour and nonlinear modal coupling. Previous analyses of the vibrations, often neglecting sag, have generally dealt with direct and parametric excitation separately or have reverted to numerical solutions of the responses. Here a nonlinear cable model is adopted, applicable to taut cables such as on cable-stayed bridges, that allows for cable inclination, small sag (such that the vibration modes are similar to those of a taut string), multiple modes in both planes and end motion and/or external forcing close to any natural frequency. Based on the method of scaling and averaging it is found that, for sinusoidal inputs and positive damping, non-zero steady state responses can only occur in the modes in each plane with natural frequencies close to the excitation frequency and those with natural frequencies close to half this frequency. Analytical solutions, in the form of non-dimensional polynomial equations, are derived for the steady state vibration amplitudes in up to three modes simultaneously: the directly excited mode, the corresponding nonlinearly coupled mode in the orthogonal plane and a parametrically excited mode with half the natural frequency. The stability of the solutions is also identified. The outputs of the equations are consistent with previous results, where available. Example results from the analytical solutions are presented for a typical inclined bridge cable subject to vertical excitation of the lower end, and they are validated by numerical integration of the equations of motion and against some previous experimental

  6. Enhanced Visualization of Subtle Outer Retinal Pathology by En Face Optical Coherence Tomography and Correlation with Multi-Modal Imaging

    Science.gov (United States)

    Chew, Avenell L.; Lamey, Tina; McLaren, Terri; De Roach, John

    2016-01-01

    Purpose To present en face optical coherence tomography (OCT) images generated by graph-search theory algorithm-based custom software and examine correlation with other imaging modalities. Methods En face OCT images derived from high density OCT volumetric scans of 3 healthy subjects and 4 patients using a custom algorithm (graph-search theory) and commercial software (Heidelberg Eye Explorer software (Heidelberg Engineering)) were compared and correlated with near infrared reflectance, fundus autofluorescence, adaptive optics flood-illumination ophthalmoscopy (AO-FIO) and microperimetry. Results Commercial software was unable to generate accurate en face OCT images in eyes with retinal pigment epithelium (RPE) pathology due to segmentation error at the level of Bruch’s membrane (BM). Accurate segmentation of the basal RPE and BM was achieved using custom software. The en face OCT images from eyes with isolated interdigitation or ellipsoid zone pathology were of similar quality between custom software and Heidelberg Eye Explorer software in the absence of any other significant outer retinal pathology. En face OCT images demonstrated angioid streaks, lesions of acute macular neuroretinopathy, hydroxychloroquine toxicity and Bietti crystalline deposits that correlated with other imaging modalities. Conclusions Graph-search theory algorithm helps to overcome the limitations of outer retinal segmentation inaccuracies in commercial software. En face OCT images can provide detailed topography of the reflectivity within a specific layer of the retina which correlates with other forms of fundus imaging. Our results highlight the need for standardization of image reflectivity to facilitate quantification of en face OCT images and longitudinal analysis. PMID:27959968

  7. CoSMoMVPA: Multi-Modal Multivariate Pattern Analysis of Neuroimaging Data in Matlab/GNU Octave.

    Science.gov (United States)

    Oosterhof, Nikolaas N; Connolly, Andrew C; Haxby, James V

    2016-01-01

    Recent years have seen an increase in the popularity of multivariate pattern (MVP) analysis of functional magnetic resonance (fMRI) data, and, to a much lesser extent, magneto- and electro-encephalography (M/EEG) data. We present CoSMoMVPA, a lightweight MVPA (MVP analysis) toolbox implemented in the intersection of the Matlab and GNU Octave languages, that treats both fMRI and M/EEG data as first-class citizens. CoSMoMVPA supports all state-of-the-art MVP analysis techniques, including searchlight analyses, classification, correlations, representational similarity analysis, and the time generalization method. These can be used to address both data-driven and hypothesis-driven questions about neural organization and representations, both within and across: space, time, frequency bands, neuroimaging modalities, individuals, and species. It uses a uniform data representation of fMRI data in the volume or on the surface, and of M/EEG data at the sensor and source level. Through various external toolboxes, it directly supports reading and writing a variety of fMRI and M/EEG neuroimaging formats, and, where applicable, can convert between them. As a result, it can be integrated readily in existing pipelines and used with existing preprocessed datasets. CoSMoMVPA overloads the traditional volumetric searchlight concept to support neighborhoods for M/EEG and surface-based fMRI data, which supports localization of multivariate effects of interest across space, time, and frequency dimensions. CoSMoMVPA also provides a generalized approach to multiple comparison correction across these dimensions using Threshold-Free Cluster Enhancement with state-of-the-art clustering and permutation techniques. CoSMoMVPA is highly modular and uses abstractions to provide a uniform interface for a variety of MVP measures. Typical analyses require a few lines of code, making it accessible to beginner users. At the same time, expert programmers can easily extend its functionality. Co

  8. An evaluation of the effectiveness of a multi-modal intervention in frail and pre-frail older people with type 2 diabetes--the MID-Frail study: study protocol for a randomised controlled trial.

    Science.gov (United States)

    Rodríguez-Mañas, Leocadio; Bayer, Antony J; Kelly, Mark; Zeyfang, Andrej; Izquierdo, Mikel; Laosa, Olga; Hardman, Timothy C; Sinclair, Alan J; Moreira, Severina; Cook, Justin

    2014-01-24

    Diabetes, a highly prevalent, chronic disease, is associated with increasing frailty and functional decline in older people, with concomitant personal, social, and public health implications. We describe the rationale and methods of the multi-modal intervention in diabetes in frailty (MID-Frail) study. The MID-Frail study is an open, randomised, multicentre study, with random allocation by clusters (each trial site) to a usual care group or an intervention group. A total of 1,718 subjects will be randomised with each site enrolling on average 14 or 15 subjects. The primary objective of the study is to evaluate, in comparison with usual clinical practice, the effectiveness of a multi-modal intervention (specific clinical targets, education, diet, and resistance training exercise) in frail and pre-frail subjects aged ≥70 years with type 2 diabetes in terms of the difference in function 2 years post-randomisation. Difference in function will be measured by changes in a summary ordinal score on the short physical performance battery (SPPB) of at least one point. Secondary outcomes include daily activities, economic evaluation, and quality of life. The MID-Frail study will provide evidence on the clinical, functional, social, and economic impact of a multi-modal approach in frail and pre-frail older people with type 2 diabetes. ClinicalTrials.gov: NCT01654341.

  9. The effects of pharmaceutical thrombolysis and multi-modal therapy on patients with acute posterior circulation ischemic stroke: Results of a one center retrospective study.

    Science.gov (United States)

    Yang, Yang; Liang, Chunyang; Shen, Chunsen; Tang, Hao; Ma, Shang; Zhang, Qiang; Gao, Mou; Dong, Qin; Xu, Ruxiang

    2017-03-01

    The treatment method for acute ischemic stroke is rapidly developing, and the effects of endovascular modalities, when used alone or in combination, needs to be studied. We aimed to identify the difference between pharmaceutical thrombolysis and multi-modal therapy (MMT) used in acute posterior circulation ischemic stroke (APCIS) patients and also to detect the predictors for successful recanalization and favorable outcomes. A retrospective analysis of patients with APCIS who received thrombolytic pharmaceuticals and MMT from 2011 to 2016 was performed at the stroke center. Demographic information, therapeutic methods and the results were recorded. Logistic regression model was constructed in variables to determine the predictors of outcome. A total of 124 patients were included in this study, the mean age was 59.6 ± 9.5 years and the mean admission National Institutes of Health Stroke Scale (NIHSS) was 15.1 ± 6.6. Recanalization was achieved in 87 (70.2%) patients and favorable outcomes were observed in 65 (52.4%) patients. Patients treated with MMT demonstrated a higher recanalization rate, especially the use of stent placement and thrombectomy device, which were also related to the favorable outcome three months post-stroke. Logistic regression showed that stent placement and thrombectomy were the predictors of recanalization, and a favorable outcome was associated with coronary artery disease, MMT methods as well as recanalization. MMT methods, especially stent placement and thrombectomy device may be the first recommended for patients with a delayed admission time, and it may have the advantage of better perfusion and neurological outcomes. Copyright © 2017 IJS Publishing Group Ltd. Published by Elsevier Ltd. All rights reserved.

  10. Malignant and borderline phyllodes tumor of breast treated with a multi-modality approach in a tertiary cancer care centre in North India

    Directory of Open Access Journals (Sweden)

    Supriya Mallick

    2016-01-01

    Full Text Available Background: Phyllodes tumor (PT of the breast can be categorized into benign, borderline and malignant subgroups depending on various histopathological factors. Although malignant PTs may be indolent and controlled by local excision, they frequently show local and distant relapses. Literature reveals local recurrence to be the predominant pattern of failure and thus emphasizes the importance of adjuvant radiation in these tumors. The role of systemic chemotherapy has remained doubtful. Materials and Methods: We have analyzed details of all patients of PT (n = 33 treated with adjuvant multi-modality approach in our institute since 1994–2009. The demographic data, treatment details, recurrence patterns and salvage treatment options were documented. Results: All patients received adjuvant radiation. Seven patients received adjuvant chemotherapy. The mean survival of the entire cohort was 150.618 months. There was a trend for better overall survival with borderline grade (193.6 vs. 160.2 months; P = 0.08, log rank. The disease free survival (DFS favored borderline grade (193.6 months vs. 82.9 months for high grade; P = 0.02, log rank. The DFS was significantly better in tumors having negative margins on postoperative histopathological examination (DFS rate at 5 years being 100% vs. 69.2% for positive or close margins; P = 0.015. The mode of surgery did not have any impact on survival. Conclusion: Adjuvant Radiation should be discussed taking into account surgical margins, size and various pathological factors of the primary. Adjuvant radiation may be utilized in high risk patients to enhance loco-regional control. Systemic chemotherapy is an option, worth exploring, in cases of systemic failure.

  11. Bedside functional brain imaging in critically-ill children using high-density EEG source modeling and multi-modal sensory stimulation

    Directory of Open Access Journals (Sweden)

    Danny Eytan

    2016-01-01

    Full Text Available Acute brain injury is a common cause of death and critical illness in children and young adults. Fundamental management focuses on early characterization of the extent of injury and optimizing recovery by preventing secondary damage during the days following the primary injury. Currently, bedside technology for measuring neurological function is mainly limited to using electroencephalography (EEG for detection of seizures and encephalopathic features, and evoked potentials. We present a proof of concept study in patients with acute brain injury in the intensive care setting, featuring a bedside functional imaging set-up designed to map cortical brain activation patterns by combining high density EEG recordings, multi-modal sensory stimulation (auditory, visual, and somatosensory, and EEG source modeling. Use of source-modeling allows for examination of spatiotemporal activation patterns at the cortical region level as opposed to the traditional scalp potential maps. The application of this system in both healthy and brain-injured participants is demonstrated with modality-specific source-reconstructed cortical activation patterns. By combining stimulation obtained with different modalities, most of the cortical surface can be monitored for changes in functional activation without having to physically transport the subject to an imaging suite. The results in patients in an intensive care setting with anatomically well-defined brain lesions suggest a topographic association between their injuries and activation patterns. Moreover, we report the reproducible application of a protocol examining a higher-level cortical processing with an auditory oddball paradigm involving presentation of the patient's own name. This study reports the first successful application of a bedside functional brain mapping tool in the intensive care setting. This application has the potential to provide clinicians with an additional dimension of information to manage

  12. Inter-modality relationship constrained multi-modality multi-task feature selection for Alzheimer's Disease and mild cognitive impairment identification.

    Science.gov (United States)

    Liu, Feng; Wee, Chong-Yaw; Chen, Huafu; Shen, Dinggang

    2014-01-01

    Previous studies have demonstrated that the use of integrated information from multi-modalities could significantly improve diagnosis of Alzheimer's Disease (AD). However, feature selection, which is one of the most important steps in classification, is typically performed separately for each modality, which ignores the potentially strong inter-modality relationship within each subject. Recent emergence of multi-task learning approach makes the joint feature selection from different modalities possible. However, joint feature selection may unfortunately overlook different yet complementary information conveyed by different modalities. We propose a novel multi-task feature selection method to preserve the complementary inter-modality information. Specifically, we treat feature selection from each modality as a separate task and further impose a constraint for preserving the inter-modality relationship, besides separately enforcing the sparseness of the selected features from each modality. After feature selection, a multi-kernel support vector machine (SVM) is further used to integrate the selected features from each modality for classification. Our method is evaluated using the baseline PET and MRI images of subjects obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Our method achieves a good performance, with an accuracy of 94.37% and an area under the ROC curve (AUC) of 0.9724 for AD identification, and also an accuracy of 78.80% and an AUC of 0.8284 for mild cognitive impairment (MCI) identification. Moreover, the proposed method achieves an accuracy of 67.83% and an AUC of 0.6957 for separating between MCI converters and MCI non-converters (to AD). These performances demonstrate the superiority of the proposed method over the state-of-the-art classification methods.

  13. The Influence of Mid-Event Deception on Psychophysiological Status and Pacing Can Persist across Consecutive Disciplines and Enhance Self-paced Multi-modal Endurance Performance

    Science.gov (United States)

    Taylor, Daniel; Smith, Mark F.

    2017-01-01

    Purpose: To examine the effects of deceptively aggressive bike pacing on performance, pacing, and associated physiological and perceptual responses during simulated sprint-distance triathlon. Methods: Ten non-elite, competitive male triathletes completed three simulated sprint-distance triathlons (0.75 km swim, 500 kJ bike, 5 km run), the first of which established personal best “baseline” performance (BL). During the remaining two trials athletes maintained a cycling power output 5% greater than BL, before completing the run as quickly as possible. However, participants were informed of this aggressive cycling strategy before and during only one of the two trials (HON). Prior to the alternate trial (DEC), participants were misinformed that cycling power output would equal that of BL, with on-screen feedback manipulated to reinforce this deception. Results: Compared to BL, a significantly faster run performance was observed following DEC cycling (p triathlon performance to be quicker during DEC (4339 ± 395 s) compared to HON (4356 ± 384 s), the only significant and almost certainly meaningful differences were between each of these trials and BL (4465 ± 420 s; p triathlon run. Conclusions: The present study is the first to show that mid-event pace deception can have a practically meaningful effect on multi-modal endurance performance, though the relative importance of different psychophysiological and emotional responses remains unclear. Whilst our findings support the view that some form of anticipatory “template” may be used by athletes to interpret levels of psychophysiological and emotional strain, and regulate exercise intensity accordingly, they would also suggest that individual constructs such as RPE and affect may be more loosely tied with pacing than previously suggested. PMID:28174540

  14. Multi-Modalities Sensor Science

    Science.gov (United States)

    2015-02-28

    portable and high efficiency Raman testing system was developed to distinguish different types of avian influenza viruses. Figure1. SEM of Gold...Current Simultaneously,Physical Review Letters, Volume 113, Issue 20 6). Huilin Zhu, Yuebo Fan , Huan Guo, Dan Huang, and Sailing He, Reduced...enhancement with transformation optics (invited paper)," Progress In Electromagnetics Research, Vol. 146, 187-194, 2014. 8) H.Zhu, Y. Fan , H. Guo, D

  15. Multi-modal analysis of functional connectivity and cerebral blood flow reveals shared and unique effects of propofol in large-scale brain networks.

    Science.gov (United States)

    Qiu, Maolin; Scheinost, Dustin; Ramani, Ramachandran; Constable, R Todd

    2017-03-01

    Anesthesia-induced changes in functional connectivity and cerebral blow flow (CBF) in large-scale brain networks have emerged as key markers of reduced consciousness. However, studies of functional connectivity disagree on which large-scale networks are altered or preserved during anesthesia, making it difficult to find a consensus amount studies. Additionally, pharmacological alterations in CBF could amplify or occlude changes in connectivity due to the shared variance between CBF and connectivity. Here, we used data-driven connectivity methods and multi-modal imaging to investigate shared and unique neural correlates of reduced consciousness for connectivity in large-scale brain networks. Rs-fMRI and CBF data were collected from the same subjects during an awake and deep sedation condition induced by propofol. We measured whole-brain connectivity using the intrinsic connectivity distribution (ICD), a method not reliant on pre-defined seed regions, networks of interest, or connectivity thresholds. The shared and unique variance between connectivity and CBF were investigated. Finally, to account for shared variance, we present a novel extension to ICD that incorporates cerebral blood flow (CBF) as a scaling factor in the calculation of global connectivity, labeled CBF-adjusted ICD). We observed altered connectivity in multiple large-scale brain networks including the default mode (DMN), salience, visual, and motor networks and reduced CBF in the DMN, frontoparietal network, and thalamus. Regional connectivity and CBF were significantly correlated during both the awake and propofol condition. Nevertheless changes in connectivity and CBF between the awake and deep sedation condition were only significantly correlated in a subsystem of the DMN, suggesting that, while there is significant shared variance between the modalities, changes due to propofol are relatively unique. Similar, but less significant, results were observed in the CBF-adjusted ICD analysis, providing

  16. 多式综合公交系统线网布局优化模型及仿真%Network layout optimization model of multi-modal comprehensive public transit system and simulation

    Institute of Scientific and Technical Information of China (English)

    周高卫; 罗霞

    2013-01-01

    结合综合公交中各式公交的适应性和服务阈值,兼顾出行者不同出行目的时间价值敏感性,建立了综合公交系统线网布局双层优化模型,上层是O-1数学规划模型,下层是用户平衡分配模型.同时,基于改进的IOA进行优化求解,克服了传统单式线网优化层次化不显著的缺陷,提高了布局优化过程求解效率.算例仿真结果表明:综合公交系统需求多样性在客观上决定综合公交系统线网的多元性和层次性,线网布局优化需考虑不同出行目的的时间价值特性,以提升系统速度和能力的连续性.同时,基于改进的IOA在多式综合公交系统线网布局优化的巨大搜索空间中可靠便捷地找到近似最优解,提高了计算效率.%In combination of the different transit mode' s adaptability and service threshold of the multi-modal comprehensive public transit system,this paper established the layout bi-level optimization model of comprehensive transit system, giving attention to the time value sensitivity of different trip purposes. The upper model was 0-1 mathematics programming model, while the lower model was the user equilibrium assignment model. Besides, this paper proposed solving algorithm based on the improved IOA, it adopted above algorithm to find solution of model which overcame the defects of lack of significant hierarchy and the consubstantial trend of traditional single mode network optimization and it improved the solving effect as well. Example simulation result shows that the diversity of comprehensive transit system demand objectively determines its network hierarchy and pluralism and the network layout optimization should consider different time value to improve the system speed and capacity continuity. The improved IOA can find the approximate best result in the huge search space of optimization, while greatly increases the computational efficiency.

  17. The Study of Multi-modal Transportation in the Light of“One Belt and One Road”%“一带一路”背景下我国海陆联运建设与发展

    Institute of Scientific and Technical Information of China (English)

    张滨; 黄波; 樊娉

    2015-01-01

    “一带一路”背景下,要实现互联互通,交通运输行业实际上起着基础和支撑作用,而将陆上丝绸之路和海上丝绸之路有效衔接的交通运输方式——海陆联运的建设与发展,必将成为“一带一路”战略的重要一环。目前,我国海陆联运在建设与发展过程中仍存在诸多问题,如码头基础设施与技术装备落后,海陆运输衔接困难,交通运输能力不足等。因此,应积极发展现代港口物流,规范多式联运市场,继续完善水陆交通网络,加快信息技术应用,完善相关法律法规,为“一带一路”战略的全面实施提供有力保障。%In the light of“One Belt and One Road”,the transportation industry should play the fundamental and supporting role in realizing the connectivity;and the construction and development of multi-modal transportation,which links the Overland Silk Road and Maritime Silk Road,will definitely become one of the important links in the strategy of“One Belt and One Road”. At present,there are still some problems with the construction and development of multi-modal transportation,such as the lagged behind dock infrastructure and technology and equipment,the difficult linkage in multi-modal transportation,and the insufficient capability of transportation. So,we should develop modern port logistics,standardize the market of multi-modal transportation,improve the water and land transportation network,speed up the application of information technology,perfect related laws and policies,and provide the powerful safeguard for the realization of“One Belt and One Road”.

  18. SU-E-I-84: Accuracy Comparison of Multi-Modality Image-Based Volumes of Rodent Solid Tumors Using In-Air Micro-CT Image Volume

    Energy Technology Data Exchange (ETDEWEB)

    Lee, Y [University of Kansas Hospital, Kansas City, KS (United States); Fullerton, G; Goins, B [University of Texas Health Science Center at San Antonio, San Antonio, TX (United States)

    2015-06-15

    Purpose: Tumor volume is considered as a better predictor for therapy response monitoring and tumor staging over Response Evaluation Criteria In Solid Tumors (RECIST) or World Health Organization (WHO) criteria. In this study, the accuracy of subcutaneous rodent tumor volumes using preclinical magnetic resonance imaging (MRI), micro-computed tomography (micro-CT) and ultrasound (US) equipment and with an external caliper was compared using in-air micro-CT image volume of excised tumors determined as reference tumor volume in our prior study. Methods: MR, US and micro-CT images of subcutaneous SCC4 head and neck tumor xenografts were acquired 4, 6, 9, 11 and 13 days after tumor cell inoculation. Before MR and US scans, caliper measurements were made. After tumors were excised, in-air micro-CT imaging and ex vivo caliper measurements were performed. Tumor volumes were calculated using formula V = (π/6)*a*b*c where a, b and c are the maximum diameters in three perpendicular dimensions determined by the three image modalities and caliper, and compared with reference tumor volume by linear regression analysis as well as Bland-Altman plots. A one-way Analysis of Variance (ANOVA) test was also performed to compare volumes among caliper measurements. Results: The correlation coefficients (R2) of the regression lines for tumor volumes measured by the three imaging modalities and caliper were 0.9939, 0.9669, 0.9806, 0.9274, 0.9619 and 0.9819 for MRI, US and micro-CT, caliperbeforeMRI, caliperbeforeUS and ex vivo caliper respectively. In Bland-Altman plots, the average of tumor volume difference from reference tumor volume (bias) was significant for caliper and micro- CT, but not for MRI and US. Comparison of caliper measurements showed a significant difference (p < 0.05). Conclusion: Using the in-air micro-CT image volume, tumor volume measured by MRI was the most accurate among the three imaging modalities. In vivo caliper volume measurements showed unreliability while ex vivo caliper measurements reduced errors.

  19. Evaluation of a supervised multi-modal physical exercise program for prostate cancer survivors in the rehabilitation phase: Rationale and study protocol of the ProCaLife study.

    Science.gov (United States)

    Schega, Lutz; Törpel, Alexander; Hein, Nico; Napiontek, André; Wenzel, Constanze; Becker, Tim

    2015-11-01

    After treatment for localized prostate cancer, many survivors experience severe physical and psychological/psychosocial impairments, such as urinary incontinence, erectile dysfunction, fatigue, depressive symptoms and decreased physical functioning. Physical activity and exercise can positively influence such side effects and improve quality of life. However, the majority of prostate cancer survivors are not physically active. Thus, supportive interventions, such as supervised exercise programs, are necessary. But particularly in the post-treatment phase, infrastructure and resources are limited and specific exercise recommendations for prostate cancer survivors do not yet exist. The ProCaLife study is a quasi-randomized controlled intervention trial evaluating a specific 26-week physical exercise program for prostate cancer survivors in the rehabilitation phase following medical treatment. Participants are assigned to one of two intervention groups (supervised multi-modal physical exercise including or not including further behavior-oriented techniques) or a control group (not receiving any supervised intervention). Exercise sessions are performed twice weekly and contain specific aerobic, strengthening, flexibility, balance, relaxation and pelvic floor/sphincter exercises as well as mixed games. Behavior-oriented techniques include physical activity-related knowledge transfer and barriers management. The primary endpoint quality of life and secondary psychological/psychosocial, urological, physical fitness and physical activity outcomes are assessed at pre-intervention, post-intervention and follow-up time points. By evaluating a specific supervised multi-modal physical exercise program, the ProCaLife study contributes to identify effective forms of physical exercise for prostate cancer survivors in the rehabilitation phase. This is of great importance for establishing specific exercise recommendations which are missing so far.

  20. Design of web applications framework based on model-View-Controller%基于模型-视图-控制器的Web应用程序框架设计

    Institute of Scientific and Technical Information of China (English)

    王文新

    2009-01-01

    根据模型-视图-控制器(MVC)设计模式,提出一个web应用程序开发框架,该框架可简化web应用程序的开发,便于web页面和业务逻辑的修改和复用,增加应用程序的灵活性和可扩展性.最后以一个汽车4S店配件采购订单模块为例,验证了这种开发框架的作用.

  1. Manifold learning based registration algorithms applied to multimodal images.

    Science.gov (United States)

    Azampour, Mohammad Farid; Ghaffari, Aboozar; Hamidinekoo, Azam; Fatemizadeh, Emad

    2014-01-01

    Manifold learning algorithms are proposed to be used in image processing based on their ability in preserving data structures while reducing the dimension and the exposure of data structure in lower dimension. Multi-modal images have the same structure and can be registered together as monomodal images if only structural information is shown. As a result, manifold learning is able to transform multi-modal images to mono-modal ones and subsequently do the registration using mono-modal methods. Based on this application, in this paper novel similarity measures are proposed for multi-modal images in which Laplacian eigenmaps are employed as manifold learning algorithm and are tested against rigid registration of PET/MR images. Results show the feasibility of using manifold learning as a way of calculating the similarity between multimodal images.

  2. 专业英语写作课堂的多模态话语媒体系统分析%Media system analysis of multi-modal discourse in writing class of English major

    Institute of Scientific and Technical Information of China (English)

    窦琳

    2014-01-01

    英语专业写作课程通常采用语言和文字为主要教学方式,辅以PPT、图片、声音、视频等多种手段和符号。文章首先分析影响模态选择的主导因素,进而从纯语言和伴语言等语言角度及肢体语言和非肢体语言等非语言角度出发,对英语专业写作课堂进行多模态话语媒体系统分析,从而得出对专业英语写作课堂的教学启示。%Writing course of English major usually uses language and words as the basic teaching methods, with many other methods and symbols like PPT, pictures, sounds and videos as subsidiary methods. By analyzing the leading factors which influence modal choices, this paper aims to analyze multi-modal discourse media system of writing course of English major from the verbal angle of pure language and accompanying language, and the non-verbal angle of body language and non-body language, and then raises some teaching enlightenments for writing course of English major.

  3. Multi-modal Framework Construction and Empirical Study of English Teaching in Vocational Colleges%高职多模态英语写作教学框架构建与实证研究

    Institute of Scientific and Technical Information of China (English)

    李颖

    2016-01-01

    With insufficient writing skill and ability, students in vocational college are not interested in writing. At the same time, English teachers, with high pressure, are low efficient. Surveys from home and abroad show that combining multi-media and internet in writing, multi-modal discourse meaning expression can help interpret the teaching content and enhance learning effect. After 2 semesters teaching practice, the experimental group made a great improvement in academic achievement,skill, thinking, methods and evaluation.%当前高职英语写作面临的问题有二:高职学生写作能力不足,写作意愿不高;高职英语教师工作量大,耗时低效。国内外研究表明:写作中结合多媒体与互联网,利用多通道话语意义表达方式来解读教学内容、完成教学任务,能提高英语写作学习效果。经过两个学期的教学实践后,实验组学生的写作成绩、思路、方法和评价都有显著提升。

  4. FY1995 development of a endoscopic surgical system utilizing multi-modal functional images; 1995 nendo tashu kino gazo wo mochiiru teishinshu naishikyo shujutsu system no kaihatsu

    Energy Technology Data Exchange (ETDEWEB)

    NONE

    1997-05-01

    The purpose of this study is to develop an endoscope system for neurosurgery that can provide not only conventional endoscopic images but also ultraviolet-visible spectra, fluorescence spectra, near infrared spectra, and ultra-soundimages of tissue aiming for real-time identification of pathological tissue. The system also incorporates surgical manipulator and devices such as micro forceps and laser surgical instruments for endoscopic image guided surgery. Surgical Manipulator should be a high performance and easy to operate surgical instrument as well as conventional surgical tools such as scissors and knife. Since living tissue deforms during surgical operation, pre-operative three dimensional information for registration of pathological tissue should be modified based on information obtained during surgery. Thus surgical manipulator should be operated under guidance of surgeon's observation. Consequently, surgical manipulator should have various types of imaging and measurement devices such as an endoscope and an ultrasound imaging probe at its end effectors. Based on this concept, a prototype of a new multi channel surgical manipulator system CM cube (CM3, Computer aided Micro Multichannel Manipulator) that has various types of imaging and measurement devices such as ultra-violet-visible camera for spectroscopic measurement, ultra-sound imaging probe, three dimensional endoscope, together with micro surgical instruments and laser surgical systems has been developed. Its performance was evaluated through in vitro/in vivo experiments and clinical application. (NEDO)

  5. Validation of automatic target volume definition as demonstrated for 11C-choline PET/CT of human prostate cancer using multi-modality fusion techniques.

    Science.gov (United States)

    Park, Hyunjin; Meyer, Charles R; Wood, David; Khan, Asra; Shah, Rajal; Hussain, Hero; Siddiqui, Javed; Seo, Jongbum; Chenevert, Thomas; Piert, Morand

    2010-05-01

    Positron emission tomography (PET) is actively investigated to aid in target volume definition for radiation therapy. The objectives of this study were to apply an automatic computer algorithm to compute target volumes and to validate the algorithm using histologic data from real human prostate cancer. Various modalities for prostate imaging were performed. In vivo imaging included T2 3-T magnetic resonance imaging and (11)C-choline PET. Ex vivo imaging included 3-T magnetic resonance imaging, histology, and block face photos of the prostate specimen. A novel registration method based on mutual information and thin-plate splines was applied to all modalities. Once PET is registered with histology, a voxel-by-voxel comparison between PET and histology is possible. A thresholding technique based on various fractions of the maximum standardized uptake value in the tumor was applied, and the respective computed threshold volume on PET was compared with histologic truth. Sixteen patients whose primary tumor volumes ranged from 1.2 to 12.6 cm(3) were tested. PET has low spatial resolution, so only tumors > 4 cm(3) were considered. Four cases met this criterion. A threshold value of 60% of the (11)C-choline maximum standardized uptake value resulted in the highest volume overlap between threshold volume on PET and histology. Medial axis distances between threshold volume on PET and histology showed a mean error of 7.7 +/- 5.2 mm. This is a proof-of-concept study demonstrating for the first time that histology-guided thresholding on PET can delineate tumor volumes in real human prostate cancer. Copyright 2010 AUR. Published by Elsevier Inc. All rights reserved.

  6. An optimized algorithm of image stitching in the case of a multi-modal probe for monitoring the evolution of scars

    Science.gov (United States)

    Kassab, R.; Treuillet, S.; Marzani, F.; Pieralli, C.; Lapayre, J. C.

    2013-03-01

    We propose a new system that makes possible to monitor the evolution of scars after the excision of a tumorous dermatosis. The hardware part of this system is composed of a new optical innovative probe with which two types of images can be acquired simultaneously: an anatomic image acquired under a white light and a functional one based on autofluorescence from the protoporphyrin within the cancer cells. For technical reasons related to the maximum size of the area covered by the probe, acquired images are too small to cover the whole scar. That is why a sequence of overlapping images is taken in order to cover the required area. The main goal of this paper is to describe the creation of two panoramic images (anatomic and functional). Fluorescence images do not have enough salient information for matching the images; stitching algorithms are applied over each couple of successive white light images to produce an anatomic panorama of the entire scar. The same transformations obtained from this step are used to register and stitch the functional images. Several experiments have been implemented using different stitching algorithms (SIFT, ASIFT and SURF), with various transformation parameters (angles of rotation, projection, scaling, etc…) and different types of skin images. We present the results of these experiments that propose the best solution. Thus, clinician has two panoramic images superimposed and usable for diagnostic support. A collaborative layer is added to the system to allow sharing panoramas among several practitioners over different places.

  7. Multi-modal demands of a smartphone used to place calls and enter addresses during highway driving relative to two embedded systems.

    Science.gov (United States)

    Reimer, Bryan; Mehler, Bruce; Reagan, Ian; Kidd, David; Dobres, Jonathan

    2016-12-01

    There is limited research on trade-offs in demand between manual and voice interfaces of embedded and portable technologies. Mehler et al. identified differences in driving performance, visual engagement and workload between two contrasting embedded vehicle system designs (Chevrolet MyLink and Volvo Sensus). The current study extends this work by comparing these embedded systems with a smartphone (Samsung Galaxy S4). None of the voice interfaces eliminated visual demand. Relative to placing calls manually, both embedded voice interfaces resulted in less eyes-off-road time than the smartphone. Errors were most frequent when calling contacts using the smartphone. The smartphone and MyLink allowed addresses to be entered using compound voice commands resulting in shorter eyes-off-road time compared with the menu-based Sensus but with many more errors. Driving performance and physiological measures indicated increased demand when performing secondary tasks relative to 'just driving', but were not significantly different between the smartphone and embedded systems. Practitioner Summary: The findings show that embedded system and portable device voice interfaces place fewer visual demands on the driver than manual interfaces, but they also underscore how differences in system designs can significantly affect not only the demands placed on drivers, but also the successful completion of tasks.

  8. Multi-modal magnetic resonance imaging in the acute and sub-acute phase of mild traumatic brain injury: can we see the difference?

    Science.gov (United States)

    Toth, Arnold; Kovacs, Noemi; Perlaki, Gabor; Orsi, Gergely; Aradi, Mihaly; Komaromy, Hedvig; Ezer, Erzsebet; Bukovics, Peter; Farkas, Orsolya; Janszky, Jozsef; Doczi, Tamas; Buki, Andras; Schwarcz, Attila

    2013-01-01

    Advanced magnetic resonance imaging (MRI) methods were shown to be able to detect the subtle structural consequences of mild traumatic brain injury (mTBI). The objective of this study was to investigate the acute structural alterations and recovery after mTBI, using diffusion tensor imaging (DTI) to reveal axonal pathology, volumetric analysis, and susceptibility weighted imaging (SWI) to detect microhemorrhage. Fourteen patients with mTBI who had computed tomography with negative results underwent MRI within 3 days and 1 month after injury. High resolution T1-weighted imaging, DTI, and SWI, were performed at both time points. A control group of 14 matched volunteers were also examined following the same imaging protocol and time interval. Tract-Based Spatial Statistics (TBSS) were performed on DTI data to reveal group differences. T1-weighted images were fed into Freesurfer volumetric analysis. TBSS showed fractional anisotropy (FA) to be significantly (corrected p<0.05) lower, and mean diffusivity (MD) to be higher in the mTBI group in several white matter tracts (FA=40,737; MD=39,078 voxels) compared with controls at 72 hours after injury and still 1month later for FA. Longitudinal analysis revealed significant change (i.e., normalization) of FA and MD over 1 month dominantly in the left hemisphere (FA=3408; MD=7450 voxels). A significant (p<0.05) decrease in cortical volumes (mean 1%) and increase in ventricular volumes (mean 3.4%) appeared at 1 month after injury in the mTBI group. SWI did not reveal microhemorrhage in our patients. Our findings present dynamic micro- and macrostructural changes occurring in the acute to sub-acute phase in mTBI, in very mildly injured patients lacking microhemorrhage detectable by SWI. These results underscore the importance of strictly defined image acquisition time points when performing MRI studies on patients with mTBI.

  9. A Multi-modality Study on PPT in College English Teaching%关于高校英语教学中PPT课件的多模态性研究

    Institute of Scientific and Technical Information of China (English)

    叶砾

    2016-01-01

    在现代教育技术发达的背景下,数字化英语教学,尤其是PPT在教学中的应用,为促进大学生英语学习的目的提供了可能。多模态性作为PPT辅助教学的主要特点,是指在教学中将文字、图片、声音和视频动画等进行有机结合,从而制作成PPT进行教学的模式。文中通过对数字化教学在英语教学中作用的分析,帮助教师认识到PPT等多模态教学手段在英语教学中的重要性,增加教师教学过程的灵活性,进而促进高校英语教学质量的提高。%With the rapid development of modern education technology, the application of digital English instruction, PPT in particular, provides possibilities both in promoting English learning efficiency and interests among college students. Multimodality, as the main characteristics of PPT auxiliary teaching, refers to the teaching mode that PPT is made with an organic combination of text, images, sound and video animation in teaching. This paper analyzes the ef-fect of digital education in college English teaching, aiming to help teachers to realize the the importance of multi-modal teaching techniques such as PPT in English teaching, to increase the flexibility of the teaching process, and thus improve the quality of college English teaching.

  10. Multi-modal aggression detection in trains

    NARCIS (Netherlands)

    Yang, Z.

    2009-01-01

    In many public places multiple sensing devices, such as cameras, are installed to help prevent unwanted situations such as aggression and violence. At the moment, the best solution to reach a safe environment requires human operators to monitor the camera images and take appropriate actions when nec

  11. Multi-modal human aggression detection

    NARCIS (Netherlands)

    Kooij, J. F. P.; Liem, M. C.; Krijnders, J. D.; Andringa, T. C.; Gavrila, D. M.

    2016-01-01

    This paper presents a smart surveillance system named CASSANDRA, aimed at detecting instances of aggressive human behavior in public environments. A distinguishing aspect of CASSANDRA is the exploitation of complementary audio and video cues to disambiguate scene activity in real-life environments.

  12. Multi-Modal Treatment of Nocturnal Enuresis.

    Science.gov (United States)

    Mohr, Caroline; Sharpley, Christopher F.

    1988-01-01

    The article reports a multimodal treatment of nocturnal enuresis and anxious behavior in a mildly mentally retarded woman. Behavioral treatment and removal of caffeine from the subject's diet eliminated both nocturnal enuresis and anxious behavior. (Author/DB)

  13. 一步浸渍合成具有多重孔隙的铸型炭体%Synthesis of carbon monoliths with a multi-modal pore system bya one step impregnation technique

    Institute of Scientific and Technical Information of China (English)

    陆安慧; Jan-Henrik Sm(a)tt; Mika Lindén; Ferdi Schüth

    2003-01-01

    以多孔块状硅体为模板,通过一步浸渍、炭化、酸处理工艺,制备出结构可控、孔隙联通且具有多重孔隙的铸型炭体.分别采用氮吸附技术、高分辨透射电镜和扫描电镜对模板硅、硅碳复合物及相应炭体进行了结构表征.从微米尺度分析,该炭体是由高度联接的枝状结构单元为骨架构筑而成.与模板硅相比较,此炭体是硅体的正复本.从纳米尺度分析,这种炭体枝状骨架是由分布均匀且相互连接的中孔构成,此中孔及其孔壁对应于模板硅的孔壁及中孔,是多孔硅的负复本.此外构成中孔的炭骨架本体又含有大量炭化过程产生的微孔.因此该法合成的铸型炭具有孔隙高度发达和结构层层嵌套的特点.%Carbon monoliths with a multi-modal hierarchical porosity have been prepared by a nanocasting method with silica monoliths as the scaffold, in which volume and surface templating has been successfully combined in a one-step impregnation approach, and the smaller pores in the silica template are impregnated in a straightforward way. The monoliths obtained at different stages of the process were characterized by N2-adsorption, scanning electron microscopy and transmission electron microscopy. It is shown that the carbon monoliths represent a positive replica of the starting silica monoliths on the micrometer scale. The surface templated mesopores can be regarded as a positive replica, while the volume templated mesopores are a negative replica of the silica scaffold.

  14. Small-animal PET imaging of amyloid-beta plaques with [11C]PiB and its multi-modal validation in an APP/PS1 mouse model of Alzheimer's disease.

    Directory of Open Access Journals (Sweden)

    André Manook

    Full Text Available In vivo imaging and quantification of amyloid-β plaque (Aβ burden in small-animal models of Alzheimer's disease (AD is a valuable tool for translational research such as developing specific imaging markers and monitoring new therapy approaches. Methodological constraints such as image resolution of positron emission tomography (PET and lack of suitable AD models have limited the feasibility of PET in mice. In this study, we evaluated a feasible protocol for PET imaging of Aβ in mouse brain with [(11C]PiB and specific activities commonly used in human studies. In vivo mouse brain MRI for anatomical reference was acquired with a clinical 1.5 T system. A recently characterized APP/PS1 mouse was employed to measure Aβ at different disease stages in homozygous and hemizygous animals. We performed multi-modal cross-validations for the PET results with ex vivo and in vitro methodologies, including regional brain biodistribution, multi-label digital autoradiography, protein quantification with ELISA, fluorescence microscopy, semi-automated histological quantification and radioligand binding assays. Specific [(11C]PiB uptake in individual brain regions with Aβ deposition was demonstrated and validated in all animals of the study cohort including homozygous AD animals as young as nine months. Corresponding to the extent of Aβ pathology, old homozygous AD animals (21 months showed the highest uptake followed by old hemizygous (23 months and young homozygous mice (9 months. In all AD age groups the cerebellum was shown to be suitable as an intracerebral reference region. PET results were cross-validated and consistent with all applied ex vivo and in vitro methodologies. The results confirm that the experimental setup for non-invasive [(11C]PiB imaging of Aβ in the APP/PS1 mice provides a feasible, reproducible and robust protocol for small-animal Aβ imaging. It allows longitudinal imaging studies with follow-up periods of approximately one and a

  15. Design of Open Content Social Learning That Increases Learning Efficiency and Engagement Based on Open Pedagogy

    Science.gov (United States)

    John, Benneaser; Thavavel, V.; Jayaraj, Jayakumar; Muthukumar, A.; Jeevanandam, Poornaselvan Kittu

    2016-01-01

    Academic writing skills are crucial when students, e.g., in teacher education programs, write their undergraduate theses. A multi-modal web-based and self-regulated learning resource on academic writing was developed, using texts, hypertext, moving images, podcasts and templates. A study, using surveys and a focus group, showed that students used…

  16. Small bowel tumor:a comparative study of multi-modality MR enterography and CT enterography as diagnostic technique%多模态 MR与CT小肠造影诊断小肠肿瘤性疾病的对比观察

    Institute of Scientific and Technical Information of China (English)

    王梓; 胡道予; 汤浩; 李建军; 孟晓岩; 沈亚琪; 王秋霞

    2015-01-01

    Objective:To compare the diagnostic value of multi-modality MR enterography and CT enterography in small bowel tumor.Methods:From February 2012 to August 2014,Sixty-five patients who were suspected with small bowel diseases underwent CT enterography and multi-modality MR enterography.Two independent readers evaluated CT and MR images for presence of small bowel lesions in duodenum,proximal jejunum,distal jejunum,proximal ileum and distal ileum which were pathologically confirmed by operation and endoscopic biopsy.Results:Of 65 cases,38 small bowel tumors in 37 patients were confirmed (6 adenocarcinomas,7 lymphomas,18 gastrointestinal stromal tumors,3 neuroendocrine tumors,2 hemangiomas,2 lipomas).The detection rate of multi-modality MR enterography and CT enterography in diagnosing small bowel tumor was 97.4% (37/38)and 94.7% (36/38)respectively,with no significant difference (P>0.05).The results of statistic analysis (McNemar test)showed that there was no significant difference of specificity and sensitivity between multi-modality MR enterography and CT enterography for evaluating the tumor diseases located at different segments of small bowel (P>0.05).Conclusion:Multi-modality MR enterography and CT enterography are useful methods for diagno-sing small bowel tumors.%目的:比较多模态 MR 小肠口服造影法与 CT 小肠造影在诊断小肠肿瘤性疾病中的价值。方法:对本院2012年2月至2014年8月对怀疑有小肠肿瘤的65例患者行CT和多模态MR小肠造影检查。由两位腹部影像学医师分别对CT及 MR图像进行分析,记录十二指肠、近段空肠、远段空肠、近段回肠以及远段回肠肠管的病变累及情况,并与手术以及内镜活检病理结果进行对照。结果:经手术及内镜病理证实,65例中共37例患者有38个小肠肿瘤病灶(腺癌6例,淋巴瘤7例,间质瘤18例,神经内分泌肿瘤3例,海绵状血管瘤2例,脂肪瘤2例)。CT及 MRI对小肠肿瘤性

  17. Integrating Argument-Based Science Inquiry with Modal Representations: Impact on Science Achievement, Argumentation, and Writing Skills

    Science.gov (United States)

    Demirbag, Mehmet; Gunel, Murat

    2014-01-01

    This study aims to investigate the effect of integrating the Argument-Based Science Inquiry (ABSI) approach with multi-modal representations on students' achievement, and their argumentation and writing skills. The study was conducted with 62 female and 57 male college students at the Central Anatolian Turkish University. All participants…

  18. 多模态读写教学模式在体育专业大学生英语课堂中的有效性研究%An Empirical Research on the Multi-modal Reading and Writing Teaching Mode in English Class of PE College Student

    Institute of Scientific and Technical Information of China (English)

    杨倩

    2014-01-01

    PE majors are generally weak in English foundation and lack of interest in learning English. A single teaching mode can not arouse their interest and enthusiasm in learning English. Multi-modal reading and writing teaching mode mobilizes different symbols to construct meaning and fully arouse the students’auditory,visual,tact-ile,perceptual abilities to learn the target language. Through adopting multi-modal reading and writing teaching mode to implement a reformation in the 2010 PE majors of Henan Institute of Science and Technology,the teaching experiments and survey result show that:this teaching mode not only arouses PE majors’interest in learning English and improves students’reading and writing skills remarkably.%体育专业大学生英语基础普遍薄弱,对英语学习缺乏兴趣,单一的教学模式无法调动他们学习英语的兴趣和积极性。多模态读写教学模式调动不同的符号资源来构建意义,将学生的听觉、视觉、触觉、感知能力等充分调动起来进行目的语学习。通过在河南科技学院2010级体育学院采用多模态读写教学模式对大学英语读写课程实施改革,教学实验和问卷调查结果表明:该教学模式显著提高了体育专业大学生的英语学习兴趣和英语读写能力。

  19. Computer-based image analysis in radiological diagnostics and image-guided therapy 3D-Reconstruction, contrast medium dynamics, surface analysis, radiation therapy and multi-modal image fusion

    CERN Document Server

    Beier, J

    2001-01-01

    This book deals with substantial subjects of postprocessing and analysis of radiological image data, a particular emphasis was put on pulmonary themes. For a multitude of purposes the developed methods and procedures can directly be transferred to other non-pulmonary applications. The work presented here is structured in 14 chapters, each describing a selected complex of research. The chapter order reflects the sequence of the processing steps starting from artefact reduction, segmentation, visualization, analysis, therapy planning and image fusion up to multimedia archiving. In particular, this includes virtual endoscopy with three different scene viewers (Chap. 6), visualizations of the lung disease bronchiectasis (Chap. 7), surface structure analysis of pulmonary tumors (Chap. 8), quantification of contrast medium dynamics from temporal 2D and 3D image sequences (Chap. 9) as well as multimodality image fusion of arbitrary tomographical data using several visualization techniques (Chap. 12). Thus, the softw...

  20. 一个以实践确证论为基础的认知逻辑系统KjB%A System KjB of Multi- Modal Epistemic Logic Based on the Knowledge Theory of Practical Justification

    Institute of Scientific and Technical Information of China (English)

    闫景强

    2008-01-01

    国外的多模态认知逻辑系统在认识论基础和公理的使用上存在不足.笔者以马克思主义实践论为基础,吸收了国外知识确证理论的先进成果,提出了一种知识的实践确证理论.在此基础上,构造了多模态认知逻辑系统KjB,并证明其可靠性和完全性.

  1. 论多媒体与多模态条件下的大学英语听力教学%On Teaching College English Listening——Based on Multi-Media and Multi-Modal Teaching and Learning

    Institute of Scientific and Technical Information of China (English)

    谢竞贤; 董剑桥

    2010-01-01

    本文认为多媒体与多模态下的大学英语听力教学印证了David Nunan的"后教学法"学说.听力练习不再是单独的技能训练,而是通过信息的整合,充分融合到了课堂教学的各个环节.这种听力教学是以多媒体技术为支撑,以学生多模态感知为基础,教师根据听力教学矩阵原则和"可理解性输入"原则设计并开展听力活动的过程.

  2. Multi-modal applicability of a reversed-phase/weak-anion exchange material in reversed-phase, anion-exchange, ion-exclusion, hydrophilic interaction and hydrophobic interaction chromatography modes.

    Science.gov (United States)

    Lämmerhofer, Michael; Nogueira, Raquel; Lindner, Wolfgang

    2011-06-01

    We recently introduced a mixed-mode reversed-phase/weak anion-exchange type separation material based on silica particles which consisted of a hydrophobic alkyl strand with polar embedded groups (thioether and amide functionalities) and a terminal weak anion-exchange-type quinuclidine moiety. This stationary phase was designed to separate molecules by lipophilicity and charge differences and was mainly devised for peptide separations with hydroorganic reversed-phase type elution conditions. Herein, we demonstrate the extraordinary flexibility of this RP/WAX phase, in particular for peptide separations, by illustrating its applicability in various chromatographic modes. The column packed with this material can, depending on the solute character and employed elution conditions, exploit attractive or repulsive electrostatic interactions, and/or hydrophobic or hydrophilic interactions as retention and selectivity increments. As a consequence, the column can be operated in a reversed-phase mode (neutral compounds), anion-exchange mode (acidic compounds), ion-exclusion chromatography mode (cationic solutes), hydrophilic interaction chromatography mode (polar compounds), and hydrophobic interaction chromatography mode (e.g., hydrophobic peptides). Mixed-modes of these chromatographic retention principles may be materialized as well. This allows an exceptionally flexible adjustment of retention and selectivity by tuning experimental conditions. The distinct separation mechanisms will be outlined by selected examples of peptide separations in the different modes.

  3. Interactive Medical Visualization and Simulation for Multi-modal Virtual Learning%适用于多模式虚拟学习的交互医学可视化及模拟

    Institute of Scientific and Technical Information of China (English)

    孙汉秋; 蔡及时; 柏龄

    2004-01-01

    医学图像及其衍生的知识是医学教育中的一个关键学习部分,透过不同的图像模式,可以使医生及医科学生更有效地学习人体的体内结构.而计算机可视化技术最近的发展正满足了医生、外科医生及医科学生与日俱增的需求,为深入地了解人体生理学及病理学提供了宝贵的资料.本文提出了一个网上交互医学学习系统,并提供了一个虚拟现实工具包以支持二维医学图像序列观察、体数据和表面数据的三维可视化、目视放大镜,以及医学数据的交互变形模拟.其中人体组织物理特性的模拟以有限元法为基准,通过优化而获得有关的变形模型参数.该工具包可应用于个性化的二维及三维数据场可视化、优化的学习及手术规划和在线的交互医学教育.%Image and their derivatives form the key learning components in medical education.Medical students and doctors learn to examine the human body through many different imaging modalities, which facilitate them to inspect the internal structure of human bodies. The recent developments of computer visualization technology meet the ever-growing need for doctors, surgeons,and medical students to gain valuable insight into human physiology and pathology. In this paper, we have developed a web-based interactive medical learning system with the advanced VR toolkit that supports 2D medical image sequence viewing, 3D visualization of both volume & surface datasets, visual magnification lens, and interactive deformable simulation of medical data in which the physical properties of human tissues are simulated by heuristic optimization against finite element model. The toolkit we have developed supports personalized 2D/3D visualizations, optimal learning & planning, and on-line interactive medical education.

  4. 公益广告多模态互动意义分析——以公益广告《老爸的谎言,你听得出来吗?》为例%Multi-modality Analysis of Public Service Advertisements—Taking the Public Service Advertisement Papa's Lie as an Example

    Institute of Scientific and Technical Information of China (English)

    王道友

    2015-01-01

    With the advent of information age,people's communication mode is changing dramatically with the new media.The forms of spreading discourses becomes rich and colorful.Discourse analysis and research have developed into the new stage of multi-modality.The study of public service advertising has long been ignored by many scholars.In this paper,the multi modali-ty discourse analysis of image analysis is the theoretical framework,mainly analyzing images'and other symbols'interactive meaning in the public interest advertising discourse and expressing social relations,attitude,emotion,etc.This paper mainly ana-lyzes the four aspects of the contact,social distance,perspective and color (modality),and reveals how the interaction of dis-course can be realized through various means.%人类进入信息时代,交流方式发生了巨大变化.传播声音的载体变得更加丰富,话语分析研究也由此进入了多模态话语分析的新阶段.对广告的研究很多,而对公益广告的研究却很少.该文以多模态话语分析为理论框架,主要分析图像符号,声音符号在公益广告中互动意义.这些符号不仅传达了信息,态度还表达了社会关系和情感.该文选取中央电视台公益广告"老爸的谎言,你听得出来吗?"为文本,揭示语篇的互动意义是怎样通过各种符号得以传达的.

  5. A dynamically weighted multi-modal biometric security system

    CSIR Research Space (South Africa)

    Brown, Dane

    2016-09-01

    Full Text Available dataset [11] were used in the experiments discussed in Section IV. The five samples per 100 individuals used for training and testing can be summarized as follows: 1) Face – The faces consisted of frontal poses with the following expressions and props... or fingerprints with poor ridge and valley contrast. The solution used in this paper applies an edge preserving non-local means (NL-means) filter [14] before applying Poincare´. A ROI can also be determined for facial images. The key points are the eyes, nose...

  6. Multi-modal analysis of small-group conversational dynamics

    NARCIS (Netherlands)

    Akker, op den Rieks; Gatica-Perez, Daniel; Heylen, Dirk; Renals, Steve; Bourlard, Hervé; Carletta, Jean; Popescu-Belis, Andrei

    2012-01-01

    This chapter provides an overview of the basic problems realted to automatic understanding of conversational group dynamics. It provides an overview of current research in automatic detection of the addressee(s) of the speaker in multiparty conversations, the visual focus of attention of participant

  7. Multi-modal distraction: insights from children's limited attention.

    Science.gov (United States)

    Matusz, Pawel J; Broadbent, Hannah; Ferrari, Jessica; Forrest, Benjamin; Merkley, Rebecca; Scerif, Gaia

    2015-03-01

    How does the multi-sensory nature of stimuli influence information processing? Cognitive systems with limited selective attention can elucidate these processes. Six-year-olds, 11-year-olds and 20-year-olds engaged in a visual search task that required them to detect a pre-defined coloured shape under conditions of low or high visual perceptual load. On each trial, a peripheral distractor that could be either compatible or incompatible with the current target colour was presented either visually, auditorily or audiovisually. Unlike unimodal distractors, audiovisual distractors elicited reliable compatibility effects across the two levels of load in adults and in the older children, but high visual load significantly reduced distraction for all children, especially the youngest participants. This study provides the first demonstration that multi-sensory distraction has powerful effects on selective attention: Adults and older children alike allocate attention to potentially relevant information across multiple senses. However, poorer attentional resources can, paradoxically, shield the youngest children from the deleterious effects of multi-sensory distraction. Furthermore, we highlight how developmental research can enrich the understanding of distinct mechanisms controlling adult selective attention in multi-sensory environments. Copyright © 2014 Elsevier B.V. All rights reserved.

  8. The Multi-Modal Redesign of School Texts

    Science.gov (United States)

    Walsh, Christopher S.

    2009-01-01

    Multiliteracies-related research is just emerging from the formal discourse of pedagogical theorising and how it may look in practice needs further exploration. This research, initiated under that warrant, presents practitioner research and the enactment of a multiliteracies curriculum with Year 8 students in New York City's Chinatown. The study…

  9. Multi-modal information processing for visual workload relief

    Science.gov (United States)

    Burke, M. W.; Gilson, R. D.; Jagacinski, R. J.

    1980-01-01

    The simultaneous performance of two single-dimensional compensatory tracking tasks, one with the left hand and one with the right hand, is discussed. The tracking performed with the left hand was considered the primary task and was performed with a visual display or a quickened kinesthetic-tactual (KT) display. The right-handed tracking was considered the secondary task and was carried out only with a visual display. Although the two primary task displays had afforded equivalent performance in a critical tracking task performed alone, in the dual-task situation the quickened KT primary display resulted in superior secondary visual task performance. Comparisons of various combinations of primary and secondary visual displays in integrated or separated formats indicate that the superiority of the quickened KT display is not simply due to the elimination of visual scanning. Additional testing indicated that quickening per se also is not the immediate cause of the observed KT superiority.

  10. Multi-modal RGB–Depth–Thermal Human Body Segmentation

    DEFF Research Database (Denmark)

    Palmero, Cristina; Clapés, Albert; Bahnsen, Chris

    2016-01-01

    device and a registration algorithm. Our baseline extracts regions of interest using background sub- traction, defines a partitioning of the foreground regions into cells, computes a set of image features on those cells us- ing different state-of-the-art feature extractions, and models the distribution...... of the descriptors per cell using probabilis- tic models. A supervised learning algorithm then fuses the output likelihoods over cells in a stacked feature vector rep- resentation. The baseline, using Gaussian Mixture Models for the probabilistic modeling and Random Forest for the stacked learning, is superior...

  11. Multi-modality imaging of transient osteoporosis of the hip

    NARCIS (Netherlands)

    Gemmel, Filip; Van der Veen, Hugo C.; Van Schelven, Willem D.; Collins, James M. P.; Vanneuville, Isabelle; Rijk, Paul C.

    2012-01-01

    Transient osteoporosis of the hip (TOH), also referred to as bone marrow edema syndrome (BMES) of the femoral head and neck, is an uncommon and therefore underdiagnosed benign skeletal disorder, affecting primarily women, particularly in their last trimester of pregnancy, and middle-aged men. The di

  12. Computer-Supported Modelling of Multi modal Transportation Networks Rationalization

    Directory of Open Access Journals (Sweden)

    Ratko Zelenika

    2007-09-01

    Full Text Available This paper deals with issues of shaping and functioning ofcomputer programs in the modelling and solving of multimoda Itransportation network problems. A methodology of an integrateduse of a programming language for mathematical modellingis defined, as well as spreadsheets for the solving of complexmultimodal transportation network problems. The papercontains a comparison of the partial and integral methods ofsolving multimodal transportation networks. The basic hypothesisset forth in this paper is that the integral method results inbetter multimodal transportation network rationalization effects,whereas a multimodal transportation network modelbased on the integral method, once built, can be used as the basisfor all kinds of transportation problems within multimodaltransport. As opposed to linear transport problems, multimodaltransport network can assume very complex shapes. This papercontains a comparison of the partial and integral approach totransp01tation network solving. In the partial approach, astraightforward model of a transp01tation network, which canbe solved through the use of the Solver computer tool within theExcel spreadsheet inteiface, is quite sufficient. In the solving ofa multimodal transportation problem through the integralmethod, it is necessmy to apply sophisticated mathematicalmodelling programming languages which supp01t the use ofcomplex matrix functions and the processing of a vast amountof variables and limitations. The LINGO programming languageis more abstract than the Excel spreadsheet, and it requiresa certain programming knowledge. The definition andpresentation of a problem logic within Excel, in a manner whichis acceptable to computer software, is an ideal basis for modellingin the LINGO programming language, as well as a fasterand more effective implementation of the mathematical model.This paper provides proof for the fact that it is more rational tosolve the problem of multimodal transportation networks by usingthe integral, rather than the partial method.

  13. Multi-modality imaging of transient osteoporosis of the hip

    NARCIS (Netherlands)

    Gemmel, Filip; Van der Veen, Hugo C.; Van Schelven, Willem D.; Collins, James M. P.; Vanneuville, Isabelle; Rijk, Paul C.

    2012-01-01

    Transient osteoporosis of the hip (TOH), also referred to as bone marrow edema syndrome (BMES) of the femoral head and neck, is an uncommon and therefore underdiagnosed benign skeletal disorder, affecting primarily women, particularly in their last trimester of pregnancy, and middle-aged men. The

  14. Multi-modality imaging of transient osteoporosis of the hip.

    Science.gov (United States)

    Gemmel, Filip; Van Der Veen, Hugo C; Van Schelven, Willem D; Collins, James M P; Vanneuville, Isabelle; Rijk, Paul C

    2012-10-01

    Transient osteoporosis of the hip (TOH), also referred to as bone marrow edema syndrome (BMES) of the femoral head and neck, is an uncommon and therefore underdiagnosed benign skeletal disorder, affecting primarily women, particularly in their last trimester of pregnancy, and middle-aged men. The disease is characterized by self-limiting hip pain and radiographically evident osteopenia, but these radiographic findings can sometimes be delayed. In the early phase, the main diagnostic dilemma lies in differentiating TOH from osteonecrosis of the femoral head (ONFH). Conventional radiographs, Tc-99m bone scans (multiphase, SPECT or SPECT/CT) and MRI scans from 10 male patients with 12 TOH episodes were retrospectively and independently reviewed by two nuclear medicine physicians and a musculoskeletal radiologist. The purpose was to identify a typical imaging pattern, and secondly, to reliably distinguish TOH from ONFH. In the early phase of TOH, conventional radiography of the hip could not sufficiently detect focal osteopenia. But in all 10 patients (mean age 45 years, range, 34-62), bone scans and MRI scans demonstrated a similar pattern of diffuse hyperaemia, bony uptake, and bone marrow edema in the femoral head and neck, extending to and ending with a sharp demarcation at the intertrochanteric region. Additionally, neither SPECT nor SPECT/CT nor MRI revealed any cold area or crescent-shaped subchondral defect in the femoral head, indicating ONFH. In some cases there was a joint effusion in varying degree. In 9 patients, an uneventful recovery was eventually observed. Scintigraphically diffuse hyperaemic and/or homogeneous osseous uptake in femoral head and neck extending to the intertrochanteric region, as well as the recently introduced term transient bone marrow edema syndrome (BMES) of the hip on MRI, are probably both expressions of the same pathophysiological mechanism, and pathognomonic for TOH. Hopefully, recognizing this highly specific imaging pattern will exclude in the future more aggressive skeletal diseases like ONFH, severe arthritis, osteomyelitis or even malignancy.

  15. Assessment of multi-modality evaluations of obscure gastrointestinal bleeding

    Science.gov (United States)

    Law, Ryan; Varayil, Jithinraj E; WongKeeSong, Louis M; Fidler, Jeff; Fletcher, Joel G; Barlow, John; Alexander, Jeffrey; Rajan, Elizabeth; Hansel, Stephanie; Becker, Brenda; Larson, Joseph J; Enders, Felicity T; Bruining, David H; Coelho-Prabhu, Nayantara

    2017-01-01

    AIM To determine the frequency of bleeding source detection in patients with obscure gastrointestinal bleeding (OGIB) who underwent double balloon enteroscopy (DBE) after pre-procedure imaging [multiphase computed tomography enterography (MPCTE), video capsule endoscopy (VCE), or both] and assess the impact of imaging on DBE diagnostic yield. METHODS Retrospective cohort study using a prospectively maintained database of all adult patients presenting with OGIB who underwent DBE from September 1st, 2002 to June 30th, 2013 at a single tertiary center. RESULTS Four hundred and ninety five patients (52% females; median age 68 years) underwent DBE for OGIB. AVCE and/or MPCTE performed within 1 year prior to DBE (in 441 patients) increased the diagnostic yield of DBE (67.1% with preceding imaging vs 59.5% without). Using DBE as the gold standard, VCE and MPCTE had a diagnostic yield of 72.7% and 32.5% respectively. There were no increased odds of finding a bleeding site at DBE compared to VCE (OR = 1.3, P = 0.150). There were increased odds of finding a bleeding site at DBE compared to MPCTE (OR = 5.9, P < 0.001). In inpatients with overt OGIB, diagnostic yield of DBE was not affected by preceding imaging. CONCLUSION DBE is a safe and well-tolerated procedure for the diagnosis and treatment of OGIB, with a diagnostic yield that may be increased after obtaining a preceding VCE or MPCTE. However, inpatients with active ongoing bleeding may benefit from proceeding directly to antegrade DBE. PMID:28216967

  16. Multi-modal Biomarkers to Discriminate Cognitive State

    Science.gov (United States)

    2015-11-01

    have been shown to change with a subject’s mental and emotional state, under numerous conditions including cognitive load and neurological conditions...between motor activity Protocol Voice, face, physiology, EEG Cognitive)Task Repeat)x324 (2)hours) Pa:ta:ka (10)sec) Vowel ) (“ahh”) (5)sec) Pa:ta:ka...10)sec) Vowel ) (“ahh”) (5)sec) Cognitive)load)&)vocal)load 3)Difficulties)– 108)unique)sentences Task) Training (max)54) trials) 4,6,7,8 Hear) Digits

  17. Multi-modality nanoparticles having optically responsive shape

    Science.gov (United States)

    Chen, Fanqing; Bouchard, Louis-Serge

    2015-05-19

    In certain embodiments novel nanoparticles (nanowontons) are provided that are suitable for multimodal imaging and/or therapy. In one embodiment, the nanoparticles include a first biocompatible (e.g., gold) layer, an inner core layer (e.g., a non-biocompatible material), and a biocompatible (e.g., gold) layer. The first gold layer includes a concave surface that forms a first outer surface of the layered nanoparticle. The second gold layer includes a convex surface that forms a second outer surface of the layered nanoparticle. The first and second gold layers encapsulate the inner core material layer. Methods of fabricating such nanoparticles are also provided.

  18. A transformation approach to modelling multi-modal diffusions

    DEFF Research Database (Denmark)

    Forman, Julie Lyng; Sørensen, Michael

    2014-01-01

    when the diffusion is observed with additional measurement error. The new approach is applied to molecular dynamics data in the form of a reaction coordinate of the small Trp-zipper protein, from which the folding and unfolding rates of the protein are estimated. Because the diffusion coefficient...... is state-dependent, the new models provide a better fit to this type of protein folding data than the previous models with a constant diffusion coefficient, particularly when the effect of errors with a short time-scale is taken into account....

  19. The mysterious multi-modal repellency of DEET

    Science.gov (United States)

    DeGennaro, Matthew

    2015-01-01

    DEET is the most effective insect repellent available and has been widely used for more than half a century. Here, I review what is known about the olfactory and contact mechanisms of DEET repellency. For mosquitoes, DEET has at least two molecular targets: Odorant Receptors (ORs) mediate the effect of DEET at a distance, while unknown chemoreceptors mediate repellency upon contact. Additionally, the ionotropic receptor Ir40a has recently been identified as a putative DEET chemosensor in Drosophila. The mechanism of how DEET manipulates these molecular targets to induce insect avoidance in the vapor phase is also contested. Two hypotheses are the most likely: DEET activates an innate olfactory neural circuit leading to avoidance of hosts (smell and avoid hypothesis) or DEET has no behavioral effect on its own, but instead acts cooperatively with host odors to drive repellency (confusant hypothesis). Resolving this mystery will inform the search for a new generation of insect repellents. PMID:26252744

  20. Multi-modal Social Networks: A MRF Learning Approach

    Science.gov (United States)

    2016-06-20

    Network forensics : random infection vs spreading epidemic, Proceedings of ACM Sigmetrics. 11-JUN-12, London, UK. : , TOTAL: 4 06/09/2016 Received Paper...Netrapalli Chris Milling 3 ...... ...... Sub Contractors (DD882) Names of other research staff Inventions (DD882) Scientific Progress Please see...malicious hypothesis (spreading process such as malware). Scientific Barriers: The high dimensionality of the problem, along with noisy, partial

  1. Multi-Modal Neurodiagnostic Tool for Exploration Missions Project

    Data.gov (United States)

    National Aeronautics and Space Administration — NASA has a critical requirement for a neurodiagnostic tool that can be used to monitor the behavioral health of the crew during long duration exploration missions....

  2. Multi-modal CT in Stroke Imaging: New Concepts

    Science.gov (United States)

    Ledezma, Carlos J.; Wintermark, Max

    2009-01-01

    A multimodal CT protocol provides a comprehensive non-invasive survey of acute stroke patients with accurate demonstration of the site of arterial occlusion and its hemodynamic tissue status. It combines widespread availability with the ability to provide functional characterization of cerebral ischemia, and could potentially allow more accurate selection of candidates for acute stroke reperfusion therapy. PMID:19195537

  3. Multi-Modal Neurodiagnostic Tool for Stress Monitoring Project

    Data.gov (United States)

    National Aeronautics and Space Administration — NASA has a requirement for a neurodiagnostic tool that can be used to monitor the behavioral health of the crew during long duration Exploration missions. The device...

  4. An Efficient Human Identification through MultiModal Biometric System

    Directory of Open Access Journals (Sweden)

    K. Meena

    Full Text Available ABSTRACT Human identification is essential for proper functioning of society. Human identification through multimodal biometrics is becoming an emerging trend, and one of the reasons is to improve recognition accuracy. Unimodal biometric systems are affected by various problemssuch as noisy sensor data,non-universality, lack of individuality, lack of invariant representation and susceptibility to circumvention.A unimodal system has limited accuracy. Hence, Multimodal biometric systems by combining more than one biometric feature in different levels are proposed in order to enhance the performance of the system. A supervisor module combines the different opinions or decisions delivered by each subsystem and then make a final decision. In this paper, a multimodal biometrics authentication is proposed by combining face, iris and finger features. Biometric features are extracted by Local Derivative Ternary Pattern (LDTP in Contourlet domain and an extensive evaluation of LDTP is done using Support Vector Machine and Nearest Neighborhood Classifier. The experimental evaluations are performed on a public dataset demonstrating the accuracy of the proposed system compared with the existing systems. It is observed that, the combination of face, fingerprint and iris gives better performance in terms of accuracy, False Acceptance Rate, False Rejection Rate with minimum computation time.

  5. A System Approach to Adaptive Multi-Modal Sensor Designs

    Science.gov (United States)

    2010-02-01

    signals needed. As an example, using the Polytec 505 LDV, the built-in automatic focusing takes about 15 seconds to focus the laser beam on the surface...time, e.g. 15 seconds for Polytec OFV-505. With our automatic focusing method, our current implementation reduced the time to 1.5 second, a ten-fold

  6. Multi-modal big data management for film production

    OpenAIRE

    Kim, H.; Pabst, S.; Sneddon, J; Waine , T.; Clifford, J; Hilton, A.

    2015-01-01

    Modern digital film production uses large quantities of data from videos, digital photographs, LIDAR scans, spherical photography and many other sources to create the final film frames. The processing and management of this massive amount of heterogeneous data consumes enormous resources. We propose an integrated pipeline for 2D/3D data registration for film production. We present the prototype application Jigsaw, which allows users to efficiently manage and process various data from digital ...

  7. A Multi-Modal Recognition System Using Face and Speech

    Directory of Open Access Journals (Sweden)

    Samir Akrouf

    2011-05-01

    Full Text Available Nowadays Person Recognition has got more and more interest especially for security reasons. The recognition performed by a biometric system using a single modality tends to be less performing due to sensor data, restricted degrees of freedom and unacceptable error rates. To alleviate some of these problems we use multimodal biometric systems which provide better recognition results. By combining different modalities, such us speech, face, fingerprint, etc., we increase the performance of recognition systems. In this paper, we study the fusion of speech and face in a recognition system for taking a final decision (i.e., accept or reject identity claim. We evaluate the performance of each system differently then we fuse the results and compare the performances.

  8. Analyse et traitement d'images multi modales en oncologie

    OpenAIRE

    Hatt, Mathieu

    2012-01-01

    With an initial formation in theoretical computer sciences with a focus on image processing and analysis, my current research activities deal with image and information processing and analysis for applications in medicine, namely oncology and radiotherapy. More specifically, my research interests are image automatic segmentation and classification for organs and tumors delineation, image denoising and deconvolution for qualitative and quantitative improvement, and more recently, multi observa...

  9. MULTI-MODAL REMOTE SENSING DATA FUSION FRAMEWORK

    Directory of Open Access Journals (Sweden)

    M. A. A. Ghaffar

    2017-07-01

    Full Text Available The inconsistency between the freely available remote sensing datasets and crowd-sourced data from the resolution perspective forms a big challenge in the context of data fusion. In classical classification problems, crowd-sourced data are represented as points that may or not be located within the same pixel. This discrepancy can result in having mixed pixels that could be unjustly classified. Moreover, it leads to failure in retaining sufficient level of details from data inferences. In this paper we propose a method that can preserve detailed inferences from remote sensing datasets accompanied with crowd-sourced data. We show that advanced machine learning techniques can be utilized towards this objective. The proposed method relies on two steps, firstly we enhance the spatial resolution of the satellite image using Convolutional Neural Networks and secondly we fuse the crowd-sourced data with the upscaled version of the satellite image. However, the covered scope in this paper is concerning the first step. Results show that CNN can enhance Landsat 8 scenes resolution visually and quantitatively.

  10. Multi-modality treatment of colorectal liver metastases

    Institute of Scientific and Technical Information of China (English)

    Guo-Xiang Cai; San-Jun Cai

    2012-01-01

    Liver metastases synchronously or metachronously occur in approximately 50% of colorectal cancer patients. Multimodality comprehensive treatment is the best therapeutic strategy for these patients. However, the optimal pattern of multimodality therapy is still controversial, and it raises several significant concerns. Liver resection is the most important treatment for colorectal liver metastases. The definition of resectability has shifted to focus on the completion of R0 resection and normal liver function maintenance. The role of neoadjuvant and adjuvant chemotherapy still needs to be clarified. The management of either progression or complete remission during neoadjuvant chemotherapy is challenging. The optimal sequencing of surgery and chemotherapy in synchronous colorectal liver metastases patients is still unclear. Conversional chemotherapy, portal vein embolization, two-stage resection, and tumor ablation are effective approaches to improve resectability for initially unresectable patients. Several technical issues and concerns related to these methods need to be further explored. For patients with definitely unresectable liver disease, the necessity of resecting the primary tumor is still debatable, and evaluating and predicting the efficacy of targeted therapy deserve further investigation. This review discusses different patterns and important concerns of multidisciplinary treatment of colorectal liver metastases.

  11. Multi-Modal Remote Sensing Data Fusion Framework

    Science.gov (United States)

    Ghaffar, M. A. A.; Vu, T. T.; Maul, T. H.

    2017-07-01

    The inconsistency between the freely available remote sensing datasets and crowd-sourced data from the resolution perspective forms a big challenge in the context of data fusion. In classical classification problems, crowd-sourced data are represented as points that may or not be located within the same pixel. This discrepancy can result in having mixed pixels that could be unjustly classified. Moreover, it leads to failure in retaining sufficient level of details from data inferences. In this paper we propose a method that can preserve detailed inferences from remote sensing datasets accompanied with crowd-sourced data. We show that advanced machine learning techniques can be utilized towards this objective. The proposed method relies on two steps, firstly we enhance the spatial resolution of the satellite image using Convolutional Neural Networks and secondly we fuse the crowd-sourced data with the upscaled version of the satellite image. However, the covered scope in this paper is concerning the first step. Results show that CNN can enhance Landsat 8 scenes resolution visually and quantitatively.

  12. Multi-modal imaging of the subscapularis muscle

    OpenAIRE

    Alilet, Mona; Behr, Julien; Nueffer, Jean-Philippe; Barbier-Brion, Benoit; Aubry, Sébastien

    2016-01-01

    Abstract The subscapularis (SSC) muscle is the most powerful of the rotator cuff muscles, and plays an important role in shoulder motion and stabilization. SSC tendon tear is quite uncommon, compared to the supraspinatus (SSP) tendon, and, most of the time, part of a large rupture of the rotator cuff. Various complementary imaging techniques can be used to obtain an accurate diagnosis of SSC tendon lesions, as well as their extension and muscular impact. Pre-operative diagnosis by imaging is ...

  13. Detection of Epileptic Seizures with Multi-modal Signal Processing

    DEFF Research Database (Denmark)

    Conradsen, Isa

    and alarm whenever a seizure starts is of great importance to these patients and their relatives, in the sense, that the alert of the seizure will make them feel more safe. Thus the objective of the project is to investigate the movements of convulsive epileptic seizures and design seizure detection...... convulsive seizures tested. Another study was performed, involving quantitative parameters in the time and frequency domain. The study showed, that there are several differences between tonic seizures and the tonic phase of GTC seizures and furthermore revealed differences of the epileptic (tonic and tonic...

  14. An Automated Weather Research and Forecasting (WRF)-Based Nowcasting System: Software Description

    Science.gov (United States)

    2013-10-01

    native features of HTML. WRFEE is based on the model-view-controller ( MVC ) paradigm whereby the model controls program flow (see figure 1), the view is...modifications are outlined later in this report. 3 3. Background WRFEE is based on the MVC paradigm whereby the model handles data and the business logic...Wrfendtoend Java Bean The WRFEE bean represents the “model” portion of the MVC system, as it steps through each of the requisite processes

  15. Analysis-Based Verification: A Programmer-Oriented Approach to the Assurance of Mechanical Program Properties

    Science.gov (United States)

    2010-05-27

    Metamathematics. D. Van Nostrand Company, 1950. [71] Glenn E. Krasner and Stephen T. Pope. A cookbook for using the model-view controller user interface...Software-Practice and Experience, 9(4):255–65, 1979. [45] Cormac Flanagan and Stephen H. Freund. Type-based race detection for Java. In 2000 Conference on...Programming Language Design and Implementation (PLDI’00), pages 219–232. ACM Press, 2000. [46] Cormac Flanagan and Stephen N. Freund. Detecting race

  16. Migrating Department of Defense (DoD) Web Service Based Applications to Mobile Computing Platforms

    Science.gov (United States)

    2012-03-01

    Application Archetype MVC Model View Controller NDFD National Digital Forecast Database NOAA National Oceanic and Atmospheric Administration’s NSSC...for Java (GAE-J). GWT and GAE are not required to implement the COLD-T application, any web framework (PHP, Struts, JSF, Spring MVC , etc.) could be...2010. [3] S. D. K. Hyun Jung La, “Balanced MVC Architecture for Developing Service-based Mobile Applications,” IEEE International Conference on E

  17. A LIGHT-WEIGHT MVC (MODEL-VIEW-CONTROLLER FRAMEWORK FOR SMART DEVICE APPLICATION

    Directory of Open Access Journals (Sweden)

    Budi Darma Laksana

    2006-01-01

    Full Text Available In this paper, a light-weight MVC framework for smart device application is designed and implemented. The primary goal of the work is to provide a MVC framework for a commercial smart device product development. To this end, the developed framework presents integration between the classic design patterns, MVC and state-of-the-art technology XAML by adapting a MVC framework of an open source XAML efforts, MyXaml into .NET Compact Framework. As the compact framework only comprises 12% of .NET Framework library, some design and architectural changes of the existing framework need to be done to achieve the same abstraction level. The adapted framework enables to reduce the complexity of the smart device application development, reuse each component of the MVC separately in different project and provide a more manageable source code as the system architecture is more apparent from the source code itself as well as provide a commonality of the development pattern. A prototype of simple database interface application was built to show these benefits.

  18. A LIGHT-WEIGHT MVC (MODEL-VIEW-CONTROLLER) FRAMEWORK FOR SMART DEVICE APPLICATION

    OpenAIRE

    Budi Darma Laksana; Cherry Galatia Ballangan

    2006-01-01

    In this paper, a light-weight MVC framework for smart device application is designed and implemented. The primary goal of the work is to provide a MVC framework for a commercial smart device product development. To this end, the developed framework presents integration between the classic design patterns, MVC and state-of-the-art technology XAML by adapting a MVC framework of an open source XAML efforts, MyXaml into .NET Compact Framework. As the compact framework only comprises 12% of .NET F...

  19. Analisis Arsitektur Aplikasi Web Menggunakan Model View Controller (MVC pada Framework Java Server Faces

    Directory of Open Access Journals (Sweden)

    Gunawan Gunawan

    2016-06-01

    Full Text Available Aplikasi web yang khususnya memiliki kompleksitas besar dalam melakukan transaksi data sehingga konsep arsitektur (pattern perlu menjadi perhatian khusus untuk dapat mengoptimalkan kinerja performansi sistem ketika pengguna (user menggunakan dalam waktu yang bersamaan dengan jumlah yang banyak. Analisis performa arsitektur aplikasi web yang menggunakan model 2 (MVC dengan menggunakan framework Java Server Faces (JSF dan model 1 sebagai pembanding. Metode yang digunakan adalah Load dan Scalability Testing dengan dua cara yaitu uji coba terhadap response time karena peningkatan ukuran dari database dan uji coba terhadap response time karena peningkatan jumlah user yang menggunakan sistem secara bersamaan (concurrent users dan waktu tunggu (ramp-up yang ditentukan menggunakan Apache Jmeter. Analisis menunjukkan bahwa dalam implementasi arsitektur web yang menggunakan model 1 waktu rata-rata yang dibutuhkan untuk merespon permintaan user lebih cepat dan efisien dibanding model 2 (MVC.  

  20. Tensor scale-based image registration

    Science.gov (United States)

    Saha, Punam K.; Zhang, Hui; Udupa, Jayaram K.; Gee, James C.

    2003-05-01

    Tangible solutions to image registration are paramount in longitudinal as well as multi-modal medical imaging studies. In this paper, we introduce tensor scale - a recently developed local morphometric parameter - in rigid image registration. A tensor scale-based registration method incorporates local structure size, orientation and anisotropy into the matching criterion, and therefore, allows efficient multi-modal image registration and holds potential to overcome the effects of intensity inhomogeneity in MRI. Two classes of two-dimensional image registration methods are proposed - (1) that computes angular shift between two images by correlating their tensor scale orientation histogram, and (2) that registers two images by maximizing the similarity of tensor scale features. Results of applications of the proposed methods on proton density and T2-weighted MR brain images of (1) the same slice of the same subject, and (2) different slices of the same subject are presented. The basic superiority of tensor scale-based registration over intensity-based registration is that it may allow the use of local Gestalts formed by the intensity patterns over the image instead of simply considering intensities as isolated events at the pixel level. This would be helpful in dealing with the effects of intensity inhomogeneity and noise in MRI.

  1. Design and Implementation of Campus Application APP Based on Android

    Science.gov (United States)

    dongxu, Zhu; yabin, liu; xian lei, PI; weixiang, Zhou; meng, Huang

    2017-07-01

    In this paper, "Internet + campus" as the entrance of the Android technology based on the application of campus design and implementation of Application program. Based on GIS(Geographic Information System) spatial database, GIS spatial analysis technology, Java development technology and Android development technology, this system server adopts the Model View Controller architectue to realize the efficient use of campus information and provide real-time information of all kinds of learning and life for campus student at the same time. "Fingertips on the Institute of Disaster Prevention Science and Technology" release for the campus students of all grades of life, learning, entertainment provides a convenient.

  2. 高级英语课程活动多模态设计的案例分析--依托 Blackboard 教学平台%Case Analysis of Teaching Activities of Multi-modal Design in Advanced English-Based on Blackboard Teaching Platform

    Institute of Scientific and Technical Information of China (English)

    单慧芳; 芦建顺; 韩俊瑞

    2015-01-01

    通过多模态语言学习环境,设计多种教学活动提高学生的主观能动性,使教师真正作到与学生深度互动,从而提高学生类似母语学习者的能力。介绍了高级英语课程教学活动的主要类型,并分析了各种教学活动的设计理念、原则、教学目标、内容及组织形式等方面存在的问题。教学活动使平时成绩管理更具科学性,更有助于教师为每个学生建立课程档案。%In the multimodal language learning environment,a variety of teaching activities improve students'subjective initiative and make teachers have the deep interaction with students,which improve the students’abilities similar to native language learners’capabilities.The paper mainly introduces the main types of teaching activities in Advanced English and analyzes design ideas,principles,teaching goals,con-tent,and organizational forms etc.of each type.Teaching activities make the management of everyday eval-uation more scientific,and furthermore help teachers form the course file of each student.

  3. Design and Implementation of Harmful Algal Bloom Diagnosis System Based on J2EE Platform

    Science.gov (United States)

    Guo, Chunfeng; Zheng, Haiyong; Ji, Guangrong; Lv, Liang

    According to the shortcomings which are time consuming and laborious of the traditional HAB (Harmful Algal Bloom) diagnosis by the experienced experts using microscope, all kinds of methods and technologies to identify HAB emerged such as microscopic images, molecular biology, characteristics of pigments analysis, fluorescence spectra, inherent optical properties, etc. This paper proposes the design and implementation of a web-based diagnosis system integrating the popular methods for HAB identification. This system is designed with J2EE platform based on MVC (Model-View-Controller) model as well as technologies such as JSP, Servlets, EJB and JDBC.

  4. Clinical evaluation of 3D/3D MRI-CBCT automatching on brain tumors for online patient setup verification - A step towards MRI-based treatment planning

    DEFF Research Database (Denmark)

    Buhl, Sune K.; Duun-Christensen, Anne Katrine; Kristensen, Brian H.

    2010-01-01

    Background. Magnetic Resonance Imaging (MRI) is often used in modern day radiotherapy (RT) due to superior soft tissue contrast. However, treatment planning based solely on MRI is restricted due to e. g. the limitations of conducting online patient setup verification using MRI as reference....... In this study 3D/3D MRI-Cone Beam CT (CBCT) automatching for online patient setup verification was investigated. Material and methods. Initially, a multi-modality phantom was constructed and used for a quantitative comparison of CT-CBCT and MRI-CBCT automatching. Following the phantom experiment three patients...

  5. 基于核密度估计多样性采集的背景建模算法%Diversity Sampling Based Kernel Density Estimation for Background Modeling

    Institute of Scientific and Technical Information of China (English)

    毛燕芬; 施鹏飞

    2005-01-01

    A novel diversity-sampling based nonparametric multi-modal background model is proposed. Using the samples having more popular and various intensity values in the training sequence, a nonparametric model is built for background subtraction. According to the related intensities, different weights are given to the distinct samples in kernel density estimation. This avoids repeated computation using all samples, and makes computation more efficient in the evaluation phase. Experimental results show the validity of the diversitysampling scheme and robustness of the proposed model in moving objects segmentation. The proposed algorithm can be used in outdoor surveillance systems.

  6. 多模态宣传话语的隐喻建构分析--以天津滨海新区网站为例%Metaphorical Representation of Multi-modal Publicity Discourse--A Case Study of Binhai New Area Website

    Institute of Scientific and Technical Information of China (English)

    张晓辉

    2013-01-01

    以Lakoff&Johnson的隐喻理论为框架,以天津滨海新区网站多模态宣传语篇为语料、图像分析对象,以其中的隐喻意义为切入视角,多角度诠释了多模态宣传话语的隐喻意义。发现文字、图像、颜色等社会符号的共同作用能更好地再现政府宣传语篇中多模态符号的社会功能和意义,从而实现良好的宣传功能。%Based on the metaphor theories put forward by Lakoff&Johnson,using a multimodal publicity dis-course of Tianjin Binhai New Area website as a case study,this paper explores the social functions and signifi-cance that language,pictures and colors convey. This study is to illustrate how verbal and visual semiotic devic-es contribute to construct meanings in order to achieve the effect of publicity.

  7. Preparation and characterization of temperature-responsive magnetic composite particles for multi-modal cancer therapy.

    Science.gov (United States)

    Yao, Aihua; Chen, Qi; Ai, Fanrong; Wang, Deping; Huang, Wenhai

    2011-10-01

    The temperature-responsive magnetic composite particles were synthesized by emulsion-free polymerization of N-isopropylacrylamide (NIPAAm) and acrylamide (Am) in the presence of oleic acid-modified Fe(3)O(4) nanoparticles. The magnetic properties and heat generation ability of the composite particles were characterized. Furthermore, temperature and alternating magnetic field (AMF) triggered drug release behaviors of vitamin B(12)-loaded composite particles were also examined. It was found that composite particles enabled drug release to be controlled through temperature changes in the neighborhood of lower critical solution temperature. Continuous application of AMF resulted in an accelerated release of the loaded drug. On the other hand, intermittent AMF application to the composite particles resulted in an "on-off", stepwise release pattern. Longer release duration and larger overall release could be achieved by intermittent application of AMF as compared to continuous magnetic field. Such composite particles may be used for magnetic drug targeting followed by simultaneous hyperthermia and drug release.

  8. Generation of weakly nonlinear nonhydrostatic internal tides over large topography: a multi-modal approach

    Directory of Open Access Journals (Sweden)

    R. Maugé

    2008-03-01

    Full Text Available A set of evolution equations is derived for the modal coefficients in a weakly nonlinear nonhydrostatic internal-tide generation problem. The equations allow for the presence of large-amplitude topography, e.g. a continental slope, which is formally assumed to have a length scale much larger than that of the internal tide. However, comparison with results from more sophisticated numerical models show that this restriction can in practice be relaxed. It is shown that a topographically induced coupling between modes occurs that is distinct from nonlinear coupling. Nonlinear effects include the generation of higher harmonics by reflection from boundaries, i.e. steeper tidal beams at frequencies that are multiples of the basic tidal frequency. With a seasonal thermocline included, the model is capable of reproducing the phenomenon of local generation of internal solitary waves by a tidal beam impinging on the seasonal thermocline.

  9. Adaptation of Physiological and Cognitive Workload via Interactive Multi-modal Displays

    Science.gov (United States)

    2014-05-28

    peer-reviewed journals (N/A for none) 09/07/2013 Received Paper 8.00 James Merlo, Joseph E. Mercado , Jan B.F. Van Erp, Peter A. Hancock. Improving...08, . : , Mr. Joseph Mercado , Mr. Timothy White, Dr. Peter Hancock. Effects of Cross-Modal Sensory Cueing Automation Failurein a Target Detection Task...fields:...... ...... ...... ...... ...... PERCENT_SUPPORTEDNAME FTE Equivalent: Total Number: Discipline Joseph Mercado 0.50 Timothy White 0.50 1.00 2

  10. Multi-modal memory restructuring for patients suffering from combat-related PTSD: A pilot study

    NARCIS (Netherlands)

    Steen, M. van den; Brinkman, W.P.; Vermetten, E.; Neerincx, M.

    2010-01-01

    The paper discusses the design and evaluation of a multimedia software application, which can be used in the treatment of combat-related posttraumatic stress disorder (PTSD). The application allows patients and therapist to visualize the patients' past experience using maps, personal photos, stories

  11. New generation multi-modal antidepressants: focus on vortioxetine for major depressive disorder

    Directory of Open Access Journals (Sweden)

    Katona CL

    2014-02-01

    Full Text Available Cornelius L Katona,1 Cara P Katona2 1Division of Psychiatry, University College London, 2North Central London Psychiatry Training Programme, London, UK Abstract: Vortioxetine is a novel antidepressant with effects on multiple 5-HT receptors and on the serotonin transporter. This paper reviews preclinical and clinical evidence regarding its mechanism of action, its tolerability, and its efficacy in treating major depression. Clinical studies indicate that vortioxetine is effective in the treatment of major depression, though there is no suggestion of superiority over active comparators. There may be a clinically meaningful advantage in terms of tolerability. Keywords: vortioxetine, major depression, review

  12. A data-driven approach for evaluating multi-modal therapy in traumatic brain injury

    Science.gov (United States)

    Haefeli, Jenny; Ferguson, Adam R.; Bingham, Deborah; Orr, Adrienne; Won, Seok Joon; Lam, Tina I.; Shi, Jian; Hawley, Sarah; Liu, Jialing; Swanson, Raymond A.; Massa, Stephen M.

    2017-01-01

    Combination therapies targeting multiple recovery mechanisms have the potential for additive or synergistic effects, but experimental design and analyses of multimodal therapeutic trials are challenging. To address this problem, we developed a data-driven approach to integrate and analyze raw source data from separate pre-clinical studies and evaluated interactions between four treatments following traumatic brain injury. Histologic and behavioral outcomes were measured in 202 rats treated with combinations of an anti-inflammatory agent (minocycline), a neurotrophic agent (LM11A-31), and physical therapy consisting of assisted exercise with or without botulinum toxin-induced limb constraint. Data was curated and analyzed in a linked workflow involving non-linear principal component analysis followed by hypothesis testing with a linear mixed model. Results revealed significant benefits of the neurotrophic agent LM11A-31 on learning and memory outcomes after traumatic brain injury. In addition, modulations of LM11A-31 effects by co-administration of minocycline and by the type of physical therapy applied reached statistical significance. These results suggest a combinatorial effect of drug and physical therapy interventions that was not evident by univariate analysis. The study designs and analytic techniques applied here form a structured, unbiased, internally validated workflow that may be applied to other combinatorial studies, both in animals and humans. PMID:28205533

  13. The Use of Scattering Matrix to Model Multi-Modal Array Inspection with the Tfm

    Science.gov (United States)

    Zhang, J.; Drinkwater, B. W.; Wilcox, P. D.

    2009-03-01

    The scattering coefficient matrix describes the far field amplitude of scattered signals from a scatterer as a function of incident and scattering angles. In this paper an FE model is used to predict scattering matrices. By combining the predicted scattering coefficient matrix with a ray tracing model to predict the full matrix of array data, an efficient forward model of the complete array inspection process is presented. Longitudinal wave, shear waves and wave mode conversions are considered in the model. The TFM images for various wave mode combination cases from a weld sample are predicted and measured. Results show that by selecting the optimum array mode combination a good image for a given defect in the weld sample can be produced using an array. It is also shown how the model can be used to optimize the array inspection configuration.

  14. Multi-Modal and Targeted Imaging Improves Automated Mid-Brain Segmentation.

    Science.gov (United States)

    Plassard, Andrew J; D'Haese, Pierre F; Pallavaram, Srivatsan; Newton, Allen T; Claassen, Daniel O; Dawant, Benoit M; Landman, Bennett A

    2017-02-11

    The basal ganglia and limbic system, particularly the thalamus, putamen, internal and external globus pallidus, substantia nigra, and sub-thalamic nucleus, comprise a clinically relevant signal network for Parkinson's disease. In order to manually trace these structures, a combination of high-resolution and specialized sequences at 7T are used, but it is not feasible to scan clinical patients in those scanners. Targeted imaging sequences at 3T such as F-GATIR, and other optimized inversion recovery sequences, have been presented which enhance contrast in a select group of these structures. In this work, we show that a series of atlases generated at 7T can be used to accurately segment these structures at 3T using a combination of standard and optimized imaging sequences, though no one approach provided the best result across all structures. In the thalamus and putamen, a median Dice coefficient over 0.88 and a mean surface distance less than 1.0mm was achieved using a combination of T1 and an optimized inversion recovery imaging sequences. In the internal and external globus pallidus a Dice over 0.75 and a mean surface distance less than 1.2mm was achieved using a combination of T1 and F-GATIR imaging sequences. In the substantia nigra and sub-thalamic nucleus a Dice coefficient of over 0.6 and a mean surface distance of less than 1.0mm was achieved using the optimized inversion recovery imaging sequence. On average, using T1 and optimized inversion recovery together produced significantly improved segmentation results than any individual modality (p<0.05 wilcox sign-rank test).

  15. Expanding the Four Resources Model: Reading Visual and Multi-Modal Texts

    Science.gov (United States)

    Serafini, Frank

    2012-01-01

    Freebody and Luke proffered an expanded conceptualization of the resources readers utilize when reading and the roles readers adopt during the act of reading. The four resources model, and its associated four roles of the reader, expanded the definition of reading from a simple model of decoding printed texts to a model of constructing meaning and…

  16. Multi-Modal Image Registration and Matching for Localization of a Balloon on Titan

    Science.gov (United States)

    Ansar, Adnan I.

    2011-01-01

    A solution was developed that matches visible/IR imagery aboard a balloon in Saturn's moon Titan's atmosphere to SAR (synthetic aperture radar) and visible/IR data acquired from orbit. A balloon in Titan's atmosphere must be able to localize itself autonomously both globally and with respect to local terrain. The orbital data is used to provide the balloon imagery with global context. The work is novel in applying mutual information (MI) to orbital vs. aerial data. There are unique challenges in this setting. Image offsets are much higher than in medical imaging, there is local distortion due to 3D terrain relief, and the fields of regard from orbit and from the air are quite different.

  17. Unilateral deafness in children affects development of multi-modal modulation and default mode networks.

    Science.gov (United States)

    Schmithorst, Vincent J; Plante, Elena; Holland, Scott

    2014-01-01

    Monaural auditory input due to congenital or acquired unilateral hearing loss (UHL) may have neurobiological effects on the developing brain. Using functional magnetic resonance imaging (fMRI), we investigated the effect of UHL on the development of functional brain networks used for cross-modal processing. Children ages 7-12 with moderate or greater unilateral hearing loss of sensorineural origin (UHL-SN; N = 21) and normal-hearing controls (N = 23) performed an fMRI-compatible adaptation of the Token Test involving listening to a sentence such as "touched the small green circle and the large blue square" and simultaneously viewing an arrow touching colored shapes on a video. Children with right or severe-to-profound UHL-SN displayed smaller activation in a region encompassing the right inferior temporal, middle temporal, and middle occipital gyrus (BA 19/37/39), evidencing differences due to monaural hearing in cross-modal modulation of the visual processing pathway. Children with UHL-SN displayed increased activation in the left posterior superior temporal gyrus, likely the result either of more effortful low-level processing of auditory stimuli or differences in cross-modal modulation of the auditory processing pathway. Additionally, children with UHL-SN displayed reduced deactivation of anterior and posterior regions of the default mode network. Results suggest that monaural hearing affects the development of brain networks related to cross-modal sensory processing and the regulation of the default network during processing of spoken language.

  18. Beyond Relational: A Database Architecture and Federated Query Optimization in a Multi-Modal Healthcare Environment

    Science.gov (United States)

    Hylock, Ray Hales

    2013-01-01

    Over the past thirty years, clinical research has benefited substantially from the adoption of electronic medical record systems. As deployment has increased, so too has the number of researchers seeking to improve the overall analytical environment by way of tools and models. Although much work has been done, there are still many uninvestigated…

  19. Hybrid System Design for the Coordination of Multi-Modal Aerial Robots

    DEFF Research Database (Denmark)

    Koo, T. John; Quottrup, Michael Melholt; Clifton, C. A.

    2006-01-01

    In this paper we provide a framework for the coordination of a network of heterogeneous aerial robots by using temporal logic to formulate mission speci¯cations for the network of robots. The full dynamics of the aerial robots are considered, and multiple controllers that can cope with various co...

  20. Design and evaluation of a multi-modal footstep controller with VR-applications

    DEFF Research Database (Denmark)

    Nordahl, Rolf

    2005-01-01

    In this paper we describe the results of experiments whose goal is to investigate the effect of enhancing a virtual reality experience with the sound of synthetic footsteps. In order to do so we had to design a new controller and sound synthesis engine. Results show that the sense of presence is ...

  1. A multi-modal solution for the transmission of sound in nonuniform ducts

    Science.gov (United States)

    Eversman, W.

    1976-01-01

    The method of weighted residuals in the form of a modified Galerkin method with boundary residuals is developed for the study of the transmission of sound in nonuniform ducts carrying a steady compressible flow. In this formulation the steady flow is modeled as essentially one-dimensional but with a kinematic modification to force tangency of the flow at the duct walls. Good agreement has been obtained with known results for transmission and reflection coefficients in hard walled ducts up to near sonic velocities. In ducts with acoustically compliant boundaries good comparisons have been more difficult to achieve except at low Mach numbers. The problem of transmission in a straight, acoustically treated duct with a uniform flow has been formulated and the Galerkin method used with basis functions derived from the case when flow is absent. Results indicate that favorable comparisons with exact computations can be obtained if care is taken in choosing the basis functions.

  2. Multi-Modality Pulsed AC Source for Medical Applications of Non-Equilibrium Plasmas

    Science.gov (United States)

    Friedrichs, Daniel; Gilbert, James

    2014-10-01

    A burgeoning field has developed around the use of non-equilibrium (``cold'') plasmas for various medical applications, including wound treatment, surface sterilization, non-thermal hemostasis, and selective cell destruction. Proposed devices typically utilize pulsed DC power sources, which have no other therapeutic utility, and may encounter significant regulatory restrictions regarding their safety for use in patient care. Additionally, dedicated capital equipment is difficult for healthcare facilities to justify. In this work, we have demonstrated for the first time the generation of non-equilibrium plasma using pulsed AC output from a specially-designed electrosurgical generator. The ability to power novel non-equilibrium plasma devices from a piece of equipment already ubiquitous in operating theatres should significantly reduce the barriers to adoption of plasma devices. We demonstrate the ability of a prototype device, coupled to this source, to reduce bacterial growth in vitro. Such a system could allow a single surgical instrument to provide both non-thermal sterilization and thermal tissue dissection.

  3. The GuideView System for Interactive, Structured, Multi-modal Delivery of Clinical Guidelines

    Science.gov (United States)

    Iyengar, Sriram; Florez-Arango, Jose; Garcia, Carlos Andres

    2009-01-01

    GuideView is a computerized clinical guideline system which delivers clinical guidelines in an easy-to-understand and easy-to-use package. It may potentially enhance the quality of medical care or allow non-medical personnel to provide acceptable levels of care in situations where physicians or nurses may not be available. Such a system can be very valuable during space flight missions when a physician is not readily available, or perhaps the designated medical personnel is unable to provide care. Complex clinical guidelines are broken into simple steps. At each step clinical information is presented in multiple modes, including voice,audio, text, pictures, and video. Users can respond via mouse clicks or via voice navigation. GuideView can also interact with medical sensors using wireless or wired connections. The system's interface is illustrated and the results of a usability study are presented.

  4. Disguised face identification using multi-modal features in a quaternionic form

    DEFF Research Database (Denmark)

    Apostolopoulos, George; Tzitzilonis, Vasileios; Kappatos, Vassilios;

    2017-01-01

    Disguised face recognition is considered as very challenging and important problem in the face recognition field. A disguised face recognition algorithm is proposed using quaternionic representation. The feature extraction module is accomplished with a new method, decomposing each face image...

  5. Multi-modal albedo distributions in the ablation area of the southwestern Greenland Ice Sheet

    Science.gov (United States)

    Moustafa, S. E.; Rennermalm, A. K.; Smith, L. C.; Miller, M. A.; Mioduszewski, J. R.; Koenig, L. S.; Hom, M. G.; Shuman, C. A.

    2015-05-01

    Surface albedo is a key variable controlling solar radiation absorbed at the Greenland Ice Sheet (GrIS) surface and, thus, meltwater production. Recent decline in surface albedo over the GrIS has been linked to enhanced snow grain metamorphic rates, earlier snowmelt, and amplified melt-albedo feedback from atmospheric warming. However, the importance of distinct surface types on ablation area albedo and meltwater production is still relatively unknown. In this study, we analyze albedo and ablation rates using in situ and remotely sensed data. Observations include (1) a new high-quality in situ spectral albedo data set collected with an Analytical Spectral Devices Inc. spectroradiometer measuring at 325-1075 nm along a 1.25 km transect during 3 days in June 2013; (2) broadband albedo at two automatic weather stations; and (3) daily MODerate Resolution Imaging Spectroradiometer (MODIS) albedo (MOD10A1) between 31 May and 30 August 2012 and 2013. We find that seasonal ablation area albedos in 2013 have a bimodal distribution, with snow and ice facies characterizing the two peaks. Our results show that a shift from a distribution dominated by high to low albedos corresponds to an observed melt rate increase of 51.5% (between 10-14 July and 20-24 July 2013). In contrast, melt rate variability caused by albedo changes before and after this shift was much lower and varied between ~10 and 30% in the melting season. Ablation area albedos in 2012 exhibited a more complex multimodal distribution, reflecting a transition from light to dark-dominated surface, as well as sensitivity to the so called "dark-band" region in southwest Greenland. In addition to a darkening surface from ice crystal growth, our findings demonstrate that seasonal changes in GrIS ablation area albedos are controlled by changes in the fractional coverage of snow, bare ice, and impurity-rich surface types. Thus, seasonal variability in ablation area albedos appears to be regulated primarily as a function of bare ice expansion at the expense of snow, surface meltwater ponding, and melting of outcropped ice layers enriched with mineral materials, enabling dust and impurities to accumulate. As climate change continues in the Arctic region, understanding the seasonal evolution of ice sheet surface types in Greenland's ablation area is critical to improve projections of mass loss contributions to sea level rise.

  6. Beyond Relational: A Database Architecture and Federated Query Optimization in a Multi-Modal Healthcare Environment

    Science.gov (United States)

    Hylock, Ray Hales

    2013-01-01

    Over the past thirty years, clinical research has benefited substantially from the adoption of electronic medical record systems. As deployment has increased, so too has the number of researchers seeking to improve the overall analytical environment by way of tools and models. Although much work has been done, there are still many uninvestigated…

  7. A Multi-Modal Approach for Hand Motion Classification Using Surface EMG and Accelerometers

    OpenAIRE

    Fougner, Anders Lyngvi; Scheme, Erik; Chan, Adrian D. C.; Englehart, Kevin; Stavdahl, Øyvind

    2011-01-01

    For decades, electromyography (EMG) has been used for diagnostics, upper-limb prosthesis control, and recently even for more general human-machine interfaces. Current commercial upper limb prostheses usually have only two electrode sites due to cost and space limitations, while researchers often experiment with multiple sites. Micro-machined inertial sensors are gaining popularity in many commercial and research applications where knowledge of the postures and movements of the body is desired...

  8. A multi-modal approach for hand motion classification using surface EMG and accelerometers.

    Science.gov (United States)

    Fougner, A; Scheme, E; Chan, A D C; Englehart, K; Stavdahl, Ø

    2011-01-01

    For decades, electromyography (EMG) has been used for diagnostics, upper-limb prosthesis control, and recently even for more general human-machine interfaces. Current commercial upper limb prostheses usually have only two electrode sites due to cost and space limitations, while researchers often experiment with multiple sites. Micro-machined inertial sensors are gaining popularity in many commercial and research applications where knowledge of the postures and movements of the body is desired. In the present study, we have investigated whether accelerometers, which are relatively cheap, small, robust to noise, and easily integrated in a prosthetic socket; can reduce the need for adding more electrode sites to the prosthesis control system. This was done by adding accelerometers to a multifunction system and also to a simplified system more similar to current commercially available prosthesis controllers, and assessing the resulting changes in classification accuracy. The accelerometer does not provide information on muscle force like EMG electrodes, but the results show that it provides useful supplementary information. Specifically, if one wants to improve a two-site EMG system, one should add an accelerometer affixed to the forearm rather than a third electrode.

  9. A MEDICAL MULTI-MODALITY IMAGE FUSION OF CT/PET WITH PCA, DWT METHODS

    Directory of Open Access Journals (Sweden)

    S. Guruprasad

    2013-11-01

    Full Text Available This paper gives a view on the fusion of different modality images like PET and CT (Positron Emission Tomography & Computed Tomography by two domain methods PCA and DWT methods. The spatial domain is PCA method, and another transformation domain method (DWT. In dwt decomposed coefficients of DWT (discrete wavelet transformation are applied with the IDWT to get fused image information. Before that, choose a detailed part of decomposed coefficients by maximum selection and averaging the approximated part of DWT coefficients. In applying the PCA using eigen values and eigen vector of larger values as principal components and after to reconstruct using addition to these to get the fussed image of two modalities CT & PET. So that adds complimentary features of both anatomic, physiological and metabolic information in one image, provides better visual information in single image of patients in medical field. The analytic parameters like, MSE, PSNR, ENTROPY results are better enough to prove the methods each other.

  10. Acquisition multi-modale en temps réel pour le suivi du mouvement respiratoire

    OpenAIRE

    2011-01-01

    National audience; Treatment of cancerous tumours in the lungs by ha- drontherapy requires precise knowledge of the position of the tumour throughout the treatment. A biomechani- cal model of the respiratory system allows the tracking of the tumour. This model requires the de nition of boundary conditions, set by the skin of the chest. In this sense, the objective of this article concerns the establishment of the complete processing chain for a continuous monitoring of the skin of the thorax ...

  11. Multi-Modal Neural Conditional Ordinal Random Fields for Agreement Level Estimation

    NARCIS (Netherlands)

    Rakicevic, N.; Rudovic, O.; Petridis, S.; Pantic, Maja

    2016-01-01

    The ability to automatically detect the extent of agreement or disagreement a person expresses is an important indicator of inter-personal relations and emotion expression. Most of existing methods for automated analysis of human agreement from audio-visual data perform agreement detection using eit

  12. Feature Extraction and Object Recognition in Multi-Modal Forward Looking Imagery

    Science.gov (United States)

    2011-02-22

    a US Army test site. I. Introduction Forward-looking ground penetrating radar (FLGPR) is a primary sensor used for landmine detection. The...FLGPR can detect both above and below ground targets, but unfortunately it is can produce a large number of false detections. With proper registration...detections. These FPs can arise from various sources including bushes, cacti and even bare ground . Previous work used one monolithic model for all

  13. Multi-modal inter-subject registration of mouse brain images

    Science.gov (United States)

    Li, Xia; Yankeelov, Thomas E.; Rosen, Glenn; Gore, John C.; Dawant, Benoit M.

    2006-03-01

    The importance of small animal imaging in fundamental and clinical research is growing rapidly. These studies typically involve micro PET, micro MR, and micro CT images as well as optical or fluorescence images. Histological images are also often used to complement and/or validate the in vivo data. As is the case for human studies, automatic registration of these imaging modalities is a critical component of the overall analysis process, but, the small size of the animals and thus the limited spatial resolution of the in vivo images present specific challenges. In this paper, we propose a series of methods and techniques that permit the inter-subject registration of micro MR and histological images. We then compare results obtained by registering directly MR volumes to each other using a non-rigid registration algorithm we have developed at our institution with results obtained by registering first the MR volumes to their corresponding histological volume, which we reconstruct from 2D cross-sections, and then registering histological volumes to each other. We show that the second approach is preferable.

  14. Intelligent Virtual Agent: Creating a Multi-modal 3D Avatar Interface

    OpenAIRE

    Dunne, Mark; Mac Namee, Brian; Kelleher, John

    2009-01-01

    Human-computer interactions can be greatly enhanced by the use of 3D avatars, representing both human users and computer systems in 3D virtual spaces. This allows the human user to interface with the computer system in a natural and intuitive human-to-human dialog (human face-to-face conversation). Hence, continuing to blur the boundaries between the real and virtual worlds. This proposed avatar system will go a step further and will use a camera to track the user’s head and eye movements dur...

  15. Double jeopardy: multi-modality imaging of monozygotic "twin cap" atherosclerosis.

    Science.gov (United States)

    Murray, Scott W; Cooper, Robert M; Appleby, Clare; McCann, Caroline; Binukrishnan, Sukumaran; Radu, Maria D; Stables, Rodney H

    2014-11-01

    The investigation of asymptomatic but potentially vulnerable atherosclerosis is not yet a major focus for clinical Cardiologists. We have illustrated the contemporary investigation and treatment of such disease using a clinical case that involved monozygotic twins. One twin (T1) had unfortunately suffered a cardiac arrest whilst jogging and survived only due to bystander CPR and prompt defibrillation. His identical twin brother (T2), on subsequent investigation, harbours a compositionally identical lesion in a proximal coronary vessel that has not yet ruptured or provoked a clinical event. Following the presentation of both non-invasive and invasive images, we discuss the need for active suspicion and intensive treatment for those people with a 'genetic' risk of future myocardial infarction.

  16. Cognitive engineering of a military multi-modal memory restructuring system

    NARCIS (Netherlands)

    Brinkman, W.P.; Vermetten, E.; Steen, M. van den; Neerincx, M.A.

    2011-01-01

    Several methods have been proposed to treat combat veterans with Posttraumatic Stress Disorder (PTSD). Still, a recent review reports on high drop-out and non response rates. This has motivated work in the design of a software application to support and increase the appeal of traditional face-to-fac

  17. Sistemas multi–modales de profundidad restringida Multi-modal systems of restricted depth

    Directory of Open Access Journals (Sweden)

    Manuel Sierra A.

    2008-12-01

    Full Text Available Se presentan como extensiones del cálculo proposicional clásico, la jerarquíade sistemas deductivos SMM–n con n > 1. SMM–n es el sistema multi–modalde profundidad–n. El sistema SMM–1 es el cálculo proposicional clásico. Elsistema SMM–(n + 1 puede ser visto como el resultado de aplicar la regla denecesariedad, asociada a los razonadores con suficiente capacidad de razona-miento, una vez a los teoremas del sistema SMM–n. El sistema SMM resultade la reunión de los sistemas de la jerarquía, y puede ser visto como el sis-tema de lógica multi–modal Km con restricciones. Los sistemas SMM–n soncaracterizados con una semántica al estilo Kripke, en la cual, la longitud delas cadenas de mundos posibles se encuentra restringida.They are presented as extensions of the classical propositional logic, the hierarchy of deductive systems SMM–n with n > 1. SMM–n is the multi–modal system of depth–n. The system SMM–1 is the classical propositional logic. The system SMM–(n + 1 it can be seen as the result of applying the necesariedad rule, associated to the reasoners with enough reasoning capacity, once to the theorems of the system SMM–n. The system SMM is of the union of the systems of the hierarchy, and it can be seen as the system of logic multimodal Km with restrictions. The systems SMM–n are characterized with a semantics to the style Kripke, in the one which, the longitude of the chains of possible worlds is restricted.

  18. Multi-modal microtubule binding by the Ndc80 kinetochore complex

    Science.gov (United States)

    Alushin, Gregory M.; Musinipally, Vivek; Matson, Daniel; Tooley, John; Stukenberg, P. Todd; Nogales, Eva

    2012-01-01

    Summary The Ndc80 complex is a key site of kinetochore-microtubule attachment during cell division. The human complex engages microtubules with a globular “head” formed by tandem calponin-homology domains and an 80 amino-acid unstructured “tail” that contains sites of phospho-regulation by the Aurora B kinase. Using biochemical, cell biological, and electron microscopy analyses, we have dissected the tail’s roles in microtubule binding and mediating cooperative interactions between Ndc80 complexes. Two segments of the tail that contain Aurora B sites become ordered at interfaces; one with tubulin and the second with an adjacent Ndc80 head on the microtubule surface, forming interactions which are disrupted by phosphorylation. We propose a model in which Ndc80’s interaction with either growing or shrinking microtubule ends can be tuned by the phosphorylation state of its tail. PMID:23085714

  19. Multi-modal contrast of tissue anatomy enables correlative biomarker imaging

    Science.gov (United States)

    Garsha, Karl; Ventura, Franklin; Pestano, Gary; Otter, Michael; Nagy, Dea; Nagle, Ray B.; Roberts, Esteban; Barnes, Michael

    2015-03-01

    Optical imaging techniques are being developed that promise to increase the information content related to specific molecular reporters. Such modalities do not produce contrast in the structural context of the surrounding tissue, making it difficult to reconcile molecular information with morphological context. We report a solution that enables visualization of the tissue morphology on formalin-fixed, paraffin embedded sections prepared for analytical biomarker imaging. Our approach combines modes of transmitted darkfield and fluorescence contrast and computer visualization to produce 2-component image data analogous to the classical hematoxylin and eosin histological stain. An interferometric hyperspectral image capture mode enables measurement of multiplexed biomarkers in annotated anatomic regions. The system enables practical correlative analysis of molecular changes within areas of anatomic pathology.

  20. Three-dimensional registration methods for multi-modal magnetic resonance neuroimages

    CERN Document Server

    Triantafyllou, C

    2001-01-01

    automatically such measures in a reliable way. possible in principle, although the true accuracy of the method depends on the type of geometrical distortions present. These results also reveal that this class of algorithm is unable to solve more localised variations and higher order magnetic field distortions between the images. These facts motivate the development of a high-dimensional 3-D registration method capable of effecting a one-to-one correspondence by capturing the localised differences. This method was seen to account not only for topological differences but also for non-linear deformations in size and shape. Validation of the algorithm is carried out on geometrical objects, simulated data and real images to ensure that the important requirements for a topologically useful mapping; invertibility, smoothness of the deformation field and an almost perfect correspondence can be maintained between two image sequences. Finally, the performance of both approaches is compared by their application to clini...