Text linguistics and critical discourse analysis: A multimodal analysis of a magazine advertisement

Directory of Open Access Journals (Sweden)

Sidnéa Nunes Ferreira

2013-07-01

Full Text Available http://dx.doi.org/10.5007/2175-8026.2013n64p111 Drawing on Fairclough’s (1995 three-dimensional framework of discourse analysis of communicative events, in this paper we carry out a multimodal analysis of a diners Club international magazine advertisement. Moving from the description of how textimage (Mitchell 1995 constructs a problem-solution structure in the advertisement to the discussion of its discourse and sociocultural practices, the paper foregrounds a multi-layered ideological message, besides the construal of a need (problem for a product (solution. Through its multimodal structure, the advertisement seems to tap on two important sociological issues: the avoidance of human togetherness and the colonization of travelling by consumer markets (bauman  2007.

Multispectral analysis of multimodal images

Energy Technology Data Exchange (ETDEWEB)

Kvinnsland, Yngve; Brekke, Njaal (Dept. of Surgical Sciences, Univ. of Bergen, Bergen (Norway)); Taxt, Torfinn M.; Gruener, Renate (Dept. of Biomedicine, Univ. of Bergen, Bergen (Norway))

2009-02-15

An increasing number of multimodal images represent a valuable increase in available image information, but at the same time it complicates the extraction of diagnostic information across the images. Multispectral analysis (MSA) has the potential to simplify this problem substantially as unlimited number of images can be combined, and tissue properties across the images can be extracted automatically. Materials and methods. We have developed a software solution for MSA containing two algorithms for unsupervised classification, an EM-algorithm finding multinormal class descriptions and the k-means clustering algorithm, and two for supervised classification, a Bayesian classifier using multinormal class descriptions and a kNN-algorithm. The software has an efficient user interface for the creation and manipulation of class descriptions, and it has proper tools for displaying the results. Results. The software has been tested on different sets of images. One application is to segment cross-sectional images of brain tissue (T1- and T2-weighted MR images) into its main normal tissues and brain tumors. Another interesting set of images are the perfusion maps and diffusion maps, derived images from raw MR images. The software returns segmentation that seem to be sensible. Discussion. The MSA software appears to be a valuable tool for image analysis with multimodal images at hand. It readily gives a segmentation of image volumes that visually seems to be sensible. However, to really learn how to use MSA, it will be necessary to gain more insight into what tissues the different segments contain, and the upcoming work will therefore be focused on examining the tissues through for example histological sections.

Structured and Sparse Canonical Correlation Analysis as a Brain-Wide Multi-Modal Data Fusion Approach.

Science.gov (United States)

Mohammadi-Nejad, Ali-Reza; Hossein-Zadeh, Gholam-Ali; Soltanian-Zadeh, Hamid

2017-07-01

Multi-modal data fusion has recently emerged as a comprehensive neuroimaging analysis approach, which usually uses canonical correlation analysis (CCA). However, the current CCA-based fusion approaches face problems like high-dimensionality, multi-collinearity, unimodal feature selection, asymmetry, and loss of spatial information in reshaping the imaging data into vectors. This paper proposes a structured and sparse CCA (ssCCA) technique as a novel CCA method to overcome the above problems. To investigate the performance of the proposed algorithm, we have compared three data fusion techniques: standard CCA, regularized CCA, and ssCCA, and evaluated their ability to detect multi-modal data associations. We have used simulations to compare the performance of these approaches and probe the effects of non-negativity constraint, the dimensionality of features, sample size, and noise power. The results demonstrate that ssCCA outperforms the existing standard and regularized CCA-based fusion approaches. We have also applied the methods to real functional magnetic resonance imaging (fMRI) and structural MRI data of Alzheimer's disease (AD) patients (n = 34) and healthy control (HC) subjects (n = 42) from the ADNI database. The results illustrate that the proposed unsupervised technique differentiates the transition pattern between the subject-course of AD patients and HC subjects with a p-value of less than 1×10 -6 . Furthermore, we have depicted the brain mapping of functional areas that are most correlated with the anatomical changes in AD patients relative to HC subjects.

Meaning Making through Multiple Modalities in a Biology Classroom: A Multimodal Semiotics Discourse Analysis

Science.gov (United States)

Jaipal, Kamini

2010-01-01

The teaching of science is a complex process, involving the use of multiple modalities. This paper illustrates the potential of a multimodal semiotics discourse analysis framework to illuminate meaning-making possibilities during the teaching of a science concept. A multimodal semiotics analytical framework is developed and used to (1) analyze the…

Multimodality in organization studies

DEFF Research Database (Denmark)

Van Leeuwen, Theo

2017-01-01

This afterword reviews the chapters in this volume and reflects on the synergies between organization and management studies and multimodality studies that emerge from the volume. These include the combination of strong sociological theorizing and detailed multimodal analysis, a focus on material...

Multimodal Processes Rescheduling

DEFF Research Database (Denmark)

Bocewicz, Grzegorz; Banaszak, Zbigniew A.; Nielsen, Peter

2013-01-01

Cyclic scheduling problems concerning multimodal processes are usually observed in FMSs producing multi-type parts where the Automated Guided Vehicles System (AGVS) plays a role of a material handling system. Schedulability analysis of concurrently flowing cyclic processes (SCCP) exe-cuted in the......Cyclic scheduling problems concerning multimodal processes are usually observed in FMSs producing multi-type parts where the Automated Guided Vehicles System (AGVS) plays a role of a material handling system. Schedulability analysis of concurrently flowing cyclic processes (SCCP) exe...

Multimodal Aspects of Corporate Social Responsibility Communication

Directory of Open Access Journals (Sweden)

Carmen Daniela Maier

2014-12-01

Full Text Available This article addresses how the multimodal persuasive strategies of corporate social responsibility communication can highlight a company’s commitment to gender empowerment and environmental protection while advertising simultaneously its products. Drawing on an interdisciplinary methodological framework related to CSR communication, multimodal discourse analysis and gender theory, the article proposes a multimodal analysis model through which it is possible to map and explain the multimodal persuasive strategies employed by Coca-Cola company in their community-related films. By examining the semiotic modes’ interconnectivity and functional differentiation, this analytical endeavour expands the existing research work as the usual textual focus is extended to a multimodal one.

Multimodality image analysis work station

International Nuclear Information System (INIS)

Ratib, O.; Huang, H.K.

1989-01-01

The goal of this project is to design and implement a PACS (picture archiving and communication system) workstation for quantitative analysis of multimodality images. The Macintosh II personal computer was selected for its friendly user interface, its popularity among the academic and medical community, and its low cost. The Macintosh operates as a stand alone workstation where images are imported from a central PACS server through a standard Ethernet network and saved on a local magnetic or optical disk. A video digitizer board allows for direct acquisition of images from sonograms or from digitized cine angiograms. The authors have focused their project on the exploration of new means of communicating quantitative data and information through the use of an interactive and symbolic user interface. The software developed includes a variety of image analysis, algorithms for digitized angiograms, sonograms, scintigraphic images, MR images, and CT scans

An analysis of science content and representations in introductory college physics textbooks and multimodal learning resources

Science.gov (United States)

Donnelly, Suzanne M.

This study features a comparative descriptive analysis of the physics content and representations surrounding the first law of thermodynamics as presented in four widely used introductory college physics textbooks representing each of four physics textbook categories (calculus-based, algebra/trigonometry-based, conceptual, and technical/applied). Introducing and employing a newly developed theoretical framework, multimodal generative learning theory (MGLT), an analysis of the multimodal characteristics of textbook and multimedia representations of physics principles was conducted. The modal affordances of textbook representations were identified, characterized, and compared across the four physics textbook categories in the context of their support of problem-solving. Keywords: college science, science textbooks, multimodal learning theory, thermodynamics, representations

The Review of Visual Analysis Methods of Multi-modal Spatio-temporal Big Data

Directory of Open Access Journals (Sweden)

ZHU Qing

2017-10-01

Full Text Available The visual analysis of spatio-temporal big data is not only the state-of-art research direction of both big data analysis and data visualization, but also the core module of pan-spatial information system. This paper reviews existing visual analysis methods at three levels:descriptive visual analysis, explanatory visual analysis and exploratory visual analysis, focusing on spatio-temporal big data's characteristics of multi-source, multi-granularity, multi-modal and complex association.The technical difficulties and development tendencies of multi-modal feature selection, innovative human-computer interaction analysis and exploratory visual reasoning in the visual analysis of spatio-temporal big data were discussed. Research shows that the study of descriptive visual analysis for data visualizationis is relatively mature.The explanatory visual analysis has become the focus of the big data analysis, which is mainly based on interactive data mining in a visual environment to diagnose implicit reason of problem. And the exploratory visual analysis method needs a major break-through.

Design and Applications of a Multimodality Image Data Warehouse Framework

Science.gov (United States)

Wong, Stephen T.C.; Hoo, Kent Soo; Knowlton, Robert C.; Laxer, Kenneth D.; Cao, Xinhau; Hawkins, Randall A.; Dillon, William P.; Arenson, Ronald L.

2002-01-01

A comprehensive data warehouse framework is needed, which encompasses imaging and non-imaging information in supporting disease management and research. The authors propose such a framework, describe general design principles and system architecture, and illustrate a multimodality neuroimaging data warehouse system implemented for clinical epilepsy research. The data warehouse system is built on top of a picture archiving and communication system (PACS) environment and applies an iterative object-oriented analysis and design (OOAD) approach and recognized data interface and design standards. The implementation is based on a Java CORBA (Common Object Request Broker Architecture) and Web-based architecture that separates the graphical user interface presentation, data warehouse business services, data staging area, and backend source systems into distinct software layers. To illustrate the practicality of the data warehouse system, the authors describe two distinct biomedical applications—namely, clinical diagnostic workup of multimodality neuroimaging cases and research data analysis and decision threshold on seizure foci lateralization. The image data warehouse framework can be modified and generalized for new application domains. PMID:11971885

Multimodal Resources in Transnational Adoption

DEFF Research Database (Denmark)

Raudaskoski, Pirkko Liisa

The paper discusses an empirical analysis which highlights the multimodal nature of identity construction. A documentary on transnational adoption provides real life incidents as research material. The incidents involve (or from them emerge) various kinds of multimodal resources and participants...

Multimodal exemplification: The expansion of meaning in electronic ...

African Journals Online (AJOL)

Functional Multimodal Discourse Analysis (SF-MDA) and argues for improving their exemplifica-tion multimodally. Multimodal devices, if well coordinated, can help optimize e-dictionary exam-ples in informativity, diversity, dynamicity and ...

Computer-aided psychotherapy based on multimodal elicitation, estimation and regulation of emotion.

Science.gov (United States)

Cosić, Krešimir; Popović, Siniša; Horvat, Marko; Kukolja, Davor; Dropuljić, Branimir; Kovač, Bernard; Jakovljević, Miro

2013-09-01

Contemporary psychiatry is looking at affective sciences to understand human behavior, cognition and the mind in health and disease. Since it has been recognized that emotions have a pivotal role for the human mind, an ever increasing number of laboratories and research centers are interested in affective sciences, affective neuroscience, affective psychology and affective psychopathology. Therefore, this paper presents multidisciplinary research results of Laboratory for Interactive Simulation System at Faculty of Electrical Engineering and Computing, University of Zagreb in the stress resilience. Patient's distortion in emotional processing of multimodal input stimuli is predominantly consequence of his/her cognitive deficit which is result of their individual mental health disorders. These emotional distortions in patient's multimodal physiological, facial, acoustic, and linguistic features related to presented stimulation can be used as indicator of patient's mental illness. Real-time processing and analysis of patient's multimodal response related to annotated input stimuli is based on appropriate machine learning methods from computer science. Comprehensive longitudinal multimodal analysis of patient's emotion, mood, feelings, attention, motivation, decision-making, and working memory in synchronization with multimodal stimuli provides extremely valuable big database for data mining, machine learning and machine reasoning. Presented multimedia stimuli sequence includes personalized images, movies and sounds, as well as semantically congruent narratives. Simultaneously, with stimuli presentation patient provides subjective emotional ratings of presented stimuli in terms of subjective units of discomfort/distress, discrete emotions, or valence and arousal. These subjective emotional ratings of input stimuli and corresponding physiological, speech, and facial output features provides enough information for evaluation of patient's cognitive appraisal deficit

On-road anomaly detection by multimodal sensor analysis and multimedia processing

Science.gov (United States)

Orhan, Fatih; Eren, P. E.

2014-03-01

The use of smartphones in Intelligent Transportation Systems is gaining popularity, yet many challenges exist in developing functional applications. Due to the dynamic nature of transportation, vehicular social applications face complexities such as developing robust sensor management, performing signal and image processing tasks, and sharing information among users. This study utilizes a multimodal sensor analysis framework which enables the analysis of sensors in multimodal aspect. It also provides plugin-based analyzing interfaces to develop sensor and image processing based applications, and connects its users via a centralized application as well as to social networks to facilitate communication and socialization. With the usage of this framework, an on-road anomaly detector is being developed and tested. The detector utilizes the sensors of a mobile device and is able to identify anomalies such as hard brake, pothole crossing, and speed bump crossing. Upon such detection, the video portion containing the anomaly is automatically extracted in order to enable further image processing analysis. The detection results are shared on a central portal application for online traffic condition monitoring.

Multimodal Diversity of Postmodernist Fiction Text

Directory of Open Access Journals (Sweden)

U. I. Tykha

2016-12-01

Full Text Available The article is devoted to the analysis of structural and functional manifestations of multimodal diversity in postmodernist fiction texts. Multimodality is defined as the coexistence of more than one semiotic mode within a certain context. Multimodal texts feature a diversity of semiotic modes in the communication and development of their narrative. Such experimental texts subvert conventional patterns by introducing various semiotic resources – verbal or non-verbal.

Quantitative multimodality imaging in cancer research and therapy.

Science.gov (United States)

Yankeelov, Thomas E; Abramson, Richard G; Quarles, C Chad

2014-11-01

Advances in hardware and software have enabled the realization of clinically feasible, quantitative multimodality imaging of tissue pathophysiology. Earlier efforts relating to multimodality imaging of cancer have focused on the integration of anatomical and functional characteristics, such as PET-CT and single-photon emission CT (SPECT-CT), whereas more-recent advances and applications have involved the integration of multiple quantitative, functional measurements (for example, multiple PET tracers, varied MRI contrast mechanisms, and PET-MRI), thereby providing a more-comprehensive characterization of the tumour phenotype. The enormous amount of complementary quantitative data generated by such studies is beginning to offer unique insights into opportunities to optimize care for individual patients. Although important technical optimization and improved biological interpretation of multimodality imaging findings are needed, this approach can already be applied informatively in clinical trials of cancer therapeutics using existing tools. These concepts are discussed herein.

Mediating multimodal environmental knowledge across animation techniques

DEFF Research Database (Denmark)

Maier, Carmen Daniela

2011-01-01

://www.sustainlane.com/. The multimodal discourse analysis is meant to reveal how selection and representation of environmental knowledge about social actors, social actions, resources, time and space are influenced by animation techniques. Furthermore, in the context of this multimodal discourse analysis, their influence upon......The growing awareness of and concern about present environmental problems generate a proliferation of new forms of environmental discourses that are mediated in various ways. This chapter explores issues related to the ways in which environmental knowledge is multimodally communicated...

EXPLICITATION AND ADDITION TECHNIQUES IN AUDIOVISUAL TRANSLATION: A MULTIMODAL APPROACH OF ENGLISHINDONESIAN SUBTITLES

Directory of Open Access Journals (Sweden)

Ichwan Suyudi

2017-12-01

Full Text Available In audiovisual translation, the multimodality of the audiovisual text is both a challenge and a resource for subtitlers. This paper illustrates how multi-modes provide information that helps subtitlers to gain a better understanding of meaning-making practices that will influence them to make a decision-making in translating a certain verbal text. Subtitlers may explicit, add, and condense the texts based on the multi-modes as seen on the visual frames. Subtitlers have to consider the distribution and integration of the meanings of multi-modes in order to create comprehensive equivalence between the source and target texts. Excerpts of visual frames in this paper are taken from English films Forrest Gump (drama, 1996, and James Bond (thriller, 2010.

Development of comprehensive image processing technique for differential diagnosis of liver disease by using multi-modality images. Pixel-based cross-correlation method using a profile

International Nuclear Information System (INIS)

Inoue, Akira; Okura, Yasuhiko; Akiyama, Mitoshi; Ishida, Takayuki; Kawashita, Ikuo; Ito, Katsuyoshi; Matsunaga, Naofumi; Sanada, Taizo

2009-01-01

Imaging techniques such as high magnetic field imaging and multidetector-row CT have been markedly improved recently. The final image-reading systems easily produce more than a thousand diagnostic images per patient. Therefore, we developed a comprehensive cross-correlation processing technique using multi-modality images, in order to decrease the considerable time and effort involved in the interpretation of a radiogram (multi-formatted display and/or stack display method, etc). In this scheme, the criteria of an attending radiologist for the differential diagnosis of liver cyst, hemangioma of liver, hepatocellular carcinoma, and metastatic liver cancer on magnetic resonance images with various sequences and CT images with and without contrast enhancement employ a cross-correlation coefficient. Using a one-dimensional cross-correlation method, comprehensive image processing could be also adapted for various artifacts (some depending on modality imaging, and some on patients), which may be encountered at the clinical scene. This comprehensive image-processing technique could assist radiologists in the differential diagnosis of liver diseases. (author)

Multimodal optical analysis discriminates freshly extracted human sample of gliomas, metastases and meningiomas from their appropriate controls

Science.gov (United States)

Zanello, Marc; Poulon, Fanny; Pallud, Johan; Varlet, Pascale; Hamzeh, H.; Abi Lahoud, Georges; Andreiuolo, Felipe; Ibrahim, Ali; Pages, Mélanie; Chretien, Fabrice; di Rocco, Federico; Dezamis, Edouard; Nataf, François; Turak, Baris; Devaux, Bertrand; Abi Haidar, Darine

2017-02-01

Delineating tumor margins as accurately as possible is of primordial importance in surgical oncology: extent of resection is associated with survival but respect of healthy surrounding tissue is necessary for preserved quality of life. The real-time analysis of the endogeneous fluorescence signal of brain tissues is a promising tool for defining margins of brain tumors. The present study aims to demonstrate the feasibility of multimodal optical analysis to discriminate fresh samples of gliomas, metastases and meningiomas from their appropriate controls. Tumor samples were studied on an optical fibered endoscope using spectral and fluorescence lifetime analysis and then on a multimodal set-up for acquiring spectral, one and two-photon fluorescence images, second harmonic generation signals and two-photon fluorescence lifetime datasets. The obtained data allowed us to differentiate healthy samples from tumor samples. These results confirmed the possible clinical relevance of this real-time multimodal optical analysis. This technique can be easily applied to neurosurgical procedures for a better delineation of surgical margins.

Burnout: A Multimodal Approach to Assessment and Resolution.

Science.gov (United States)

Kesler, Kathryn D.

1990-01-01

Claims assessment and treatment of guidance counselor burnout is not simple. A variety of causes and symptoms leads to the need for multidimensional conceptualization and action plan. The multimodal behavior mode, BASIC I.D., with the adoption of a Setting modality, has been shown to be a comprehensive approach when applied to the understanding…

Interactivity in Educational Apps for Young Children: A Multimodal Analysis

Science.gov (United States)

Blitz-Raith, Alexandra H.; Liu, Jianxin

2017-01-01

Interactivity is an important indicator of an educational app's reception. Since most educational apps are multimodal, it justifies a methodological initiative to understand meaningful involvement of multimodality in enacting and even amplifying interactivity in an educational app. Yet research so far has largely concentrated on algorithm…

A multimodal stress monitoring system with canonical correlation analysis.

Science.gov (United States)

Unsoo Ha; Changhyeon Kim; Yongsu Lee; Hyunki Kim; Taehwan Roh; Hoi-Jun Yoo

2015-08-01

The multimodal stress monitoring headband is proposed for mobile stress management system. It is composed of headband and earplugs. Electroencephalography (EEG), hemoencephalography (HEG) and heart-rate variability (HRV) can be achieved simultaneously in the proposed system for user status estimation. With canonical correlation analysis (CCA) and temporal-kernel CCA (tkCCA) algorithm, those different signals can be combined for maximum correlation. Thanks to the proposed combination algorithm, the accuracy of the proposed system increased up to 19 percentage points than unimodal monitoring system in n-back task.

Multimodal Hyper-connectivity Networks for MCI Classification.

Science.gov (United States)

Li, Yang; Gao, Xinqiang; Jie, Biao; Yap, Pew-Thian; Kim, Min-Jeong; Wee, Chong-Yaw; Shen, Dinggang

2017-09-01

Hyper-connectivity network is a network where every edge is connected to more than two nodes, and can be naturally denoted using a hyper-graph. Hyper-connectivity brain network, either based on structural or functional interactions among the brain regions, has been used for brain disease diagnosis. However, the conventional hyper-connectivity network is constructed solely based on single modality data, ignoring potential complementary information conveyed by other modalities. The integration of complementary information from multiple modalities has been shown to provide a more comprehensive representation about the brain disruptions. In this paper, a novel multimodal hyper-network modelling method was proposed for improving the diagnostic accuracy of mild cognitive impairment (MCI). Specifically, we first constructed a multimodal hyper-connectivity network by simultaneously considering information from diffusion tensor imaging and resting-state functional magnetic resonance imaging data. We then extracted different types of network features from the hyper-connectivity network, and further exploited a manifold regularized multi-task feature selection method to jointly select the most discriminative features. Our proposed multimodal hyper-connectivity network demonstrated a better MCI classification performance than the conventional single modality based hyper-connectivity networks.

Researchers and teachers learning together and from each other using video-based multimodal analysis

DEFF Research Database (Denmark)

Davidsen, Jacob; Vanderlinde, Ruben

2014-01-01

integrated touch-screens into their teaching and learning. This paper examines the methodological usefulness of video-based multimodal analysis. Through reflection on the research project, we discuss how, by using video-based multimodal analysis, researchers and teachers can study children’s touch......This paper discusses a year-long technology integration project, during which teachers and researchers joined forces to explore children’s collaborative activities through the use of touch-screens. In the research project, discussed in this paper, 16 touch-screens were integrated into teaching...... and learning activities in two separate classrooms; the learning and collaborative processes were captured by using video, collecting over 150 hours of footage. By using digital research technologies and a longitudinal design, the authors of the research project studied how teachers and children gradually...

360-Degree Rhetorical Analysis of Job Hunting: A Four-Part, Multimodal Project

Science.gov (United States)

Ding, Huiling; Ding, Xin

2013-01-01

This article proposes the use of a four-component multimodal employment project that offers students a 360-degree understanding of the rhetorical situations surrounding job searches. More specifically, we argue for the use of the four deliverables of written resumes and cover letters, mock oral onsite interview, video resume analysis, and peer…

Multimodal interaction with W3C standards toward natural user interfaces to everything

CERN Document Server

2017-01-01

This book presents new standards for multimodal interaction published by the W3C and other standards bodies in straightforward and accessible language, while also illustrating the standards in operation through case studies and chapters on innovative implementations. The book illustrates how, as smart technology becomes ubiquitous, and appears in more and more different shapes and sizes, vendor-specific approaches to multimodal interaction become impractical, motivating the need for standards. This book covers standards for voice, emotion, natural language understanding, dialog, and multimodal architectures. The book describes the standards in a practical manner, making them accessible to developers, students, and researchers. Comprehensive resource that explains the W3C standards for multimodal interaction clear and straightforward way; Includes case studies of the use of the standards on a wide variety of devices, including mobile devices, tablets, wearables and robots, in applications such as assisted livi...

Multimodal Voxel-Based Meta-Analysis of White Matter Abnormalities in Obsessive-Compulsive Disorder

NARCIS (Netherlands)

Radua, J.; Grau, M.; van den Heuvel, O.A.; Thiebaut de Schotten, M.; Stein, D.J.; Canales-Rodriguez, E.J.; Catani, M.; Mataix-Cols, D.

2014-01-01

White matter (WM) abnormalities have long been suspected in obsessive-compulsive disorder (OCD) but the available evidence has been inconsistent. We conducted the first multimodal meta-analysis of WM volume (WMV) and fractional anisotropy (FA) studies in OCD. All voxel-wise studies comparing WMV or

A novel balance training system using multimodal biofeedback.

Science.gov (United States)

Afzal, Muhammad Raheel; Oh, Min-Kyun; Choi, Hye Young; Yoon, Jungwon

2016-04-22

A biofeedback-based balance training system can be used to provide the compromised sensory information to subjects in order to retrain their sensorimotor function. In this study, the design and evaluation of the low-cost, intuitive biofeedback system developed at Gyeongsang National University is extended to provide multimodal biofeedback for balance training by utilization of visual and haptic modalities. The system consists of a smartphone attached to the waist of the subject to provide information about tilt of the torso, a personal computer running a purpose built software to process the smartphone data and provide visual biofeedback to the subject by means of a dedicated monitor and a dedicated Phantom Omni(®) device for haptic biofeedback. For experimental verification of the system, eleven healthy young participants performed balance tasks assuming two distinct postures for 30 s each while acquiring torso tilt. The postures used were the one foot stance and the tandem Romberg stance. For both the postures, the subjects stood on a foam platform which provided a certain amount of ground instability. Post-experiment data analysis was performed using MATLAB(®) to analyze reduction in body sway. Analysis parameters based on the projection of trunk tilt information were calculated in order to ascertain the reduction in body sway and improvements in postural control. Two-way analysis of variance (ANOVA) showed no statistically significant interactions between postures and biofeedback. Post-hoc analysis revealed statistically significant reduction in body sway on provision of biofeedback. Subjects exhibited maximum body sway during no biofeedback trial, followed by either haptic or visual biofeedback and in most of the trials the multimodal biofeedback of visual and haptic together resulted in minimization of body sway, thus indicating that the multimodal biofeedback system worked well to provide significant (p biofeedback system can offer more customized training

A multimodal parallel architecture: A cognitive framework for multimodal interactions.

Science.gov (United States)

Cohn, Neil

2016-01-01

Human communication is naturally multimodal, and substantial focus has examined the semantic correspondences in speech-gesture and text-image relationships. However, visual narratives, like those in comics, provide an interesting challenge to multimodal communication because the words and/or images can guide the overall meaning, and both modalities can appear in complicated "grammatical" sequences: sentences use a syntactic structure and sequential images use a narrative structure. These dual structures create complexity beyond those typically addressed by theories of multimodality where only a single form uses combinatorial structure, and also poses challenges for models of the linguistic system that focus on single modalities. This paper outlines a broad theoretical framework for multimodal interactions by expanding on Jackendoff's (2002) parallel architecture for language. Multimodal interactions are characterized in terms of their component cognitive structures: whether a particular modality (verbal, bodily, visual) is present, whether it uses a grammatical structure (syntax, narrative), and whether it "dominates" the semantics of the overall expression. Altogether, this approach integrates multimodal interactions into an existing framework of language and cognition, and characterizes interactions between varying complexity in the verbal, bodily, and graphic domains. The resulting theoretical model presents an expanded consideration of the boundaries of the "linguistic" system and its involvement in multimodal interactions, with a framework that can benefit research on corpus analyses, experimentation, and the educational benefits of multimodality. Copyright © 2015.

Effective Fusion of Multi-Modal Remote Sensing Data in a Fully Convolutional Network for Semantic Labeling

Directory of Open Access Journals (Sweden)

Wenkai Zhang

2017-12-01

Full Text Available In recent years, Fully Convolutional Networks (FCN have led to a great improvement of semantic labeling for various applications including multi-modal remote sensing data. Although different fusion strategies have been reported for multi-modal data, there is no in-depth study of the reasons of performance limits. For example, it is unclear, why an early fusion of multi-modal data in FCN does not lead to a satisfying result. In this paper, we investigate the contribution of individual layers inside FCN and propose an effective fusion strategy for the semantic labeling of color or infrared imagery together with elevation (e.g., Digital Surface Models. The sensitivity and contribution of layers concerning classes and multi-modal data are quantified by recall and descent rate of recall in a multi-resolution model. The contribution of different modalities to the pixel-wise prediction is analyzed explaining the reason of the poor performance caused by the plain concatenation of different modalities. Finally, based on the analysis an optimized scheme for the fusion of layers with image and elevation information into a single FCN model is derived. Experiments are performed on the ISPRS Vaihingen 2D Semantic Labeling dataset (infrared and RGB imagery as well as elevation and the Potsdam dataset (RGB imagery and elevation. Comprehensive evaluations demonstrate the potential of the proposed approach.

Multimode model for projective photon-counting measurements

International Nuclear Information System (INIS)

Tualle-Brouri, Rosa; Ourjoumtsev, Alexei; Dantan, Aurelien; Grangier, Philippe; Wubs, Martijn; Soerensen, Anders S.

2009-01-01

We present a general model to account for the multimode nature of the quantum electromagnetic field in projective photon-counting measurements. We focus on photon-subtraction experiments, where non-Gaussian states are produced conditionally. These are useful states for continuous-variable quantum-information processing. We present a general method called mode reduction that reduces the multimode model to an effective two-mode problem. We apply this method to a multimode model describing broadband parametric down-conversion, thereby improving the analysis of existing experimental results. The main improvement is that spatial and frequency filters before the photon detector are taken into account explicitly. We find excellent agreement with previously published experimental results, using fewer free parameters than before, and discuss the implications of our analysis for the optimized production of states with negative Wigner functions.

Analysis and synthesis of multi-qubit, multi-mode quantum devices

Energy Technology Data Exchange (ETDEWEB)

Solgun, Firat

2015-03-27

In this thesis we propose new methods in multi-qubit multi-mode circuit quantum electrodynamics (circuit-QED) architectures. First we describe a direct parity measurement method for three qubits, which can be realized in 2D circuit-QED with a possible extension to four qubits in a 3D circuit-QED setup for the implementation of the surface code. In Chapter 3 we show how to derive Hamiltonians and compute relaxation rates of the multi-mode superconducting microwave circuits consisting of single Josephson junctions using an exact impedance synthesis technique (the Brune synthesis) and applying previous formalisms for lumped element circuit quantization. In the rest of the thesis we extend our method to multi-junction (multi-qubit) multi-mode circuits through the use of state-space descriptions which allows us to quantize any multiport microwave superconducting circuit with a reciprocal lossy impedance response.

Multimodal Corpus Analysis as a Method for Ensuring Cultural Usability of Embodied Conversational Agents

DEFF Research Database (Denmark)

Nakano, Yukiko; Rehm, Matthias

2009-01-01

In this paper we propose the method of multimodal corpus analysis to collect enough empirical data for modeling the behavior of embodied conversational agents. This is a prerequisite to ensure the usability of such complex interactive systems. So far, the development of embodied agents suffers fr...

Multimodal secondary prevention behavioral interventions for TIA and stroke: a systematic review and meta-analysis.

Directory of Open Access Journals (Sweden)

Maggie Lawrence

.16 to 0.88, P = 0.02, I2 = 0%, 4,053 participants.There are benefits to be derived from multimodal secondary prevention interventions. However, the findings are complex and should be interpreted with caution. Further, high quality trials providing comprehensive detail of interventions and outcomes, are required.PROSPERO CRD42012002538.

Multimodal aspects of CSR communication related to gender empowerment and environmental protection

DEFF Research Database (Denmark)

Maier, Carmen Daniela

Purpose – This paper explores how the multimodal persuasive strategies of CSR communication related to Coca-Cola’s “5 by 20” succeed to highlight the company’s continuous commitment to gender empowerment and environmental protection. Launched in 2010, “5 by 20” is a program designed to empower 5...... as the usual textual focus is extended to a multimodal one. Shedding light on how the multimodal interplay contributes to communicate corporate commitment to gender empowerment and environmental protection, this model can also be employed in order to explore multimodally other areas of CSR communication....... a multimodal analysis model through which it is possible to map and explain the multimodal persuasive strategies employed by the company in their CSR communication. The paper is focused on the analysis of the video series that can be accessed at: http://www.coca-colacompany.com/stories/5by20. Based on a social...

Patient-tailored multimodal neuroimaging, visualization and quantification of human intra-cerebral hemorrhage

Science.gov (United States)

Goh, Sheng-Yang M.; Irimia, Andrei; Vespa, Paul M.; Van Horn, John D.

2016-03-01

In traumatic brain injury (TBI) and intracerebral hemorrhage (ICH), the heterogeneity of lesion sizes and types necessitates a variety of imaging modalities to acquire a comprehensive perspective on injury extent. Although it is advantageous to combine imaging modalities and to leverage their complementary benefits, there are difficulties in integrating information across imaging types. Thus, it is important that efforts be dedicated to the creation and sustained refinement of resources for multimodal data integration. Here, we propose a novel approach to the integration of neuroimaging data acquired from human patients with TBI/ICH using various modalities; we also demonstrate the integrated use of multimodal magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI) data for TBI analysis based on both visual observations and quantitative metrics. 3D models of healthy-appearing tissues and TBIrelated pathology are generated, both of which are derived from multimodal imaging data. MRI volumes acquired using FLAIR, SWI, and T2 GRE are used to segment pathology. Healthy tissues are segmented using user-supervised tools, and results are visualized using a novel graphical approach called a `connectogram', where brain connectivity information is depicted within a circle of radially aligned elements. Inter-region connectivity and its strength are represented by links of variable opacities drawn between regions, where opacity reflects the percentage longitudinal change in brain connectivity density. Our method for integrating, analyzing and visualizing structural brain changes due to TBI and ICH can promote knowledge extraction and enhance the understanding of mechanisms underlying recovery.

Realtime Interaction Analysis of Social Interplay in a Multimodal Musical-Sonic Interaction Context

DEFF Research Database (Denmark)

Hansen, Anne-Marie

2010-01-01

This paper presents an approach to the analysis of social interplay among users in a multimodal interaction and musical performance situation. The approach consists of a combined method of realtime sensor data analysis for the description and interpretation of player gestures and video micro......-analysis methods used to describe the interaction situation and the context in which the social interplay takes place. This combined method is used in an iterative process, where the design of interactive games with musical-sonic feedback is improved according to newly discovered understandings and interpretations...

An Efficient Quality-Related Fault Diagnosis Method for Real-Time Multimode Industrial Process

Directory of Open Access Journals (Sweden)

Kaixiang Peng

2017-01-01

Full Text Available Focusing on quality-related complex industrial process performance monitoring, a novel multimode process monitoring method is proposed in this paper. Firstly, principal component space clustering is implemented under the guidance of quality variables. Through extraction of model tags, clustering information of original training data can be acquired. Secondly, according to multimode characteristics of process data, the monitoring model integrated Gaussian mixture model with total projection to latent structures is effective after building the covariance description form. The multimode total projection to latent structures (MTPLS model is the foundation of problem solving about quality-related monitoring for multimode processes. Then, a comprehensive statistics index is defined which is based on the posterior probability of the monitored samples belonging to each Gaussian component in the Bayesian theory. After that, a combined index is constructed for process monitoring. Finally, motivated by the application of traditional contribution plot in fault diagnosis, a gradient contribution rate is applied for analyzing the variation of variable contribution rate along samples. Our method can ensure the implementation of online fault monitoring and diagnosis for multimode processes. Performances of the whole proposed scheme are verified in a real industrial, hot strip mill process (HSMP compared with some existing methods.

The Big Five: Addressing Recurrent Multimodal Learning Data Challenges

NARCIS (Netherlands)

Di Mitri, Daniele; Schneider, Jan; Specht, Marcus; Drachsler, Hendrik

2018-01-01

The analysis of multimodal data in learning is a growing field of research, which has led to the development of different analytics solutions. However, there is no standardised approach to handle multimodal data. In this paper, we describe and outline a solution for five recurrent challenges in

ANALYSIS OF MULTIMODAL FUSION TECHNIQUES FOR AUDIO-VISUAL SPEECH RECOGNITION

Directory of Open Access Journals (Sweden)

D.V. Ivanko

2016-05-01

Full Text Available The paper deals with analytical review, covering the latest achievements in the field of audio-visual (AV fusion (integration of multimodal information. We discuss the main challenges and report on approaches to address them. One of the most important tasks of the AV integration is to understand how the modalities interact and influence each other. The paper addresses this problem in the context of AV speech processing and speech recognition. In the first part of the review we set out the basic principles of AV speech recognition and give the classification of audio and visual features of speech. Special attention is paid to the systematization of the existing techniques and the AV data fusion methods. In the second part we provide a consolidated list of tasks and applications that use the AV fusion based on carried out analysis of research area. We also indicate used methods, techniques, audio and video features. We propose classification of the AV integration, and discuss the advantages and disadvantages of different approaches. We draw conclusions and offer our assessment of the future in the field of AV fusion. In the further research we plan to implement a system of audio-visual Russian continuous speech recognition using advanced methods of multimodal fusion.

Optical sensor in planar configuration based on multimode interference

Science.gov (United States)

Blahut, Marek

2017-08-01

In the paper a numerical analysis of optical sensors based on multimode interference in planar one-dimensional step-index configuration is presented. The structure consists in single-mode input and output waveguides and multimode waveguide which guide only few modes. Material parameters discussed refer to a SU8 polymer waveguide on SiO2 substrate. The optical system described will be designed to the analysis of biological substances.

Acoustic multimode interference and self-imaging phenomena realized in multimodal phononic crystal waveguides

International Nuclear Information System (INIS)

Zou, Qiushun; Yu, Tianbao; Liu, Jiangtao; Wang, Tongbiao; Liao, Qinghua; Liu, Nianhua

2015-01-01

We report an acoustic multimode interference effect and self-imaging phenomena in an acoustic multimode waveguide system which consists of M parallel phononic crystal waveguides (M-PnCWs). Results show that the self-imaging principle remains applicable for acoustic waveguides just as it does for optical multimode waveguides. To achieve the dispersions and replicas of the input acoustic waves produced along the propagation direction, we performed the finite element method on M-PnCWs, which support M guided modes within the target frequency range. The simulation results show that single images (including direct and mirrored images) and N-fold images (N is an integer) are identified along the propagation direction with asymmetric and symmetric incidence discussed separately. The simulated positions of the replicas agree well with the calculated values that are theoretically decided by self-imaging conditions based on the guided mode propagation analysis. Moreover, the potential applications based on this self-imaging effect for acoustic wavelength de-multiplexing and beam splitting in the acoustic field are also presented. (paper)

A MULTIMODAL DISCOURSE ANALYSIS OF SELECTED ADVERTISEMENT OF MALARIA DRUGS

Directory of Open Access Journals (Sweden)

Ayodeji Olowu

2015-06-01

Full Text Available This study identified and analyzed the visual and linguistic components associated with the selected advertisement of malaria drugs. This was with a view to describing the essential communication devices the advertisers of such drugs have employed. Data for the study were drawn from both primary and secondary sources. The primary source for the study comprised 4 purposively selected posters, stickers and drugs literature advertisement on malaria. Analysis of the data followed the framework of Kress and Leeuwen’s Multimodal Discourse Analysis. The results showed that such visual resources as colour, pictures, symbols and icons, gaze and posture enhance the semantic quality of the advertisement. In the whole, the study emphasizes the vitality of visual and linguistic elements as important communication devices in advertising.

Constructing hotel brands: A multimodal analysis of luxury hotel homepages

Directory of Open Access Journals (Sweden)

Fei-Wen Cheng

2016-04-01

Full Text Available As e-marketing has become the dominant marketing mode in the hospitality industry, this study investigates how two luxury hotels represent and promote themselves through their major e-commerce platforms (i.e. hotel-owned websites. The verbal and visual texts of 51 website homepages owned by these two hotel chains are compiled and analyzed by drawing upon the corpus linguistic approach for verbal analysis and Kress and van Leeuwen’s (2006 visual grammar framework for image analysis. The findings indicate that despite some similarities in their web-mediated communication strategies, each hotel firm has discursive strategies that reveal diverging attitudes in their choices of various semiotic resources to construct their own brand identities. This study contributes to the academic literature on web-mediated tourism discourse by showing how a multimodal analysis can add insights to brand formulation.

MMX-I: A data-processing software for multi-modal X-ray imaging and tomography

International Nuclear Information System (INIS)

Bergamaschi, A; Medjoubi, K; Somogyi, A; Messaoudi, C; Marco, S

2017-01-01

Scanning hard X-ray imaging allows simultaneous acquisition of multimodal information, including X-ray fluorescence, absorption, phase and dark-field contrasts, providing structural and chemical details of the samples. Combining these scanning techniques with the infrastructure developed for fast data acquisition at Synchrotron Soleil permits to perform multimodal imaging and tomography during routine user experiments at the Nanoscopium beamline. A main challenge of such imaging techniques is the online processing and analysis of the generated very large volume (several hundreds of Giga Bytes) multimodal data-sets. This is especially important for the wide user community foreseen at the user oriented Nanoscopium beamline (e.g. from the fields of Biology, Life Sciences, Geology, Geobiology), having no experience in such data-handling. MMX-I is a new multi-platform open-source freeware for the processing and reconstruction of scanning multi-technique X-ray imaging and tomographic datasets. The MMX-I project aims to offer, both expert users and beginners, the possibility of processing and analysing raw data, either on-site or off-site. Therefore we have developed a multi-platform (Mac, Windows and Linux 64bit) data processing tool, which is easy to install, comprehensive, intuitive, extendable and user-friendly. MMX-I is now routinely used by the Nanoscopium user community and has demonstrated its performance in treating big data. (paper)

MMX-I: A data-processing software for multi-modal X-ray imaging and tomography

Science.gov (United States)

Bergamaschi, A.; Medjoubi, K.; Messaoudi, C.; Marco, S.; Somogyi, A.

2017-06-01

Scanning hard X-ray imaging allows simultaneous acquisition of multimodal information, including X-ray fluorescence, absorption, phase and dark-field contrasts, providing structural and chemical details of the samples. Combining these scanning techniques with the infrastructure developed for fast data acquisition at Synchrotron Soleil permits to perform multimodal imaging and tomography during routine user experiments at the Nanoscopium beamline. A main challenge of such imaging techniques is the online processing and analysis of the generated very large volume (several hundreds of Giga Bytes) multimodal data-sets. This is especially important for the wide user community foreseen at the user oriented Nanoscopium beamline (e.g. from the fields of Biology, Life Sciences, Geology, Geobiology), having no experience in such data-handling. MMX-I is a new multi-platform open-source freeware for the processing and reconstruction of scanning multi-technique X-ray imaging and tomographic datasets. The MMX-I project aims to offer, both expert users and beginners, the possibility of processing and analysing raw data, either on-site or off-site. Therefore we have developed a multi-platform (Mac, Windows and Linux 64bit) data processing tool, which is easy to install, comprehensive, intuitive, extendable and user-friendly. MMX-I is now routinely used by the Nanoscopium user community and has demonstrated its performance in treating big data.

Multimodality and Ambient Intelligence

NARCIS (Netherlands)

Nijholt, Antinus; Verhaegh, W.; Aarts, E.; Korst, J.

2004-01-01

In this chapter we discuss multimodal interface technology. We present eexamples of multimodal interfaces and show problems and opportunities. Fusion of modalities is discussed and some roadmap discussions on research in multimodality are summarized. This chapter also discusses future developments

Video genre classification using multimodal features

Science.gov (United States)

Jin, Sung Ho; Bae, Tae Meon; Choo, Jin Ho; Ro, Yong Man

2003-12-01

We propose a video genre classification method using multimodal features. The proposed method is applied for the preprocessing of automatic video summarization or the retrieval and classification of broadcasting video contents. Through a statistical analysis of low-level and middle-level audio-visual features in video, the proposed method can achieve good performance in classifying several broadcasting genres such as cartoon, drama, music video, news, and sports. In this paper, we adopt MPEG-7 audio-visual descriptors as multimodal features of video contents and evaluate the performance of the classification by feeding the features into a decision tree-based classifier which is trained by CART. The experimental results show that the proposed method can recognize several broadcasting video genres with a high accuracy and the classification performance with multimodal features is superior to the one with unimodal features in the genre classification.

A Multi-Modality CMOS Sensor Array for Cell-Based Assay and Drug Screening.

Science.gov (United States)

Chi, Taiyun; Park, Jong Seok; Butts, Jessica C; Hookway, Tracy A; Su, Amy; Zhu, Chengjie; Styczynski, Mark P; McDevitt, Todd C; Wang, Hua

2015-12-01

In this paper, we present a fully integrated multi-modality CMOS cellular sensor array with four sensing modalities to characterize different cell physiological responses, including extracellular voltage recording, cellular impedance mapping, optical detection with shadow imaging and bioluminescence sensing, and thermal monitoring. The sensor array consists of nine parallel pixel groups and nine corresponding signal conditioning blocks. Each pixel group comprises one temperature sensor and 16 tri-modality sensor pixels, while each tri-modality sensor pixel can be independently configured for extracellular voltage recording, cellular impedance measurement (voltage excitation/current sensing), and optical detection. This sensor array supports multi-modality cellular sensing at the pixel level, which enables holistic cell characterization and joint-modality physiological monitoring on the same cellular sample with a pixel resolution of 80 μm × 100 μm. Comprehensive biological experiments with different living cell samples demonstrate the functionality and benefit of the proposed multi-modality sensing in cell-based assay and drug screening.

Performance Evaluation of Multimodal Multifeature Authentication System Using KNN Classification

Directory of Open Access Journals (Sweden)

Gayathri Rajagopal

2015-01-01

Full Text Available This research proposes a multimodal multifeature biometric system for human recognition using two traits, that is, palmprint and iris. The purpose of this research is to analyse integration of multimodal and multifeature biometric system using feature level fusion to achieve better performance. The main aim of the proposed system is to increase the recognition accuracy using feature level fusion. The features at the feature level fusion are raw biometric data which contains rich information when compared to decision and matching score level fusion. Hence information fused at the feature level is expected to obtain improved recognition accuracy. However, information fused at feature level has the problem of curse in dimensionality; here PCA (principal component analysis is used to diminish the dimensionality of the feature sets as they are high dimensional. The proposed multimodal results were compared with other multimodal and monomodal approaches. Out of these comparisons, the multimodal multifeature palmprint iris fusion offers significant improvements in the accuracy of the suggested multimodal biometric system. The proposed algorithm is tested using created virtual multimodal database using UPOL iris database and PolyU palmprint database.

Time-dependent, multimode interaction analysis of the gyroklystron amplifier

Energy Technology Data Exchange (ETDEWEB)

Swati, M. V., E-mail: swati.mv.ece10@iitbhu.ac.in; Chauhan, M. S.; Jain, P. K. [Department of Electronics Engineering, Indian Institute of Technology, Banaras Hindu University, Varanasi 221005 (India)

2016-08-15

In this paper, a time-dependent multimode nonlinear analysis for the gyroklystron amplifier has been developed by extending the analysis of gyrotron oscillators by employing the self-consistent approach. The nonlinear analysis developed here has been validated by taking into account the reported experimental results for a 32.3 GHz, three cavity, second harmonic gyroklystron operating in the TE{sub 02} mode. The analysis has been used to estimate the temporal RF growth in the operating mode as well as the nearby competing modes. Device gain and bandwidth have been computed for different drive powers and frequencies. The effect of various beam parameters, such as beam voltage, beam current, and pitch factor, has also been studied. The computational results have estimated the gyroklystron saturated RF power ∼319 kW at 32.3 GHz with efficiency ∼23% and gain ∼26.3 dB with device bandwidth ∼0.027% (8 MHz) for a 70 kV, 20 A electron beam. The computed results are found to be in agreement with the experimental values within 10%.

Visual analytics for multimodal social network analysis: a design study with social scientists.

Science.gov (United States)

Ghani, Sohaib; Kwon, Bum Chul; Lee, Seungyoon; Yi, Ji Soo; Elmqvist, Niklas

2013-12-01

Social network analysis (SNA) is becoming increasingly concerned not only with actors and their relations, but also with distinguishing between different types of such entities. For example, social scientists may want to investigate asymmetric relations in organizations with strict chains of command, or incorporate non-actors such as conferences and projects when analyzing coauthorship patterns. Multimodal social networks are those where actors and relations belong to different types, or modes, and multimodal social network analysis (mSNA) is accordingly SNA for such networks. In this paper, we present a design study that we conducted with several social scientist collaborators on how to support mSNA using visual analytics tools. Based on an openended, formative design process, we devised a visual representation called parallel node-link bands (PNLBs) that splits modes into separate bands and renders connections between adjacent ones, similar to the list view in Jigsaw. We then used the tool in a qualitative evaluation involving five social scientists whose feedback informed a second design phase that incorporated additional network metrics. Finally, we conducted a second qualitative evaluation with our social scientist collaborators that provided further insights on the utility of the PNLBs representation and the potential of visual analytics for mSNA.

Learning multimodal dictionaries.

Science.gov (United States)

Monaci, Gianluca; Jost, Philippe; Vandergheynst, Pierre; Mailhé, Boris; Lesage, Sylvain; Gribonval, Rémi

2007-09-01

Real-world phenomena involve complex interactions between multiple signal modalities. As a consequence, humans are used to integrate at each instant perceptions from all their senses in order to enrich their understanding of the surrounding world. This paradigm can be also extremely useful in many signal processing and computer vision problems involving mutually related signals. The simultaneous processing of multimodal data can, in fact, reveal information that is otherwise hidden when considering the signals independently. However, in natural multimodal signals, the statistical dependencies between modalities are in general not obvious. Learning fundamental multimodal patterns could offer deep insight into the structure of such signals. In this paper, we present a novel model of multimodal signals based on their sparse decomposition over a dictionary of multimodal structures. An algorithm for iteratively learning multimodal generating functions that can be shifted at all positions in the signal is proposed, as well. The learning is defined in such a way that it can be accomplished by iteratively solving a generalized eigenvector problem, which makes the algorithm fast, flexible, and free of user-defined parameters. The proposed algorithm is applied to audiovisual sequences and it is able to discover underlying structures in the data. The detection of such audio-video patterns in audiovisual clips allows to effectively localize the sound source on the video in presence of substantial acoustic and visual distractors, outperforming state-of-the-art audiovisual localization algorithms.

Teaching Poetry through Collaborative Art: An Analysis of Multimodal Ensembles for Transformative Learning

Science.gov (United States)

Wandera, David B.

2016-01-01

This study is anchored on two positions: that every communication is multimodal and that different modalities within multimodal communication have particular affordances. Written and oral language and other modalities, such as body language and audio/visual media, are interwoven in classroom communication. What might it look like to strategically…

The Comprehension Problems of Children with Poor Reading Comprehension despite Adequate Decoding: A Meta-Analysis.

Science.gov (United States)

Spencer, Mercedes; Wagner, Richard K

2018-06-01

The purpose of this meta-analysis was to examine the comprehension problems of children who have a specific reading comprehension deficit (SCD), which is characterized by poor reading comprehension despite adequate decoding. The meta-analysis included 86 studies of children with SCD who were assessed in reading comprehension and oral language (vocabulary, listening comprehension, storytelling ability, and semantic and syntactic knowledge). Results indicated that children with SCD had deficits in oral language ( d = -0.78, 95% CI [-0.89, -0.68], but these deficits were not as severe as their deficit in reading comprehension ( d = -2.78, 95% CI [-3.01, -2.54]). When compared to reading comprehension age-matched normal readers, the oral language skills of the two groups were comparable ( d = 0.32, 95% CI [-0.49, 1.14]), which suggests that the oral language weaknesses of children with SCD represent a developmental delay rather than developmental deviance. Theoretical and practical implications of these findings are discussed.

Multimodality

DEFF Research Database (Denmark)

Buhl, Mie

2010-01-01

In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal' communication, which should not be confused with the term ‘multimedia'. While multimedia...... on their teaching and learning situations. The choices they make involve e-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very...

Multimodal Speaker Diarization.

Science.gov (United States)

Noulas, A; Englebienne, G; Krose, B J A

2012-01-01

We present a novel probabilistic framework that fuses information coming from the audio and video modality to perform speaker diarization. The proposed framework is a Dynamic Bayesian Network (DBN) that is an extension of a factorial Hidden Markov Model (fHMM) and models the people appearing in an audiovisual recording as multimodal entities that generate observations in the audio stream, the video stream, and the joint audiovisual space. The framework is very robust to different contexts, makes no assumptions about the location of the recording equipment, and does not require labeled training data as it acquires the model parameters using the Expectation Maximization (EM) algorithm. We apply the proposed model to two meeting videos and a news broadcast video, all of which come from publicly available data sets. The results acquired in speaker diarization are in favor of the proposed multimodal framework, which outperforms the single modality analysis results and improves over the state-of-the-art audio-based speaker diarization.

The semiotics of typography in literary texts. A multimodal approach

DEFF Research Database (Denmark)

Nørgaard, Nina

2009-01-01

to multimodal discourse proposed, for instance, by Kress & Van Leeuwen (2001) and Baldry & Thibault (2006), and, more specifically, the multimodal approach to typography suggested by Van Leeuwen (2005b; 2006), in order to sketch out a methodological framework applicable to the description and analysis...... of the semiotic potential of typography in literary texts....

Facilitating Multiple Intelligences Through Multimodal Learning Analytics

Directory of Open Access Journals (Sweden)

Ayesha PERVEEN

2018-01-01

Full Text Available This paper develops a theoretical framework for employing learning analytics in online education to trace multiple learning variations of online students by considering their potential of being multiple intelligences based on Howard Gardner’s 1983 theory of multiple intelligences. The study first emphasizes the need to facilitate students as multiple intelligences by online education systems and then suggests a framework of the advanced form of learning analytics i.e., multimodal learning analytics for tracing and facilitating multiple intelligences while they are engaged in online ubiquitous learning. As multimodal learning analytics is still an evolving area, it poses many challenges for technologists, educationists as well as organizational managers. Learning analytics make machines meet humans, therefore, the educationists with an expertise in learning theories can help technologists devise latest technological methods for multimodal learning analytics and organizational managers can implement them for the improvement of online education. Therefore, a careful instructional design based on a deep understanding of students’ learning abilities, is required to develop teaching plans and technological possibilities for monitoring students’ learning paths. This is how learning analytics can help design an adaptive instructional design based on a quick analysis of the data gathered. Based on that analysis, the academicians can critically reflect upon the quick or delayed implementation of the existing instructional design based on students’ cognitive abilities or even about the single or double loop learning design. The researcher concludes that the online education is multimodal in nature, has the capacity to endorse multiliteracies and, therefore, multiple intelligences can be tracked and facilitated through multimodal learning analytics in an online mode. However, online teachers’ training both in technological implementations and

Retwitting, Reposting, Repinning; Reshaping Identities Online: Towards a Social Semiotic Multimodal Analysis of Digital Remediation

Directory of Open Access Journals (Sweden)

Elisabetta Adami

2014-12-01

Full Text Available The paper focuses on crossposting, as a form of digital remediation consisting in the production and distribution of multimodal texts in multiple online spaces through embedding and sharing. The study sketches the analytical steps to approach the phenomenon, applying them on a UK food blogger’s activity spanning her blog, her Facebook, Twitter, YouTube, Pinterest, and Instagram accounts. In the instance examined, recontextualized texts are re-genred; genre assignment is given by the combination of the multimodal configuration in each space and the blogger’s use of these affordances to her aims. Through minimum new text creation, by recontextualizing her texts in different spaces, the blogger can shape differently her relation with the audience. The analytical framework is intended as a flexible tool that, adjusted as appropriate, can be used for a broader in-depth analysis of crossposting.

Pattern recognition of neurotransmitters using multimode sensing.

Science.gov (United States)

Stefan-van Staden, Raluca-Ioana; Moldoveanu, Iuliana; van Staden, Jacobus Frederick

2014-05-30

Pattern recognition is essential in chemical analysis of biological fluids. Reliable and sensitive methods for neurotransmitters analysis are needed. Therefore, we developed for pattern recognition of neurotransmitters: dopamine, epinephrine, norepinephrine a method based on multimode sensing. Multimode sensing was performed using microsensors based on diamond paste modified with 5,10,15,20-tetraphenyl-21H,23H-porphyrine, hemin and protoporphyrin IX in stochastic and differential pulse voltammetry modes. Optimized working conditions: phosphate buffer solution of pH 3.01 and KCl 0.1mol/L (as electrolyte support), were determined using cyclic voltammetry and used in all measurements. The lowest limits of quantification were: 10(-10)mol/L for dopamine and epinephrine, and 10(-11)mol/L for norepinephrine. The multimode microsensors were selective over ascorbic and uric acids and the method facilitated reliable assay of neurotransmitters in urine samples, and therefore, the pattern recognition showed high reliability (RSDneurotransmitters on biological fluids at a lower determination level than chromatographic methods. The sampling of the biological fluids referees only to the buffering (1:1, v/v) with a phosphate buffer pH 3.01, while for chromatographic methods the sampling is laborious. Accordingly with the statistic evaluation of the results at 99.00% confidence level, both modes can be used for pattern recognition and quantification of neurotransmitters with high reliability. The best multimode microsensor was the one based on diamond paste modified with protoporphyrin IX. Copyright © 2014 Elsevier B.V. All rights reserved.

A Multimodal Discourse Analysis of Advertisements-Based on Visual Grammar

Directory of Open Access Journals (Sweden)

Fang Guo

2017-03-01

Full Text Available In addition to words, the symbols, colors, sculptures, photographs, music, etc. are also frequently employed by participants to express themselves in communication. Advertising is closely related to sounds, colors, picture animations and other symbols. This paper aims to present how semiotics acts effectively to realize the real business purpose to reflect the unique significance of the multimodal discourse analysis. Based on Visual Grammar, this paper analyzes the 2014 Brazil World Cup advertisements from the perspective of representational meaning, interactive meaning and compositional meaning, this research means to prove that different modes within an advertisement depend on each other and have an interdependent relationship. And these relationships have different roles in different contexts.

Integrative Data Analysis of Multi-Platform Cancer Data with a Multimodal Deep Learning Approach.

Science.gov (United States)

Liang, Muxuan; Li, Zhizhong; Chen, Ting; Zeng, Jianyang

2015-01-01

Identification of cancer subtypes plays an important role in revealing useful insights into disease pathogenesis and advancing personalized therapy. The recent development of high-throughput sequencing technologies has enabled the rapid collection of multi-platform genomic data (e.g., gene expression, miRNA expression, and DNA methylation) for the same set of tumor samples. Although numerous integrative clustering approaches have been developed to analyze cancer data, few of them are particularly designed to exploit both deep intrinsic statistical properties of each input modality and complex cross-modality correlations among multi-platform input data. In this paper, we propose a new machine learning model, called multimodal deep belief network (DBN), to cluster cancer patients from multi-platform observation data. In our integrative clustering framework, relationships among inherent features of each single modality are first encoded into multiple layers of hidden variables, and then a joint latent model is employed to fuse common features derived from multiple input modalities. A practical learning algorithm, called contrastive divergence (CD), is applied to infer the parameters of our multimodal DBN model in an unsupervised manner. Tests on two available cancer datasets show that our integrative data analysis approach can effectively extract a unified representation of latent features to capture both intra- and cross-modality correlations, and identify meaningful disease subtypes from multi-platform cancer data. In addition, our approach can identify key genes and miRNAs that may play distinct roles in the pathogenesis of different cancer subtypes. Among those key miRNAs, we found that the expression level of miR-29a is highly correlated with survival time in ovarian cancer patients. These results indicate that our multimodal DBN based data analysis approach may have practical applications in cancer pathogenesis studies and provide useful guidelines for

Multimodal EEG Recordings, Psychometrics and Behavioural Analysis.

Science.gov (United States)

Boeijinga, Peter H

2015-01-01

High spatial and temporal resolution measurements of neuronal activity are preferably combined. In an overview on how this approach can take shape, multimodal electroencephalography (EEG) is treated in 2 main parts: by experiments without a task and in the experimentally cued working brain. It concentrates first on the alpha rhythm properties and next on data-driven search for patterns such as the default mode network. The high-resolution volumic distributions of neuronal metabolic indices result in distributed cortical regions and possibly relate to numerous nuclei, observable in a non-invasive manner in the central nervous system of humans. The second part deals with paradigms in which nowadays assessment of target-related networks can align level-dependent blood oxygenation, electrical responses and behaviour, taking the temporal resolution advantages of event-related potentials. Evidence-based electrical propagation in serial tasks during performance is now to a large extent attributed to interconnected pathways, particularly chronometry-dependent ones, throughout a chain including a dorsal stream, next ventral cortical areas taking the flow of information towards inferior temporal domains. The influence of aging is documented, and results of the first multimodal studies in neuropharmacology are consistent. Finally a scope on implementation of advanced clinical applications and personalized marker strategies in neuropsychiatry is indicated. © 2016 S. Karger AG, Basel.

Multi-modal RGB–Depth–Thermal Human Body Segmentation

DEFF Research Database (Denmark)

Palmero, Cristina; Clapés, Albert; Bahnsen, Chris

2016-01-01

This work addresses the problem of human body segmentation from multi-modal visual cues as a first stage of automatic human behavior analysis. We propose a novel RGB-Depth-Thermal dataset along with a multi-modal seg- mentation baseline. The several modalities are registered us- ing a calibration...... to other state-of-the-art meth- ods, obtaining an overlap above 75% on the novel dataset when compared to the manually annotated ground-truth of human segmentations....

Multimodal label-free microscopy

Directory of Open Access Journals (Sweden)

Nicolas Pavillon

2014-09-01

Full Text Available This paper reviews the different multimodal applications based on a large extent of label-free imaging modalities, ranging from linear to nonlinear optics, while also including spectroscopic measurements. We put specific emphasis on multimodal measurements going across the usual boundaries between imaging modalities, whereas most multimodal platforms combine techniques based on similar light interactions or similar hardware implementations. In this review, we limit the scope to focus on applications for biology such as live cells or tissues, since by their nature of being alive or fragile, we are often not free to take liberties with the image acquisition times and are forced to gather the maximum amount of information possible at one time. For such samples, imaging by a given label-free method usually presents a challenge in obtaining sufficient optical signal or is limited in terms of the types of observable targets. Multimodal imaging is then particularly attractive for these samples in order to maximize the amount of measured information. While multimodal imaging is always useful in the sense of acquiring additional information from additional modes, at times it is possible to attain information that could not be discovered using any single mode alone, which is the essence of the progress that is possible using a multimodal approach.

A Multimode Equivalent Network Approach for the Analysis of a 'Realistic' Finite Array of Open Ended Waveguides

NARCIS (Netherlands)

Neto, A.; Bolt, R.; Gerini, G.; Schmitt, D.

2003-01-01

In this contribution we present a theoretical model for the analysis of finite arrays of open-ended waveguides mounted on finite mounting platforms or having radome coverages. This model is based on a Multimode Equivalent Network (MEN) [1] representation of the radiating waveguides complete with

Constructing Israeli and Palestinian Identity: A Multimodal Critical Discourse Analysis of World History Textbooks and Teacher Discourse

Science.gov (United States)

Osborn, Daniel

2017-01-01

This research critically evaluates the depiction of Israelis and Palestinians in World History textbooks and World History teachers' instructional discourse. Employing a Multimodal Critical Discourse Analysis methodology, this study offers a comparison between written narratives and spoken discourse in order to analyze the portrayals found in…

The Multimodal Possibilities of Online Instructions

DEFF Research Database (Denmark)

Kampf, Constance

2006-01-01

The WWW simplifies the process of delivering online instructions through multimodal channels because of the ease of use for voice, video, pictures, and text modes of communication built into it.  Given that instructions are being produced in multimodal format for the WWW, how do multi-modal analy......The WWW simplifies the process of delivering online instructions through multimodal channels because of the ease of use for voice, video, pictures, and text modes of communication built into it.  Given that instructions are being produced in multimodal format for the WWW, how do multi...

A multimodal image sensor system for identifying water stress in grapevines

Science.gov (United States)

Zhao, Yong; Zhang, Qin; Li, Minzan; Shao, Yongni; Zhou, Jianfeng; Sun, Hong

2012-11-01

Water stress is one of the most common limitations of fruit growth. Water is the most limiting resource for crop growth. In grapevines, as well as in other fruit crops, fruit quality benefits from a certain level of water deficit which facilitates to balance vegetative and reproductive growth and the flow of carbohydrates to reproductive structures. A multi-modal sensor system was designed to measure the reflectance signature of grape plant surfaces and identify different water stress levels in this paper. The multi-modal sensor system was equipped with one 3CCD camera (three channels in R, G, and IR). The multi-modal sensor can capture and analyze grape canopy from its reflectance features, and identify the different water stress levels. This research aims at solving the aforementioned problems. The core technology of this multi-modal sensor system could further be used as a decision support system that combines multi-modal sensory data to improve plant stress detection and identify the causes of stress. The images were taken by multi-modal sensor which could output images in spectral bands of near-infrared, green and red channel. Based on the analysis of the acquired images, color features based on color space and reflectance features based on image process method were calculated. The results showed that these parameters had the potential as water stress indicators. More experiments and analysis are needed to validate the conclusion.

Study of internalization and viability of multimodal nanoparticles for labeling of human umbilical cord mesenchymal stem cells; Estudo de internalizacao e viabilidade de nanoparticulas multimodal para marcacao de celulas-tronco mesenquimais de cordao umbilical humano

Energy Technology Data Exchange (ETDEWEB)

Miyaki, Liza Aya Mabuchi [Faculdade de Enfermagem, Hospital Israelita Albert Einstein - HIAE, Sao Paulo, SP (Brazil); Sibov, Tatiana Tais; Pavon, Lorena Favaro; Mamani, Javier Bustamante; Gamarra, Lionel Fernel, E-mail: tatianats@einstein.br [Instituto do Cerebro - InCe, Hospital Israelita Albert Einstein - HIAE, Sao Paulo, SP (Brazil)

2012-04-15

Objective: To analyze multimodal magnetic nanoparticles-Rhodamine B in culture media for cell labeling, and to establish a study of multimodal magnetic nanoparticles-Rhodamine B detection at labeled cells evaluating they viability at concentrations of 10 {mu}g Fe/mL and 100{mu}g Fe/mL. Methods: We performed the analysis of stability of multimodal magnetic nanoparticles-Rhodamine B in different culture media; the mesenchymal stem cells labeling with multimodal magnetic nanoparticles-Rhodamine B; the intracellular detection of multimodal magnetic nanoparticles-Rhodamine B in mesenchymal stem cells, and assessment of the viability of labeled cells by kinetic proliferation. Results: The stability analysis showed that multimodal magnetic nanoparticles-Rhodamine B had good stability in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium. The mesenchymal stem cell with multimodal magnetic nanoparticles-Rhodamine B described location of intracellular nanoparticles, which were shown as blue granules co-localized in fluorescent clusters, thus characterizing magnetic and fluorescent properties of multimodal magnetic nanoparticles Rhodamine B. Conclusion: The stability of multimodal magnetic nanoparticles-Rhodamine B found in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium assured intracellular mesenchymal stem cells labeling. This cell labeling did not affect viability of labeled mesenchymal stem cells since they continued to proliferate for five days. (author)

Comprehensive analysis of transport aircraft flight performance

Science.gov (United States)

Filippone, Antonio

2008-04-01

This paper reviews the state-of-the art in comprehensive performance codes for fixed-wing aircraft. The importance of system analysis in flight performance is discussed. The paper highlights the role of aerodynamics, propulsion, flight mechanics, aeroacoustics, flight operation, numerical optimisation, stochastic methods and numerical analysis. The latter discipline is used to investigate the sensitivities of the sub-systems to uncertainties in critical state parameters or functional parameters. The paper discusses critically the data used for performance analysis, and the areas where progress is required. Comprehensive analysis codes can be used for mission fuel planning, envelope exploration, competition analysis, a wide variety of environmental studies, marketing analysis, aircraft certification and conceptual aircraft design. A comprehensive program that uses the multi-disciplinary approach for transport aircraft is presented. The model includes a geometry deck, a separate engine input deck with the main parameters, a database of engine performance from an independent simulation, and an operational deck. The comprehensive code has modules for deriving the geometry from bitmap files, an aerodynamics model for all flight conditions, a flight mechanics model for flight envelopes and mission analysis, an aircraft noise model and engine emissions. The model is validated at different levels. Validation of the aerodynamic model is done against the scale models DLR-F4 and F6. A general model analysis and flight envelope exploration are shown for the Boeing B-777-300 with GE-90 turbofan engines with intermediate passenger capacity (394 passengers in 2 classes). Validation of the flight model is done by sensitivity analysis on the wetted area (or profile drag), on the specific air range, the brake-release gross weight and the aircraft noise. A variety of results is shown, including specific air range charts, take-off weight-altitude charts, payload-range performance

Analyzing Multimode Wireless Sensor Networks Using the Network Calculus

Directory of Open Access Journals (Sweden)

Xi Jin

2015-01-01

Full Text Available The network calculus is a powerful tool to analyze the performance of wireless sensor networks. But the original network calculus can only model the single-mode wireless sensor network. In this paper, we combine the original network calculus with the multimode model to analyze the maximum delay bound of the flow of interest in the multimode wireless sensor network. There are two combined methods A-MM and N-MM. The method A-MM models the whole network as a multimode component, and the method N-MM models each node as a multimode component. We prove that the maximum delay bound computed by the method A-MM is tighter than or equal to that computed by the method N-MM. Experiments show that our proposed methods can significantly decrease the analytical delay bound comparing with the separate flow analysis method. For the large-scale wireless sensor network with 32 thousands of sensor nodes, our proposed methods can decrease about 70% of the analytical delay bound.

Multimodal Representations: A Fifth-Grade Teacher Influences Students' Design and Production

Science.gov (United States)

Shanahan, Lynn E.

2013-01-01

The purpose of this interpretive case study is to explore--through a close analysis of one fifth-grade class project--teacher's scaffolding and students' use of visual and linguistic modes when composing multimodally. Using Kress and van Leeuwen's multimodal theory of communication as a framework, this case study examines why teachers, whose…

Application of Multimodality Imaging Fusion Technology in Diagnosis and Treatment of Malignant Tumors under the Precision Medicine Plan.

Science.gov (United States)

Wang, Shun-Yi; Chen, Xian-Xia; Li, Yi; Zhang, Yu-Ying

2016-12-20

The arrival of precision medicine plan brings new opportunities and challenges for patients undergoing precision diagnosis and treatment of malignant tumors. With the development of medical imaging, information on different modality imaging can be integrated and comprehensively analyzed by imaging fusion system. This review aimed to update the application of multimodality imaging fusion technology in the precise diagnosis and treatment of malignant tumors under the precision medicine plan. We introduced several multimodality imaging fusion technologies and their application to the diagnosis and treatment of malignant tumors in clinical practice. The data cited in this review were obtained mainly from the PubMed database from 1996 to 2016, using the keywords of "precision medicine", "fusion imaging", "multimodality", and "tumor diagnosis and treatment". Original articles, clinical practice, reviews, and other relevant literatures published in English were reviewed. Papers focusing on precision medicine, fusion imaging, multimodality, and tumor diagnosis and treatment were selected. Duplicated papers were excluded. Multimodality imaging fusion technology plays an important role in tumor diagnosis and treatment under the precision medicine plan, such as accurate location, qualitative diagnosis, tumor staging, treatment plan design, and real-time intraoperative monitoring. Multimodality imaging fusion systems could provide more imaging information of tumors from different dimensions and angles, thereby offing strong technical support for the implementation of precision oncology. Under the precision medicine plan, personalized treatment of tumors is a distinct possibility. We believe that multimodality imaging fusion technology will find an increasingly wide application in clinical practice.

Multimodality imaging techniques.

Science.gov (United States)

Martí-Bonmatí, Luis; Sopena, Ramón; Bartumeus, Paula; Sopena, Pablo

2010-01-01

In multimodality imaging, the need to combine morphofunctional information can be approached by either acquiring images at different times (asynchronous), and fused them through digital image manipulation techniques or simultaneously acquiring images (synchronous) and merging them automatically. The asynchronous post-processing solution presents various constraints, mainly conditioned by the different positioning of the patient in the two scans acquired at different times in separated machines. The best solution to achieve consistency in time and space is obtained by the synchronous image acquisition. There are many multimodal technologies in molecular imaging. In this review we will focus on those multimodality image techniques more commonly used in the field of diagnostic imaging (SPECT-CT, PET-CT) and new developments (as PET-MR). The technological innovations and development of new tracers and smart probes are the main key points that will condition multimodality image and diagnostic imaging professionals' future. Although SPECT-CT and PET-CT are standard in most clinical scenarios, MR imaging has some advantages, providing excellent soft-tissue contrast and multidimensional functional, structural and morphological information. The next frontier is to develop efficient detectors and electronics systems capable of detecting two modality signals at the same time. Not only PET-MR but also MR-US or optic-PET will be introduced in clinical scenarios. Even more, MR diffusion-weighted, pharmacokinetic imaging, spectroscopy or functional BOLD imaging will merge with PET tracers to further increase molecular imaging as a relevant medical discipline. Multimodality imaging techniques will play a leading role in relevant clinical applications. The development of new diagnostic imaging research areas, mainly in the field of oncology, cardiology and neuropsychiatry, will impact the way medicine is performed today. Both clinical and experimental multimodality studies, in

Multimodality Registration without a Dedicated Multimodality Scanner

Directory of Open Access Journals (Sweden)

Bradley J. Beattie

2007-03-01

Full Text Available Multimodality scanners that allow the acquisition of both functional and structural image sets on a single system have recently become available for animal research use. Although the resultant registered functional/structural image sets can greatly enhance the interpretability of the functional data, the cost of multimodality systems can be prohibitive, and they are often limited to two modalities, which generally do not include magnetic resonance imaging. Using a thin plastic wrap to immobilize and fix a mouse or other small animal atop a removable bed, we are able to calculate registrations between all combinations of four different small animal imaging scanners (positron emission tomography, single-photon emission computed tomography, magnetic resonance, and computed tomography [CT] at our disposal, effectively equivalent to a quadruple-modality scanner. A comparison of serially acquired CT images, with intervening acquisitions on other scanners, demonstrates the ability of the proposed procedures to maintain the rigidity of an anesthetized mouse during transport between scanners. Movement of the bony structures of the mouse was estimated to be 0.62 mm. Soft tissue movement was predominantly the result of the filling (or emptying of the urinary bladder and thus largely constrained to this region. Phantom studies estimate the registration errors for all registration types to be less than 0.5 mm. Functional images using tracers targeted to known structures verify the accuracy of the functional to structural registrations. The procedures are easy to perform and produce robust and accurate results that rival those of dedicated multimodality scanners, but with more flexible registration combinations and while avoiding the expense and redundancy of multimodality systems.

A System for the Semantic Multimodal Analysis of News Audio-Visual Content

Directory of Open Access Journals (Sweden)

Michael G. Strintzis

2010-01-01

Full Text Available News-related content is nowadays among the most popular types of content for users in everyday applications. Although the generation and distribution of news content has become commonplace, due to the availability of inexpensive media capturing devices and the development of media sharing services targeting both professional and user-generated news content, the automatic analysis and annotation that is required for supporting intelligent search and delivery of this content remains an open issue. In this paper, a complete architecture for knowledge-assisted multimodal analysis of news-related multimedia content is presented, along with its constituent components. The proposed analysis architecture employs state-of-the-art methods for the analysis of each individual modality (visual, audio, text separately and proposes a novel fusion technique based on the particular characteristics of news-related content for the combination of the individual modality analysis results. Experimental results on news broadcast video illustrate the usefulness of the proposed techniques in the automatic generation of semantic annotations.

Bi-objective optimization for multi-modal transportation routing planning problem based on Pareto optimality

Directory of Open Access Journals (Sweden)

Yan Sun

2015-09-01

Full Text Available Purpose: The purpose of study is to solve the multi-modal transportation routing planning problem that aims to select an optimal route to move a consignment of goods from its origin to its destination through the multi-modal transportation network. And the optimization is from two viewpoints including cost and time. Design/methodology/approach: In this study, a bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. Minimizing the total transportation cost and the total transportation time are set as the optimization objectives of the model. In order to balance the benefit between the two objectives, Pareto optimality is utilized to solve the model by gaining its Pareto frontier. The Pareto frontier of the model can provide the multi-modal transportation operator (MTO and customers with better decision support and it is gained by the normalized normal constraint method. Then, an experimental case study is designed to verify the feasibility of the model and Pareto optimality by using the mathematical programming software Lingo. Finally, the sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case. Findings: The calculation results indicate that the proposed model and Pareto optimality have good performance in dealing with the bi-objective optimization. The sensitivity analysis also shows the influence of the variation of the demand and supply on the multi-modal transportation organization clearly. Therefore, this method can be further promoted to the practice. Originality/value: A bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. The Pareto frontier based sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case.

Advanced complex analysis a comprehensive course in analysis, part 2b

CERN Document Server

Simon, Barry

2015-01-01

A Comprehensive Course in Analysis by Poincaré Prize winner Barry Simon is a five-volume set that can serve as a graduate-level analysis textbook with a lot of additional bonus information, including hundreds of problems and numerous notes that extend the text and provide important historical background. Depth and breadth of exposition make this set a valuable reference source for almost all areas of classical analysis. Part 2B provides a comprehensive look at a number of subjects of complex analysis not included in Part 2A. Presented in this volume are the theory of conformal metrics (includ

Multimodal fluorescence imaging spectroscopy

NARCIS (Netherlands)

Stopel, Martijn H W; Blum, Christian; Subramaniam, Vinod; Engelborghs, Yves; Visser, Anthonie J.W.G.

2014-01-01

Multimodal fluorescence imaging is a versatile method that has a wide application range from biological studies to materials science. Typical observables in multimodal fluorescence imaging are intensity, lifetime, excitation, and emission spectra which are recorded at chosen locations at the sample.

Study of internalization and viability of multimodal nanoparticles for labeling of human umbilical cord mesenchymal stem cells

International Nuclear Information System (INIS)

Miyaki, Liza Aya Mabuchi; Sibov, Tatiana Tais; Pavon, Lorena Favaro; Mamani, Javier Bustamante; Gamarra, Lionel Fernel

2012-01-01

Objective: To analyze multimodal magnetic nanoparticles-Rhodamine B in culture media for cell labeling, and to establish a study of multimodal magnetic nanoparticles-Rhodamine B detection at labeled cells evaluating they viability at concentrations of 10 μg Fe/mL and 100μg Fe/mL. Methods: We performed the analysis of stability of multimodal magnetic nanoparticles-Rhodamine B in different culture media; the mesenchymal stem cells labeling with multimodal magnetic nanoparticles-Rhodamine B; the intracellular detection of multimodal magnetic nanoparticles-Rhodamine B in mesenchymal stem cells, and assessment of the viability of labeled cells by kinetic proliferation. Results: The stability analysis showed that multimodal magnetic nanoparticles-Rhodamine B had good stability in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium. The mesenchymal stem cell with multimodal magnetic nanoparticles-Rhodamine B described location of intracellular nanoparticles, which were shown as blue granules co-localized in fluorescent clusters, thus characterizing magnetic and fluorescent properties of multimodal magnetic nanoparticles Rhodamine B. Conclusion: The stability of multimodal magnetic nanoparticles-Rhodamine B found in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium assured intracellular mesenchymal stem cells labeling. This cell labeling did not affect viability of labeled mesenchymal stem cells since they continued to proliferate for five days. (author)

Juveniles' Miranda comprehension: Understanding, appreciation, and totality of circumstances factors.

Science.gov (United States)

Zelle, Heather; Romaine, Christina L Riggs; Goldstein, Naomi E S

2015-06-01

This study examined juvenile justice-involved youths' understanding and appreciation of the Miranda warnings' rights to silence and legal counsel using the Miranda Rights Comprehension Instruments (Goldstein, Zelle, & Grisso, 2012). It also examined the relationships between totality of circumstances factors and understanding and appreciation of rights. Data were collected from 183 youths (140 boys) in pre- and postadjudication facilities in 2 states. Overall, youths demonstrated greater difficulty on measures of appreciation than understanding, with particular deficits in their abilities to comprehend the abstract concept of the right to silence. Results varied slightly by instrument, highlighting the importance of a multimodal assessment of these complex abilities. Examination of totality of circumstances factors identified relationships between some factors (e.g., age, verbal IQ, academic achievement) and Miranda comprehension, but revealed that other factors (e.g., gender, number of previous arrests) were not significantly related to Miranda understanding or appreciation. The findings support a nuanced conceptualization of Miranda rights comprehension that acknowledges the complexity of understanding and appreciating the warnings. Empirical analyses also support the continued use of some totality of circumstances factors and abandonment of others. Findings underscore the necessity of multimodal assessment and interpretation when conducting capacity to waive Miranda rights evaluations. (c) 2015 APA, all rights reserved).

Analysis of the harmonic and intermodulation distortion in a multimode fiber optic link.

Science.gov (United States)

Gasulla, I; Capmany, J

2007-07-23

We present an analytical evaluation of the harmonic and the intermodulation distortion effects produced in the transmission of an analog signal composed of various RF tones through a multimode fiber link. It is based on the electric field propagation model previously published by the authors. Results show the possibility of implementing subcarrier multiplexing techniques (SCM) with Composite Second Order (CSO) values below -50 dBc over short and middle reach multimode fiber links.

Inorganic Nanoparticles for Multimodal Molecular Imaging

Directory of Open Access Journals (Sweden)

Magdalena Swierczewska

2011-01-01

Full Text Available Multimodal molecular imaging can offer a synergistic improvement of diagnostic ability over a single imaging modality. Recent development of hybrid imaging systems has profoundly impacted the pool of available multimodal imaging probes. In particular, much interest has been focused on biocompatible, inorganic nanoparticle-based multimodal probes. Inorganic nanoparticles offer exceptional advantages to the field of multimodal imaging owing to their unique characteristics, such as nanometer dimensions, tunable imaging properties, and multifunctionality. Nanoparticles mainly based on iron oxide, quantum dots, gold, and silica have been applied to various imaging modalities to characterize and image specific biologic processes on a molecular level. A combination of nanoparticles and other materials such as biomolecules, polymers, and radiometals continue to increase functionality for in vivo multimodal imaging and therapeutic agents. In this review, we discuss the unique concepts, characteristics, and applications of the various multimodal imaging probes based on inorganic nanoparticles.

A Multimodal Data Analysis Approach for Targeted Drug Discovery Involving Topological Data Analysis (TDA).

Science.gov (United States)

Alagappan, Muthuraman; Jiang, Dadi; Denko, Nicholas; Koong, Albert C

In silico drug discovery refers to a combination of computational techniques that augment our ability to discover drug compounds from compound libraries. Many such techniques exist, including virtual high-throughput screening (vHTS), high-throughput screening (HTS), and mechanisms for data storage and querying. However, presently these tools are often used independent of one another. In this chapter, we describe a new multimodal in silico technique for the hit identification and lead generation phases of traditional drug discovery. Our technique leverages the benefits of three independent methods-virtual high-throughput screening, high-throughput screening, and structural fingerprint analysis-by using a fourth technique called topological data analysis (TDA). We describe how a compound library can be independently tested with vHTS, HTS, and fingerprint analysis, and how the results can be transformed into a topological data analysis network to identify compounds from a diverse group of structural families. This process of using TDA or similar clustering methods to identify drug leads is advantageous because it provides a mechanism for choosing structurally diverse compounds while maintaining the unique advantages of already established techniques such as vHTS and HTS.

Exploring Multimodal Registers in and Across Organizations and Institutional Fields

DEFF Research Database (Denmark)

Meyer, Renate; Jancsary, Dennis; Höllerer, Markus

In this article, we develop methodology that enables a systematic analysis of the structuralaspects of multimodal discourse from larger amounts of data. While existing research in visualorganization studies has provided interesting insights into the content and meaning(s) of visualand multimodal ......Responsibility (CSR), a complex and multivocal management idea that touches a variety oftopics and incorporates multiple levels of audience engagement with regard to a substantialdiversity of audiences....

Multimode optical dermoscopy (SkinSpect) analysis for skin with melanocytic nevus

Science.gov (United States)

Vasefi, Fartash; MacKinnon, Nicholas; Saager, Rolf; Kelly, Kristen M.; Maly, Tyler; Chave, Robert; Booth, Nicholas; Durkin, Anthony J.; Farkas, Daniel L.

2016-04-01

We have developed a multimode dermoscope (SkinSpect™) capable of illuminating human skin samples in-vivo with spectrally-programmable linearly-polarized light at 33 wavelengths between 468nm and 857 nm. Diffusely reflected photons are separated into collinear and cross-polarized image paths and images captured for each illumination wavelength. In vivo human skin nevi (N = 20) were evaluated with the multimode dermoscope and melanin and hemoglobin concentrations were compared with Spatially Modulated Quantitative Spectroscopy (SMoQS) measurements. Both systems show low correlation between their melanin and hemoglobin concentrations, demonstrating the ability of the SkinSpect™ to separate these molecular signatures and thus act as a biologically plausible device capable of early onset melanoma detection.

The anterior temporal lobes support residual comprehension in Wernicke's aphasia.

Science.gov (United States)

Robson, Holly; Zahn, Roland; Keidel, James L; Binney, Richard J; Sage, Karen; Lambon Ralph, Matthew A

2014-03-01

Wernicke's aphasia occurs after a stroke to classical language comprehension regions in the left temporoparietal cortex. Consequently, auditory-verbal comprehension is significantly impaired in Wernicke's aphasia but the capacity to comprehend visually presented materials (written words and pictures) is partially spared. This study used functional magnetic resonance imaging to investigate the neural basis of written word and picture semantic processing in Wernicke's aphasia, with the wider aim of examining how the semantic system is altered after damage to the classical comprehension regions. Twelve participants with chronic Wernicke's aphasia and 12 control participants performed semantic animate-inanimate judgements and a visual height judgement baseline task. Whole brain and region of interest analysis in Wernicke's aphasia and control participants found that semantic judgements were underpinned by activation in the ventral and anterior temporal lobes bilaterally. The Wernicke's aphasia group displayed an 'over-activation' in comparison with control participants, indicating that anterior temporal lobe regions become increasingly influential following reduction in posterior semantic resources. Semantic processing of written words in Wernicke's aphasia was additionally supported by recruitment of the right anterior superior temporal lobe, a region previously associated with recovery from auditory-verbal comprehension impairments. Overall, the results provide support for models in which the anterior temporal lobes are crucial for multimodal semantic processing and that these regions may be accessed without support from classic posterior comprehension regions.

Practical multimodal care for cancer cachexia.

Science.gov (United States)

Maddocks, Matthew; Hopkinson, Jane; Conibear, John; Reeves, Annie; Shaw, Clare; Fearon, Ken C H

2016-12-01

Cancer cachexia is common and reduces function, treatment tolerability and quality of life. Given its multifaceted pathophysiology a multimodal approach to cachexia management is advocated for, but can be difficult to realise in practice. We use a case-based approach to highlight practical approaches to the multimodal management of cachexia for patients across the cancer trajectory. Four cases with lung cancer spanning surgical resection, radical chemoradiotherapy, palliative chemotherapy and no anticancer treatment are presented. We propose multimodal care approaches that incorporate nutritional support, exercise, and anti-inflammatory agents, on a background of personalized oncology care and family-centred education. Collectively, the cases reveal that multimodal care is part of everyone's remit, often focuses on supported self-management, and demands buy-in from the patient and their family. Once operationalized, multimodal care approaches can be tested pragmatically, including alongside emerging pharmacological cachexia treatments. We demonstrate that multimodal care for cancer cachexia can be achieved using simple treatments and without a dedicated team of specialists. The sharing of advice between health professionals can help build collective confidence and expertise, moving towards a position in which every team member feels they can contribute towards multimodal care.

Operative and economic evaluation of a 'Laser Printer Multimodality' System

International Nuclear Information System (INIS)

Battaglia, G.; Moscatelli, G.; Maroldi, R.; Chiesa, A.

1991-01-01

The increasing application of digital techniques to diagnostic imaging is causing significant changes in several related activities, such as a reproduction of digital images on film. In the Department of Diagnostic Imaging of the University of Brescia, about 70% of the whole of images are produced by digital techniques; at present, most of these images are reproduced on film with a Multimodality System interfacing CT, MR, DSA, and DR units with a single laser printer. Our analysis evaluates the operative and economics aspects of image reproduction, by comparing the 'single cassette' multiformat Camera and the Laser Printer Multimodality SAystem. Our results point out the advantages obtained by reproducing images with a Laser Printer Multimodality System: outstanding quality, reproduction of multiple originals, and marked reduction in the time needed for both image archiving and film handling. The Laser Printer Multimodality System allows over 5 hours/day to be saved -that is to say the working day of an operator, who can be thus shifted to other functions. The important economic aspect of the reproduction of digital images on film proves the Laser Printer Multimodality System to have some advantage over Cameras

COMAN: a web server for comprehensive metatranscriptomics analysis.

Science.gov (United States)

Ni, Yueqiong; Li, Jun; Panagiotou, Gianni

2016-08-11

Microbiota-oriented studies based on metagenomic or metatranscriptomic sequencing have revolutionised our understanding on microbial ecology and the roles of both clinical and environmental microbes. The analysis of massive metatranscriptomic data requires extensive computational resources, a collection of bioinformatics tools and expertise in programming. We developed COMAN (Comprehensive Metatranscriptomics Analysis), a web-based tool dedicated to automatically and comprehensively analysing metatranscriptomic data. COMAN pipeline includes quality control of raw reads, removal of reads derived from non-coding RNA, followed by functional annotation, comparative statistical analysis, pathway enrichment analysis, co-expression network analysis and high-quality visualisation. The essential data generated by COMAN are also provided in tabular format for additional analysis and integration with other software. The web server has an easy-to-use interface and detailed instructions, and is freely available at http://sbb.hku.hk/COMAN/ CONCLUSIONS: COMAN is an integrated web server dedicated to comprehensive functional analysis of metatranscriptomic data, translating massive amount of reads to data tables and high-standard figures. It is expected to facilitate the researchers with less expertise in bioinformatics in answering microbiota-related biological questions and to increase the accessibility and interpretation of microbiota RNA-Seq data.

Revisiting persuasion in oral academic and professional genres: Towards a methodological framework for Multimodal Discourse Analysis of research dissemination talks

Directory of Open Access Journals (Sweden)

Julia Valeiras-Jurado

2018-04-01

Full Text Available Previous work on oral genres (Kress & Van Leeuwen, 2001; Kress, 2010; Bateman, 2011 as well as on persuasion (O’Keefe, 2002; Perloff, 2003; Poggi & Pelachaud, 2008 has indicated that effective persuasive oral communication depends heavily on the use of a wide range of different semiotic modes including words, gestures and intonation. However, little attention has been paid so far to how speakers convey their communicative intentions orchestrating different modes into a coherent multimodal ensemble (Kress, 2010. In this paper we propose a methodological framework for Multimodal Discourse Analysis (MDA of persuasion in oral academic and professional genres. Drawing on previous studies on persuasion (Fuertes-Olivera et al., 2001; O’Keefe, 2002; Perloff, 2003; Virtanen & Halmari, 2005; Dafouz-Milne, 2008, our framework combines earlier proposals for MDA (Querol-Julián, 2011; Querol-Julián & Fortanet-Gómez, 2014 with an ethnographic perspective (Rubin & Rubin, 1995. Our study focuses specifically on the analysis of persuasive strategies used in dissemination talks. The proposed MDA caters for the following modes: words, intonation, head movements and gestures. Preliminary findings hint at a relation between persuasion and so-called modal density (Norris, 2004. Finally, we propose a tentative taxonomy of persuasive strategies and how they are realised multimodally.

Could a Multimodal Dictionary Serve as a Learning Tool? An Examination of the Impact of Technologically Enhanced Visual Glosses on L2 Text Comprehension

Science.gov (United States)

Sato, Takeshi

2016-01-01

This study examines the efficacy of a multimodal online bilingual dictionary based on cognitive linguistics in order to explore the advantages and limitations of explicit multimodal L2 vocabulary learning. Previous studies have examined the efficacy of the verbal and visual representation of words while reading L2 texts, concluding that it…

Outcome of transarterial chemoembolization-based multi-modal treatment in patients with unresectable hepatocellular carcinoma.

Science.gov (United States)

Song, Do Seon; Nam, Soon Woo; Bae, Si Hyun; Kim, Jin Dong; Jang, Jeong Won; Song, Myeong Jun; Lee, Sung Won; Kim, Hee Yeon; Lee, Young Joon; Chun, Ho Jong; You, Young Kyoung; Choi, Jong Young; Yoon, Seung Kew

2015-02-28

To investigate the efficacy and safety of transarterial chemoembolization (TACE)-based multimodal treatment in patients with large hepatocellular carcinoma (HCC). A total of 146 consecutive patients were included in the analysis, and their medical records and radiological data were reviewed retrospectively. In total, 119 patients received TACE-based multi-modal treatments, and the remaining 27 received conservative management. Overall survival (P<0.001) and objective tumor response (P=0.003) were significantly better in the treatment group than in the conservative group. After subgroup analysis, survival benefits were observed not only in the multi-modal treatment group compared with the TACE-only group (P=0.002) but also in the surgical treatment group compared with the loco-regional treatment-only group (P<0.001). Multivariate analysis identified tumor stage (P<0.001) and tumor type (P=0.009) as two independent pre-treatment factors for survival. After adjusting for significant pre-treatment prognostic factors, objective response (P<0.001), surgical treatment (P=0.009), and multi-modal treatment (P=0.002) were identified as independent post-treatment prognostic factors. TACE-based multi-modal treatments were safe and more beneficial than conservative management. Salvage surgery after successful downstaging resulted in long-term survival in patients with large, unresectable HCC.

A Learning Algorithm for Multimodal Grammar Inference.

Science.gov (United States)

D'Ulizia, A; Ferri, F; Grifoni, P

2011-12-01

The high costs of development and maintenance of multimodal grammars in integrating and understanding input in multimodal interfaces lead to the investigation of novel algorithmic solutions in automating grammar generation and in updating processes. Many algorithms for context-free grammar inference have been developed in the natural language processing literature. An extension of these algorithms toward the inference of multimodal grammars is necessary for multimodal input processing. In this paper, we propose a novel grammar inference mechanism that allows us to learn a multimodal grammar from its positive samples of multimodal sentences. The algorithm first generates the multimodal grammar that is able to parse the positive samples of sentences and, afterward, makes use of two learning operators and the minimum description length metrics in improving the grammar description and in avoiding the over-generalization problem. The experimental results highlight the acceptable performances of the algorithm proposed in this paper since it has a very high probability of parsing valid sentences.

Multidimensional and Multimodal Separations by HPTLC in Phytochemistry

Science.gov (United States)

Ciesla, Lukasz; Waksmundzka-Hajnos, Monika

HPTLC is one of the most widely applied methods in phytochemical analysis. It is due to its numerous advantages, e.g., it is the only chromatographic method offering the option of presenting the results as an image. Other advantages include simplicity, low costs, parallel analysis of samples, high sample capacity, rapidly obtained results, and possibility of multiple detection. HPTLC provides identification as well as quantitative results. It also enables the identification of adulterants. In case of complex samples, the resolving power of traditional one-dimensional chromatography is usually inadequate, hence special modes of development are required. Multidimensional and multimodal HPTLC techniques include those realized in one direction (UMD, IMD, GMD, BMD, AMD) as well as typical two-dimensional methods realized on mono- or bi-layers. In this manuscript, an overview on variable multidimensional and multimodal methods, applied in the analysis of phytochemical samples, is presented.

Mode analysis of heuristic behavior of searching for multimodal optimum point

Energy Technology Data Exchange (ETDEWEB)

Kamei, K; Araki, Y; Inoue, K

1982-01-01

Describes an experimental study of a heuristic behavior of searching for the global optimum (maximum) point of a two-dimensional, multimodal, nonlinear and unknown function. First, the authors define three modes dealing with the trial purposes, called the purpose modes and show the heuristic search behaviors expressed by the purpose modes which the human subjects select in the search experiments. Second, the authors classify the heuristic search behaviors into three types according to the mode transitions and extracts eight states of searches which cause the mode transitions. Third, a model of the heuristic search behavior is composed of the eight mode transitions. The analysis of the heuristic search behaviors by use of the purpose modes plays an important role in the heuristic search techniques. 6 references.

VoxelStats: A MATLAB Package for Multi-Modal Voxel-Wise Brain Image Analysis.

Science.gov (United States)

Mathotaarachchi, Sulantha; Wang, Seqian; Shin, Monica; Pascoal, Tharick A; Benedet, Andrea L; Kang, Min Su; Beaudry, Thomas; Fonov, Vladimir S; Gauthier, Serge; Labbe, Aurélie; Rosa-Neto, Pedro

2016-01-01

In healthy individuals, behavioral outcomes are highly associated with the variability on brain regional structure or neurochemical phenotypes. Similarly, in the context of neurodegenerative conditions, neuroimaging reveals that cognitive decline is linked to the magnitude of atrophy, neurochemical declines, or concentrations of abnormal protein aggregates across brain regions. However, modeling the effects of multiple regional abnormalities as determinants of cognitive decline at the voxel level remains largely unexplored by multimodal imaging research, given the high computational cost of estimating regression models for every single voxel from various imaging modalities. VoxelStats is a voxel-wise computational framework to overcome these computational limitations and to perform statistical operations on multiple scalar variables and imaging modalities at the voxel level. VoxelStats package has been developed in Matlab(®) and supports imaging formats such as Nifti-1, ANALYZE, and MINC v2. Prebuilt functions in VoxelStats enable the user to perform voxel-wise general and generalized linear models and mixed effect models with multiple volumetric covariates. Importantly, VoxelStats can recognize scalar values or image volumes as response variables and can accommodate volumetric statistical covariates as well as their interaction effects with other variables. Furthermore, this package includes built-in functionality to perform voxel-wise receiver operating characteristic analysis and paired and unpaired group contrast analysis. Validation of VoxelStats was conducted by comparing the linear regression functionality with existing toolboxes such as glim_image and RMINC. The validation results were identical to existing methods and the additional functionality was demonstrated by generating feature case assessments (t-statistics, odds ratio, and true positive rate maps). In summary, VoxelStats expands the current methods for multimodal imaging analysis by allowing the

Construction of Common Interpretive Spaces through Intertextual Loops--How Teachers Interpret Multimodal Learning Materials

Science.gov (United States)

Poyas, Yael; Eilam, Billie

2012-01-01

This study draws on several theoretical domains: intertextuality, multimodality, and the pedagogy of multiliteracies. We introduced multimodal textbook materials to eleven experienced teachers and examined, through in-depth interviews, their approach to juxtapositions of literary texts and visual artwork. Our analysis revealed (a) three attitudes…

Multimodal sequence learning.

Science.gov (United States)

Kemény, Ferenc; Meier, Beat

2016-02-01

While sequence learning research models complex phenomena, previous studies have mostly focused on unimodal sequences. The goal of the current experiment is to put implicit sequence learning into a multimodal context: to test whether it can operate across different modalities. We used the Task Sequence Learning paradigm to test whether sequence learning varies across modalities, and whether participants are able to learn multimodal sequences. Our results show that implicit sequence learning is very similar regardless of the source modality. However, the presence of correlated task and response sequences was required for learning to take place. The experiment provides new evidence for implicit sequence learning of abstract conceptual representations. In general, the results suggest that correlated sequences are necessary for implicit sequence learning to occur. Moreover, they show that elements from different modalities can be automatically integrated into one unitary multimodal sequence. Copyright © 2015 Elsevier B.V. All rights reserved.

Knowledge translation in health care as a multimodal interactional accomplishment

DEFF Research Database (Denmark)

Kjær, Malene

2014-01-01

of their education where they are in clinical practice. The analysis is made possible through video recordings of how student nurses translate their theoretical knowledge into a professional situational conduct in everyday interactional accomplishments among supervisors and patients. The analysis shows how some......In the theory of health care, knowledge translation is regarded as a crucial phenomenon that makes the whole health care system work in a desired manner. The present paper studies knowledge translation from the student nurses’ perspective and does that through a close analysis of the part...... knowledge gets translated through the use of rich multimodal embodied interactions, whereas the more abstract aspects of knowledge remain untranslated. Overall, the study contributes to the understanding of knowledge translation as a multimodal, locally situated accomplishment....

Adhesion of multimode adhesives to enamel and dentin after one year of water storage.

Science.gov (United States)

Vermelho, Paulo Moreira; Reis, André Figueiredo; Ambrosano, Glaucia Maria Bovi; Giannini, Marcelo

2017-06-01

This study aimed to evaluate the ultramorphological characteristics of tooth-resin interfaces and the bond strength (BS) of multimode adhesive systems to enamel and dentin. Multimode adhesives (Scotchbond Universal (SBU) and All-Bond Universal) were tested in both self-etch and etch-and-rinse modes and compared to control groups (Optibond FL and Clearfil SE Bond (CSB)). Adhesives were applied to human molars and composite blocks were incrementally built up. Teeth were sectioned to obtain specimens for microtensile BS and TEM analysis. Specimens were tested after storage for either 24 h or 1 year. SEM analyses were performed to classify the failure pattern of beam specimens after BS testing. Etching increased the enamel BS of multimode adhesives; however, BS decreased after storage for 1 year. No significant differences in dentin BS were noted between multimode and control in either evaluation period. Storage for 1 year only reduced the dentin BS for SBU in self-etch mode. TEM analysis identified hybridization and interaction zones in dentin and enamel for all adhesives. Silver impregnation was detected on dentin-resin interfaces after storage of specimens for 1 year only with the SBU and CSB. Storage for 1 year reduced enamel BS when adhesives are applied on etched surface; however, BS of multimode adhesives did not differ from those of the control group. In dentin, no significant difference was noted between the multimode and control group adhesives, regardless of etching mode. In general, multimode adhesives showed similar behavior when compared to traditional adhesive techniques. Multimode adhesives are one-step self-etching adhesives that can also be used after enamel/dentin phosphoric acid etching, but each product may work better in specific conditions.

A Novel Multimodal Biometrics Recognition Model Based on Stacked ELM and CCA Methods

Directory of Open Access Journals (Sweden)

Jucheng Yang

2018-04-01

Full Text Available Multimodal biometrics combine a variety of biological features to have a significant impact on identification performance, which is a newly developed trend in biometrics identification technology. This study proposes a novel multimodal biometrics recognition model based on the stacked extreme learning machines (ELMs and canonical correlation analysis (CCA methods. The model, which has a symmetric structure, is found to have high potential for multimodal biometrics. The model works as follows. First, it learns the hidden-layer representation of biological images using extreme learning machines layer by layer. Second, the canonical correlation analysis method is applied to map the representation to a feature space, which is used to reconstruct the multimodal image feature representation. Third, the reconstructed features are used as the input of a classifier for supervised training and output. To verify the validity and efficiency of the method, we adopt it for new hybrid datasets obtained from typical face image datasets and finger-vein image datasets. Our experimental results demonstrate that our model performs better than traditional methods.

Multimodal functional network connectivity: an EEG-fMRI fusion in network space.

Directory of Open Access Journals (Sweden)

Xu Lei

Full Text Available EEG and fMRI recordings measure the functional activity of multiple coherent networks distributed in the cerebral cortex. Identifying network interaction from the complementary neuroelectric and hemodynamic signals may help to explain the complex relationships between different brain regions. In this paper, multimodal functional network connectivity (mFNC is proposed for the fusion of EEG and fMRI in network space. First, functional networks (FNs are extracted using spatial independent component analysis (ICA in each modality separately. Then the interactions among FNs in each modality are explored by Granger causality analysis (GCA. Finally, fMRI FNs are matched to EEG FNs in the spatial domain using network-based source imaging (NESOI. Investigations of both synthetic and real data demonstrate that mFNC has the potential to reveal the underlying neural networks of each modality separately and in their combination. With mFNC, comprehensive relationships among FNs might be unveiled for the deep exploration of neural activities and metabolic responses in a specific task or neurological state.

[Multimodal medical image registration using cubic spline interpolation method].

Science.gov (United States)

He, Yuanlie; Tian, Lianfang; Chen, Ping; Wang, Lifei; Ye, Guangchun; Mao, Zongyuan

2007-12-01

Based on the characteristic of the PET-CT multimodal image series, a novel image registration and fusion method is proposed, in which the cubic spline interpolation method is applied to realize the interpolation of PET-CT image series, then registration is carried out by using mutual information algorithm and finally the improved principal component analysis method is used for the fusion of PET-CT multimodal images to enhance the visual effect of PET image, thus satisfied registration and fusion results are obtained. The cubic spline interpolation method is used for reconstruction to restore the missed information between image slices, which can compensate for the shortage of previous registration methods, improve the accuracy of the registration, and make the fused multimodal images more similar to the real image. Finally, the cubic spline interpolation method has been successfully applied in developing 3D-CRT (3D Conformal Radiation Therapy) system.

Experiments in Multimodal Information Presentation

NARCIS (Netherlands)

van Hooijdonk, Charlotte; Bosma, W.E.; Krahmer, Emiel; Maes, Alfons; Theune, Mariet; van den Bosch, Antal; Bouma, Gosse

In this chapter we describe three experiments investigating multimodal information presentation in the context of a medical QA system. In Experiment 1, we wanted to know how non-experts design (multimodal) answers to medical questions, distinguishing between what questions and how questions. In

Modeling multimodal human-computer interaction

NARCIS (Netherlands)

Obrenovic, Z.; Starcevic, D.

2004-01-01

Incorporating the well-known Unified Modeling Language into a generic modeling framework makes research on multimodal human-computer interaction accessible to a wide range off software engineers. Multimodal interaction is part of everyday human discourse: We speak, move, gesture, and shift our gaze

Experimental evaluation of user performance in a pursuit tracking task with multimodal feedback

Directory of Open Access Journals (Sweden)

Obrenović Željko

2004-01-01

Full Text Available In this paper we describe the results of experimental evaluation of user performance in a pursuit-tracking task with multimodal feedback. Our experimental results indicate that audio can significantly improve the accuracy of pursuit tracking. Experiments with 19 participants have shown that addition of acoustic modalities reduces the error during pursuit tracking for up to 19%. Moreover, experiments indicated the existence of perceptual boundaries of multimodal HCI for different scene complexity and target speeds. We have also shown that the most appealing paradigms are not the most effective ones, which necessitates a careful quantitative analysis of proposed multimodal HCI paradigms.

从多模态角度浅析手机广告%A Brief Analysis of Mobile Advertisement from the Multi-modal Perspective

Institute of Scientific and Technical Information of China (English)

刘静

2014-01-01

20世纪90年代西方兴起的多模态话语分析，逐渐成为语言学研究的新热点之一。经过十多年的发展，多模态分析已从语言学逐渐延伸到其他领域，研究对象也从语言文字扩展到音乐、图片、视频等多种社会符号系统。于是，随着人类社会步入3G时代，手机的普及使得手机广告具有极大的发展市场，将多模态分析运用到手机广告中将是今后的必然趋势。该文试图从多模态分析角度对手机广告进行浅析。%Multimodal discourse analysis rising in the western in 1990s has gradually become a new hot spot of the linguistic re-search. After more than ten years of development, multimodal analysis is not only applied in linguistics, but also extended to other areas. The research object is also extended from language to music, pictures, video and other social symbols. Thus, as human soci-ety has entered the 3G era, the popularity of mobile phones makes the mobile advertising market has great development, and the multimodal analysis will be greatly applied to mobile advertising. This paper attempts to analyze mobile advertisement from a multi-modal perspective.

Multimodality, politics and ideology

DEFF Research Database (Denmark)

Machin, David; Van Leeuwen, T.

2016-01-01

This journal's editorial statement is clear that political discourse should be studied not only as regards parliamentary type politics. In this introduction we argue precisely for the need to pay increasing attention to the way that political ideologies are infused into culture more widely...... of power, requires meanings and identities which can hold them in place. We explain the processes by which critical multimodal discourse analysis can best draw out this ideology as it is realized through different semiotics resources. © John Benjamins Publishing Company....

Performance characterization of the IEEE 802.11 signal transmission over a multimode fiber PON

Science.gov (United States)

Maksymiuk, L.; Siuzdak, J.

2014-11-01

In this paper there are presented measurements concerning performance analysis of the IEEE 802.11 signal distribution over multimode fiber based passive optical network. In the paper there are addressed three main sources of impairments: modal noise, frequency response fluctuation of the multimode fiber and non-linear distortion of the signal in the receiver.

The anterior temporal lobes support residual comprehension in Wernicke’s aphasia

Science.gov (United States)

Robson, Holly; Zahn, Roland; Keidel, James L.; Binney, Richard J.; Sage, Karen; Lambon Ralph, Matthew A.

2014-01-01

Wernicke’s aphasia occurs after a stroke to classical language comprehension regions in the left temporoparietal cortex. Consequently, auditory–verbal comprehension is significantly impaired in Wernicke’s aphasia but the capacity to comprehend visually presented materials (written words and pictures) is partially spared. This study used functional magnetic resonance imaging to investigate the neural basis of written word and picture semantic processing in Wernicke’s aphasia, with the wider aim of examining how the semantic system is altered after damage to the classical comprehension regions. Twelve participants with chronic Wernicke’s aphasia and 12 control participants performed semantic animate–inanimate judgements and a visual height judgement baseline task. Whole brain and region of interest analysis in Wernicke’s aphasia and control participants found that semantic judgements were underpinned by activation in the ventral and anterior temporal lobes bilaterally. The Wernicke’s aphasia group displayed an ‘over-activation’ in comparison with control participants, indicating that anterior temporal lobe regions become increasingly influential following reduction in posterior semantic resources. Semantic processing of written words in Wernicke’s aphasia was additionally supported by recruitment of the right anterior superior temporal lobe, a region previously associated with recovery from auditory-verbal comprehension impairments. Overall, the results provide support for models in which the anterior temporal lobes are crucial for multimodal semantic processing and that these regions may be accessed without support from classic posterior comprehension regions. PMID:24519979

Introducing the Interactive Model for the Training of Audiovisual Translators and Analysis of Multimodal Texts

Directory of Open Access Journals (Sweden)

Pietro Luigi Iaia

2015-07-01

Full Text Available Abstract – This paper introduces the ‘Interactive Model’ of audiovisual translation developed in the context of my PhD research on the cognitive-semantic, functional and socio-cultural features of the Italian-dubbing translation of a corpus of humorous texts. The Model is based on two interactive macro-phases – ‘Multimodal Critical Analysis of Scripts’ (MuCrAS and ‘Multimodal Re-Textualization of Scripts’ (MuReTS. Its construction and application are justified by a multidisciplinary approach to the analysis and translation of audiovisual texts, so as to focus on the linguistic and extralinguistic dimensions affecting both the reception of source texts and the production of target ones (Chaume 2004; Díaz Cintas 2004. By resorting to Critical Discourse Analysis (Fairclough 1995, 2001, to a process-based approach to translation and to a socio-semiotic analysis of multimodal texts (van Leeuwen 2004; Kress and van Leeuwen 2006, the Model is meant to be applied to the training of audiovisual translators and discourse analysts in order to help them enquire into the levels of pragmalinguistic equivalence between the source and the target versions. Finally, a practical application shall be discussed, detailing the Italian rendering of a comic sketch from the American late-night talk show Conan.Abstract – Questo studio introduce il ‘Modello Interattivo’ di traduzione audiovisiva sviluppato durante il mio dottorato di ricerca incentrato sulle caratteristiche cognitivo-semantiche, funzionali e socio-culturali della traduzione italiana per il doppiaggio di un corpus di testi comici. Il Modello è costituito da due fasi: la prima, di ‘Analisi critica e multimodale degli script’ (MuCrAS e la seconda, di ‘Ritestualizzazione critica e multimodale degli script’ (MuReTS, e la sua costruzione e applicazione sono frutto di un approccio multidisciplinare all’analisi e traduzione dei testi audiovisivi, al fine di esaminare le

Real analysis a comprehensive course in analysis, part 1

CERN Document Server

Simon, Barry

2015-01-01

A Comprehensive Course in Analysis by Poincaré Prize winner Barry Simon is a five-volume set that can serve as a graduate-level analysis textbook with a lot of additional bonus information, including hundreds of problems and numerous notes that extend the text and provide important historical background. Depth and breadth of exposition make this set a valuable reference source for almost all areas of classical analysis. Part 1 is devoted to real analysis. From one point of view, it presents the infinitesimal calculus of the twentieth century with the ultimate integral calculus (measure theory)

A systematic review and meta-analysis of comprehensive interventions for pre-school children with autism spectrum disorder (ASD).

Science.gov (United States)

Tachibana, Yoshiyuki; Miyazaki, Celine; Ota, Erika; Mori, Rintaro; Hwang, Yeonhee; Kobayashi, Eriko; Terasaka, Akiko; Tang, Julian; Kamio, Yoko

2017-01-01

There has an increasing number of published trials on psychosocial intervention programmes for pre-school children with autism spectrum disorder (ASD). To achieve better quality of unbiased evidence for the effectiveness of ASD interventions, it is necessary to conduct a comprehensive review that covers studies with adequate quality standards, such as randomised controlled trials (RCTs), and different types of intervention In this study, we categorize interventions for ASD as behavioural, social-communication focused, and multimodal developmental based on Howlin's classification of early interventions for children with ASD. The aim of this study was to compare these three models and investigate the strengths and weaknesses of each type of intervention and to identify the approaches that contribute to a successful outcome for children with autism. We performed a systematic review and meta-analysis. We included RCTs targeting children with ASD 6 years old or younger. A random effects model was used to present the effect estimate for the outcomes. This study also performed combined meta-analyses of all the three models to investigate the overall effectiveness of the intervention programmes. 32 randomized controlled studies were found to be eligible for inclusion. The synthesized data included 594 children from 14 RCTs. There was no statistically significant difference in the effects on autism general symptoms between the social-communication-focused model and the multimodal developmental model (p = 0.83). The results suggest that there is evidence of an effect on 'reciprocity of social interaction towards others' (standard mean difference [95% confidential interval] = 0.53[0.29,0.78], pASD have significant effects on a generalized skill to engage in reciprocal interactions with others. However, the outcomes of 'reciprocity of social interaction towards others' and 'parental synchrony' may be promising targets for interventions involving pre-school children with ASD

Reference resolution in multi-modal interaction: Preliminary observations

NARCIS (Netherlands)

González González, G.R.; Nijholt, Antinus

2002-01-01

In this paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can apply

Reference Resolution in Multi-modal Interaction: Position paper

NARCIS (Netherlands)

Fernando, T.; Nijholt, Antinus

2002-01-01

In this position paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can

Robust Multimodal Dictionary Learning

Science.gov (United States)

Cao, Tian; Jojic, Vladimir; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

2014-01-01

We propose a robust multimodal dictionary learning method for multimodal images. Joint dictionary learning for both modalities may be impaired by lack of correspondence between image modalities in training data, for example due to areas of low quality in one of the modalities. Dictionaries learned with such non-corresponding data will induce uncertainty about image representation. In this paper, we propose a probabilistic model that accounts for image areas that are poorly corresponding between the image modalities. We cast the problem of learning a dictionary in presence of problematic image patches as a likelihood maximization problem and solve it with a variant of the EM algorithm. Our algorithm iterates identification of poorly corresponding patches and re-finements of the dictionary. We tested our method on synthetic and real data. We show improvements in image prediction quality and alignment accuracy when using the method for multimodal image registration. PMID:24505674

Human Behavior Analysis by Means of Multimodal Context Mining

Directory of Open Access Journals (Sweden)

Oresti Banos

2016-08-01

Full Text Available There is sufficient evidence proving the impact that negative lifestyle choices have on people’s health and wellness. Changing unhealthy behaviours requires raising people’s self-awareness and also providing healthcare experts with a thorough and continuous description of the user’s conduct. Several monitoring techniques have been proposed in the past to track users’ behaviour; however, these approaches are either subjective and prone to misreporting, such as questionnaires, or only focus on a specific component of context, such as activity counters. This work presents an innovative multimodal context mining framework to inspect and infer human behaviour in a more holistic fashion. The proposed approach extends beyond the state-of-the-art, since it not only explores a sole type of context, but also combines diverse levels of context in an integral manner. Namely, low-level contexts, including activities, emotions and locations, are identified from heterogeneous sensory data through machine learning techniques. Low-level contexts are combined using ontological mechanisms to derive a more abstract representation of the user’s context, here referred to as high-level context. An initial implementation of the proposed framework supporting real-time context identification is also presented. The developed system is evaluated for various realistic scenarios making use of a novel multimodal context open dataset and data on-the-go, demonstrating prominent context-aware capabilities at both low and high levels.

A Robust Multimodal Bio metric Authentication Scheme with Voice and Face Recognition

International Nuclear Information System (INIS)

Kasban, H.

2017-01-01

This paper proposes a multimodal biometric scheme for human authentication based on fusion of voice and face recognition. For voice recognition, three categories of features (statistical coefficients, cepstral coefficients and voice timbre) are used and compared. The voice identification modality is carried out using Gaussian Mixture Model (GMM). For face recognition, three recognition methods (Eigenface, Linear Discriminate Analysis (LDA), and Gabor filter) are used and compared. The combination of voice and face biometrics systems into a single multimodal biometrics system is performed using features fusion and scores fusion. This study shows that the best results are obtained using all the features (cepstral coefficients, statistical coefficients and voice timbre features) for voice recognition, LDA face recognition method and scores fusion for the multimodal biometrics system

Multimodal 2D Brain Computer Interface.

Science.gov (United States)

Almajidy, Rand K; Boudria, Yacine; Hofmann, Ulrich G; Besio, Walter; Mankodiya, Kunal

2015-08-01

In this work we used multimodal, non-invasive brain signal recording systems, namely Near Infrared Spectroscopy (NIRS), disc electrode electroencephalography (EEG) and tripolar concentric ring electrodes (TCRE) electroencephalography (tEEG). 7 healthy subjects participated in our experiments to control a 2-D Brain Computer Interface (BCI). Four motor imagery task were performed, imagery motion of the left hand, the right hand, both hands and both feet. The signal slope (SS) of the change in oxygenated hemoglobin concentration measured by NIRS was used for feature extraction while the power spectrum density (PSD) of both EEG and tEEG in the frequency band 8-30Hz was used for feature extraction. Linear Discriminant Analysis (LDA) was used to classify different combinations of the aforementioned features. The highest classification accuracy (85.2%) was achieved by using features from all the three brain signals recording modules. The improvement in classification accuracy was highly significant (p = 0.0033) when using the multimodal signals features as compared to pure EEG features.

100G WDM Transmission over 100 meter Multimode Fiber

DEFF Research Database (Denmark)

Cimoli, Bruno; Estaran Tolosa, Jose Manuel; Rodes Lopez, Guillermo Arturo

We present a comparative performance analysis for wavelength-grid selection in WDM shortrange multimode-fibers. We study 100Gbps links over OM2, OM3 and OM4 fibers and show it is feasible to reach over 100 m transmission distances....

Toward an infrastructure for data-driven multimodal communication research

DEFF Research Database (Denmark)

Steen, Francis F.; Hougaard, Anders; Joo, Jungseock

2018-01-01

Research into the multimodal dimensions of human communication faces a set of distinctive methodological challenges. Collecting the datasets is resource-intensive, analysis often lacks peer validation, and the absence of shared datasets makes it difficult to develop standards. External validity...

Comprehensive two-dimensional gas chromatography and food sensory properties: potential and challenges.

Science.gov (United States)

Cordero, Chiara; Kiefl, Johannes; Schieberle, Peter; Reichenbach, Stephen E; Bicchi, Carlo

2015-01-01

Modern omics disciplines dealing with food flavor focus the analytical efforts on the elucidation of sensory-active compounds, including all possible stimuli of multimodal perception (aroma, taste, texture, etc.) by means of a comprehensive, integrated treatment of sample constituents, such as physicochemical properties, concentration in the matrix, and sensory properties (odor/taste quality, perception threshold). Such analyses require detailed profiling of known bioactive components as well as advanced fingerprinting techniques to catalog sample constituents comprehensively, quantitatively, and comparably across samples. Multidimensional analytical platforms support comprehensive investigations required for flavor analysis by combining information on analytes' identities, physicochemical behaviors (volatility, polarity, partition coefficient, and solubility), concentration, and odor quality. Unlike other omics, flavor metabolomics and sensomics include the final output of the biological phenomenon (i.e., sensory perceptions) as an additional analytical dimension, which is specifically and exclusively triggered by the chemicals analyzed. However, advanced omics platforms, which are multidimensional by definition, pose challenging issues not only in terms of coupling with detection systems and sample preparation, but also in terms of data elaboration and processing. The large number of variables collected during each analytical run provides a high level of information, but requires appropriate strategies to exploit fully this potential. This review focuses on advances in comprehensive two-dimensional gas chromatography and analytical platforms combining two-dimensional gas chromatography with olfactometry, chemometrics, and quantitative assays for food sensory analysis to assess the quality of a given product. We review instrumental advances and couplings, automation in sample preparation, data elaboration, and a selection of applications.

Recent developments in multimodality fluorescence imaging probes

Directory of Open Access Journals (Sweden)

Jianhong Zhao

2018-05-01

Full Text Available Multimodality optical imaging probes have emerged as powerful tools that improve detection sensitivity and accuracy, important in disease diagnosis and treatment. In this review, we focus on recent developments of optical fluorescence imaging (OFI probe integration with other imaging modalities such as X-ray computed tomography (CT, magnetic resonance imaging (MRI, positron emission tomography (PET, single-photon emission computed tomography (SPECT, and photoacoustic imaging (PAI. The imaging technologies are briefly described in order to introduce the strengths and limitations of each techniques and the need for further multimodality optical imaging probe development. The emphasis of this account is placed on how design strategies are currently implemented to afford physicochemically and biologically compatible multimodality optical fluorescence imaging probes. We also present studies that overcame intrinsic disadvantages of each imaging technique by multimodality approach with improved detection sensitivity and accuracy. KEY WORDS: Optical imaging, Fluorescence, Multimodality, Near-infrared fluorescence, Nanoprobe, Computed tomography, Magnetic resonance imaging, Positron emission tomography, Single-photon emission computed tomography, Photoacoustic imaging

The Effect of Graphic Novel Supplements on Reading Comprehension and Motivation in Secondary Students

Science.gov (United States)

Wood, Mara

2015-01-01

Graphic novels use visual literacy and multimodal learning two methods of teaching. Graphic novels also have a history of being motivating to students. This study aims to quantify the degree of influence graphic novels have on secondary student comprehension and motivation. Students were recruited from two classrooms taught by one twelfth-grade…

Windowed Multitaper Correlation Analysis of Multimodal Brain Monitoring Parameters

Directory of Open Access Journals (Sweden)

Rupert Faltermeier

2015-01-01

Full Text Available Although multimodal monitoring sets the standard in daily practice of neurocritical care, problem-oriented analysis tools to interpret the huge amount of data are lacking. Recently a mathematical model was presented that simulates the cerebral perfusion and oxygen supply in case of a severe head trauma, predicting the appearance of distinct correlations between arterial blood pressure and intracranial pressure. In this study we present a set of mathematical tools that reliably detect the predicted correlations in data recorded at a neurocritical care unit. The time resolved correlations will be identified by a windowing technique combined with Fourier-based coherence calculations. The phasing of the data is detected by means of Hilbert phase difference within the above mentioned windows. A statistical testing method is introduced that allows tuning the parameters of the windowing method in such a way that a predefined accuracy is reached. With this method the data of fifteen patients were examined in which we found the predicted correlation in each patient. Additionally it could be shown that the occurrence of a distinct correlation parameter, called scp, represents a predictive value of high quality for the patients outcome.

Windowed multitaper correlation analysis of multimodal brain monitoring parameters.

Science.gov (United States)

Faltermeier, Rupert; Proescholdt, Martin A; Bele, Sylvia; Brawanski, Alexander

2015-01-01

Although multimodal monitoring sets the standard in daily practice of neurocritical care, problem-oriented analysis tools to interpret the huge amount of data are lacking. Recently a mathematical model was presented that simulates the cerebral perfusion and oxygen supply in case of a severe head trauma, predicting the appearance of distinct correlations between arterial blood pressure and intracranial pressure. In this study we present a set of mathematical tools that reliably detect the predicted correlations in data recorded at a neurocritical care unit. The time resolved correlations will be identified by a windowing technique combined with Fourier-based coherence calculations. The phasing of the data is detected by means of Hilbert phase difference within the above mentioned windows. A statistical testing method is introduced that allows tuning the parameters of the windowing method in such a way that a predefined accuracy is reached. With this method the data of fifteen patients were examined in which we found the predicted correlation in each patient. Additionally it could be shown that the occurrence of a distinct correlation parameter, called scp, represents a predictive value of high quality for the patients outcome.

Multimode-singlemode-multimode fiber sensor for alcohol sensing application

Science.gov (United States)

Rofi'ah, Iftihatur; Hatta, A. M.; Sekartedjo, Sekartedjo

2016-11-01

Alcohol is volatile and flammable liquid which is soluble substances both on polar and non polar substances that has been used in some industrial sectors. Alcohol detection method now widely used one of them is the optical fiber sensor. In this paper used fiber optic sensor based on Multimode-Single-mode-Multimode (MSM) to detect alcohol solution at a concentration range of 0-3%. The working principle of sensor utilizes the modal interference between the core modes and the cladding modes, thus make the sensor sensitive to environmental changes. The result showed that characteristic of the sensor not affect the length of the single-mode fiber (SMF). We obtain that the sensor with a length of 5 mm of single-mode can sensing the alcohol with a sensitivity of 0.107 dB/v%.

A low-cost multimodal head-mounted display system for neuroendoscopic surgery.

Science.gov (United States)

Xu, Xinghua; Zheng, Yi; Yao, Shujing; Sun, Guochen; Xu, Bainan; Chen, Xiaolei

2018-01-01

With rapid advances in technology, wearable devices as head-mounted display (HMD) have been adopted for various uses in medical science, ranging from simply aiding in fitness to assisting surgery. We aimed to investigate the feasibility and practicability of a low-cost multimodal HMD system in neuroendoscopic surgery. A multimodal HMD system, mainly consisted of a HMD with two built-in displays, an action camera, and a laptop computer displaying reconstructed medical images, was developed to assist neuroendoscopic surgery. With this intensively integrated system, the neurosurgeon could freely switch between endoscopic image, three-dimensional (3D) reconstructed virtual endoscopy images, and surrounding environment images. Using a leap motion controller, the neurosurgeon could adjust or rotate the 3D virtual endoscopic images at a distance to better understand the positional relation between lesions and normal tissues at will. A total of 21 consecutive patients with ventricular system diseases underwent neuroendoscopic surgery with the aid of this system. All operations were accomplished successfully, and no system-related complications occurred. The HMD was comfortable to wear and easy to operate. Screen resolution of the HMD was high enough for the neurosurgeon to operate carefully. With the system, the neurosurgeon might get a better comprehension on lesions by freely switching among images of different modalities. The system had a steep learning curve, which meant a quick increment of skill with it. Compared with commercially available surgical assistant instruments, this system was relatively low-cost. The multimodal HMD system is feasible, practical, helpful, and relatively cost efficient in neuroendoscopic surgery.

Multimodal pain management after arthroscopic surgery

DEFF Research Database (Denmark)

Rasmussen, Sten

Multimodal Pain Management after Arthroscopic Surgery By Sten Rasmussen, M.D. The thesis is based on four randomized controlled trials. The main hypothesis was that multimodal pain treatment provides faster recovery after arthroscopic surgery. NSAID was tested against placebo after knee arthroscopy...

Design of a Multi-mode Flight Deck Decision Support System for Airborne Conflict Management

Science.gov (United States)

Barhydt, Richard; Krishnamurthy, Karthik

2004-01-01

NASA Langley has developed a multi-mode decision support system for pilots operating in a Distributed Air-Ground Traffic Management (DAG-TM) environment. An Autonomous Operations Planner (AOP) assists pilots in performing separation assurance functions, including conflict detection, prevention, and resolution. Ongoing AOP design has been based on a comprehensive human factors analysis and evaluation results from previous human-in-the-loop experiments with airline pilot test subjects. AOP considers complex flight mode interactions and provides flight guidance to pilots consistent with the current aircraft control state. Pilots communicate goals to AOP by setting system preferences and actively probing potential trajectories for conflicts. To minimize training requirements and improve operational use, AOP design leverages existing alerting philosophies, displays, and crew interfaces common on commercial aircraft. Future work will consider trajectory prediction uncertainties, integration with the TCAS collision avoidance system, and will incorporate enhancements based on an upcoming air-ground coordination experiment.

Spatial Heterogeneity of Leaf Area Index (LAI) and Its Temporal Course on Arable Land: Combining Field Measurements, Remote Sensing and Simulation in a Comprehensive Data Analysis Approach (CDAA)

Science.gov (United States)

Korres, Wolfgang; Montzka, Carsten; Fiener, Peter; Wilken, Florian; Stadler, Anja; Waldhoff, Guido; Schneider, Karl

2016-01-01

The ratio of leaf area to ground area (leaf area index, LAI) is an important state variable in ecosystem studies since it influences fluxes of matter and energy between the land surface and the atmosphere. As a basis for generating temporally continuous and spatially distributed datasets of LAI, the current study contributes an analysis of its spatial variability and spatial structure. Soil-vegetation-atmosphere fluxes of water, carbon and energy are nonlinearly related to LAI. Therefore, its spatial heterogeneity, i.e., the combination of spatial variability and structure, has an effect on simulations of these fluxes. To assess LAI spatial heterogeneity, we apply a Comprehensive Data Analysis Approach that combines data from remote sensing (5 m resolution) and simulation (150 m resolution) with field measurements and a detailed land use map. Test area is the arable land in the fertile loess plain of the Rur catchment on the Germany-Belgium-Netherlands border. LAI from remote sensing and simulation compares well with field measurements. Based on the simulation results, we describe characteristic crop-specific temporal patterns of LAI spatial variability. By means of these patterns, we explain the complex multimodal frequency distributions of LAI in the remote sensing data. In the test area, variability between agricultural fields is higher than within fields. Therefore, spatial resolutions less than the 5 m of the remote sensing scenes are sufficient to infer LAI spatial variability. Frequency distributions from the simulation agree better with the multimodal distributions from remote sensing than normal distributions do. The spatial structure of LAI in the test area is dominated by a short distance referring to field sizes. Longer distances that refer to soil and weather can only be derived from remote sensing data. Therefore, simulations alone are not sufficient to characterize LAI spatial structure. It can be concluded that a comprehensive picture of LAI spatial

Multimodality, creativity and children's meaning-making: Drawings ...

African Journals Online (AJOL)

Multimodality, creativity and children's meaning-making: Drawings, writings, imaginings. ... Framed by social semiotic theories of communication, multimodal ... to create imaginary worlds and express meanings according to their interests.

Separating Bulk and Surface Contributions to Electronic Excited-State Processes in Hybrid Mixed Perovskite Thin Films via Multimodal All-Optical Imaging.

Science.gov (United States)

Simpson, Mary Jane; Doughty, Benjamin; Das, Sanjib; Xiao, Kai; Ma, Ying-Zhong

2017-07-20

A comprehensive understanding of electronic excited-state phenomena underlying the impressive performance of solution-processed hybrid halide perovskite solar cells requires access to both spatially resolved electronic processes and corresponding sample morphological characteristics. Here, we demonstrate an all-optical multimodal imaging approach that enables us to obtain both electronic excited-state and morphological information on a single optical microscope platform with simultaneous high temporal and spatial resolution. Specifically, images were acquired for the same region of interest in thin films of chloride containing mixed lead halide perovskites (CH 3 NH 3 PbI 3-x Cl x ) using femtosecond transient absorption, time-integrated photoluminescence, confocal reflectance, and transmission microscopies. Comprehensive image analysis revealed the presence of surface- and bulk-dominated contributions to the various images, which describe either spatially dependent electronic excited-state properties or morphological variations across the probed region of the thin films. These results show that PL probes effectively the species near or at the film surface.

The Comprehension Problems for Second-Language Learners with Poor Reading Comprehension Despite Adequate Decoding: A Meta-Analysis

Science.gov (United States)

Spencer, Mercedes; Wagner, Richard K.

2017-01-01

We conducted a meta-analysis of 16 existing studies to examine the nature of the comprehension problems for children who were second-language learners with poor reading comprehension despite adequate decoding. Results indicated that these children had deficits in oral language (d = -0.80), but these deficits were not as severe as their reading…

Harmonic analysis a comprehensive course in analysis, part 3

CERN Document Server

Simon, Barry

2015-01-01

A Comprehensive Course in Analysis by Poincaré Prize winner Barry Simon is a five-volume set that can serve as a graduate-level analysis textbook with a lot of additional bonus information, including hundreds of problems and numerous notes that extend the text and provide important historical background. Depth and breadth of exposition make this set a valuable reference source for almost all areas of classical analysis. Part 3 returns to the themes of Part 1 by discussing pointwise limits (going beyond the usual focus on the Hardy-Littlewood maximal function by including ergodic theorems and m

Predictive brain networks for major depression in a semi-multimodal fusion hierarchical feature reduction framework.

Science.gov (United States)

Yang, Jie; Yin, Yingying; Zhang, Zuping; Long, Jun; Dong, Jian; Zhang, Yuqun; Xu, Zhi; Li, Lei; Liu, Jie; Yuan, Yonggui

2018-02-05

Major depressive disorder (MDD) is characterized by dysregulation of distributed structural and functional networks. It is now recognized that structural and functional networks are related at multiple temporal scales. The recent emergence of multimodal fusion methods has made it possible to comprehensively and systematically investigate brain networks and thereby provide essential information for influencing disease diagnosis and prognosis. However, such investigations are hampered by the inconsistent dimensionality features between structural and functional networks. Thus, a semi-multimodal fusion hierarchical feature reduction framework is proposed. Feature reduction is a vital procedure in classification that can be used to eliminate irrelevant and redundant information and thereby improve the accuracy of disease diagnosis. Our proposed framework primarily consists of two steps. The first step considers the connection distances in both structural and functional networks between MDD and healthy control (HC) groups. By adding a constraint based on sparsity regularization, the second step fully utilizes the inter-relationship between the two modalities. However, in contrast to conventional multi-modality multi-task methods, the structural networks were considered to play only a subsidiary role in feature reduction and were not included in the following classification. The proposed method achieved a classification accuracy, specificity, sensitivity, and area under the curve of 84.91%, 88.6%, 81.29%, and 0.91, respectively. Moreover, the frontal-limbic system contributed the most to disease diagnosis. Importantly, by taking full advantage of the complementary information from multimodal neuroimaging data, the selected consensus connections may be highly reliable biomarkers of MDD. Copyright © 2017 Elsevier B.V. All rights reserved.

Adaptive Multiview Nonnegative Matrix Factorization Algorithm for Integration of Multimodal Biomedical Data

Directory of Open Access Journals (Sweden)

Bisakha Ray

2017-08-01

Full Text Available The amounts and types of available multimodal tumor data are rapidly increasing, and their integration is critical for fully understanding the underlying cancer biology and personalizing treatment. However, the development of methods for effectively integrating multimodal data in a principled manner is lagging behind our ability to generate the data. In this article, we introduce an extension to a multiview nonnegative matrix factorization algorithm (NNMF for dimensionality reduction and integration of heterogeneous data types and compare the predictive modeling performance of the method on unimodal and multimodal data. We also present a comparative evaluation of our novel multiview approach and current data integration methods. Our work provides an efficient method to extend an existing dimensionality reduction method. We report rigorous evaluation of the method on large-scale quantitative protein and phosphoprotein tumor data from the Clinical Proteomic Tumor Analysis Consortium (CPTAC acquired using state-of-the-art liquid chromatography mass spectrometry. Exome sequencing and RNA-Seq data were also available from The Cancer Genome Atlas for the same tumors. For unimodal data, in case of breast cancer, transcript levels were most predictive of estrogen and progesterone receptor status and copy number variation of human epidermal growth factor receptor 2 status. For ovarian and colon cancers, phosphoprotein and protein levels were most predictive of tumor grade and stage and residual tumor, respectively. When multiview NNMF was applied to multimodal data to predict outcomes, the improvement in performance is not overall statistically significant beyond unimodal data, suggesting that proteomics data may contain more predictive information regarding tumor phenotypes than transcript levels, probably due to the fact that proteins are the functional gene products and therefore a more direct measurement of the functional state of the tumor. Here, we

Applications of Elpasolites as a Multimode Radiation Sensor

Science.gov (United States)

Guckes, Amber

This study consists of both computational and experimental investigations. The computational results enabled detector design selections and confirmed experimental results. The experimental results determined that the CLYC scintillation detector can be applied as a functional and field-deployable multimode radiation sensor. The computational study utilized MCNP6 code to investigate the response of CLYC to various incident radiations and to determine the feasibility of its application as a handheld multimode sensor and as a single-scintillator collimated directional detection system. These simulations include: • Characterization of the response of the CLYC scintillator to gamma-rays and neutrons; • Study of the isotopic enrichment of 7Li versus 6Li in the CLYC for optimal detection of both thermal neutrons and fast neutrons; • Analysis of collimator designs to determine the optimal collimator for the single CLYC sensor directional detection system to assay gamma rays and neutrons; Simulations of a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system with the optimized collimator to determine the feasibility of detecting nuclear materials that could be encountered during field operations. These nuclear materials include depleted uranium, natural uranium, low-enriched uranium, highly-enriched uranium, reactor-grade plutonium, and weapons-grade plutonium. The experimental study includes the design, construction, and testing of both a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system. Both were designed in the Inventor CAD software and based on results of the computational study to optimize its performance. The handheld CLYC multimode sensor is modular, scalable, low?power, and optimized for high count rates. Commercial?off?the?shelf components were used where possible in order to optimize size, increase robustness, and minimize cost. The handheld CLYC multimode

Echocardiography in the Era of Multimodality Cardiovascular Imaging

Science.gov (United States)

Shah, Benoy Nalin

2013-01-01

Echocardiography remains the most frequently performed cardiac imaging investigation and is an invaluable tool for detailed and accurate evaluation of cardiac structure and function. Echocardiography, nuclear cardiology, cardiac magnetic resonance imaging, and cardiovascular-computed tomography comprise the subspeciality of cardiovascular imaging, and these techniques are often used together for a multimodality, comprehensive assessment of a number of cardiac diseases. This paper provides the general cardiologist and physician with an overview of state-of-the-art modern echocardiography, summarising established indications as well as highlighting advances in stress echocardiography, three-dimensional echocardiography, deformation imaging, and contrast echocardiography. Strengths and limitations of echocardiography are discussed as well as the growing role of real-time three-dimensional echocardiography in the guidance of structural heart interventions in the cardiac catheter laboratory. PMID:23878804

A multimodal spectral approach to characterize rhythm in natural speech.

Science.gov (United States)

Alexandrou, Anna Maria; Saarinen, Timo; Kujala, Jan; Salmelin, Riitta

2016-01-01

Human utterances demonstrate temporal patterning, also referred to as rhythm. While simple oromotor behaviors (e.g., chewing) feature a salient periodical structure, conversational speech displays a time-varying quasi-rhythmic pattern. Quantification of periodicity in speech is challenging. Unimodal spectral approaches have highlighted rhythmic aspects of speech. However, speech is a complex multimodal phenomenon that arises from the interplay of articulatory, respiratory, and vocal systems. The present study addressed the question of whether a multimodal spectral approach, in the form of coherence analysis between electromyographic (EMG) and acoustic signals, would allow one to characterize rhythm in natural speech more efficiently than a unimodal analysis. The main experimental task consisted of speech production at three speaking rates; a simple oromotor task served as control. The EMG-acoustic coherence emerged as a sensitive means of tracking speech rhythm, whereas spectral analysis of either EMG or acoustic amplitude envelope alone was less informative. Coherence metrics seem to distinguish and highlight rhythmic structure in natural speech.

(Re-)Examination of Multimodal Augmented Reality

NARCIS (Netherlands)

Rosa, N.E.; Werkhoven, P.J.; Hürst, W.O.

2016-01-01

The majority of augmented reality (AR) research has been concerned with visual perception, however the move towards multimodality is imminent. At the same time, there is no clear vision of what multimodal AR is. The purpose of this position paper is to consider possible ways of examining AR other

Multimodal integration of anatomy and physiology classes: How instructors utilize multimodal teaching in their classrooms

Science.gov (United States)

McGraw, Gerald M., Jr.

Multimodality is the theory of communication as it applies to social and educational semiotics (making meaning through the use of multiple signs and symbols). The term multimodality describes a communication methodology that includes multiple textual, aural, and visual applications (modes) that are woven together to create what is referred to as an artifact. Multimodal teaching methodology attempts to create a deeper meaning to course content by activating the higher cognitive areas of the student's brain, creating a more sustained retention of the information (Murray, 2009). The introduction of multimodality educational methodologies as a means to more optimally engage students has been documented within educational literature. However, studies analyzing the distribution and penetration into basic sciences, more specifically anatomy and physiology, have not been forthcoming. This study used a quantitative survey design to determine the degree to which instructors integrated multimodality teaching practices into their course curricula. The instrument used for the study was designed by the researcher based on evidence found in the literature and sent to members of three associations/societies for anatomy and physiology instructors: the Human Anatomy and Physiology Society; the iTeach Anatomy & Physiology Collaborate; and the American Physiology Society. Respondents totaled 182 instructor members of two- and four-year, private and public higher learning colleges collected from the three organizations collectively with over 13,500 members in over 925 higher learning institutions nationwide. The study concluded that the expansion of multimodal methodologies into anatomy and physiology classrooms is at the beginning of the process and that there is ample opportunity for expansion. Instructors continue to use lecture as their primary means of interaction with students. Email is still the major form of out-of-class communication for full-time instructors. Instructors with

Multimodal approach to postoperative recovery

DEFF Research Database (Denmark)

Kehlet, Henrik

2009-01-01

PURPOSE OF REVIEW: To provide updated information on recent developments within individual components of multimodal interventions to improve postoperative outcome (fast-track methodology). RECENT FINDINGS: The value of the fast-track methodology to improve recovery and decrease hospital stay...... and morbidity has been firmly consolidated, especially in colorectal procedures. An increasing amount of data from other procedures supports the value of the fast-track concept across procedures. Fast-track programs should be based on the analysis of procedure-specific factors that may influence outcome...

Multimodale trafiknet i GIS (Multimodal Traffic Network in GIS)

DEFF Research Database (Denmark)

Kronbak, Jacob; Brems, Camilla Riff

1996-01-01

The report introduces the use of multi-modal traffic networks within a geographical Information System (GIS). The necessary theory of modelling multi-modal traffic network is reviewed and applied to the ARC/INFO GIS by an explorative example.......The report introduces the use of multi-modal traffic networks within a geographical Information System (GIS). The necessary theory of modelling multi-modal traffic network is reviewed and applied to the ARC/INFO GIS by an explorative example....

Training of Perceptual Motor Skills in Multimodal Virtual Environments

Directory of Open Access Journals (Sweden)

Gopher Daniel

2011-12-01

Full Text Available Multimodal, immersive, virtual reality (VR techniques open new perspectives for perceptualmotor skill trainers. They also introduce new risks and dangers. This paper describes the benefits and pitfalls of multimodal training and the cognitive building blocks of a multimodal, VR training simulators.

Multimodal processes scheduling in mesh-like network environment

Directory of Open Access Journals (Sweden)

Bocewicz Grzegorz

2015-06-01

Full Text Available Multimodal processes planning and scheduling play a pivotal role in many different domains including city networks, multimodal transportation systems, computer and telecommunication networks and so on. Multimodal process can be seen as a process partially processed by locally executed cyclic processes. In that context the concept of a Mesh-like Multimodal Transportation Network (MMTN in which several isomorphic subnetworks interact each other via distinguished subsets of common shared intermodal transport interchange facilities (such as a railway station, bus station or bus/tram stop as to provide a variety of demand-responsive passenger transportation services is examined. Consider a mesh-like layout of a passengers transport network equipped with different lines including buses, trams, metro, trains etc. where passenger flows are treated as multimodal processes. The goal is to provide a declarative model enabling to state a constraint satisfaction problem aimed at multimodal transportation processes scheduling encompassing passenger flow itineraries. Then, the main objective is to provide conditions guaranteeing solvability of particular transport lines scheduling, i.e. guaranteeing the right match-up of local cyclic acting bus, tram, metro and train schedules to a given passengers flow itineraries.

Evaluating Dynamic Analysis Techniques for Program Comprehension

NARCIS (Netherlands)

Cornelissen, S.G.M.

2009-01-01

Program comprehension is an essential part of software development and software maintenance, as software must be sufficiently understood before it can be properly modified. One of the common approaches in getting to understand a program is the study of its execution, also known as dynamic analysis.

Nuevas alfabetizaciones en un entorno multimodal: nuevas necesidades lectoras para un entorno textual múltiple

Directory of Open Access Journals (Sweden)

Juan Patricio Sánchez-Claros

2016-01-01

Full Text Available The new technologies of information, the development of the media and the massive presence of multimedia devices have brought a renewal of the traditional concept of literacy. Multimodality in the media, in the dissemination of knowledge and the communicat ion formats have brought a change in the system of reception of media objects and each of its integral elements. This multimodal environment is part of the daily life of students who access through a scenario of screens and images across a virtual environm ent in which both textual and visual are integrated as an informational continuum that requires to users new interpretation skills. And, consequently, a new approach to media literacy should be the subject of attention from educators. Media literac y implies the need to address new visual skills, new reading skills and especially new skills for integration and analysis, among those who cannot be set aside on the critical apparatus necessary. This paper discusses the content of these skills, some cri tical tools for multimodal approach speech as well as the role the four substrata of discourse, design, production and distribution , typical ofCritical Analysis of Multimodal Discourse are analysed .

Palmprint and face multi-modal biometric recognition based on SDA-GSVD and its kernelization.

Science.gov (United States)

Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

2012-01-01

When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

Science.gov (United States)

Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

2012-01-01

When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance. PMID:22778600

Speech comprehension aided by multiple modalities: behavioural and neural interactions

Science.gov (United States)

McGettigan, Carolyn; Faulkner, Andrew; Altarelli, Irene; Obleser, Jonas; Baverstock, Harriet; Scott, Sophie K.

2014-01-01

Speech comprehension is a complex human skill, the performance of which requires the perceiver to combine information from several sources – e.g. voice, face, gesture, linguistic context – to achieve an intelligible and interpretable percept. We describe a functional imaging investigation of how auditory, visual and linguistic information interact to facilitate comprehension. Our specific aims were to investigate the neural responses to these different information sources, alone and in interaction, and further to use behavioural speech comprehension scores to address sites of intelligibility-related activation in multifactorial speech comprehension. In fMRI, participants passively watched videos of spoken sentences, in which we varied Auditory Clarity (with noise-vocoding), Visual Clarity (with Gaussian blurring) and Linguistic Predictability. Main effects of enhanced signal with increased auditory and visual clarity were observed in overlapping regions of posterior STS. Two-way interactions of the factors (auditory × visual, auditory × predictability) in the neural data were observed outside temporal cortex, where positive signal change in response to clearer facial information and greater semantic predictability was greatest at intermediate levels of auditory clarity. Overall changes in stimulus intelligibility by condition (as determined using an independent behavioural experiment) were reflected in the neural data by increased activation predominantly in bilateral dorsolateral temporal cortex, as well as inferior frontal cortex and left fusiform gyrus. Specific investigation of intelligibility changes at intermediate auditory clarity revealed a set of regions, including posterior STS and fusiform gyrus, showing enhanced responses to both visual and linguistic information. Finally, an individual differences analysis showed that greater comprehension performance in the scanning participants (measured in a post-scan behavioural test) were associated with

Comprehensive adaptive mesh refinement in wrinkling prediction analysis

NARCIS (Netherlands)

Selman, A.; Meinders, Vincent T.; Huetink, Han; van den Boogaard, Antonius H.

2002-01-01

Discretisation errors indicator, contact free wrinkling and wrinkling with contact indicators are, in a challenging task, brought together and used in a comprehensive approach to wrinkling prediction analysis in thin sheet metal forming processes.

Template security analysis of multimodal biometric frameworks based on fingerprint and hand geometry

Directory of Open Access Journals (Sweden)

Arvind Selwal

2016-09-01

Full Text Available Biometric systems are automatic tools used to provide authentication during various applications of modern computing. In this work, three different design frameworks for multimodal biometric systems based on fingerprint and hand geometry modalities are proposed. An analysis is also presented to diagnose various types of template security issues in the proposed system. Fuzzy analytic hierarchy process (FAHP is applied with five decision parameters on all the designs and framework 1 is found to be better in terms of template data security, templates fusion and computational efficiency. It is noticed that template data security before storage in database is a challenging task. An important observation is that a template may be secured at feature fusion level and an indexing technique may be used to improve the size of secured templates.

Advanced Multimodal Solutions for Information Presentation

Science.gov (United States)

Wenzel, Elizabeth M.; Godfroy-Cooper, Martine

2018-01-01

possible solution, adaptive systems have been proposed in which the information presented to the user changes as a function of taskcontext-dependent factors. However, this presupposes that adequate methods for detecting andor predicting such factors are developed. Further, research in adaptive systems for aviation suggests that they can sometimes serve to increase workload and reduce situational awareness. It will be critical to develop multimodal display guidelines that include consideration of smart systems that can select the best display method for a particular contextsituation.The scope of the current work is an analysis of potential multimodal display technologies for long duration missions and, in particular, will focus on their potential role in EVA activities. The review will address multimodal (combined visual, auditory andor tactile) displays investigated by NASA, industry, and DoD (Dept. of Defense). It also considers the need for adaptive information systems to accommodate a variety of operational contexts such as crew status (e.g., fatigue, workload level) and task environment (e.g., EVA, habitat, rover, spacecraft). Current approaches to guidelines and best practices for combining modalities for the most effective information displays are also reviewed. Potential issues in developing interface guidelines for the Exploration Information System (EIS) are briefly considered.

Association between structural and functional brain alterations in drug-free patients with schizophrenia: a multimodal meta-analysis.

Science.gov (United States)

Gao, Xin; Zhang, Wenjing; Yao, Li; Xiao, Yuan; Liu, Lu; Liu, Jieke; Li, Siyi; Tao, Bo; Shah, Chandan; Gong, Qiyong; Sweeney, John A; Lui, Su

2018-03-01

Neuroimaging studies have shown both structural and functional abnormalities in patients with schizophrenia. Recently, studies have begun to explore the association between structural and functional grey matter abnormalities. By conducting a meta-analysis on morphometric and functional imaging studies of grey matter alterations in drug-free patients, the present study aims to examine the degree of overlap between brain regions with anatomic and functional changes in patients with schizophrenia. We performed a systematic search of PubMed, Embase, Web of Science and the Cochrane Library to identify relevant publications. A multimodal analysis was then conducted using Seed-based d Mapping software. Exploratory analyses included jackknife, subgroup and meta-regression analyses. We included 15 structural MRI studies comprising 486 drug-free patients and 485 healthy controls, and 16 functional MRI studies comprising 403 drug-free patients and 428 controls in our meta-analysis. Drug-free patients were examined to reduce pharmacological effects on the imaging data. Multimodal analysis showed considerable overlap between anatomic and functional changes, mainly in frontotemporal regions, bilateral medial posterior cingulate/paracingulate gyrus, bilateral insula, basal ganglia and left cerebellum. There were also brain regions showing only anatomic changes in the right superior frontal gyrus, left supramarginal gyrus, right lingual gyrus and functional alternations involving the right angular gyrus. The methodological aspects, patient characteristics and clinical variables of the included studies were heterogeneous, and we cannot exclude medication effects. The present study showed overlapping anatomic and functional brain abnormalities mainly in the default mode (DMN) and auditory networks (AN) in drug-free patients with schizophrenia. However, the pattern of changes differed in these networks. Decreased grey matter was associated with decreased activation within the DMN

Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval

Science.gov (United States)

Bonnici, Heidi M.; Richter, Franziska R.; Yazar, Yasemin

2016-01-01

Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. SIGNIFICANCE STATEMENT Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (An

Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval.

Science.gov (United States)

Bonnici, Heidi M; Richter, Franziska R; Yazar, Yasemin; Simons, Jon S

2016-05-18

Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (AnG) contribute to the retrieval of

Multimodal imaging analysis of single-photon emission computed tomography and magnetic resonance tomography for improving diagnosis of Parkinson's disease

International Nuclear Information System (INIS)

Barthel, H.; Georgi, P.; Slomka, P.; Dannenberg, C.; Kahn, T.

2000-01-01

Parkinson's disease (PD) is characterized by a degeneration of nigrostriated dopaminergic neurons, which can be imaged with 123 I-labeled 2β-carbomethoxy-3β-(4-iodophenyl) tropane ([ 123 I]β-CIT) and single-photon emission computed tomography (SPECT). However, the quality of the region of interest (ROI) technique used for quantitative analysis of SPECT data is compromised by limited anatomical information in the images. We investigated whether the diagnosis of PD can be improved by combining the use of SPECT images with morphological image data from magnetic resonance imaging (MRI)/computed tomography (CT). We examined 27 patients (8 men, 19 women; aged 55±13 years) with PD (Hoehn and Yahr stage 2.1±0.8) by high-resolution [ 123 I]β-CIT SPECT (185-200 MBq, Ceraspect camera). SPECT images were analyzed both by a unimodal technique (ROIs defined directly within the SPECT studies) and a multimodal technique (ROIs defined within individual MRI/CT studies and transferred to the corresponding interactively coregistered SPECT studies). [ 123 I]β-CIT binding ratios (cerebellum as reference), which were obtained for heads of caudate nuclei (CA), putamina (PU), and global striatal structures were compared with clinical parameters. Differences between contra- and ipsilateral (related to symptom dominance) striatal [ 123 I]β-CIT binding ratios proved to be larger in the multimodal ROI technique than in the unimodal approach (e.g., for PU: 1.2*** vs. 0.7**). Binding ratios obtained by the unimodal ROI technique were significantly correlated with those of the multimodal technique (e.g., for CA: y=0.97x+2.8; r=0.70; P com subscore (r=-0.49* vs. -0.32). These results show that the impact of [ 123 I]β-CIT SPECT for diagnosing PD is affected by the method used to analyze the SPECT images. The described multimodal approach, which is based on coregistration of SPECT and morphological imaging data, leads to improved determination of the degree of this dopaminergic disorder

Polarization Characterization of a Multi-Moded Feed Structure

Data.gov (United States)

National Aeronautics and Space Administration — The Polarization Characterization of a Multi-Moded Feed Structure projects characterize the polarization response of a multi-moded feed horn as an innovative...

Adaptive multimodal interaction in mobile augmented reality: A conceptual framework

Science.gov (United States)

Abidin, Rimaniza Zainal; Arshad, Haslina; Shukri, Saidatul A'isyah Ahmad

2017-10-01

Recently, Augmented Reality (AR) is an emerging technology in many mobile applications. Mobile AR was defined as a medium for displaying information merged with the real world environment mapped with augmented reality surrounding in a single view. There are four main types of mobile augmented reality interfaces and one of them are multimodal interfaces. Multimodal interface processes two or more combined user input modes (such as speech, pen, touch, manual gesture, gaze, and head and body movements) in a coordinated manner with multimedia system output. In multimodal interface, many frameworks have been proposed to guide the designer to develop a multimodal applications including in augmented reality environment but there has been little work reviewing the framework of adaptive multimodal interface in mobile augmented reality. The main goal of this study is to propose a conceptual framework to illustrate the adaptive multimodal interface in mobile augmented reality. We reviewed several frameworks that have been proposed in the field of multimodal interfaces, adaptive interface and augmented reality. We analyzed the components in the previous frameworks and measure which can be applied in mobile devices. Our framework can be used as a guide for designers and developer to develop a mobile AR application with an adaptive multimodal interfaces.

The Generic Structure of Print Advertisement of Elizabeth Arden’s INTERVENE: A Multimodal Discourse Analysis

Directory of Open Access Journals (Sweden)

Aylanda Dwi Nugroho

2009-01-01

Full Text Available The Elizabeth Arden campaign with Catherine Zeta-Jones as the brand ambassador has deployed the semiotic resources of language and visual images. The analysis of this paper is based on the systemic functional linguistics (SFL proposed by Halliday (1985, 1994 and Halliday and Matthiessen (2004, which says that a text is understood to simultaneously function three metafunctions: Ideational, Interpersonal and Textual. O’Toole’s (1994 framework of analysing visual images, which follows the main concept of SFL, is also used in the analysis. A multimodal discourse analysis is then applied to analyse one of the series, Intervene, using Cheong’s framework (2004, which combined both frameworks to find the generic structure of this advertisement. Further, this paper also analyses the intersemiosis of the linguistic and the visual resources using Wee’s (2009 intersemiotic mechanisms. It concludes that the interplay of the language and the visual image has proved to be very effective in the meaning-making process of this print advertisement.

Basic complex analysis a comprehensive course in analysis, part 2a

CERN Document Server

Simon, Barry

2015-01-01

A Comprehensive Course in Analysis by Poincaré Prize winner Barry Simon is a five-volume set that can serve as a graduate-level analysis textbook with a lot of additional bonus information, including hundreds of problems and numerous notes that extend the text and provide important historical background. Depth and breadth of exposition make this set a valuable reference source for almost all areas of classical analysis. Part 2A is devoted to basic complex analysis. It interweaves three analytic threads associated with Cauchy, Riemann, and Weierstrass, respectively. Cauchy's view focuses on th

Filter. Remix. Make.: Cultivating Adaptability through Multimodality

Science.gov (United States)

Dusenberry, Lisa; Hutter, Liz; Robinson, Joy

2015-01-01

This article establishes traits of adaptable communicators in the 21st century, explains why adaptability should be a goal of technical communication educators, and shows how multimodal pedagogy supports adaptability. Three examples of scalable, multimodal assignments (infographics, research interviews, and software demonstrations) that evidence…

Neurofunctional maps of the 'maternal brain' and the effects of oxytocin: a multimodal voxel-based meta-analysis.

Science.gov (United States)

Rocchetti, Matteo; Radua, Joaquim; Paloyelis, Yannis; Xenaki, Lida-Alkisti; Frascarelli, Marianna; Caverzasi, Edgardo; Politi, Pierluigi; Fusar-Poli, Paolo

2014-10-01

Several studies have tried to understand the possible neurobiological basis of mothering. The putative involvement of oxytocin, in this regard, has been deeply investigated. Performing a voxel-based meta-analysis, we aimed at testing the hypothesis of overlapping brain activation in functional magnetic resonance imaging (fMRI) studies investigating the mother-infant interaction and the oxytocin modulation of emotional stimuli in humans. We performed two systematic literature searches: fMRI studies investigating the neurofunctional correlates of the 'maternal brain' by employing mother-infant paradigms; and fMRI studies employing oxytocin during emotional tasks. A unimodal voxel-based meta-analysis was performed on each database, whereas a multimodal voxel-based meta-analytical tool was adopted to assess the hypothesis that the neurofunctional effects of oxytocin are detected in brain areas implicated in the 'maternal brain.' We found greater activation in the bilateral insula extending to the inferior frontal gyrus, basal ganglia and thalamus during mother-infant interaction and greater left insular activation associated with oxytocin administration versus placebo. Left insula extending to basal ganglia and frontotemporal gyri as well as bilateral thalamus and amygdala showed consistent activation across the two paradigms. Right insula also showed activation across the two paradigms, and dorsomedial frontal cortex activation in mothers but deactivation with oxytocin. Significant activation in areas involved in empathy, emotion regulation, motivation, social cognition and theory of mind emerged from our multimodal meta-analysis, supporting the need for further studies directly investigating the neurobiology of oxytocin in the mother-infant relationship. © 2014 The Authors. Psychiatry and Clinical Neurosciences © 2014 Japanese Society of Psychiatry and Neurology.

Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

Directory of Open Access Journals (Sweden)

Jing-Yu Yang

2012-04-01

Full Text Available When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person’s overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA. Specifically, one person’s different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

Integration of geospatial multi-mode transportation Systems in Kuala Lumpur

Science.gov (United States)

Ismail, M. A.; Said, M. N.

2014-06-01

Public transportation serves people with mobility and accessibility to workplaces, health facilities, community resources, and recreational areas across the country. Development in the application of Geographical Information Systems (GIS) to transportation problems represents one of the most important areas of GIS-technology today. To show the importance of GIS network analysis, this paper highlights the determination of the optimal path between two or more destinations based on multi-mode concepts. The abstract connector is introduced in this research as an approach to integrate urban public transportation in Kuala Lumpur, Malaysia including facilities such as Light Rapid Transit (LRT), Keretapi Tanah Melayu (KTM) Komuter, Express Rail Link (ERL), KL Monorail, road driving as well as pedestrian modes into a single intelligent data model. To assist such analysis, ArcGIS's Network Analyst functions are used whereby the final output includes the total distance, total travelled time, directional maps produced to find the quickest, shortest paths, and closest facilities based on either time or distance impedance for multi-mode route analysis.

Integration of geospatial multi-mode transportation Systems in Kuala Lumpur

International Nuclear Information System (INIS)

Ismail, M A; Said, M N

2014-01-01

Public transportation serves people with mobility and accessibility to workplaces, health facilities, community resources, and recreational areas across the country. Development in the application of Geographical Information Systems (GIS) to transportation problems represents one of the most important areas of GIS-technology today. To show the importance of GIS network analysis, this paper highlights the determination of the optimal path between two or more destinations based on multi-mode concepts. The abstract connector is introduced in this research as an approach to integrate urban public transportation in Kuala Lumpur, Malaysia including facilities such as Light Rapid Transit (LRT), Keretapi Tanah Melayu (KTM) Komuter, Express Rail Link (ERL), KL Monorail, road driving as well as pedestrian modes into a single intelligent data model. To assist such analysis, ArcGIS's Network Analyst functions are used whereby the final output includes the total distance, total travelled time, directional maps produced to find the quickest, shortest paths, and closest facilities based on either time or distance impedance for multi-mode route analysis

Using miscue analysis to assess comprehension in deaf college readers.

Science.gov (United States)

Albertini, John; Mayer, Connie

2011-01-01

For over 30 years, teachers have used miscue analysis as a tool to assess and evaluate the reading abilities of hearing students in elementary and middle schools and to design effective literacy programs. More recently, teachers of deaf and hard-of-hearing students have also reported its usefulness for diagnosing word- and phrase-level reading difficulties and for planning instruction. To our knowledge, miscue analysis has not been used with older, college-age deaf students who might also be having difficulty decoding and understanding text at the word level. The goal of this study was to determine whether such an analysis would be helpful in identifying the source of college students' reading comprehension difficulties. After analyzing the miscues of 10 college-age readers and the results of other comprehension-related tasks, we concluded that comprehension of basic grade school-level passages depended on the ability to recognize and comprehend key words and phrases in these texts. We also concluded that these diagnostic procedures provided useful information about the reading abilities and strategies of each reader that had implications for designing more effective interventions.

Multimodal Pedagogies for Teacher Education in TESOL

Science.gov (United States)

Yi, Youngjoo; Angay-Crowder, Tuba

2016-01-01

As a growing number of English language learners (ELLs) engage in digital and multimodal literacy practices in their daily lives, teachers are starting to incorporate multimodal approaches into their instruction. However, anecdotal and empirical evidence shows that teachers often feel unprepared for integrating such practices into their curricula…

Modality. Commitment, Truth Value and Reality Claims Across Modes in Multimodal Novels

DEFF Research Database (Denmark)

Nørgaard, Nina

2010-01-01

to the description and analysis of literary texts which – in addition to wording – make use of other semiotic modes such as typography, visual images, colour and layout for their meaning-making. The approach to multimodality deployed and examined is that proposed, for instance, by Kress and van Leeuwen (e.g. 1996...... to the analysis of two explicitly multimodal novels, with particular focus on the realisation of modality in visual images and typography. The texts put up for analysis are Alexander Masters’ Stuart. A Life Backwards and Jonathan Safran Foer’s Extremely Loud and Incredibly Close. While Kress and van Leeuwen...... of Masters’ and Foer’s sporadic use of special typography, in turn, reveals that although some of Kress and van Leeuwen’s modality parameters may be applicable to typography, the descriptive system is clearly less adequate in a typographic context where further work is needed before workable tools can...

Implications of Multimodal Learning Models for foreign language teaching and learning

Directory of Open Access Journals (Sweden)

Miguel Farías

2011-04-01

Full Text Available This literature review article approaches the topic of information and communications technologies from the perspective of their impact on the language learning process, with particular emphasis on the most appropriate designs of multimodal texts as informed by models of multimodal learning. The first part contextualizes multimodality within the fields of discourse studies, the psychology of learning and CALL; the second, deals with multimodal conceptions of reading and writing by discussing hypertextuality and literacy. A final section outlines the possible implications of multimodal learning models for foreign language teaching and learning.

Spatiotemporal Analysis of RGB-D-T Facial Images for Multimodal Pain Level Recognition

DEFF Research Database (Denmark)

Irani, Ramin; Nasrollahi, Kamal; Oliu Simon, Marc

2015-01-01

facial images for pain detection and pain intensity level recognition. For this purpose, we extract energies released by facial pixels using a spatiotemporal filter. Experiments on a group of 12 elderly people applying the multimodal approach show that the proposed method successfully detects pain...

Neuronal pathology in deep grey matter structures: a multimodal imaging analysis combining PET and MRI

Energy Technology Data Exchange (ETDEWEB)

Bosque-Freeman, L.; Leroy, C.; Galanaud, D.; Sureau, F.; Assouad, R.; Tourbah, A.; Papeix, C.; Comtat, C.; Trebossen, R.; Lubetzki, C.; Delforge, J.; Bottlaender, M.; Stankoff, B. [Serv. Hosp. Frederic Joliot, Orsay (France)

2009-07-01

Objective: To assess neuronal damage in deep gray matter structures by positron emission tomography (PET) using [{sup 11}C]-flumazenil (FMZ), a specific central benzodiazepine receptor antagonist, and [{sup 18}F]-fluorodeoxyglucose (FDG), which reflects neuronal metabolism. To compare results obtained by PET and those with multimodal magnetic resonance imaging (MRI). Background: It is now accepted that neuronal injury plays a crucial role in the occurrence and progression of neurological disability in multiple sclerosis (MS). To date, available MRI techniques do not specifically assess neuronal damage, but early abnormalities, such as iron deposition or atrophy, have been described in deep gray matter structures. Whether those MRI modifications correspond to neuronal damage remains to be further investigated. Materials and methods: Nine healthy volunteers were compared to 10 progressive and 9 relapsing remitting (RR) MS patients. Each subject performed two PET examinations with [{sup 11}C]-FMZ and [{sup 18}F]-FDG, on a high resolution research tomograph dedicated to brain imaging (Siemens Medical Solution, spatial resolution of 2.5 mm). Deep gray matter regions were manually segmented on T1-weighted MR images with the mutual information algorithm (www.brainvisa.info), and co-registered with PET images. A multimodal MRI including T1 pre and post gadolinium, T2-proton density sequences, magnetization transfer, diffusion tensor, and protonic spectroscopy was also performed for each subject. Results: On PET with [{sup 11}C]-FMZ, there was a pronounced decrease in receptor density for RR patients in all deep gray matter structures investigated, whereas the density was unchanged or even increased in the same regions for progressive patients. Whether the different patterns between RR and progressive patients reflect distinct pathogenic mechanisms is currently investigated by comparing PET and multimodal MRI results. Conclusion: Combination of PET and multimodal MR imaging

Reflection effects in multimode fiber systems utilizing laser transmitters

Science.gov (United States)

Bates, Harry E.

1991-11-01

A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.

The Influence of Presentation Modality on the Social Comprehension of Naturalistic Scenes in Adults with Autism Spectrum Disorder

Science.gov (United States)

Gedek, Haley M.; Pantelis, Peter C.; Kennedy, Daniel P.

2018-01-01

The comprehension of dynamically unfolding social situations is made possible by the seamless integration of multimodal information merged with rich intuitions about the thoughts and behaviors of others. We examined how high-functioning adults with autism spectrum disorder and neurotypical controls made a complex social judgment (i.e. rating the…

Impact of comprehensive two-dimensional gas chromatography with mass spectrometry on food analysis.

Science.gov (United States)

Tranchida, Peter Q; Purcaro, Giorgia; Maimone, Mariarosa; Mondello, Luigi

2016-01-01

Comprehensive two-dimensional gas chromatography with mass spectrometry has been on the separation-science scene for about 15 years. This three-dimensional method has made a great positive impact on various fields of research, and among these that related to food analysis is certainly at the forefront. The present critical review is based on the use of comprehensive two-dimensional gas chromatography with mass spectrometry in the untargeted (general qualitative profiling and fingerprinting) and targeted analysis of food volatiles; attention is focused not only on its potential in such applications, but also on how recent advances in comprehensive two-dimensional gas chromatography with mass spectrometry will potentially be important for food analysis. Additionally, emphasis is devoted to the many instances in which straightforward gas chromatography with mass spectrometry is a sufficiently-powerful analytical tool. Finally, possible future scenarios in the comprehensive two-dimensional gas chromatography with mass spectrometry food analysis field are discussed. © 2015 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

TU-C-BRD-01: Image Guided SBRT I: Multi-Modality 4D Imaging

International Nuclear Information System (INIS)

Cai, J; Mageras, G; Pan, T

2014-01-01

Motion management is one of the critical technical challenges for radiation therapy. 4D imaging has been rapidly adopted as essential tool to assess organ motion associated with respiratory breathing. A variety of 4D imaging techniques have been developed and are currently under development based on different imaging modalities such as CT, MRI, PET, and CBCT. Each modality provides specific and complementary information about organ and tumor respiratory motion. Effective use of each different technique or combined use of different techniques can introduce a comprehensive management of tumor motion. Specifically, these techniques have afforded tremendous opportunities to better define and delineate tumor volumes, more accurately perform patient positioning, and effectively apply highly conformal therapy techniques such as IMRT and SBRT. Successful implementation requires good understanding of not only each technique, including unique features, limitations, artifacts, imaging acquisition and process, but also how to systematically apply the information obtained from different imaging modalities using proper tools such as deformable image registration. Furthermore, it is important to understand the differences in the effects of breathing variation between different imaging modalities. A comprehensive motion management strategy using multi-modality 4D imaging has shown promise in improving patient care, but at the same time faces significant challenges. This session will focuses on the current status and advances in imaging respiration-induced organ motion with different imaging modalities: 4D-CT, 4D-MRI, 4D-PET, and 4D-CBCT/DTS. Learning Objectives: Understand the need and role of multimodality 4D imaging in radiation therapy. Understand the underlying physics behind each 4D imaging technique. Recognize the advantages and limitations of each 4D imaging technique

Fiber-Optic Vibration Sensor Based on Multimode Fiber

Directory of Open Access Journals (Sweden)

I. Lujo

2008-06-01

Full Text Available The purpose of this paper is to present a fiberoptic vibration sensor based on the monitoring of the mode distribution in a multimode optical fiber. Detection of vibrations and their parameters is possible through observation of the output speckle pattern from the multimode optical fiber. A working experimental model has been built in which all used components are widely available and cheap: a CCD camera (a simple web-cam, a multimode laser in visible range as a light source, a length of multimode optical fiber, and a computer for signal processing. Measurements have shown good agreement with the actual frequency of vibrations, and promising results were achieved with the amplitude measurements although they require some adaptation of the experimental model. Proposed sensor is cheap and lightweight and therefore presents an interesting alternative for monitoring large smart structures.

Multi-Modality Medical Image Fusion Based on Wavelet Analysis and Quality Evaluation

Institute of Scientific and Technical Information of China (English)

无

2001-01-01

Multi-modality medical image fusion has more and more important applications in medical image analysisand understanding. In this paper, we develop and apply a multi-resolution method based on wavelet pyramid to fusemedical images from different modalities such as PET-MRI and CT-MRI. In particular, we evaluate the different fusionresults when applying different selection rules and obtain optimum combination of fusion parameters.

Concepts for space nuclear multi-mode reactors

International Nuclear Information System (INIS)

Myrabo, L.; Botts, T.E.; Powell, J.R.

1983-01-01

A number of nuclear multi-mode reactor power plants are conceptualized for use with solid core, fixed particle bed and rotating particle bed reactors. Multi-mode systems generate high peak electrical power in the open cycle mode, with MHD generator or turbogenerator converters and cryogenically stored coolants. Low level stationkeeping power and auxiliary reactor cooling (i.e., for the removal of reactor afterheat) are provided in a closed cycle mode. Depending on reactor design, heat transfer to the low power converters can be accomplished by heat pipes, liquid metal coolants or high pressure gas coolants. Candidate low power conversion cycles include Brayton turbogenerator, Rankine turbogenerator, thermoelectric and thermionic approaches. A methodology is suggested for estimating the system mass of multi-mode nuclear power plants as a function of peak electric power level and required mission run time. The masses of closed cycle nuclear and open cycle chemical power systems are briefly examined to identify the regime of superiority for nuclear multi-mode systems. Key research and technology issues for such power plants are also identified

Digital Storytelling and Multimodal Literacy in Education

OpenAIRE

Gregori-Signes, Carmen

2014-01-01

This article argues in favour of using digital storytelling to encourage a critical socio-educational focus in education and include multimodal explicit teaching in the curriculum.The analysis of fifty digital stories indicates that the students developed a certain awareness of the issue chosen for their story (e.g. violence, racism, war) since the final product transmits a critical perspective on the topic itself. Further work, however, needs to be invested in the development of the digital ...

Multimode optical fibers: steady state mode exciter.

Science.gov (United States)

Ikeda, M; Sugimura, A; Ikegami, T

1976-09-01

The steady state mode power distribution of the multimode graded index fiber was measured. A simple and effective steady state mode exciter was fabricated by an etching technique. Its insertion loss was 0.5 dB for an injection laser. Deviation in transmission characteristics of multimode graded index fibers can be avoided by using the steady state mode exciter.

Deterministic multimode photonic device for quantum-information processing

DEFF Research Database (Denmark)

Nielsen, Anne E. B.; Mølmer, Klaus

2010-01-01

We propose the implementation of a light source that can deterministically generate a rich variety of multimode quantum states. The desired states are encoded in the collective population of different ground hyperfine states of an atomic ensemble and converted to multimode photonic states by exci...

Multimodal network design for sustainable household plastic recycling

NARCIS (Netherlands)

Bing Xiaoyun, Xiaoyun; Groot, J.J.; Bloemhof, J.M.; Vorst, van der J.G.A.J.

2013-01-01

Purpose – This research studies a plastic recycling system from a reverse logistics angle and investigates the potential benefits of a multimodality strategy to the network design of plastic recycling. This research aims to quantify the impact of multimodality on the network, to provide decision

Multimodal warnings to enhance risk communication and safety

NARCIS (Netherlands)

Haas, E.C.; Erp, J.B.F. van

2014-01-01

Multimodal warnings incorporate audio and/or skin-based (tactile) cues to supplement or replace visual cues in environments where the user’s visual perception is busy, impaired, or nonexistent. This paper describes characteristics of audio, tactile, and multimodal warning displays and their role in

Comprehensive School Reform and Achievement: A Meta-Analysis

Science.gov (United States)

Borman, Geoffrey D.; Hewes, Gina M.; Overman, Laura T.; Brown, Shelly

2003-01-01

This meta-analysis reviews research on the achievement effects of comprehensive school reform (CSR) and summarizes the specific effects of 29 widely implemented models. There are limitations on the overall quantity and quality of the research base, but the overall effects of CSR appear promising. The combined quantity, quality, and statistical…

Multimodal Self-Authoring across Bi/Multilingual Educator and Student Learning Spaces

Science.gov (United States)

Valdez, Verónica E.; Omerbašic, Delila

2015-01-01

Drawing on sociocultural perspectives, this article illustrates the potential for extending figured worlds through cultural artifacts. Using thematic and multimodal analysis, the authors first compare how spaces of authoring were produced in two professional development settings: Proyecto Bilingüe and Critical Education Studies. Following one…

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer's Disease Diagnosis.

Science.gov (United States)

Liu, Manhua; Cheng, Danni; Wang, Kundong; Wang, Yaping

2018-03-23

Accurate and early diagnosis of Alzheimer's disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer's Disease Neuroimaging

Comprehensive benefit analysis of regional water resources based on multi-objective evaluation

Science.gov (United States)

Chi, Yixia; Xue, Lianqing; Zhang, Hui

2018-01-01

The purpose of the water resources comprehensive benefits analysis is to maximize the comprehensive benefits on the aspects of social, economic and ecological environment. Aiming at the defects of the traditional analytic hierarchy process in the evaluation of water resources, it proposed a comprehensive benefit evaluation of social, economic and environmental benefits index from the perspective of water resources comprehensive benefit in the social system, economic system and environmental system; determined the index weight by the improved fuzzy analytic hierarchy process (AHP), calculated the relative index of water resources comprehensive benefit and analyzed the comprehensive benefit of water resources in Xiangshui County by the multi-objective evaluation model. Based on the water resources data in Xiangshui County, 20 main comprehensive benefit assessment factors of 5 districts belonged to Xiangshui County were evaluated. The results showed that the comprehensive benefit of Xiangshui County was 0.7317, meanwhile the social economy has a further development space in the current situation of water resources.

Raman Plus X: Biomedical Applications of Multimodal Raman Spectroscopy.

Science.gov (United States)

Das, Nandan K; Dai, Yichuan; Liu, Peng; Hu, Chuanzhen; Tong, Lieshu; Chen, Xiaoya; Smith, Zachary J

2017-07-07

Raman spectroscopy is a label-free method of obtaining detailed chemical information about samples. Its compatibility with living tissue makes it an attractive choice for biomedical analysis, yet its translation from a research tool to a clinical tool has been slow, hampered by fundamental Raman scattering issues such as long integration times and limited penetration depth. In this review we detail the how combining Raman spectroscopy with other techniques yields multimodal instruments that can help to surmount the translational barriers faced by Raman alone. We review Raman combined with several optical and non-optical methods, including fluorescence, elastic scattering, OCT, phase imaging, and mass spectrometry. In each section we highlight the power of each combination along with a brief history and presentation of representative results. Finally, we conclude with a perspective detailing both benefits and challenges for multimodal Raman measurements, and give thoughts on future directions in the field.

HCIDL: Human-computer interface description language for multi-target, multimodal, plastic user interfaces

Directory of Open Access Journals (Sweden)

Lamia Gaouar

2018-06-01

Full Text Available From the human-computer interface perspectives, the challenges to be faced are related to the consideration of new, multiple interactions, and the diversity of devices. The large panel of interactions (touching, shaking, voice dictation, positioning … and the diversification of interaction devices can be seen as a factor of flexibility albeit introducing incidental complexity. Our work is part of the field of user interface description languages. After an analysis of the scientific context of our work, this paper introduces HCIDL, a modelling language staged in a model-driven engineering approach. Among the properties related to human-computer interface, our proposition is intended for modelling multi-target, multimodal, plastic interaction interfaces using user interface description languages. By combining plasticity and multimodality, HCIDL improves usability of user interfaces through adaptive behaviour by providing end-users with an interaction-set adapted to input/output of terminals and, an optimum layout. Keywords: Model driven engineering, Human-computer interface, User interface description languages, Multimodal applications, Plastic user interfaces

Performance of Series Connected GaAs Photovoltaic Converters under Multimode Optical Fiber Illumination

Directory of Open Access Journals (Sweden)

Tiqiang Shan

2014-01-01

Full Text Available In many military and industrial applications, GaAs photovoltaic (PV converters are connected in series in order to generate the required voltage compatible with most common electronics. Multimode optical fibers are usually used to carry high-intensity laser and illuminate the series connected GaAs PV converters in real time. However, multimode optical fiber illumination has a speckled intensity pattern. The series connected PV array is extremely sensitive to nonuniform illumination; its performance is limited severely by the converter that is illuminated the least. This paper quantifies the effects of multimode optical fiber illumination on the performance of series connected GaAs PV converters, analyzes the loss mechanisms due to speckles, and discusses the maximum illumination efficiency. In order to describe the illumination dependent behavior detailedly, modeling of the series connected PV array is accomplished based on the equivalent circuit for PV cells. Finally, a series of experiments are carried out to demonstrate the theory analysis.

Multimodality 3D Superposition and Automated Whole Brain Tractography: Comprehensive Printing of the Functional Brain.

Science.gov (United States)

Konakondla, Sanjay; Brimley, Cameron J; Sublett, Jesna Mathew; Stefanowicz, Edward; Flora, Sarah; Mongelluzzo, Gino; Schirmer, Clemens M

2017-09-29

Whole brain tractography using diffusion tensor imaging (DTI) sequences can be used to map cerebral connectivity; however, this can be time-consuming due to the manual component of image manipulation required, calling for the need for a standardized, automated, and accurate fiber tracking protocol with automatic whole brain tractography (AWBT). Interpreting conventional two-dimensional (2D) images, such as computed tomography (CT) and magnetic resonance imaging (MRI), as an intraoperative three-dimensional (3D) environment is a difficult task with recognized inter-operator variability. Three-dimensional printing in neurosurgery has gained significant traction in the past decade, and as software, equipment, and practices become more refined, trainee education, surgical skills, research endeavors, innovation, patient education, and outcomes via valued care is projected to improve. We describe a novel multimodality 3D superposition (MMTS) technique, which fuses multiple imaging sequences alongside cerebral tractography into one patient-specific 3D printed model. Inferences on cost and improved outcomes fueled by encouraging patient engagement are explored.

Going political – multimodal metaphor framings on a cover of the sports newspaper A Bola

Directory of Open Access Journals (Sweden)

Maria Clotilde Almeida

2016-12-01

Full Text Available This paper analyses a political-oriented multimodal metaphor on a cover of the sports newspaper A Bola, sequencing another study on multimodal metaphors deployed on the covers of the very same sports newspaper pertaining to the 2014 Football World Cup in Brazil (Almeida/Sousa, 2015 in the light of Forceville (2009, 2012. The fact that European politics is mapped onto football in multimodal metaphors on this sports newspaper cover draws on the interplay of conceptual metaphors, respectively in the visual mode and in the written mode. Furthermore, there is a relevant time-bound leitmotif which motivates the mapping of politics onto football in the sports newspaper A Bola, namely the upcoming football match between Portugal and Germany. In the multimodal framing of the story line under analysis. The visual mode apparently assumes preponderance, since a picture of Angela Merkel, a prominent leader of EU, is clearly overshadowed by a large picture of Cristiano Ronaldo, the captain of the Portuguese National Football team. However, the visual modality of Cristiano Ronaldo’s dominance over Angela Merkel is intertwined with the powerful metaphorical headline “Vamos expulsar a Alemanha do Euro” (“Let’s kick Germany out of the European Championship”, intended to boost the courage of the Portuguese national football team: “Go Portugal – you can win this time!”. Thus, differently from multimodal metaphors on other covers of the same newspaper, the visual modality in this case cannot be considered the dominant factor in multimodal meaning creation in this politically-oriented layout.Keywords: Multimodal Metaphors. Sports and Politics. Metaphors in Sports Newspapers.

Arbitrary-ratio power splitter based on nonlinear multimode interference coupler

International Nuclear Information System (INIS)

Tajaldini, Mehdi; Jafri, Mohd Zubir Mat

2015-01-01

We propose an ultra-compact multimode interference (MMI) power splitter based on nonlinear effects from simulations using nonlinear modal propagation analysis (NMPA) cooperation with finite difference Method (FDM) to access free choice of splitting ratio. Conventional multimode interference power splitter could only obtain a few discrete ratios. The power splitting ratio may be adjusted continuously while the input set power is varying by a tunable laser. In fact, using an ultra- compact MMI with a simple structure that is launched by a tunable nonlinear input fulfills the problem of arbitrary-ratio in integrated photonics circuits. Silicon on insulator (SOI) is used as the offered material due to the high contrast refractive index and Centro symmetric properties. The high-resolution images at the end of the multimode waveguide in the simulated power splitter have a high power balance, whereas access to a free choice of splitting ratio is not possible under the linear regime in the proposed length range except changes in the dimension for any ratio. The compact dimensions and ideal performance of the device are established according to optimized parameters. The proposed regime can be extended to the design of M×N arbitrary power splitters ratio for programmable logic devices in all optical digital signal processing. The results of this study indicate that nonlinear modal propagation analysis solves the miniaturization problem for all-optical devices based on MMI couplers to achieve multiple functions in a compact planar integrated circuit and also overcomes the limitations of previously proposed methods for nonlinear MMI

Arbitrary-ratio power splitter based on nonlinear multimode interference coupler

Energy Technology Data Exchange (ETDEWEB)

Tajaldini, Mehdi [School of Physics, Universiti Sains Malaysia, 11800 Pulau Pinang (Malaysia); Young Researchers and Elite Club, Baft Branch, Islamic Azad University, Baft (Iran, Islamic Republic of); Jafri, Mohd Zubir Mat [School of Physics, Universiti Sains Malaysia, 11800 Pulau Pinang (Malaysia)

2015-04-24

We propose an ultra-compact multimode interference (MMI) power splitter based on nonlinear effects from simulations using nonlinear modal propagation analysis (NMPA) cooperation with finite difference Method (FDM) to access free choice of splitting ratio. Conventional multimode interference power splitter could only obtain a few discrete ratios. The power splitting ratio may be adjusted continuously while the input set power is varying by a tunable laser. In fact, using an ultra- compact MMI with a simple structure that is launched by a tunable nonlinear input fulfills the problem of arbitrary-ratio in integrated photonics circuits. Silicon on insulator (SOI) is used as the offered material due to the high contrast refractive index and Centro symmetric properties. The high-resolution images at the end of the multimode waveguide in the simulated power splitter have a high power balance, whereas access to a free choice of splitting ratio is not possible under the linear regime in the proposed length range except changes in the dimension for any ratio. The compact dimensions and ideal performance of the device are established according to optimized parameters. The proposed regime can be extended to the design of M×N arbitrary power splitters ratio for programmable logic devices in all optical digital signal processing. The results of this study indicate that nonlinear modal propagation analysis solves the miniaturization problem for all-optical devices based on MMI couplers to achieve multiple functions in a compact planar integrated circuit and also overcomes the limitations of previously proposed methods for nonlinear MMI.

SU-E-I-83: Error Analysis of Multi-Modality Image-Based Volumes of Rodent Solid Tumors Using a Preclinical Multi-Modality QA Phantom

Energy Technology Data Exchange (ETDEWEB)

Lee, Y [University of Kansas Hospital, Kansas City, KS (United States); Fullerton, G; Goins, B [University of Texas Health Science Center at San Antonio, San Antonio, TX (United States)

2015-06-15

Purpose: In our previous study a preclinical multi-modality quality assurance (QA) phantom that contains five tumor-simulating test objects with 2, 4, 7, 10 and 14 mm diameters was developed for accurate tumor size measurement by researchers during cancer drug development and testing. This study analyzed the errors during tumor volume measurement from preclinical magnetic resonance (MR), micro-computed tomography (micro- CT) and ultrasound (US) images acquired in a rodent tumor model using the preclinical multi-modality QA phantom. Methods: Using preclinical 7-Tesla MR, US and micro-CT scanners, images were acquired of subcutaneous SCC4 tumor xenografts in nude rats (3–4 rats per group; 5 groups) along with the QA phantom using the same imaging protocols. After tumors were excised, in-air micro-CT imaging was performed to determine reference tumor volume. Volumes measured for the rat tumors and phantom test objects were calculated using formula V = (π/6)*a*b*c where a, b and c are the maximum diameters in three perpendicular dimensions determined by the three imaging modalities. Then linear regression analysis was performed to compare image-based tumor volumes with the reference tumor volume and known test object volume for the rats and the phantom respectively. Results: The slopes of regression lines for in-vivo tumor volumes measured by three imaging modalities were 1.021, 1.101 and 0.862 for MRI, micro-CT and US respectively. For phantom, the slopes were 0.9485, 0.9971 and 0.9734 for MRI, micro-CT and US respectively. Conclusion: For both animal and phantom studies, random and systematic errors were observed. Random errors were observer-dependent and systematic errors were mainly due to selected imaging protocols and/or measurement method. In the animal study, there were additional systematic errors attributed to ellipsoidal assumption for tumor shape. The systematic errors measured using the QA phantom need to be taken into account to reduce measurement

A Selective Review of Multimodal Fusion Methods in Schizophrenia

Directory of Open Access Journals (Sweden)

Jing eSui

2012-02-01

Full Text Available Schizophrenia (SZ is one of the most cryptic and costly mental disorders in terms of human suffering and societal expenditure (van Os and Kapur, 2009. Though strong evidences for functional, structural and genetic abnormalities associated with this disease exist, there is yet no replicable finding which has proven accurate enough to be useful in clinical decision making (Fornito et al., 2009, and its diagnosis relies primarily upon symptom assessment (Williams et al., 2010a. It is likely in part that the lack of consistent neuroimaging findings is because most models favor only one data type or do not combine data from different imaging modalities effectively, thus missing potentially important differences which are only partially detected by each modality (Calhoun et al., 2006a. It is becoming increasingly clear that multi-modal fusion, a technique which takes advantage of the fact that each modality provides a limited view of the brain/gene and may uncover hidden relationships, is an important tool to help unravel the black box of schizophrenia. In this review paper, we survey a number of multimodal fusion applications which enable us to study the schizophrenia macro-connectome, including brain functional, structural and genetic aspects and may help us understand the disorder in a more comprehensive and integrated manner. We also provide a table that characterizes these applications by the methods used and compare these methods in detail, especially for multivariate models, which may serve as a valuable reference that helps readers select an appropriate method based on a given research.

Analysis of psychological factors for quality assessment of interactive multimodal service

Science.gov (United States)

Yamagishi, Kazuhisa; Hayashi, Takanori

2005-03-01

We proposed a subjective quality assessment model for interactive multimodal services. First, psychological factors of an audiovisual communication service were extracted by using the semantic differential (SD) technique and factor analysis. Forty subjects participated in subjective tests and performed point-to-point conversational tasks on a PC-based TV phone that exhibits various network qualities. The subjects assessed those qualities on the basis of 25 pairs of adjectives. Two psychological factors, i.e., an aesthetic feeling and a feeling of activity, were extracted from the results. Then, quality impairment factors affecting these two psychological factors were analyzed. We found that the aesthetic feeling is mainly affected by IP packet loss and video coding bit rate, and the feeling of activity depends on delay time and video frame rate. We then proposed an opinion model derived from the relationships among quality impairment factors, psychological factors, and overall quality. The results indicated that the estimation error of the proposed model is almost equivalent to the statistical reliability of the subjective score. Finally, using the proposed model, we discuss guidelines for quality design of interactive audiovisual communication services.

Multi-modal locomotion: from animal to application

International Nuclear Information System (INIS)

Lock, R J; Burgess, S C; Vaidyanathan, R

2014-01-01

The majority of robotic vehicles that can be found today are bound to operations within a single media (i.e. land, air or water). This is very rarely the case when considering locomotive capabilities in natural systems. Utility for small robots often reflects the exact same problem domain as small animals, hence providing numerous avenues for biological inspiration. This paper begins to investigate the various modes of locomotion adopted by different genus groups in multiple media as an initial attempt to determine the compromise in ability adopted by the animals when achieving multi-modal locomotion. A review of current biologically inspired multi-modal robots is also presented. The primary aim of this research is to lay the foundation for a generation of vehicles capable of multi-modal locomotion, allowing ambulatory abilities in more than one media, surpassing current capabilities. By identifying and understanding when natural systems use specific locomotion mechanisms, when they opt for disparate mechanisms for each mode of locomotion rather than using a synergized singular mechanism, and how this affects their capability in each medium, similar combinations can be used as inspiration for future multi-modal biologically inspired robotic platforms. (topical review)

Multimodal Scaffolding in the Secondary English Classroom Curriculum

Science.gov (United States)

Boche, Benjamin; Henning, Megan

2015-01-01

This article examines the topic of multimodal scaffolding in the secondary English classroom curriculum through the viewpoint of one teacher's experiences. With technology becoming more commonplace and readily available in the English classroom, we must pinpoint specific and tangible ways to help teachers use and teach multimodalities in their…

Optimal Face-Iris Multimodal Fusion Scheme

Directory of Open Access Journals (Sweden)

Omid Sharifi

2016-06-01

Full Text Available Multimodal biometric systems are considered a way to minimize the limitations raised by single traits. This paper proposes new schemes based on score level, feature level and decision level fusion to efficiently fuse face and iris modalities. Log-Gabor transformation is applied as the feature extraction method on face and iris modalities. At each level of fusion, different schemes are proposed to improve the recognition performance and, finally, a combination of schemes at different fusion levels constructs an optimized and robust scheme. In this study, CASIA Iris Distance database is used to examine the robustness of all unimodal and multimodal schemes. In addition, Backtracking Search Algorithm (BSA, a novel population-based iterative evolutionary algorithm, is applied to improve the recognition accuracy of schemes by reducing the number of features and selecting the optimized weights for feature level and score level fusion, respectively. Experimental results on verification rates demonstrate a significant improvement of proposed fusion schemes over unimodal and multimodal fusion methods.

Multimodal coaching and its application to workplace, life and health coaching

OpenAIRE

Stephen Palmer

2012-01-01

This article highlights how the multimodal approach (Lazarus, 1989) has been adapted to the field of coachingand coaching psychology. It covers the basic theories underpinning the multimodal approach and illustratesthe link between the theory and practice. Key multimodal strategies are covered including modalityprofiles, structural profiles, tracking and bridging.

Multimodal Discourse Strategies of Factuality and Subjectivity in Educational Digital Storytelling

Directory of Open Access Journals (Sweden)

Patricia Bou-Franch

2012-12-01

Full Text Available As new technologies continue to emerge, students and lecturers are provided with new educational tools. One such tool, which is increasingly used in higher education, is digital storytelling, i.e. multi-media digital narratives. Despite the increasing attention that education and media scholars have paid to digital storytelling, there is scant research examining digital narratives from a discourse-analytic perspective.This paper addresses this gap in the literature and, in line with the belief that individuals make meaning through a range of semiotic devices, including, among others, language, sound, graphics and text, it aims to examine discourse strategies of factuality and subjectivity in historical-cultural digital narratives and their multimodal realisations (Kress & Van Leeuwen 2001; Patrona 2005. To carry out this study a corpus of 16 digital stories was compiled and analysed from a multidisciplinary framework which draws from studies on digital storytelling, computer-mediated communication, media studies, and multimodal discourse analysis. Results show that students/digital story tellers resort to a number of varied multimodal discursive strategies which are constitutive of their identity as capable students in an educational setting.

Diffusion Maps for Multimodal Registration

Directory of Open Access Journals (Sweden)

Gemma Piella

2014-06-01

Full Text Available Multimodal image registration is a difficult task, due to the significant intensity variations between the images. A common approach is to use sophisticated similarity measures, such as mutual information, that are robust to those intensity variations. However, these similarity measures are computationally expensive and, moreover, often fail to capture the geometry and the associated dynamics linked with the images. Another approach is the transformation of the images into a common space where modalities can be directly compared. Within this approach, we propose to register multimodal images by using diffusion maps to describe the geometric and spectral properties of the data. Through diffusion maps, the multimodal data is transformed into a new set of canonical coordinates that reflect its geometry uniformly across modalities, so that meaningful correspondences can be established between them. Images in this new representation can then be registered using a simple Euclidean distance as a similarity measure. Registration accuracy was evaluated on both real and simulated brain images with known ground-truth for both rigid and non-rigid registration. Results showed that the proposed approach achieved higher accuracy than the conventional approach using mutual information.

Robustness of multimodal processes itineraries

DEFF Research Database (Denmark)

Bocewicz, G.; Banaszak, Z.; Nielsen, Izabela Ewa

2013-01-01

itineraries for assumed (O-D) trip. Since itinerary planning problem, constitutes a common routing and scheduling decision faced by travelers, hence the main question regards of itinerary replanning and particularly a method aimed at prototyping of mode sequences and paths selections. The declarative model......This paper concerns multimodal transport systems (MTS) represented by a supernetworks in which several unimodal networks are connected by transfer links and focuses on the scheduling problems encountered in these systems. Assuming unimodal networks are modeled as cyclic lines, i.e. the routes...... of multimodal processes driven itinerary planning problem is our main contribution. Illustrative examples providing alternative itineraries in some cases of MTS malfunction are presented....

Multimodal coaching and its application to workplace, life and health coaching

Directory of Open Access Journals (Sweden)

Stephen Palmer

2012-10-01

Full Text Available This article highlights how the multimodal approach (Lazarus, 1989 has been adapted to the field of coachingand coaching psychology. It covers the basic theories underpinning the multimodal approach and illustratesthe link between the theory and practice. Key multimodal strategies are covered including modalityprofiles, structural profiles, tracking and bridging.

Experiencia de enseñanza multimodal en una clase de idiomas [Experience of multimodal teaching in a language classroom

Directory of Open Access Journals (Sweden)

María Martínez Lirola

2013-12-01

Full Text Available Resumen: Nuestra sociedad es cada vez más tecnológica y multimodal por lo que es necesario que la enseñanza se adapte a los nuevos tiempos. Este artículo analiza el modo en que la asignatura Lengua Inglesa IV de la Licenciatura en Filología Inglesa en la Universidad de Alicante combina el desarrollo de las cinco destrezas (escucha, habla, lectura, escritura e interacción evaluadas por medio de un portafolio con la multimodalidad en las prácticas docentes y en cada una de las actividades que componen el portafolio. Los resultados de una encuesta preparada al final del curso académico 2011-2012 ponen de manifiesto las competencias principales que el alumnado universitario desarrolla gracias a la docencia multimodal y la importancia de las tutorías en este tipo de enseñanza. Abstract: Our society becomes more technological and multimodal and, consequently, teaching has to be adapted to the new time. This article analyses the way in which the subject English Language IV of the degree English Studies at the University of Alicante combines the development of the five skills (listening, speaking, reading, writing and interacting evaluated through a portfolio with multimodality in the teaching practices and in each of the activities that are part of the portfolio. The results of a survey prepared at the end of the academic year 2011-2012 point out the main competences that university students develop thanks to multimodal teaching and the importance of tutorials in this kind of teaching.

Multimodality

DEFF Research Database (Denmark)

Buhl, Mie

In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal’ communication, which should not be confused with the term ‘multimedia’. While multimedia...... and learning situations. The choices they make involve E-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very useful...

Multimodal freight investment criteria.

Science.gov (United States)

2010-07-01

Literature was reviewed on multi-modal investment criteria for freight projects, examining measures and techniques for quantifying project benefits and costs, as well as ways to describe the economic importance of freight transportation. : A limited ...

Language and Identity in Multimodal Text: Case Study of Thailand’s Bank Pamphlet

Directory of Open Access Journals (Sweden)

Korapat Pruekchaikul

2017-12-01

Full Text Available With the main objective of presenting a linguistic model for the analysis of identity construction in multimodal texts, particularly in advertising, this article attempts to integrate three theoretical frameworks, namely the types of discourse of the Socio-Discursive Interactionism, Greimas’ actantial roles and the symbolic processes of the Grammar of Visual Design proposed by Kress e van Leeuwen. The first two theories are used to analyze verbal language form whereas the third is exclusively for images in advertising. The data sample is a Thai bank pamphlet of Siam Commercial Bank, collected in Bangkok, Thailand, in June, 2015. According to the data analysis, the theoretical frameworks employed here proves that identity, the psychological product, exists in the human mind and can be indexed by language in interaction. Also, the analysis found that identity could be projected as multimodally as language manifestation, of which forms are not only verbal but also pictorial.

Multimodal follow-up questions to multimodal answers in a QA system

NARCIS (Netherlands)

van Schooten, B.W.; op den Akker, Hendrikus J.A.

2007-01-01

We are developing a dialogue manager (DM) for a multimodal interactive Question Answering (QA) system. Our QA system presents answers using text and pictures, and the user may pose follow-up questions using text or speech, while indicating screen elements with the mouse. We developed a corpus of

Multimodality and the literary text: making sense of Safran Foer's Extremely Loud and Incredibly Close

DEFF Research Database (Denmark)

Nørgaard, Nina

2010-01-01

This article explores the applicability of a multimodal framework to the analysis of literature. The framework adopted is that proposed by Kress and Van Leeuwen (2001) and Van Leeuwen (2005). In seeking to develop a detailed and consistent methodology that will allow us to deal with multimodal te...... typographies, graphics, colour, layout, photographic images etc. - emphatically invites an analytical approach designed to understand meaning-making as an interplay of different semiotic modes....

Reliability-Based Decision Fusion in Multimodal Biometric Verification Systems

Directory of Open Access Journals (Sweden)

Kryszczuk Krzysztof

2007-01-01

Full Text Available We present a methodology of reliability estimation in the multimodal biometric verification scenario. Reliability estimation has shown to be an efficient and accurate way of predicting and correcting erroneous classification decisions in both unimodal (speech, face, online signature and multimodal (speech and face systems. While the initial research results indicate the high potential of the proposed methodology, the performance of the reliability estimation in a multimodal setting has not been sufficiently studied or evaluated. In this paper, we demonstrate the advantages of using the unimodal reliability information in order to perform an efficient biometric fusion of two modalities. We further show the presented method to be superior to state-of-the-art multimodal decision-level fusion schemes. The experimental evaluation presented in this paper is based on the popular benchmarking bimodal BANCA database.

Cross-media communication in advertising: exploring multimodal connections between television commercials and websites

DEFF Research Database (Denmark)

Jessen, Iben Bredahl; Graakjær, Nicolai Jørgensgaard

2013-01-01

The aim of this article is to advance current understandings of cross-media communication in advertising. The study is based on a sample of 80 television commercials and their announced websites, and the article is inspired by recent studies of cross-media advertising effectiveness as well...... as semiotic perspectives on multimodal analysis. The authors present three dimensions to be considered when examining multimodal connections between television commercials and websites: announcements, participants and address strategy. These dimensions are brought together in an analytical framework that can...... serve as inspiration for further research on cross-media communication in advertising and possibly in other types of communication....

100G shortwave wavelength division multiplexing solutions for multimode fiber data links

DEFF Research Database (Denmark)

Cimoli, Bruno; Estaran Tolosa, Jose Manuel; Rodes Lopez, Guillermo Arturo

2016-01-01

We investigate an alternative 100G solution for optical short-range data center links. The presented solution adopts wavelength division multiplexing technology to transmit four channels of 25G over a multimode fiber. A comparative performance analysis of the wavelength-grid selection for the wav...

Teleportation of continuous variable multimode Greeberger-Horne-Zeilinger entangled states

International Nuclear Information System (INIS)

He Guangqiang; Zhang Jingtao; Zeng Guihua

2008-01-01

Quantum teleportation protocols of continuous variable (CV) Greeberger-Horne-Zeilinger (GHZ) and Einstein-Podolsky-Rosen (EPR) entangled states are proposed, and are generalized to teleportation of arbitrary multimode GHZ entangled states described by Van Loock and Braunstein (2000 Phys. Rev. Lett. 84 3482). Each mode of a multimode entangled state is teleported using a CV EPR entangled pair and classical communication. The analytical expression of fidelity for the multimode Gaussian states which evaluates the teleportation quality is presented. The analytical results show that the fidelity is a function of both the squeezing parameter r, which characterizes the multimode entangled state to be teleported, and the channel parameter p, which characterizes the EPR pairs shared by Alice and Bob. The fidelity increases with increasing p, but decreases with increasing r, i.e., it is more difficult to teleport the more perfect multimode entangled states. The entanglement degree of the teleported multimode entangled states increases with increasing both r and p. In addition, the fact is proved that our teleportation protocol of EPR entangled states using parallel EPR pairs as quantum channels is the best case of the protocol using four-mode entangled states (Adhikari et al 2008 Phys. Rev. A 77 012337).

Mode-selective mapping and control of vectorial nonlinear-optical processes in multimode photonic-crystal fibers.

Science.gov (United States)

Hu, Ming-Lie; Wang, Ching-Yue; Song, You-Jian; Li, Yan-Feng; Chai, Lu; Serebryannikov, Evgenii; Zheltikov, Aleksei

2006-02-06

We demonstrate an experimental technique that allows a mapping of vectorial nonlinear-optical processes in multimode photonic-crystal fibers (PCFs). Spatial and polarization modes of PCFs are selectively excited in this technique by varying the tilt angle of the input beam and rotating the polarization of the input field. Intensity spectra of the PCF output plotted as a function of the input field power and polarization then yield mode-resolved maps of nonlinear-optical interactions in multimode PCFs, facilitating the analysis and control of nonlinear-optical transformations of ultrashort laser pulses in such fibers.

Multimodal surveillance sensors, algorithms, and systems

CERN Document Server

Zhu, Zhigang

2007-01-01

From front-end sensors to systems and environmental issues, this practical resource guides you through the many facets of multimodal surveillance. The book examines thermal, vibration, video, and audio sensors in a broad context of civilian and military applications. This cutting-edge volume provides an in-depth treatment of data fusion algorithms that takes you to the core of multimodal surveillance, biometrics, and sentient computing. The book discusses such people and activity topics as tracking people and vehicles and identifying individuals by their speech.Systems designers benefit from d

A Multimodal Learning System for Individuals with Sensorial, Neuropsychological, and Relational Impairments

Directory of Open Access Journals (Sweden)

Sergio Canazza

2013-01-01

Full Text Available This paper presents a system for an interactive multimodal environment able (i to train the listening comprehension in various populations of pupils, both Italian and immigrants, having different disabilities and (ii to assess speech production and discrimination. The proposed system is the result of a research project focused on pupils with sensorial, neuropsychological, and relational impairments. The project involves innovative technological systems that the users (speech terabits psychologists and preprimary and primary schools teachers could adopt for training and assessment of language and speech. Because the system is used in a real scenario (the Italian schools are often affected by poor funding for education and teachers without informatics skills, the guidelines adopted are low-cost technology; usability; customizable system; robustness.

Multimode waveguide speckle patterns for compressive sensing.

Science.gov (United States)

Valley, George C; Sefler, George A; Justin Shaw, T

2016-06-01

Compressive sensing (CS) of sparse gigahertz-band RF signals using microwave photonics may achieve better performances with smaller size, weight, and power than electronic CS or conventional Nyquist rate sampling. The critical element in a CS system is the device that produces the CS measurement matrix (MM). We show that passive speckle patterns in multimode waveguides potentially provide excellent MMs for CS. We measure and calculate the MM for a multimode fiber and perform simulations using this MM in a CS system. We show that the speckle MM exhibits the sharp phase transition and coherence properties needed for CS and that these properties are similar to those of a sub-Gaussian MM with the same mean and standard deviation. We calculate the MM for a multimode planar waveguide and find dimensions of the planar guide that give a speckle MM with a performance similar to that of the multimode fiber. The CS simulations show that all measured and calculated speckle MMs exhibit a robust performance with equal amplitude signals that are sparse in time, in frequency, and in wavelets (Haar wavelet transform). The planar waveguide results indicate a path to a microwave photonic integrated circuit for measuring sparse gigahertz-band RF signals using CS.

Development of a Framework for Multimodal Research: Creation of a Bibliographic Database

National Research Council Canada - National Science Library

Coovert, Michael D; Gray, Ashley A; Elliott, Linda R; Redden, Elizabeth S

2007-01-01

.... The results of the overall effort, the multimodal framework and article tracking sheet, bibliographic database, and searchable multimodal database make substantial and valuable contributions to the accumulation and interpretation of multimodal research. References collected in this effort are listed in the appendix.

Mode-multiplexed transmission over conventional graded-index multimode fibers

NARCIS (Netherlands)

Ryf, R.; Fontaine, N.K.; Chen, H.; Guan, B.; Huang, B.; Esmaeelpour, M.; Gnauck, A.H.; Randel, S.; Yoo, S.J.B.; Koonen, A.M.J.; Shubochkin, R.; Sun, Yi; Lingle, R.

2015-01-01

We present experimental results for combined mode-multiplexed and wavelength multiplexed transmission over conventional graded-index multimode fibers. We use mode-selective photonic lanterns as mode couplers to precisely excite a subset of the modes of the multimode fiber and additionally to

A Multimodal Database for Affect Recognition and Implicit Tagging

NARCIS (Netherlands)

Soleymani, Mohammad; Lichtenauer, Jeroen; Pun, Thierry; Pantic, Maja

MAHNOB-HCI is a multimodal database recorded in response to affective stimuli with the goal of emotion recognition and implicit tagging research. A multimodal setup was arranged for synchronized recording of face videos, audio signals, eye gaze data, and peripheral/central nervous system

Quantifying Quality Aspects of Multimodal Interactive Systems

CERN Document Server

Kühnel, Christine

2012-01-01

This book systematically addresses the quantification of quality aspects of multimodal interactive systems. The conceptual structure is based on a schematic view on human-computer interaction where the user interacts with the system and perceives it via input and output interfaces. Thus, aspects of multimodal interaction are analyzed first, followed by a discussion of the evaluation of output and input and concluding with a view on the evaluation of a complete system.

Gastric Adenocarcinoma: A Multimodal Approach

Directory of Open Access Journals (Sweden)

Humair S. Quadri

2017-08-01

Full Text Available Despite its declining incidence, gastric cancer (GC remains a leading cause of cancer-related deaths worldwide. A multimodal approach to GC is critical to ensure optimal patient outcomes. Pretherapy fine resolution contrast-enhanced cross-sectional imaging, endoscopic ultrasound and staging laparoscopy play an important role in patients with newly diagnosed ostensibly operable GC to avoid unnecessary non-therapeutic laparotomies. Currently, margin negative gastrectomy and adequate lymphadenectomy performed at high volume hospitals remain the backbone of GC treatment. Importantly, adequate GC surgery should be integrated in the setting of a multimodal treatment approach. Treatment for advanced GC continues to expand with the emergence of additional lines of systemic and targeted therapies.

Multimodal Estimation of Distribution Algorithms.

Science.gov (United States)

Yang, Qiang; Chen, Wei-Neng; Li, Yun; Chen, C L Philip; Xu, Xiang-Min; Zhang, Jun

2016-02-15

Taking the advantage of estimation of distribution algorithms (EDAs) in preserving high diversity, this paper proposes a multimodal EDA. Integrated with clustering strategies for crowding and speciation, two versions of this algorithm are developed, which operate at the niche level. Then these two algorithms are equipped with three distinctive techniques: 1) a dynamic cluster sizing strategy; 2) an alternative utilization of Gaussian and Cauchy distributions to generate offspring; and 3) an adaptive local search. The dynamic cluster sizing affords a potential balance between exploration and exploitation and reduces the sensitivity to the cluster size in the niching methods. Taking advantages of Gaussian and Cauchy distributions, we generate the offspring at the niche level through alternatively using these two distributions. Such utilization can also potentially offer a balance between exploration and exploitation. Further, solution accuracy is enhanced through a new local search scheme probabilistically conducted around seeds of niches with probabilities determined self-adaptively according to fitness values of these seeds. Extensive experiments conducted on 20 benchmark multimodal problems confirm that both algorithms can achieve competitive performance compared with several state-of-the-art multimodal algorithms, which is supported by nonparametric tests. Especially, the proposed algorithms are very promising for complex problems with many local optima.

Player/Avatar Body Relations in Multimodal Augmented Reality Games

NARCIS (Netherlands)

Rosa, N.E.

2016-01-01

Augmented reality research is finally moving towards multimodal experiences: more and more applications do not only include visuals, but also audio and even haptics. The purpose of multimodality in these applications can be to increase realism or to increase the amount or quality of communicated

Composition at Washington State University: Building a Multimodal Bricolage

Science.gov (United States)

Ericsson, Patricia; Hunter, Leeann Downing; Macklin, Tialitha Michelle; Edwards, Elizabeth Sue

2016-01-01

Multimodal pedagogy is increasingly accepted among composition scholars. However, putting such pedagogy into practice presents significant challenges. In this profile of Washington State University's first-year composition program, we suggest a multi-vocal and multi-theoretical approach to addressing the challenges of multimodal pedagogy. Patricia…

Multifuel multimodal network design; Projeto de redes multicombustiveis multimodal

Energy Technology Data Exchange (ETDEWEB)

Lage, Carolina; Dias, Gustavo; Bahiense, Laura; Ferreira Filho, Virgilio J.M. [Universidade Federal do Rio de Janeiro (UFRJ), RJ (Brazil). Coordenacao dos Programas de Pos-graduacao de Engenharia (COPPE). Programa de Engenharia de Producao

2008-07-01

The objective of the Multi commodity Multimodal Network Project is the development of modeling tools and methodologies for the optimal sizing of production networks and multimodal distribution of multiple fuel and its incomes, considering investments and transportation costs. Given the inherently non-linear combinatory nature of the problem, the resolution of real instances by the complete model, in an exact way, becomes computationally intractable. Thus, the strategy for resolution should contain a combination of exacts and heuristics methods, that must be applied to subdivisions of the original problem. This paper deals with one of these subdivisions, tackling the problem of modeling a network of pipelines in order to drain the production of ethanol away from the producing plants. The objective consists in defining the best network topology, minimizing investment and operational costs, and attending the total demand. In order to do that, the network was considered a tree, where the nodes are the center of producing regions and the edges are the pipelines, trough where the ethanol produced by plants must be drained away. The main objective also includes the decision over the optimal diameter of each pipeline and the optimal size of the bombs, in order to minimize the pumping costs. (author)

MULTIMODAL FEEDBACK PROVISION IN IMPROVING PRE-SERVICE TEACHERS’ COMPETENCE

Directory of Open Access Journals (Sweden)

Fazri Nur Yusuf

2017-09-01

Full Text Available Studies on potentials of feedback over English language teaching seem not to have not been well-revealed, including studies on the use of feedback to improve English pre-service teachers’ competence. The present study investigates to what extent a multimodal feedback can influence pre-service teachers’ teaching, and which teaching aspects are influenced. Twenty five pre-service teachers taking Microteaching Course served as respondents supervised by a course advisor. The data were collected by teacher observation in a rating-scale form, self-appraisal, and interviews. The data were analyzed by using correlated sample t-test and the eight teaching components proposed by Brown (2001. The results showed that after multimodal feedback provision, pre-service teachers indicated an improvement significantly in seven out of eight teaching aspects. The provision of multimodal feedback could improve their teaching competence on preparation, instructional objective elicitation, mastery of instructional materials, use of media, and classroom management, including classroom language. But, the results do not indicate that they perform well on reflection and follow-up due to some reasons. In addition, the results evince that multimodal feedback provision could improve pre-service teachers’ pedagogical competence when the multimodal feedback is integrated with content, interpersonal relationship, and management.

Multimode optical fiber

Science.gov (United States)

Bigot-Astruc, Marianne; Molin, Denis; Sillard, Pierre

2014-11-04

A depressed graded-index multimode optical fiber includes a central core, an inner depressed cladding, a depressed trench, an outer depressed cladding, and an outer cladding. The central core has an alpha-index profile. The depressed claddings limit the impact of leaky modes on optical-fiber performance characteristics (e.g., bandwidth, core size, and/or numerical aperture).

MIMI: multimodality, multiresource, information integration environment for biomedical core facilities.

Science.gov (United States)

Szymanski, Jacek; Wilson, David L; Zhang, Guo-Qiang

2009-10-01

The rapid expansion of biomedical research has brought substantial scientific and administrative data management challenges to modern core facilities. Scientifically, a core facility must be able to manage experimental workflow and the corresponding set of large and complex scientific data. It must also disseminate experimental data to relevant researchers in a secure and expedient manner that facilitates collaboration and provides support for data interpretation and analysis. Administratively, a core facility must be able to manage the scheduling of its equipment and to maintain a flexible and effective billing system to track material, resource, and personnel costs and charge for services to sustain its operation. It must also have the ability to regularly monitor the usage and performance of its equipment and to provide summary statistics on resources spent on different categories of research. To address these informatics challenges, we introduce a comprehensive system called MIMI (multimodality, multiresource, information integration environment) that integrates the administrative and scientific support of a core facility into a single web-based environment. We report the design, development, and deployment experience of a baseline MIMI system at an imaging core facility and discuss the general applicability of such a system in other types of core facilities. These initial results suggest that MIMI will be a unique, cost-effective approach to addressing the informatics infrastructure needs of core facilities and similar research laboratories.

Multimodal versus Unimodal Instruction in a Complex Learning Context.

Science.gov (United States)

Gellevij, Mark; van der Meij, Hans; de Jong, Ton; Pieters, Jules

2002-01-01

Compared multimodal instruction with text and pictures with unimodal text-only instruction as 44 college students used a visual or textual manual to learn a complex software application. Results initially support dual coding theory and indicate that multimodal instruction led to better performance than unimodal instruction. (SLD)

The Stability of Multi-modal Traffic Network

International Nuclear Information System (INIS)

Han Linghui; Sun Huijun; Zhu Chengjuan; Jia Bin; Wu Jianjun

2013-01-01

There is an explicit and implicit assumption in multimodal traffic equilibrium models, that is, if the equilibrium exists, then it will also occur. The assumption is very idealized; in fact, it may be shown that the quite contrary could happen, because in multimodal traffic network, especially in mixed traffic conditions the interaction among traffic modes is asymmetric and the asymmetric interaction may result in the instability of traffic system. In this paper, to study the stability of multimodal traffic system, we respectively present the travel cost function in mixed traffic conditions and in traffic network with dedicated bus lanes. Based on a day-to-day dynamical model, we study the evolution of daily route choice of travelers in multimodal traffic network using 10000 random initial values for different cases. From the results of simulation, it can be concluded that the asymmetric interaction between the cars and buses in mixed traffic conditions can lead the traffic system to instability when traffic demand is larger. We also study the effect of travelers' perception error on the stability of multimodal traffic network. Although the larger perception error can alleviate the effect of interaction between cars and buses and improve the stability of traffic system in mixed traffic conditions, the traffic system also become instable when the traffic demand is larger than a number. For all cases simulated in this study, with the same parameters, traffic system with dedicated bus lane has better stability for traffic demand than that in mixed traffic conditions. We also find that the network with dedicated bus lane has higher portion of travelers by bus than it of mixed traffic network. So it can be concluded that building dedicated bus lane can improve the stability of traffic system and attract more travelers to choose bus reducing the traffic congestion. (general)

Double-Wavelet Approach to Studying the Modulation Properties of Nonstationary Multimode Dynamics

DEFF Research Database (Denmark)

Sosnovtseva, Olga; Mosekilde, Erik; Pavlov, A.N.

2005-01-01

On the basis of double-wavelet analysis, the paper proposes a method to study interactions in the form of frequency and amplitude modulation in nonstationary multimode data series. Special emphasis is given to the problem of quantifying the strength of modulation for a fast signal by a coexisting...

Photoacoustic-Based Multimodal Nanoprobes: from Constructing to Biological Applications.

Science.gov (United States)

Gao, Duyang; Yuan, Zhen

2017-01-01

Multimodal nanoprobes have attracted intensive attentions since they can integrate various imaging modalities to obtain complementary merits of single modality. Meanwhile, recent interest in laser-induced photoacoustic imaging is rapidly growing due to its unique advantages in visualizing tissue structure and function with high spatial resolution and satisfactory imaging depth. In this review, we summarize multimodal nanoprobes involving photoacoustic imaging. In particular, we focus on the method to construct multimodal nanoprobes. We have divided the synthetic methods into two types. First, we call it "one for all" concept, which involves intrinsic properties of the element in a single particle. Second, "all in one" concept, which means integrating different functional blocks in one particle. Then, we simply introduce the applications of the multifunctional nanoprobes for in vivo imaging and imaging-guided tumor therapy. At last, we discuss the advantages and disadvantages of the present methods to construct the multimodal nanoprobes and share our viewpoints in this area.

PET-MRI and multimodal cancer imaging

International Nuclear Information System (INIS)

Wang Taisong; Zhao Jinhua; Song Jianhua

2011-01-01

Multimodality imaging, specifically PET-CT, brought a new perspective into the fields of clinical imaging. Clinical cases have shown that PET-CT has great value in clinical diagnosis and experimental research. But PET-CT still bears some limitations. A major drawback is that CT provides only limited soft tissue contrast and exposes the patient to a significant radiation dose. MRI overcome these limitations, it has excellent soft tissue contrast, high temporal and spatial resolution and no radiation damage. Additionally, since MRI provides also functional information, PET-MRI will show a new direction of multimodality imaging in the future. (authors)

Multimodal training between agents

DEFF Research Database (Denmark)

Rehm, Matthias

2003-01-01

In the system Locator1, agents are treated as individual and autonomous subjects that are able to adapt to heterogenous user groups. Applying multimodal information from their surroundings (visual and linguistic), they acquire the necessary concepts for a successful interaction. This approach has...

Analyzing the Potential for High-speed Rail as Part of the Multimodal Transportation System in the United States' Midwest Corridor

Directory of Open Access Journals (Sweden)

Jeffrey C. Peters

2014-06-01

Full Text Available With increasing demand and rising fuel costs, both travel time and cost of current intercity passenger transportation modes are becoming increasingly relevant. Around the world, highspeed rail (HSR is seen as a way to alleviate demand on highways and at airports. Ridership is the critical element in determining the viability of a large capital, long-term transportation investment. This paper provides a systematic, consistent methodology for analyzing systemwide modal ridership with and without a proposed HSR network and analyzes the potential for highspeed rail as part of the existing multimodal transportation system in a region in terms of ridership. Considerations of capital investment (e.g., network design and HSR speed, along with exogenous demographic, technological, economic, and policy trends in the long-term, are used to project ridership over time. This study represents an important step toward a consistent, comprehensive economic analysis of HSR in the United States.

Information impact on quality of travel choices: analysis of data from a multimodal travel simulator

NARCIS (Netherlands)

Chorus, C.G.; Arentze, T.A.; Timmermans, H.J.P.; Silva, da A.N.R.; Souza, de L.C.L.

2007-01-01

This paper investigates the impact of travel information on the quality of travel choices. It distinguishes itself from earlier studies on this topic by empirically investigating the impact of a variety of travel information types on the quality of observed multimodal travel choices. Choice quality

Hand Specific Representations in Language Comprehension

Directory of Open Access Journals (Sweden)

Claire eMoody-Triantis

2014-06-01

Full Text Available Theories of embodied cognition argue that language comprehension involves sensory-motor re-enactments of the actions described. However, the degree of specificity of these re-enactments as well as the relationship between action and language remains a matter of debate. Here we investigate these issues by examining how hand-specific information (left or right hand is recruited in language comprehension and action execution. An fMRI study tested right-handed participants in two separate tasks that were designed to be as similar as possible to increase sensitivity of the comparison across task: an action execution go/no-go task where participants performed right or left hand actions, and a language task where participants read sentences describing the same left or right handed actions as in the execution task. We found that language-induced activity did not match the hand-specific patterns of activity found for action execution in primary somatosensory and motor cortex, but it overlapped with pre-motor and parietal regions associated with action planning. Within these pre-motor regions, both right hand actions and sentences elicited stronger activity than left hand actions and sentences - a dominant hand effect -. Importantly, both dorsal and ventral sections of the left pre-central gyrus were recruited by both tasks, suggesting different action features being recruited. These results suggest that (a language comprehension elicits motor representations that are hand-specific and akin to multimodal action plans, rather than full action re-enactments; and (b language comprehension and action execution share schematic hand-specific representations that are richer for the dominant hand, and thus linked to previous motor experience.

Hand specific representations in language comprehension.

Science.gov (United States)

Moody-Triantis, Claire; Humphreys, Gina F; Gennari, Silvia P

2014-01-01

Theories of embodied cognition argue that language comprehension involves sensory-motor re-enactments of the actions described. However, the degree of specificity of these re-enactments as well as the relationship between action and language remains a matter of debate. Here we investigate these issues by examining how hand-specific information (left or right hand) is recruited in language comprehension and action execution. An fMRI study tested self-reported right-handed participants in two separate tasks that were designed to be as similar as possible to increase sensitivity of the comparison across task: an action execution go/no-go task where participants performed right or left hand actions, and a language task where participants read sentences describing the same left or right handed actions as in the execution task. We found that language-induced activity did not match the hand-specific patterns of activity found for action execution in primary somatosensory and motor cortex, but it overlapped with pre-motor and parietal regions associated with action planning. Within these pre-motor regions, both right hand actions and sentences elicited stronger activity than left hand actions and sentences-a dominant hand effect. Importantly, both dorsal and ventral sections of the left pre-central gyrus were recruited by both tasks, suggesting different action features being recruited. These results suggest that (a) language comprehension elicits motor representations that are hand-specific and akin to multimodal action plans, rather than full action re-enactments; and (b) language comprehension and action execution share schematic hand-specific representations that are richer for the dominant hand, and thus linked to previous motor experience.

Are There Gender Differences in Emotion Comprehension? Analysis of the Test of Emotion Comprehension.

Science.gov (United States)

Fidalgo, Angel M; Tenenbaum, Harriet R; Aznar, Ana

2018-01-01

This article examines whether there are gender differences in understanding the emotions evaluated by the Test of Emotion Comprehension (TEC). The TEC provides a global index of emotion comprehension in children 3-11 years of age, which is the sum of the nine components that constitute emotion comprehension: (1) recognition of facial expressions, (2) understanding of external causes of emotions, (3) understanding of desire-based emotions, (4) understanding of belief-based emotions, (5) understanding of the influence of a reminder on present emotional states, (6) understanding of the possibility to regulate emotional states, (7) understanding of the possibility of hiding emotional states, (8) understanding of mixed emotions, and (9) understanding of moral emotions. We used the answers to the TEC given by 172 English girls and 181 boys from 3 to 8 years of age. First, the nine components into which the TEC is subdivided were analysed for differential item functioning (DIF), taking gender as the grouping variable. To evaluate DIF, the Mantel-Haenszel method and logistic regression analysis were used applying the Educational Testing Service DIF classification criteria. The results show that the TEC did not display gender DIF. Second, when absence of DIF had been corroborated, it was analysed for differences between boys and girls in the total TEC score and its components controlling for age. Our data are compatible with the hypothesis of independence between gender and level of comprehension in 8 of the 9 components of the TEC. Several hypotheses are discussed that could explain the differences found between boys and girls in the belief component. Given that the Belief component is basically a false belief task, the differences found seem to support findings in the literature indicating that girls perform better on this task.

Multimodal imaging of spike propagation: a technical case report.

Science.gov (United States)

Tanaka, N; Grant, P E; Suzuki, N; Madsen, J R; Bergin, A M; Hämäläinen, M S; Stufflebeam, S M

2012-06-01

We report an 11-year-old boy with intractable epilepsy, who had cortical dysplasia in the right superior frontal gyrus. Spatiotemporal source analysis of MEG and EEG spikes demonstrated a similar time course of spike propagation from the superior to inferior frontal gyri, as observed on intracranial EEG. The tractography reconstructed from DTI showed a fiber connection between these areas. Our multimodal approach demonstrates spike propagation and a white matter tract guiding the propagation.

Agrupador de imágenes multimodal no supervisado

OpenAIRE

Pérez Hernando, Jesús

2013-01-01

Trabajo Fin de Máster donde se implementa un método multimodal para la clasificación de imágenes sin etiquetar y sin intervención humana. Treball Fi de Màster on s'implementa un mètode multimodal per a la classificació d'imatges sense etiquetar i sense intervenció humana. Master thesis for the Computer Science Engineering program.

Connecting multimodality in human communication.

Science.gov (United States)

Regenbogen, Christina; Habel, Ute; Kellermann, Thilo

2013-01-01

DCM analysis instead showed a pronounced top-down control. Remarkably, all connections from the dmPFC to the three other regions were modulated by the experimental conditions. This observation is in line with the presumed role of the dmPFC in the allocation of attention. In contrary, all incoming connections to the AG were modulated, indicating its key role in integrating multimodal information and supporting comprehension. Notably, the input from the FFG to the AG was enhanced when facial expressions conveyed emotional information. These findings serve as preliminary results in understanding network dynamics in human emotional communication and empathy.

Multimodal news framing effects

NARCIS (Netherlands)

Powell, T.E.

2017-01-01

Visuals in news media play a vital role in framing citizens’ political preferences. Yet, compared to the written word, visual images are undervalued in political communication research. Using framing theory, this thesis redresses the balance by studying the combined, or multimodal, effects of visual

Score level fusion scheme based on adaptive local Gabor features for face-iris-fingerprint multimodal biometric

Science.gov (United States)

He, Fei; Liu, Yuanning; Zhu, Xiaodong; Huang, Chun; Han, Ye; Chen, Ying

2014-05-01

A multimodal biometric system has been considered a promising technique to overcome the defects of unimodal biometric systems. We have introduced a fusion scheme to gain a better understanding and fusion method for a face-iris-fingerprint multimodal biometric system. In our case, we use particle swarm optimization to train a set of adaptive Gabor filters in order to achieve the proper Gabor basic functions for each modality. For a closer analysis of texture information, two different local Gabor features for each modality are produced by the corresponding Gabor coefficients. Next, all matching scores of the two Gabor features for each modality are projected to a single-scalar score via a trained, supported, vector regression model for a final decision. A large-scale dataset is formed to validate the proposed scheme using the Facial Recognition Technology database-fafb and CASIA-V3-Interval together with FVC2004-DB2a datasets. The experimental results demonstrate that as well as achieving further powerful local Gabor features of multimodalities and obtaining better recognition performance by their fusion strategy, our architecture also outperforms some state-of-the-art individual methods and other fusion approaches for face-iris-fingerprint multimodal biometric systems.

Object recognition through a multi-mode fiber

Science.gov (United States)

Takagi, Ryosuke; Horisaki, Ryoichi; Tanida, Jun

2017-04-01

We present a method of recognizing an object through a multi-mode fiber. A number of speckle patterns transmitted through a multi-mode fiber are provided to a classifier based on machine learning. We experimentally demonstrated binary classification of face and non-face targets based on the method. The measurement process of the experimental setup was random and nonlinear because a multi-mode fiber is a typical strongly scattering medium and any reference light was not used in our setup. Comparisons between three supervised learning methods, support vector machine, adaptive boosting, and neural network, are also provided. All of those learning methods achieved high accuracy rates at about 90% for the classification. The approach presented here can realize a compact and smart optical sensor. It is practically useful for medical applications, such as endoscopy. Also our study indicated a promising utilization of artificial intelligence, which has rapidly progressed, for reducing optical and computational costs in optical sensing systems.

The dynamics of multimodal integration: The averaging diffusion model.

Science.gov (United States)

Turner, Brandon M; Gao, Juan; Koenig, Scott; Palfy, Dylan; L McClelland, James

2017-12-01

We combine extant theories of evidence accumulation and multi-modal integration to develop an integrated framework for modeling multimodal integration as a process that unfolds in real time. Many studies have formulated sensory processing as a dynamic process where noisy samples of evidence are accumulated until a decision is made. However, these studies are often limited to a single sensory modality. Studies of multimodal stimulus integration have focused on how best to combine different sources of information to elicit a judgment. These studies are often limited to a single time point, typically after the integration process has occurred. We address these limitations by combining the two approaches. Experimentally, we present data that allow us to study the time course of evidence accumulation within each of the visual and auditory domains as well as in a bimodal condition. Theoretically, we develop a new Averaging Diffusion Model in which the decision variable is the mean rather than the sum of evidence samples and use it as a base for comparing three alternative models of multimodal integration, allowing us to assess the optimality of this integration. The outcome reveals rich individual differences in multimodal integration: while some subjects' data are consistent with adaptive optimal integration, reweighting sources of evidence as their relative reliability changes during evidence integration, others exhibit patterns inconsistent with optimality.

Detection of heart beats in multimodal data: a robust beat-to-beat interval estimation approach.

Science.gov (United States)

Antink, Christoph Hoog; Brüser, Christoph; Leonhardt, Steffen

2015-08-01

The heart rate and its variability play a vital role in the continuous monitoring of patients, especially in the critical care unit. They are commonly derived automatically from the electrocardiogram as the interval between consecutive heart beat. While their identification by QRS-complexes is straightforward under ideal conditions, the exact localization can be a challenging task if the signal is severely contaminated with noise and artifacts. At the same time, other signals directly related to cardiac activity are often available. In this multi-sensor scenario, methods of multimodal sensor-fusion allow the exploitation of redundancies to increase the accuracy and robustness of beat detection.In this paper, an algorithm for the robust detection of heart beats in multimodal data is presented. Classic peak-detection is augmented by robust multi-channel, multimodal interval estimation to eliminate false detections and insert missing beats. This approach yielded a score of 90.70 and was thus ranked third place in the PhysioNet/Computing in Cardiology Challenge 2014: Robust Detection of Heart Beats in Muthmodal Data follow-up analysis.In the future, the robust beat-to-beat interval estimator may directly be used for the automated processing of multimodal patient data for applications such as diagnosis support and intelligent alarming.

Multimodal instruction and persuasion in disclosing greenwashing discourses

DEFF Research Database (Denmark)

Maier, Carmen Daniela

and accompanied by new voice-over commentaries and new visual material. The new voice-over narrator instructs the viewers how to identify and decode the multimodal persuasive strategies employed in the original discourse. Simultaneously, the viewers are also persuaded to accept the new understanding...... and social actions when the commercials' greenwashing discourse is used for other instructive and persuasive purposes. When mapping and explaining these transformations, the analysis is based on the investigation of the multifunctional interplay of semiotic modes as language and images. On the basis...

Strategy development management of Multimodal Transport Network

Directory of Open Access Journals (Sweden)

Nesterova Natalia S.

2016-01-01

Full Text Available The article gives a brief overview of works on the development of transport infrastructure for multimodal transportation and integration of Russian transport system into the international transport corridors. The technology for control of the strategy, that changes shape and capacity of Multi-modal Transport Network (MTN, is considered as part of the methodology for designing and development of MTN. This technology allows to carry out strategic and operational management of the strategy implementation based on the use of the balanced scorecard.

Behavior change, acceptance, and coping flexibility in highly distressed patients with rheumatic diseases: feasibility of a cognitive-behavioral therapy in multimodal rehabilitation.

Science.gov (United States)

Vriezekolk, Johanna E; Geenen, Rinie; van den Ende, Cornelia H M; Slot, Helma; van Lankveld, Wim G J M; van Helmond, Toon

2012-05-01

To describe the development and feasibility of the integration of a cognitive-behavioral therapy (CBT) within a multimodal rehabilitation program for highly distressed patients with rheumatic diseases. Development included the detailed specification of the theoretical and empirical-based underpinnings of the CBT and the comprehensive description of its design and content. Feasibility was assessed by percentage of eligible patients, attrition and attendance rates, and patient satisfaction. The developed CBT component seeks to decrease psychological distress and improve activities and participation across multiple life domains by accomplishing behavior change, acceptance, and coping flexibility. Motivational interviewing was applied to endorse patients' own reasons to change. Forty percent (35/87) of the eligible patients were admitted to the program. Attendance rate (>95%) was high. Patient satisfaction ranged from 6.8 to 8.0 (10-point scale). Integrating CBT within a multimodal rehabilitation program is feasible. An acceptable proportion of the intended patient sample is eligible and patient's attendance and satisfaction is high. Patients with impaired physical and psychosocial functioning despite adequate medical treatment pose a great challenge. Their treatment outcome may be improved by screening and selecting highly distressed patients and offering them a CBT embedded in multimodal rehabilitation program. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Multimodal Behavior Therapy: Case Study of a High School Student.

Science.gov (United States)

Seligman, Linda

1981-01-01

A case study of a high school student concerned with weight problems illustrates multimodal behavior therapy and its use in a high school setting. Multimodal therapy allows the school counselor to maximize referral sources while emphasizing growth and actualization. (JAC)

Multimodal Imaging of Brain Connectivity Using the MIBCA Toolbox: Preliminary Application to Alzheimer's Disease

Science.gov (United States)

Ribeiro, André Santos; Lacerda, Luís Miguel; Silva, Nuno André da; Ferreira, Hugo Alexandre

2015-06-01

The Multimodal Imaging Brain Connectivity Analysis (MIBCA) toolbox is a fully automated all-in-one connectivity analysis toolbox that offers both pre-processing, connectivity, and graph theory analysis of multimodal images such as anatomical, diffusion, and functional MRI, and PET. In this work, the MIBCA functionalities were used to study Alzheimer's Disease (AD) in a multimodal MR/PET approach. Materials and Methods: Data from 12 healthy controls, and 36 patients with EMCI, LMCI and AD (12 patients for each group) were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu), including T1-weighted (T1-w), Diffusion Tensor Imaging (DTI) data, and 18F-AV-45 (florbetapir) dynamic PET data from 40-60 min post injection (4x5 min). Both MR and PET data were automatically pre-processed for all subjects using MIBCA. T1-w data was parcellated into cortical and subcortical regions-of-interest (ROIs), and the corresponding thicknesses and volumes were calculated. DTI data was used to compute structural connectivity matrices based on fibers connecting pairs of ROIs. Lastly, dynamic PET images were summed, and the relative Standard Uptake Values calculated for each ROI. Results: An overall higher uptake of 18F-AV-45, consistent with an increased deposition of beta-amyloid, was observed for the AD group. Additionally, patients showed significant cortical atrophy (thickness and volume) especially in the entorhinal cortex and temporal areas, and a significant increase in Mean Diffusivity (MD) in the hippocampus, amygdala and temporal areas. Furthermore, patients showed a reduction of fiber connectivity with the progression of the disease, especially for intra-hemispherical connections. Conclusion: This work shows the potential of the MIBCA toolbox for the study of AD, as findings were shown to be in agreement with the literature. Here, only structural changes and beta-amyloid accumulation were considered. Yet, MIBCA is further able to

Multimodal aspects of CSR communication related to gender empowerment and environmental protection

DEFF Research Database (Denmark)

Maier, Carmen Daniela

Purpose – This paper explores how the multimodal persuasive strategies of CSR communication related to Coca-Cola’s “5 by 20” succeed to highlight the company’s continuous commitment to gender empowerment and environmental protection. Launched in 2010, “5 by 20” is a program designed to empower 5...... million female entrepreneurs throughout the company’s global business system by 2020. The program has recently received 2013 Catalyst Award for its accomplishments. According to the company’s homepage, hundreds of thousands of women around the world are building stronger businesses, families...... and communities due to the implementation of this program. The environmental concerns are embedded in their activities. Approach – Drawing on an interdisciplinary methodological framework related to CSR communication, multimodal discourse analysis, gender theory and environmental communication, the paper proposes...

Acting rehearsal in collaborative multimodal mixed reality environments

OpenAIRE

Steptoe, William; Normand, Jean-Marie; Oyekoya, Oyewole; Pece, Fabrizio; Giannopoulos, Elias; Tecchia, Franco; Steed, Anthony; Weyrich, Tim; Kautz, Jan; Slater, Mel

2012-01-01

This paper presents the use of our multimodal mixed reality telecommunication system to support remote acting rehearsal. The rehearsals involved two actors, located in London and Barcelona, and a director in another location in London. This triadic audiovisual telecommunication was performed in a spatial and multimodal collaborative mixed reality environment based on the 'destination-visitor' paradigm, which we define and put into use. We detail our heterogeneous system architecture, which sp...

Revealing and Quantifying the Impaired Phonological Analysis Underpinning Impaired Comprehension in Wernicke's Aphasia

Science.gov (United States)

Robson, Holly; Keidel, James L.; Lambon Ralph, Matthew A.; Sage, Karen

2012-01-01

Wernicke's aphasia is a condition which results in severely disrupted language comprehension following a lesion to the left temporo-parietal region. A phonological analysis deficit has traditionally been held to be at the root of the comprehension impairment in Wernicke's aphasia, a view consistent with current functional neuroimaging which finds…

Operator theory a comprehensive course in analysis, part 4

CERN Document Server

Simon, Barry

2015-01-01

A Comprehensive Course in Analysis by Poincaré Prize winner Barry Simon is a five-volume set that can serve as a graduate-level analysis textbook with a lot of additional bonus information, including hundreds of problems and numerous notes that extend the text and provide important historical background. Depth and breadth of exposition make this set a valuable reference source for almost all areas of classical analysis. Part 4 focuses on operator theory, especially on a Hilbert space. Central topics are the spectral theorem, the theory of trace class and Fredholm determinants, and the study of

Multimodal approach to the international transit transport

Directory of Open Access Journals (Sweden)

D. Bazaras

2003-12-01

Full Text Available In the article not only the problems of multi-modal and inter-modal conveyances in Lithuania and the concept of transit and the transit system stimulating factors are analysed, but also the modelling of transit transport and the flows of the loads are given. The main part of the article comes to the analysis of resent situation of Lithuania. In this part the place of transport sector in the market of transit services is analysed and the transit profit for Lithuanian economy is evaluated. The conclusions and proposals are given at the end of the article.

MIDA - Optimizing control room performance through multi-modal design

International Nuclear Information System (INIS)

Ronan, A. M.

2006-01-01

Multi-modal interfaces can support the integration of humans with information processing systems and computational devices to maximize the unique qualities that comprise a complex system. In a dynamic environment, such as a nuclear power plant control room, multi-modal interfaces, if designed correctly, can provide complementary interaction between the human operator and the system which can improve overall performance while reducing human error. Developing such interfaces can be difficult for a designer without explicit knowledge of Human Factors Engineering principles. The Multi-modal Interface Design Advisor (MIDA) was developed as a support tool for system designers and developers. It provides design recommendations based upon a combination of Human Factors principles, a knowledge base of historical research, and current interface technologies. MIDA's primary objective is to optimize available multi-modal technologies within a human computer interface in order to balance operator workload with efficient operator performance. The purpose of this paper is to demonstrate MIDA and illustrate its value as a design evaluation tool within the nuclear power industry. (authors)

AMIDE: A Free Software Tool for Multimodality Medical Image Analysis

Directory of Open Access Journals (Sweden)

Andreas Markus Loening

2003-07-01

Full Text Available Amide's a Medical Image Data Examiner (AMIDE has been developed as a user-friendly, open-source software tool for displaying and analyzing multimodality volumetric medical images. Central to the package's abilities to simultaneously display multiple data sets (e.g., PET, CT, MRI and regions of interest is the on-demand data reslicing implemented within the program. Data sets can be freely shifted, rotated, viewed, and analyzed with the program automatically handling interpolation as needed from the original data. Validation has been performed by comparing the output of AMIDE with that of several existing software packages. AMIDE runs on UNIX, Macintosh OS X, and Microsoft Windows platforms, and it is freely available with source code under the terms of the GNU General Public License.

[Multimodal pain therapy - implementation of process management - an attempt to consider management approaches].

Science.gov (United States)

Dunkel, Marion; Kramp, Melanie

2012-07-01

The combination of medical and economical proceedings allows new perspectives in the illustration of medical workflows. Considering structural and developmental aspects multimodal therapy programs show similarities with typical subjects of economic process systems. By pointing out the strategic appearance of the multimodal pain therapy concept multimodal approaches can be described to some extent by using management approaches. E. g., an economic process landscape can be used to represent procedures of a multimodal pain therapy program. © Georg Thieme Verlag Stuttgart · New York.

Validation of a multimodal travel simulator with travel information provision

NARCIS (Netherlands)

Chorus, C.G.; Molin, E.J.E.; Arentze, T.A.; Hoogendoorn, S.P.; Timmermans, H.J.P.; Wee, van G.P.

2007-01-01

This paper presents a computer based travel simulator for collecting data concerning the use of next-generation ATIS and their effects on traveler decision making in a multimodal travel environment. The tool distinguishes itself by presenting a completely abstract multimodal transport network, where

Multimode vibration analysis with high-speed TV holography and a spatiotemporal 3D Fourier transform method.

Science.gov (United States)

Trillo, Cristina; Doval, Angel F; Mendoza-Santoyo, Fernando; Pérez-López, Carlos; de la Torre-Ibarra, Manuel; Deán, J Luis

2009-09-28

The combination of a high-speed TV holography system and a 3D Fourier-transform data processing is proposed for the analysis of multimode vibrations in plates. The out-of-plane displacement of the object under generic vibrational excitation is resolved in time by the fast acquisition rate of a high-speed camera, and recorded in a sequence of interferograms with spatial carrier. A full-field temporal history of the multimode vibration is thus obtained. The optical phase of the interferograms is extracted and subtracted from the phase of a reference state to yield a sequence of optical phase-change maps. Each map represents the change undergone by the object between any given state and the reference state. The sequence of maps is a 3D array of data (two spatial dimensions plus time) that is processed with a 3D Fourier-transform algorithm. The individual vibration modes are separated in the 3D frequency space due to their different vibration frequencies and, to a lesser extent, to the different spatial frequencies of the mode shapes. The contribution of each individual mode (or indeed the superposition of several modes) to the dynamic behaviour of the object can then be separated by means of a bandpass filter (or filters). The final output is a sequence of complex-valued maps that contain the full-field temporal history of the selected mode (or modes) in terms of its mechanical amplitude and phase. The proof-of-principle of the technique is demonstrated with a rectangular, fully clamped, thin metal plate vibrating simultaneously in several of its natural resonant frequencies under white-noise excitation.

Multimodal assessment of visual attention using the Bethesda Eye & Attention Measure (BEAM).

Science.gov (United States)

Ettenhofer, Mark L; Hershaw, Jamie N; Barry, David M

2016-01-01

Computerized cognitive tests measuring manual response time (RT) and errors are often used in the assessment of visual attention. Evidence suggests that saccadic RT and errors may also provide valuable information about attention. This study was conducted to examine a novel approach to multimodal assessment of visual attention incorporating concurrent measurements of saccadic eye movements and manual responses. A computerized cognitive task, the Bethesda Eye & Attention Measure (BEAM) v.34, was designed to evaluate key attention networks through concurrent measurement of saccadic and manual RT and inhibition errors. Results from a community sample of n = 54 adults were analyzed to examine effects of BEAM attention cues on manual and saccadic RT and inhibition errors, internal reliability of BEAM metrics, relationships between parallel saccadic and manual metrics, and relationships of BEAM metrics to demographic characteristics. Effects of BEAM attention cues (alerting, orienting, interference, gap, and no-go signals) were consistent with previous literature examining key attention processes. However, corresponding saccadic and manual measurements were weakly related to each other, and only manual measurements were related to estimated verbal intelligence or years of education. This study provides preliminary support for the feasibility of multimodal assessment of visual attention using the BEAM. Results suggest that BEAM saccadic and manual metrics provide divergent measurements. Additional research will be needed to obtain comprehensive normative data, to cross-validate BEAM measurements with other indicators of neural and cognitive function, and to evaluate the utility of these metrics within clinical populations of interest.

Joint sparse representation for robust multimodal biometrics recognition.

Science.gov (United States)

Shekhar, Sumit; Patel, Vishal M; Nasrabadi, Nasser M; Chellappa, Rama

2014-01-01

Traditional biometric recognition systems rely on a single biometric signature for authentication. While the advantage of using multiple sources of information for establishing the identity has been widely recognized, computational models for multimodal biometrics recognition have only recently received attention. We propose a multimodal sparse representation method, which represents the test data by a sparse linear combination of training data, while constraining the observations from different modalities of the test subject to share their sparse representations. Thus, we simultaneously take into account correlations as well as coupling information among biometric modalities. A multimodal quality measure is also proposed to weigh each modality as it gets fused. Furthermore, we also kernelize the algorithm to handle nonlinearity in data. The optimization problem is solved using an efficient alternative direction method. Various experiments show that the proposed method compares favorably with competing fusion-based methods.

OSM-ORIENTED METHOD OF MULTIMODAL ROUTE PLANNING

Directory of Open Access Journals (Sweden)

X. Li

2015-07-01

Full Text Available With the increasing pervasiveness of basic facilitate of transportation and information, the need of multimodal route planning is becoming more essential in the fields of communication and transportation, urban planning, logistics management, etc. This article mainly described an OSM-oriented method of multimodal route planning. Firstly, it introduced how to extract the information we need from OSM data and build proper network model and storage model; then it analysed the accustomed cost standard adopted by most travellers; finally, we used shortest path algorithm to calculate the best route with multiple traffic means.

An atlas-based multimodal registration method for 2D images with discrepancy structures.

Science.gov (United States)

Lv, Wenchao; Chen, Houjin; Peng, Yahui; Li, Yanfeng; Li, Jupeng

2018-06-04

An atlas-based multimodal registration method for 2-dimension images with discrepancy structures was proposed in this paper. Atlas was utilized for complementing the discrepancy structure information in multimodal medical images. The scheme includes three steps: floating image to atlas registration, atlas to reference image registration, and field-based deformation. To evaluate the performance, a frame model, a brain model, and clinical images were employed in registration experiments. We measured the registration performance by the squared sum of intensity differences. Results indicate that this method is robust and performs better than the direct registration for multimodal images with discrepancy structures. We conclude that the proposed method is suitable for multimodal images with discrepancy structures. Graphical Abstract An Atlas-based multimodal registration method schematic diagram.

A new piezoelectric energy harvesting design concept: multimodal energy harvesting skin.

Science.gov (United States)

Lee, Soobum; Youn, Byeng D

2011-03-01

This paper presents an advanced design concept for a piezoelectric energy harvesting (EH), referred to as multimodal EH skin. This EH design facilitates the use of multimodal vibration and enhances power harvesting efficiency. The multimodal EH skin is an extension of our previous work, EH skin, which was an innovative design paradigm for a piezoelectric energy harvester: a vibrating skin structure and an additional thin piezoelectric layer in one device. A computational (finite element) model of the multilayered assembly - the vibrating skin structure and piezoelectric layer - is constructed and the optimal topology and/or shape of the piezoelectric layer is found for maximum power generation from multiple vibration modes. A design rationale for the multimodal EH skin was proposed: designing a piezoelectric material distribution and external resistors. In the material design step, the piezoelectric material is segmented by inflection lines from multiple vibration modes of interests to minimize voltage cancellation. The inflection lines are detected using the voltage phase. In the external resistor design step, the resistor values are found for each segment to maximize power output. The presented design concept, which can be applied to any engineering system with multimodal harmonic-vibrating skins, was applied to two case studies: an aircraft skin and a power transformer panel. The excellent performance of multimodal EH skin was demonstrated, showing larger power generation than EH skin without segmentation or unimodal EH skin.

Increased discriminability of authenticity from multimodal laughter is driven by auditory information.

Science.gov (United States)

Lavan, Nadine; McGettigan, Carolyn

2017-10-01

We present an investigation of the perception of authenticity in audiovisual laughter, in which we contrast spontaneous and volitional samples and examine the contributions of unimodal affective information to multimodal percepts. In a pilot study, we demonstrate that listeners perceive spontaneous laughs as more authentic than volitional ones, both in unimodal (audio-only, visual-only) and multimodal contexts (audiovisual). In the main experiment, we show that the discriminability of volitional and spontaneous laughter is enhanced for multimodal laughter. Analyses of relationships between affective ratings and the perception of authenticity show that, while both unimodal percepts significantly predict evaluations of audiovisual laughter, it is auditory affective cues that have the greater influence on multimodal percepts. We discuss differences and potential mismatches in emotion signalling through voices and faces, in the context of spontaneous and volitional behaviour, and highlight issues that should be addressed in future studies of dynamic multimodal emotion processing.

Multimodal genres in textbooks: are students being schooled for visual literacy?

Directory of Open Access Journals (Sweden)

Cláudia Graziano Paes de Barros

2012-11-01

Full Text Available In this paper, we discuss some issues involved in teaching and learning reading, especially schooling in visual literacy. We seek to observe the work developed with genres that combine verbal and visual languages, found in the reading activities of two high school textbook series for Portuguese language teaching. Our goal was to understand to what extent these activities contribute towards the development of reading skills needed to deal with the specificities of these genres. Therefore, we used the enunciative and discursive assumptions of the socio-historical approach of Bakhtin Circle, as well as the Social Semiotics perspective to understand multimodality. Data analysis revealed that the incidence of multimodal genres studied in the two textbook series is hardly representative. The didactic treatment these genres receive in reading activities does not favor the mobilization of specific reading skills and contributes little to students‟ visual literacy schooling.

Examining the Association of Economic Development with Intercity Multimodal Transport Demand in China: A Focus on Spatial Autoregressive Analysis

Directory of Open Access Journals (Sweden)

Jinbao Zhao

2018-02-01

Full Text Available Transportation is generally perceived as a catalyst for economic development. This has been highlighted in previous studies. However, less attention has been paid to examine the relationship between economy and transport demand by exploring spatially cross-sectional data, especially for countries with significant regional economic imbalance, like China. In this article, we assess the economic influence of intercity multimodal transport demand at the prefecture level in China. Spatial autoregressive regression models are used to examine the impact of transport demand on economy by deep analysis of transport modes (land, air, and water and regions (eastern, central, and western. Through contrasting results from spatial lag model and spatial error model with those from the ordinary least square, this study finds that the estimation results can become more accurate by controlling for spatial autocorrelation, especially at the national level. Through rigorous analysis it is identified that except for water passenger traffic, all other intercity transport demand significantly contribute to a city’s economic development level in gross domestic product. In particular, air transport demands distribute more evenly and are estimated with the highest beta coefficients at both national and regional levels. In addition, the beta coefficients for land, air and water transportation are estimated with different magnitudes and significances at the national and regional levels. This study contributes to the ongoing discussion on the relationship between intercity multimodal transport demand and economic development level. Findings from this paper provide planning makers with valid and efficient strategies to better develop the economy by leveraging the special “⊣” cluster pattern of economic development and the benefits of air transportation.

Optical modelling of far-infrared astronomical instrumentation exploiting multimode horn antennas

Science.gov (United States)

O'Sullivan, Créidhe; Murphy, J. Anthony; Mc Auley, Ian; Wilson, Daniel; Gradziel, Marcin L.; Trappe, Neil; Cahill, Fiachra; Peacocke, T.; Savini, G.; Ganga, K.

2014-07-01

In this paper we describe the optical modelling of astronomical telescopes that exploit bolometric detectors fed by multimoded horn antennas. In cases where the horn shape is profiled rather than being a simple cone, we determine the beam at the horn aperture using an electromagnetic mode-matching technique. Bolometers, usually placed in an integrating cavity, can excite many hybrid modes in a corrugated horn; we usually assume they excite all modes equally. If the waveguide section feeding the horn is oversized these modes can propagate independently, thereby increasing the throughput of the system. We use an SVD analysis on the matrix that describes the scattering between waveguide (TE/TM) modes to recover the independent orthogonal fields (hybrid modes) and then propagate these to the sky independently where they are added in quadrature. Beam patterns at many frequencies across the band are then added with a weighting appropriate to the source spectrum. Here we describe simulations carried out on the highest-frequency (857-GHz) channel of the Planck HFI instrument. We concentrate in particular on the use of multimode feedhorns and consider the effects of possible manufacturing tolerances on the beam on the sky. We also investigate the feasibility of modelling far-out sidelobes across a wide band for electrically large structures and bolometers fed by multi-mode feedhorns. Our optical simulations are carried out using the industry-standard GRASP software package.

Multimodal microscopy and the stepwise multi-photon activation fluorescence of melanin

Science.gov (United States)

Lai, Zhenhua

The author's work is divided into three aspects: multimodal microscopy, stepwise multi-photon activation fluorescence (SMPAF) of melanin, and customized-profile lenses (CPL) for on-axis laser scanners, which will be introduced respectively. A multimodal microscope provides the ability to image samples with multiple modalities on the same stage, which incorporates the benefits of all modalities. The multimodal microscopes developed in this dissertation are the Keck 3D fusion multimodal microscope 2.0 (3DFM 2.0), upgraded from the old 3DFM with improved performance and flexibility, and the multimodal microscope for targeting small particles (the "Target" system). The control systems developed for both microscopes are low-cost and easy-to-build, with all components off-the-shelf. The control system have not only significantly decreased the complexity and size of the microscope, but also increased the pixel resolution and flexibility. The SMPAF of melanin, activated by a continuous-wave (CW) mode near-infrared (NIR) laser, has potential applications for a low-cost and reliable method of detecting melanin. The photophysics of melanin SMPAF has been studied by theoretical analysis of the excitation process and investigation of the spectra, activation threshold, and photon number absorption of melanin SMPAF. SMPAF images of melanin in mouse hair and skin, mouse melanoma, and human black and white hairs are compared with images taken by conventional multi-photon fluorescence microscopy (MPFM) and confocal reflectance microscopy (CRM). SMPAF images significantly increase specificity and demonstrate the potential to increase sensitivity for melanin detection compared to MPFM images and CRM images. Employing melanin SMPAF imaging to detect melanin inside human skin in vivo has been demonstrated, which proves the effectiveness of melanin detection using SMPAF for medical purposes. Selective melanin ablation with micrometer resolution has been presented using the Target system

Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example

DEFF Research Database (Denmark)

Vidakis, Nikolas; Vlasopoulos, Anastasios; Kounalakis, Tsampikos

2013-01-01

This paper presents a natural user interface system based on multimodal human computer interaction, which operates as an intermediate module between the user and the operating system. The aim of this work is to demonstrate a multimodal system which gives users the ability to interact with desktop...

Hybrid PD and effective multi-mode positive position feedback control for slewing and vibration suppression of a smart flexible manipulator

International Nuclear Information System (INIS)

Lou, Jun-qiang; Wei, Yan-ding; Yang, Yi-ling; Xie, Feng-ran

2015-01-01

A hybrid control strategy for slewing and vibration suppression of a smart flexible manipulator is presented in this paper. It consists of a proportional derivative controller to realize motion control, and an effective multi-mode positive position feedback (EMPPF) controller to suppress the multi-mode vibration. Rather than treat each mode equally as the standard multi-mode PPF, the essence of the EMPPF is that control forces of different modes are applied according to the mode parameters of the respective modes, so the vibration modes with less vibration energy receive fewer control forces. Stability conditions for the close loop system are established through stability analysis. Optimal parameters of the EMPPF controller are obtained using the method of root locus analysis. The performance of the proposed strategy is demonstrated by simulation and experiments. Experimental results show that the first two vibration modes of the manipulator are effectively suppressed. The setting time of the setup descends approximately 55%, reaching 3.12 s from 5.67 s. (paper)

Hybrid PD and effective multi-mode positive position feedback control for slewing and vibration suppression of a smart flexible manipulator

Science.gov (United States)

Lou, Jun-qiang; Wei, Yan-ding; Yang, Yi-ling; Xie, Feng-ran

2015-03-01

A hybrid control strategy for slewing and vibration suppression of a smart flexible manipulator is presented in this paper. It consists of a proportional derivative controller to realize motion control, and an effective multi-mode positive position feedback (EMPPF) controller to suppress the multi-mode vibration. Rather than treat each mode equally as the standard multi-mode PPF, the essence of the EMPPF is that control forces of different modes are applied according to the mode parameters of the respective modes, so the vibration modes with less vibration energy receive fewer control forces. Stability conditions for the close loop system are established through stability analysis. Optimal parameters of the EMPPF controller are obtained using the method of root locus analysis. The performance of the proposed strategy is demonstrated by simulation and experiments. Experimental results show that the first two vibration modes of the manipulator are effectively suppressed. The setting time of the setup descends approximately 55%, reaching 3.12 s from 5.67 s.

Multimodality imaging of the postoperative shoulder

Energy Technology Data Exchange (ETDEWEB)

Woertler, Klaus [Technische Universitaet Muenchen, Department of Radiology, Munich (Germany)

2007-12-15

Multimodality imaging of the postoperative shoulder includes radiography, magnetic resonance (MR) imaging, MR arthrography, computed tomography (CT), CT arthrography, and ultrasound. Target-oriented evaluation of the postoperative shoulder necessitates familiarity with surgical techniques, their typical complications and sources of failure, knowledge of normal and abnormal postoperative findings, awareness of the advantages and weaknesses with the different radiologic techniques, and clinical information on current symptoms and function. This article reviews the most commonly used surgical procedures for treatment of anterior glenohumeral instability, lesions of the labral-bicipital complex, subacromial impingement, and rotator cuff lesions and highlights the significance of imaging findings with a view to detection of recurrent lesions and postoperative complications in a multimodality approach. (orig.)

New Technologies, New Possibilities for the Arts and Multimodality in English Language Arts

Science.gov (United States)

Williams, Wendy R.

2014-01-01

This article discusses the arts, multimodality, and new technologies in English language arts. It then turns to the example of the illuminated text--a multimodal book report consisting of animated text, music, and images--to consider how art, multimodality, and technology can work together to support students' reading of literature and inspire…

Comprehensive physical analysis of bond wire interfaces in power modules

DEFF Research Database (Denmark)

Popok, Vladimir; Pedersen, Kristian Bonderup; Kristensen, Peter Kjær

2016-01-01

causing failures. In this paper we present a review on the set of our experimental and theoretical studies allowing comprehensive physical analysis of changes in materials under active power cycling with focus on bond wire interfaces and thin metallisation layers. The developed electro-thermal and thermo...

Multimodal Strategies of Theorization

DEFF Research Database (Denmark)

Cartel, Melodie; Colombero, Sylvain; Boxenbaum, Eva

This paper examines the role of multimodal strategies in processes of theorization. Empirically, we investigate the theorization process of a highly disruptive innovation in the history of architecture: reinforced concrete. Relying on archival data from a dominant French architectural journal from...... with well-known rhetorical strategies and develop a process model of theorization....

Toward multimodal signal detection of adverse drug reactions.

Science.gov (United States)

Harpaz, Rave; DuMouchel, William; Schuemie, Martijn; Bodenreider, Olivier; Friedman, Carol; Horvitz, Eric; Ripple, Anna; Sorbello, Alfred; White, Ryen W; Winnenburg, Rainer; Shah, Nigam H

2017-12-01

Improving mechanisms to detect adverse drug reactions (ADRs) is key to strengthening post-marketing drug safety surveillance. Signal detection is presently unimodal, relying on a single information source. Multimodal signal detection is based on jointly analyzing multiple information sources. Building on, and expanding the work done in prior studies, the aim of the article is to further research on multimodal signal detection, explore its potential benefits, and propose methods for its construction and evaluation. Four data sources are investigated; FDA's adverse event reporting system, insurance claims, the MEDLINE citation database, and the logs of major Web search engines. Published methods are used to generate and combine signals from each data source. Two distinct reference benchmarks corresponding to well-established and recently labeled ADRs respectively are used to evaluate the performance of multimodal signal detection in terms of area under the ROC curve (AUC) and lead-time-to-detection, with the latter relative to labeling revision dates. Limited to our reference benchmarks, multimodal signal detection provides AUC improvements ranging from 0.04 to 0.09 based on a widely used evaluation benchmark, and a comparative added lead-time of 7-22 months relative to labeling revision dates from a time-indexed benchmark. The results support the notion that utilizing and jointly analyzing multiple data sources may lead to improved signal detection. Given certain data and benchmark limitations, the early stage of development, and the complexity of ADRs, it is currently not possible to make definitive statements about the ultimate utility of the concept. Continued development of multimodal signal detection requires a deeper understanding the data sources used, additional benchmarks, and further research on methods to generate and synthesize signals. Copyright © 2017 Elsevier Inc. All rights reserved.

Multimodal treatment for unresectable pancreatic cancer

International Nuclear Information System (INIS)

Katayama, Kanji; Iida, Atsushi; Fujita, Takashi; Kobayashi, Taizo; Shinmoto, Syuichi; Hirose, Kazuo; Yamaguchi, Akio; Yoshida, Masanori

1998-01-01

In order to improve in prognosis and quality of life (QOL), the multimodal treatment for unresectable pancreatic cancers were performed. Bypass surgery was carried out for unresectable pancreatic cancer with intraoperative irradiation (IOR). After surgery, patients were treated with the combination of CDDP (25 mg) and MMC (4 mg) administration, intravenously continuous injection of 5-FU (250 mg for 24 hours), external radiation by the high voltage X-ray (1.5 Gy per irradiation, 4 times a week, and during hyperthermia 3 Gy per irradiation) and hyperthermia using the Thermotron RF-8 warmer. Six out of 13 patients received hyperthermia at over 40degC, were obtained PR, and their survival periods were 22, 21, 19, 18, 11 and 8 months and they could return to work. For all patients with pain, the symptom was abolished or reduced. The survival periods in cases of the multimodal treatment were longer than those of only bypass-surgery or of the resective cases with the curability C. The multimodal treatment combined with radiation, hyperthermia and surgery is more useful for the removal of pain and the improvement of QOL, and also expected the improvement of the prognosis than pancreatectomy. And hyperthermia has an important role on the effect of this treatment. (K.H.)

Multimodal treatment for unresectable pancreatic cancer

Energy Technology Data Exchange (ETDEWEB)

Katayama, Kanji; Iida, Atsushi; Fujita, Takashi; Kobayashi, Taizo; Shinmoto, Syuichi; Hirose, Kazuo; Yamaguchi, Akio; Yoshida, Masanori [Fukui Medical School, Matsuoka (Japan)

1998-07-01

In order to improve in prognosis and quality of life (QOL), the multimodal treatment for unresectable pancreatic cancers were performed. Bypass surgery was carried out for unresectable pancreatic cancer with intraoperative irradiation (IOR). After surgery, patients were treated with the combination of CDDP (25 mg) and MMC (4 mg) administration, intravenously continuous injection of 5-FU (250 mg for 24 hours), external radiation by the high voltage X-ray (1.5 Gy per irradiation, 4 times a week, and during hyperthermia 3 Gy per irradiation) and hyperthermia using the Thermotron RF-8 warmer. Six out of 13 patients received hyperthermia at over 40degC, were obtained PR, and their survival periods were 22, 21, 19, 18, 11 and 8 months and they could return to work. For all patients with pain, the symptom was abolished or reduced. The survival periods in cases of the multimodal treatment were longer than those of only bypass-surgery or of the resective cases with the curability C. The multimodal treatment combined with radiation, hyperthermia and surgery is more useful for the removal of pain and the improvement of QOL, and also expected the improvement of the prognosis than pancreatectomy. And hyperthermia has an important role on the effect of this treatment. (K.H.)

Dynamic analysis of holiday travel behavior with integrated multimodal travel information usage : a life-oriented approach

NARCIS (Netherlands)

Wang, B.; Shao, C.; Ji, X.

2017-01-01

The Integrated Multimodal Travel Information (IMTI) plays an important role in the evolution process of holiday travel behaviour, which is seldom investigated. To fill this gap, this study analyses holiday travel behaviour dynamics with IMTI usage, based on the life-oriented approach. IMTI usage is

Framework for Developing a Multimodal Programming Interface Used on Industrial Robots

Directory of Open Access Journals (Sweden)

Bogdan Mocan

2014-12-01

Full Text Available The proposed approach within this paper shifts the focus from the coordinate based programming of an industrial robot, which currently dominates the field, to an object based programming scheme. The general framework proposed in this paper is designed to perform natural language understanding, gesture integration and semantic analysis which facilitate the development of a multimodal robot programming interface that facilitate an intuitive programming.

Spectral embedding-based registration (SERg) for multimodal fusion of prostate histology and MRI

Science.gov (United States)

Hwuang, Eileen; Rusu, Mirabela; Karthigeyan, Sudha; Agner, Shannon C.; Sparks, Rachel; Shih, Natalie; Tomaszewski, John E.; Rosen, Mark; Feldman, Michael; Madabhushi, Anant

2014-03-01

Multi-modal image registration is needed to align medical images collected from different protocols or imaging sources, thereby allowing the mapping of complementary information between images. One challenge of multimodal image registration is that typical similarity measures rely on statistical correlations between image intensities to determine anatomical alignment. The use of alternate image representations could allow for mapping of intensities into a space or representation such that the multimodal images appear more similar, thus facilitating their co-registration. In this work, we present a spectral embedding based registration (SERg) method that uses non-linearly embedded representations obtained from independent components of statistical texture maps of the original images to facilitate multimodal image registration. Our methodology comprises the following main steps: 1) image-derived textural representation of the original images, 2) dimensionality reduction using independent component analysis (ICA), 3) spectral embedding to generate the alternate representations, and 4) image registration. The rationale behind our approach is that SERg yields embedded representations that can allow for very different looking images to appear more similar, thereby facilitating improved co-registration. Statistical texture features are derived from the image intensities and then reduced to a smaller set by using independent component analysis to remove redundant information. Spectral embedding generates a new representation by eigendecomposition from which only the most important eigenvectors are selected. This helps to accentuate areas of salience based on modality-invariant structural information and therefore better identifies corresponding regions in both the template and target images. The spirit behind SERg is that image registration driven by these areas of salience and correspondence should improve alignment accuracy. In this work, SERg is implemented using Demons

Multimodal quantitative phase and fluorescence imaging of cell apoptosis

Science.gov (United States)

Fu, Xinye; Zuo, Chao; Yan, Hao

2017-06-01

Fluorescence microscopy, utilizing fluorescence labeling, has the capability to observe intercellular changes which transmitted and reflected light microscopy techniques cannot resolve. However, the parts without fluorescence labeling are not imaged. Hence, the processes simultaneously happen in these parts cannot be revealed. Meanwhile, fluorescence imaging is 2D imaging where information in the depth is missing. Therefore the information in labeling parts is also not complete. On the other hand, quantitative phase imaging is capable to image cells in 3D in real time through phase calculation. However, its resolution is limited by the optical diffraction and cannot observe intercellular changes below 200 nanometers. In this work, fluorescence imaging and quantitative phase imaging are combined to build a multimodal imaging system. Such system has the capability to simultaneously observe the detailed intercellular phenomenon and 3D cell morphology. In this study the proposed multimodal imaging system is used to observe the cell behavior in the cell apoptosis. The aim is to highlight the limitations of fluorescence microscopy and to point out the advantages of multimodal quantitative phase and fluorescence imaging. The proposed multimodal quantitative phase imaging could be further applied in cell related biomedical research, such as tumor.

Label-free evaluation of hepatic microvesicular steatosis with multimodal coherent anti-Stokes Raman scattering microscopy.

Directory of Open Access Journals (Sweden)

Thuc T Le

Full Text Available Hepatic microvesicular steatosis is a hallmark of drug-induced hepatotoxicity and early-stage fatty liver disease. Current histopathology techniques are inadequate for the clinical evaluation of hepatic microvesicular steatosis. In this paper, we explore the use of multimodal coherent anti-Stokes Raman scattering (CARS microscopy for the detection and characterization of hepatic microvesicular steatosis. We show that CARS microscopy is more sensitive than Oil Red O histology for the detection of microvesicular steatosis. Computer-assisted analysis of liver lipid level based on CARS signal intensity is consistent with triglyceride measurement using a standard biochemical assay. Most importantly, in a single measurement procedure on unprocessed and unstained liver tissues, multimodal CARS imaging provides a wealth of critical information including the detection of microvesicular steatosis and quantitation of liver lipid content, number and size of lipid droplets, and lipid unsaturation and packing order of lipid droplets. Such information can only be assessed by multiple different methods on processed and stained liver tissues or tissue extracts using current standard analytical techniques. Multimodal CARS microscopy also permits label-free identification of lipid-rich non-parenchymal cells. In addition, label-free and non-perturbative CARS imaging allow rapid screening of mitochondrial toxins-induced microvesicular steatosis in primary hepatocyte cultures. With its sensitivity and versatility, multimodal CARS microscopy should be a powerful tool for the clinical evaluation of hepatic microvesicular steatosis.

Game of Objects: vicarious causation and multi-modal media

Directory of Open Access Journals (Sweden)

Aaron Pedinotti

2013-09-01

Full Text Available This paper applies philosopher Graham Harman's object-oriented theory of "vicarious causation" to an analysis of the multi-modal media phenomenon known as "Game of Thrones." Examining the manner in which George R.R. Martin's best-selling series of fantasy novels has been adapted into a board game, a video game, and a hit HBO television series, it uses the changes entailed by these processes to trace the contours of vicariously generative relations. In the course of the resulting analysis, it provides new suggestions concerning the eidetic dimensions of Harman's causal model, particularly with regard to causation in linear networks and in differing types of game systems.

Comprehensive proteomic analysis of human pancreatic juice

DEFF Research Database (Denmark)

Grønborg, Mads; Bunkenborg, Jakob; Kristiansen, Troels Zakarias

2004-01-01

Proteomic technologies provide an excellent means for analysis of body fluids for cataloging protein constituents and identifying biomarkers for early detection of cancers. The biomarkers currently available for pancreatic cancer, such as CA19-9, lack adequate sensitivity and specificity...... contributing to late diagnosis of this deadly disease. In this study, we carried out a comprehensive characterization of the "pancreatic juice proteome" in patients with pancreatic adenocarcinoma. Pancreatic juice was first fractionated by 1-dimensional gel electrophoresis and subsequently analyzed by liquid...... in this study could be directly assessed for their potential as biomarkers for pancreatic cancer by quantitative proteomics methods or immunoassays....

Upper Mantle Shear Wave Structure Beneath North America From Multi-mode Surface Wave Tomography

Science.gov (United States)

Yoshizawa, K.; Ekström, G.

2008-12-01

The upper mantle structure beneath the North American continent has been investigated from measurements of multi-mode phase speeds of Love and Rayleigh waves. To estimate fundamental-mode and higher-mode phase speeds of surface waves from a single seismogram at regional distances, we have employed a method of nonlinear waveform fitting based on a direct model-parameter search using the neighbourhood algorithm (Yoshizawa & Kennett, 2002). The method of the waveform analysis has been fully automated by employing empirical quantitative measures for evaluating the accuracy/reliability of estimated multi-mode phase dispersion curves, and thus it is helpful in processing the dramatically increasing numbers of seismic data from the latest regional networks such as USArray. As a first step toward modeling the regional anisotropic shear-wave velocity structure of the North American upper mantle with extended vertical resolution, we have applied the method to long-period three-component records of seismic stations in North America, which mostly comprise the GSN and US regional networks as well as the permanent and transportable USArray stations distributed by the IRIS DMC. Preliminary multi-mode phase-speed models show large-scale patterns of isotropic heterogeneity, such as a strong velocity contrast between the western and central/eastern United States, which are consistent with the recent global and regional models (e.g., Marone, et al. 2007; Nettles & Dziewonski, 2008). We will also discuss radial anisotropy of shear wave speed beneath North America from multi-mode dispersion measurements of Love and Rayleigh waves.

Multimodal neural correlates of cognitive control in the Human Connectome Project.

Science.gov (United States)

Lerman-Sinkoff, Dov B; Sui, Jing; Rachakonda, Srinivas; Kandala, Sridhar; Calhoun, Vince D; Barch, Deanna M

2017-12-01

Cognitive control is a construct that refers to the set of functions that enable decision-making and task performance through the representation of task states, goals, and rules. The neural correlates of cognitive control have been studied in humans using a wide variety of neuroimaging modalities, including structural MRI, resting-state fMRI, and task-based fMRI. The results from each of these modalities independently have implicated the involvement of a number of brain regions in cognitive control, including dorsal prefrontal cortex, and frontal parietal and cingulo-opercular brain networks. However, it is not clear how the results from a single modality relate to results in other modalities. Recent developments in multimodal image analysis methods provide an avenue for answering such questions and could yield more integrated models of the neural correlates of cognitive control. In this study, we used multiset canonical correlation analysis with joint independent component analysis (mCCA + jICA) to identify multimodal patterns of variation related to cognitive control. We used two independent cohorts of participants from the Human Connectome Project, each of which had data from four imaging modalities. We replicated the findings from the first cohort in the second cohort using both independent and predictive analyses. The independent analyses identified a component in each cohort that was highly similar to the other and significantly correlated with cognitive control performance. The replication by prediction analyses identified two independent components that were significantly correlated with cognitive control performance in the first cohort and significantly predictive of performance in the second cohort. These components identified positive relationships across the modalities in neural regions related to both dynamic and stable aspects of task control, including regions in both the frontal-parietal and cingulo-opercular networks, as well as regions

Multimodal imaging in cerebral gliomas and its neuropathological correlation

Energy Technology Data Exchange (ETDEWEB)

Gempt, Jens, E-mail: jens.gempt@lrz.tum.de [Neurochirurgische Klinik und Poliklinik, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Soehngen, Eric [Abteilung für Neuroradiologie, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Abteilung für Neuropathologie des Instituts für Allgemeine Pathologie und Pathologische Anatomie, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Förster, Stefan [Nuklearmedizinische Klinik und Poliklinik, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Ryang, Yu-Mi [Neurochirurgische Klinik und Poliklinik, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Schlegel, Jürgen [Abteilung für Neuropathologie des Instituts für Allgemeine Pathologie und Pathologische Anatomie, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); and others

2014-05-15

Introduction: Concerning the preoperative clinical diagnostic work-up of glioma patients, tumor heterogeneity challenges the oncological therapy. The current study assesses the performance of a multimodal imaging approach to differentiate between areas in malignant gliomas and to investigate the extent to which such a combinatorial imaging approach might predict the underlying histology. Methods: Prior to surgical resection, patients harboring intracranial gliomas underwent MRIs (MR-S, PWI) and {sup 18}F-FET-PETs. Intratumoral and peritumoral biopsy targets were defined, by MRI only, by FET-PET only, and by MRI and FET-PET combined, and biopsied prior to surgical resection and which then received separate histopathological examinations. Results: In total, 38 tissue samples were acquired (seven glioblastomas, one anaplastic astrocytoma, one anaplastic oligoastrocytoma, one diffuse astrocytoma, and one oligoastrocytoma) and underwent histopathological analysis. The highest mean values of Mib1 and CD31 were found in the target point “T’ defined by MRI and FET-PET combined. A significant correlation between NAA/Cr and PET tracer uptake (−0.845, p < 0.05) as well as Cho/Cr ratio and cell density (0.742, p < 0.05) and NAA/Cr ratio and MIB-1 (−0761, p < 0.05) was disclosed for this target point, though not for target points defined by MRI and FET-PET alone. Conclusion: Multimodal-imaging-guided stereotactic biopsy correlated more with histological malignancy indices, such as cell density and MIB-1 labeling, than targets that were based solely on the highest amino acid uptake or contrast enhancement on MRI. The results of our study indicate that a combined PET-MR multimodal imaging approach bears potential benefits in detecting glioma heterogeneity.

Cultural Shifts, Multimodal Representations, and Assessment Practices: A Case Study

Science.gov (United States)

Curwood, Jen Scott

2012-01-01

Multimodal texts involve the presence, absence, and co-occurrence of alphabetic text with visual, audio, tactile, gestural, and spatial representations. This article explores how teachers' evaluation of students' multimodal work can be understood in terms of cognition and culture. When teachers apply a paradigm of assessment rooted in print-based…

Multiscale climate emulator of multimodal wave spectra: MUSCLE-spectra

Science.gov (United States)

Rueda, Ana; Hegermiller, Christie A.; Antolinez, Jose A. A.; Camus, Paula; Vitousek, Sean; Ruggiero, Peter; Barnard, Patrick L.; Erikson, Li H.; Tomás, Antonio; Mendez, Fernando J.

2017-02-01

Characterization of multimodal directional wave spectra is important for many offshore and coastal applications, such as marine forecasting, coastal hazard assessment, and design of offshore wave energy farms and coastal structures. However, the multivariate and multiscale nature of wave climate variability makes this complex problem tractable using computationally expensive numerical models. So far, the skill of statistical-downscaling model-based parametric (unimodal) wave conditions is limited in large ocean basins such as the Pacific. The recent availability of long-term directional spectral data from buoys and wave hindcast models allows for development of stochastic models that include multimodal sea-state parameters. This work introduces a statistical downscaling framework based on weather types to predict multimodal wave spectra (e.g., significant wave height, mean wave period, and mean wave direction from different storm systems, including sea and swells) from large-scale atmospheric pressure fields. For each weather type, variables of interest are modeled using the categorical distribution for the sea-state type, the Generalized Extreme Value (GEV) distribution for wave height and wave period, a multivariate Gaussian copula for the interdependence between variables, and a Markov chain model for the chronology of daily weather types. We apply the model to the southern California coast, where local seas and swells from both the Northern and Southern Hemispheres contribute to the multimodal wave spectrum. This work allows attribution of particular extreme multimodal wave events to specific atmospheric conditions, expanding knowledge of time-dependent, climate-driven offshore and coastal sea-state conditions that have a significant influence on local nearshore processes, coastal morphology, and flood hazards.

A Case Study of Diverse Multimodal Influences on Music Improvisation Using Visual Methodology

Science.gov (United States)

Tomlinson, Michelle M.

2016-01-01

This case study employed multimodal methods and visual analysis to explore how a young multilingual student used music improvisation to form a speech rap. This student, recently arrived in Australia from Ethiopia, created piano music that was central to his music identity and that simultaneously, through dialogue with his mother, enhanced his…

The Work of Comics Collaborations: Considerations of Multimodal Composition for Writing Scholarship and Pedagogy

Science.gov (United States)

Scanlon, Molly J.

2015-01-01

Though multimodality is increasingly incorporated into our pedagogies and scholarship, explorations of collaborative multimodal composition are lacking. Existing literature on collaborative writing focuses predominately on texts either composed in singular modes or by a single author, neglecting the ways in which multimodal texts are composed…

A systematic review and meta-analysis of comprehensive interventions for pre-school children with autism spectrum disorder (ASD.

Directory of Open Access Journals (Sweden)

Yoshiyuki Tachibana

Full Text Available There has an increasing number of published trials on psychosocial intervention programmes for pre-school children with autism spectrum disorder (ASD. To achieve better quality of unbiased evidence for the effectiveness of ASD interventions, it is necessary to conduct a comprehensive review that covers studies with adequate quality standards, such as randomised controlled trials (RCTs, and different types of intervention In this study, we categorize interventions for ASD as behavioural, social-communication focused, and multimodal developmental based on Howlin's classification of early interventions for children with ASD. The aim of this study was to compare these three models and investigate the strengths and weaknesses of each type of intervention and to identify the approaches that contribute to a successful outcome for children with autism.We performed a systematic review and meta-analysis. We included RCTs targeting children with ASD 6 years old or younger. A random effects model was used to present the effect estimate for the outcomes. This study also performed combined meta-analyses of all the three models to investigate the overall effectiveness of the intervention programmes.32 randomized controlled studies were found to be eligible for inclusion. The synthesized data included 594 children from 14 RCTs. There was no statistically significant difference in the effects on autism general symptoms between the social-communication-focused model and the multimodal developmental model (p = 0.83. The results suggest that there is evidence of an effect on 'reciprocity of social interaction towards others' (standard mean difference [95% confidential interval] = 0.53[0.29,0.78], p<0.01 and 'parental synchrony' (SMD = 0.99[0.70,1.29], p<0.01.The small number of studies included in the present study limited the ability to make inferences when comparing the three models and investigating the strengths and weaknesses of each type of intervention with

Body-insensitive Multi-Mode MIMO Terminal Antenna of Double-Ring Structure

DEFF Research Database (Denmark)

Zhao, Kun; Zhang, Shuai; Ishimiya, Katsunori

2015-01-01

of mobile terminals. With the multimode excitation, the MIMO cellular antenna can operate at 830-900 MHz, 1700-2200 MHz, and 2400-2700 MHz, for 2G, 3G, and LTE bands, respectively. The MIMO Wi-Fi antenna can cover two Wi-Fi bands from 2.4 to 2.5 GHz and from 5.2 to 5.8 GHz. The effect of a user's body......In this paper, we propose a novel multimode multi-input multi-output (MIMO) antenna system composed of a dual-element MIMO cellular antenna and dual-element MIMO Wi-Fi antenna for mobile terminal applications. The antenna system has a double-ring structure and can be integrated with the metal frame...... on the MIMO cellular antenna is investigated on CTIA standard phantoms and a real user. Since our antenna mainly operates in the loop mode, it has a much lower efficiency loss than conventional mobile antennas in both talking and data modes. Our theoretical analysis and experiments have shown that our design...

A Multimodal Search Engine for Medical Imaging Studies.

Science.gov (United States)

Pinho, Eduardo; Godinho, Tiago; Valente, Frederico; Costa, Carlos

2017-02-01

The use of digital medical imaging systems in healthcare institutions has increased significantly, and the large amounts of data in these systems have led to the conception of powerful support tools: recent studies on content-based image retrieval (CBIR) and multimodal information retrieval in the field hold great potential in decision support, as well as for addressing multiple challenges in healthcare systems, such as computer-aided diagnosis (CAD). However, the subject is still under heavy research, and very few solutions have become part of Picture Archiving and Communication Systems (PACS) in hospitals and clinics. This paper proposes an extensible platform for multimodal medical image retrieval, integrated in an open-source PACS software with profile-based CBIR capabilities. In this article, we detail a technical approach to the problem by describing its main architecture and each sub-component, as well as the available web interfaces and the multimodal query techniques applied. Finally, we assess our implementation of the engine with computational performance benchmarks.

Multimodal designs for learning in contexts of diversity

Directory of Open Access Journals (Sweden)

Arlene Archer

2014-12-01

Full Text Available This paper aims to identify multimodal designs for learning in diverse and developing contexts, where access to resources remains vastly unequal. Using case studies from South African education, the paper explores ways of surfacing the range of students’ resources which are often not noticed or valued in formal educational settings. The studies showcased here demonstrate how ethnographic and textually-based approaches can be combined. Opening up the semiotic space of the classroom through multimodal designs for learning is important for finding innovative ways of addressing access, diversity, and past inequalities. This is of relevance not only to South Africa, but a range of global contexts. The paper argues that multimodal designs for learning can involve interrogating the relation between ‘tradition’ and ‘modernity’; harnessing students’ creative practices as resources for pedagogy; developing metalanguages for critical reflection; creating less regulated pedagogical spaces in order to enable useful teaching and learning practices.

Analysis and Comprehensive Analytical Modeling of Statistical Variations in Subthreshold MOSFET's High Frequency Characteristics

Directory of Open Access Journals (Sweden)

Rawid Banchuin

2014-01-01

Full Text Available In this research, the analysis of statistical variations in subthreshold MOSFET's high frequency characteristics defined in terms of gate capacitance and transition frequency, have been shown and the resulting comprehensive analytical models of such variations in terms of their variances have been proposed. Major imperfection in the physical level properties including random dopant fluctuation and effects of variations in MOSFET's manufacturing process, have been taken into account in the proposed analysis and modeling. The up to dated comprehensive analytical model of statistical variation in MOSFET's parameter has been used as the basis of analysis and modeling. The resulting models have been found to be both analytic and comprehensive as they are the precise mathematical expressions in terms of physical level variables of MOSFET. Furthermore, they have been verified at the nanometer level by using 65~nm level BSIM4 based benchmarks and have been found to be very accurate with smaller than 5 % average percentages of errors. Hence, the performed analysis gives the resulting models which have been found to be the potential mathematical tool for the statistical and variability aware analysis and design of subthreshold MOSFET based VHF circuits, systems and applications.

Multimodality imaging of pulmonary infarction

International Nuclear Information System (INIS)

Bray, T.J.P.; Mortensen, K.H.; Gopalan, D.

2014-01-01

Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis

Multimodality imaging of pulmonary infarction

Energy Technology Data Exchange (ETDEWEB)

Bray, T.J.P., E-mail: timothyjpbray@gmail.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); Mortensen, K.H., E-mail: mortensen@doctors.org.uk [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); University Department of Radiology, Addenbrookes Hospital, Cambridge University Hospitals NHS Foundation Trust, Hills Road, Box 318, Cambridge CB2 0QQ (United Kingdom); Gopalan, D., E-mail: deepa.gopalan@btopenworld.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom)

2014-12-15

Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis.

Neuromuscular Adaptations to Multimodal Injury Prevention Programs in Youth Sports: A Systematic Review with Meta-Analysis of Randomized Controlled Trials

Directory of Open Access Journals (Sweden)

Oliver Faude

2017-10-01

Full Text Available Objective: Neuromuscular injury prevention programs (IPP can reduce injury rate by about 40% in youth sport. Multimodal IPP include, for instance, balance, strength, power, and agility exercises. Our systematic review and meta-analysis aimed to evaluate the effects of multimodal IPP on neuromuscular performance in youth sports.Methods: We conducted a systematic literature search including selected search terms related to youth sports, injury prevention, and neuromuscular performance. Inclusion criteria were: (i the study was a (cluster-randomized controlled trial (RCT, and (ii investigated healthy participants, up to 20 years of age and involved in organized sport, (iii an intervention arm performing a multimodal IPP was compared to a control arm following a common training regime, and (iv neuromuscular performance parameters (e.g., balance, power, strength, sprint were assessed. Furthermore, we evaluated IPP effects on sport-specific skills.Results: Fourteen RCTs (comprising 704 participants were analyzed. Eight studies included only males, and five only females. Seventy-one percent of all studies investigated soccer players with basketball, field hockey, futsal, Gaelic football, and hurling being the remaining sports. The average age of the participants ranged from 10 years up to 19 years and the level of play from recreational to professional. Intervention durations ranged from 4 weeks to 4.5 months with a total of 12 to 57 training sessions. We observed a small overall effect in favor of IPP for balance/stability (Hedges' g = 0.37; 95%CI 0.17, 0.58, leg power (g = 0.22; 95%CI 0.07, 0.38, and isokinetic hamstring and quadriceps strength as well as hamstrings-to-quadriceps ratio (g = 0.38; 95%CI 0.21, 0.55. We found a large overall effect for sprint abilities (g = 0.80; 95%CI 0.50, 1.09 and sport-specific skills (g = 0.83; 95%CI 0.34, 1.32. Subgroup analyses revealed larger effects in high-level (g = 0.34–1.18 compared to low-level athletes

Neuromuscular Adaptations to Multimodal Injury Prevention Programs in Youth Sports: A Systematic Review with Meta-Analysis of Randomized Controlled Trials.

Science.gov (United States)

Faude, Oliver; Rössler, Roland; Petushek, Erich J; Roth, Ralf; Zahner, Lukas; Donath, Lars

2017-01-01

Objective: Neuromuscular injury prevention programs (IPP) can reduce injury rate by about 40% in youth sport. Multimodal IPP include, for instance, balance, strength, power, and agility exercises. Our systematic review and meta-analysis aimed to evaluate the effects of multimodal IPP on neuromuscular performance in youth sports. Methods: We conducted a systematic literature search including selected search terms related to youth sports, injury prevention, and neuromuscular performance. Inclusion criteria were: (i) the study was a (cluster-)randomized controlled trial (RCT), and (ii) investigated healthy participants, up to 20 years of age and involved in organized sport, (iii) an intervention arm performing a multimodal IPP was compared to a control arm following a common training regime, and (iv) neuromuscular performance parameters (e.g., balance, power, strength, sprint) were assessed. Furthermore, we evaluated IPP effects on sport-specific skills. Results: Fourteen RCTs (comprising 704 participants) were analyzed. Eight studies included only males, and five only females. Seventy-one percent of all studies investigated soccer players with basketball, field hockey, futsal, Gaelic football, and hurling being the remaining sports. The average age of the participants ranged from 10 years up to 19 years and the level of play from recreational to professional. Intervention durations ranged from 4 weeks to 4.5 months with a total of 12 to 57 training sessions. We observed a small overall effect in favor of IPP for balance/stability (Hedges' g = 0.37; 95%CI 0.17, 0.58), leg power (g = 0.22; 95%CI 0.07, 0.38), and isokinetic hamstring and quadriceps strength as well as hamstrings-to-quadriceps ratio (g = 0.38; 95%CI 0.21, 0.55). We found a large overall effect for sprint abilities (g = 0.80; 95%CI 0.50, 1.09) and sport-specific skills (g = 0.83; 95%CI 0.34, 1.32). Subgroup analyses revealed larger effects in high-level (g = 0.34-1.18) compared to low-level athletes (g

Investigating multimodal communication in virtual meetings

DEFF Research Database (Denmark)

Persson, John Stouby; Mathiassen, Lars

2014-01-01

recordings of their oral exchanges and video recordings of their shared dynamic representation of the project’s status and plans, our analysis reveals how their interrelating of visual and verbal communication acts enabled effective communication and coordination. In conclusion, we offer theoretical......To manage distributed work, organizations increasingly rely on virtual meetings based on multimodal, synchronous communication technologies. However, despite technological advances, it is still challenging to coordinate knowledge through these meetings with spatial and cultural separation. Against...... propositions that explain how interrelating of verbal and visual acts based on shared dynamic representations enable communication repairs during virtual meetings. We argue the proposed framework provides researchers with a novel and practical approach to investigate the complex data involved in virtual...

Multimode Interference: Identifying Channels and Ridges in Quantum Probability Distributions

OpenAIRE

O'Connell, Ross C.; Loinaz, Will

2004-01-01

The multimode interference technique is a simple way to study the interference patterns found in many quantum probability distributions. We demonstrate that this analysis not only explains the existence of so-called "quantum carpets," but can explain the spatial distribution of channels and ridges in the carpets. With an understanding of the factors that govern these channels and ridges we have a limited ability to produce a particular pattern of channels and ridges by carefully choosing the ...

BILINGUAL MULTIMODAL SYSTEM FOR TEXT-TO-AUDIOVISUAL SPEECH AND SIGN LANGUAGE SYNTHESIS

Directory of Open Access Journals (Sweden)

A. A. Karpov

2014-09-01

Full Text Available We present a conceptual model, architecture and software of a multimodal system for audio-visual speech and sign language synthesis by the input text. The main components of the developed multimodal synthesis system (signing avatar are: automatic text processor for input text analysis; simulation 3D model of human's head; computer text-to-speech synthesizer; a system for audio-visual speech synthesis; simulation 3D model of human’s hands and upper body; multimodal user interface integrating all the components for generation of audio, visual and signed speech. The proposed system performs automatic translation of input textual information into speech (audio information and gestures (video information, information fusion and its output in the form of multimedia information. A user can input any grammatically correct text in Russian or Czech languages to the system; it is analyzed by the text processor to detect sentences, words and characters. Then this textual information is converted into symbols of the sign language notation. We apply international «Hamburg Notation System» - HamNoSys, which describes the main differential features of each manual sign: hand shape, hand orientation, place and type of movement. On their basis the 3D signing avatar displays the elements of the sign language. The virtual 3D model of human’s head and upper body has been created using VRML virtual reality modeling language, and it is controlled by the software based on OpenGL graphical library. The developed multimodal synthesis system is a universal one since it is oriented for both regular users and disabled people (in particular, for the hard-of-hearing and visually impaired, and it serves for multimedia output (by audio and visual modalities of input textual information.

L2 Reading Comprehension and Its Correlates: A Meta-Analysis

Science.gov (United States)

Jeon, Eun Hee; Yamashita, Junko

2014-01-01

The present meta-analysis examined the overall average correlation (weighted for sample size and corrected for measurement error) between passage-level second language (L2) reading comprehension and 10 key reading component variables investigated in the research domain. Four high-evidence correlates (with 18 or more accumulated effect sizes: L2…

Investigation of protein selectivity in multimodal chromatography using in silico designed Fab fragment variants.

Science.gov (United States)

Karkov, Hanne Sophie; Krogh, Berit Olsen; Woo, James; Parimal, Siddharth; Ahmadian, Haleh; Cramer, Steven M

2015-11-01

In this study, a unique set of antibody Fab fragments was designed in silico and produced to examine the relationship between protein surface properties and selectivity in multimodal chromatographic systems. We hypothesized that multimodal ligands containing both hydrophobic and charged moieties would interact strongly with protein surface regions where charged groups and hydrophobic patches were in close spatial proximity. Protein surface property characterization tools were employed to identify the potential multimodal ligand binding regions on the Fab fragment of a humanized antibody and to evaluate the impact of mutations on surface charge and hydrophobicity. Twenty Fab variants were generated by site-directed mutagenesis, recombinant expression, and affinity purification. Column gradient experiments were carried out with the Fab variants in multimodal, cation-exchange, and hydrophobic interaction chromatographic systems. The results clearly indicated that selectivity in the multimodal system was different from the other chromatographic modes examined. Column retention data for the reduced charge Fab variants identified a binding site comprising light chain CDR1 as the main electrostatic interaction site for the multimodal and cation-exchange ligands. Furthermore, the multimodal ligand binding was enhanced by additional hydrophobic contributions as evident from the results obtained with hydrophobic Fab variants. The use of in silico protein surface property analyses combined with molecular biology techniques, protein expression, and chromatographic evaluations represents a previously undescribed and powerful approach for investigating multimodal selectivity with complex biomolecules. © 2015 Wiley Periodicals, Inc.

Multimodal network design and assessment

NARCIS (Netherlands)

Brands, Ties; Alkim, T.P.; van Eck, Gijs; van Arem, Bart; Arentze, T.

2010-01-01

A framework is proposed for the design of an optimal multimodal transport network for the Randstad area. This research framework consists of a multi-objective optimization heuristic and a fast network assessment module, which results in a set of Pareto optimal solutions. Subsequently, a proper

Discrimination of skin diseases using the multimodal imaging approach

Science.gov (United States)

Vogler, N.; Heuke, S.; Akimov, D.; Latka, I.; Kluschke, F.; Röwert-Huber, H.-J.; Lademann, J.; Dietzek, B.; Popp, J.

2012-06-01

Optical microspectroscopic tools reveal great potential for dermatologic diagnostics in the clinical day-to-day routine. To enhance the diagnostic value of individual nonlinear optical imaging modalities such as coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG) or two-photon excited fluorescence (TPF), the approach of multimodal imaging has recently been developed. Here, we present an application of nonlinear optical multimodal imaging with Raman-scattering microscopy to study sizable human-tissue cross-sections. The samples investigated contain both healthy tissue and various skin tumors. This contribution details the rich information content, which can be obtained from the multimodal approach: While CARS microscopy, which - in contrast to spontaneous Raman-scattering microscopy - is not hampered by single-photon excited fluorescence, is used to monitor the lipid and protein distribution in the samples, SHG imaging selectively highlights the distribution of collagen structures within the tissue. This is due to the fact, that SHG is only generated in structures which lack inversion geometry. Finally, TPF reveals the distribution of autofluorophores in tissue. The combination of these techniques, i.e. multimodal imaging, allows for recording chemical images of large area samples and is - as this contribution will highlight - of high clinically diagnostic value.

Comprehensive two-dimensional liquid chromatographic analysis of poloxamers.

Science.gov (United States)

Malik, Muhammad Imran; Lee, Sanghoon; Chang, Taihyun

2016-04-15

Poloxamers are low molar mass triblock copolymers of poly(ethylene oxide) (PEO) and poly(propylene oxide) (PPO), having number of applications as non-ionic surfactants. Comprehensive one and two-dimensional liquid chromatographic (LC) analysis of these materials is proposed in this study. The separation of oligomers of both types (PEO and PPO) is demonstrated for several commercial poloxamers. This is accomplished at the critical conditions for one of the block while interaction for the other block. Reversed phase LC at CAP of PEO allowed for oligomeric separation of triblock copolymers with regard to PPO block whereas normal phase LC at CAP of PPO renders oligomeric separation with respect to PEO block. The oligomeric separation with regard to PEO and PPO are coupled online (comprehensive 2D-LC) to reveal two-dimensional contour plots by unconventional 2D IC×IC (interaction chromatography) coupling. The study provides chemical composition mapping of both PEO and PPO, equivalent to combined molar mass and chemical composition mapping for several commercial poloxamers. Copyright © 2016 Elsevier B.V. All rights reserved.

Cycling in multimodal transport behaviours: Exploring modality styles in the Danish population

DEFF Research Database (Denmark)

Olafsson, Anton Stahl; Nielsen, Thomas Alexander Sick; Carstensen, Trine Agervig

2016-01-01

and small towns. Thus, the way in which travel modes relate to the urban environment and variations in modality styles must serve as the starting point for policies aiming to fulfil the potential of multimodal transport behaviour and promote cycling. (C) 2016 Elsevier Ltd. All rights reserved....... explores how cycling forms part of multimodal transport behaviour based on survey data on transport modes and travel purposes and the weekly frequency of out-of-home activities and travel mode use in a representative sample of adult Danes (n = 1957). The following five distinct multimodal travel segments...... or 'modality styles' are identified: 'education transport'; 'public-based transport'; 'limited transport'; 'bicycle-based transport'; and 'car-based transport'. Travel behaviour is predominantly multimodal with few unimodal car-drivers being identified. Substantial cycling takes place in all modality styles...

Multimodality with Eye tracking and Haptics: A New Horizon for Serious Games?

Directory of Open Access Journals (Sweden)

Shujie Deng

2014-10-01

Full Text Available The goal of this review is to illustrate the emerging use of multimodal virtual reality that can benefit learning-based games. The review begins with an introduction to multimodal virtual reality in serious games and we provide a brief discussion of why cognitive processes involved in learning and training are enhanced under immersive virtual environments. We initially outline studies that have used eye tracking and haptic feedback independently in serious games, and then review some innovative applications that have already combined eye tracking and haptic devices in order to provide applicable multimodal frameworks for learning-based games. Finally, some general conclusions are identified and clarified in order to advance current understanding in multimodal serious game production as well as exploring possible areas for new applications.

Design, Performance and Optimization for Multimodal Radar Operation

Directory of Open Access Journals (Sweden)

Surendra S. Bhat

2012-09-01

Full Text Available This paper describes the underlying methodology behind an adaptive multimodal radar sensor that is capable of progressively optimizing its range resolution depending upon the target scattering features. It consists of a test-bed that enables the generation of linear frequency modulated waveforms of various bandwidths. This paper discusses a theoretical approach to optimizing the bandwidth used by the multimodal radar. It also discusses the various experimental results obtained from measurement. The resolution predicted from theory agrees quite well with that obtained from experiments for different target arrangements.

Spectral space-time coding for optical communications through a multimode fiber

NARCIS (Netherlands)

Alonso, A.; Berghmans, F.; Thienpont, H.; Danckaert, J.; Desmet, L.

2001-01-01

We propose a method for coding the mode structure of a multimode optical fiber by spectral coding mixed with space-time modulation. With this system we can improve the data carrying capacity of a multimode fiber for optical communications and optical interconnects, and encode and decode the

Semiconductor laser using multimode interference principle

Science.gov (United States)

Gong, Zisu; Yin, Rui; Ji, Wei; Wu, Chonghao

2018-01-01

Multimode interference (MMI) structure is introduced in semiconductor laser used in optical communication system to realize higher power and better temperature tolerance. Using beam propagation method (BPM), Multimode interference laser diode (MMI-LD) is designed and fabricated in InGaAsP/InP based material. As a comparison, conventional semiconductor laser using straight single-mode waveguide is also fabricated in the same wafer. With a low injection current (about 230 mA), the output power of the implemented MMI-LD is up to 2.296 mW which is about four times higher than the output power of the conventional semiconductor laser. The implemented MMI-LD exhibits stable output operating at the wavelength of 1.52 μm and better temperature tolerance when the temperature varies from 283.15 K to 293.15 K.

Driver Education for New Multimodal Facilities

Science.gov (United States)

2016-05-24

Local and state transportation agencies are redesigning roads to accommodate multimodal travel, including the addition of new configurations, infrastructures, and rules that may be unfamiliar to current drivers and other road users. Education and out...

Multimodal Learning Analytics and Education Data Mining: Using Computational Technologies to Measure Complex Learning Tasks

Science.gov (United States)

Blikstein, Paulo; Worsley, Marcelo

2016-01-01

New high-frequency multimodal data collection technologies and machine learning analysis techniques could offer new insights into learning, especially when students have the opportunity to generate unique, personalized artifacts, such as computer programs, robots, and solutions engineering challenges. To date most of the work on learning analytics…

A Study on International Multimodal Transport Networks from Korea to Central Asia: Focus on Secondhand Vehicles

Directory of Open Access Journals (Sweden)

Ying Wang

2016-03-01

Full Text Available Currently, high-income countries use multimodal transportation to export large quantities of secondhand vehicles to low-income countries. Secondhand vehicle export has shown its highest growth in recent years, especially in Korea. The problem of transporting secondhand vehicles from Korea to Central Asia is becoming an important issue, but few researchers are interested in it. The objective of this research is to determine the optimal transport network for exporting secondhand vehicles from Korea to Central Asian countries by combining experts’ opinions and real data from existing transport networks. The fuzzy Delphi method was applied to obtain factors to evaluate alternative multimodal transport networks for moving secondhand vehicles from Korea to Central Asian countries by judgment from experts. The analysis shows that among the five factors (total cost, total time, reliability, security, and transportation capability, total cost is the most considerable factor, followed by reliability, transportation capability, total time, and security. Additionally, in the mainly three multimodal transport networks, the sea+Trans-China Railway route is ranked first, followed by the sea+Trans-Siberian Railway and sea+truck routes.

Multimodality and the Multiliteracies Pedagogy: "Design" and "Recruitment" in South African Children's Musical Games

Science.gov (United States)

Harrop-Allin, Susan

2017-01-01

Drawing on a study of children's musical games in urban South Africa, this article employs two theoretical frames: that of multimodality and the multiliteracies pedagogy. These are applied to a contextual analysis of the forms of musicality that musical games embody and to ways of incorporating children's play into pedagogy. Based on ethnographic…

Multimode-singlemode-multimode optical fiber sensor coated with novolac resin for detecting liquid phase alcohol

Science.gov (United States)

Marfu'ah, Amalia, Niza Rosyda; Hatta, Agus Muhamad; Pratama, Detak Yan

2018-04-01

Alcohol sensor based on multimode-singlemode-multimode (MSM) optical fiber with novolac resin as the external medium is proposed and demonstrated experimentally. Novolac resin swells when it is exposed by the alcohol. This effect causes a change in the polymer density leading to the refractive index's variation. The transmission light of the sensor depends on the refractive index of external medium. Based on the results, alcohol sensor based on MSM optical fiber structure using novolac resin has a higher sensitivity compared to the sensor without using novolac resin in the mixture of alcohol and distilled water. Alcohol sensor based on MSM optical fiber structure using novolac resin in the mixture of alcohol and distilled water with a singlemode fiber length of 5 mm has a sensitivity of 0.028972 dBm per % V/V, and in the mixture of alcohol and sugar solution of 10% w/w has a sensitivity of 0.005005 dBm per % V/V.

High-resolution multimodal clinical multiphoton tomography of skin

Science.gov (United States)

König, Karsten

2011-03-01

This review focuses on multimodal multiphoton tomography based on near infrared femtosecond lasers. Clinical multiphoton tomographs for 3D high-resolution in vivo imaging have been placed into the market several years ago. The second generation of this Prism-Award winning High-Tech skin imaging tool (MPTflex) was introduced in 2010. The same year, the world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph. In particular, non-fluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen has been imaged with submicron resolution in patients suffering from psoriasis. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution wide-field systems such as ultrasound, optoacoustical, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer, optimization of treatment strategies, and cosmetic research including long-term testing of sunscreen nanoparticles as well as anti-aging products.

Modelling multimodal expression of emotion in a virtual agent.

Science.gov (United States)

Pelachaud, Catherine

2009-12-12

Over the past few years we have been developing an expressive embodied conversational agent system. In particular, we have developed a model of multimodal behaviours that includes dynamism and complex facial expressions. The first feature refers to the qualitative execution of behaviours. Our model is based on perceptual studies and encompasses several parameters that modulate multimodal behaviours. The second feature, the model of complex expressions, follows a componential approach where a new expression is obtained by combining facial areas of other expressions. Lately we have been working on adding temporal dynamism to expressions. So far they have been designed statically, typically at their apex. Only full-blown expressions could be modelled. To overcome this limitation, we have defined a representation scheme that describes the temporal evolution of the expression of an emotion. It is no longer represented by a static definition but by a temporally ordered sequence of multimodal signals.

Study on multimodal transport route under low carbon background

Science.gov (United States)

Liu, Lele; Liu, Jie

2018-06-01

Low-carbon environmental protection is the focus of attention around the world, scientists are constantly researching on production of carbon emissions and living carbon emissions. However, there is little literature about multimodal transportation based on carbon emission at home and abroad. Firstly, this paper introduces the theory of multimodal transportation, the multimodal transport models that didn't consider carbon emissions and consider carbon emissions are analyzed. On this basis, a multi-objective programming 0-1 programming model with minimum total transportation cost and minimum total carbon emission is proposed. The idea of weight is applied to Ideal point method for solving problem, multi-objective programming is transformed into a single objective function. The optimal solution of carbon emission to transportation cost under different weights is determined by a single objective function with variable weights. Based on the model and algorithm, an example is given and the results are analyzed.

MODELING PARTICLE SIZE DISTRIBUTION IN HETEROGENEOUS POLYMERIZATION SYSTEMS USING MULTIMODAL LOGNORMAL FUNCTION

Directory of Open Access Journals (Sweden)

J. C. Ferrari

Full Text Available Abstract This work evaluates the usage of the multimodal lognormal function to describe Particle Size Distributions (PSD of emulsion and suspension polymerization processes, including continuous reactions with particle re-nucleation leading to complex multimodal PSDs. A global optimization algorithm, namely Particle Swarm Optimization (PSO, was used for parameter estimation of the proposed model, minimizing the objective function defined by the mean squared errors. Statistical evaluation of the results indicated that the multimodal lognormal function could describe distinctive features of different types of PSDs with accuracy and consistency.

An evaluation framework for multimodal interaction determining quality aspects and modality choice

CERN Document Server

Wechsung, Ina

2014-01-01

This book presents (1) an exhaustive and empirically validated taxonomy of quality aspects of multimodal interaction as well as respective measurement methods, (2) a validated questionnaire specifically tailored to the evaluation of multimodal systems and covering most of the taxonomy‘s quality aspects, (3) insights on how the quality perceptions of multimodal systems relate to the quality perceptions of its individual components, (4) a set of empirically tested factors which influence modality choice, and (5) models regarding the relationship of the perceived quality of a modality and the actual usage of a modality.

Comprehensive metabolic panel

Science.gov (United States)

Metabolic panel - comprehensive; Chem-20; SMA20; Sequential multi-channel analysis with computer-20; SMAC20; Metabolic panel 20 ... Chernecky CC, Berger BJ. Comprehensive metabolic panel (CMP) - blood. In: ... Tests and Diagnostic Procedures . 6th ed. St Louis, MO: ...

Use of the Comprehensive Inversion method for Swarm satellite data analysis

DEFF Research Database (Denmark)

Sabaka, T. J.; Tøffner-Clausen, Lars; Olsen, Nils

2013-01-01

An advanced algorithm, known as the “Comprehensive Inversion” (CI), is presented for the analysis of Swarm measurements to generate a consistent set of Level-2 data products to be delivered by the Swarm “Satellite Constellation Application and Research Facility” (SCARF) to the European Space Agency...

Virtual Chironomia: A Multimodal Study of Verbal and Non-Verbal Communication in a Virtual World

Science.gov (United States)

Verhulsdonck, Gustav

2010-01-01

This mixed methods study examined the various aspects of multimodal use of non-verbal communication in virtual worlds during dyadic negotiations. Quantitative analysis uncovered a treatment effect whereby people with more rhetorical certainty used more neutral non-verbal communication; whereas people that were rhetorically less certain used more…

On the effects of multimodal information integration in multitasking.

Science.gov (United States)

Stock, Ann-Kathrin; Gohil, Krutika; Huster, René J; Beste, Christian

2017-07-07

There have recently been considerable advances in our understanding of the neuronal mechanisms underlying multitasking, but the role of multimodal integration for this faculty has remained rather unclear. We examined this issue by comparing different modality combinations in a multitasking (stop-change) paradigm. In-depth neurophysiological analyses of event-related potentials (ERPs) were conducted to complement the obtained behavioral data. Specifically, we applied signal decomposition using second order blind identification (SOBI) to the multi-subject ERP data and source localization. We found that both general multimodal information integration and modality-specific aspects (potentially related to task difficulty) modulate behavioral performance and associated neurophysiological correlates. Simultaneous multimodal input generally increased early attentional processing of visual stimuli (i.e. P1 and N1 amplitudes) as well as measures of cognitive effort and conflict (i.e. central P3 amplitudes). Yet, tactile-visual input caused larger impairments in multitasking than audio-visual input. General aspects of multimodal information integration modulated the activity in the premotor cortex (BA 6) as well as different visual association areas concerned with the integration of visual information with input from other modalities (BA 19, BA 21, BA 37). On top of this, differences in the specific combination of modalities also affected performance and measures of conflict/effort originating in prefrontal regions (BA 6).

Multimodal nonlinear microscopy: A powerful label-free method for supporting standard diagnostics on biological tissues

Directory of Open Access Journals (Sweden)

Riccardo Cicchi

2014-09-01

Full Text Available The large use of nonlinear laser scanning microscopy in the past decade paved the way for potential clinical application of this imaging technique. Modern nonlinear microscopy techniques offer promising label-free solutions to improve diagnostic performances on tissues. In particular, the combination of multiple nonlinear imaging techniques in the same microscope allows integrating morphological with functional information in a morpho-functional scheme. Such approach provides a high-resolution label-free alternative to both histological and immunohistochemical examination of tissues and is becoming increasingly popular among the clinical community. Nevertheless, several technical improvements, including automatic scanning and image analysis, are required before the technique represents a standard diagnostic method. In this review paper, we highlight the capabilities of multimodal nonlinear microscopy for tissue imaging, by providing various examples on colon, arterial and skin tissues. The comparison between images acquired using multimodal nonlinear microscopy and histology shows a good agreement between the two methods. The results demonstrate that multimodal nonlinear microscopy is a powerful label-free alternative to standard histopathological methods and has the potential to find a stable place in the clinical setting in the near future.

Evaluation of selectivity in homologous multimodal chromatographic systems using in silico designed antibody fragment libraries.

Science.gov (United States)

Karkov, Hanne Sophie; Woo, James; Krogh, Berit Olsen; Ahmadian, Haleh; Cramer, Steven M

2015-12-24

This study describes the in silico design, surface property analyses, production and chromatographic evaluations of a diverse set of antibody Fab fragment variants. Based on previous findings, we hypothesized that the complementarity-determining regions (CDRs) constitute important binding sites for multimodal chromatographic ligands. Given that antibodies are highly diversified molecules and in particular the CDRs, we set out to examine the generality of this result. For this purpose, four different Fab fragments with different CDRs and/or framework regions of the variable domains were identified and related variants were designed in silico. The four Fab variant libraries were subsequently generated by site-directed mutagenesis and produced by recombinant expression and affinity purification to enable examination of their chromatographic retention behavior. The effects of geometric re-arrangement of the functional moieties on the multimodal resin ligands were also investigated with respect to Fab variant retention profiles by comparing two commercially available multimodal cation-exchange ligands, Capto MMC and Nuvia cPrime, and two novel multimodal ligand prototypes. Interestingly, the chromatographic data demonstrated distinct selectivity trends between the four Fab variant libraries. For three of the Fab libraries, the CDR regions appeared as major binding sites for all multimodal ligands. In contrast, the fourth Fab library displayed a distinctly different chromatographic behavior, where Nuvia cPrime and related multimodal ligand prototypes provided markedly improved selectivity over Capto MMC. Clearly, the results illustrate that the discriminating power of multimodal ligands differs between different Fab fragments. The results are promising indications that multimodal chromatography using the appropriate multimodal ligands can be employed in downstream bioprocessing for challenging selective separation of product related variants. Copyright © 2015 Elsevier B

A Single Session of rTMS Enhances Small-Worldness in Writer’s Cramp: Evidence from Simultaneous EEG-fMRI Multi-Modal Brain Graph

Directory of Open Access Journals (Sweden)

Rose D. Bharath

2017-09-01

Full Text Available Background and Purpose: Repetitive transcranial magnetic stimulation (rTMS induces widespread changes in brain connectivity. As the network topology differences induced by a single session of rTMS are less known we undertook this study to ascertain whether the network alterations had a small-world morphology using multi-modal graph theory analysis of simultaneous EEG-fMRI.Method: Simultaneous EEG-fMRI was acquired in duplicate before (R1 and after (R2 a single session of rTMS in 14 patients with Writer’s Cramp (WC. Whole brain neuronal and hemodynamic network connectivity were explored using the graph theory measures and clustering coefficient, path length and small-world index were calculated for EEG and resting state fMRI (rsfMRI. Multi-modal graph theory analysis was used to evaluate the correlation of EEG and fMRI clustering coefficients.Result: A single session of rTMS was found to increase the clustering coefficient and small-worldness significantly in both EEG and fMRI (p < 0.05. Multi-modal graph theory analysis revealed significant modulations in the fronto-parietal regions immediately after rTMS. The rsfMRI revealed additional modulations in several deep brain regions including cerebellum, insula and medial frontal lobe.Conclusion: Multi-modal graph theory analysis of simultaneous EEG-fMRI can supplement motor physiology methods in understanding the neurobiology of rTMS in vivo. Coinciding evidence from EEG and rsfMRI reports small-world morphology for the acute phase network hyper-connectivity indicating changes ensuing low-frequency rTMS is probably not “noise”.

Identification Of Protein Vaccine Candidates Using Comprehensive Proteomic Analysis Strategies

Science.gov (United States)

2007-12-01

that fascinating fungus known as Coccidioides. I also want to thank the UA Mass Spectrometry Facility and the UA Proteomics Consortium, especially...W. & N. N. Kav. 2006. The proteome of the phytopathogenic fungus Sclerotinia sclerotiorum. Proteomics 6: 5995-6007. 127. de Godoy, L. M., J. V...IDENTIFICATION OF PROTEIN VACCINE CANDIDATES USING COMPREHENSIVE PROTEOMIC ANALYSIS STRATEGIES by James G. Rohrbough

Multimodal approaches to use mobile, digital devices in learning practies

DEFF Research Database (Denmark)

Buhl, Mie

, anthropology, psychology and sociology) and outlines the prospect of a trans-disciplinary learning mode. The learning mode reflects the current society where knowledge production is social collaborative process and is produced in formal as well as informal and non-formal contexts. My discussion’s theoretical......In this paper, I discuss the potential of multimodal approaches to enhance learning processes. I draw on a case based on Danish Master Courses in ICT and didactic designs where multimodal approaches are in the center of students’ practical design experience as well as in generation of theoretical...... knowledge. The design of the master courses takes its starting point in the assumption that theoretical knowledge generates from practical experiences. Thus, the organization of the students’ learning processes revolves around practical multimodal experiences followed by iterative reflexive sessions...

Multi-Modal Intelligent Traffic Signal Systems GPS

Data.gov (United States)

Department of Transportation — Data were collected during the Multi-Modal Intelligent Transportation Signal Systems (MMITSS) study. MMITSS is a next-generation traffic signal system that seeks to...

Automated diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks

Science.gov (United States)

Le, Minh Hung; Chen, Jingyu; Wang, Liang; Wang, Zhiwei; Liu, Wenyu; (Tim Cheng, Kwang-Ting; Yang, Xin

2017-08-01

Automated methods for prostate cancer (PCa) diagnosis in multi-parametric magnetic resonance imaging (MP-MRIs) are critical for alleviating requirements for interpretation of radiographs while helping to improve diagnostic accuracy (Artan et al 2010 IEEE Trans. Image Process. 19 2444-55, Litjens et al 2014 IEEE Trans. Med. Imaging 33 1083-92, Liu et al 2013 SPIE Medical Imaging (International Society for Optics and Photonics) p 86701G, Moradi et al 2012 J. Magn. Reson. Imaging 35 1403-13, Niaf et al 2014 IEEE Trans. Image Process. 23 979-91, Niaf et al 2012 Phys. Med. Biol. 57 3833, Peng et al 2013a SPIE Medical Imaging (International Society for Optics and Photonics) p 86701H, Peng et al 2013b Radiology 267 787-96, Wang et al 2014 BioMed. Res. Int. 2014). This paper presents an automated method based on multimodal convolutional neural networks (CNNs) for two PCa diagnostic tasks: (1) distinguishing between cancerous and noncancerous tissues and (2) distinguishing between clinically significant (CS) and indolent PCa. Specifically, our multimodal CNNs effectively fuse apparent diffusion coefficients (ADCs) and T2-weighted MP-MRI images (T2WIs). To effectively fuse ADCs and T2WIs we design a new similarity loss function to enforce consistent features being extracted from both ADCs and T2WIs. The similarity loss is combined with the conventional classification loss functions and integrated into the back-propagation procedure of CNN training. The similarity loss enables better fusion results than existing methods as the feature learning processes of both modalities are mutually guided, jointly facilitating CNN to ‘see’ the true visual patterns of PCa. The classification results of multimodal CNNs are further combined with the results based on handcrafted features using a support vector machine classifier. To achieve a satisfactory accuracy for clinical use, we comprehensively investigate three critical factors which could greatly affect the performance of our

Quantitative analysis of target components by comprehensive two-dimensional gas chromatography

NARCIS (Netherlands)

Mispelaar, V.G. van; Tas, A.C.; Smilde, A.K.; Schoenmakers, P.J.; Asten, A.C. van

2003-01-01

Quantitative analysis using comprehensive two-dimensional (2D) gas chromatography (GC) is still rarely reported. This is largely due to a lack of suitable software. The objective of the present study is to generate quantitative results from a large GC x GC data set, consisting of 32 chromatograms.

All-optical universal logic gates on nonlinear multimode interference coupler using tunable input intensity

Science.gov (United States)

Tajaldini, Mehdi; Jafri, Mohd Zubir Mat

2015-04-01

The theory of Nonlinear Modal Propagation Analysis Method (NMPA) have shown significant features of nonlinear multimode interference (MMI) coupler with compact dimension and when launched near the threshold of nonlinearity. Moreover, NMPA have the potential to allow studying the nonlinear MMI based the modal interference to explorer the phenomenon that what happen due to the natural of multimode region. Proposal of all-optical switch based NMPA has approved its capability to achieving the all-optical gates. All-optical gates have attracted increasing attention due to their practical utility in all-optical signal processing networks and systems. Nonlinear multimode interference devices could apply as universal all-optical gates due to significant features that NMPA introduce them. In this Paper, we present a novel Ultra-compact MMI coupler based on NMPA method in low intensity compared to last reports either as a novel design method and potential application for optical NAND, NOR as universal gates on single structure for Boolean logic signal processing devices and optimize their application via studding the contrast ratio between ON and OFF as a function of output width. We have applied NMPA for several applications so that the miniaturization in low nonlinear intensities is their main purpose.

Investigation of Biophysical Mechanisms in Gold Nanoparticle Mediated Laser Manipulation of Cells Using a Multimodal Holographic and Fluorescence Imaging Setup

Science.gov (United States)

Rakoski, Mirko S.; Heinemann, Dag; Schomaker, Markus; Ripken, Tammo; Meyer, Heiko

2015-01-01

Laser based cell manipulation has proven to be a versatile tool in biomedical applications. In this context, combining weakly focused laser pulses and nanostructures, e.g. gold nanoparticles, promises to be useful for high throughput cell manipulation, such as transfection and photothermal therapy. Interactions between laser pulses and gold nanoparticles are well understood. However, it is still necessary to study cell behavior in gold nanoparticle mediated laser manipulation. While parameters like cell viability or perforation efficiency are commonly addressed, the influence of the manipulation process on other essential cell parameters is not sufficiently investigated yet. Thus, we set out to study four relevant cell properties: cell volume and area, ion exchange and cytoskeleton structure after gold nanoparticle based laser manipulation. For this, we designed a multimodal imaging and manipulation setup. 200 nm gold nanoparticles were attached unspecifically to canine cells and irradiated by weakly focused 850 ps laser pulses. Volume and area change in the first minute post laser manipulation was monitored using digital holography. Calcium imaging and cells expressing a marker for filamentous actin (F-actin) served to analyze the ion exchange and the cytoskeleton, respectively. High radiant exposures led to cells exhibiting a tendency to shrink in volume and area, possibly due to outflow of cytoplasm. An intracellular raise in calcium was observed and accompanied by an intercellular calcium wave. This multimodal approach enabled for the first time a comprehensive analysis of the cell behavior in gold nanoparticle mediated cell manipulation. Additionally, this work can pave the way for a better understanding and the evaluation of new applications in the context of cell transfection or photothermal therapy. PMID:25909631

Investigation of biophysical mechanisms in gold nanoparticle mediated laser manipulation of cells using a multimodal holographic and fluorescence imaging setup.

Directory of Open Access Journals (Sweden)

Stefan Kalies

Full Text Available Laser based cell manipulation has proven to be a versatile tool in biomedical applications. In this context, combining weakly focused laser pulses and nanostructures, e.g. gold nanoparticles, promises to be useful for high throughput cell manipulation, such as transfection and photothermal therapy. Interactions between laser pulses and gold nanoparticles are well understood. However, it is still necessary to study cell behavior in gold nanoparticle mediated laser manipulation. While parameters like cell viability or perforation efficiency are commonly addressed, the influence of the manipulation process on other essential cell parameters is not sufficiently investigated yet. Thus, we set out to study four relevant cell properties: cell volume and area, ion exchange and cytoskeleton structure after gold nanoparticle based laser manipulation. For this, we designed a multimodal imaging and manipulation setup. 200 nm gold nanoparticles were attached unspecifically to canine cells and irradiated by weakly focused 850 ps laser pulses. Volume and area change in the first minute post laser manipulation was monitored using digital holography. Calcium imaging and cells expressing a marker for filamentous actin (F-actin served to analyze the ion exchange and the cytoskeleton, respectively. High radiant exposures led to cells exhibiting a tendency to shrink in volume and area, possibly due to outflow of cytoplasm. An intracellular raise in calcium was observed and accompanied by an intercellular calcium wave. This multimodal approach enabled for the first time a comprehensive analysis of the cell behavior in gold nanoparticle mediated cell manipulation. Additionally, this work can pave the way for a better understanding and the evaluation of new applications in the context of cell transfection or photothermal therapy.

Approaching Athenian Graffiti as a Multimodal Genre with GIS Application

OpenAIRE

Stampoulidis, Georgios

2017-01-01

Graffiti as an ever-changing form of urban art and visual communication is naturally multimodal, focusing on text–image relations (Bateman 2014; Forceville 2008; Kress 2006), which owe their existence mainly to the sociocultural and historical knowledge of the represented world of our experience – Husserlian Lebenswelt [Lifeworld] (Sonesson 2008; 2015). These relations constitute an interesting challenge to multimodal interpretations, because both verbal and/or pictorial representations can i...

Polyomavirus-Negative Merkel Cell Carcinoma: A More Aggressive Subtype Based on Analysis of 282 Cases Using Multimodal Tumor Virus Detection.

Science.gov (United States)

Moshiri, Ata S; Doumani, Ryan; Yelistratova, Lola; Blom, Astrid; Lachance, Kristina; Shinohara, Michi M; Delaney, Martha; Chang, Oliver; McArdle, Susan; Thomas, Hannah; Asgari, Maryam M; Huang, Meei-Li; Schwartz, Stephen M; Nghiem, Paul

2017-04-01

Previous studies have reached conflicting conclusions regarding the proportion of Merkel cell carcinomas (MCCs) that contain the Merkel cell polyomavirus (MCPyV) and the clinical significance of tumor viral status. To address these controversies, we detected MCPyV large T antigen using immunohistochemistry with two distinct antibodies and MCPyV DNA using quantitative PCR. Tumors were called MCPyV-positive if two or more of these three assays indicated presence of this virus. A total of 53 of 282 (19%) MCC tumors in this cohort were virus-negative using this multimodal system. Immunohistochemistry with the CM2B4 antibody had the best overall performance (sensitivity = 0.882, specificity = 0.943) compared with the multimodal classification. Multivariate analysis including age, sex, and immunosuppression showed that, relative to MCC patients with virus-positive tumors, virus-negative MCC patients had significantly increased risk of disease progression (hazard ratio = 1.77, 95% confidence interval = 1.20-2.62) and death from MCC (hazard ratio = 1.85, 95% confidence interval = 1.19-2.89). We confirm that approximately 20% of MCCs are not driven by MCPyV and that such virus-negative MCCs, which can be quite reliably identified by immunohistochemistry using the CM2B4 antibody alone, represent a more aggressive subtype that warrants closer clinical follow-up. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Evaluation and Socio-occupational Intervention in Bipolar and Schizophrenic Patients within a Multimodal Intervention Program- PRISMA.

Science.gov (United States)

Díaz Zuluaga, Ana M; Duica, Kelly; Ruiz Galeano, Carlos; Vargas, Cristian; Agudelo Berruecos, Yuli; Ospina, Sigifredo; López-Jaramillo, Carlos

Functional improvement in bipolar and schizophrenic patients is one of the main aims of treatment. Nevertheless, there is no evidence about the effect of socio-occupational intervention within a multimodal intervention (MI) programme. To describe the socio-occupational profile and to evaluate the functional effect of a MI in bipolar I and schizophrenic patients. A prospective, longitudinal, therapeutic-comparative study was performed including 302 subjects (104 schizophrenic and 198 Bipolar Disorder I [BDI] patients), who were randomised into two groups, multimodal (psychiatry, psychology, medicine, occupational therapy, neuropsychology, and family therapy), or traditional intervention (psychiatry and medicine only). Several scales were applied to assess assertiveness, free time management, social abilities, general anxiety, self-care and performance in home, work and community tasks. After performing the longitudinal analysis, it was shown that the multimodal intervention was more effective than traditional intervention in general anxiety scores (P=.026) and development in home tasks (P=.03) in schizophrenic patients. No statistical differences were found in bipolar patients. The other variables showed improvement, however, their effect was similar in both intervention groups. Our study identified functional improvement in home tasks in schizophrenic patients after receiving multimodal intervention. Other variables also showed improvement for both interventions groups. Future studies, applying longer rehabilitation programs and other ecological strategies should be performed to identify the most effective interventions. Copyright © 2017 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

Multimodal human-machine interaction for service robots in home-care environments

OpenAIRE

Goetze, Stefan; Fischer, S.; Moritz, Niko; Appell, Jens-E.; Wallhoff, Frank

2012-01-01

This contribution focuses on multimodal interaction techniques for a mobile communication and assistance system on a robot platform. The system comprises of acoustic, visual and haptic input modalities. Feedback is given to the user by a graphical user interface and a speech synthesis system. By this, multimodal and natural communication with the robot system is possible.

Drusen Characterization with Multimodal Imaging

Science.gov (United States)

Spaide, Richard F.; Curcio, Christine A.

2010-01-01

Summary Multimodal imaging findings and histological demonstration of soft drusen, cuticular drusen, and subretinal drusenoid deposits provided information used to develop a model explaining their imaging characteristics. Purpose To characterize the known appearance of cuticular drusen, subretinal drusenoid deposits (reticular pseudodrusen), and soft drusen as revealed by multimodal fundus imaging; to create an explanatory model that accounts for these observations. Methods Reported color, fluorescein angiographic, autofluorescence, and spectral domain optical coherence tomography (SD-OCT) images of patients with cuticular drusen, soft drusen, and subretinal drusenoid deposits were reviewed, as were actual images from affected eyes. Representative histological sections were examined. The geometry, location, and imaging characteristics of these lesions were evaluated. A hypothesis based on the Beer-Lambert Law of light absorption was generated to fit these observations. Results Cuticular drusen appear as numerous uniform round yellow-white punctate accumulations under the retinal pigment epithelium (RPE). Soft drusen are larger yellow-white dome-shaped mounds of deposit under the RPE. Subretinal drusenoid deposits are polymorphous light-grey interconnected accumulations above the RPE. Based on the model, both cuticular and soft drusen appear yellow due to the removal of shorter wavelength light by a double pass through the RPE. Subretinal drusenoid deposits, which are located on the RPE, are not subjected to short wavelength attenuation and therefore are more prominent when viewed with blue light. The location and morphology of extracellular material in relationship to the RPE, and associated changes to RPE morphology and pigmentation, appeared to be primary determinants of druse appearance in different imaging modalities. Conclusion Although cuticular drusen, subretinal drusenoid deposits, and soft drusen are composed of common components, they are distinguishable

Preferential loss of dorsal-hippocampus synapses underlies memory impairments provoked by short, multimodal stress.

Science.gov (United States)

Maras, P M; Molet, J; Chen, Y; Rice, C; Ji, S G; Solodkin, A; Baram, T Z

2014-07-01

The cognitive effects of stress are profound, yet it is unknown if the consequences of concurrent multiple stresses on learning and memory differ from those of a single stress of equal intensity and duration. We compared the effects on hippocampus-dependent memory of concurrent, hours-long light, loud noise, jostling and restraint (multimodal stress) with those of restraint or of loud noise alone. We then examined if differences in memory impairment following these two stress types might derive from their differential impact on hippocampal synapses, distinguishing dorsal and ventral hippocampus. Mice exposed to hours-long restraint or loud noise were modestly or minimally impaired in novel object recognition, whereas similar-duration multimodal stress provoked severe deficits. Differences in memory were not explained by differences in plasma corticosterone levels or numbers of Fos-labeled neurons in stress-sensitive hypothalamic neurons. However, although synapses in hippocampal CA3 were impacted by both restraint and multimodal stress, multimodal stress alone reduced synapse numbers severely in dorsal CA1, a region crucial for hippocampus-dependent memory. Ventral CA1 synapses were not significantly affected by either stress modality. Probing the basis of the preferential loss of dorsal synapses after multimodal stress, we found differential patterns of neuronal activation by the two stress types. Cross-correlation matrices, reflecting functional connectivity among activated regions, demonstrated that multimodal stress reduced hippocampal correlations with septum and thalamus and increased correlations with amygdala and BST. Thus, despite similar effects on plasma corticosterone and on hypothalamic stress-sensitive cells, multimodal and restraint stress differ in their activation of brain networks and in their impact on hippocampal synapses. Both of these processes might contribute to amplified memory impairments following short, multimodal stress.

Preferential loss of dorsal-hippocampus synapses underlies memory impairments provoked by short, multimodal stress

Science.gov (United States)

Maras, P M; Molet, J; Chen, Y; Rice, C; Ji, S G; Solodkin, A; Baram, T Z

2014-01-01

The cognitive effects of stress are profound, yet it is unknown if the consequences of concurrent multiple stresses on learning and memory differ from those of a single stress of equal intensity and duration. We compared the effects on hippocampus-dependent memory of concurrent, hours-long light, loud noise, jostling and restraint (multimodal stress) with those of restraint or of loud noise alone. We then examined if differences in memory impairment following these two stress types might derive from their differential impact on hippocampal synapses, distinguishing dorsal and ventral hippocampus. Mice exposed to hours-long restraint or loud noise were modestly or minimally impaired in novel object recognition, whereas similar-duration multimodal stress provoked severe deficits. Differences in memory were not explained by differences in plasma corticosterone levels or numbers of Fos-labeled neurons in stress-sensitive hypothalamic neurons. However, although synapses in hippocampal CA3 were impacted by both restraint and multimodal stress, multimodal stress alone reduced synapse numbers severely in dorsal CA1, a region crucial for hippocampus-dependent memory. Ventral CA1 synapses were not significantly affected by either stress modality. Probing the basis of the preferential loss of dorsal synapses after multimodal stress, we found differential patterns of neuronal activation by the two stress types. Cross-correlation matrices, reflecting functional connectivity among activated regions, demonstrated that multimodal stress reduced hippocampal correlations with septum and thalamus and increased correlations with amygdala and BST. Thus, despite similar effects on plasma corticosterone and on hypothalamic stress-sensitive cells, multimodal and restraint stress differ in their activation of brain networks and in their impact on hippocampal synapses. Both of these processes might contribute to amplified memory impairments following short, multimodal stress. PMID:24589888

EEG Classification for Hybrid Brain-Computer Interface Using a Tensor Based Multiclass Multimodal Analysis Scheme.

Science.gov (United States)

Ji, Hongfei; Li, Jie; Lu, Rongrong; Gu, Rong; Cao, Lei; Gong, Xiaoliang

2016-01-01

Electroencephalogram- (EEG-) based brain-computer interface (BCI) systems usually utilize one type of changes in the dynamics of brain oscillations for control, such as event-related desynchronization/synchronization (ERD/ERS), steady state visual evoked potential (SSVEP), and P300 evoked potentials. There is a recent trend to detect more than one of these signals in one system to create a hybrid BCI. However, in this case, EEG data were always divided into groups and analyzed by the separate processing procedures. As a result, the interactive effects were ignored when different types of BCI tasks were executed simultaneously. In this work, we propose an improved tensor based multiclass multimodal scheme especially for hybrid BCI, in which EEG signals are denoted as multiway tensors, a nonredundant rank-one tensor decomposition model is proposed to obtain nonredundant tensor components, a weighted fisher criterion is designed to select multimodal discriminative patterns without ignoring the interactive effects, and support vector machine (SVM) is extended to multiclass classification. Experiment results suggest that the proposed scheme can not only identify the different changes in the dynamics of brain oscillations induced by different types of tasks but also capture the interactive effects of simultaneous tasks properly. Therefore, it has great potential use for hybrid BCI.

Pixel-based analysis of comprehensive two-dimensional gas chromatograms (color plots) of petroleum

DEFF Research Database (Denmark)

Furbo, Søren; Hansen, Asger B.; Skov, Thomas

2014-01-01

We demonstrate how to process comprehensive two-dimensional gas chromatograms (GC × GC chromatograms) to remove nonsample information (artifacts), including background and retention time shifts. We also demonstrate how this, combined with further reduction of the influence of irrelevant informati......, allows for data analysis without integration or peak deconvolution (pixelbased analysis)....

Alternative modalities – A Review of Graphic Encounters: Comics and the Sponsorship of Multimodal Literacy

Directory of Open Access Journals (Sweden)

Aaron Scott Humphrey

2014-05-01

Full Text Available Research exploring the multimodal characteristics of comics has recently flourished, and Dale Jacobs has been one of the early prolific authors on this topic. Jacobs expands these ideas further in 'Graphic Encounters: Comics and the Sponsorship of Multimodal Literacy', a monograph which engages with theories of multimodality, but shifts its focus primarily to literacy sponsorship.

Multimodality image registration with software: state-of-the-art

International Nuclear Information System (INIS)

Slomka, Piotr J.; Baum, Richard P.

2009-01-01

Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

[Semantic Network Analysis of Online News and Social Media Text Related to Comprehensive Nursing Care Service].

Science.gov (United States)

Kim, Minji; Choi, Mona; Youm, Yoosik

2017-12-01

As comprehensive nursing care service has gradually expanded, it has become necessary to explore the various opinions about it. The purpose of this study is to explore the large amount of text data regarding comprehensive nursing care service extracted from online news and social media by applying a semantic network analysis. The web pages of the Korean Nurses Association (KNA) News, major daily newspapers, and Twitter were crawled by searching the keyword 'comprehensive nursing care service' using Python. A morphological analysis was performed using KoNLPy. Nodes on a 'comprehensive nursing care service' cluster were selected, and frequency, edge weight, and degree centrality were calculated and visualized with Gephi for the semantic network. A total of 536 news pages and 464 tweets were analyzed. In the KNA News and major daily newspapers, 'nursing workforce' and 'nursing service' were highly rated in frequency, edge weight, and degree centrality. On Twitter, the most frequent nodes were 'National Health Insurance Service' and 'comprehensive nursing care service hospital.' The nodes with the highest edge weight were 'national health insurance,' 'wards without caregiver presence,' and 'caregiving costs.' 'National Health Insurance Service' was highest in degree centrality. This study provides an example of how to use atypical big data for a nursing issue through semantic network analysis to explore diverse perspectives surrounding the nursing community through various media sources. Applying semantic network analysis to online big data to gather information regarding various nursing issues would help to explore opinions for formulating and implementing nursing policies. © 2017 Korean Society of Nursing Science

Introducing People – Genre Analysis and Oral Comprehension and Oral Production Tasks

Directory of Open Access Journals (Sweden)

Keila Rocha Reis de Carvalho

2012-02-01

Full Text Available This paper aims at presenting an analysis of the genre introducing people and at suggesting listening comprehension and oral production tasks. This work was developed according to the characterization of the rhetorical organization of situations taken from seventeen films that contain the genre under analysis. Although several studies in the ESP area carried out recently (Andrade, 2003; Cardoso, 2003; Shergue, 2003; Belmonte, 2003; Serafini, 2003 have identified listening comprehension and oral production as the abilities that should be prioritized in an English course, much needs to be done, especially concerning the oral genres that take into account the language the learners of English as a second language need in their target situation. This work is based on Hutchinson & Waters (1987 theoretical background on ESP, Swales’ (1990 genre analysis, Ramos’ (2004 pedagogical proposal, and also on Ellis´ (2003 tasks concept. The familiarization of learners of English as a second language with this genre will provide them with the opportunity to better understand and use the English language in their academic and professional life.

Experimental Study on Bioluminescence Tomography with Multimodality Fusion

Directory of Open Access Journals (Sweden)

Yujie Lv

2007-01-01

Full Text Available To verify the influence of a priori information on the nonuniqueness problem of bioluminescence tomography (BLT, the multimodality imaging fusion based BLT experiment is performed by multiview noncontact detection mode, which incorporates the anatomical information obtained by the microCT scanner and the background optical properties based on diffuse reflectance measurements. In the reconstruction procedure, the utilization of adaptive finite element methods (FEMs and a priori permissible source region refines the reconstructed results and improves numerical robustness and efficiency. The comparison between the absence and employment of a priori information shows that multimodality imaging fusion is essential to quantitative BLT reconstruction.

Multimodal medical information retrieval with unsupervised rank fusion.

Science.gov (United States)

Mourão, André; Martins, Flávio; Magalhães, João

2015-01-01

Modern medical information retrieval systems are paramount to manage the insurmountable quantities of clinical data. These systems empower health care experts in the diagnosis of patients and play an important role in the clinical decision process. However, the ever-growing heterogeneous information generated in medical environments poses several challenges for retrieval systems. We propose a medical information retrieval system with support for multimodal medical case-based retrieval. The system supports medical information discovery by providing multimodal search, through a novel data fusion algorithm, and term suggestions from a medical thesaurus. Our search system compared favorably to other systems in 2013 ImageCLEFMedical. Copyright © 2014 Elsevier Ltd. All rights reserved.

Current and future multimodal learning analytics data challenges

DEFF Research Database (Denmark)

Spikol, Daniel; Prieto, Luis P.; Rodriguez-Triana, M.J.

2017-01-01

Multimodal Learning Analytics (MMLA) captures, integrates and analyzes learning traces from different sources in order to obtain a more holistic understanding of the learning process, wherever it happens. MMLA leverages the increasingly widespread availability of diverse sensors, high......-frequency data collection technologies and sophisticated machine learning and artificial intelligence techniques. The aim of this workshop is twofold: first, to expose participants to, and develop, different multimodal datasets that reflect how MMLA can bring new insights and opportunities to investigate complex...... learning processes and environments; second, to collaboratively identify a set of grand challenges for further MMLA research, built upon the foundations of previous workshops on the topic....

Effects of Multimodal Presentation and Stimulus Familiarity on Auditory and Visual Processing

Science.gov (United States)

Robinson, Christopher W.; Sloutsky, Vladimir M.

2010-01-01

Two experiments examined the effects of multimodal presentation and stimulus familiarity on auditory and visual processing. In Experiment 1, 10-month-olds were habituated to either an auditory stimulus, a visual stimulus, or an auditory-visual multimodal stimulus. Processing time was assessed during the habituation phase, and discrimination of…

Multimodal Teacher Input and Science Learning in a Middle School Sheltered Classroom

Science.gov (United States)

Zhang, Ying

2016-01-01

This article reports the results of an ethnographic research about the multimodal science discourse in a sixth-grade sheltered classroom involving English Language Learners (ELLs) only. Drawing from the perspective of multimodality, this study examines how science learning is constructed in science lectures through multiple semiotic resources,…

Interaction between visual and chemical cues in a Liolaemus lizard: a multimodal approach.

Science.gov (United States)

Vicente, Natalin S; Halloy, Monique

2017-12-01

Multimodal communication involves the use of signals and cues across two or more sensory modalities. The genus Liolaemus (Iguania: Liolaemidae) offers a great potential for studies on the ecology and evolution of multimodal communication, including visual and chemical signals. In this study, we analyzed the response of male and female Liolaemus pacha to chemical, visual and combined (multimodal) stimuli. Using cue-isolation tests, we registered the number of tongue flicks and headbob displays from exposure to signals in each modality. Number of tongue flicks was greater when a chemical stimulus was presented alone than in the presence of visual or multimodal stimuli. In contrast, headbob displays were fewer in number with visual and chemical stimuli alone, but significantly higher in number when combined. Female signallers triggered significantly more tongue flicks than male signallers, suggesting that chemical cues are involved in sexual recognition. We did not find an inhibition between chemical and visual cues. On the contrary, we observed a dominance of the chemical modality, because when presented with visual stimuli, lizards also responded with more tongue flicks than headbob displays. The total response produced by multimodal stimuli was similar to that of the chemical stimuli alone, possibly suggesting non-redundancy. We discuss whether the visual component of a multimodal signal could attract attention at a distance, increasing the effectiveness of transmission and reception of the information in chemical cues. Copyright © 2017 Elsevier GmbH. All rights reserved.

Multimodal representations in collaborative history learning

NARCIS (Netherlands)

Prangsma, M.E.

2007-01-01

This dissertation focuses on the question: How does making and connecting different types of multimodal representations affect the collaborative learning process and the acquisition of a chronological frame of reference in 12 to 14-year olds in pre vocational education? A chronological frame of

Comprehensive NMR analysis of compositional changes of black garlic during thermal processing.

Science.gov (United States)

Liang, Tingfu; Wei, Feifei; Lu, Yi; Kodani, Yoshinori; Nakada, Mitsuhiko; Miyakawa, Takuya; Tanokura, Masaru

2015-01-21

Black garlic is a processed food product obtained by subjecting whole raw garlic to thermal processing that causes chemical reactions, such as the Maillard reaction, which change the composition of the garlic. In this paper, we report a nuclear magnetic resonance (NMR)-based comprehensive analysis of raw garlic and black garlic extracts to determine the compositional changes resulting from thermal processing. (1)H NMR spectra with a detailed signal assignment showed that 38 components were altered by thermal processing of raw garlic. For example, the contents of 11 l-amino acids increased during the first step of thermal processing over 5 days and then decreased. Multivariate data analysis revealed changes in the contents of fructose, glucose, acetic acid, formic acid, pyroglutamic acid, cycloalliin, and 5-(hydroxymethyl)furfural (5-HMF). Our results provide comprehensive information on changes in NMR-detectable components during thermal processing of whole garlic.

Computer-based image analysis in radiological diagnostics and image-guided therapy: 3D-Reconstruction, contrast medium dynamics, surface analysis, radiation therapy and multi-modal image fusion

International Nuclear Information System (INIS)

Beier, J.

2001-01-01

This book deals with substantial subjects of postprocessing and analysis of radiological image data, a particular emphasis was put on pulmonary themes. For a multitude of purposes the developed methods and procedures can directly be transferred to other non-pulmonary applications. The work presented here is structured in 14 chapters, each describing a selected complex of research. The chapter order reflects the sequence of the processing steps starting from artefact reduction, segmentation, visualization, analysis, therapy planning and image fusion up to multimedia archiving. In particular, this includes virtual endoscopy with three different scene viewers (Chap. 6), visualizations of the lung disease bronchiectasis (Chap. 7), surface structure analysis of pulmonary tumors (Chap. 8), quantification of contrast medium dynamics from temporal 2D and 3D image sequences (Chap. 9) as well as multimodality image fusion of arbitrary tomographical data using several visualization techniques (Chap. 12). Thus, the software systems presented cover the majority of image processing applications necessary in radiology and were entirely developed, implemented and validated in the clinical routine of a university medical school. (orig.) [de

Fast multi-core based multimodal registration of 2D cross-sections and 3D datasets.

Science.gov (United States)

Scharfe, Michael; Pielot, Rainer; Schreiber, Falk

2010-01-11

Solving bioinformatics tasks often requires extensive computational power. Recent trends in processor architecture combine multiple cores into a single chip to improve overall performance. The Cell Broadband Engine (CBE), a heterogeneous multi-core processor, provides power-efficient and cost-effective high-performance computing. One application area is image analysis and visualisation, in particular registration of 2D cross-sections into 3D image datasets. Such techniques can be used to put different image modalities into spatial correspondence, for example, 2D images of histological cuts into morphological 3D frameworks. We evaluate the CBE-driven PlayStation 3 as a high performance, cost-effective computing platform by adapting a multimodal alignment procedure to several characteristic hardware properties. The optimisations are based on partitioning, vectorisation, branch reducing and loop unrolling techniques with special attention to 32-bit multiplies and limited local storage on the computing units. We show how a typical image analysis and visualisation problem, the multimodal registration of 2D cross-sections and 3D datasets, benefits from the multi-core based implementation of the alignment algorithm. We discuss several CBE-based optimisation methods and compare our results to standard solutions. More information and the source code are available from http://cbe.ipk-gatersleben.de. The results demonstrate that the CBE processor in a PlayStation 3 accelerates computational intensive multimodal registration, which is of great importance in biological/medical image processing. The PlayStation 3 as a low cost CBE-based platform offers an efficient option to conventional hardware to solve computational problems in image processing and bioinformatics.

Integration of Multi-Modal Biomedical Data to Predict Cancer Grade and Patient Survival.

Science.gov (United States)

Phan, John H; Hoffman, Ryan; Kothari, Sonal; Wu, Po-Yen; Wang, May D

2016-02-01

The Big Data era in Biomedical research has resulted in large-cohort data repositories such as The Cancer Genome Atlas (TCGA). These repositories routinely contain hundreds of matched patient samples for genomic, proteomic, imaging, and clinical data modalities, enabling holistic and multi-modal integrative analysis of human disease. Using TCGA renal and ovarian cancer data, we conducted a novel investigation of multi-modal data integration by combining histopathological image and RNA-seq data. We compared the performances of two integrative prediction methods: majority vote and stacked generalization. Results indicate that integration of multiple data modalities improves prediction of cancer grade and outcome. Specifically, stacked generalization, a method that integrates multiple data modalities to produce a single prediction result, outperforms both single-data-modality prediction and majority vote. Moreover, stacked generalization reveals the contribution of each data modality (and specific features within each data modality) to the final prediction result and may provide biological insights to explain prediction performance.

Super-Gaussian, super-diffusive transport of multi-mode active matter

OpenAIRE

Hahn, Seungsoo; Song, Sanggeun; Kim, Dae Hyun; Yang, Gil-Suk; Lee, Kang Taek; Sung, Jaeyoung

2017-01-01

Living cells exhibit multi-mode transport that switches between an active, self-propelled motion and a seemingly passive, random motion. Cellular decision-making over transport mode switching is a stochastic process that depends on the dynamics of the intracellular chemical network regulating the cell migration process. Here, we propose a theory and an exactly solvable model of multi-mode active matter. Our exact model study shows that the reversible transition between a passive mode and an a...

Systemic multimodal approach to speech therapy treatment in autistic children.

Science.gov (United States)

Tamas, Daniela; Marković, Slavica; Milankov, Vesela

2013-01-01

Conditions in which speech therapy treatment is applied in autistic children are often not in accordance with characteristics of opinions and learning of people with autism. A systemic multimodal approach means motivating autistic people to develop their language speech skill through the procedure which allows reliving of their personal experience according to the contents that are presented in the their natural social environment. This research was aimed at evaluating the efficiency of speech treatment based on the systemic multimodal approach to the work with autistic children. The study sample consisted of 34 children, aged from 8 to 16 years, diagnosed to have different autistic disorders, whose results showed a moderate and severe clinical picture of autism on the Childhood Autism Rating Scale. The applied instruments for the evaluation of ability were the Childhood Autism Rating Scale and Ganzberg II test. The study subjects were divided into two groups according to the type of treatment: children who were covered by the continuing treatment and systemic multimodal approach in the treatment, and children who were covered by classical speech treatment. It is shown that the systemic multimodal approach in teaching autistic children affects the stimulation of communication, socialization, self-service and work as well as that the progress achieved in these areas of functioning was retainable after long time, too. By applying the systemic multimodal approach when dealing with autistic children and by comparing their achievements on tests applied before, during and after the application of this mode, it has been concluded that certain improvement has been achieved in the functionality within the diagnosed category. The results point to a possible direction in the creation of new methods, plans and programs in dealing with autistic children based on empirical and interactive learning.

MANIFESTATION OF MANIPULATION IN POLITICAL TALK-SHOWS: COGNITIVE AND MULTIMODAL ASPECTS

Directory of Open Access Journals (Sweden)

Petrova Anna Aleksandrovna

2014-11-01

Full Text Available The article deals with the problems of the manipulation manifestation in political television talk-shows. The suggestive processes of interaction in the analyzed genre of the media political discourse are studied in two aspects: а monomodal – as speech manipulation by verbal means at the level of emotional suggestion; b multimodal – as counter-suggestion, that restricts the effect of suggestion with visual and kinetic resources. The foundation of the cognitive analysis is a modeling method with a linguistic model which contains components of the cognitive and emotional processing of meaning, conclusions and reasoning. According to this three-component model, the speech manipulation consists in activation of dominant scripts of an addressee and is assured by the verbal resources of suggestion which associate with these scripts. The foundation of the multimodal research of the situations with counter-suggestion in the mass-media discourse is an ethnomethodological method with a reconstruction device. With this scientific attitude the authors have divided the resources of protection from the activating manipulation into two groups: 1 passive interactive communication of a suggestee in a verbal pause 2 active interactive communication of a suggestee aimed at changing the status and role domination. The empiric study of two isolated modalities and their correlations in specific situations of political talk shows allowed to develop the hypothesis on the existence of the fourth visual and kinetic component which represents space and corporal constellations with other models (or modalities of communication and their configurations. This study emphasizes the need to extend the research frames for the complex interactive processes of communication through their study in the multimodal aspect.

Testing nonclassicality in multimode fields: A unified derivation of classical inequalities

International Nuclear Information System (INIS)

Miranowicz, Adam; Bartkowiak, Monika; Wang Xiaoguang; Liu Yuxi; Nori, Franco

2010-01-01

We consider a way to generate operational inequalities to test nonclassicality (or quantumness) of multimode bosonic fields (or multiparty bosonic systems) that unifies the derivation of many known inequalities and allows to propose new ones. The nonclassicality criteria are based on Vogel's criterion corresponding to analyzing the positivity of multimode P functions or, equivalently, the positivity of matrices of expectation values of, e.g., creation and annihilation operators. We analyze not only monomials but also polynomial functions of such moments, which can sometimes enable simpler derivations of physically relevant inequalities. As an example, we derive various classical inequalities which can be violated only by nonclassical fields. In particular, we show how the criteria introduced here easily reduce to the well-known inequalities describing (a) multimode quadrature squeezing and its generalizations, including sum, difference, and principal squeezing; (b) two-mode one-time photon-number correlations, including sub-Poisson photon-number correlations and effects corresponding to violations of the Cauchy-Schwarz and Muirhead inequalities; (c) two-time single-mode photon-number correlations, including photon antibunching and hyperbunching; and (d) two- and three-mode quantum entanglement. Other simple inequalities for testing nonclassicality are also proposed. We have found some general relations between the nonclassicality and entanglement criteria, in particular those resulting from the Cauchy-Schwarz inequality. It is shown that some known entanglement inequalities can be derived as nonclassicality inequalities within our formalism, while some other known entanglement inequalities can be seen as sums of more than one inequality derived from the nonclassicality criterion. This approach enables a deeper analysis of the entanglement for a given nonclassicality.

Multimodality therapy of local regional esophageal cancer.

Science.gov (United States)

Kelsen, David P

2005-12-01

Recent trials regarding the use of multimodality therapy for patients with cancers of the esophagus and gastroesophageal junction have not conclusively shown benefit. Regimens containing cisplatin and fluorouracil administered preoperatively appear to be tolerable and do not increase operative morbidity or mortality when compared with surgery alone. Yet clinical trials have not clearly shown that such regimens improve outcome as measured by survival. Likewise, trials of postoperative chemoradiation have not reported a significant improvement in median or overall survival. The reasons for the lack of clinical benefit from multimodality therapy are not completely understood, but improvements in systemic therapy will probably be necessary before disease-free or overall survival improves substantially. Some new single agents such as the taxanes (docetaxel or paclitaxel) and the camptothecan analog irinotecan have shown modest activity for palliative therapy.

Comprehensive two-dimensional gas chromatography for the analysis of organohalogenated micro-contaminants

NARCIS (Netherlands)

Korytar, P.; Haglund, P.; Boer, de J.; Brinkman, U.A.Th.

2006-01-01

We explain the principles of comprehensive two-dimensional gas chromatography (GC × GC), and discuss key instrumental aspects - with emphasis on column combinations and mass spectrometric detection. As the main item of interest, we review the potential of GC × GC for the analysis of

New two-port multimode interference reflectors

NARCIS (Netherlands)

Kleijn, E.; Smit, M.K.; Wale, M.J.; Leijtens, X.J.M.

2012-01-01

Multi-mode interference reflectors (MIRs) are versatile components. Two new MIR designs with a fixed 50/50 reflection to transmission ratio are introduced. Measurements on these new devices and on devices similar to those in [1] are presented and compared to the design values. Measured losses are

Influence of Blood Contamination During Multimode Adhesive ...

African Journals Online (AJOL)

2018-01-30

Jan 30, 2018 ... (μTBS) of multimode adhesives to dentin when using the self‑etch approach. Materials and Methods: ... adhesion, the collagen fibers collapse during the. Introduction ..... The failure mode was determined using an optical.

Key Concept Identification: A Comprehensive Analysis of Frequency and Topical Graph-Based Approaches

Directory of Open Access Journals (Sweden)

Muhammad Aman

2018-05-01

Full Text Available Automatic key concept extraction from text is the main challenging task in information extraction, information retrieval and digital libraries, ontology learning, and text analysis. The statistical frequency and topical graph-based ranking are the two kinds of potentially powerful and leading unsupervised approaches in this area, devised to address the problem. To utilize the potential of these approaches and improve key concept identification, a comprehensive performance analysis of these approaches on datasets from different domains is needed. The objective of the study presented in this paper is to perform a comprehensive empirical analysis of selected frequency and topical graph-based algorithms for key concept extraction on three different datasets, to identify the major sources of error in these approaches. For experimental analysis, we have selected TF-IDF, KP-Miner and TopicRank. Three major sources of error, i.e., frequency errors, syntactical errors and semantical errors, and the factors that contribute to these errors are identified. Analysis of the results reveals that performance of the selected approaches is significantly degraded by these errors. These findings can help us develop an intelligent solution for key concept extraction in the future.

Multimodal mechanisms of food creaminess sensation.

Science.gov (United States)

Chen, Jianshe; Eaton, Louise

2012-12-01

In this work, the sensory creaminess of a set of four viscosity-matched fluid foods (single cream, evaporated milk, corn starch solution, and corn starch solution containing long chain free fatty acids) was tested by a panel of 16 assessors via controlled sensation mechanisms of smell only, taste only, taste and tactile, and integrated multimodal. It was found that all sensation channels were able to discriminate between creamy and non-creamy foods, but only the multimodal method gave creaminess ratings in agreement with the samples' fat content. Results from this study show that the presence of long chain free fatty acids has no influence on creaminess perception. It is certain that food creaminess is not a primary sensory property but an integrated sensory perception (or sensory experience) derived from combined sensations of visual, olfactory, gustatory, and tactile cues. Creamy colour, milky flavour, and smooth texture are probably the most important sensory features of food creaminess.

Hydrocarbon Fuel Thermal Performance Modeling based on Systematic Measurement and Comprehensive Chromatographic Analysis

Science.gov (United States)

2016-07-31

distribution unlimited Hydrocarbon Fuel Thermal Performance Modeling based on Systematic Measurement and Comprehensive Chromatographic Analysis Matthew...vital importance for hydrocarbon -fueled propulsion systems: fuel thermal performance as indicated by physical and chemical effects of cooling passage... analysis . The selection and acquisition of a set of chemically diverse fuels is pivotal for a successful outcome since test method validation and

Gestures and multimodal input

OpenAIRE

Keates, Simeon; Robinson, Peter

1999-01-01

For users with motion impairments, the standard keyboard and mouse arrangement for computer access often presents problems. Other approaches have to be adopted to overcome this. In this paper, we will describe the development of a prototype multimodal input system based on two gestural input channels. Results from extensive user trials of this system are presented. These trials showed that the physical and cognitive loads on the user can quickly become excessive and detrimental to the interac...

MOBILTEL - Mobile Multimodal Telecommunications dialogue system based on VoIP telephony

Directory of Open Access Journals (Sweden)

Anton Čižmár

2009-10-01

Full Text Available In this paper the project MobilTel ispresented. The communication itself is becoming amultimodal interactive process. The MobilTel projectprovides research and development activities inmultimodal interfaces area. The result is a functionalarchitecture for mobile multimodal telecommunicationsystem running on handheld device. The MobilTelcommunicator is a multimodal Slovak speech andgraphical interface with integrated VoIP client. Theother possible modalities are pen – touch screeninteraction, keyboard, and display on which theinformation is more user friendly presented (icons,emoticons, etc., and provides hyperlink and scrollingmenu availability.We describe the method of interaction between mobileterminal (PDA and MobilTel multimodal PCcommunicator over a VoIP WLAN connection basedon SIP protocol. We also present the graphicalexamples of services that enable users to obtaininformation about weather or information about trainconnection between two train stations.

Multi-focus beam shaping of high power multimode lasers

Science.gov (United States)

Laskin, Alexander; Volpp, Joerg; Laskin, Vadim; Ostrun, Aleksei

2017-08-01

Beam shaping of powerful multimode fiber lasers, fiber-coupled solid-state and diode lasers is of great importance for improvements of industrial laser applications. Welding, cladding with millimetre scale working spots benefit from "inverseGauss" intensity profiles; performance of thick metal sheet cutting, deep penetration welding can be enhanced when distributing the laser energy along the optical axis as more efficient usage of laser energy, higher edge quality and reduction of the heat affected zone can be achieved. Building of beam shaping optics for multimode lasers encounters physical limitations due to the low beam spatial coherence of multimode fiber-coupled lasers resulting in big Beam Parameter Products (BPP) or M² values. The laser radiation emerging from a multimode fiber presents a mixture of wavefronts. The fiber end can be considered as a light source which optical properties are intermediate between a Lambertian source and a single mode laser beam. Imaging of the fiber end, using a collimator and a focusing objective, is a robust and widely used beam delivery approach. Beam shaping solutions are suggested in form of optics combining fiber end imaging and geometrical separation of focused spots either perpendicular to or along the optical axis. Thus, energy of high power lasers is distributed among multiple foci. In order to provide reliable operation with multi-kW lasers and avoid damages the optics are designed as refractive elements with smooth optical surfaces. The paper presents descriptions of multi-focus optics as well as examples of intensity profile measurements of beam caustics and application results.

Multimodality image registration with software: state-of-the-art

Energy Technology Data Exchange (ETDEWEB)

Slomka, Piotr J. [Cedars-Sinai Medical Center, AIM Program/Department of Imaging, Los Angeles, CA (United States); University of California, David Geffen School of Medicine, Los Angeles, CA (United States); Baum, Richard P. [Center for PET, Department of Nuclear Medicine, Bad Berka (Germany)

2009-03-15

Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

Marveling at "The Man Called Nova": Comics as Sponsors of Multimodal Literacy

Science.gov (United States)

Jacobs, Dale

2007-01-01

This essay theorizes the ways in which comics, and Marvel Comics in particular, acted as sponsors of multimodal literacy for the author. In doing so, the essay demonstrates the possibilities that exist in examining comics more closely and in thinking about how literacy sponsorship happens in multimodal texts. (Contains 1 figure and 13 notes.)

Numerical modelling of multimode fibre-optic communication lines

Energy Technology Data Exchange (ETDEWEB)

Sidelnikov, O S; Fedoruk, M P [Novosibirsk State University, Novosibirsk (Russian Federation); Sygletos, S; Ferreira, F [Aston University, England, Birmingham, B4 7ET (United Kingdom)

2016-01-31

The results of numerical modelling of nonlinear propagation of an optical signal in multimode fibres with a small differential group delay are presented. It is found that the dependence of the error vector magnitude (EVM) on the differential group delay can be reduced by increasing the number of ADC samples per symbol in the numerical implementation of the differential group delay compensation algorithm in the receiver. The possibility of using multimode fibres with a small differential group delay for data transmission in modern digital communication systems is demonstrated. It is shown that with increasing number of modes the strong coupling regime provides a lower EVM level than the weak coupling one. (fibre-optic communication lines)

Diagnostic and therapeutic implications of genetic heterogeneity in myeloid neoplasms uncovered by comprehensive mutational analysis

Directory of Open Access Journals (Sweden)

Sarah M. Choi

2017-01-01

Full Text Available While growing use of comprehensive mutational analysis has led to the discovery of innumerable genetic alterations associated with various myeloid neoplasms, the under-recognized phenomenon of genetic heterogeneity within such neoplasms creates a potential for diagnostic confusion. Here, we describe two cases where expanded mutational testing led to amendment of an initial diagnosis of chronic myelogenous leukemia with subsequent altered treatment of each patient. We demonstrate the power of comprehensive testing in ensuring appropriate classification of genetically heterogeneous neoplasms, and emphasize thoughtful analysis of molecular and genetic data as an essential component of diagnosis and management.

The case for multimodal analysis of atypical interaction: questions, answers and gaze in play involving a child with autism.

Science.gov (United States)

Muskett, Tom; Body, Richard

2013-01-01

Conversation analysis (CA) continues to accrue interest within clinical linguistics as a methodology that can enable elucidation of structural and sequential orderliness in interactions involving participants who produce ostensibly disordered communication behaviours. However, it can be challenging to apply CA to re-examine clinical phenomena that have initially been defined in terms of linguistics, as a logical starting point for analysis may be to focus primarily on the organisation of language ("talk") in such interactions. In this article, we argue that CA's methodological power can only be fully exploited in this research context when a multimodal analytic orientation is adopted, where due consideration is given to participants' co-ordinated use of multiple semiotic resources including, but not limited to, talk (e.g., gaze, embodied action, object use and so forth). To evidence this argument, a two-layered analysis of unusual question-answer sequences in a play episode involving a child with autism is presented. It is thereby demonstrated that only when the scope of enquiry is broadened to include gaze and other embodied action can an account be generated of orderliness within these sequences. This finding has important implications for CA's application as a research methodology within clinical linguistics.

An Association between Auditory-Visual Synchrony Processing and Reading Comprehension: Behavioral and Electrophysiological Evidence.

Science.gov (United States)

Mossbridge, Julia; Zweig, Jacob; Grabowecky, Marcia; Suzuki, Satoru

2017-03-01

The perceptual system integrates synchronized auditory-visual signals in part to promote individuation of objects in cluttered environments. The processing of auditory-visual synchrony may more generally contribute to cognition by synchronizing internally generated multimodal signals. Reading is a prime example because the ability to synchronize internal phonological and/or lexical processing with visual orthographic processing may facilitate encoding of words and meanings. Consistent with this possibility, developmental and clinical research has suggested a link between reading performance and the ability to compare visual spatial/temporal patterns with auditory temporal patterns. Here, we provide converging behavioral and electrophysiological evidence suggesting that greater behavioral ability to judge auditory-visual synchrony (Experiment 1) and greater sensitivity of an electrophysiological marker of auditory-visual synchrony processing (Experiment 2) both predict superior reading comprehension performance, accounting for 16% and 25% of the variance, respectively. These results support the idea that the mechanisms that detect auditory-visual synchrony contribute to reading comprehension.

Multimodal Imaging of Human Brain Activity: Rational, Biophysical Aspects and Modes of Integration

Science.gov (United States)

Blinowska, Katarzyna; Müller-Putz, Gernot; Kaiser, Vera; Astolfi, Laura; Vanderperren, Katrien; Van Huffel, Sabine; Lemieux, Louis

2009-01-01

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship. PMID:19547657

Empowering Prospective Teachers to Become Active Sense-Makers: Multimodal Modeling of the Seasons

Science.gov (United States)

Kim, Mi Song

2015-10-01

Situating science concepts in concrete and authentic contexts, using information and communications technologies, including multimodal modeling tools, is important for promoting the development of higher-order thinking skills in learners. However, teachers often struggle to integrate emergent multimodal models into a technology-rich informal learning environment. Our design-based research co-designs and develops engaging, immersive, and interactive informal learning activities called "Embodied Modeling-Mediated Activities" (EMMA) to support not only Singaporean learners' deep learning of astronomy but also the capacity of teachers. As part of the research on EMMA, this case study describes two prospective teachers' co-design processes involving multimodal models for teaching and learning the concept of the seasons in a technology-rich informal learning setting. Our study uncovers four prominent themes emerging from our data concerning the contextualized nature of learning and teaching involving multimodal models in informal learning contexts: (1) promoting communication and emerging questions, (2) offering affordances through limitations, (3) explaining one concept involving multiple concepts, and (4) integrating teaching and learning experiences. This study has an implication for the development of a pedagogical framework for teaching and learning in technology-enhanced learning environments—that is empowering teachers to become active sense-makers using multimodal models.

Responsive Multimodal Transportation Management Strategies And IVHS

Science.gov (United States)

1995-02-01

THE PURPOSE OF THIS STUDY WAS TO INVESTIGATE NEW AND INNOVATIVE WAYS TO INCORPORATE IVHS TECHNOLOGIES INTO MULTIMODAL TRANSPORTATION MANAGEMENT STRATEGIES. MUCH OF THE IVHS RESEARCH DONE TO DATE HAS ADDRESSED THE MODES INDIVIDUALLY. THIS PROJECT FOCU...

A multimodal 3D framework for fire characteristics estimation

Science.gov (United States)

Toulouse, T.; Rossi, L.; Akhloufi, M. A.; Pieri, A.; Maldague, X.

2018-02-01

In the last decade we have witnessed an increasing interest in using computer vision and image processing in forest fire research. Image processing techniques have been successfully used in different fire analysis areas such as early detection, monitoring, modeling and fire front characteristics estimation. While the majority of the work deals with the use of 2D visible spectrum images, recent work has introduced the use of 3D vision in this field. This work proposes a new multimodal vision framework permitting the extraction of the three-dimensional geometrical characteristics of fires captured by multiple 3D vision systems. The 3D system is a multispectral stereo system operating in both the visible and near-infrared (NIR) spectral bands. The framework supports the use of multiple stereo pairs positioned so as to capture complementary views of the fire front during its propagation. Multimodal registration is conducted using the captured views in order to build a complete 3D model of the fire front. The registration process is achieved using multisensory fusion based on visual data (2D and NIR images), GPS positions and IMU inertial data. Experiments were conducted outdoors in order to show the performance of the proposed framework. The obtained results are promising and show the potential of using the proposed framework in operational scenarios for wildland fire research and as a decision management system in fighting.

Comprehensive Analysis Competence and Innovative Approaches for Sustainable Chemical Production.

Science.gov (United States)

Appel, Joerg; Colombo, Corrado; Dätwyler, Urs; Chen, Yun; Kerimoglu, Nimet

2016-01-01

Humanity currently sees itself facing enormous economic, ecological, and social challenges. Sustainable products and production in specialty chemistry are an important strategic element to address these megatrends. In addition to that, digitalization and global connectivity will create new opportunities for the industry. One aspect is examined in this paper, which shows the development of comprehensive analysis of production networks for a more sustainable production in which the need for innovative solutions arises. Examples from data analysis, advanced process control and automated performance monitoring are shown. These efforts have significant impact on improved yields, reduced energy and water consumption, and better product performance in the application of the products.

The future of multimodal corpora O futuro dos corpora modais

Directory of Open Access Journals (Sweden)

Dawn Knight

2011-01-01

Full Text Available This paper takes stock of the current state-of-the-art in multimodal corpus linguistics, and proposes some projections of future developments in this field. It provides a critical overview of key multimodal corpora that have been constructed over the past decade and presents a wish-list of future technological and methodological advancements that may help to increase the availability, utility and functionality of such corpora for linguistic research.Este artigo apresenta um balanço do estado da arte da linguística de corpus multimodal e propõe a projeção de desenvolvimentos futuros nessa área. Um resumo crítico dos corpora multimodais-chave que foram construídos na última década é apresentado, assim como uma lista de desenvolvimentos tecnológicos e metodológicos futuros que podem auxiliar na disponibilização e utilização, bem como na funcionalidade, de tais corpora para a pesquisa linguística.

Using MetaboAnalyst 3.0 for Comprehensive Metabolomics Data Analysis.

Science.gov (United States)

Xia, Jianguo; Wishart, David S

2016-09-07

MetaboAnalyst (http://www.metaboanalyst.ca) is a comprehensive Web application for metabolomic data analysis and interpretation. MetaboAnalyst handles most of the common metabolomic data types from most kinds of metabolomics platforms (MS and NMR) for most kinds of metabolomics experiments (targeted, untargeted, quantitative). In addition to providing a variety of data processing and normalization procedures, MetaboAnalyst also supports a number of data analysis and data visualization tasks using a range of univariate, multivariate methods such as PCA (principal component analysis), PLS-DA (partial least squares discriminant analysis), heatmap clustering and machine learning methods. MetaboAnalyst also offers a variety of tools for metabolomic data interpretation including MSEA (metabolite set enrichment analysis), MetPA (metabolite pathway analysis), and biomarker selection via ROC (receiver operating characteristic) curve analysis, as well as time series and power analysis. This unit provides an overview of the main functional modules and the general workflow of the latest version of MetaboAnalyst (MetaboAnalyst 3.0), followed by eight detailed protocols. © 2016 by John Wiley & Sons, Inc. Copyright © 2016 John Wiley & Sons, Inc.

New developments in multimodal clinical multiphoton tomography

Science.gov (United States)

König, Karsten

2011-03-01

80 years ago, the PhD student Maria Goeppert predicted in her thesis in Goettingen, Germany, two-photon effects. It took 30 years to prove her theory, and another three decades to realize the first two-photon microscope. With the beginning of this millennium, first clinical multiphoton tomographs started operation in research institutions, hospitals, and in the cosmetic industry. The multiphoton tomograph MPTflexTM with its miniaturized flexible scan head became the Prism-Award 2010 winner in the category Life Sciences. Multiphoton tomographs with its superior submicron spatial resolution can be upgraded to 5D imaging tools by adding spectral time-correlated single photon counting units. Furthermore, multimodal hybrid tomographs provide chemical fingerprinting and fast wide-field imaging. The world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph in spring 2010. In particular, nonfluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen have been imaged in patients with dermatological disorders. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution imaging tools such as ultrasound, optoacoustic, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer (malignant melanoma), optimization of treatment strategies (wound healing, dermatitis), and cosmetic research including long-term biosafety tests of ZnO sunscreen nanoparticles and the measurement of the stimulated biosynthesis of collagen by anti-ageing products.

Comprehension-Driven Program Analysis (CPA) for Malware Detection in Android Phones

Science.gov (United States)

2015-07-01

Android source . 3.1.2.2 Analyzers An analyzer conforms to specifications defined by the Security Toolbox. Specifically an analyzer encapsulates a...COMPREHENSION-DRIVEN PROGRAM ANALYSIS (CPA) FOR MALWARE DETECTION IN ANDROID PHONES IOWA STATE UNIVERSITY JULY 2015 FINAL...average 1 hour per response, including the time for reviewing instructions, searching existing data sources , gathering and maintaining the data needed

The economic implications of a multimodal analgesic regimen for patients undergoing major orthopedic surgery: a comparative study of direct costs.

Science.gov (United States)

Duncan, Christopher M; Hall Long, Kirsten; Warner, David O; Hebl, James R

2009-01-01

Total knee and total hip arthoplasty (THA) are 2 of the most common surgical procedures performed in the United States and represent the greatest single Medicare procedural expenditure. This study was designed to evaluate the economic impact of implementing a multimodal analgesic regimen (Total Joint Regional Anesthesia [TJRA] Clinical Pathway) on the estimated direct medical costs of patients undergoing lower extremity joint replacement surgery. An economic cost comparison was performed on Mayo Clinic patients (n = 100) undergoing traditional total knee or total hip arthroplasty using the TJRA Clinical Pathway. Study patients were matched 1:1 with historical controls undergoing similar procedures using traditional anesthetic (non-TJRA) techniques. Matching criteria included age, sex, surgeon, type of procedure, and American Society of Anesthesiologists (ASA) physical status (PS) classification. Hospital-based direct costs were collected for each patient and analyzed in standardized inflation-adjusted constant dollars using cost-to-charge ratios, wage indexes, and physician services valued using Medicare reimbursement rates. The estimated mean direct hospital costs were compared between groups, and a subgroup analysis was performed based on ASA PS classification. The estimated mean direct hospital costs were significantly reduced among TJRA patients when compared with controls (cost difference, 1999 dollars; 95% confidence interval, 584-3231 dollars; P = 0.0004). A significant reduction in hospital-based (Medicare Part A) costs accounted for the majority of the total cost savings. Use of a comprehensive, multimodal analgesic regimen (TJRA Clinical Pathway) in patients undergoing lower extremity joint replacement surgery provides a significant reduction in the estimated total direct medical costs. The reduction in mean cost is primarily associated with lower hospital-based (Medicare Part A) costs, with the greatest overall cost difference appearing among patients

Naming Block Structures: A Multimodal Approach

Science.gov (United States)

Cohen, Lynn; Uhry, Joanna

2011-01-01

This study describes symbolic representation in block play in a culturally diverse suburban preschool classroom. Block play is "multimodal" and can allow children to experiment with materials to represent the world in many forms of literacy. Combined qualitative and quantitative data from seventy-seven block structures were collected and analyzed.…

Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking.

Science.gov (United States)

Yu, Jun; Yang, Xiaokang; Gao, Fei; Tao, Dacheng

2017-12-01

How do we retrieve images accurately? Also, how do we rank a group of images precisely and efficiently for specific queries? These problems are critical for researchers and engineers to generate a novel image searching engine. First, it is important to obtain an appropriate description that effectively represent the images. In this paper, multimodal features are considered for describing images. The images unique properties are reflected by visual features, which are correlated to each other. However, semantic gaps always exist between images visual features and semantics. Therefore, we utilize click feature to reduce the semantic gap. The second key issue is learning an appropriate distance metric to combine these multimodal features. This paper develops a novel deep multimodal distance metric learning (Deep-MDML) method. A structured ranking model is adopted to utilize both visual and click features in distance metric learning (DML). Specifically, images and their related ranking results are first collected to form the training set. Multimodal features, including click and visual features, are collected with these images. Next, a group of autoencoders is applied to obtain initially a distance metric in different visual spaces, and an MDML method is used to assign optimal weights for different modalities. Next, we conduct alternating optimization to train the ranking model, which is used for the ranking of new queries with click features. Compared with existing image ranking methods, the proposed method adopts a new ranking model to use multimodal features, including click features and visual features in DML. We operated experiments to analyze the proposed Deep-MDML in two benchmark data sets, and the results validate the effects of the method.

Evaluation of multimodal ground cues

DEFF Research Database (Denmark)

Nordahl, Rolf; Lecuyer, Anatole; Serafin, Stefania

2012-01-01

This chapter presents an array of results on the perception of ground surfaces via multiple sensory modalities,with special attention to non visual perceptual cues, notably those arising from audition and haptics, as well as interactions between them. It also reviews approaches to combining...... synthetic multimodal cues, from vision, haptics, and audition, in order to realize virtual experiences of walking on simulated ground surfaces or other features....

Digging beneath the Surface Behavioral and Neural Indices of Lexical Access during Idiom Comprehension in Aphasia: A Multi-Modal Approach

Science.gov (United States)

Brumm, Kathleen Patricia

2011-01-01

This project examines spoken language comprehension in Broca's aphasia, a non-fluent language disorder acquired subsequent to stroke. Broca's aphasics demonstrate impaired comprehension for complex sentence constructions. To account for this deficit, one current processing theory claims that Broca's patients retain intrinsic linguistic knowledge,…

Reflex-based grasping, skilled forelimb reaching, and electrodiagnostic evaluation for comprehensive analysis of functional recovery-The 7-mm rat median nerve gap repair model revisited.

Science.gov (United States)

Stößel, Maria; Rehra, Lena; Haastert-Talini, Kirsten

2017-10-01

The rat median nerve injury and repair model gets increasingly important for research on novel bioartificial nerve grafts. It allows follow-up evaluation of the recovery of the forepaw functional ability with several sensitive techniques. The reflex-based grasping test, the skilled forelimb reaching staircase test, as well as electrodiagnostic recordings have been described useful in this context. Currently, no standard values exist, however, for comparison or comprehensive correlation of results obtained in each of the three methods after nerve gap repair in adult rats. Here, we bilaterally reconstructed 7-mm median nerve gaps with autologous nerve grafts (ANG) or autologous muscle-in-vein grafts (MVG), respectively. During 8 and 12 weeks of observation, functional recovery of each paw was separately monitored using the grasping test (weekly), the staircase test, and noninvasive electrophysiological recordings from the thenar muscles (both every 4 weeks). Evaluation was completed by histomorphometrical analyses at 8 and 12 weeks postsurgery. The comprehensive evaluation detected a significant difference in the recovery of forepaw functional motor ability between the ANG and MVG groups. The correlation between the different functional tests evaluated precisely displayed the recovery of distinct levels of forepaw functional ability over time. Thus, this multimodal evaluation model represents a valuable preclinical model for peripheral nerve reconstruction approaches.

Contemporary Multi-Modal Historical Representations and the Teaching of Disciplinary Understandings in History

Science.gov (United States)

Donnelly, Debra J.

2018-01-01

Traditional privileging of the printed text has been considerably eroded by rapid technological advancement and in Australia, as elsewhere, many History teaching programs feature an array of multi-modal historical representations. Research suggests that engagement with the visual and multi-modal constructs has the potential to enrich the pedagogy…

Multimodal retrieval of autobiographical memories: sensory information contributes differently to the recollection of events.

Science.gov (United States)

Willander, Johan; Sikström, Sverker; Karlsson, Kristina

2015-01-01

Previous studies on autobiographical memory have focused on unimodal retrieval cues (i.e., cues pertaining to one modality). However, from an ecological perspective multimodal cues (i.e., cues pertaining to several modalities) are highly important to investigate. In the present study we investigated age distributions and experiential ratings of autobiographical memories retrieved with unimodal and multimodal cues. Sixty-two participants were randomized to one of four cue-conditions: visual, olfactory, auditory, or multimodal. The results showed that the peak of the distributions depends on the modality of the retrieval cue. The results indicated that multimodal retrieval seemed to be driven by visual and auditory information to a larger extent and to a lesser extent by olfactory information. Finally, no differences were observed in the number of retrieved memories or experiential ratings across the four cue-conditions.

Multimodal Retrieval of Autobiographical Memories: Sensory Information Contributes Differently to the Recollection of Events

Directory of Open Access Journals (Sweden)

Johan eWillander

2015-11-01

Full Text Available Previous studies on autobiographical memory have focused on unimodal retrieval cues (i.e., cues pertaining to one modality. However, from an ecological perspective multimodal cues (i.e., cues pertaining to several modalities are highly important to investigate. In the present study we investigated age distributions and experiential ratings of autobiographical memories retrieved with unimodal and multimodal cues. Sixty-two participants were randomized to one of four cue-conditions: visual, olfactory, auditory, and multimodal. The results showed that the peak of the distributions depend on the modality of the retrieval cue. The results indicated that multimodal retrieval seemed to be driven by visual and auditory information to a larger extent and to a lesser extent by olfactory information. Finally, no differences were observed in the number of retrieved memories or experiential ratings across the four cue-conditions.

The Effects of Visual Attention Span and Phonological Decoding in Reading Comprehension in Dyslexia: A Path Analysis

OpenAIRE

Chen, C.; Schneps, M.; Masyn, K.; Thomson, J.

2016-01-01

Increasing evidence has shown visual attention span to be a factor, distinct from phonological skills, that explains single-word identification (pseudo-word/word reading) performance in dyslexia. Yet, little is known about how well visual attention span explains text comprehension. Observing reading comprehension in a sample of 105 high school students with dyslexia, we used a pathway analysis to examine the direct and indirect path between visual attention span and reading comprehension whil...

Fast multi-core based multimodal registration of 2D cross-sections and 3D datasets

Directory of Open Access Journals (Sweden)

Pielot Rainer

2010-01-01

Full Text Available Abstract Background Solving bioinformatics tasks often requires extensive computational power. Recent trends in processor architecture combine multiple cores into a single chip to improve overall performance. The Cell Broadband Engine (CBE, a heterogeneous multi-core processor, provides power-efficient and cost-effective high-performance computing. One application area is image analysis and visualisation, in particular registration of 2D cross-sections into 3D image datasets. Such techniques can be used to put different image modalities into spatial correspondence, for example, 2D images of histological cuts into morphological 3D frameworks. Results We evaluate the CBE-driven PlayStation 3 as a high performance, cost-effective computing platform by adapting a multimodal alignment procedure to several characteristic hardware properties. The optimisations are based on partitioning, vectorisation, branch reducing and loop unrolling techniques with special attention to 32-bit multiplies and limited local storage on the computing units. We show how a typical image analysis and visualisation problem, the multimodal registration of 2D cross-sections and 3D datasets, benefits from the multi-core based implementation of the alignment algorithm. We discuss several CBE-based optimisation methods and compare our results to standard solutions. More information and the source code are available from http://cbe.ipk-gatersleben.de. Conclusions The results demonstrate that the CBE processor in a PlayStation 3 accelerates computational intensive multimodal registration, which is of great importance in biological/medical image processing. The PlayStation 3 as a low cost CBE-based platform offers an efficient option to conventional hardware to solve computational problems in image processing and bioinformatics.

Effect of Multimodal Pore Channels on Cargo Release from Mesoporous Silica Nanoparticles

Directory of Open Access Journals (Sweden)

Sushilkumar A. Jadhav

2016-01-01

Full Text Available Mesoporous silica nanoparticles (MSNs with multimodal pore channels were fully characterized by TEM, nitrogen adsorption-desorption, and DLS analyses. MSNs with average diameter of 200 nm with dual pore channel zones with pore diameters of 1.3–2.6 and 4 nm were tested for their use in drug delivery application. Important role of the multimodal pore systems present on MSNs on the quantitative release of model drug ibuprofen was investigated. The results obtained revealed that the release profile for ibuprofen clearly shows distinct zones which can be attributed to the respective porous channel zones present on the particles. The fluctuations in the concentration of ibuprofen during the prolonged release from MSNs were caused by the multimodal pore channel systems.

Sustained Spatial Attention in Touch: Modality-Specific and Multimodal Mechanisms

Directory of Open Access Journals (Sweden)

Chiara F. Sambo

2011-01-01

Full Text Available Sustained attention to a body location results in enhanced processing of tactile stimuli presented at that location compared to another unattended location. In this paper, we review studies investigating the neural correlates of sustained spatial attention in touch. These studies consistently show that activity within modality-specific somatosensory areas (SI and SII is modulated by sustained tactile-spatial attention. Recent evidence suggests that these somatosensory areas may be recruited as part of a larger cortical network,also including higher-level multimodal regions involved in spatial selection across modalities. We discuss, in turn, the following multimodal effects in sustained tactile-spatial attention tasks. First, cross-modal attentional links between touch and vision, reflected in enhanced processing of task-irrelevant visual stimuli at tactuallyattended locations, are mediated by common (multimodal representations of external space. Second, vision of the body modulates activity underlying sustained tactile-spatial attention, facilitating attentional modulation of tactile processing in between-hand (when hands are sufficiently far apart and impairing attentional modulation in within-hand selection tasks. Finally, body posture influences mechanisms of sustained tactile-spatial attention, relying, at least partly, on remapping of tactile stimuli in external, visuallydefined, spatial coordinates. Taken together, the findings reviewed in this paper indicate that sustained spatial attention in touch is subserved by both modality-specific and multimodal mechanisms. The interplay between these mechanisms allows flexible and efficient spatial selection within and across sensory modalities.

Multimodal imaging of lung cancer and its microenvironment (Conference Presentation)

Science.gov (United States)

Hariri, Lida P.; Niederst, Matthew J.; Mulvey, Hillary; Adams, David C.; Hu, Haichuan; Chico Calero, Isabel; Szabari, Margit V.; Vakoc, Benjamin J.; Hasan, Tayyaba; Bouma, Brett E.; Engelman, Jeffrey A.; Suter, Melissa J.

2016-03-01

Despite significant advances in targeted therapies for lung cancer, nearly all patients develop drug resistance within 6-12 months and prognosis remains poor. Developing drug resistance is a progressive process that involves tumor cells and their microenvironment. We hypothesize that microenvironment factors alter tumor growth and response to targeted therapy. We conducted in vitro studies in human EGFR-mutant lung carcinoma cells, and demonstrated that factors secreted from lung fibroblasts results in increased tumor cell survival during targeted therapy with EGFR inhibitor, gefitinib. We also demonstrated that increased environment stiffness results in increased tumor survival during gefitinib therapy. In order to test our hypothesis in vivo, we developed a multimodal optical imaging protocol for preclinical intravital imaging in mouse models to assess tumor and its microenvironment over time. We have successfully conducted multimodal imaging of dorsal skinfold chamber (DSC) window mice implanted with GFP-labeled human EGFR mutant lung carcinoma cells and visualized changes in tumor development and microenvironment facets over time. Multimodal imaging included structural OCT to assess tumor viability and necrosis, polarization-sensitive OCT to measure tissue birefringence for collagen/fibroblast detection, and Doppler OCT to assess tumor vasculature. Confocal imaging was also performed for high-resolution visualization of EGFR-mutant lung cancer cells labeled with GFP, and was coregistered with OCT. Our results demonstrated that stromal support and vascular growth are essential to tumor progression. Multimodal imaging is a useful tool to assess tumor and its microenvironment over time.

Comprehensive analysis of a straw-fired power plant in Vojvodina

Directory of Open Access Journals (Sweden)

Urošević Dragan M.

2012-01-01

Full Text Available In recent years, renewable energy sources have played an increasingly important role in potential energy production. The integration of renewable energy technologies into existing national energy system has therefore become a major challenge for many countries. Due to the importance of this matter, this paper deals with the comprehensive analysis for implementation of a power plant on biomass (straw. The analysis is conducted regarding several key indicators: availability of biomass, regulation, reduction of greenhouse gas emissions, location, land use, electricity price and social impacts. The analysis also includes favorable price for electricity produced from biomass relevant to national feed in tariffs. In order to demonstrate all above mentioned indicators, the region in Serbia (Province of Vojvodina with significant potential in biomass, especially in straw, is selected. The results of the analysis are validated trough environmental and social aspects. Special attention is given to identifying risks for this application.

Multimodal system for the planning and guidance of bronchoscopy

Science.gov (United States)

Higgins, William E.; Cheirsilp, Ronnarit; Zang, Xiaonan; Byrnes, Patrick

2015-03-01

Many technical innovations in multimodal radiologic imaging and bronchoscopy have emerged recently in the effort against lung cancer. Modern X-ray computed-tomography (CT) scanners provide three-dimensional (3D) high-resolution chest images, positron emission tomography (PET) scanners give complementary molecular imaging data, and new integrated PET/CT scanners combine the strengths of both modalities. State-of-the-art bronchoscopes permit minimally invasive tissue sampling, with vivid endobronchial video enabling navigation deep into the airway-tree periphery, while complementary endobronchial ultrasound (EBUS) reveals local views of anatomical structures outside the airways. In addition, image-guided intervention (IGI) systems have proven their utility for CT-based planning and guidance of bronchoscopy. Unfortunately, no IGI system exists that integrates all sources effectively through the complete lung-cancer staging work flow. This paper presents a prototype of a computer-based multimodal IGI system that strives to fill this need. The system combines a wide range of automatic and semi-automatic image-processing tools for multimodal data fusion and procedure planning. It also provides a flexible graphical user interface for follow-on guidance of bronchoscopy/EBUS. Human-study results demonstrate the system's potential.

Early functional MRI activation predicts motor outcome after ischemic stroke: a longitudinal, multimodal study.

Science.gov (United States)

Du, Juan; Yang, Fang; Zhang, Zhiqiang; Hu, Jingze; Xu, Qiang; Hu, Jianping; Zeng, Fanyong; Lu, Guangming; Liu, Xinfeng

2018-05-15

An accurate prediction of long term outcome after stroke is urgently required to provide early individualized neurorehabilitation. This study aimed to examine the added value of early neuroimaging measures and identify the best approaches for predicting motor outcome after stroke. This prospective study involved 34 first-ever ischemic stroke patients (time since stroke: 1-14 days) with upper limb impairment. All patients underwent baseline multimodal assessments that included clinical (age, motor impairment), neurophysiological (motor-evoked potentials, MEP) and neuroimaging (diffusion tensor imaging and motor task-based fMRI) measures, and also underwent reassessment 3 months after stroke. Bivariate analysis and multivariate linear regression models were used to predict the motor scores (Fugl-Meyer assessment, FMA) at 3 months post-stroke. With bivariate analysis, better motor outcome significantly correlated with (1) less initial motor impairment and disability, (2) less corticospinal tract injury, (3) the initial presence of MEPs, (4) stronger baseline motor fMRI activations. In multivariate analysis, incorporating neuroimaging data improved the predictive accuracy relative to only clinical and neurophysiological assessments. Baseline fMRI activation in SMA was an independent predictor of motor outcome after stroke. A multimodal model incorporating fMRI and clinical measures best predicted the motor outcome following stroke. fMRI measures obtained early after stroke provided independent prediction of long-term motor outcome.

Multimodality and children's participation in classrooms: Instances of ...

African Journals Online (AJOL)

Multimodality and children's participation in classrooms: Instances of research. ... deficit models of children, drawing on their everyday experiences and their existing ... It outlines the theoretical framework supporting the pedagogical approach, ...

Elimination of mode coupling in multimode continuous-variable key distribution

International Nuclear Information System (INIS)

Filip, Radim; Mista, Ladislav; Marek, Petr

2005-01-01

A multimode channel can be utilized to substantially increase the capacity of quantum continuous-variable key distribution. Beyond losses in the channel, an uncontrollable coupling between the modes of the channel typically degrades the capacity of multimode channels. For the key distribution protocol with simultaneous measurement of both complementary quadratures we propose a feasible method to eliminate any undesirable mode coupling by only the receiver's appropriate measurement and data manipulation. It can be used to substantially increase the capacity of the channel, which has an important application in practical continuous-variable quantum cryptography

OpenLMD, multimodal monitoring and control of LMD processing

Science.gov (United States)

Rodríguez-Araújo, Jorge; García-Díaz, Antón

2017-02-01

This paper presents OpenLMD, a novel open-source solution for on-line multimodal monitoring of Laser Metal Deposition (LMD). The solution is also applicable to a wider range of laser-based applications that require on-line control (e.g. laser welding). OpenLMD is a middleware that enables the orchestration and virtualization of a LMD robot cell, using several open-source frameworks (e.g. ROS, OpenCV, PCL). The solution also allows reconfiguration by easy integration of multiple sensors and processing equipment. As a result, OpenLMD delivers significant advantages over existing monitoring and control approaches, such as improved scalability, and multimodal monitoring and data sharing capabilities.

3D hierarchical spatial representation and memory of multimodal sensory data

Science.gov (United States)

Khosla, Deepak; Dow, Paul A.; Huber, David J.

2009-04-01

This paper describes an efficient method and system for representing, processing and understanding multi-modal sensory data. More specifically, it describes a computational method and system for how to process and remember multiple locations in multimodal sensory space (e.g., visual, auditory, somatosensory, etc.). The multimodal representation and memory is based on a biologically-inspired hierarchy of spatial representations implemented with novel analogues of real representations used in the human brain. The novelty of the work is in the computationally efficient and robust spatial representation of 3D locations in multimodal sensory space as well as an associated working memory for storage and recall of these representations at the desired level for goal-oriented action. We describe (1) A simple and efficient method for human-like hierarchical spatial representations of sensory data and how to associate, integrate and convert between these representations (head-centered coordinate system, body-centered coordinate, etc.); (2) a robust method for training and learning a mapping of points in multimodal sensory space (e.g., camera-visible object positions, location of auditory sources, etc.) to the above hierarchical spatial representations; and (3) a specification and implementation of a hierarchical spatial working memory based on the above for storage and recall at the desired level for goal-oriented action(s). This work is most useful for any machine or human-machine application that requires processing of multimodal sensory inputs, making sense of it from a spatial perspective (e.g., where is the sensory information coming from with respect to the machine and its parts) and then taking some goal-oriented action based on this spatial understanding. A multi-level spatial representation hierarchy means that heterogeneous sensory inputs (e.g., visual, auditory, somatosensory, etc.) can map onto the hierarchy at different levels. When controlling various machine

A data fusion environment for multimodal and multi-informational neuronavigation.

Science.gov (United States)

Jannin, P; Fleig, O J; Seigneuret, E; Grova, C; Morandi, X; Scarabin, J M

2000-01-01

Part of the planning and performance of neurosurgery consists of determining target areas, areas to be avoided, landmark areas, and trajectories, all of which are components of the surgical script. Nowadays, neurosurgeons have access to multimodal medical imaging to support the definition of the surgical script. The purpose of this paper is to present a software environment developed by the authors that allows full multimodal and multi-informational planning as well as neuronavigation for epilepsy and tumor surgery. We have developed a data fusion environment dedicated to neuronavigation around the Surgical Microscope Neuronavigator system (Carl Zeiss, Oberkochen, Germany). This environment includes registration, segmentation, 3D visualization, and interaction-applied tools. It provides the neuronavigation system with the multimodal information involved in the definition of the surgical script: lesional areas, sulci, ventricles segmented from magnetic resonance imaging (MRI), vessels segmented from magnetic resonance angiography (MRA), functional areas from magneto-encephalography (MEG), and functional magnetic resonance imaging (fMRI) for somatosensory, motor, or language activation. These data are considered to be relevant for the performance of the surgical procedure. The definition of each entity results from the same procedure: registration to the anatomical MRI data set (defined as the reference data set), segmentation, fused 3D display, selection of the relevant entities for the surgical step, encoding in 3D surface-based representation, and storage of the 3D surfaces in a file recognized by the neuronavigation software (STP 3.4, Leibinger; Freiburg, Germany). Multimodal neuronavigation is illustrated with two clinical cases for which multimodal information was introduced into the neuronavigation system. Lesional areas were used to define and follow the surgical path, sulci and vessels helped identify the anatomical environment of the surgical field, and

Single versus multimodality training basic laparoscopic skills

NARCIS (Netherlands)

Brinkman, W.M.; Havermans, S.Y.; Buzink, S.N.; Botden, S.M.B.I.; Jakimowicz, J.J.; Schoot, B.C.

2012-01-01

Introduction - Even though literature provides compelling evidence of the value of simulators for training of basic laparoscopic skills, the best way to incorporate them into a surgical curriculum is unclear. This study compares the training outcome of single modality training with multimodality

The Multimodalities of Globalization: Teaching a YouTube Video in an EAP Classroom

Science.gov (United States)

Chun, Christian W.

2012-01-01

This article examines the ways in which a multimodal text--a YouTube video on globalization and business--was mediated in two English for Academic Purposes (EAP) classrooms, and how these mediations shaped the instructor's and her students' meaning-making in specific ways. I first explore the complex multimodal discourses involved with this…

Comprehensive Mass Analysis for Chemical Processes, a Case Study on L-Dopa Manufacture

Science.gov (United States)

To evaluate the “greenness” of chemical processes in route selection and process development, we propose a comprehensive mass analysis to inform the stakeholders from different fields. This is carried out by characterizing the mass intensity for each contributing chemical or wast...

Multimodal interaction in image and video applications

CERN Document Server

Sappa, Angel D

2013-01-01

Traditional Pattern Recognition (PR) and Computer Vision (CV) technologies have mainly focused on full automation, even though full automation often proves elusive or unnatural in many applications, where the technology is expected to assist rather than replace the human agents. However, not all the problems can be automatically solved being the human interaction the only way to tackle those applications. Recently, multimodal human interaction has become an important field of increasing interest in the research community. Advanced man-machine interfaces with high cognitive capabilities are a hot research topic that aims at solving challenging problems in image and video applications. Actually, the idea of computer interactive systems was already proposed on the early stages of computer science. Nowadays, the ubiquity of image sensors together with the ever-increasing computing performance has open new and challenging opportunities for research in multimodal human interaction. This book aims to show how existi...

Photonic lantern with multimode fibers embedded

Science.gov (United States)

Yu, Hai-Jiao; Yan, Qi; Huang, Zong-Jun; Tian, He; Jiang, Yu; Liu, Yong-Jun; Zhang, Jian-Zhong; Sun, Wei-Min

2014-08-01

A photonic lantern is studied which is formed by seven multimode fibers inserted into a pure silica capillary tube. The core of the tapered end has a uniform refractive index because the polymer claddings are removed before the fibers are inserted. Consequently, the light distribution is also uniform. Two theories describing a slowly varying waveguide and multimode coupling are used to analyze the photonic lantern. The transmission loss decreases as the length of the tapered part increases. For a device with a taper length of 3.4 cm, the loss is about 1.06 dB on average for light propagating through the taper from an inserted fiber to the tapered end and 0.99 dB in the reverse direction. For a device with a taper length of 0.7 cm, the two loss values are 2.63 dB and 2.53 dB, respectively. The results show that it is possible to achieve a uniform light distribution with the tapered end and a low-loss transmission in the device if parameters related to the lantern are reasonably defined.

Photonic lantern with multimode fibers embedded

International Nuclear Information System (INIS)

Yu Hai-Jiao; Yan Qi; Huang Zong-Jun; Tian He; Jiang Yu; Liu Yong-Jun; Zhang Jian-Zhong; Sun Wei-Min

2014-01-01

A photonic lantern is studied which is formed by seven multimode fibers inserted into a pure silica capillary tube. The core of the tapered end has a uniform refractive index because the polymer claddings are removed before the fibers are inserted. Consequently, the light distribution is also uniform. Two theories describing a slowly varying waveguide and multimode coupling are used to analyze the photonic lantern. The transmission loss decreases as the length of the tapered part increases. For a device with a taper length of 3.4 cm, the loss is about 1.06 dB on average for light propagating through the taper from an inserted fiber to the tapered end and 0.99 dB in the reverse direction. For a device with a taper length of 0.7 cm, the two loss values are 2.63 dB and 2.53 dB, respectively. The results show that it is possible to achieve a uniform light distribution with the tapered end and a low-loss transmission in the device if parameters related to the lantern are reasonably defined. (research papers)

An Efficient Multimodal 2D + 3D Feature-based Approach to Automatic Facial Expression Recognition

KAUST Repository

Li, Huibin

2015-07-29

We present a fully automatic multimodal 2D + 3D feature-based facial expression recognition approach and demonstrate its performance on the BU-3DFE database. Our approach combines multi-order gradient-based local texture and shape descriptors in order to achieve efficiency and robustness. First, a large set of fiducial facial landmarks of 2D face images along with their 3D face scans are localized using a novel algorithm namely incremental Parallel Cascade of Linear Regression (iPar-CLR). Then, a novel Histogram of Second Order Gradients (HSOG) based local image descriptor in conjunction with the widely used first-order gradient based SIFT descriptor are used to describe the local texture around each 2D landmark. Similarly, the local geometry around each 3D landmark is described by two novel local shape descriptors constructed using the first-order and the second-order surface differential geometry quantities, i.e., Histogram of mesh Gradients (meshHOG) and Histogram of mesh Shape index (curvature quantization, meshHOS). Finally, the Support Vector Machine (SVM) based recognition results of all 2D and 3D descriptors are fused at both feature-level and score-level to further improve the accuracy. Comprehensive experimental results demonstrate that there exist impressive complementary characteristics between the 2D and 3D descriptors. We use the BU-3DFE benchmark to compare our approach to the state-of-the-art ones. Our multimodal feature-based approach outperforms the others by achieving an average recognition accuracy of 86.32%. Moreover, a good generalization ability is shown on the Bosphorus database.

An Efficient Multimodal 2D + 3D Feature-based Approach to Automatic Facial Expression Recognition

KAUST Repository

Li, Huibin; Ding, Huaxiong; Huang, Di; Wang, Yunhong; Zhao, Xi; Morvan, Jean-Marie; Chen, Liming

2015-01-01

We present a fully automatic multimodal 2D + 3D feature-based facial expression recognition approach and demonstrate its performance on the BU-3DFE database. Our approach combines multi-order gradient-based local texture and shape descriptors in order to achieve efficiency and robustness. First, a large set of fiducial facial landmarks of 2D face images along with their 3D face scans are localized using a novel algorithm namely incremental Parallel Cascade of Linear Regression (iPar-CLR). Then, a novel Histogram of Second Order Gradients (HSOG) based local image descriptor in conjunction with the widely used first-order gradient based SIFT descriptor are used to describe the local texture around each 2D landmark. Similarly, the local geometry around each 3D landmark is described by two novel local shape descriptors constructed using the first-order and the second-order surface differential geometry quantities, i.e., Histogram of mesh Gradients (meshHOG) and Histogram of mesh Shape index (curvature quantization, meshHOS). Finally, the Support Vector Machine (SVM) based recognition results of all 2D and 3D descriptors are fused at both feature-level and score-level to further improve the accuracy. Comprehensive experimental results demonstrate that there exist impressive complementary characteristics between the 2D and 3D descriptors. We use the BU-3DFE benchmark to compare our approach to the state-of-the-art ones. Our multimodal feature-based approach outperforms the others by achieving an average recognition accuracy of 86.32%. Moreover, a good generalization ability is shown on the Bosphorus database.

Self-imaging effect of TM modes in photonic crystal multimode waveguides only exhibiting band gaps for TE modes

International Nuclear Information System (INIS)

Yu Tianbao; Jiang Xiaoqing; Yang Jianyi; Zhou Haifeng; Liao Qinghua; Wang Minghua

2007-01-01

This Letter presents the properties of transverse-magnetic (TM) modes in multimode photonic crystal waveguides (PCWs), which only exhibit photonic band gaps for transverse-electric (TE) modes. A good equivalent model is applied to analysis the designed structures on the basis of multimode interference effect and self-imaging principle. The performance shows that the TM modes can also be propagated with high efficiency, and resemble index-guided modes owing to the combination of total internal reflection (TIR) and distribution Bragg reflection. It provides a novel way to realize the components for both TM and TE polarizations by combining PBG and TIR effect in PCWs. As one of potential applications, polarization-insensitive power splitter based on the proposed structures can be designed

Exploring Adolescents' Multimodal Responses to "The Kite Runner": Understanding How Students Use Digital Media for Academic Purposes

Science.gov (United States)

Jocius, Robin

2013-01-01

This qualitative study explores how adolescent high school students in an AP English class used multiple forms of media (the internet, digital video, slide show software, video editing tools, literary texts, and writing) to respond to and analyze a contemporary novel, "The Kite Runner". Using a multimodal analysis framework, the author explores…

A community intervention trial of multimodal suicide prevention program in Japan: A Novel multimodal Community Intervention program to prevent suicide and suicide attempt in Japan, NOCOMIT-J

OpenAIRE

Ono, Yutaka; Awata, Shuichi; Iida, Hideharu; Ishida, Yasushi; Ishizuka, Naoki; Iwasa, Hiroto; Kamei, Yuichi; Motohashi, Yutaka; Nakagawa, Atsuo; Nakamura, Jun; Nishi, Nobuyuki; Otsuka, Kotaro; Oyama, Hirofumi; Sakai, Akio; Sakai, Hironori

2008-01-01

Abstract Background To respond to the rapid surge in the incidence of suicide in Japan, which appears to be an ongoing trend, the Japanese Multimodal Intervention Trials for Suicide Prevention (J-MISP) have launched a multimodal community-based suicide prevention program, NOCOMIT-J. The primary aim of this study is to examine whether NOCOMIT-J is effective in reducing suicidal behavior in the community. Methods/DesignThis study is a community intervention trial involving seven intervention re...

A multimodal interface to resolve the Midas-Touch problem in gaze controlled wheelchair.

Science.gov (United States)

Meena, Yogesh Kumar; Cecotti, Hubert; Wong-Lin, KongFatt; Prasad, Girijesh

2017-07-01

Human-computer interaction (HCI) research has been playing an essential role in the field of rehabilitation. The usability of the gaze controlled powered wheelchair is limited due to Midas-Touch problem. In this work, we propose a multimodal graphical user interface (GUI) to control a powered wheelchair that aims to help upper-limb mobility impaired people in daily living activities. The GUI was designed to include a portable and low-cost eye-tracker and a soft-switch wherein the wheelchair can be controlled in three different ways: 1) with a touchpad 2) with an eye-tracker only, and 3) eye-tracker with soft-switch. The interface includes nine different commands (eight directions and stop) and integrated within a powered wheelchair system. We evaluated the performance of the multimodal interface in terms of lap-completion time, the number of commands, and the information transfer rate (ITR) with eight healthy participants. The analysis of the results showed that the eye-tracker with soft-switch provides superior performance with an ITR of 37.77 bits/min among the three different conditions (pusers.

MultiModality Surgical and Hyperbaric Management of Mandibular Osteoradionecrosis

International Nuclear Information System (INIS)

Freiberger, John J.; Yoo, David S.; Lisle Dear, Guy de; McGraw, Thomas A.; Blakey, George H.; Padilla Burgos, Rebecca; Kraft, Kevin; Nelson, John W.; Moon, Richard E.; Piantadosi, Claude A.

2009-01-01

Purpose: To elucidate long-term outcomes in 65 consecutive patients meeting a uniform definition of mandibular osteoradionecrosis (ORN) treated with multimodality therapy including hyperbaric oxygen (HBO). Methods and Materials: Pretreatment, post-treatment and long-term follow-up of mandibular lesions with exposed bone were ranked by a systematic review of medical records and patient telephone calls. The ranking system was based on lesion diameter and number plus disease progression. Changes from pretreatment to post-treatment and follow-up were analyzed by Wilcoxon signed-rank tests. Improved wound survival, measured by time to relapse, defined as any less favorable rank after HBO treatment, was assessed by Kaplan-Meier analysis. Results: In all, 57 cases (88%) resolved or improved by lesion grade or progression and evolution criteria after HBO (p < 0.001). Four patients healed before surgery after HBO alone. Of 57 patients who experienced improvement, 41 had failed previous nonmultimodality therapy for 3 months and 26 for 6 months or more. A total of 43 patients were eligible for time-to-relapse survival analysis. Healing or improvement lasted a mean duration of 86.1 months (95% confidence interval [95% CI], 64.0-108.2) in nonsmokers (n = 20) vs. 15.8 months (95% CI, 8.4-23.2) in smokers (n = 14) versus 24.2 months (95% CI, 15.2-33.2) in patients with recurrent cancer (n = 9) (p = 0.002 by the log-rank method). Conclusions: Multimodality therapy using HBO is effective for ORN when less intensive therapies have failed. Although the healing rate in similarly affected patients not treated with HBO is unknown, the improvements seen with peri-operative HBO were durable provided that the patients remained cancer free and abstained from smoking.

The integration of emotional and symbolic components in multimodal communication

Directory of Open Access Journals (Sweden)

Marc eMehu

2015-07-01

Full Text Available Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g. verbal and denotative signals are well suited to transfer conceptual information, emotional components (e.g. nonverbal signals that are difficult to manipulate voluntarily likely take a function that is closer to social influence. I suggest that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by nonverbal signals. In this view, the effect of emotional processes on communication serve to change the quality of social signals to make them more efficient at producing responses in perceivers, whereas symbolic components increase the signals’ efficiency at interacting with the cognitive processes dedicated to the assessment of relevance. The interaction between symbolic and emotional components will be discussed in relation to the need for perceivers to evaluate the reliability of multimodal signals.

The integration of emotional and symbolic components in multimodal communication

Science.gov (United States)

Mehu, Marc

2015-01-01

Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g., verbal and denotative signals) are well suited to transfer conceptual information, emotional components (e.g., non-verbal signals that are difficult to manipulate voluntarily) likely take a function that is closer to social influence. I suggest that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by non-verbal signals. In this view, the effect of emotional processes on communication serve to change the quality of social signals to make them more efficient at producing responses in perceivers, whereas symbolic components increase the signals’ efficiency at interacting with the cognitive processes dedicated to the assessment of relevance. The interaction between symbolic and emotional components will be discussed in relation to the need for perceivers to evaluate the reliability of multimodal signals. PMID:26217280

Comprehensive Evaluation and Analysis of China's Mainstream Online Map Service Websites

Science.gov (United States)

Zhang, H.; Jiang, J.; Huang, W.; Wang, Q.; Gu, X.

2012-08-01

With the flourish development of China's Internet market, all kinds of users for map service demand is rising continually, within it contains tremendous commercial interests. Many internet giants have got involved in the field of online map service, and defined it as an important strategic product of the company. The main purpose of this research is to evaluate these online map service websites comprehensively with a model, and analyse the problems according to the evaluation results. Then some corresponding solving measures are proposed, which provides a theoretical and application guidance for the future development of fiercely competitive online map websites. The research consists of three stages: (a) the mainstream online map service websites in China are introduced and the present situation of them is analysed through visit, investigation, consultant, analysis and research. (b) a whole comprehensive evaluation quota system of online map service websites from the view of functions, layout, interaction design color position and so on, combining with the data indexes such as time efficiency, accuracy, objectivity and authority. (c) a comprehensive evaluation to these online map service websites is proceeded based on the fuzzy evaluation mathematical model, and the difficulty that measure the map websites quantitatively is solved.

Scenemash: multimodal route summarization for city exploration

NARCIS (Netherlands)

Berg, J. van den; Rudinac, S.; Worring, M.

2016-01-01

The potential of mining tourist information from social multimedia data gives rise to new applications offering much richer impressions of the city. In this paper we propose Scenemash, a system that generates multimodal summaries of multiple alternative routes between locations in a city. To get

An agent-based architecture for multimodal interaction

NARCIS (Netherlands)

Jonker, C.M.; Treur, J.; Wijngaards, W.C.A.

In this paper, an executable generic process model is proposed for combined verbal and non-verbal communication processes and their interaction. The agent-based architecture can be used to create multimodal interaction. The generic process model has been designed, implemented and used to simulate

An agent-based architecture for multimodal interaction

NARCIS (Netherlands)

Jonker, C.M.; Treur, J.; Wijngaards, W.C.A.

2001-01-01

In this paper, an executable generic process model is proposed for combined verbal and non-verbal communication processes and their interaction. The agent-based architecture can be used to create multimodal interaction. The generic process model has been designed, implemented and used to simulate

Academic Knowledge Construction and Multimodal Curriculum Development

Science.gov (United States)

Loveless, Douglas J., Ed.; Griffith, Bryant, Ed.; Bérci, Margaret E., Ed.; Ortlieb, Evan, Ed.; Sullivan, Pamela, Ed.

2014-01-01

While incorporating digital technologies into the classroom has offered new ways of teaching and learning into educational processes, it is essential to take a look at how the digital shift impacts teachers, school administration, and curriculum development. "Academic Knowledge Construction and Multimodal Curriculum Development" presents…

User habits and multimodal route planning

Directory of Open Access Journals (Sweden)

Géza Katona

2017-10-01

Full Text Available The results of route planning researches are monitored by logistic and automotive industries. The economic aspects of the cost saving are in the focus of the attention. An optimal route could cause time or fuel savings. An effective driving or an optimal route is a good basis to achieve an economical aim. Moreover the spread of new automotive solutions especially in case of electric cars the optimisation has particular significance regarding the limited battery storage. Additionally the autonomous car development could not be neglected. As a result the society could expect safer roads, better space usage and effective resource management. Nevertheless the requirements of users are extremely diverse, which is not negligible. Supporting these aims, in this paper the connection between the multimodal route planning and the user requirements are investigated. The examination is focused to a sensitivity analysis and a survey to evaluate the data and support the settings of a user habit effect to the final route.

SBS management in Yb-fiber-amplifiers using multimode seeds and pulse-shaping

International Nuclear Information System (INIS)

Jolly, Alain; Fikri Serdar Gokhan; Bello, Ramatou; Dupriez, Pascal

2014-01-01

We present a comprehensive analysis of the technique of Longitudinal-Mode-Filling (LMF) to reduce Stimulated Brillouin Scattering (SBS) limitations in Ytterbium Doped Fibre Amplifiers (YDFA), for the generation of nanosecond, temporally shaped pulses. A basic Master-Oscillator-Power-Amplifier (MOPA) system, comprising an output YDFA with 10 μm-core active fibre, is experienced for benchmarking purposes. Input pulse-shaping is operated thanks to direct current modulation in highly multimode laser-diode seeds, either based on the use of Distributed Feed-Back (DFB) or of a Fibre Bragg Grating (FBG). These seeds enable wavelength control. We verify the effectiveness of the combination of LMF, with appropriate mode spacing, in combination with natural chirp effects from the seed to control the SBS threshold in a broad range of output energies, from a few to some tens of μJ. These variations are discussed versus all the parameters of the laser system. In accordance with the proposal of a couple of basic principles and with the addition of gain saturation effects along the active fibre, we develop a full-vectorial numerical model. Fine fits between experimental results and theoretical expectations are demonstrated. The only limitation of the technique arises from broadband beating noise, which is analysed thanks to a simplified, but fully representative description to discuss the signal-to-noise ratio of the amplified pulses. This provides efficient tools for application to the design of robust and cost-effective MOPAs, aiming to the generation of finely shaped and energetic nanosecond pulses without the need for any additional electro-optics. (authors)

Multimodality localization of epileptic foci

Science.gov (United States)

Desco, Manuel; Pascau, Javier; Pozo, M. A.; Santos, Andres; Reig, Santiago; Gispert, Juan D.; Garcia-Barreno, Pedro

2001-05-01

This paper presents a multimodality approach for the localization of epileptic foci using PET, MRI and EEG combined without the need of external markers. Mutual Information algorithm is used for MRI-PET registration. Dipole coordinates (provided by BESA software) are projected onto the MRI using a specifically developed algorithm. The four anatomical references used for electrode positioning (nasion, inion and two preauricular points) are located on the MRI using a triplanar viewer combined with a surface-rendering tool. Geometric transformation using deformation of the ideal sphere used for dipole calculations is then applied to match the patient's brain size and shape. Eight treatment-refractory epileptic patients have been studied. The combination of the anatomical information from the MRI, hipoperfusion areas in PET and dipole position and orientation helped the physician in the diagnosis of epileptic focus location. Neurosurgery was not indicated for patients where PET and dipole results were inconsistent; in two cases it was clinically indicated despite the mismatch, showing a negative follow up. The multimodality approach presented does not require external markers for dipole projection onto the MRI, this being the main difference with previous methods. The proposed method may play an important role in the indication of surgery for treatment- refractory epileptic patients.

Multimodal transport and TransLoad facilities in Arkansas.

Science.gov (United States)

2015-01-01

National Priorities consist of building a clean and ecient 21st century : transportation sector, and Multimodal Transportation is one of ve : Transportation System Eciency strategies at the US Department of Energy. Six : locomotives co...

A Multimodal Communication Aid for Global Aphasia Patients

DEFF Research Database (Denmark)

Pedersen, Jakob Schou; Dalsgaard, Paul; Lindberg, Børge

2004-01-01

This paper presents the basic rationale behind the development and testing of a multimodal communication aid especially designed for people suffering from global aphasia, and thus having severe expressive difficulties. The principle of the aid is to trigger patient associations by presenting...... various multimodal representations of communicative expressions. The aid can in this way be seen as a conceptual continuation of previous research within the field of communication aids based on uni-modal (pictorial) representations of communicative expressions. As patients suffering from global aphasia...... expressions can be used to support patients with global aphasia in communicating by means of short sentences with their surroundings. Only a limited evaluation is carried out, and as such no statistically significant results are obtained. The tests however indicate that the aid is capable of supporting...

Alcohol sensor based on single-mode-multimode-single-mode fiber structure

Science.gov (United States)

Mefina Yulias, R.; Hatta, A. M.; Sekartedjo, Sekartedjo

2016-11-01

Alcohol sensor based on Single-mode -Multimode-Single-mode (SMS) fiber structure is being proposed to sense alcohol concentration in alcohol-water mixtures. This proposed sensor uses refractive index sensing as its sensing principle. Fabricated SMS fiber structure had 40 m of multimode length. With power input -6 dBm and wavelength 1550 nm, the proposed sensor showed good response with sensitivity 1,983 dB per % v/v with measurement range 05 % v/v and measurement span 0,5% v/v.

The role of radiation therapy in multimodality treatment for renal-cell cancer

International Nuclear Information System (INIS)

Semikoz, N.G.; Kudryashov, O.G.; Ponomar'ov, V.V.; Osipenkov, R.A.; Anyishchenko, A.O.; Kudryashova, S.M.

2011-01-01

The authors report the results of multimodality treatment for renal-cell cancer (pT any, N any, M0) using pre- operative large-fraction irradiation. Our findings demonstrate that radiation therapy does not aggravate the conditions for surgery and improves long-term results. The data about efficacy of multimodality treatment (palliative nephrectomy with radiation therapy) in patients with primary metastatic kidney cancer T any, N any, M1) are also reported.

Multimodal biometric method that combines veins, prints, and shape of a finger

Science.gov (United States)

Kang, Byung Jun; Park, Kang Ryoung; Yoo, Jang-Hee; Kim, Jeong Nyeo

2011-01-01

Multimodal biometrics provides high recognition accuracy and population coverage by using various biometric features. A single finger contains finger veins, fingerprints, and finger geometry features; by using multimodal biometrics, information on these multiple features can be simultaneously obtained in a short time and their fusion can outperform the use of a single feature. This paper proposes a new finger recognition method based on the score-level fusion of finger veins, fingerprints, and finger geometry features. This research is novel in the following four ways. First, the performances of the finger-vein and fingerprint recognition are improved by using a method based on a local derivative pattern. Second, the accuracy of the finger geometry recognition is greatly increased by combining a Fourier descriptor with principal component analysis. Third, a fuzzy score normalization method is introduced; its performance is better than the conventional Z-score normalization method. Fourth, finger-vein, fingerprint, and finger geometry recognitions are combined by using three support vector machines and a weighted SUM rule. Experimental results showed that the equal error rate of the proposed method was 0.254%, which was lower than those of the other methods.

MINERVA: A multi-modality plug-in-based radiation therapy treatment planning system

International Nuclear Information System (INIS)

Wemple, C. A.; Wessol, D. E.; Nigg, D. W.; Cogliati, J. J.; Milvich, M.; Fredrickson, C. M.; Perkins, M.; Harkin, G. J.; Hartmann-Siantar, C. L.; Lehmann, J.; Flickinger, T.; Pletcher, D.; Yuan, A.; DeNardo, G. L.

2005-01-01

Researchers at the INEEL, MSU, LLNL and UCD have undertaken development of MINERVA, a patient-centric, multi-modal, radiation treatment planning system, which can be used for planning and analysing several radiotherapy modalities, either singly or combined, using common treatment planning tools. It employs an integrated, lightweight plug-in architecture to accommodate multi-modal treatment planning using standard interface components. The design also facilitates the future integration of improved planning technologies. The code is being developed with the Java programming language for inter-operability. The MINERVA design includes the image processing, model definition and data analysis modules with a central module to coordinate communication and data transfer. Dose calculation is performed by source and transport plug-in modules, which communicate either directly through the database or through MINERVA's openly published, extensible markup language (XML)-based application programmer's interface (API). All internal data are managed by a database management system and can be exported to other applications or new installations through the API data formats. A full computation path has been established for molecular-targeted radiotherapy treatment planning, with additional treatment modalities presently under development. (authors)

Squeezing in multi-mode nonlinear optical state truncation

International Nuclear Information System (INIS)

Said, R.S.; Wahiddin, M.R.B.; Umarov, B.A.

2007-01-01

In this Letter, we show that multi-mode qubit states produced via nonlinear optical state truncation driven by classical external pumpings exhibit squeezing condition. We restrict our discussions to the two- and three-mode cases

Effects of a novel multimodal group intervention on myocardial perfusion in patients with coronary heart disease (CHD)

International Nuclear Information System (INIS)

Theissen, P.; Schicha, H.; Albus, C.; Koehle, K.; Griebenow, R.; Son, P.

2002-01-01

Full text: Recently, it could be shown that a multimodal intervention can promote health behavior in patients with CHD. Purpose of the actual study was to evaluate the effects on somatic endpoints, e.g. myocardial perfusion. We randomly assigned 77 patients (age 54 ± 6.9 y, male 87 %) with angiographically documented CHD to a multimodal group intervention plus standardized cardiological care (INT n=39) or standardized cardiological care only (CO n = 38). The intervention, for out-patients only, consisted of 77.5 hours of group-psychotherapy, relaxation and exercise training, and teaching lessons for one year. A Thallium myocardial perfusion scintigraphy (MyoSc) (after bicycle exercise test and at rest; 70 - 110 MBq Thallium-201, SPECT-technique, quantitative wash-out (w.-o.) analysis derived from polar maps) was performed at baseline, after 2 years, and 3 years, respectively: A w.-o. increase res. decrease by 5 % or more indicated an improved / a diminished myocardial perfusion within the affected coronary artery territory. Results were analyzed on an intention to treat basis. 70/77 patients (91 %) completed the study (drop-outs CO n=4, INT n=3). After 2 years (1st interval), there was no significant difference between groups. After 3 years (2nd interval) 36/39 patients (92.3 %) of INT showed a stable or improved myocardial perfusion, compared to 18/38 patients (47.4 %) of CO (p= 0.008). The recent data analysis demonstrates the extra benefit of a multimodal intervention, compared to standardized cardiological care alone, on myocardial perfusion in CHD patients. (author)

Workflow optimisation for multimodal imaging procedures: a case of combined X-ray and MRI-guided TACE.

Science.gov (United States)

Fernández-Gutiérrez, Fabiola; Wolska-Krawczyk, Malgorzata; Buecker, Arno; Houston, J Graeme; Melzer, Andreas

2017-02-01

This study presents a framework for workflow optimisation of multimodal image-guided procedures (MIGP) based on discrete event simulation (DES). A case of a combined X-Ray and magnetic resonance image-guided transarterial chemoembolisation (TACE) is presented to illustrate the application of this method. We used a ranking and selection optimisation algorithm to measure the performance of a number of proposed alternatives to improve a current scenario. A DES model was implemented with detail data collected from 59 TACE procedures and durations of magnetic resonance imaging (MRI) diagnostic procedures usually performed in a common MRI suite. Fourteen alternatives were proposed and assessed to minimise the waiting times and improve workflow. Data analysis observed an average of 20.68 (7.68) min of waiting between angiography and MRI for TACE patients in 71.19% of the cases. Following the optimisation analysis, an alternative was identified to reduce waiting times in angiography suite up to 48.74%. The model helped to understand and detect 'bottlenecks' during multimodal TACE procedures, identifying a better alternative to the current workflow and reducing waiting times. Simulation-based workflow analysis provides a cost-effective way to face some of the challenges of introducing MIGP in clinical radiology, highligthed in this study.

Magnetic Iron Oxide Nanoparticles for Multimodal Imaging and Therapy of Cancer

Directory of Open Access Journals (Sweden)

In-Kyu Park

2013-07-01

Full Text Available Superparamagnetic iron oxide nanoparticles (SPION have emerged as an MRI contrast agent for tumor imaging due to their efficacy and safety. Their utility has been proven in clinical applications with a series of marketed SPION-based contrast agents. Extensive research has been performed to study various strategies that could improve SPION by tailoring the surface chemistry and by applying additional therapeutic functionality. Research into the dual-modal contrast uses of SPION has developed because these applications can save time and effort by reducing the number of imaging sessions. In addition to multimodal strategies, efforts have been made to develop multifunctional nanoparticles that carry both diagnostic and therapeutic cargos specifically for cancer. This review provides an overview of recent advances in multimodality imaging agents and focuses on iron oxide based nanoparticles and their theranostic applications for cancer. Furthermore, we discuss the physiochemical properties and compare different synthesis methods of SPION for the development of multimodal contrast agents.

Co-constructing referential space in multimodal narratives

NARCIS (Netherlands)

Stec, Kashmiri; Huiskes, Mike

Meaning-making is a situated, multimodal process. Although most research has focused on conceptualization in individuals, recent work points to the way dynamic processes can affect both conceptualization and expression in multiple individuals (e.g. Özyürek 2002; Fusaroli and Tylén 2012; Narayan

Multimodal Dialogue Management - State of the art

NARCIS (Netherlands)

Bui Huu Trung, B.H.T.

This report is about the state of the art in dialogue management. We first introduce an overview of a multimodal dialogue system and its components. Second, four main approaches to dialogue management are described (finite-state and frame-based, information-state based and probabilistic, plan-based,

Multimodal Student Interaction Online: An Ecological Perspective

Science.gov (United States)

Berglund, Therese Ornberg

2009-01-01

This article describes the influence of tool and task design on student interaction in language learning at a distance. Interaction in a multimodal desktop video conferencing environment, FlashMeeting, is analyzed from an ecological perspective with two main foci: participation rates and conversational feedback strategies. The quantitative…

Detection of elemental mercury by multimode diode laser correlation spectroscopy.

Science.gov (United States)

Lou, Xiutao; Somesfalean, Gabriel; Svanberg, Sune; Zhang, Zhiguo; Wu, Shaohua

2012-02-27

We demonstrate a method for elemental mercury detection based on correlation spectroscopy employing UV laser radiation generated by sum-frequency mixing of two visible multimode diode lasers. Resonance matching of the multimode UV laser is achieved in a wide wavelength range and with good tolerance for various operating conditions. Large mode-hops provide an off-resonance baseline, eliminating interferences from other gas species with broadband absorption. A sensitivity of 1 μg/m3 is obtained for a 1-m path length and 30-s integration time. The performance of the system shows promise for mercury monitoring in industrial applications.

Multimodal and ubiquitous computing systems: supporting independent-living older users.

Science.gov (United States)

Perry, Mark; Dowdall, Alan; Lines, Lorna; Hone, Kate

2004-09-01

We document the rationale and design of a multimodal interface to a pervasive/ubiquitous computing system that supports independent living by older people in their own homes. The Millennium Home system involves fitting a resident's home with sensors--these sensors can be used to trigger sequences of interaction with the resident to warn them about dangerous events, or to check if they need external help. We draw lessons from the design process and conclude the paper with implications for the design of multimodal interfaces to ubiquitous systems developed for the elderly and in healthcare, as well as for more general ubiquitous computing applications.

Generalized uncertainty relations and characteristic invariants for the multimode states

International Nuclear Information System (INIS)

Sudarshan, E.C.G.; Chiu, C.B.; Bhamathi, G.

1995-01-01

The close relationship between the zero-point energy, the uncertainty relation, coherent states, squeezed states, and correlated states for one mode is investigated. This group theoretic perspective of the problem enables the parametrization and identification of their multimode generalization. A simple and efficient method of determining the canonical structure of the generalized correlated states is presented. Implication of canonical commutation relations for correlations are not exhausted by the Heisenberg uncertainty relation, not even by the Schroedinger-Robertson uncertainty inequality, but there are relations in the multimode case that are the generalization of the Schroedinger-Robertson relation

Multimodal location estimation of videos and images

CERN Document Server

Friedland, Gerald

2015-01-01

This book presents an overview of the field of multimodal location estimation, i.e. using acoustic, visual, and/or textual cues to estimate the shown location of a video recording. The authors' sample research results in this field in a unified way integrating research work on this topic that focuses on different modalities, viewpoints, and applications. The book describes fundamental methods of acoustic, visual, textual, social graph, and metadata processing as well as multimodal integration methods used for location estimation. In addition, the text covers benchmark metrics and explores the limits of the technology based on a human baseline. ·         Discusses localization of multimedia data; ·         Examines fundamental methods of establishing location metadata for images and videos (other than GPS tagging); ·         Covers Data-Driven as well as Semantic Location Estimation.

Multi-Modal Traveler Information System - Gateway Functional Requirements

Science.gov (United States)

1997-11-17

The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

Context-Aware Multimodal FIDO Authenticator for Sustainable IT Services

Directory of Open Access Journals (Sweden)

Seung-Hyun Kim

2018-05-01

Full Text Available Existing sustainable IT services have several problems related to user authentication such as the inefficiency of managing the system security, low security, and low usability. In this paper, we propose a Fast IDentity Online (FIDO authenticator that performs continuous authentication with implicit authentication based on user context and multimodal authentication. The proposed FIDO authenticator, a context-aware multimodal FIDO authentication (CAMFA method, combines information such as the user context, state of the mobile device, and user biometrics, then applies implicit and explicit authentication methods to meet the level of authentication required by the service provider. This reduces the user’s explicit authentication burden and continually authenticates users at risk during the session. Moreover, it is able to respond to attacks such as the theft of the authentication method or session hijacking. To study the effectiveness of CAMFA, we ran a user study by collecting data from 22 participants over 42 days of activity on a practical Android platform. The result of the user study demonstrates that the number of explicit authentication requests could be reduced by half. Based on the results of this study, an advanced user authentication that provides multimodal and continuous authentication could be applied to sustainable IT services.

An Efficient Human Identification through MultiModal Biometric System

Directory of Open Access Journals (Sweden)

K. Meena

Full Text Available ABSTRACT Human identification is essential for proper functioning of society. Human identification through multimodal biometrics is becoming an emerging trend, and one of the reasons is to improve recognition accuracy. Unimodal biometric systems are affected by various problemssuch as noisy sensor data,non-universality, lack of individuality, lack of invariant representation and susceptibility to circumvention.A unimodal system has limited accuracy. Hence, Multimodal biometric systems by combining more than one biometric feature in different levels are proposed in order to enhance the performance of the system. A supervisor module combines the different opinions or decisions delivered by each subsystem and then make a final decision. In this paper, a multimodal biometrics authentication is proposed by combining face, iris and finger features. Biometric features are extracted by Local Derivative Ternary Pattern (LDTP in Contourlet domain and an extensive evaluation of LDTP is done using Support Vector Machine and Nearest Neighborhood Classifier. The experimental evaluations are performed on a public dataset demonstrating the accuracy of the proposed system compared with the existing systems. It is observed that, the combination of face, fingerprint and iris gives better performance in terms of accuracy, False Acceptance Rate, False Rejection Rate with minimum computation time.

Effects of Multimodal Analgesia on the Success of Mouse Embryo Transfer Surgery

Science.gov (United States)

Parker, John M.; Austin, Jamie; Wilkerson, James; Carbone, Larry

2011-01-01

Multimodal analgesia is promoted as the best practice pain management for invasive animal research procedures. Universal acceptance and incorporation of multimodal analgesia requires assessing potential effects on study outcome. The focus of this study was to assess effects on embryo survival after multimodal analgesia comprising an opioid and nonsteroidal antiinflammatory drug (NSAID) compared with opioid-only analgesia during embryo transfer procedures in transgenic mouse production. Mice were assigned to receive either carprofen (5 mg/kg) with buprenorphine (0.1 mg/kg; CB) or vehicle with buprenorphine (0.1 mg/kg; VB) in a prospective, double-blinded placebo controlled clinical trial. Data were analyzed in surgical sets of 1 to 3 female mice receiving embryos chimeric for a shared targeted embryonic stem-cell clone and host blastocyst cells. A total of 99 surgical sets were analyzed, comprising 199 Crl:CD1 female mice and their 996 offspring. Neither yield (pups weaned per embryo implanted in the surgical set) nor birth rate (average number of pups weaned per dam in the set) differed significantly between the CB and VB conditions. Multimodal opioid–NSAID analgesia appears to have no significant positive or negative effect on the success of producing novel lines of transgenic mice by blastocyst transfer. PMID:21838973

Advanced driver assistance systems: Using multimodal redundant warnings to enhance road safety.

Science.gov (United States)

Biondi, Francesco; Strayer, David L; Rossi, Riccardo; Gastaldi, Massimiliano; Mulatti, Claudio

2017-01-01

This study investigated whether multimodal redundant warnings presented by advanced assistance systems reduce brake response times. Warnings presented by assistance systems are designed to assist drivers by informing them that evasive driving maneuvers are needed in order to avoid a potential accident. If these warnings are poorly designed, they may distract drivers, slow their responses, and reduce road safety. In two experiments, participants drove a simulated vehicle equipped with a forward collision avoidance system. Auditory, vibrotactile, and multimodal warnings were presented when the time to collision was shorter than five seconds. The effects of these warnings were investigated with participants performing a concurrent cell phone conversation (Exp. 1) or driving in high-density traffic (Exp. 2). Braking times and subjective workload were measured. Multimodal redundant warnings elicited faster braking reaction times. These warnings were found to be effective even when talking on a cell phone (Exp. 1) or driving in dense traffic (Exp. 2). Multimodal warnings produced higher ratings of urgency, but ratings of frustration did not increase compared to other warnings. Findings obtained in these two experiments are important given that faster braking responses may reduce the potential for a collision. Copyright © 2016 Elsevier Ltd. All rights reserved.

Water-stable NaLuF4-based upconversion nanophosphors with long-term validity for multimodal lymphatic imaging.

Science.gov (United States)

Zhou, Jing; Zhu, Xingjun; Chen, Min; Sun, Yun; Li, Fuyou

2012-09-01

Multimodal imaging is rapidly becoming an important tool for biomedical applications because it can compensate for the deficiencies of individual imaging modalities. Herein, multifunctional NaLuF(4)-based upconversion nanoparticles (Lu-UCNPs) were synthesized though a facile one-step microemulsion method under ambient condition. The doping of lanthanide ions (Gd(3+), Yb(3+) and Er(3+)/Tm(3+)) endows the Lu-UCNPs with high T(1)-enhancement, bright upconversion luminescence (UCL) emissions, and excellent X-ray absorption coefficient. Moreover, the as-prepared Lu-UCNPs are stable in water for more than six months, due to the protection of sodium glutamate and diethylene triamine pentacetate acid (DTPA) coordinating ligands on the surface. Lu-UCNPs have been successfully applied to the trimodal CT/MR/UCL lymphatic imaging on the modal of small animals. It is worth noting that Lu-UCNPs could be used for imaging even after preserving for over six months. In vitro transmission electron microscope (TEM), methyl thiazolyl tetrazolium (MTT) assay and histological analysis demonstrated that Lu-UCNPs exhibited low toxicity on living systems. Therefore, Lu-UCNPs could be multimodal agents for CT/MR/UCL imaging, and the concept can be served as a platform technology for the next-generation of probes for multimodal imaging. Copyright © 2012 Elsevier Ltd. All rights reserved.

A 10-Week Multimodal Nutrition Education Intervention Improves Dietary Intake among University Students: Cluster Randomised Controlled Trial

Directory of Open Access Journals (Sweden)

Mohd Razif Shahril

2013-01-01

Full Text Available The aim of the study was to evaluate the effectiveness of implementing multimodal nutrition education intervention (NEI to improve dietary intake among university students. The design of study used was cluster randomised controlled design at four public universities in East Coast of Malaysia. A total of 417 university students participated in the study. They were randomly selected and assigned into two arms, that is, intervention group (IG or control group (CG according to their cluster. The IG received 10-week multimodal intervention using three modes (conventional lecture, brochures, and text messages while CG did not receive any intervention. Dietary intake was assessed before and after intervention and outcomes reported as nutrient intakes as well as average daily servings of food intake. Analysis of covariance (ANCOVA and adjusted effect size were used to determine difference in dietary changes between groups and time. Results showed that, compared to CG, participants in IG significantly improved their dietary intake by increasing their energy intake, carbohydrate, calcium, vitamin C and thiamine, fruits and 100% fruit juice, fish, egg, milk, and dairy products while at the same time significantly decreased their processed food intake. In conclusion, multimodal NEI focusing on healthy eating promotion is an effective approach to improve dietary intakes among university students.

Gas detection by correlation spectroscopy employing a multimode diode laser.

Science.gov (United States)

Lou, Xiutao; Somesfalean, Gabriel; Zhang, Zhiguo

2008-05-01

A gas sensor based on the gas-correlation technique has been developed using a multimode diode laser (MDL) in a dual-beam detection scheme. Measurement of CO(2) mixed with CO as an interfering gas is successfully demonstrated using a 1570 nm tunable MDL. Despite overlapping absorption spectra and occasional mode hops, the interfering signals can be effectively excluded by a statistical procedure including correlation analysis and outlier identification. The gas concentration is retrieved from several pair-correlated signals by a linear-regression scheme, yielding a reliable and accurate measurement. This demonstrates the utility of the unsophisticated MDLs as novel light sources for gas detection applications.

Modal noise impact in radio over fiber multimode fiber links.

Science.gov (United States)

Gasulla, I; Capmany, J

2008-01-07

A novel analysis is given on the statistics of modal noise for a graded-index multimode fiber (MMF) link excited by an analog intensity modulated laser diode. We present the speckle contrast as a function of the power spectrum of the modulated source and the transfer function of the MMF which behaves as an imperfect transversal microwave photonic filter. The theoretical results confirm that the modal noise is directly connected with the coherence properties of the optical source and show that the performance of high-frequency Radio Over Fiber (ROF) transmission through MMF links for short and middle reach distances is not substantially degraded by modal noise.

Analyse Factorielle d'une Batterie de Tests de Comprehension Orale et Ecrite (Factor Analysis of a Battery of Tests of Listening and Reading Comprehension). Melanges Pedagogiques, 1971.

Science.gov (United States)

Lonchamp, F.

This is a presentation of the results of a factor analysis of a battery of tests intended to measure listening and reading comprehension in English as a second language. The analysis sought to answer the following questions: (1) whether the factor analysis method yields results when applied to tests which are not specifically designed for this…

Multi-modal MRI analysis with disease-specific spatial filtering: initial testing to predict mild cognitive impairment patients who convert to Alzheimer’s disease

Directory of Open Access Journals (Sweden)

Kenichi eOishi

2011-08-01

Full Text Available Background: Alterations of the gray and white matter have been identified in Alzheimer’s disease (AD by structural MRI and diffusion tensor imaging (DTI. However, whether the combination of these modalities could increase the diagnostic performance is unknown.Methods: Participants included 19 AD patients, 22 amnestic mild cognitive impairment (aMCI patients, and 22 cognitively normal elderly (NC. The aMCI group was further divided into an aMCI-converter group (converted to AD dementia within three years, and an aMCI-stable group who did not convert in this time period. A T1-weighted image, a T2 map, and a DTI of each participant were normalized, and voxel-based comparisons between AD and NC groups were performed. Regions-of-interest, which defined the areas with significant differences between AD and NC, were created for each modality and named disease-specific spatial filters (DSF. Linear discriminant analysis was used to optimize the combination of multiple MRI measurements extracted by DSF to effectively differentiate AD from NC. The resultant DSF and the discriminant function were applied to the aMCI group to investigate the power to differentiate the aMCI-converters from the aMCI-stable patients. Results: The multi-modal approach with AD-specific filters led to a predictive model with an area under the receiver operating characteristic curve (AUC of 0.93, in differentiating aMCI-converters from aMCI-stable patients. This AUC was better than that of a single-contrast-based approach, such as T1-based morphometry or diffusion anisotropy analysis. Conclusion: The multi-modal approach has the potential to increase the value of MRI in predicting conversion from aMCI to AD.

Influence of Blood Contamination During Multimode Adhesive ...

African Journals Online (AJOL)

Objectives: The present study evaluated the effects of blood contamination performed at different steps of bonding on the microtensile bond strength (μTBS) of multimode adhesives to dentin when using the self-etch approach. Materials and Methods: Seventy-five molars were randomly assigned to three adhesive groups ...