Multiphoton microscopy: an efficient tool for in-situ study of cultural heritage artifacts

Science.gov (United States)

Latour, Gaël.; Echard, Jean-Philippe; Didier, Marie; Schanne-Klein, Marie-Claire

2013-05-01

We present multimodal nonlinear optical imaging of historical artifacts by combining Two-Photon Excited Fluorescence (2PEF) and Second Harmonic Generation (SHG) microscopies. Three-dimensional (3D) non-contact laser-scanning imaging with micrometer resolution is performed without any preparation of the objects under study. 2PEF signals are emitted by a wide range of fluorophores such as pigments and binder, which can be discriminated thanks to their different emission spectral bands by using suitable spectral filters in the detection channel. SHG signals are specific for dense non-centrosymmetric organizations such as the crystalline cellulose within the wood cell walls. We also show that plaster particles exhibit SHG signals. These particles are bassanite crystals with a non-centrosymmetric crystalline structure, while the other types of calcium sulphates exhibit a centrosymmetric crystalline structure with no SHG signal. In our study, we first characterize model single-layered samples: wood, gelatin-based films containing plaster or cochineal lake and sandarac film containing cochineal lake. We then study multilayered coating systems on wood and show that multimodal nonlinear microscopy successfully reveals the 3D distribution of all components within the stratified sample. We also show that the fine structure of the wood can be assessed, even through a thick multilayered varnish coating. Finally, in situ multimodal nonlinear imaging is demonstrated in a historical violin. SHG/2PEF imaging thus appears as an efficient non-destructive and contactless 3D imaging technique for in situ investigation of historical coatings and more generally for wood characterization and coating analysis at micrometer scale.

Proximal design for a multimodality endoscope with multiphoton microscopy, optical coherence microscopy and visual modalities

Science.gov (United States)

Kiekens, Kelli C.; Talarico, Olivia; Barton, Jennifer K.

2018-02-01

A multimodality endoscope system has been designed for early detection of ovarian cancer. Multiple illumination and detection systems must be integrated in a compact, stable, transportable configuration to meet the requirements of a clinical setting. The proximal configuration presented here supports visible light navigation with a large field of view and low resolution, high resolution multiphoton microscopy (MPM), and high resolution optical coherence microscopy (OCM). All modalities are integrated into a single optical system in the endoscope. The system requires two light sources: a green laser for visible light navigation and a compact fiber based femtosecond laser for MPM and OCM. Using an inline wavelength division multiplexer, the two sources are combined into a single mode fiber. To accomplish OCM, a fiber coupler is used to separate the femtosecond laser into a reference arm and signal arm. The reflected reference arm and the signal from the sample are interfered and wavelength separated by a reflection grating and detected using a linear array. The MPM signal is collimated and goes through a series of filters to separate the 2nd and 3rd harmonics as well as twophoton excitation florescence (2PEF) and 3PEF. Each signal is independently detected on a photo multiplier tube and amplified. The visible light is collected by multiple high numerical aperture fibers at the endoscope tip which are bundled into one SMA adapter at the proximal end and connected to a photodetector. This integrated system design is compact, efficient and meets both optical and mechanical requirements for clinical applications.

Group velocity measurement using spectral interference in near-field scanning optical microscopy

International Nuclear Information System (INIS)

Mills, John D.; Chaipiboonwong, Tipsuda; Brocklesby, William S.; Charlton, Martin D. B.; Netti, Caterina; Zoorob, Majd E.; Baumberg, Jeremy J.

2006-01-01

Near-field scanning optical microscopy provides a tool for studying the behavior of optical fields inside waveguides. In this experiment the authors measure directly the variation of group velocity between different modes of a planar slab waveguide as the modes propagate along the guide. The measurement is made using the spectral interference between pulses propagating inside the waveguide with different group velocities, collected using a near-field scanning optical microscope at different points down the guide and spectrally resolved. The results are compared to models of group velocities in simple guides

Coherent noise reduction in digital holographic microscopy by averaging multiple holograms recorded with a multimode laser.

Science.gov (United States)

Pan, Feng; Yang, Lizhi; Xiao, Wen

2017-09-04

In digital holographic microscopy (DHM), it is undesirable to observe coherent noise in the reconstructed images. The sources of the noise are mainly the parasitic interference fringes caused by multiple reflections and the speckle pattern caused by the optical scattering on the object surface. Here we propose a noise reduction approach in DHM by averaging multiple holograms recorded with a multimode laser. Based on the periodicity of the temporal coherence of a multimode semiconductor laser, we acquire a series of holograms by changing the optical path length difference between the reference beam and object beam. Because of the use of low coherence light, we can remove the parasitic interference fringes caused by multiple reflections in the holograms. In addition, the coherent noise patterns change in this process due to the different optical paths. Therefore, the coherent noise can be reduced by averaging the multiple reconstructions with uncorrelated noise patterns. Several experiments have been carried out to validate the effectiveness of the proposed approach for coherent noise reduction in DHM. It is shown a remarkable improvement both in amplitude imaging quality and phase measurement accuracy.

Multimodal quantitative phase and fluorescence imaging of cell apoptosis

Science.gov (United States)

Fu, Xinye; Zuo, Chao; Yan, Hao

2017-06-01

Fluorescence microscopy, utilizing fluorescence labeling, has the capability to observe intercellular changes which transmitted and reflected light microscopy techniques cannot resolve. However, the parts without fluorescence labeling are not imaged. Hence, the processes simultaneously happen in these parts cannot be revealed. Meanwhile, fluorescence imaging is 2D imaging where information in the depth is missing. Therefore the information in labeling parts is also not complete. On the other hand, quantitative phase imaging is capable to image cells in 3D in real time through phase calculation. However, its resolution is limited by the optical diffraction and cannot observe intercellular changes below 200 nanometers. In this work, fluorescence imaging and quantitative phase imaging are combined to build a multimodal imaging system. Such system has the capability to simultaneously observe the detailed intercellular phenomenon and 3D cell morphology. In this study the proposed multimodal imaging system is used to observe the cell behavior in the cell apoptosis. The aim is to highlight the limitations of fluorescence microscopy and to point out the advantages of multimodal quantitative phase and fluorescence imaging. The proposed multimodal quantitative phase imaging could be further applied in cell related biomedical research, such as tumor.

Discrimination of skin diseases using the multimodal imaging approach

Science.gov (United States)

Vogler, N.; Heuke, S.; Akimov, D.; Latka, I.; Kluschke, F.; Röwert-Huber, H.-J.; Lademann, J.; Dietzek, B.; Popp, J.

2012-06-01

Optical microspectroscopic tools reveal great potential for dermatologic diagnostics in the clinical day-to-day routine. To enhance the diagnostic value of individual nonlinear optical imaging modalities such as coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG) or two-photon excited fluorescence (TPF), the approach of multimodal imaging has recently been developed. Here, we present an application of nonlinear optical multimodal imaging with Raman-scattering microscopy to study sizable human-tissue cross-sections. The samples investigated contain both healthy tissue and various skin tumors. This contribution details the rich information content, which can be obtained from the multimodal approach: While CARS microscopy, which - in contrast to spontaneous Raman-scattering microscopy - is not hampered by single-photon excited fluorescence, is used to monitor the lipid and protein distribution in the samples, SHG imaging selectively highlights the distribution of collagen structures within the tissue. This is due to the fact, that SHG is only generated in structures which lack inversion geometry. Finally, TPF reveals the distribution of autofluorophores in tissue. The combination of these techniques, i.e. multimodal imaging, allows for recording chemical images of large area samples and is - as this contribution will highlight - of high clinically diagnostic value.

Spectrally Resolved and Functional Super-resolution Microscopy via Ultrahigh-Throughput Single-Molecule Spectroscopy.

Science.gov (United States)

Yan, Rui; Moon, Seonah; Kenny, Samuel J; Xu, Ke

2018-03-20

As an elegant integration of the spatial and temporal dimensions of single-molecule fluorescence, single-molecule localization microscopy (SMLM) overcomes the diffraction-limited resolution barrier of optical microscopy by localizing single molecules that stochastically switch between fluorescent and dark states over time. While this type of super-resolution microscopy (SRM) technique readily achieves remarkable spatial resolutions of ∼10 nm, it typically provides no spectral information. Meanwhile, current scanning-based single-location approaches for mapping the positions and spectra of single molecules are limited by low throughput and are difficult to apply to densely labeled (bio)samples. In this Account, we summarize the rationale, design, and results of our recent efforts toward the integration of the spectral dimension of single-molecule fluorescence with SMLM to achieve spectrally resolved SMLM (SR-SMLM) and functional SRM ( f-SRM). By developing a wide-field scheme for spectral measurement and implementing single-molecule fluorescence on-off switching typical of SMLM, we first showed that in densely labeled (bio)samples it is possible to record the fluorescence spectra and positions of millions of single molecules synchronously within minutes, giving rise to ultrahigh-throughput single-molecule spectroscopy and SR-SMLM. This allowed us to first show statistically that for many dyes, single molecules of the same species exhibit near identical emission in fixed cells. This narrow distribution of emission wavelengths, which contrasts markedly with previous results at solid surfaces, allowed us to unambiguously identify single molecules of spectrally similar dyes. Crosstalk-free, multiplexed SRM was thus achieved for four dyes that were merely 10 nm apart in emission spectrum, with the three-dimensional SRM images of all four dyes being automatically aligned within one image channel. The ability to incorporate single-molecule fluorescence measurement with

3D imaging of intrinsic crystalline defects in zinc oxide by spectrally resolved two-photon fluorescence microscopy

Science.gov (United States)

Al-Tabich, A.; Inami, W.; Kawata, Y.; Jablonski, R.; Worasawat, S.; Mimura, H.

2017-05-01

We present a method for three-dimensional intrinsic defect imaging in zinc oxide (ZnO) by spectrally resolved two-photon fluorescence microscopy, based on the previously presented method of observing a photoluminescence distribution in wide-gap semiconductor crystals [Noor et al., Appl. Phys. Lett. 92(16), 161106 (2008)]. A tightly focused light beam radiated by a titanium-sapphire laser is used to obtain a two-photon excitation of selected area of the ZnO sample. Photoluminescence intensity of a specific spectral range is then selected by optical band pass filters and measured by a photomultiplier tube. Reconstruction of the specimen image is done by scanning the volume of interest by a piezoelectric positioning stage and measuring the spectrally resolved photoluminescence intensity at each point. The method has been proved to be effective at locating intrinsic defects of the ZnO crystalline structure in the volume of the crystal. The method was compared with other defect imaging and 3D imaging techniques like scanning tunneling microscopy and confocal microscopy. In both cases, our method shows superior penetration abilities and, as the only method, allows location of the defects of the chosen type in 3D. In this paper, we present the results of oxygen vacancies and zinc antisites imaging in ZnO nanorods.

Multimodal ophthalmic imaging using handheld spectrally encoded coherence tomography and reflectometry (SECTR)

Science.gov (United States)

Leeburg, Kelsey C.; El-Haddad, Mohamed T.; Malone, Joseph D.; Terrones, Benjamin D.; Tao, Yuankai K.

2018-02-01

Scanning laser ophthalmoscopy (SLO) provides high-speed, noninvasive en face imaging of the retinal fundus. Optical coherence tomography (OCT) is the current "gold-standard" for ophthalmic diagnostic imaging and enables depth-resolved visualization of ophthalmic structures and image-based surrogate biomarkers of disease. We present a compact optical and mechanical design for handheld spectrally encoded coherence tomography and reflectometry (SECTR) for multimodality en face spectrally encoded reflectometry (SER) and cross-sectional OCT imaging. We custom-designed a double-pass telecentric scan lens, which halves the size of 4-f optical relays and allowed us to reduce the footprint of our SECTR scan-head by a factor of >2.7x (volume) over our previous design. The double-pass scan lens was optimized for diffraction-limited performance over a +/-10° scan field. SECTR optics and optomechanics were combined in a compact rapid-prototyped enclosure with dimensions 87 x 141.8 x 137 mm (w x h x d). SECTR was implemented using a custom-built 400 kHz 1050 nm swept-source. OCT and SER were simultaneously digitized on dual input channels of a 4 GS/s digitizer at 1.4 GS/s per channel. In vivo human en face SER and cross-sectional OCT images were acquired at 350 fps. OCT volumes of 1000 B-scans were acquired in 2.86 s. We believe clinical translation of our compact handheld design will benefit point-of-care ophthalmic diagnostics in patients who are unable to be imaged on conventional slit-lamp based systems, such as infants and the bedridden. When combined with multi-volumetric registration methods, handheld SECTR will have advantages in motion-artifact free imaging over existing handheld technologies.

An approach to estimate spatial distribution of analyte within cells using spectrally-resolved fluorescence microscopy

Science.gov (United States)

Sharma, Dharmendar Kumar; Irfanullah, Mir; Basu, Santanu Kumar; Madhu, Sheri; De, Suman; Jadhav, Sameer; Ravikanth, Mangalampalli; Chowdhury, Arindam

2017-03-01

While fluorescence microscopy has become an essential tool amongst chemists and biologists for the detection of various analyte within cellular environments, non-uniform spatial distribution of sensors within cells often restricts extraction of reliable information on relative abundance of analytes in different subcellular regions. As an alternative to existing sensing methodologies such as ratiometric or FRET imaging, where relative proportion of analyte with respect to the sensor can be obtained within cells, we propose a methodology using spectrally-resolved fluorescence microscopy, via which both the relative abundance of sensor as well as their relative proportion with respect to the analyte can be simultaneously extracted for local subcellular regions. This method is exemplified using a BODIPY sensor, capable of detecting mercury ions within cellular environments, characterized by spectral blue-shift and concurrent enhancement of emission intensity. Spectral emission envelopes collected from sub-microscopic regions allowed us to compare the shift in transition energies as well as integrated emission intensities within various intracellular regions. Construction of a 2D scatter plot using spectral shifts and emission intensities, which depend on the relative amount of analyte with respect to sensor and the approximate local amounts of the probe, respectively, enabled qualitative extraction of relative abundance of analyte in various local regions within a single cell as well as amongst different cells. Although the comparisons remain semi-quantitative, this approach involving analysis of multiple spectral parameters opens up an alternative way to extract spatial distribution of analyte in heterogeneous systems. The proposed method would be especially relevant for fluorescent probes that undergo relatively nominal shift in transition energies compared to their emission bandwidths, which often restricts their usage for quantitative ratiometric imaging in

Systems and methods for selective detection and imaging in coherent Raman microscopy by spectral excitation shaping

Science.gov (United States)

Xie, Xiaoliang Sunney; Freudiger, Christian; Min, Wei

2016-03-15

A microscopy imaging system is disclosed that includes a light source system, a spectral shaper, a modulator system, an optics system, an optical detector and a processor. The light source system is for providing a first train of pulses and a second train of pulses. The spectral shaper is for spectrally modifying an optical property of at least some frequency components of the broadband range of frequency components such that the broadband range of frequency components is shaped producing a shaped first train of pulses to specifically probe a spectral feature of interest from a sample, and to reduce information from features that are not of interest from the sample. The modulator system is for modulating a property of at least one of the shaped first train of pulses and the second train of pulses at a modulation frequency. The optical detector is for detecting an integrated intensity of substantially all optical frequency components of a train of pulses of interest transmitted or reflected through the common focal volume. The processor is for detecting a modulation at the modulation frequency of the integrated intensity of substantially all of the optical frequency components of the train of pulses of interest due to the non-linear interaction of the shaped first train of pulses with the second train of pulses as modulated in the common focal volume, and for providing an output signal for a pixel of an image for the microscopy imaging system.

Multimode simulations of a wide field of view double-Fourier far-infrared spatio-spectral interferometer

Science.gov (United States)

Bracken, Colm P.; Lightfoot, John; O'Sullivan, Creidhe; Murphy, J. Anthony; Donohoe, Anthony; Savini, Giorgio; Juanola-Parramon, Roser; The Fisica Consortium, On Behalf Of

2018-01-01

In the absence of 50-m class space-based observatories, subarcsecond astronomy spanning the full far-infrared wavelength range will require space-based long-baseline interferometry. The long baselines of up to tens of meters are necessary to achieve subarcsecond resolution demanded by science goals. Also, practical observing times command a field of view toward an arcminute (1‧) or so, not achievable with a single on-axis coherent detector. This paper is concerned with an application of an end-to-end instrument simulator PyFIInS, developed as part of the FISICA project under funding from the European Commission's seventh Framework Programme for Research and Technological Development (FP7). Predicted results of wide field of view spatio-spectral interferometry through simulations of a long-baseline, double-Fourier, far-infrared interferometer concept are presented and analyzed. It is shown how such an interferometer, illuminated by a multimode detector can recover a large field of view at subarcsecond angular resolution, resulting in similar image quality as that achieved by illuminating the system with an array of coherent detectors. Through careful analysis, the importance of accounting for the correct number of higher-order optical modes is demonstrated, as well as accounting for both orthogonal polarizations. Given that it is very difficult to manufacture waveguide and feed structures at sub-mm wavelengths, the larger multimode design is recommended over the array of smaller single mode detectors. A brief note is provided in the conclusion of this paper addressing a more elegant solution to modeling far-infrared interferometers, which holds promise for improving the computational efficiency of the simulations presented here.

Hybrid of two-photon microscopy and optical multimodality imaging for multi-scale imaging of small animals

Science.gov (United States)

Li, Tianmeng; Hui, Hui; Ma, He; Yang, Xin; Tian, Jie

2018-02-01

Non-invasive imaging technologies, such as magnetic resonance imaging (MRI) and optical multimodality imaging methods, are commonly used for diagnosing and supervising the development of inflammatory bowel disease (IBD). These in vivo imaging methods can provide morphology changes information of IBD in macro-scale. However, it is difficult to investigate the intestinal wall in molecular and cellular level. State-of-art light-sheet and two-photon microscopy have the ability to acquire the changes for IBD in micro-scale. The aim of this work is to evaluate the size of the enterocoel and the thickness of colon wall using both MRI for in vivo imaging, and light-sheet and two-photon microscope for in vitro imaging. C57BL/6 mice were received 3.5% Dextran sodium sulfate (DSS) in the drinking water for 5 days to build IBD model. Mice were imaged with MRI on days 0, 6 to observe colitis progression. After MRI imaging, the mice were sacrificed to take colons for tissue clearing. Then, light-sheet and two-photon microscopies are used for in vitro imaging of the cleared samples. The experimental group showed symptoms of bloody stools, sluggishness and weight loss. It showed that the colon wall was thicker while the enterocoel was narrower compare to control group. The more details are observed using light-sheet and two-photon microscope. It is demonstrated that hybrid of MRI in macro-scale and light-sheet and two-photon microscopy in micro-scale imaging is feasible for colon inflammation diagnosing and supervising.

Passive microrheology of soft materials with atomic force microscopy: A wavelet-based spectral analysis

Energy Technology Data Exchange (ETDEWEB)

Martinez-Torres, C.; Streppa, L. [CNRS, UMR5672, Laboratoire de Physique, Ecole Normale Supérieure de Lyon, 46 Allée d' Italie, Université de Lyon, 69007 Lyon (France); Arneodo, A.; Argoul, F. [CNRS, UMR5672, Laboratoire de Physique, Ecole Normale Supérieure de Lyon, 46 Allée d' Italie, Université de Lyon, 69007 Lyon (France); CNRS, UMR5798, Laboratoire Ondes et Matière d' Aquitaine, Université de Bordeaux, 351 Cours de la Libération, 33405 Talence (France); Argoul, P. [Université Paris-Est, Ecole des Ponts ParisTech, SDOA, MAST, IFSTTAR, 14-20 Bd Newton, Cité Descartes, 77420 Champs sur Marne (France)

2016-01-18

Compared to active microrheology where a known force or modulation is periodically imposed to a soft material, passive microrheology relies on the spectral analysis of the spontaneous motion of tracers inherent or external to the material. Passive microrheology studies of soft or living materials with atomic force microscopy (AFM) cantilever tips are rather rare because, in the spectral densities, the rheological response of the materials is hardly distinguishable from other sources of random or periodic perturbations. To circumvent this difficulty, we propose here a wavelet-based decomposition of AFM cantilever tip fluctuations and we show that when applying this multi-scale method to soft polymer layers and to living myoblasts, the structural damping exponents of these soft materials can be retrieved.

Combining total internal reflection sum frequency spectroscopy spectral imaging and confocal fluorescence microscopy.

Science.gov (United States)

Allgeyer, Edward S; Sterling, Sarah M; Gunewardene, Mudalige S; Hess, Samuel T; Neivandt, David J; Mason, Michael D

2015-01-27

Understanding surface and interfacial lateral organization in material and biological systems is critical in nearly every field of science. The continued development of tools and techniques viable for elucidation of interfacial and surface information is therefore necessary to address new questions and further current investigations. Sum frequency spectroscopy (SFS) is a label-free, nonlinear optical technique with inherent surface specificity that can yield critical organizational information on interfacial species. Unfortunately, SFS provides no spatial information on a surface; small scale heterogeneities that may exist are averaged over the large areas typically probed. Over the past decade, this has begun to be addressed with the advent of SFS microscopy. Here we detail the construction and function of a total internal reflection (TIR) SFS spectral and confocal fluorescence imaging microscope directly amenable to surface investigations. This instrument combines, for the first time, sample scanning TIR-SFS imaging with confocal fluorescence microscopy.

Multi-modality photoacoustic tomography, ultrasound, and light sheet microscopy for volumetric tumor margin detection

Science.gov (United States)

Sangha, Gurneet S.; Hu, Bihe; Bolus, Daniel; Wang, Mei; Skidmore, Shelby J.; Sholl, Andrew B.; Brown, J. Quincy; Goergen, Craig J.

2018-02-01

Current methods for breast tumor margin detection are invasive, time consuming, and typically result in a reoperative rate of over 25%. This marks a clear clinical need to develop improved tools to intraoperatively differentiate negative versus positive tumor margins. Here, we utilize photoacoustic tomography (PAT), ultrasound (US), and inverted Selective Plane Illumination Microscopy (iSPIM) to assess breast tumor margins in eight human breast biopsies. Our PAT/US system consists of a tunable Nd:YAG laser (NT 300, EKSPLA) coupled with a 40MHz central frequency US probe (Vevo2100, FUJIFILM Visual Sonics). This system allows for the delivery of 10Hz, 5ns pulses with fluence of 40mJ/cm2 to the tissue with PAT and US axial resolutions of 125μm and 40μm, respectively. For this study, we used a linear stepper motor to acquire volumetric PAT/US images of the breast biopsies using 1100nm light to identify bloodrich "tumor" regions and 1210nm light to identify lipid-rich "healthy" regions. iSPIM (Applied Scientific Instrumentation) is an advanced microscopy technique with lateral resolution of 1.5μm and axial resolution of 7μm. We used 488nm laser excitation and acridine orange as a general comprehensive histology stain. Our results show that PAT/US can be used to identify lipid-rich regions, dense areas of arterioles and arteries, and other internal structures such as ducts. iSPIM images correlate well with histopathology slides and can verify nuclear features, cell type and density, stromal features, and microcalcifications. Together, this multimodality approach has the potential to improve tumor margin detection with a high degree of sensitivity and specificity.

Diffusion Maps for Multimodal Registration

Directory of Open Access Journals (Sweden)

Gemma Piella

2014-06-01

Full Text Available Multimodal image registration is a difficult task, due to the significant intensity variations between the images. A common approach is to use sophisticated similarity measures, such as mutual information, that are robust to those intensity variations. However, these similarity measures are computationally expensive and, moreover, often fail to capture the geometry and the associated dynamics linked with the images. Another approach is the transformation of the images into a common space where modalities can be directly compared. Within this approach, we propose to register multimodal images by using diffusion maps to describe the geometric and spectral properties of the data. Through diffusion maps, the multimodal data is transformed into a new set of canonical coordinates that reflect its geometry uniformly across modalities, so that meaningful correspondences can be established between them. Images in this new representation can then be registered using a simple Euclidean distance as a similarity measure. Registration accuracy was evaluated on both real and simulated brain images with known ground-truth for both rigid and non-rigid registration. Results showed that the proposed approach achieved higher accuracy than the conventional approach using mutual information.

Investigation of an angiogenesis-promoting topical treatment for diabetic wounds using multimodal microscopy (Conference Presentation)

Science.gov (United States)

Li, Joanne; Bower, Andrew J.; Arp, Zane A.; Olson, Eric; Holland, Claire; Chaney, Eric J.; Marjanovic, Marina; Boppart, Stephen A.

2016-02-01

Impaired skin wound healing is a significant co-morbid condition of diabetes that is caused by poor microcirculation among other factors. Hypoxia-inducible factors (HIFs) are transcription factors that mediate the effects of decreased levels of oxygen in biological environments. Inducing mild hypoxia in the tissue could promote angiogenesis, a critical step in the wound healing process in diabetic wounds. To investigate the relationship between hypoxia and diabetic wound healing, a topical treatment consisting of a HIF-activating prolyl-hydroxylase inhibitor was administered to the wounded skin of diabetic (db/db) mice. Studies were conducted in accordance with the GSK Policy on the Care, Welfare and Treatment of Laboratory Animals and were reviewed at GSK or by the ethical review process at the institution where the work was performed. The wounded area was tracked in vivo for 28 days utilizing a custom-built multimodal microscopy system. An increase in vascular density around the wounds of treated animals was observed using phase-variance optical coherence tomography (PV-OCT), in comparison to normal controls. In addition, second harmonic generation (SHG) and fluorescence lifetime imaging microscopy (FLIM) were utilized to examine the collagen regeneration and cellular metabolic activity, respectively, in the wounded skin. The utilization of these light based methods can follow metabolic and morphologic changes in the wound healing process in ways not possible with current evaluation processes. Insights demonstrated in these studies could lead to new endpoints for evaluation of the efficacy of drugs and lead to more direct ways of detecting patient response to treatment.

Probing chemistry within the membrane structure of wood with soft X-ray spectral microscopy

International Nuclear Information System (INIS)

Cody, George D.

2000-01-01

Scanning Transmission Soft X-ray spectral microscopy on Carbon's 1s absorption edge reveals the distribution of structural biopolymers within cell membrane regions of modern cedar and oak. Cellulose is extremely susceptible to beam damage. Spectroscopic studies of beam damage reveals that the chemical changes resulting from secondary electron impact may be highly selective and is consistent with hydroxyl eliminations and structural rearrangement of pyranose rings in alpha-cellulose to hydroxyl substituted γ pyrones. A study of acetylated cellulose demonstrates significantly different chemistry; principally massive decarboxylation. Defocusing the beam to a 2 μm spot size allows for the acquisition of 'pristine' cellulose spectra. Spectral deconvolution is used to assess the distribution of lignin and cellulose in the different regions of the cell membrane. Using the intensity of the hydroxylated aromatic carbons 1s-π * transition, the ratio of coniferyl and syringyl based lignin within the middle lamellae and secondary cell wall of oak, an angiosperm can be determined

High-speed vibrational imaging and spectral analysis of lipid bodies by compound Raman microscopy.

Science.gov (United States)

Slipchenko, Mikhail N; Le, Thuc T; Chen, Hongtao; Cheng, Ji-Xin

2009-05-28

Cells store excess energy in the form of cytoplasmic lipid droplets. At present, it is unclear how different types of fatty acids contribute to the formation of lipid droplets. We describe a compound Raman microscope capable of both high-speed chemical imaging and quantitative spectral analysis on the same platform. We used a picosecond laser source to perform coherent Raman scattering imaging of a biological sample and confocal Raman spectral analysis at points of interest. The potential of the compound Raman microscope was evaluated on lipid bodies of cultured cells and live animals. Our data indicate that the in vivo fat contains much more unsaturated fatty acids (FAs) than the fat formed via de novo synthesis in 3T3-L1 cells. Furthermore, in vivo analysis of subcutaneous adipocytes and glands revealed a dramatic difference not only in the unsaturation level but also in the thermodynamic state of FAs inside their lipid bodies. Additionally, the compound Raman microscope allows tracking of the cellular uptake of a specific fatty acid and its abundance in nascent cytoplasmic lipid droplets. The high-speed vibrational imaging and spectral analysis capability renders compound Raman microscopy an indispensible analytical tool for the study of lipid-droplet biology.

Multimodal optical analysis discriminates freshly extracted human sample of gliomas, metastases and meningiomas from their appropriate controls

Science.gov (United States)

Zanello, Marc; Poulon, Fanny; Pallud, Johan; Varlet, Pascale; Hamzeh, H.; Abi Lahoud, Georges; Andreiuolo, Felipe; Ibrahim, Ali; Pages, Mélanie; Chretien, Fabrice; di Rocco, Federico; Dezamis, Edouard; Nataf, François; Turak, Baris; Devaux, Bertrand; Abi Haidar, Darine

2017-02-01

Delineating tumor margins as accurately as possible is of primordial importance in surgical oncology: extent of resection is associated with survival but respect of healthy surrounding tissue is necessary for preserved quality of life. The real-time analysis of the endogeneous fluorescence signal of brain tissues is a promising tool for defining margins of brain tumors. The present study aims to demonstrate the feasibility of multimodal optical analysis to discriminate fresh samples of gliomas, metastases and meningiomas from their appropriate controls. Tumor samples were studied on an optical fibered endoscope using spectral and fluorescence lifetime analysis and then on a multimodal set-up for acquiring spectral, one and two-photon fluorescence images, second harmonic generation signals and two-photon fluorescence lifetime datasets. The obtained data allowed us to differentiate healthy samples from tumor samples. These results confirmed the possible clinical relevance of this real-time multimodal optical analysis. This technique can be easily applied to neurosurgical procedures for a better delineation of surgical margins.

Multimodal Dispersion of Nanoparticles: A Comprehensive Evaluation of Size Distribution with 9 Size Measurement Methods.

Science.gov (United States)

Varenne, Fanny; Makky, Ali; Gaucher-Delmas, Mireille; Violleau, Frédéric; Vauthier, Christine

2016-05-01

Evaluation of particle size distribution (PSD) of multimodal dispersion of nanoparticles is a difficult task due to inherent limitations of size measurement methods. The present work reports the evaluation of PSD of a dispersion of poly(isobutylcyanoacrylate) nanoparticles decorated with dextran known as multimodal and developed as nanomedecine. The nine methods used were classified as batch particle i.e. Static Light Scattering (SLS) and Dynamic Light Scattering (DLS), single particle i.e. Electron Microscopy (EM), Atomic Force Microscopy (AFM), Tunable Resistive Pulse Sensing (TRPS) and Nanoparticle Tracking Analysis (NTA) and separative particle i.e. Asymmetrical Flow Field-Flow Fractionation coupled with DLS (AsFlFFF) size measurement methods. The multimodal dispersion was identified using AFM, TRPS and NTA and results were consistent with those provided with the method based on a separation step prior to on-line size measurements. None of the light scattering batch methods could reveal the complexity of the PSD of the dispersion. Difference between PSD obtained from all size measurement methods tested suggested that study of the PSD of multimodal dispersion required to analyze samples by at least one of the single size particle measurement method or a method that uses a separation step prior PSD measurement.

A multimodal image sensor system for identifying water stress in grapevines

Science.gov (United States)

Zhao, Yong; Zhang, Qin; Li, Minzan; Shao, Yongni; Zhou, Jianfeng; Sun, Hong

2012-11-01

Water stress is one of the most common limitations of fruit growth. Water is the most limiting resource for crop growth. In grapevines, as well as in other fruit crops, fruit quality benefits from a certain level of water deficit which facilitates to balance vegetative and reproductive growth and the flow of carbohydrates to reproductive structures. A multi-modal sensor system was designed to measure the reflectance signature of grape plant surfaces and identify different water stress levels in this paper. The multi-modal sensor system was equipped with one 3CCD camera (three channels in R, G, and IR). The multi-modal sensor can capture and analyze grape canopy from its reflectance features, and identify the different water stress levels. This research aims at solving the aforementioned problems. The core technology of this multi-modal sensor system could further be used as a decision support system that combines multi-modal sensory data to improve plant stress detection and identify the causes of stress. The images were taken by multi-modal sensor which could output images in spectral bands of near-infrared, green and red channel. Based on the analysis of the acquired images, color features based on color space and reflectance features based on image process method were calculated. The results showed that these parameters had the potential as water stress indicators. More experiments and analysis are needed to validate the conclusion.

Multimodal nonlinear imaging of arabidopsis thaliana root cell

Science.gov (United States)

Jang, Bumjoon; Lee, Sung-Ho; Woo, Sooah; Park, Jong-Hyun; Lee, Myeong Min; Park, Seung-Han

2017-07-01

Nonlinear optical microscopy has enabled the possibility to explore inside the living organisms. It utilizes ultrashort laser pulse with long wavelength (greater than 800nm). Ultrashort pulse produces high peak power to induce nonlinear optical phenomenon such as two-photon excitation fluorescence (TPEF) and harmonic generations in the medium while maintaining relatively low average energy pre area. In plant developmental biology, confocal microscopy is widely used in plant cell imaging after the development of biological fluorescence labels in mid-1990s. However, fluorescence labeling itself affects the sample and the sample deviates from intact condition especially when labelling the entire cell. In this work, we report the dynamic images of Arabidopsis thaliana root cells. This demonstrates the multimodal nonlinear optical microscopy is an effective tool for long-term plant cell imaging.

High-frequency multimodal atomic force microscopy

Directory of Open Access Journals (Sweden)

Adrian P. Nievergelt

2014-12-01

Full Text Available Multifrequency atomic force microscopy imaging has been recently demonstrated as a powerful technique for quickly obtaining information about the mechanical properties of a sample. Combining this development with recent gains in imaging speed through small cantilevers holds the promise of a convenient, high-speed method for obtaining nanoscale topography as well as mechanical properties. Nevertheless, instrument bandwidth limitations on cantilever excitation and readout have restricted the ability of multifrequency techniques to fully benefit from small cantilevers. We present an approach for cantilever excitation and deflection readout with a bandwidth of 20 MHz, enabling multifrequency techniques extended beyond 2 MHz for obtaining materials contrast in liquid and air, as well as soft imaging of delicate biological samples.

Label-free imaging of arterial cells and extracellular matrix using a multimodal CARS microscope

Science.gov (United States)

Wang, Han-Wei; Le, Thuc T.; Cheng, Ji-Xin

2008-04-01

A multimodal nonlinear optical imaging system that integrates coherent anti-Stokes Raman scattering (CARS), sum-frequency generation (SFG), and two-photon excitation fluorescence (TPEF) on the same platform was developed and applied to visualize single cells and extracellular matrix in fresh carotid arteries. CARS signals arising from CH 2-rich membranes allowed visualization of endothelial cells and smooth muscle cells of the arterial wall. Additionally, CARS microscopy allowed vibrational imaging of elastin and collagen fibrils which are also rich in CH 2 bonds. The extracellular matrix organization was further confirmed by TPEF signals arising from elastin's autofluorescence and SFG signals arising from collagen fibrils' non-centrosymmetric structure. Label-free imaging of significant components of arterial tissues suggests the potential application of multimodal nonlinear optical microscopy to monitor onset and progression of arterial diseases.

Multiscale climate emulator of multimodal wave spectra: MUSCLE-spectra

Science.gov (United States)

Rueda, Ana; Hegermiller, Christie A.; Antolinez, Jose A. A.; Camus, Paula; Vitousek, Sean; Ruggiero, Peter; Barnard, Patrick L.; Erikson, Li H.; Tomás, Antonio; Mendez, Fernando J.

2017-02-01

Characterization of multimodal directional wave spectra is important for many offshore and coastal applications, such as marine forecasting, coastal hazard assessment, and design of offshore wave energy farms and coastal structures. However, the multivariate and multiscale nature of wave climate variability makes this complex problem tractable using computationally expensive numerical models. So far, the skill of statistical-downscaling model-based parametric (unimodal) wave conditions is limited in large ocean basins such as the Pacific. The recent availability of long-term directional spectral data from buoys and wave hindcast models allows for development of stochastic models that include multimodal sea-state parameters. This work introduces a statistical downscaling framework based on weather types to predict multimodal wave spectra (e.g., significant wave height, mean wave period, and mean wave direction from different storm systems, including sea and swells) from large-scale atmospheric pressure fields. For each weather type, variables of interest are modeled using the categorical distribution for the sea-state type, the Generalized Extreme Value (GEV) distribution for wave height and wave period, a multivariate Gaussian copula for the interdependence between variables, and a Markov chain model for the chronology of daily weather types. We apply the model to the southern California coast, where local seas and swells from both the Northern and Southern Hemispheres contribute to the multimodal wave spectrum. This work allows attribution of particular extreme multimodal wave events to specific atmospheric conditions, expanding knowledge of time-dependent, climate-driven offshore and coastal sea-state conditions that have a significant influence on local nearshore processes, coastal morphology, and flood hazards.

Multimode optical dermoscopy (SkinSpect) analysis for skin with melanocytic nevus

Science.gov (United States)

Vasefi, Fartash; MacKinnon, Nicholas; Saager, Rolf; Kelly, Kristen M.; Maly, Tyler; Chave, Robert; Booth, Nicholas; Durkin, Anthony J.; Farkas, Daniel L.

2016-04-01

We have developed a multimode dermoscope (SkinSpect™) capable of illuminating human skin samples in-vivo with spectrally-programmable linearly-polarized light at 33 wavelengths between 468nm and 857 nm. Diffusely reflected photons are separated into collinear and cross-polarized image paths and images captured for each illumination wavelength. In vivo human skin nevi (N = 20) were evaluated with the multimode dermoscope and melanin and hemoglobin concentrations were compared with Spatially Modulated Quantitative Spectroscopy (SMoQS) measurements. Both systems show low correlation between their melanin and hemoglobin concentrations, demonstrating the ability of the SkinSpect™ to separate these molecular signatures and thus act as a biologically plausible device capable of early onset melanoma detection.

Spectral confocal reflection microscopy using a white light source

Science.gov (United States)

Booth, M.; Juškaitis, R.; Wilson, T.

2008-08-01

We present a reflection confocal microscope incorporating a white light supercontinuum source and spectral detection. The microscope provides images resolved spatially in three-dimensions, in addition to spectral resolution covering the wavelength range 450-650nm. Images and reflection spectra of artificial and natural specimens are presented, showing features that are not normally revealed in conventional microscopes or confocal microscopes using discrete line lasers. The specimens include thin film structures on semiconductor chips, iridescent structures in Papilio blumei butterfly scales, nacre from abalone shells and opal gemstones. Quantitative size and refractive index measurements of transparent beads are derived from spectral interference bands.

Multimodal ophthalmic imaging using spectrally encoded scanning laser ophthalmoscopy and optical coherence tomography

Science.gov (United States)

El-Haddad, Mohamed T.; Malone, Joseph D.; Li, Jianwei D.; Bozic, Ivan; Arquitola, Amber M.; Joos, Karen M.; Patel, Shriji N.; Tao, Yuankai K.

2017-08-01

Ophthalmic surgery involves manipulation of delicate, layered tissue structures on milli- to micrometer scales. Traditional surgical microscopes provide an inherently two-dimensional view of the surgical field with limited depth perception which precludes accurate depth-resolved visualization of these tissue layers, and limits the development of novel surgical techniques. We demonstrate multimodal swept-source spectrally encoded scanning laser ophthalmoscopy and optical coherence tomography (SS-SESLO-OCT) to address current limitations of image-guided ophthalmic microsurgery. SS-SESLO-OCT provides inherently co-registered en face and cross-sectional field-of-views (FOVs) at a line rate of 400 kHz and >2 GPix/s throughput. We show in vivo imaging of the anterior segment and retinal fundus of a healthy volunteer, and preliminary results of multi-volumetric mosaicking for ultrawide-field retinal imaging with 90° FOV. Additionally, a scan-head was rapid-prototyped with a modular architecture which enabled integration of SS-SESLO-OCT with traditional surgical microscope and slit-lamp imaging optics. Ex vivo surgical maneuvers were simulated in cadaveric porcine eyes. The system throughput enabled volumetric acquisition at 10 volumes-per-second (vps) and allowed visualization of surgical dynamics in corneal sweeps, compressions, and dissections, and retinal sweeps, compressions, and elevations. SESLO en face images enabled simple real-time co-registration with the surgical microscope FOV, and OCT cross-sections provided depth-resolved visualization of instrument-tissue interactions. Finally, we demonstrate novel augmented-reality integration with the surgical view using segmentation overlays to aid surgical guidance. SS-SESLO-OCT may benefit clinical diagnostics by enabling aiming, registration, and mosaicking; and intraoperative imaging by allowing for real-time surgical feedback, instrument tracking, and overlays of computationally extracted biomarkers of disease.

Tunable optical setup with high flexibility for spectrally resolved coherent anti-Stokes Raman scattering microscopy

International Nuclear Information System (INIS)

Bergner, G; Akimov, D; Bartelt, H; Dietzek, B; Popp, J; Schlücker, S

2011-01-01

A simplified setup for coherent anti-Stokes Raman scattering (CARS) microscopy is introduced, which allows for recording CARS images with 30 cm -1 excitation bandwidth for probing Raman bands between 500 and 900 cm -1 with minimal requirements for alignment. The experimental arrangement is based on electronic switching between CARS images recorded at different Raman resonances by combining a photonic crystal fiber (PCF) as broadband light source and an acousto-optical programmable dispersive filter (AOPDF) as tunable wavelength filter. Such spatial light modulator enables selection of a narrow-band spectrum to yield high vibrational contrast and hence chemical contrast in the resultant CARS images. Furthermore, an experimental approach to reconstruct spectral information from CARS image contrast is introduced

A correlative optical microscopy and scanning electron microscopy approach to locating nanoparticles in brain tumors.

Science.gov (United States)

Kempen, Paul J; Kircher, Moritz F; de la Zerda, Adam; Zavaleta, Cristina L; Jokerst, Jesse V; Mellinghoff, Ingo K; Gambhir, Sanjiv S; Sinclair, Robert

2015-01-01

The growing use of nanoparticles in biomedical applications, including cancer diagnosis and treatment, demands the capability to exactly locate them within complex biological systems. In this work a correlative optical and scanning electron microscopy technique was developed to locate and observe multi-modal gold core nanoparticle accumulation in brain tumor models. Entire brain sections from mice containing orthotopic brain tumors injected intravenously with nanoparticles were imaged using both optical microscopy to identify the brain tumor, and scanning electron microscopy to identify the individual nanoparticles. Gold-based nanoparticles were readily identified in the scanning electron microscope using backscattered electron imaging as bright spots against a darker background. This information was then correlated to determine the exact location of the nanoparticles within the brain tissue. The nanoparticles were located only in areas that contained tumor cells, and not in the surrounding healthy brain tissue. This correlative technique provides a powerful method to relate the macro- and micro-scale features visible in light microscopy with the nanoscale features resolvable in scanning electron microscopy. Copyright © 2014 Elsevier Ltd. All rights reserved.

A multimodal parallel architecture: A cognitive framework for multimodal interactions.

Science.gov (United States)

Cohn, Neil

2016-01-01

Human communication is naturally multimodal, and substantial focus has examined the semantic correspondences in speech-gesture and text-image relationships. However, visual narratives, like those in comics, provide an interesting challenge to multimodal communication because the words and/or images can guide the overall meaning, and both modalities can appear in complicated "grammatical" sequences: sentences use a syntactic structure and sequential images use a narrative structure. These dual structures create complexity beyond those typically addressed by theories of multimodality where only a single form uses combinatorial structure, and also poses challenges for models of the linguistic system that focus on single modalities. This paper outlines a broad theoretical framework for multimodal interactions by expanding on Jackendoff's (2002) parallel architecture for language. Multimodal interactions are characterized in terms of their component cognitive structures: whether a particular modality (verbal, bodily, visual) is present, whether it uses a grammatical structure (syntax, narrative), and whether it "dominates" the semantics of the overall expression. Altogether, this approach integrates multimodal interactions into an existing framework of language and cognition, and characterizes interactions between varying complexity in the verbal, bodily, and graphic domains. The resulting theoretical model presents an expanded consideration of the boundaries of the "linguistic" system and its involvement in multimodal interactions, with a framework that can benefit research on corpus analyses, experimentation, and the educational benefits of multimodality. Copyright © 2015.

A portable microscopy system for fluorescence, polarized, and brightfield imaging

Science.gov (United States)

Gordon, Paul; Wattinger, Rolla; Lewis, Cody; Venancio, Vinicius Paula; Mertens-Talcott, Susanne U.; Coté, Gerard

2018-02-01

The use of mobile phones to conduct diagnostic microscopy at the point-of-care presents intriguing possibilities for the advancement of high-quality medical care in remote settings. However, it is challenging to create a single device that can adapt to the ever-varying camera technologies in phones or that can image with the customization that multiple modalities require for applications such as malaria diagnosis. A portable multi-modal microscope system is presented that utilizes a Raspberry Pi to collect and transmit data wirelessly to a myriad of electronic devices for image analysis. The microscopy system is capable of providing to the user correlated brightfield, polarized, and fluorescent images of samples fixed on traditional microscopy slides. The multimodal diagnostic capabilities of the microscope were assessed by measuring parasitemia of Plasmodium falciparum-infected thin blood smears. The device is capable of detecting fluorescently-labeled DNA using FITC excitation (490 nm) and emission (525 nm), the birefringent P. falciparum byproduct hemozoin, and detecting brightfield absorption with a resolution of 0.78 micrometers (element 9-3 of a 1951 Air Force Target). This microscopy system is a novel portable imaging tool that may be a viable candidate for field implementation if challenges of system durability, cost considerations, and full automation can be overcome.

Microscale reconstruction of biogeochemical substrates using multimode X-ray tomography and scanning electron microscopy

Science.gov (United States)

Miller, M.; Miller, E.; Liu, J.; Lund, R. M.; McKinley, J. P.

2012-12-01

X-ray computed tomography (CT), scanning electron microscopy (SEM), electron microprobe analysis (EMP), and computational image analysis are mature technologies used in many disciplines. Cross-discipline combination of these imaging and image-analysis technologies is the focus of this research, which uses laboratory and light-source resources in an iterative approach. The objective is to produce images across length scales, taking advantage of instrumentation that is optimized for each scale, and to unify them into a single compositional reconstruction. Initially, CT images will be collected using both x-ray absorption and differential phase contrast modes. The imaged sample will then be physically sectioned and the exposed surfaces imaged and characterized via SEM/EMP. The voxel slice corresponding to the physical sample surface will be isolated computationally, and the volumetric data will be combined with two-dimensional SEM images along CT image planes. This registration step will take advantage of the similarity between the X-ray absorption (CT) and backscattered electron (SEM) coefficients (both proportional to average atomic number in the interrogated volume) as well as the images' mutual information. Elemental and solid-phase distributions on the exposed surfaces, co-registered with SEM images, will be mapped using EMP. The solid-phase distribution will be propagated into three-dimensional space using computational methods relying on the estimation of compositional distributions derived from the CT data. If necessary, solid-phase and pore-space boundaries will be resolved using X-ray differential phase contrast tomography, x-ray fluorescence tomography, and absorption-edge microtomography at a light-source facility. Computational methods will be developed to register and model images collected over varying scales and data types. Image resolution, physically and dynamically, is qualitatively different for the electron microscopy and CT methodologies. Routine

Nanodiamond Landmarks for Subcellular Multimodal Optical and Electron Imaging

Science.gov (United States)

Zurbuchen, Mark A.; Lake, Michael P.; Kohan, Sirus A.; Leung, Belinda; Bouchard, Louis-S.

2013-01-01

There is a growing need for biolabels that can be used in both optical and electron microscopies, are non-cytotoxic, and do not photobleach. Such biolabels could enable targeted nanoscale imaging of sub-cellular structures, and help to establish correlations between conjugation-delivered biomolecules and function. Here we demonstrate a sub-cellular multi-modal imaging methodology that enables localization of inert particulate probes, consisting of nanodiamonds having fluorescent nitrogen-vacancy centers. These are functionalized to target specific structures, and are observable by both optical and electron microscopies. Nanodiamonds targeted to the nuclear pore complex are rapidly localized in electron-microscopy diffraction mode to enable “zooming-in” to regions of interest for detailed structural investigations. Optical microscopies reveal nanodiamonds for in-vitro tracking or uptake-confirmation. The approach is general, works down to the single nanodiamond level, and can leverage the unique capabilities of nanodiamonds, such as biocompatibility, sensitive magnetometry, and gene and drug delivery. PMID:24036840

Multimodal label-free ex vivo imaging using a dual-wavelength microscope with axial chromatic aberration compensation.

Science.gov (United States)

Filippi, Andrea; Dal Sasso, Eleonora; Iop, Laura; Armani, Andrea; Gintoli, Michele; Sandri, Marco; Gerosa, Gino; Romanato, Filippo; Borile, Giulia

2018-03-01

Label-free microscopy is a very powerful technique that can be applied to study samples with no need for exogenous fluorescent probes, keeping the main benefits of multiphoton microscopy, such as longer penetration depths and intrinsic optical sectioning while enabling serial multitechniques examinations on the same specimen. Among the many label-free microscopy methods, harmonic generation (HG) is one of the most intriguing methods due to its generally low photo-toxicity and relative ease of implementation. Today, HG and common two-photon microscopy (TPM) are well-established techniques, and are routinely used in several research fields. However, they require a significant amount of fine-tuning to be fully exploited, making them quite difficult to perform in parallel. Here, we present our designed multimodal microscope, capable of performing simultaneously TPM and HG without any kind of compromise thanks to two, separate, individually optimized laser sources with axial chromatic aberration compensation. We also apply our setup to the examination of a plethora of ex vivo samples to prove its capabilities and the significant advantages of a multimodal approach. (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE).

New developments in multimodal clinical multiphoton tomography

Science.gov (United States)

König, Karsten

2011-03-01

80 years ago, the PhD student Maria Goeppert predicted in her thesis in Goettingen, Germany, two-photon effects. It took 30 years to prove her theory, and another three decades to realize the first two-photon microscope. With the beginning of this millennium, first clinical multiphoton tomographs started operation in research institutions, hospitals, and in the cosmetic industry. The multiphoton tomograph MPTflexTM with its miniaturized flexible scan head became the Prism-Award 2010 winner in the category Life Sciences. Multiphoton tomographs with its superior submicron spatial resolution can be upgraded to 5D imaging tools by adding spectral time-correlated single photon counting units. Furthermore, multimodal hybrid tomographs provide chemical fingerprinting and fast wide-field imaging. The world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph in spring 2010. In particular, nonfluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen have been imaged in patients with dermatological disorders. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution imaging tools such as ultrasound, optoacoustic, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer (malignant melanoma), optimization of treatment strategies (wound healing, dermatitis), and cosmetic research including long-term biosafety tests of ZnO sunscreen nanoparticles and the measurement of the stimulated biosynthesis of collagen by anti-ageing products.

Drusen Characterization with Multimodal Imaging

Science.gov (United States)

Spaide, Richard F.; Curcio, Christine A.

2010-01-01

Summary Multimodal imaging findings and histological demonstration of soft drusen, cuticular drusen, and subretinal drusenoid deposits provided information used to develop a model explaining their imaging characteristics. Purpose To characterize the known appearance of cuticular drusen, subretinal drusenoid deposits (reticular pseudodrusen), and soft drusen as revealed by multimodal fundus imaging; to create an explanatory model that accounts for these observations. Methods Reported color, fluorescein angiographic, autofluorescence, and spectral domain optical coherence tomography (SD-OCT) images of patients with cuticular drusen, soft drusen, and subretinal drusenoid deposits were reviewed, as were actual images from affected eyes. Representative histological sections were examined. The geometry, location, and imaging characteristics of these lesions were evaluated. A hypothesis based on the Beer-Lambert Law of light absorption was generated to fit these observations. Results Cuticular drusen appear as numerous uniform round yellow-white punctate accumulations under the retinal pigment epithelium (RPE). Soft drusen are larger yellow-white dome-shaped mounds of deposit under the RPE. Subretinal drusenoid deposits are polymorphous light-grey interconnected accumulations above the RPE. Based on the model, both cuticular and soft drusen appear yellow due to the removal of shorter wavelength light by a double pass through the RPE. Subretinal drusenoid deposits, which are located on the RPE, are not subjected to short wavelength attenuation and therefore are more prominent when viewed with blue light. The location and morphology of extracellular material in relationship to the RPE, and associated changes to RPE morphology and pigmentation, appeared to be primary determinants of druse appearance in different imaging modalities. Conclusion Although cuticular drusen, subretinal drusenoid deposits, and soft drusen are composed of common components, they are distinguishable

Epi-detecting label-free multimodal imaging platform using a compact diode-pumped femtosecond solid-state laser

DEFF Research Database (Denmark)

Andreana, Marco; Le, Tuan; Hansen, Anders Kragh

2017-01-01

We have developed an epi-detected multimodal nonlinear optical microscopy platform based on a compact and cost-effective laser source featuring simultaneous acquisition of signals arising from hyperspectral coherent anti-Stokes Raman scattering (CARS), two-photon fluorescence, and second harmonic...

Multimodal nanoparticles as alignment and correlation markers in fluorescence/soft X-ray cryo-microscopy/tomography of nucleoplasmic reticulum and apoptosis in mammalian cells

International Nuclear Information System (INIS)

Hagen, Christoph; Werner, Stephan; Carregal-Romero, Susana; Malhas, Ashraf N.; Klupp, Barbara G.; Guttmann, Peter; Rehbein, Stefan; Henzler, Katja; Mettenleiter, Thomas C.

2014-01-01

Correlative fluorescence and soft X-ray cryo-microscopy/tomography on flat sample holders is perfectly suited to study the uncompromised physiological status of adherent cells at its best possible preservation by imaging after fast cryo-immobilization. To understand the mechanism by which herpesviruses induce nucleoplasmic reticulum, i.e. invaginations of the nuclear envelope, during their egress from the host cell nucleus, morphologically similar structures found in laminopathies and after chemical induction were investigated as a potentially more easily accessible model system. For example, anti-retroviral protease inhibitors like Saquinavir also induce invaginations of the nuclear membranes. With the help of newly designed multimodal nanoparticles as alignment and correlation markers, and by optimizing fluorescence cryo-microscopy data acquisition, an elaborate three-dimensional network of nucleoplasmic reticulum was demonstrated in nuclei of Saquinavir-treated rabbit kidney cells expressing a fluorescently labeled inner nuclear membrane protein. In part of the protease inhibitor-treated samples, nuclei exhibited dramatic ultrastructural changes indicative of programmed cell death/apoptosis. This unexpected observation highlights another unique feature of soft X-ray microscopy, i.e. high absorption contrast information not relying on labeled cellular components, at a 3D resolution of approximately 40 nm (half-pitch) and through a sample thickness of several micrometers. These properties make it a valuable part of the cell biology imaging toolbox to visualize the cellular ultrastructure in its completeness. - Highlights: • Nucleoplasmic reticulum was demonstrated in nuclei of Saquinavir-treated cells. • New polyelectrolyte-Qdot ® 605 coated gold beads were employed as fiducials. • Saquinavir can induce a strong apoptotic phenotype in the nucleus. • CryoXT is an auspicious imaging technique in apoptosis research

Multimodality and Ambient Intelligence

NARCIS (Netherlands)

Nijholt, Antinus; Verhaegh, W.; Aarts, E.; Korst, J.

2004-01-01

In this chapter we discuss multimodal interface technology. We present eexamples of multimodal interfaces and show problems and opportunities. Fusion of modalities is discussed and some roadmap discussions on research in multimodality are summarized. This chapter also discusses future developments

Full optical model of micro-endoscope with optical coherence microscopy, multiphoton microscopy and visible capabilities

Science.gov (United States)

Vega, David; Kiekens, Kelli C.; Syson, Nikolas C.; Romano, Gabriella; Baker, Tressa; Barton, Jennifer K.

2018-02-01

While Optical Coherence Microscopy (OCM), Multiphoton Microscopy (MPM), and narrowband imaging are powerful imaging techniques that can be used to detect cancer, each imaging technique has limitations when used by itself. Combining them into an endoscope to work in synergy can help achieve high sensitivity and specificity for diagnosis at the point of care. Such complex endoscopes have an elevated risk of failure, and performing proper modelling ensures functionality and minimizes risk. We present full 2D and 3D models of a multimodality optical micro-endoscope to provide real-time detection of carcinomas, called a salpingoscope. The models evaluate the endoscope illumination and light collection capabilities of various modalities. The design features two optical paths with different numerical apertures (NA) through a single lens system with a scanning optical fiber. The dual path is achieved using dichroic coatings embedded in a triplet. A high NA optical path is designed to perform OCM and MPM while a low NA optical path is designed for the visible spectrum to navigate the endoscope to areas of interest and narrowband imaging. Different tests such as the reflectance profile of homogeneous epithelial tissue were performed to adjust the models properly. Light collection models for the different modalities were created and tested for efficiency. While it is challenging to evaluate the efficiency of multimodality endoscopes, the models ensure that the system is design for the expected light collection levels to provide detectable signal to work for the intended imaging.

Energy dissipation in multifrequency atomic force microscopy

Directory of Open Access Journals (Sweden)

Valentina Pukhova

2014-04-01

Full Text Available The instantaneous displacement, velocity and acceleration of a cantilever tip impacting onto a graphite surface are reconstructed. The total dissipated energy and the dissipated energy per cycle of each excited flexural mode during the tip interaction is retrieved. The tip dynamics evolution is studied by wavelet analysis techniques that have general relevance for multi-mode atomic force microscopy, in a regime where few cantilever oscillation cycles characterize the tip–sample interaction.

Investigating the Strain, Temperature and Humidity Sensitivity of a Multimode Graded-Index Perfluorinated Polymer Optical Fiber with Bragg Grating.

Science.gov (United States)

Zheng, Yulong; Bremer, Kort; Roth, Bernhard

2018-05-05

In this work we investigate the strain, temperature and humidity sensitivity of a Fiber Bragg Grating (FBG) inscribed in a near infrared low-loss multimode perfluorinated polymer optical fiber based on cyclic transparent optical polymer (CYTOP). For this purpose, FBGs were inscribed into the multimode CYTOP fiber with a core diameter of 50 µm by using a krypton fluoride (KrF) excimer laser and the phase mask method. The evolution of the reflection spectrum of the FBG detected with a multimode interrogation technique revealed a single reflection peak with a full width at half maximum (FHWM) bandwidth of about 9 nm. Furthermore, the spectral envelope of the single FBG reflection peak can be optimized depending on the KrF excimer laser irradiation time. A linear shift of the Bragg wavelength due to applied strain, temperature and humidity was measured. Furthermore, depending on irradiation time of the KrF excimer laser, both the failure strain and strain sensitivity of the multimode fiber with FBG can be controlled. The inherent low light attenuation in the near infrared wavelength range (telecommunication window) of the multimode CYTOP fiber and the single FBG reflection peak when applying the multimode interrogation set-up will allow for new applications in the area of telecommunication and optical sensing.

Quantitative spectral K-edge imaging in preclinical photon-counting x-ray computed tomography.

Science.gov (United States)

de Vries, Anke; Roessl, Ewald; Kneepkens, Esther; Thran, Axel; Brendel, Bernhard; Martens, Gerhard; Proska, Roland; Nicolay, Klaas; Grüll, Holger

2015-04-01

The objective of this study was to investigate the feasibility and the accuracy of spectral computed tomography (spectral CT) to determine the tissue concentrations and localization of high-attenuation, iodine-based contrast agents in mice. Iodine tissue concentrations determined with spectral CT are compared with concentrations measured with single-photon emission computed tomography (SPECT) and inductively coupled plasma mass spectrometry (ICP-MS). All animal procedures were performed according to the US National Institutes of Health principles of laboratory animal care and were approved by the ethical review committee of Maastricht, The Netherlands. Healthy Swiss mice (n = 4) were injected with an iodinated emulsion radiolabeled with indium as multimodal contrast agent for CT and SPECT. The CT and SPECT scans were acquired using a dedicated small-animal SPECT/CT system. Subsequently, scans were performed with a preclinical spectral CT scanner equipped with a photon-counting detector and 6 energy threshold levels. Quantitative data analysis of SPECT and spectral CT scans were obtained using 3-dimensional volumes-of-interest drawing methods. The ICP-MS on dissected organs was performed to determine iodine uptake per organ and was compared with the amounts determined from spectral CT and SPECT. Iodine concentrations obtained with image-processed spectral CT data correlated well with data obtained either with noninvasive SPECT imaging (slope = 0.96, r = 0.75) or with ICP-MS (slope = 0.99, r = 0.89) in tissue samples. This preclinical proof-of-concept study shows the in vivo quantification of iodine concentrations in tissues using spectral CT. Our multimodal imaging approach with spectral CT and SPECT using radiolabeled iodinated emulsions together with ICP-based quantification allows a direct comparison of all methods. Benchmarked against ICP-MS data, spectral CT in the present implementation shows a slight underestimation of organ iodine concentrations compared

Spectrally encoded confocal microscopy (SECM) for rapid assessment of breast excision specimens (Conference Presentation)

Science.gov (United States)

Brachtel, Elena F.; Johnson, Nicole B.; Huck, Amelia E.; Rice-Stitt, Travis L.; Vangel, Mark G.; Smith, Barbara L.; Tearney, Guillermo J.; Kang, DongKyun

2016-03-01

Unacceptably large percentage (20-40%) of breast cancer lumpectomy patients are required to undergo multiple surgeries when positive margins are found upon post-operative histologic assessment. If the margin status can be determined during surgery, surgeon can resect additional tissues to achieve tumor-free margin, which will reduce the need for additional surgeries. Spectrally encoded confocal microscopy (SECM) is a high-speed reflectance confocal microscopy technology that has a potential to image the entire surgical margin within a short procedural time. Previously, SECM was shown to rapidly image a large area (10 mm by 10 mm) of human esophageal tissue within a short procedural time (15 seconds). When used in lumpectomy, SECM will be able to image the entire margin surface of ~30 cm2 in around 7.5 minutes. SECM images will then be used to determine margin status intra-operatively. In this paper, we present results from a study of testing accuracy of SECM for diagnosing malignant breast tissues. We have imaged freshly-excised breast specimens (N=46) with SECM. SECM images clearly visualized histomorphologic features associated with normal/benign and malignant breast tissues in a similar manner to histologic images. Diagnostic accuracy was tested by comparing SECM diagnoses made by three junior pathologists with corresponding histologic diagnoses made by a senior pathologist. SECM sensitivity and specificity were high, 0.91 and 0.93, respectively. Intra-observer agreement and inter-observer agreement were also high, 0.87 and 0.84, respectively. Results from this study showed that SECM has a potential to accurately determine margin status during breast cancer lumpectomy.

Transfer function of radio over fiber multimode fiber optic links considering third-order dispersion.

Science.gov (United States)

Capmany, J; Gasulla, Ivana

2007-08-20

Although a considerable number of multimode fiber (MMF) links operate in a wavelength region around 850 nm where chromatic dispersion of a given modal group mu is described adequately by the second derivative beta(mu) (2) of the propagation constant beta(mu)(omega), there is also an increasing interest in MMF links transmitting in the second spectral window (@1300nm) where this second derivative vanishes being thus necessary to consider the third derivative beta(mu) (3) in the evaluation of the transfer function of the multimode fiber link. We present in this paper, for the first time to our knowledge, an analytical model for the transfer function of a multimode fiber (MMF) optic link taken into account the impact of third-order dispersion. The model extends the operation of a previously reported one for second-order dispersion. Our results show that the performance of broadband radio over fiber transmission through middle-reach distances can be improved by working at the minimum-dispersion wavelength as long as low-linewidth lasers are employed.

A Concept of Multi-Mode High Spectral Resolution Lidar Using Mach-Zehnder Interferometer

Directory of Open Access Journals (Sweden)

Jin Yoshitaka

2016-01-01

Full Text Available In this paper, we present the design of a High Spectral Resolution Lidar (HSRL using a laser that oscillates in a multi-longitudinal mode. Rayleigh and Mie scattering components are separated using a Mach-Zehnder Interferometer (MZI with the same free spectral range (FSR as the transmitted laser. The transmitted laser light is measured as a reference signal with the same MZI. By scanning the MZI periodically with a scanning range equal to the mode spacing, we can identify the maximum Mie and the maximum Rayleigh signals using the reference signal. The cross talk due to the spectral width of each laser mode can also be estimated.

Learning multimodal dictionaries.

Science.gov (United States)

Monaci, Gianluca; Jost, Philippe; Vandergheynst, Pierre; Mailhé, Boris; Lesage, Sylvain; Gribonval, Rémi

2007-09-01

Real-world phenomena involve complex interactions between multiple signal modalities. As a consequence, humans are used to integrate at each instant perceptions from all their senses in order to enrich their understanding of the surrounding world. This paradigm can be also extremely useful in many signal processing and computer vision problems involving mutually related signals. The simultaneous processing of multimodal data can, in fact, reveal information that is otherwise hidden when considering the signals independently. However, in natural multimodal signals, the statistical dependencies between modalities are in general not obvious. Learning fundamental multimodal patterns could offer deep insight into the structure of such signals. In this paper, we present a novel model of multimodal signals based on their sparse decomposition over a dictionary of multimodal structures. An algorithm for iteratively learning multimodal generating functions that can be shifted at all positions in the signal is proposed, as well. The learning is defined in such a way that it can be accomplished by iteratively solving a generalized eigenvector problem, which makes the algorithm fast, flexible, and free of user-defined parameters. The proposed algorithm is applied to audiovisual sequences and it is able to discover underlying structures in the data. The detection of such audio-video patterns in audiovisual clips allows to effectively localize the sound source on the video in presence of substantial acoustic and visual distractors, outperforming state-of-the-art audiovisual localization algorithms.

Multimodality

DEFF Research Database (Denmark)

Buhl, Mie

2010-01-01

In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal' communication, which should not be confused with the term ‘multimedia'. While multimedia...... on their teaching and learning situations. The choices they make involve e-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very...

Reading Multimodal Texts for Learning – a Model for Cultivating Multimodal Literacy

Directory of Open Access Journals (Sweden)

Kristina Danielsson

2016-08-01

Full Text Available The re-conceptualisation of texts over the last 20 years, as well as the development of a multimodal understanding of communication and representation of knowledge, has profound consequences for the reading and understanding of multimodal texts, not least in educational contexts. However, if teachers and students are given tools to “unwrap” multimodal texts, they can develop a deeper understanding of texts, information structures, and the textual organisation of knowledge. This article presents a model for working with multimodal texts in education with the intention to highlight mutual multimodal text analysis in relation to the subject content. Examples are taken from a Singaporean science textbook as well as a Chilean science textbook, in order to demonstrate that the framework is versatile and applicable across different cultural contexts. The model takes into account the following aspects of texts: the general structure, how different semiotic resources operate, the ways in which different resources are combined (including coherence, the use of figurative language, and explicit/implicit values. Since learning operates on different dimensions – such as social and affective dimensions besides the cognitive ones – our inclusion of figurative language and values as components for textual analysis is a contribution to multimodal text analysis for learning.

Critical Analysis of Multimodal Discourse

DEFF Research Database (Denmark)

van Leeuwen, Theo

2013-01-01

This is an encyclopaedia article which defines the fields of critical discourse analysis and multimodality studies, argues that within critical discourse analysis more attention should be paid to multimodality, and within multimodality to critical analysis, and ends reviewing a few examples of re...

Coherent anti-Stokes Raman scattering microscopy (CARS): Instrumentation and applications

International Nuclear Information System (INIS)

Djaker, Nadia; Lenne, Pierre-Francois; Marguet, Didier; Colonna, Anne; Hadjur, Christophe; Rigneault, Herve

2007-01-01

Recent advances in laser physics have permitted the development of a new kind of microscopy based on stimulated Raman scattering. This new technique known as Coherent anti-Stokes Raman scattering (CARS) microscopy allows vibrational imaging with high sensitivity, high spectral resolution and three-dimensional sectioning capabilities. We review recent advances in CARS microscopy, with applications to chemical and biological systems. We also present an application of CARS microscopy with high optical resolution and spectral selectivity, in resolving structures in surface ex vivo stratum corneum by looking at the CH 2 stretching vibrational band. A strong CARS signal is backscattered from an intense forward generated CARS signal in thick samples. This makes noninvasive imaging of deep structures possible, without labeling or chemical treatments

Focusing and imaging with increased numerical apertures through multimode fibers with micro-fabricated optics.

Science.gov (United States)

Bianchi, S; Rajamanickam, V P; Ferrara, L; Di Fabrizio, E; Liberale, C; Di Leonardo, R

2013-12-01

The use of individual multimode optical fibers in endoscopy applications has the potential to provide highly miniaturized and noninvasive probes for microscopy and optical micromanipulation. A few different strategies have been proposed recently, but they all suffer from intrinsically low resolution related to the low numerical aperture of multimode fibers. Here, we show that two-photon polymerization allows for direct fabrication of micro-optics components on the fiber end, resulting in an increase of the numerical aperture to a value that is close to 1. Coupling light into the fiber through a spatial light modulator, we were able to optically scan a submicrometer spot (300 nm FWHM) over an extended region, facing the opposite fiber end. Fluorescence imaging with improved resolution is also demonstrated.

Multimodal imaging of vascular network and blood microcirculation by optical diagnostic techniques

International Nuclear Information System (INIS)

Kuznetsov, Yu L; Kalchenko, V V; Meglinski, I V

2011-01-01

We present a multimodal optical diagnostic approach for simultaneous non-invasive in vivo imaging of blood and lymphatic microvessels, utilising a combined use of fluorescence intravital microscopy and a method of dynamic light scattering. This approach makes it possible to renounce the use of fluorescent markers for visualisation of blood vessels and, therefore, significantly (tenfold) reduce the toxicity of the technique and minimise side effects caused by the use of contrast fluorescent markers. We demonstrate that along with the ability to obtain images of lymph and blood microvessels with a high spatial resolution, current multimodal approach allows one to observe in real time permeability of blood vessels. This technique appears to be promising in physiology studies of blood vessels, and especially in the study of peripheral cardiovascular system in vivo. (optical technologies in biophysics and medicine)

Enhanced EDX images by fusion of multimodal SEM images using pansharpening techniques.

Science.gov (United States)

Franchi, G; Angulo, J; Moreaud, M; Sorbier, L

2018-01-01

The goal of this paper is to explore the potential interest of image fusion in the context of multimodal scanning electron microscope (SEM) imaging. In particular, we aim at merging the backscattered electron images that usually have a high spatial resolution but do not provide enough discriminative information to physically classify the nature of the sample, with energy-dispersive X-ray spectroscopy (EDX) images that have discriminative information but a lower spatial resolution. The produced images are named enhanced EDX. To achieve this goal, we have compared the results obtained with classical pansharpening techniques for image fusion with an original approach tailored for multimodal SEM fusion of information. Quantitative assessment is obtained by means of two SEM images and a simulated dataset produced by a software based on PENELOPE. © 2017 The Authors Journal of Microscopy © 2017 Royal Microscopical Society.

Multimodal analysis of diamond crystals and layers using RISE microscopy

Czech Academy of Sciences Publication Activity Database

Váňa, R.; Dluhoš, J.; Varga, Marián; Schmid, Ch.; Kromka, Alexander

2017-01-01

Roč. 23, Aug (2017), s. 2280-2281 ISSN 1431-9276 R&D Projects: GA MŠk(CZ) LD15003 Institutional support: RVO:68378271 Keywords : diamond * RISE microscopy Subject RIV: BH - Optics, Masers, Lasers OBOR OECD: Optics (including laser optics and quantum optics) Impact factor: 1.891, year: 2016

Development of fiber lasers and devices for coherent Raman scattering microscopy

Science.gov (United States)

Lamb, Erin Stranford

As ultrafast laser technology has found expanding application in machining, spectroscopy, microscopy, surgery, and numerous other areas, the desire for inexpensive and robust laser sources has grown. Until recently, nonlinear effects in fiber systems due to the tight confinement of the light in the core have limited their performance. However, with advances in managing nonlinearity through pulse propagation physics and the use of large core fibers, the performance of fiber lasers can compete with that of their solid-state counterparts. As specific applications, such as coherent Raman scattering microscopy, emerge that stand to benefit from fiber technology, new performance challenges in areas such as laser noise are anticipated. This thesis studies nonlinear pulse propagation in fiber lasers and fiber parametric devices. Applications of dissipative solitons and self-similar pulse propagation to low-repetition rate oscillators that have the potential to simplify short-pulse amplification schemes will be examined. The rest of this thesis focuses on topics relevant to fiber laser development for coherent Raman scattering microscopy sources. Coherent pulse division and recombination inside the laser cavity will be introduced as an energy-scaling mechanism and demonstrated for a fiber soliton laser. The relative intensity noise properties of mode-locked fiber lasers, with a particular emphasis on normal dispersion lasers, will be explored in simulation and experiment. A fiber optical parametric oscillator will be studied in detail for low noise frequency conversion of picosecond pulses, and its utility for coherent Raman imaging will be demonstrated. Spectral compression of femtosecond pulses is used to generate picosecond pulses to pump this device, and this technique provides a route to future noise reduction in the system. Furthermore, this device forms a multimodal source capable of providing the picosecond pulses for coherent Raman scattering microscopy and the

Investigation of multimodal forward scatter phenotyping from bacterial colonies

Science.gov (United States)

Kim, Huisung

A rapid, label-free, and elastic light scattering (ELS) based bacterial colony phenotyping technology, bacterial rapid detection using optical scattering technology (BARDOT) provides a successful classification of several bacterial genus and species. For a thorough understanding of the phenomena and overcoming the limitations of the previous design, five additional modalities from a bacterial colony: 3D morphology, spatial optical density (OD) distribution, spectral forward scattering pattern, spectral OD, and surface backward reflection pattern are proposed to enhance the classification/identification ratio, and the feasibilities of each modality are verified. For the verification, three different instruments: integrated colony morphology analyzer (ICMA), multi-spectral BARDOT (MS-BARDOT) , and multi-modal BARDOT (MM-BARDOT) are proposed and developed. The ICMA can measure 3D morphology and spatial OD distribution of the colony simultaneously. A commercialized confocal displacement meter is used to measure the profiles of the bacterial colonies, together with a custom built optical density measurement unit to interrogate the biophysics behind the collective behavior of a bacterial colony. The system delivers essential information related to the quantitative growth dynamics (height, diameter, aspect ratio, optical density) of the bacterial colony, as well as, a relationship in between the morphological characteristics of the bacterial colony and its forward scattering pattern. Two different genera: Escherichia coli O157:H7 EDL933, and Staphylococcus aureus ATCC 25923 are selected for the analysis of the spatially resolved growth dynamics, while, Bacillus spp. such as B. subtilis ATCC 6633, B. cereus ATCC 14579, B. thuringiensis DUP6044, B. polymyxa B719W, and B. megaterium DSP 81319, are interrogated since some of the Bacillus spp. provides strikingly different characteristics of ELS patterns, and the origin of the speckle patterns are successfully correlated with

The Multimodal Possibilities of Online Instructions

DEFF Research Database (Denmark)

Kampf, Constance

2006-01-01

The WWW simplifies the process of delivering online instructions through multimodal channels because of the ease of use for voice, video, pictures, and text modes of communication built into it.  Given that instructions are being produced in multimodal format for the WWW, how do multi-modal analy......The WWW simplifies the process of delivering online instructions through multimodal channels because of the ease of use for voice, video, pictures, and text modes of communication built into it.  Given that instructions are being produced in multimodal format for the WWW, how do multi...

easySTORM: a robust, lower-cost approach to localisation and TIRF microscopy.

Science.gov (United States)

Kwakwa, Kwasi; Savell, Alexander; Davies, Timothy; Munro, Ian; Parrinello, Simona; Purbhoo, Marco A; Dunsby, Chris; Neil, Mark A A; French, Paul M W

2016-09-01

TIRF and STORM microscopy are super-resolving fluorescence imaging modalities for which current implementations on standard microscopes can present significant complexity and cost. We present a straightforward and low-cost approach to implement STORM and TIRF taking advantage of multimode optical fibres and multimode diode lasers to provide the required excitation light. Combined with open source software and relatively simple protocols to prepare samples for STORM, including the use of Vectashield for non-TIRF imaging, this approach enables TIRF and STORM imaging of cells labelled with appropriate dyes or expressing suitable fluorescent proteins to become widely accessible at low cost. © 2016 The Authors. Journal of Biophotonics published by WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Multimodality imaging techniques.

Science.gov (United States)

Martí-Bonmatí, Luis; Sopena, Ramón; Bartumeus, Paula; Sopena, Pablo

2010-01-01

In multimodality imaging, the need to combine morphofunctional information can be approached by either acquiring images at different times (asynchronous), and fused them through digital image manipulation techniques or simultaneously acquiring images (synchronous) and merging them automatically. The asynchronous post-processing solution presents various constraints, mainly conditioned by the different positioning of the patient in the two scans acquired at different times in separated machines. The best solution to achieve consistency in time and space is obtained by the synchronous image acquisition. There are many multimodal technologies in molecular imaging. In this review we will focus on those multimodality image techniques more commonly used in the field of diagnostic imaging (SPECT-CT, PET-CT) and new developments (as PET-MR). The technological innovations and development of new tracers and smart probes are the main key points that will condition multimodality image and diagnostic imaging professionals' future. Although SPECT-CT and PET-CT are standard in most clinical scenarios, MR imaging has some advantages, providing excellent soft-tissue contrast and multidimensional functional, structural and morphological information. The next frontier is to develop efficient detectors and electronics systems capable of detecting two modality signals at the same time. Not only PET-MR but also MR-US or optic-PET will be introduced in clinical scenarios. Even more, MR diffusion-weighted, pharmacokinetic imaging, spectroscopy or functional BOLD imaging will merge with PET tracers to further increase molecular imaging as a relevant medical discipline. Multimodality imaging techniques will play a leading role in relevant clinical applications. The development of new diagnostic imaging research areas, mainly in the field of oncology, cardiology and neuropsychiatry, will impact the way medicine is performed today. Both clinical and experimental multimodality studies, in

Multimodality Registration without a Dedicated Multimodality Scanner

Directory of Open Access Journals (Sweden)

Bradley J. Beattie

2007-03-01

Full Text Available Multimodality scanners that allow the acquisition of both functional and structural image sets on a single system have recently become available for animal research use. Although the resultant registered functional/structural image sets can greatly enhance the interpretability of the functional data, the cost of multimodality systems can be prohibitive, and they are often limited to two modalities, which generally do not include magnetic resonance imaging. Using a thin plastic wrap to immobilize and fix a mouse or other small animal atop a removable bed, we are able to calculate registrations between all combinations of four different small animal imaging scanners (positron emission tomography, single-photon emission computed tomography, magnetic resonance, and computed tomography [CT] at our disposal, effectively equivalent to a quadruple-modality scanner. A comparison of serially acquired CT images, with intervening acquisitions on other scanners, demonstrates the ability of the proposed procedures to maintain the rigidity of an anesthetized mouse during transport between scanners. Movement of the bony structures of the mouse was estimated to be 0.62 mm. Soft tissue movement was predominantly the result of the filling (or emptying of the urinary bladder and thus largely constrained to this region. Phantom studies estimate the registration errors for all registration types to be less than 0.5 mm. Functional images using tracers targeted to known structures verify the accuracy of the functional to structural registrations. The procedures are easy to perform and produce robust and accurate results that rival those of dedicated multimodality scanners, but with more flexible registration combinations and while avoiding the expense and redundancy of multimodality systems.

In-situ Multimodal Imaging and Spectroscopy of Mg Electrodeposition at Electrode-Electrolyte Interfaces

Science.gov (United States)

Wu, Yimin A.; Yin, Zuwei; Farmand, Maryam; Yu, Young-Sang; Shapiro, David A.; Liao, Hong-Gang; Liang, Wen-I.; Chu, Ying-Hao; Zheng, Haimei

2017-02-01

We report the study of Mg cathodic electrochemical deposition on Ti and Au electrode using a multimodal approach by examining the sample area in-situ using liquid cell transmission electron microscopy (TEM), scanning transmission X-ray microscopy (STXM) and X-ray absorption spectroscopy (XAS). Magnesium Aluminum Chloride Complex was synthesized and utilized as electrolyte, where non-reversible features during in situ charging-discharging cycles were observed. During charging, a uniform Mg film was deposited on the electrode, which is consistent with the intrinsic non-dendritic nature of Mg deposition in Mg ion batteries. The Mg thin film was not dissolvable during the following discharge process. We found that such Mg thin film is hexacoordinated Mg compounds by in-situ STXM and XAS. This study provides insights on the non-reversibility issue and failure mechanism of Mg ion batteries. Also, our method provides a novel generic method to understand the in situ battery chemistry without any further sample processing, which can preserve the original nature of battery materials or electrodeposited materials. This multimodal in situ imaging and spectroscopy provides many opportunities to attack complex problems that span orders of magnitude in length and time scale, which can be applied to a broad range of the energy storage systems.

Focusing and imaging with increased numerical apertures through multimode fibers with micro-fabricated optics

KAUST Repository

Bianchi, Silvio; Rajamanickam, V.; Ferrara, Lorenzo; Di Fabrizio, Enzo M.; Liberale, Carlo; Di Leonardo, Roberto

2013-01-01

The use of individual multimode optical fibers in endoscopy applications has the potential to provide highly miniaturized and noninvasive probes for microscopy and optical micromanipulation. A few different strategies have been proposed recently, but they all suffer from intrinsically low resolution related to the low numerical aperture of multimode fibers. Here, we show that two-photon polymerization allows for direct fabrication of micro-optics components on the fiber end, resulting in an increase of the numerical aperture to a value that is close to 1. Coupling light into the fiber through a spatial light modulator, we were able to optically scan a submicrometer spot (300 nm FWHM) over an extended region, facing the opposite fiber end. Fluorescence imaging with improved resolution is also demonstrated. © 2013 Optical Society of America.

Hybrid confocal Raman fluorescence microscopy on single cells using semiconductor quantum dots

NARCIS (Netherlands)

van Manen, H.J.; Otto, Cornelis

2007-01-01

We have overcome the traditional incompatibility of Raman microscopy with fluorescence microscopy by exploiting the optical properties of semiconductor fluorescent quantum dots (QDs). Here we present a hybrid Raman fluorescence spectral imaging approach for single-cell microscopy applications. We

Mate choice in the eye and ear of the beholder? Female multimodal sensory configuration influences her preferences.

Science.gov (United States)

Ronald, Kelly L; Fernández-Juricic, Esteban; Lucas, Jeffrey R

2018-05-16

A common assumption in sexual selection studies is that receivers decode signal information similarly. However, receivers may vary in how they rank signallers if signal perception varies with an individual's sensory configuration. Furthermore, receivers may vary in their weighting of different elements of multimodal signals based on their sensory configuration. This could lead to complex levels of selection on signalling traits. We tested whether multimodal sensory configuration could affect preferences for multimodal signals. We used brown-headed cowbird ( Molothrus ater ) females to examine how auditory sensitivity and auditory filters, which influence auditory spectral and temporal resolution, affect song preferences, and how visual spatial resolution and visual temporal resolution, which influence resolution of a moving visual signal, affect visual display preferences. Our results show that multimodal sensory configuration significantly affects preferences for male displays: females with better auditory temporal resolution preferred songs that were shorter, with lower Wiener entropy, and higher frequency; and females with better visual temporal resolution preferred males with less intense visual displays. Our findings provide new insights into mate-choice decisions and receiver signal processing. Furthermore, our results challenge a long-standing assumption in animal communication which can affect how we address honest signalling, assortative mating and sensory drive. © 2018 The Author(s).

Multimodal fluorescence imaging spectroscopy

NARCIS (Netherlands)

Stopel, Martijn H W; Blum, Christian; Subramaniam, Vinod; Engelborghs, Yves; Visser, Anthonie J.W.G.

2014-01-01

Multimodal fluorescence imaging is a versatile method that has a wide application range from biological studies to materials science. Typical observables in multimodal fluorescence imaging are intensity, lifetime, excitation, and emission spectra which are recorded at chosen locations at the sample.

Tissue imaging using full field optical coherence microscopy with short multimode fiber probe

Science.gov (United States)

Sato, Manabu; Eto, Kai; Goto, Tetsuhiro; Kurotani, Reiko; Abe, Hiroyuki; Nishidate, Izumi

2018-03-01

In achieving minimally invasive accessibility to deeply located regions the size of the imaging probes is important. We demonstrated full-field optical coherence tomography (FF-OCM) using an ultrathin forward-imaging short multimode fiber (SMMF) probe of 50 μm core diameter, 125 μm diameter, and 7.4 mm length for optical communications. The axial resolution was measured to be 2.14 μm and the lateral resolution was also evaluated to be below 4.38 μm using a test pattern (TP). The spatial mode and polarization characteristics of SMMF were evaluated. Inserting SMMF to in vivo rat brain, 3D images were measured and 2D information of nerve fibers was obtained. The feasibility of an SMMF as an ultrathin forward-imaging probe in FF-OCM has been demonstrated.

Nanoparticle discrimination based on wavelength and lifetime-multiplexed cathodoluminescence microscopy

NARCIS (Netherlands)

Garming, Mathijs W H; Weppelman, I Gerward C; de Boer, Pascal; Martínez, Felipe Perona; Schirhagl, Romana; Hoogenboom, Jacob P; Moerland, Robert J

2017-01-01

Nanomaterials can be identified in high-resolution electron microscopy images using spectrally-selective cathodoluminescence. Capabilities for multiplex detection can however be limited, e.g., due to spectral overlap or availability of filters. Also, the available photon flux may be limited due to

Near-infrared multispectral photoacoustic microscopy using a graded-index fiber amplifier

Directory of Open Access Journals (Sweden)

Takashi Buma

2016-09-01

Full Text Available We demonstrate optical resolution photoacoustic microscopy (OR-PAM of lipid-rich tissue using a multi-wavelength pulsed laser based on nonlinear fiber optics. 1047 nm laser pulses are converted to 1098, 1153, 1215, and 1270 nm pulses via stimulated Raman scattering in a graded-index multimode fiber. Multispectral PAM of a lipid phantom is demonstrated with our low-cost and simple technique.

Inorganic Nanoparticles for Multimodal Molecular Imaging

Directory of Open Access Journals (Sweden)

Magdalena Swierczewska

2011-01-01

Full Text Available Multimodal molecular imaging can offer a synergistic improvement of diagnostic ability over a single imaging modality. Recent development of hybrid imaging systems has profoundly impacted the pool of available multimodal imaging probes. In particular, much interest has been focused on biocompatible, inorganic nanoparticle-based multimodal probes. Inorganic nanoparticles offer exceptional advantages to the field of multimodal imaging owing to their unique characteristics, such as nanometer dimensions, tunable imaging properties, and multifunctionality. Nanoparticles mainly based on iron oxide, quantum dots, gold, and silica have been applied to various imaging modalities to characterize and image specific biologic processes on a molecular level. A combination of nanoparticles and other materials such as biomolecules, polymers, and radiometals continue to increase functionality for in vivo multimodal imaging and therapeutic agents. In this review, we discuss the unique concepts, characteristics, and applications of the various multimodal imaging probes based on inorganic nanoparticles.

Multimodality in organization studies

DEFF Research Database (Denmark)

Van Leeuwen, Theo

2017-01-01

This afterword reviews the chapters in this volume and reflects on the synergies between organization and management studies and multimodality studies that emerge from the volume. These include the combination of strong sociological theorizing and detailed multimodal analysis, a focus on material...

Biodistribution of arctigenin-loaded nanoparticles designed for multimodal imaging.

Science.gov (United States)

Cui, Qingxin; Hou, Yuanyuan; Wang, Yanan; Li, Xu; Liu, Yang; Ma, Xiaoyao; Wang, Zengyong; Wang, Weiya; Tao, Jin; Wang, Qian; Jiang, Min; Chen, Dongyan; Feng, Xizeng; Bai, Gang

2017-04-07

Tracking targets of natural products is one of the most challenging issues in fields ranging from pharmacognosy to biomedicine. It is widely recognized that the biocompatible nanoparticle (NP) could function as a "key" that opens the target "lock". We report a functionalized poly-lysine NP technique that can monitor the target protein of arctigenin (ATG) in vivo non-invasively. The NPs were synthesized, and their morphologies and surface chemical properties were characterized by transmission electron microscopy (TEM), laser particle size analysis and atomic force microscopy (AFM). In addition, we studied the localization of ATG at the level of the cell and the whole animal (zebrafish and mice). We demonstrated that fluorescent NPs could be ideal carriers in the development of a feasible method for target identification. The distributions of the target proteins were found to be consistent with the pharmacological action of ATG at the cellular and whole-organism levels. The results indicated that functionalized poly-lysine NPs could be valuable in the multimodal imaging of arctigenin.

Practical multimodal care for cancer cachexia.

Science.gov (United States)

Maddocks, Matthew; Hopkinson, Jane; Conibear, John; Reeves, Annie; Shaw, Clare; Fearon, Ken C H

2016-12-01

Cancer cachexia is common and reduces function, treatment tolerability and quality of life. Given its multifaceted pathophysiology a multimodal approach to cachexia management is advocated for, but can be difficult to realise in practice. We use a case-based approach to highlight practical approaches to the multimodal management of cachexia for patients across the cancer trajectory. Four cases with lung cancer spanning surgical resection, radical chemoradiotherapy, palliative chemotherapy and no anticancer treatment are presented. We propose multimodal care approaches that incorporate nutritional support, exercise, and anti-inflammatory agents, on a background of personalized oncology care and family-centred education. Collectively, the cases reveal that multimodal care is part of everyone's remit, often focuses on supported self-management, and demands buy-in from the patient and their family. Once operationalized, multimodal care approaches can be tested pragmatically, including alongside emerging pharmacological cachexia treatments. We demonstrate that multimodal care for cancer cachexia can be achieved using simple treatments and without a dedicated team of specialists. The sharing of advice between health professionals can help build collective confidence and expertise, moving towards a position in which every team member feels they can contribute towards multimodal care.

Multimodal segmentation of optic disc and cup from stereo fundus and SD-OCT images

Science.gov (United States)

Miri, Mohammad Saleh; Lee, Kyungmoo; Niemeijer, Meindert; Abràmoff, Michael D.; Kwon, Young H.; Garvin, Mona K.

2013-03-01

Glaucoma is one of the major causes of blindness worldwide. One important structural parameter for the diagnosis and management of glaucoma is the cup-to-disc ratio (CDR), which tends to become larger as glaucoma progresses. While approaches exist for segmenting the optic disc and cup within fundus photographs, and more recently, within spectral-domain optical coherence tomography (SD-OCT) volumes, no approaches have been reported for the simultaneous segmentation of these structures within both modalities combined. In this work, a multimodal pixel-classification approach for the segmentation of the optic disc and cup within fundus photographs and SD-OCT volumes is presented. In particular, after segmentation of other important structures (such as the retinal layers and retinal blood vessels) and fundus-to-SD-OCT image registration, features are extracted from both modalities and a k-nearest-neighbor classification approach is used to classify each pixel as cup, rim, or background. The approach is evaluated on 70 multimodal image pairs from 35 subjects in a leave-10%-out fashion (by subject). A significant improvement in classification accuracy is obtained using the multimodal approach over that obtained from the corresponding unimodal approach (97.8% versus 95.2%; p < 0:05; paired t-test).

A Learning Algorithm for Multimodal Grammar Inference.

Science.gov (United States)

D'Ulizia, A; Ferri, F; Grifoni, P

2011-12-01

The high costs of development and maintenance of multimodal grammars in integrating and understanding input in multimodal interfaces lead to the investigation of novel algorithmic solutions in automating grammar generation and in updating processes. Many algorithms for context-free grammar inference have been developed in the natural language processing literature. An extension of these algorithms toward the inference of multimodal grammars is necessary for multimodal input processing. In this paper, we propose a novel grammar inference mechanism that allows us to learn a multimodal grammar from its positive samples of multimodal sentences. The algorithm first generates the multimodal grammar that is able to parse the positive samples of sentences and, afterward, makes use of two learning operators and the minimum description length metrics in improving the grammar description and in avoiding the over-generalization problem. The experimental results highlight the acceptable performances of the algorithm proposed in this paper since it has a very high probability of parsing valid sentences.

All-fiber multimode interference micro-displacement sensor

International Nuclear Information System (INIS)

Antonio-Lopez, J E; LiKamWa, P; Sanchez-Mondragon, J J; May-Arrioja, D A

2013-01-01

We report an all-fiber micro-displacement sensor based on multimode interference (MMI) effects. The micro-displacement sensor consists of a segment of No-Core multimode fiber (MMF) with one end spliced to a segment of single mode fiber (SMF) which acts as the input. The other end of the MMF and another SMF are inserted into a capillary ferrule filled with index matching liquid. Since the refractive index of the liquid is higher than that of the ferrule, a liquid MMF with a diameter of 125 µm is formed between the fibers inside the ferrule. When the fibers are separated this effectively increases the length of the MMF. Since the peak wavelength response of MMI devices is very sensitive to changes in the MMF's length, this can be used to detect micro-displacements. By measuring spectral changes we have obtained a sensing range of 3 mm with a sensitivity of 25 nm mm −1 and a resolution of 20 µm. The sensor can also be used to monitor small displacements by using a single wavelength to interrogate the transmission of the MMI device close to the resonance peak. Under this latter regime we were able to obtain a sensitivity of 7000 mV mm −1 and a sensing range of 100 µm, with a resolution up to 1 µm. The simplicity and versatility of the sensor make it very suitable for many diverse applications. (paper)

Multimodal Aspects of Corporate Social Responsibility Communication

Directory of Open Access Journals (Sweden)

Carmen Daniela Maier

2014-12-01

Full Text Available This article addresses how the multimodal persuasive strategies of corporate social responsibility communication can highlight a company’s commitment to gender empowerment and environmental protection while advertising simultaneously its products. Drawing on an interdisciplinary methodological framework related to CSR communication, multimodal discourse analysis and gender theory, the article proposes a multimodal analysis model through which it is possible to map and explain the multimodal persuasive strategies employed by Coca-Cola company in their community-related films. By examining the semiotic modes’ interconnectivity and functional differentiation, this analytical endeavour expands the existing research work as the usual textual focus is extended to a multimodal one.

Multimodal sequence learning.

Science.gov (United States)

Kemény, Ferenc; Meier, Beat

2016-02-01

While sequence learning research models complex phenomena, previous studies have mostly focused on unimodal sequences. The goal of the current experiment is to put implicit sequence learning into a multimodal context: to test whether it can operate across different modalities. We used the Task Sequence Learning paradigm to test whether sequence learning varies across modalities, and whether participants are able to learn multimodal sequences. Our results show that implicit sequence learning is very similar regardless of the source modality. However, the presence of correlated task and response sequences was required for learning to take place. The experiment provides new evidence for implicit sequence learning of abstract conceptual representations. In general, the results suggest that correlated sequences are necessary for implicit sequence learning to occur. Moreover, they show that elements from different modalities can be automatically integrated into one unitary multimodal sequence. Copyright © 2015 Elsevier B.V. All rights reserved.

TeraSCREEN: multi-frequency multi-mode Terahertz screening for border checks

Science.gov (United States)

Alexander, Naomi E.; Alderman, Byron; Allona, Fernando; Frijlink, Peter; Gonzalo, Ramón; Hägelen, Manfred; Ibáñez, Asier; Krozer, Viktor; Langford, Marian L.; Limiti, Ernesto; Platt, Duncan; Schikora, Marek; Wang, Hui; Weber, Marc Andree

2014-06-01

The challenge for any security screening system is to identify potentially harmful objects such as weapons and explosives concealed under clothing. Classical border and security checkpoints are no longer capable of fulfilling the demands of today's ever growing security requirements, especially with respect to the high throughput generally required which entails a high detection rate of threat material and a low false alarm rate. TeraSCREEN proposes to develop an innovative concept of multi-frequency multi-mode Terahertz and millimeter-wave detection with new automatic detection and classification functionalities. The system developed will demonstrate, at a live control point, the safe automatic detection and classification of objects concealed under clothing, whilst respecting privacy and increasing current throughput rates. This innovative screening system will combine multi-frequency, multi-mode images taken by passive and active subsystems which will scan the subjects and obtain complementary spatial and spectral information, thus allowing for automatic threat recognition. The TeraSCREEN project, which will run from 2013 to 2016, has received funding from the European Union's Seventh Framework Programme under the Security Call. This paper will describe the project objectives and approach.

Histopathology in 3D: From three-dimensional reconstruction to multi-stain and multi-modal analysis

Directory of Open Access Journals (Sweden)

Derek Magee

2015-01-01

Full Text Available Light microscopy applied to the domain of histopathology has traditionally been a two-dimensional imaging modality. Several authors, including the authors of this work, have extended the use of digital microscopy to three dimensions by stacking digital images of serial sections using image-based registration. In this paper, we give an overview of our approach, and of extensions to the approach to register multi-modal data sets such as sets of interleaved histopathology sections with different stains, and sets of histopathology images to radiology volumes with very different appearance. Our approach involves transforming dissimilar images into a multi-channel representation derived from co-occurrence statistics between roughly aligned images.

Evans blue dye-enhanced imaging of the brain microvessels using spectral focusing coherent anti-Stokes Raman scattering microscopy.

Directory of Open Access Journals (Sweden)

Bo-Ram Lee

Full Text Available We performed dye-enhanced imaging of mouse brain microvessels using spectral focusing coherent anti-Stokes Raman scattering (SF-CARS microscopy. The resonant signals from C-H stretching in forward CARS usually show high background intensity in tissues, which makes CARS imaging of microvessels difficult. In this study, epi-detection of back-scattered SF-CARS signals showed a negligible background, but the overall intensity of resonant CARS signals was too low to observe the network of brain microvessels. Therefore, Evans blue (EB dye was used as contrasting agent to enhance the back-scattered SF-CARS signals. Breakdown of brain microvessels by inducing hemorrhage in a mouse was clearly visualized using backward SF-CARS signals, following intravenous injection of EB. The improved visualization of brain microvessels with EB enhanced the sensitivity of SF-CARS, detecting not only the blood vessels themselves but their integrity as well in the brain vasculature.

Multimodal Processes Rescheduling

DEFF Research Database (Denmark)

Bocewicz, Grzegorz; Banaszak, Zbigniew A.; Nielsen, Peter

2013-01-01

Cyclic scheduling problems concerning multimodal processes are usually observed in FMSs producing multi-type parts where the Automated Guided Vehicles System (AGVS) plays a role of a material handling system. Schedulability analysis of concurrently flowing cyclic processes (SCCP) exe-cuted in the......Cyclic scheduling problems concerning multimodal processes are usually observed in FMSs producing multi-type parts where the Automated Guided Vehicles System (AGVS) plays a role of a material handling system. Schedulability analysis of concurrently flowing cyclic processes (SCCP) exe...

A multimodal instrument for real-time in situ study of ultrasound and cavitation mediated drug delivery

OpenAIRE

Bian, S; Seth, A; Daly, D; Carlisle, R; Stride, E

2017-01-01

The development of a multimodal instrument capable of real-time in situ measurements of cavitation activity and effect in tissue mimicking phantoms during ultrasound and cavitation mediated drug delivery experiments is described here. The instrument features an acoustic arm that can expose phantoms to high-intensity focused-ultrasound while measuring cavitation activity and an optical arm that monitors cavitation effect using confocal microscopy. This combination of modalities allows real-tim...

Multimodal Resources in Transnational Adoption

DEFF Research Database (Denmark)

Raudaskoski, Pirkko Liisa

The paper discusses an empirical analysis which highlights the multimodal nature of identity construction. A documentary on transnational adoption provides real life incidents as research material. The incidents involve (or from them emerge) various kinds of multimodal resources and participants...

Multimodal Diversity of Postmodernist Fiction Text

Directory of Open Access Journals (Sweden)

U. I. Tykha

2016-12-01

Full Text Available The article is devoted to the analysis of structural and functional manifestations of multimodal diversity in postmodernist fiction texts. Multimodality is defined as the coexistence of more than one semiotic mode within a certain context. Multimodal texts feature a diversity of semiotic modes in the communication and development of their narrative. Such experimental texts subvert conventional patterns by introducing various semiotic resources – verbal or non-verbal.

Experiments in Multimodal Information Presentation

NARCIS (Netherlands)

van Hooijdonk, Charlotte; Bosma, W.E.; Krahmer, Emiel; Maes, Alfons; Theune, Mariet; van den Bosch, Antal; Bouma, Gosse

In this chapter we describe three experiments investigating multimodal information presentation in the context of a medical QA system. In Experiment 1, we wanted to know how non-experts design (multimodal) answers to medical questions, distinguishing between what questions and how questions. In

Modeling multimodal human-computer interaction

NARCIS (Netherlands)

Obrenovic, Z.; Starcevic, D.

2004-01-01

Incorporating the well-known Unified Modeling Language into a generic modeling framework makes research on multimodal human-computer interaction accessible to a wide range off software engineers. Multimodal interaction is part of everyday human discourse: We speak, move, gesture, and shift our gaze

Multimodal microscopy of immune cells and melanoma for longitudinal studies

Science.gov (United States)

Entenberg, David; Aranda, Iana; Li, Yongbiao; Toledo-Crow, Ricardo; Schaer, David; Li, Yanyun

2006-02-01

Intravital microscopy of cancer is a well established tool that provides direct visualization of the tumor cycle. It traditionally involves one of several strategies: invasive subcutaneous (SC) implantation of tumors followed by surgical opening of skin flaps for imaging, techniques utilizing skin fold chambers and implanted optical windows or intradermal injections under 200μm from the skin surface. All of these techniques allow the use of fluorescent proteins as markers for biologically significant constituents. However, observation methods utilizing skin-flaps, skin-fold chambers and optical windows are invasive and tend to alter the immune environment of the tissue and/or limit the duration of studies that can be performed. If implanted correctly, intradermally injected tumors can be minimally invasive, will not require biopsies or surgical intervention to observe and are accessible for direct transdermal imaging with a number of in vivo modalities. We present our work in the development of a small animal intravital microscopy workstation that allows the acquisition of different contrast imaging modalities: reflectance confocal, wide field epifluorescence, multiphoton and second harmonic generation (SHG). The images are acquired pair-wise simultaneously and sequentially in time. The aim of our instrumentation is to gather all information generated by the single probing beam via the reflected or back-scattered signal, SHG signal and various fluorescence signals. Additionally, we also present our development of a microscopic tissue navigation technique to mark, label and track sites of interest. This technique enables us to revisit sites periodically and record, with different imaging contrasts, their biological changes over time.

Multimodal Discourse Analysis of the Movie "Argo"

Science.gov (United States)

Bo, Xu

2018-01-01

Based on multimodal discourse theory, this paper makes a multimodal discourse analysis of some shots in the movie "Argo" from the perspective of context of culture, context of situation and meaning of image. Results show that this movie constructs multimodal discourse through particular context, language and image, and successfully…

Multimodal exemplification: The expansion of meaning in electronic ...

African Journals Online (AJOL)

Functional Multimodal Discourse Analysis (SF-MDA) and argues for improving their exemplifica-tion multimodally. Multimodal devices, if well coordinated, can help optimize e-dictionary exam-ples in informativity, diversity, dynamicity and ...

A multimodal 3D framework for fire characteristics estimation

Science.gov (United States)

Toulouse, T.; Rossi, L.; Akhloufi, M. A.; Pieri, A.; Maldague, X.

2018-02-01

In the last decade we have witnessed an increasing interest in using computer vision and image processing in forest fire research. Image processing techniques have been successfully used in different fire analysis areas such as early detection, monitoring, modeling and fire front characteristics estimation. While the majority of the work deals with the use of 2D visible spectrum images, recent work has introduced the use of 3D vision in this field. This work proposes a new multimodal vision framework permitting the extraction of the three-dimensional geometrical characteristics of fires captured by multiple 3D vision systems. The 3D system is a multispectral stereo system operating in both the visible and near-infrared (NIR) spectral bands. The framework supports the use of multiple stereo pairs positioned so as to capture complementary views of the fire front during its propagation. Multimodal registration is conducted using the captured views in order to build a complete 3D model of the fire front. The registration process is achieved using multisensory fusion based on visual data (2D and NIR images), GPS positions and IMU inertial data. Experiments were conducted outdoors in order to show the performance of the proposed framework. The obtained results are promising and show the potential of using the proposed framework in operational scenarios for wildland fire research and as a decision management system in fighting.

Metabolic Mapping of Breast Cancer with Multiphoton Spectral and Lifetime Imaging

Science.gov (United States)

2007-03-01

2002. Spectrally resolved fluorescence lifetime imaging microscopy. Appl. Spec- trosc. 56 :155-166. 38. Becker, W., A. Bergmann, E. Haustein , Z...photon fluores- cence lifetime imaging microscopy of macrophage-mediated antigen processing. J. Microsc. 185 :339-353. 45. Lin, H.J., P. Herman , and

Hyperspectral light sheet microscopy

Science.gov (United States)

Jahr, Wiebke; Schmid, Benjamin; Schmied, Christopher; Fahrbach, Florian O.; Huisken, Jan

2015-09-01

To study the development and interactions of cells and tissues, multiple fluorescent markers need to be imaged efficiently in a single living organism. Instead of acquiring individual colours sequentially with filters, we created a platform based on line-scanning light sheet microscopy to record the entire spectrum for each pixel in a three-dimensional volume. We evaluated data sets with varying spectral sampling and determined the optimal channel width to be around 5 nm. With the help of these data sets, we show that our setup outperforms filter-based approaches with regard to image quality and discrimination of fluorophores. By spectral unmixing we resolved overlapping fluorophores with up to nanometre resolution and removed autofluorescence in zebrafish and fruit fly embryos.

Lobster eye as a collector for water window microscopy

Science.gov (United States)

Pina, L.; Maršíková, V.; Inneman, A.; Nawaz, M. F.; Jančárek, A.; Havlíková, R.

2017-08-01

Imaging in EUV, SXR and XR spectral bands of radiation is of increasing interest. Material science, biology and hot plasma are examples of relevant fast developing areas. Applications include spectroscopy, astrophysics, Soft X-ray Ray metrology, Water Window microscopy, radiography and tomography. Especially Water Window imaging has still not fully recognized potential in biology and medicine microscopy applications. Theoretical study and design of Lobster Eye (LE) optics as a collector for water window (WW) microscopy and comparison with a similar size ellipsoidal mirror condensor are presented.

Single-wavelength functional photoacoustic microscopy in biological tissue.

Science.gov (United States)

Danielli, Amos; Favazza, Christopher P; Maslov, Konstantin; Wang, Lihong V

2011-03-01

Recently, we developed a reflection-mode relaxation photoacoustic microscope, based on saturation intensity, to measure picosecond relaxation times using a nanosecond laser. Here, using the different relaxation times of oxygenated and deoxygenated hemoglobin molecules, both possessing extremely low fluorescence quantum yields, the oxygen saturation was quantified in vivo with single-wavelength photoacoustic microscopy. All previous functional photoacoustic microscopy measurements required imaging with multiple-laser-wavelength measurements to quantify oxygen saturation. Eliminating the need for multiwavelength measurements removes the influence of spectral properties on oxygenation calculations and improves the portability and cost-effectiveness of functional or molecular photoacoustic microscopy.

Broadband multiplex coherent anti-Stokes Raman scattering microscopy employing photonic-crystal fibers

DEFF Research Database (Denmark)

Andresen, Esben Ravn; Paulsen, Henrik Nørgaard; Birkedal, Victoria

2006-01-01

We demonstrate spectral multiplex coherent anti-Stokes Raman scattering (CARS) spectroscopy and microscopy based on a single Ti:sapphire oscillator and a nonlinear photonic-crystal fiber (PCF). The Stokes pulse is generated by spectral conversion of the laser pulse in a PCF. The pump pulse is eit...

Multimodal Broadband Vibrational Sum Frequency Generation (MM-BB-V-SFG) Spectrometer and Microscope.

Science.gov (United States)

Lee, Christopher M; Kafle, Kabindra; Huang, Shixin; Kim, Seong H

2016-01-14

A broadband sum frequency generation (BB-SFG) spectrometer with multimodal (MM) capabilities was constructed, which could be routinely reconfigured for tabletop experiments in reflection, transmission, and total internal reflection (TIR) geometries, as well as microscopic imaging. The system was constructed using a Ti:sapphire amplifier (800 nm, pulse width = 85 fs, repetition rate = 2 kHz), an optical parameter amplification (OPA) system for production of broadband IR pulses tunable between 1000 and 4000 cm(-1), and two Fabry-Pérot etalons arranged in series for production of narrowband 800 nm pulses. The key feature allowing the MM operation was the nearly collinear alignment of the visible (fixed, 800 nm) and infrared (tunable, 1000-4000 cm(-1)) pulses which were spatially separated. Physical insights discussed in this paper include the comparison of spectral bandwidth produced with 40 and 85 fs pump beams, the improvement of spectral resolution using etalons, the SFG probe volume in bulk analysis, the normalization of SFG signals, the stitching of multiple spectral segments, and the operation in different modes for air/liquid and adsorbate/solid interfaces, bulk samples, as well as spectral imaging combined with principle component analysis (PCA). The SFG spectral features obtained with the MM-BB-SFG system were compared with those obtained with picosecond-scanning-SFG system and high-resolution BB-SFG system (HR-BB-SFG) for dimethyl sulfoxide, α-pinene, and various samples containing cellulose (purified commercial products, Cladophora cell wall, cotton and flax fibers, and onion epidermis cell wall).

RELIABILITY OF CONFOCAL MICROSCOPY SPECTRAL IMAGING SYSTEMS: USE OF MULTISPECTRAL BEADS

Science.gov (United States)

Background: There is a need for a standardized, impartial calibration, and validation protocol on confocal spectral imaging (CSI) microscope systems. To achieve this goal, it is necessary to have testing tools to provide a reproducible way to evaluate instrument performance. ...

Reference resolution in multi-modal interaction: Preliminary observations

NARCIS (Netherlands)

González González, G.R.; Nijholt, Antinus

2002-01-01

In this paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can apply

Reference Resolution in Multi-modal Interaction: Position paper

NARCIS (Netherlands)

Fernando, T.; Nijholt, Antinus

2002-01-01

In this position paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can

Multimodality imaging in macular telangiectasia 2: A clue to its pathogenesis

Directory of Open Access Journals (Sweden)

Lihteh Wu

2015-01-01

Full Text Available Macular telangiectasia type 2 also known as idiopathic perifoveal telangiectasia and juxtafoveolar retinal telangiectasis type 2A is an acquired bilateral neurodegenerative macular disease that manifests itself during the fifth or sixth decades of life. It is characterized by minimal dilatation of the parafoveal capillaries with graying of the retinal area involved, a lack of lipid exudation, right-angled retinal venules, refractile deposits in the superficial retina, hyperplasia of the retinal pigment epithelium, foveal atrophy, and subretinal neovascularization (SRNV. Our understanding of the disease has paralleled advances in multimodality imaging of the fundus. Optical coherence tomography (OCT images typically demonstrate the presence of intraretinal hyporeflective spaces that are usually not related to retinal thickening or fluorescein leakage. The typical fluorescein angiographic (FA finding is a deep intraretinal hyperfluorescent staining in the temporal parafoveal area. With time, the staining may involve the whole parafoveal area but does not extend to the center of the fovea. Long-term prognosis for central vision is poor, because of the development of SRNV or macular atrophy. Its pathogenesis remains unclear but multimodality imaging with FA, spectral domain OCT, adaptive optics, confocal blue reflectance and short wave fundus autofluorescence implicate Müller cells and macular pigment. Currently, there is no known treatment for this condition.

Multimodal imaging Gd-nanoparticles functionalized with Pittsburgh compound B or a nanobody for amyloid plaques targeting.

Science.gov (United States)

Pansieri, Jonathan; Plissonneau, Marie; Stransky-Heilkron, Nathalie; Dumoulin, Mireille; Heinrich-Balard, Laurence; Rivory, Pascaline; Morfin, Jean-François; Toth, Eva; Saraiva, Maria Joao; Allémann, Eric; Tillement, Olivier; Forge, Vincent; Lux, François; Marquette, Christel

2017-07-01

Gadolinium-based nanoparticles were functionalized with either the Pittsburgh compound B or a nanobody (B10AP) in order to create multimodal tools for an early diagnosis of amyloidoses. The ability of the functionalized nanoparticles to target amyloid fibrils made of β-amyloid peptide, amylin or Val30Met-mutated transthyretin formed in vitro or from pathological tissues was investigated by a range of spectroscopic and biophysics techniques including fluorescence microscopy. Nanoparticles functionalized by both probes efficiently interacted with the three types of amyloid fibrils, with K D values in 10 micromolar and 10 nanomolar range for, respectively, Pittsburgh compound B and B10AP nanoparticles. Moreover, they allowed the detection of amyloid deposits on pathological tissues. Such functionalized nanoparticles could represent promising flexible and multimodal imaging tools for the early diagnostic of amyloid diseases, in other words, Alzheimer's disease, Type 2 diabetes mellitus and the familial amyloidotic polyneuropathy.

Robust Multimodal Dictionary Learning

Science.gov (United States)

Cao, Tian; Jojic, Vladimir; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

2014-01-01

We propose a robust multimodal dictionary learning method for multimodal images. Joint dictionary learning for both modalities may be impaired by lack of correspondence between image modalities in training data, for example due to areas of low quality in one of the modalities. Dictionaries learned with such non-corresponding data will induce uncertainty about image representation. In this paper, we propose a probabilistic model that accounts for image areas that are poorly corresponding between the image modalities. We cast the problem of learning a dictionary in presence of problematic image patches as a likelihood maximization problem and solve it with a variant of the EM algorithm. Our algorithm iterates identification of poorly corresponding patches and re-finements of the dictionary. We tested our method on synthetic and real data. We show improvements in image prediction quality and alignment accuracy when using the method for multimodal image registration. PMID:24505674

Isometric multimodal photoacoustic microscopy based on optically transparent micro-ring ultrasonic detection.

Science.gov (United States)

Dong, Biqin; Li, Hao; Zhang, Zhen; Zhang, Kevin; Chen, Siyu; Sun, Cheng; Zhang, Hao F

2015-01-01

Photoacoustic microscopy (PAM) is an attractive imaging tool complementary to established optical microscopic modalities by providing additional molecular specificities through imaging optical absorption contrast. While the development of optical resolution photoacoustic microscopy (ORPAM) offers high lateral resolution, the acoustically-determined axial resolution is limited due to the constraint in ultrasonic detection bandwidth. ORPAM with isometric spatial resolution along both axial and lateral direction is yet to be developed. Although recently developed sophisticated optical illumination and reconstruction methods offer improved axial resolution in ORPAM, the image acquisition procedures are rather complicated, limiting their capabilities for high-speed imaging and being easily integrated with established optical microscopic modalities. Here we report an isometric ORPAM based on an optically transparent micro-ring resonator ultrasonic detector and a commercial inverted microscope platform. Owing to the superior spatial resolution and the ease of integrating our ORPAM with established microscopic modalities, single cell imaging with extrinsic fluorescence staining, intrinsic autofluorescence, and optical absorption can be achieved simultaneously. This technique holds promise to greatly improve the accessibility of PAM to the broader biomedical researchers.

Spectral behavior of a low-cost all-fiber component based on untapered multifiber unions

OpenAIRE

Rodriguez Horche, Paloma; López-Amo Sainz, Manuel; Muriel Fernández, Miguel Ángel; Martín Pereda, José Antonio

1989-01-01

Untapered multifiber unions are reported to show a spectral behavior similar to the tapered ones. Their oscillatory behavior does not depend on the biconical regions. This suggests a novel way to make low-cost all-fiber devices with applications as passive components such as optical filters and wavelength multiplexers/demultiplexers. Two types of multimode fibers have been studied and information about the index profile influence has been obtained. Polarization insensitivity and temperature s...

Toward in vivo diagnosis of skin cancer using multimode imaging dermoscopy: (II) molecular mapping of highly pigmented lesions

Science.gov (United States)

Vasefi, Fartash; MacKinnon, Nicholas; Farkas, Daniel L.

2014-03-01

We have developed a multimode imaging dermoscope that combines polarization and hyperspectral imaging with a computationally rapid analytical model. This approach employs specific spectral ranges of visible and near infrared wavelengths for mapping the distribution of specific skin bio-molecules. This corrects for the melanin-hemoglobin misestimation common to other systems, without resorting to complex and computationally intensive tissue optical models that are prone to inaccuracies due to over-modeling. Various human skin measurements including a melanocytic nevus, and venous occlusion conditions were investigated and compared with other ratiometric spectral imaging approaches. Access to the broad range of hyperspectral data in the visible and near-infrared range allows our algorithm to flexibly use different wavelength ranges for chromophore estimation while minimizing melanin-hemoglobin optical signature cross-talk.

Recent developments in multimodality fluorescence imaging probes

Directory of Open Access Journals (Sweden)

Jianhong Zhao

2018-05-01

Full Text Available Multimodality optical imaging probes have emerged as powerful tools that improve detection sensitivity and accuracy, important in disease diagnosis and treatment. In this review, we focus on recent developments of optical fluorescence imaging (OFI probe integration with other imaging modalities such as X-ray computed tomography (CT, magnetic resonance imaging (MRI, positron emission tomography (PET, single-photon emission computed tomography (SPECT, and photoacoustic imaging (PAI. The imaging technologies are briefly described in order to introduce the strengths and limitations of each techniques and the need for further multimodality optical imaging probe development. The emphasis of this account is placed on how design strategies are currently implemented to afford physicochemically and biologically compatible multimodality optical fluorescence imaging probes. We also present studies that overcame intrinsic disadvantages of each imaging technique by multimodality approach with improved detection sensitivity and accuracy. KEY WORDS: Optical imaging, Fluorescence, Multimodality, Near-infrared fluorescence, Nanoprobe, Computed tomography, Magnetic resonance imaging, Positron emission tomography, Single-photon emission computed tomography, Photoacoustic imaging

Multimode-singlemode-multimode fiber sensor for alcohol sensing application

Science.gov (United States)

Rofi'ah, Iftihatur; Hatta, A. M.; Sekartedjo, Sekartedjo

2016-11-01

Alcohol is volatile and flammable liquid which is soluble substances both on polar and non polar substances that has been used in some industrial sectors. Alcohol detection method now widely used one of them is the optical fiber sensor. In this paper used fiber optic sensor based on Multimode-Single-mode-Multimode (MSM) to detect alcohol solution at a concentration range of 0-3%. The working principle of sensor utilizes the modal interference between the core modes and the cladding modes, thus make the sensor sensitive to environmental changes. The result showed that characteristic of the sensor not affect the length of the single-mode fiber (SMF). We obtain that the sensor with a length of 5 mm of single-mode can sensing the alcohol with a sensitivity of 0.107 dB/v%.

Multimodal pain management after arthroscopic surgery

DEFF Research Database (Denmark)

Rasmussen, Sten

Multimodal Pain Management after Arthroscopic Surgery By Sten Rasmussen, M.D. The thesis is based on four randomized controlled trials. The main hypothesis was that multimodal pain treatment provides faster recovery after arthroscopic surgery. NSAID was tested against placebo after knee arthroscopy...

In-fiber modal interferometer based on multimode and double cladding fiber segments for tunable fiber laser applications

Science.gov (United States)

Prieto-Cortés, P.; Álvarez-Tamayo, R. I.; Durán-Sánchez, M.; Castillo-Guzmán, A.; Salceda-Delgado, G.; Ibarra-Escamilla, B.; Kuzin, E. A.; Barcelata-Pinzón, A.; Selvas-Aguilar, R.

2018-02-01

We report an in-fiber structure based on the use of a multimode fiber segment and a double cladding fiber segment, and its application as spectral filter in an erbium-doped fiber laser for selection and tuning of the laser line wavelength. The output transmission of the proposed device exhibit spectrum modulation of the input signal with free spectral range of 21 nm and maximum visibility enhanced to more than 20 dB. The output spectrum of the in-fiber filter is wavelength displaced by bending application which allows a wavelength tuning of the generated laser line in a range of 12 nm. The use of the proposed in-fiber structure is demonstrated as a reliable, simple, and low-cost wavelength filter for tunable fiber lasers design and optical instrumentation applications.

Multimodality, creativity and children's meaning-making: Drawings ...

African Journals Online (AJOL)

Multimodality, creativity and children's meaning-making: Drawings, writings, imaginings. ... Framed by social semiotic theories of communication, multimodal ... to create imaginary worlds and express meanings according to their interests.

Stereoscopic Integrated Imaging Goggles for Multimodal Intraoperative Image Guidance.

Directory of Open Access Journals (Sweden)

Christopher A Mela

Full Text Available We have developed novel stereoscopic wearable multimodal intraoperative imaging and display systems entitled Integrated Imaging Goggles for guiding surgeries. The prototype systems offer real time stereoscopic fluorescence imaging and color reflectance imaging capacity, along with in vivo handheld microscopy and ultrasound imaging. With the Integrated Imaging Goggle, both wide-field fluorescence imaging and in vivo microscopy are provided. The real time ultrasound images can also be presented in the goggle display. Furthermore, real time goggle-to-goggle stereoscopic video sharing is demonstrated, which can greatly facilitate telemedicine. In this paper, the prototype systems are described, characterized and tested in surgeries in biological tissues ex vivo. We have found that the system can detect fluorescent targets with as low as 60 nM indocyanine green and can resolve structures down to 0.25 mm with large FOV stereoscopic imaging. The system has successfully guided simulated cancer surgeries in chicken. The Integrated Imaging Goggle is novel in 4 aspects: it is (a the first wearable stereoscopic wide-field intraoperative fluorescence imaging and display system, (b the first wearable system offering both large FOV and microscopic imaging simultaneously,

Hyper-Spectral Communications, Networking and ATM as Foundation for Safe and Efficient Future Flight: Transcending Aviation Operational Limitations with Diverse and Secure Multi-Band, Multi-Mode, and mmWave Wireless Links: Project Overview, Aviation Communications and New Signaling

Science.gov (United States)

Matolak, David W.

2017-01-01

NASA's Aeronautics Research Mission Directorate (ARMD) has recently solicited proposals and awarded funds for research and development to achieve and exceed the goals envisioned in the ARMD Strategic Implementation Plan (SIP). The Hyper-Spectral Communications and Networking for Air Traffic Management (ATM) (HSCNA) project is the only University Leadership Initiative (ULI) program to address communications and networking (and to a degree, navigation and surveillance). This paper will provide an overview of the HSCNA project, and specifically describe two of the project's technical challenges: comprehensive aviation communications and networking assessment, and proposed multi-band and multimode communications and networking. The primary goals will be described, as will be research and development aimed to achieve and exceed these goals. Some example initial results are also provided.

Towards an intelligent framework for multimodal affective data analysis.

Science.gov (United States)

Poria, Soujanya; Cambria, Erik; Hussain, Amir; Huang, Guang-Bin

2015-03-01

An increasingly large amount of multimodal content is posted on social media websites such as YouTube and Facebook everyday. In order to cope with the growth of such so much multimodal data, there is an urgent need to develop an intelligent multi-modal analysis framework that can effectively extract information from multiple modalities. In this paper, we propose a novel multimodal information extraction agent, which infers and aggregates the semantic and affective information associated with user-generated multimodal data in contexts such as e-learning, e-health, automatic video content tagging and human-computer interaction. In particular, the developed intelligent agent adopts an ensemble feature extraction approach by exploiting the joint use of tri-modal (text, audio and video) features to enhance the multimodal information extraction process. In preliminary experiments using the eNTERFACE dataset, our proposed multi-modal system is shown to achieve an accuracy of 87.95%, outperforming the best state-of-the-art system by more than 10%, or in relative terms, a 56% reduction in error rate. Copyright © 2014 Elsevier Ltd. All rights reserved.

(Re-)Examination of Multimodal Augmented Reality

NARCIS (Netherlands)

Rosa, N.E.; Werkhoven, P.J.; Hürst, W.O.

2016-01-01

The majority of augmented reality (AR) research has been concerned with visual perception, however the move towards multimodality is imminent. At the same time, there is no clear vision of what multimodal AR is. The purpose of this position paper is to consider possible ways of examining AR other

Multimodal integration of anatomy and physiology classes: How instructors utilize multimodal teaching in their classrooms

Science.gov (United States)

McGraw, Gerald M., Jr.

Multimodality is the theory of communication as it applies to social and educational semiotics (making meaning through the use of multiple signs and symbols). The term multimodality describes a communication methodology that includes multiple textual, aural, and visual applications (modes) that are woven together to create what is referred to as an artifact. Multimodal teaching methodology attempts to create a deeper meaning to course content by activating the higher cognitive areas of the student's brain, creating a more sustained retention of the information (Murray, 2009). The introduction of multimodality educational methodologies as a means to more optimally engage students has been documented within educational literature. However, studies analyzing the distribution and penetration into basic sciences, more specifically anatomy and physiology, have not been forthcoming. This study used a quantitative survey design to determine the degree to which instructors integrated multimodality teaching practices into their course curricula. The instrument used for the study was designed by the researcher based on evidence found in the literature and sent to members of three associations/societies for anatomy and physiology instructors: the Human Anatomy and Physiology Society; the iTeach Anatomy & Physiology Collaborate; and the American Physiology Society. Respondents totaled 182 instructor members of two- and four-year, private and public higher learning colleges collected from the three organizations collectively with over 13,500 members in over 925 higher learning institutions nationwide. The study concluded that the expansion of multimodal methodologies into anatomy and physiology classrooms is at the beginning of the process and that there is ample opportunity for expansion. Instructors continue to use lecture as their primary means of interaction with students. Email is still the major form of out-of-class communication for full-time instructors. Instructors with

Multimodale trafiknet i GIS (Multimodal Traffic Network in GIS)

DEFF Research Database (Denmark)

Kronbak, Jacob; Brems, Camilla Riff

1996-01-01

The report introduces the use of multi-modal traffic networks within a geographical Information System (GIS). The necessary theory of modelling multi-modal traffic network is reviewed and applied to the ARC/INFO GIS by an explorative example.......The report introduces the use of multi-modal traffic networks within a geographical Information System (GIS). The necessary theory of modelling multi-modal traffic network is reviewed and applied to the ARC/INFO GIS by an explorative example....

Training of Perceptual Motor Skills in Multimodal Virtual Environments

Directory of Open Access Journals (Sweden)

Gopher Daniel

2011-12-01

Full Text Available Multimodal, immersive, virtual reality (VR techniques open new perspectives for perceptualmotor skill trainers. They also introduce new risks and dangers. This paper describes the benefits and pitfalls of multimodal training and the cognitive building blocks of a multimodal, VR training simulators.

Multimodal processes scheduling in mesh-like network environment

Directory of Open Access Journals (Sweden)

Bocewicz Grzegorz

2015-06-01

Full Text Available Multimodal processes planning and scheduling play a pivotal role in many different domains including city networks, multimodal transportation systems, computer and telecommunication networks and so on. Multimodal process can be seen as a process partially processed by locally executed cyclic processes. In that context the concept of a Mesh-like Multimodal Transportation Network (MMTN in which several isomorphic subnetworks interact each other via distinguished subsets of common shared intermodal transport interchange facilities (such as a railway station, bus station or bus/tram stop as to provide a variety of demand-responsive passenger transportation services is examined. Consider a mesh-like layout of a passengers transport network equipped with different lines including buses, trams, metro, trains etc. where passenger flows are treated as multimodal processes. The goal is to provide a declarative model enabling to state a constraint satisfaction problem aimed at multimodal transportation processes scheduling encompassing passenger flow itineraries. Then, the main objective is to provide conditions guaranteeing solvability of particular transport lines scheduling, i.e. guaranteeing the right match-up of local cyclic acting bus, tram, metro and train schedules to a given passengers flow itineraries.

Mediating multimodal environmental knowledge across animation techniques

DEFF Research Database (Denmark)

Maier, Carmen Daniela

2011-01-01

://www.sustainlane.com/. The multimodal discourse analysis is meant to reveal how selection and representation of environmental knowledge about social actors, social actions, resources, time and space are influenced by animation techniques. Furthermore, in the context of this multimodal discourse analysis, their influence upon......The growing awareness of and concern about present environmental problems generate a proliferation of new forms of environmental discourses that are mediated in various ways. This chapter explores issues related to the ways in which environmental knowledge is multimodally communicated...

Acoustic multimode interference and self-imaging phenomena realized in multimodal phononic crystal waveguides

International Nuclear Information System (INIS)

Zou, Qiushun; Yu, Tianbao; Liu, Jiangtao; Wang, Tongbiao; Liao, Qinghua; Liu, Nianhua

2015-01-01

We report an acoustic multimode interference effect and self-imaging phenomena in an acoustic multimode waveguide system which consists of M parallel phononic crystal waveguides (M-PnCWs). Results show that the self-imaging principle remains applicable for acoustic waveguides just as it does for optical multimode waveguides. To achieve the dispersions and replicas of the input acoustic waves produced along the propagation direction, we performed the finite element method on M-PnCWs, which support M guided modes within the target frequency range. The simulation results show that single images (including direct and mirrored images) and N-fold images (N is an integer) are identified along the propagation direction with asymmetric and symmetric incidence discussed separately. The simulated positions of the replicas agree well with the calculated values that are theoretically decided by self-imaging conditions based on the guided mode propagation analysis. Moreover, the potential applications based on this self-imaging effect for acoustic wavelength de-multiplexing and beam splitting in the acoustic field are also presented. (paper)

High-speed Vibrational Imaging and Spectral Analysis of Lipid Bodies by Compound Raman Microscopy

OpenAIRE

Slipchenko, Mikhail N.; Le, Thuc T.; Chen, Hongtao; Cheng, Ji-Xin

2009-01-01

Cells store excess energy in the form of cytoplasmic lipid droplets. At present, it is unclear how different types of fatty acids contribute to the formation of lipid-droplets. We describe a compound Raman microscope capable of both high-speed chemical imaging and quantitative spectral analysis on the same platform. We use a picosecond laser source to perform coherent Raman scattering imaging of a biological sample and confocal Raman spectral analysis at points of interest. The potential of t...

Nanoparticle discrimination based on wavelength and lifetime-multiplexed cathodoluminescence microscopy.

Science.gov (United States)

Garming, Mathijs W H; Weppelman, I Gerward C; de Boer, Pascal; Martínez, Felipe Perona; Schirhagl, Romana; Hoogenboom, Jacob P; Moerland, Robert J

2017-08-31

Nanomaterials can be identified in high-resolution electron microscopy images using spectrally-selective cathodoluminescence. Capabilities for multiplex detection can however be limited, e.g., due to spectral overlap or availability of filters. Also, the available photon flux may be limited due to degradation under electron irradiation. Here, we demonstrate single-pass cathodoluminescence-lifetime based discrimination of different nanoparticles, using a pulsed electron beam. We also show that cathodoluminescence lifetime is a robust parameter even when the nanoparticle cathodoluminescence intensity decays over an order of magnitude. We create lifetime maps, where the lifetime of the cathodoluminescence emission is correlated with the emission intensity and secondary-electron images. The consistency of lifetime-based discrimination is verified by also correlating the emission wavelength and the lifetime of nanoparticles. Our results show how cathodoluminescence lifetime provides an additional channel of information in electron microscopy.

Polarization Characterization of a Multi-Moded Feed Structure

Data.gov (United States)

National Aeronautics and Space Administration — The Polarization Characterization of a Multi-Moded Feed Structure projects characterize the polarization response of a multi-moded feed horn as an innovative...

Scanning Near-Field Optical Microscopy

Directory of Open Access Journals (Sweden)

Dušan Vobornik

2008-02-01

Full Text Available An average human eye can see details down to 0,07 mm in size. The ability to see smaller details of the matter is correlated with the development of the science and the comprehension of the nature. Today’s science needs eyes for the nano-world. Examples are easily found in biology and medical sciences. There is a great need to determine shape, size, chemical composition, molecular structure and dynamic properties of nano-structures. To do this, microscopes with high spatial, spectral and temporal resolution are required. Scanning Near-field Optical Microscopy (SNOM is a new step in the evolution of microscopy. The conventional, lens-based microscopes have their resolution limited by diffraction. SNOM is not subject to this limitation and can offer up to 70 times better resolution.

Scanning near-field optical microscopy.

Science.gov (United States)

Vobornik, Dusan; Vobornik, Slavenka

2008-02-01

An average human eye can see details down to 0,07 mm in size. The ability to see smaller details of the matter is correlated with the development of the science and the comprehension of the nature. Today's science needs eyes for the nano-world. Examples are easily found in biology and medical sciences. There is a great need to determine shape, size, chemical composition, molecular structure and dynamic properties of nano-structures. To do this, microscopes with high spatial, spectral and temporal resolution are required. Scanning Near-field Optical Microscopy (SNOM) is a new step in the evolution of microscopy. The conventional, lens-based microscopes have their resolution limited by diffraction. SNOM is not subject to this limitation and can offer up to 70 times better resolution.

Adaptive multimodal interaction in mobile augmented reality: A conceptual framework

Science.gov (United States)

Abidin, Rimaniza Zainal; Arshad, Haslina; Shukri, Saidatul A'isyah Ahmad

2017-10-01

Recently, Augmented Reality (AR) is an emerging technology in many mobile applications. Mobile AR was defined as a medium for displaying information merged with the real world environment mapped with augmented reality surrounding in a single view. There are four main types of mobile augmented reality interfaces and one of them are multimodal interfaces. Multimodal interface processes two or more combined user input modes (such as speech, pen, touch, manual gesture, gaze, and head and body movements) in a coordinated manner with multimedia system output. In multimodal interface, many frameworks have been proposed to guide the designer to develop a multimodal applications including in augmented reality environment but there has been little work reviewing the framework of adaptive multimodal interface in mobile augmented reality. The main goal of this study is to propose a conceptual framework to illustrate the adaptive multimodal interface in mobile augmented reality. We reviewed several frameworks that have been proposed in the field of multimodal interfaces, adaptive interface and augmented reality. We analyzed the components in the previous frameworks and measure which can be applied in mobile devices. Our framework can be used as a guide for designers and developer to develop a mobile AR application with an adaptive multimodal interfaces.

Filter. Remix. Make.: Cultivating Adaptability through Multimodality

Science.gov (United States)

Dusenberry, Lisa; Hutter, Liz; Robinson, Joy

2015-01-01

This article establishes traits of adaptable communicators in the 21st century, explains why adaptability should be a goal of technical communication educators, and shows how multimodal pedagogy supports adaptability. Three examples of scalable, multimodal assignments (infographics, research interviews, and software demonstrations) that evidence…

Combined frequency modulated atomic force microscopy and scanning tunneling microscopy detection for multi-tip scanning probe microscopy applications

International Nuclear Information System (INIS)

Morawski, Ireneusz; Spiegelberg, Richard; Korte, Stefan; Voigtländer, Bert

2015-01-01

A method which allows scanning tunneling microscopy (STM) tip biasing independent of the sample bias during frequency modulated atomic force microscopy (AFM) operation is presented. The AFM sensor is supplied by an electronic circuit combining both a frequency shift signal and a tunneling current signal by means of an inductive coupling. This solution enables a control of the tip potential independent of the sample potential. Individual tip biasing is specifically important in order to implement multi-tip STM/AFM applications. An extensional quartz sensor (needle sensor) with a conductive tip is applied to record simultaneously topography and conductivity of the sample. The high resonance frequency of the needle sensor (1 MHz) allows scanning of a large area of the surface being investigated in a reasonably short time. A recipe for the amplitude calibration which is based only on the frequency shift signal and does not require the tip being in contact is presented. Additionally, we show spectral measurements of the mechanical vibration noise of the scanning system used in the investigations

Combined frequency modulated atomic force microscopy and scanning tunneling microscopy detection for multi-tip scanning probe microscopy applications

Energy Technology Data Exchange (ETDEWEB)

Morawski, Ireneusz [Peter Grünberg Institut (PGI-3) and JARA-Fundamentals of Future Information Technology, Forschungszentrum Jülich, 52425 Jülich (Germany); Institute of Experimental Physics, University of Wrocław, pl. M. Borna 9, 50-204 Wrocław (Poland); Spiegelberg, Richard; Korte, Stefan; Voigtländer, Bert [Peter Grünberg Institut (PGI-3) and JARA-Fundamentals of Future Information Technology, Forschungszentrum Jülich, 52425 Jülich (Germany)

2015-12-15

A method which allows scanning tunneling microscopy (STM) tip biasing independent of the sample bias during frequency modulated atomic force microscopy (AFM) operation is presented. The AFM sensor is supplied by an electronic circuit combining both a frequency shift signal and a tunneling current signal by means of an inductive coupling. This solution enables a control of the tip potential independent of the sample potential. Individual tip biasing is specifically important in order to implement multi-tip STM/AFM applications. An extensional quartz sensor (needle sensor) with a conductive tip is applied to record simultaneously topography and conductivity of the sample. The high resonance frequency of the needle sensor (1 MHz) allows scanning of a large area of the surface being investigated in a reasonably short time. A recipe for the amplitude calibration which is based only on the frequency shift signal and does not require the tip being in contact is presented. Additionally, we show spectral measurements of the mechanical vibration noise of the scanning system used in the investigations.

Multimodal sensing and imaging technology by integrated scanning electron, force, and nearfield microwave microscopy and its application to submicrometer studies

OpenAIRE

Hänßler, Olaf C.

2018-01-01

The work covers a multimodal microscope technology for the analysis, manipulation and transfer of materials and objects in the submicrometer range. An atomic force microscope (AFM) allows imaging of the surface topography and a Scanning Microwave Microscope (SMM) detects electromagnetic properties, both operating in a Scanning Electron Microscope (SEM). The described technology demonstrator allows to observe the region-of-interest live with the SEM, while at the same time a characterization w...

Dual light-emitting diode-based multichannel microscopy for whole-slide multiplane, multispectral and phase imaging.

Science.gov (United States)

Liao, Jun; Wang, Zhe; Zhang, Zibang; Bian, Zichao; Guo, Kaikai; Nambiar, Aparna; Jiang, Yutong; Jiang, Shaowei; Zhong, Jingang; Choma, Michael; Zheng, Guoan

2018-02-01

We report the development of a multichannel microscopy for whole-slide multiplane, multispectral and phase imaging. We use trinocular heads to split the beam path into 6 independent channels and employ a camera array for parallel data acquisition, achieving a maximum data throughput of approximately 1 gigapixel per second. To perform single-frame rapid autofocusing, we place 2 near-infrared light-emitting diodes (LEDs) at the back focal plane of the condenser lens to illuminate the sample from 2 different incident angles. A hot mirror is used to direct the near-infrared light to an autofocusing camera. For multiplane whole-slide imaging (WSI), we acquire 6 different focal planes of a thick specimen simultaneously. For multispectral WSI, we relay the 6 independent image planes to the same focal position and simultaneously acquire information at 6 spectral bands. For whole-slide phase imaging, we acquire images at 3 focal positions simultaneously and use the transport-of-intensity equation to recover the phase information. We also provide an open-source design to further increase the number of channels from 6 to 15. The reported platform provides a simple solution for multiplexed fluorescence imaging and multimodal WSI. Acquiring an instant focal stack without z-scanning may also enable fast 3-dimensional dynamic tracking of various biological samples. © 2017 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Multimodal Pedagogies for Teacher Education in TESOL

Science.gov (United States)

Yi, Youngjoo; Angay-Crowder, Tuba

2016-01-01

As a growing number of English language learners (ELLs) engage in digital and multimodal literacy practices in their daily lives, teachers are starting to incorporate multimodal approaches into their instruction. However, anecdotal and empirical evidence shows that teachers often feel unprepared for integrating such practices into their curricula…

Multimodal optical coherence tomography and fluorescence lifetime imaging with interleaved excitation sources for simultaneous endogenous and exogenous fluorescence.

Science.gov (United States)

Shrestha, Sebina; Serafino, Michael J; Rico-Jimenez, Jesus; Park, Jesung; Chen, Xi; Zhaorigetu, Siqin; Walton, Brian L; Jo, Javier A; Applegate, Brian E

2016-09-01

Multimodal imaging probes a variety of tissue properties in a single image acquisition by merging complimentary imaging technologies. Exploiting synergies amongst the data, algorithms can be developed that lead to better tissue characterization than could be accomplished by the constituent imaging modalities taken alone. The combination of optical coherence tomography (OCT) with fluorescence lifetime imaging microscopy (FLIM) provides access to detailed tissue morphology and local biochemistry. The optical system described here merges 1310 nm swept-source OCT with time-domain FLIM having excitation at 355 and 532 nm. The pulses from 355 and 532 nm lasers have been interleaved to enable simultaneous acquisition of endogenous and exogenous fluorescence signals, respectively. The multimodal imaging system was validated using tissue phantoms. Nonspecific tagging with Alexa Flour 532 in a Watanbe rabbit aorta and active tagging of the LOX-1 receptor in human coronary artery, demonstrate the capacity of the system for simultaneous acquisition of OCT, endogenous FLIM, and exogenous FLIM in tissues.

Implications of Multimodal Learning Models for foreign language teaching and learning

Directory of Open Access Journals (Sweden)

Miguel Farías

2011-04-01

Full Text Available This literature review article approaches the topic of information and communications technologies from the perspective of their impact on the language learning process, with particular emphasis on the most appropriate designs of multimodal texts as informed by models of multimodal learning. The first part contextualizes multimodality within the fields of discourse studies, the psychology of learning and CALL; the second, deals with multimodal conceptions of reading and writing by discussing hypertextuality and literacy. A final section outlines the possible implications of multimodal learning models for foreign language teaching and learning.

Performance Evaluation of Multimodal Multifeature Authentication System Using KNN Classification

Directory of Open Access Journals (Sweden)

Gayathri Rajagopal

2015-01-01

Full Text Available This research proposes a multimodal multifeature biometric system for human recognition using two traits, that is, palmprint and iris. The purpose of this research is to analyse integration of multimodal and multifeature biometric system using feature level fusion to achieve better performance. The main aim of the proposed system is to increase the recognition accuracy using feature level fusion. The features at the feature level fusion are raw biometric data which contains rich information when compared to decision and matching score level fusion. Hence information fused at the feature level is expected to obtain improved recognition accuracy. However, information fused at feature level has the problem of curse in dimensionality; here PCA (principal component analysis is used to diminish the dimensionality of the feature sets as they are high dimensional. The proposed multimodal results were compared with other multimodal and monomodal approaches. Out of these comparisons, the multimodal multifeature palmprint iris fusion offers significant improvements in the accuracy of the suggested multimodal biometric system. The proposed algorithm is tested using created virtual multimodal database using UPOL iris database and PolyU palmprint database.

Multi-mode optical fibers for connecting space-based spectrometers

Science.gov (United States)

Roberts, W. T.; Lindenmisth, C. A.; Bender, S.; Miller, E. A.; Motts, E.; Ott, M.; LaRocca, F.; Thomes, J.

2017-11-01

significantly smaller, less massive and less robust. Large core multi-mode optical fibers are often used to accommodate the optical connection of the two separated portions of such instrumentation. In some cases, significant throughput efficiency improvement can be realized by judiciously orienting the strands of multi-fiber cable, close-bunching them to accommodate a tight focus of the optical system on the optical side of the connection, and splaying them out linearly along a spectrometer slit on the other end. For such instrumentation to work effectively in identifying elements and molecules, and especially to produce accurate quantitative results, the spectral throughput of the optical fiber connection must be consistent over varying temperatures, over the range of motion of the optical head (and it's implied optical cable stresses), and over angle-aperture invariant of the total system. While the first two of these conditions have been demonstrated[4], spectral observations of the latter present a cause for concern, and may have an impact on future design of fiber-connected LIBS and Raman spectroscopy instruments. In short, we have observed that the shape of the spectral efficiency curve of a large multi-mode core optical fiber changes as a function of input angle.

Hyperspectral microscopy to identify foodborne bacteria with optimum lighting source

Science.gov (United States)

Hyperspectral microscopy is an emerging technology for rapid detection of foodborne pathogenic bacteria. Since scattering spectral signatures from hyperspectral microscopic images (HMI) vary with lighting sources, it is important to select optimal lights. The objective of this study is to compare t...

CONFOCAL MICROSCOPY SYSTEM PERFORMANCE: FOUNDATIONS FOR MEASUREMENTS, QUANTITATION AND SPECTROSCOPY

Science.gov (United States)

The confocal laser-scanning microscopy (CLSM) has enormous potential in many biological fields. The goal of a CLSM is to acquire and quantify fluorescence and in some instruments acquire spectral characterization of the emitted signal. The accuracy of these measurements demands t...

Boundary segmentation for fluorescence microscopy using steerable filters

Science.gov (United States)

Ho, David Joon; Salama, Paul; Dunn, Kenneth W.; Delp, Edward J.

2017-02-01

Fluorescence microscopy is used to image multiple subcellular structures in living cells which are not readily observed using conventional optical microscopy. Moreover, two-photon microscopy is widely used to image structures deeper in tissue. Recent advancement in fluorescence microscopy has enabled the generation of large data sets of images at different depths, times, and spectral channels. Thus, automatic object segmentation is necessary since manual segmentation would be inefficient and biased. However, automatic segmentation is still a challenging problem as regions of interest may not have well defined boundaries as well as non-uniform pixel intensities. This paper describes a method for segmenting tubular structures in fluorescence microscopy images of rat kidney and liver samples using adaptive histogram equalization, foreground/background segmentation, steerable filters to capture directional tendencies, and connected-component analysis. The results from several data sets demonstrate that our method can segment tubular boundaries successfully. Moreover, our method has better performance when compared to other popular image segmentation methods when using ground truth data obtained via manual segmentation.

Percorsi linguistici e semiotici: Critical Multimodal Analysis of Digital Discourse

Directory of Open Access Journals (Sweden)

edited by Ilaria Moschini

2014-12-01

Full Text Available The language section of LEA - edited by Ilaria Moschini - is dedicated to the Critical Multimodal Analysis of Digital Discourse, an approach that encompasses the linguistic and semiotic detailed investigation of texts within a socio-cultural perspective. It features an interview with Professor Theo van Leeuwen by Ilaria Moschini and four essays: “Retwitting, reposting, repinning; reshaping identities online: Towards a social semiotic multimodal analysis of digital remediation” by Elisabetta Adami; “Multimodal aspects of corporate social responsibility communication” by Carmen Daniela Maier; “Pervasive Technologies and the Paradoxes of Multimodal Digital Communication” by Sandra Petroni and “Can the powerless speak? Linguistic and multimodal corporate media manipulation in digital environments: the case of Malala Yousafzai” by Maria Grazia Sindoni. 

Fiber-Optic Vibration Sensor Based on Multimode Fiber

Directory of Open Access Journals (Sweden)

I. Lujo

2008-06-01

Full Text Available The purpose of this paper is to present a fiberoptic vibration sensor based on the monitoring of the mode distribution in a multimode optical fiber. Detection of vibrations and their parameters is possible through observation of the output speckle pattern from the multimode optical fiber. A working experimental model has been built in which all used components are widely available and cheap: a CCD camera (a simple web-cam, a multimode laser in visible range as a light source, a length of multimode optical fiber, and a computer for signal processing. Measurements have shown good agreement with the actual frequency of vibrations, and promising results were achieved with the amplitude measurements although they require some adaptation of the experimental model. Proposed sensor is cheap and lightweight and therefore presents an interesting alternative for monitoring large smart structures.

Video genre classification using multimodal features

Science.gov (United States)

Jin, Sung Ho; Bae, Tae Meon; Choo, Jin Ho; Ro, Yong Man

2003-12-01

We propose a video genre classification method using multimodal features. The proposed method is applied for the preprocessing of automatic video summarization or the retrieval and classification of broadcasting video contents. Through a statistical analysis of low-level and middle-level audio-visual features in video, the proposed method can achieve good performance in classifying several broadcasting genres such as cartoon, drama, music video, news, and sports. In this paper, we adopt MPEG-7 audio-visual descriptors as multimodal features of video contents and evaluate the performance of the classification by feeding the features into a decision tree-based classifier which is trained by CART. The experimental results show that the proposed method can recognize several broadcasting video genres with a high accuracy and the classification performance with multimodal features is superior to the one with unimodal features in the genre classification.

Concepts for space nuclear multi-mode reactors

International Nuclear Information System (INIS)

Myrabo, L.; Botts, T.E.; Powell, J.R.

1983-01-01

A number of nuclear multi-mode reactor power plants are conceptualized for use with solid core, fixed particle bed and rotating particle bed reactors. Multi-mode systems generate high peak electrical power in the open cycle mode, with MHD generator or turbogenerator converters and cryogenically stored coolants. Low level stationkeeping power and auxiliary reactor cooling (i.e., for the removal of reactor afterheat) are provided in a closed cycle mode. Depending on reactor design, heat transfer to the low power converters can be accomplished by heat pipes, liquid metal coolants or high pressure gas coolants. Candidate low power conversion cycles include Brayton turbogenerator, Rankine turbogenerator, thermoelectric and thermionic approaches. A methodology is suggested for estimating the system mass of multi-mode nuclear power plants as a function of peak electric power level and required mission run time. The masses of closed cycle nuclear and open cycle chemical power systems are briefly examined to identify the regime of superiority for nuclear multi-mode systems. Key research and technology issues for such power plants are also identified

Spectrally resolved modal characteristics of leaky-wave-coupled quantum cascade phase-locked laser arrays

Science.gov (United States)

Sigler, Chris; Gibson, Ricky; Boyle, Colin; Kirch, Jeremy D.; Lindberg, Donald; Earles, Thomas; Botez, Dan; Mawst, Luke J.; Bedford, Robert

2018-01-01

The modal characteristics of nonresonant five-element phase-locked arrays of 4.7-μm emitting quantum cascade lasers (QCLs) have been studied using spectrally resolved near- and far-field measurements and correlated with results of device simulation. Devices are fabricated by a two-step metal-organic chemical vapor deposition process and operate predominantly in an in-phase array mode near threshold, although become multimode at higher drive levels. The wide spectral bandwidth of the QCL's core region is found to be a factor in promoting multispatial-mode operation at high drive levels above threshold. An optimized resonant-array design is identified to allow sole in-phase array-mode operation to high drive levels above threshold, and indicates that for phase-locked laser arrays full spatial coherence to high output powers does not require full temporal coherence.

Multimode optical fibers: steady state mode exciter.

Science.gov (United States)

Ikeda, M; Sugimura, A; Ikegami, T

1976-09-01

The steady state mode power distribution of the multimode graded index fiber was measured. A simple and effective steady state mode exciter was fabricated by an etching technique. Its insertion loss was 0.5 dB for an injection laser. Deviation in transmission characteristics of multimode graded index fibers can be avoided by using the steady state mode exciter.

Multiplex CARS imaging with spectral notch shaped laser pulses delivered by optical fibers.

Science.gov (United States)

Oh, Seung Ryeol; Park, Joo Hyun; Kim, Kyung-Soo; Lee, Jae Yong; Kim, Soohyun

2017-12-11

We present an experimental demonstration of single-pulse coherent anti-Stokes Raman spectroscopy (CARS) using a spectrally shaped broadband laser that is delivered by an optical fiber to a sample at its distal end. The optical fiber consists of a fiber Bragg grating component to serve as a narrowband notch filter and a combined large-mode-area fiber to transmit such shaped ultrashort laser pulses without spectral distortion in a long distance. Experimentally, our implementation showed a capability to measure CARS spectra of various samples with molecular vibrations in the fingerprint region. Furthermore, CARS imaging of poly(methyl methacrylate) bead samples was carried out successfully under epi-CARS geometry in which backward-scattered CARS signals were collected into a multimode optical fiber. A compatibility of single-pulse CARS scheme with fiber optics, verified in this study, implies a potential for future realization of compact all-fiber CARS spectroscopic imaging systems.

The MIND PALACE: A Multi-Spectral Imaging and Spectroscopy Database for Planetary Science

Science.gov (United States)

Eshelman, E.; Doloboff, I.; Hara, E. K.; Uckert, K.; Sapers, H. M.; Abbey, W.; Beegle, L. W.; Bhartia, R.

2017-12-01

The Multi-Instrument Database (MIND) is the web-based home to a well-characterized set of analytical data collected by a suite of deep-UV fluorescence/Raman instruments built at the Jet Propulsion Laboratory (JPL). Samples derive from a growing body of planetary surface analogs, mineral and microbial standards, meteorites, spacecraft materials, and other astrobiologically relevant materials. In addition to deep-UV spectroscopy, datasets stored in MIND are obtained from a variety of analytical techniques obtained over multiple spatial and spectral scales including electron microscopy, optical microscopy, infrared spectroscopy, X-ray fluorescence, and direct fluorescence imaging. Multivariate statistical analysis techniques, primarily Principal Component Analysis (PCA), are used to guide interpretation of these large multi-analytical spectral datasets. Spatial co-referencing of integrated spectral/visual maps is performed using QGIS (geographic information system software). Georeferencing techniques transform individual instrument data maps into a layered co-registered data cube for analysis across spectral and spatial scales. The body of data in MIND is intended to serve as a permanent, reliable, and expanding database of deep-UV spectroscopy datasets generated by this unique suite of JPL-based instruments on samples of broad planetary science interest.

Reliability Study of Mechatronic Power Components Using Spectral Photon Emission Microscopy

Directory of Open Access Journals (Sweden)

N. Moultif

2016-11-01

Full Text Available In this paper, we present one of the most important failure analysis tools that permits the localizing and the identification of the failure mechanisms. It is a new spectral photon emission system, enabling to localize the failure, and quickly get the photon emission spectra that characterize the failure with high resolution. A diffraction grating is used as a spectrometer in the system. Application results on mechatronic power devices such as HEMT AlGaN/GAN and SiC MOSFETs are reported.

Effectiveness of Modal Decomposition for Tapping Atomic Force Microscopy Microcantilevers in Liquid Environment.

Science.gov (United States)

Kim, Il Kwang; Lee, Soo Il

2016-05-01

The modal decomposition of tapping mode atomic force microscopy microcantilevers in liquid environments was studied experimentally. Microcantilevers with different lengths and stiffnesses and two sample surfaces with different elastic moduli were used in the experiment. The response modes of the microcantilevers were extracted as proper orthogonal modes through proper orthogonal decomposition. Smooth orthogonal decomposition was used to estimate the resonance frequency directly. The effects of the tapping setpoint and the elastic modulus of the sample under test were examined in terms of their multi-mode responses with proper orthogonal modes, proper orthogonal values, smooth orthogonal modes and smooth orthogonal values. Regardless of the stiffness of the microcantilever under test, the first mode was dominant in tapping mode atomic force microscopy under normal operating conditions. However, at lower tapping setpoints, the flexible microcantilever showed modal distortion and noise near the tip when tapping on a hard sample. The stiff microcantilever had a higher mode effect on a soft sample at lower tapping setpoints. Modal decomposition for tapping mode atomic force microscopy can thus be used to estimate the characteristics of samples in liquid environments.

Deterministic multimode photonic device for quantum-information processing

DEFF Research Database (Denmark)

Nielsen, Anne E. B.; Mølmer, Klaus

2010-01-01

We propose the implementation of a light source that can deterministically generate a rich variety of multimode quantum states. The desired states are encoded in the collective population of different ground hyperfine states of an atomic ensemble and converted to multimode photonic states by exci...

Multimodal network design for sustainable household plastic recycling

NARCIS (Netherlands)

Bing Xiaoyun, Xiaoyun; Groot, J.J.; Bloemhof, J.M.; Vorst, van der J.G.A.J.

2013-01-01

Purpose – This research studies a plastic recycling system from a reverse logistics angle and investigates the potential benefits of a multimodality strategy to the network design of plastic recycling. This research aims to quantify the impact of multimodality on the network, to provide decision

Multimodal warnings to enhance risk communication and safety

NARCIS (Netherlands)

Haas, E.C.; Erp, J.B.F. van

2014-01-01

Multimodal warnings incorporate audio and/or skin-based (tactile) cues to supplement or replace visual cues in environments where the user’s visual perception is busy, impaired, or nonexistent. This paper describes characteristics of audio, tactile, and multimodal warning displays and their role in

Assessing resolution in live cell structured illumination microscopy

Science.gov (United States)

Pospíšil, Jakub; Fliegel, Karel; Klíma, Miloš

2017-12-01

Structured Illumination Microscopy (SIM) is a powerful super-resolution technique, which is able to enhance the resolution of optical microscope beyond the Abbe diffraction limit. In the last decade, numerous SIM methods that achieve the resolution of 100 nm in the lateral dimension have been developed. The SIM setups with new high-speed cameras and illumination pattern generators allow rapid acquisition of the live specimen. Therefore, SIM is widely used for investigation of the live structures in molecular and live cell biology. Quantitative evaluation of resolution enhancement in a real sample is essential to describe the efficiency of super-resolution microscopy technique. However, measuring the resolution of a live cell sample is a challenging task. Based on our experimental findings, the widely used Fourier ring correlation (FRC) method does not seem to be well suited for measuring the resolution of SIM live cell video sequences. Therefore, the resolution assessing methods based on Fourier spectrum analysis are often used. We introduce a measure based on circular average power spectral density (PSDca) estimated from a single SIM image (one video frame). PSDca describes the distribution of the power of a signal with respect to its spatial frequency. Spatial resolution corresponds to the cut-off frequency in Fourier space. In order to estimate the cut-off frequency from a noisy signal, we use a spectral subtraction method for noise suppression. In the future, this resolution assessment approach might prove useful also for single-molecule localization microscopy (SMLM) live cell imaging.

Multimodal Speaker Diarization.

Science.gov (United States)

Noulas, A; Englebienne, G; Krose, B J A

2012-01-01

We present a novel probabilistic framework that fuses information coming from the audio and video modality to perform speaker diarization. The proposed framework is a Dynamic Bayesian Network (DBN) that is an extension of a factorial Hidden Markov Model (fHMM) and models the people appearing in an audiovisual recording as multimodal entities that generate observations in the audio stream, the video stream, and the joint audiovisual space. The framework is very robust to different contexts, makes no assumptions about the location of the recording equipment, and does not require labeled training data as it acquires the model parameters using the Expectation Maximization (EM) algorithm. We apply the proposed model to two meeting videos and a news broadcast video, all of which come from publicly available data sets. The results acquired in speaker diarization are in favor of the proposed multimodal framework, which outperforms the single modality analysis results and improves over the state-of-the-art audio-based speaker diarization.

Multi-modal locomotion: from animal to application

International Nuclear Information System (INIS)

Lock, R J; Burgess, S C; Vaidyanathan, R

2014-01-01

The majority of robotic vehicles that can be found today are bound to operations within a single media (i.e. land, air or water). This is very rarely the case when considering locomotive capabilities in natural systems. Utility for small robots often reflects the exact same problem domain as small animals, hence providing numerous avenues for biological inspiration. This paper begins to investigate the various modes of locomotion adopted by different genus groups in multiple media as an initial attempt to determine the compromise in ability adopted by the animals when achieving multi-modal locomotion. A review of current biologically inspired multi-modal robots is also presented. The primary aim of this research is to lay the foundation for a generation of vehicles capable of multi-modal locomotion, allowing ambulatory abilities in more than one media, surpassing current capabilities. By identifying and understanding when natural systems use specific locomotion mechanisms, when they opt for disparate mechanisms for each mode of locomotion rather than using a synergized singular mechanism, and how this affects their capability in each medium, similar combinations can be used as inspiration for future multi-modal biologically inspired robotic platforms. (topical review)

Characterization of human arterial tissue affected by atherosclerosis using multimodal nonlinear optical microscopy

Science.gov (United States)

Baria, Enrico; Cicchi, Riccardo; Rotellini, Matteo; Nesi, Gabriella; Massi, Daniela; Pavone, Francesco S.

2016-03-01

Atherosclerosis is a widespread cardiovascular disease caused by the deposition of lipids (such as cholesterol and triglycerides) on the inner arterial wall. The rupture of an atherosclerotic plaque, resulting in a thrombus, is one of the leading causes of death in the Western World. Preventive assessment of plaque vulnerability is therefore extremely important and can be performed by studying collagen organization and lipid composition in atherosclerotic arterial tissues. Routinely used diagnostic methods, such as histopathological examination, are limited to morphological analysis of the examined tissues, whereas an exhaustive characterization requires immune-histochemical examination and a morpho-functional approach. Instead, a label-free and non-invasive alternative is provided by nonlinear microscopy. In this study, we combined SHG and FLIM microscopy in order to characterize collagen organization and lipids in human carotid ex vivo tissues affected by atherosclerosis. SHG and TPF images, acquired from different regions within atherosclerotic plaques, were processed through image pattern analysis methods (FFT, GLCM). The resulting information on collagen and cholesterol distribution and anisotropy, combined with collagen and lipids fluorescence lifetime measured from FLIM images, allowed characterization of carotid samples and discrimination of different tissue regions. The presented method can be applied for automated classification of atherosclerotic lesions and plaque vulnerability. Moreover, it lays the foundation for a potential in vivo diagnostic tool to be used in clinical setting.

Multimodal Scaffolding in the Secondary English Classroom Curriculum

Science.gov (United States)

Boche, Benjamin; Henning, Megan

2015-01-01

This article examines the topic of multimodal scaffolding in the secondary English classroom curriculum through the viewpoint of one teacher's experiences. With technology becoming more commonplace and readily available in the English classroom, we must pinpoint specific and tangible ways to help teachers use and teach multimodalities in their…

Thermal maturity of Tasmanites microfossils from confocal laser scanning fluorescence microscopy

Science.gov (United States)

Hackley, Paul C.; Kus, Jolanta

2015-01-01

We report here, for the first time, spectral properties of Tasmanites microfossils determined by confocal laser scanning fluorescence microscopy (CLSM, using Ar 458 nm excitation). The Tasmanites occur in a well-characterized natural maturation sequence (Ro 0.48–0.74%) of Devonian shale (n = 3 samples) from the Appalachian Basin. Spectral property λmax shows excellent agreement (r2 = 0.99) with extant spectra from interlaboratory studies which used conventional fluorescence microscopy techniques. This result suggests spectral measurements from CLSM can be used to infer thermal maturity of fluorescent organic materials in geologic samples. Spectra of regions with high fluorescence intensity at fold apices and flanks in individual Tasmanites are blue-shifted relative to less-deformed areas in the same body that have lower fluorescence intensity. This is interpreted to result from decreased quenching moiety concentration at these locations, and indicates caution is needed in the selection of measurement regions in conventional fluorescence microscopy, where it is common practice to select high intensity regions for improved signal intensity and better signal to noise ratios. This study also documents application of CLSM to microstructural characterization of Tasmanites microfossils. Finally, based on an extant empirical relation between conventional λmax values and bitumen reflectance, λmax values from CLSM of Tasmanites microfossils can be used to calculate a bitumen reflectance equivalent value. The results presented herein can be used as a basis to broaden the future application of CLSM in the geological sciences into hydrocarbon prospecting and basin analysis.

Optimal Face-Iris Multimodal Fusion Scheme

Directory of Open Access Journals (Sweden)

Omid Sharifi

2016-06-01

Full Text Available Multimodal biometric systems are considered a way to minimize the limitations raised by single traits. This paper proposes new schemes based on score level, feature level and decision level fusion to efficiently fuse face and iris modalities. Log-Gabor transformation is applied as the feature extraction method on face and iris modalities. At each level of fusion, different schemes are proposed to improve the recognition performance and, finally, a combination of schemes at different fusion levels constructs an optimized and robust scheme. In this study, CASIA Iris Distance database is used to examine the robustness of all unimodal and multimodal schemes. In addition, Backtracking Search Algorithm (BSA, a novel population-based iterative evolutionary algorithm, is applied to improve the recognition accuracy of schemes by reducing the number of features and selecting the optimized weights for feature level and score level fusion, respectively. Experimental results on verification rates demonstrate a significant improvement of proposed fusion schemes over unimodal and multimodal fusion methods.

New directions in scanning-tunneling microscopy

International Nuclear Information System (INIS)

Ferrell, T.L.; Warmack, R.J.; Reddick, R.C.

1989-01-01

The tunneling of electrons in scanning-tunneling microscopy (STM) has permitted imaging of the electronic distribution about individual atoms on surfaces. The need for use of conducting surfaces in STM limits its applicability, and new forms of scanning microscopy have emerged as a result of interest in poorly conducting samples. Atomic force microscopy has demonstrated that the force between a surface and a probe tip can be used to image selected materials. Now being developed are magnetic probe STM's and photon tunneling microscopes in which the probe is a sharpened optical fiber. Also of great interest presently is the measurement of differential conductance of surfaces using electron STM's. This method supplies spectral information and contrast enhancement in images. At present there remains much theoretical work to be carried out in order to better characterize related data on inelastic electron tunneling, and valuable insight may be gained from data being gathered on the local work function of materials. As matters stand today, the key problems lie in determining tip and contamination effects, preparation of samples, and understanding conductivity mechanisms in very thin materials on conducting substrates. Resolution of these problems and introduction of new forms of scanning microscopy may permit novel and important applications in biology as well as surface science

Multimodal coaching and its application to workplace, life and health coaching

OpenAIRE

Stephen Palmer

2012-01-01

This article highlights how the multimodal approach (Lazarus, 1989) has been adapted to the field of coachingand coaching psychology. It covers the basic theories underpinning the multimodal approach and illustratesthe link between the theory and practice. Key multimodal strategies are covered including modalityprofiles, structural profiles, tracking and bridging.

Effect of input spectrum on the spectral switch characteristics in a white-light Michelson interferometer.

Science.gov (United States)

Brundavanam, Maruthi M; Viswanathan, Nirmal K; Rao, D Narayana

2009-12-01

We report here a detailed experimental study to demonstrate the effect of source spectral characteristics such as spectral bandwidth (Deltalambda), peak wavelength (lambda(0)), and shape of the spectrum on the spectral shifts and spectral switches measured due to temporal correlation in a white-light Michelson interferometer operated in the spectral domain. Behavior of the spectral switch characteristics such as the switch position, switch amplitude, and switch symmetry are discussed in detail as a function of optical path difference between the interfering beams. The experimental results are compared with numerical calculations carried out using interference law in the spectral domain with modified source spectral characteristics. On the basis of our results we feel that our study is of critical importance in the selection of source spectral characteristics to further improve the longitudinal resolution or the measurement sensitivity in spectral-domain optical coherence tomography and microscopy.

Fluorescent dyes with large Stokes shifts for super-resolution optical microscopy of biological objects: a review

International Nuclear Information System (INIS)

Sednev, Maksim V; Belov, Vladimir N; Hell, Stefan W

2015-01-01

The review deals with commercially available organic dyes possessing large Stokes shifts and their applications as fluorescent labels in optical microscopy based on stimulated emission depletion (STED). STED microscopy breaks Abbe’s diffraction barrier and provides optical resolution beyond the diffraction limit. STED microscopy is non-invasive and requires photostable fluorescent markers attached to biomolecules or other objects of interest. Up to now, in most biology-related STED experiments, bright and photoresistant dyes with small Stokes shifts of 20–40 nm were used. The rapid progress in STED microscopy showed that organic fluorophores possessing large Stokes shifts are indispensable in multi-color super-resolution techniques. The ultimate result of the imaging relies on the optimal combination of a dye, the bio-conjugation procedure and the performance of the optical microscope. Modern bioconjugation methods, basics of STED microscopy, as well as structures and spectral properties of the presently available fluorescent markers are reviewed and discussed. In particular, the spectral properties of the commercial dyes are tabulated and correlated with the available depletion wavelengths found in STED microscopes produced by LEICA Microsytems, Abberior Instruments and Picoquant GmbH. (topical review)

Robustness of multimodal processes itineraries

DEFF Research Database (Denmark)

Bocewicz, G.; Banaszak, Z.; Nielsen, Izabela Ewa

2013-01-01

itineraries for assumed (O-D) trip. Since itinerary planning problem, constitutes a common routing and scheduling decision faced by travelers, hence the main question regards of itinerary replanning and particularly a method aimed at prototyping of mode sequences and paths selections. The declarative model......This paper concerns multimodal transport systems (MTS) represented by a supernetworks in which several unimodal networks are connected by transfer links and focuses on the scheduling problems encountered in these systems. Assuming unimodal networks are modeled as cyclic lines, i.e. the routes...... of multimodal processes driven itinerary planning problem is our main contribution. Illustrative examples providing alternative itineraries in some cases of MTS malfunction are presented....

Multimode model for projective photon-counting measurements

International Nuclear Information System (INIS)

Tualle-Brouri, Rosa; Ourjoumtsev, Alexei; Dantan, Aurelien; Grangier, Philippe; Wubs, Martijn; Soerensen, Anders S.

2009-01-01

We present a general model to account for the multimode nature of the quantum electromagnetic field in projective photon-counting measurements. We focus on photon-subtraction experiments, where non-Gaussian states are produced conditionally. These are useful states for continuous-variable quantum-information processing. We present a general method called mode reduction that reduces the multimode model to an effective two-mode problem. We apply this method to a multimode model describing broadband parametric down-conversion, thereby improving the analysis of existing experimental results. The main improvement is that spatial and frequency filters before the photon detector are taken into account explicitly. We find excellent agreement with previously published experimental results, using fewer free parameters than before, and discuss the implications of our analysis for the optimized production of states with negative Wigner functions.

Multimodal coaching and its application to workplace, life and health coaching

Directory of Open Access Journals (Sweden)

Stephen Palmer

2012-10-01

Full Text Available This article highlights how the multimodal approach (Lazarus, 1989 has been adapted to the field of coachingand coaching psychology. It covers the basic theories underpinning the multimodal approach and illustratesthe link between the theory and practice. Key multimodal strategies are covered including modalityprofiles, structural profiles, tracking and bridging.

Experiencia de enseñanza multimodal en una clase de idiomas [Experience of multimodal teaching in a language classroom

Directory of Open Access Journals (Sweden)

María Martínez Lirola

2013-12-01

Full Text Available Resumen: Nuestra sociedad es cada vez más tecnológica y multimodal por lo que es necesario que la enseñanza se adapte a los nuevos tiempos. Este artículo analiza el modo en que la asignatura Lengua Inglesa IV de la Licenciatura en Filología Inglesa en la Universidad de Alicante combina el desarrollo de las cinco destrezas (escucha, habla, lectura, escritura e interacción evaluadas por medio de un portafolio con la multimodalidad en las prácticas docentes y en cada una de las actividades que componen el portafolio. Los resultados de una encuesta preparada al final del curso académico 2011-2012 ponen de manifiesto las competencias principales que el alumnado universitario desarrolla gracias a la docencia multimodal y la importancia de las tutorías en este tipo de enseñanza. Abstract: Our society becomes more technological and multimodal and, consequently, teaching has to be adapted to the new time. This article analyses the way in which the subject English Language IV of the degree English Studies at the University of Alicante combines the development of the five skills (listening, speaking, reading, writing and interacting evaluated through a portfolio with multimodality in the teaching practices and in each of the activities that are part of the portfolio. The results of a survey prepared at the end of the academic year 2011-2012 point out the main competences that university students develop thanks to multimodal teaching and the importance of tutorials in this kind of teaching.

Multimodality

DEFF Research Database (Denmark)

Buhl, Mie

In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal’ communication, which should not be confused with the term ‘multimedia’. While multimedia...... and learning situations. The choices they make involve E-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very useful...

Multimodal freight investment criteria.

Science.gov (United States)

2010-07-01

Literature was reviewed on multi-modal investment criteria for freight projects, examining measures and techniques for quantifying project benefits and costs, as well as ways to describe the economic importance of freight transportation. : A limited ...

Multimodal follow-up questions to multimodal answers in a QA system

NARCIS (Netherlands)

van Schooten, B.W.; op den Akker, Hendrikus J.A.

2007-01-01

We are developing a dialogue manager (DM) for a multimodal interactive Question Answering (QA) system. Our QA system presents answers using text and pictures, and the user may pose follow-up questions using text or speech, while indicating screen elements with the mouse. We developed a corpus of

WE-H-206-02: Recent Advances in Multi-Modality Molecular Imaging of Small Animals

Energy Technology Data Exchange (ETDEWEB)

Tsui, B. [Johns Hopkins University (United States)

2016-06-15

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

WE-H-206-02: Recent Advances in Multi-Modality Molecular Imaging of Small Animals

International Nuclear Information System (INIS)

Tsui, B.

2016-01-01

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

Reliability-Based Decision Fusion in Multimodal Biometric Verification Systems

Directory of Open Access Journals (Sweden)

Kryszczuk Krzysztof

2007-01-01

Full Text Available We present a methodology of reliability estimation in the multimodal biometric verification scenario. Reliability estimation has shown to be an efficient and accurate way of predicting and correcting erroneous classification decisions in both unimodal (speech, face, online signature and multimodal (speech and face systems. While the initial research results indicate the high potential of the proposed methodology, the performance of the reliability estimation in a multimodal setting has not been sufficiently studied or evaluated. In this paper, we demonstrate the advantages of using the unimodal reliability information in order to perform an efficient biometric fusion of two modalities. We further show the presented method to be superior to state-of-the-art multimodal decision-level fusion schemes. The experimental evaluation presented in this paper is based on the popular benchmarking bimodal BANCA database.

Teleportation of continuous variable multimode Greeberger-Horne-Zeilinger entangled states

International Nuclear Information System (INIS)

He Guangqiang; Zhang Jingtao; Zeng Guihua

2008-01-01

Quantum teleportation protocols of continuous variable (CV) Greeberger-Horne-Zeilinger (GHZ) and Einstein-Podolsky-Rosen (EPR) entangled states are proposed, and are generalized to teleportation of arbitrary multimode GHZ entangled states described by Van Loock and Braunstein (2000 Phys. Rev. Lett. 84 3482). Each mode of a multimode entangled state is teleported using a CV EPR entangled pair and classical communication. The analytical expression of fidelity for the multimode Gaussian states which evaluates the teleportation quality is presented. The analytical results show that the fidelity is a function of both the squeezing parameter r, which characterizes the multimode entangled state to be teleported, and the channel parameter p, which characterizes the EPR pairs shared by Alice and Bob. The fidelity increases with increasing p, but decreases with increasing r, i.e., it is more difficult to teleport the more perfect multimode entangled states. The entanglement degree of the teleported multimode entangled states increases with increasing both r and p. In addition, the fact is proved that our teleportation protocol of EPR entangled states using parallel EPR pairs as quantum channels is the best case of the protocol using four-mode entangled states (Adhikari et al 2008 Phys. Rev. A 77 012337).

Multimodal surveillance sensors, algorithms, and systems

CERN Document Server

Zhu, Zhigang

2007-01-01

From front-end sensors to systems and environmental issues, this practical resource guides you through the many facets of multimodal surveillance. The book examines thermal, vibration, video, and audio sensors in a broad context of civilian and military applications. This cutting-edge volume provides an in-depth treatment of data fusion algorithms that takes you to the core of multimodal surveillance, biometrics, and sentient computing. The book discusses such people and activity topics as tracking people and vehicles and identifying individuals by their speech.Systems designers benefit from d

Multimode waveguide speckle patterns for compressive sensing.

Science.gov (United States)

Valley, George C; Sefler, George A; Justin Shaw, T

2016-06-01

Compressive sensing (CS) of sparse gigahertz-band RF signals using microwave photonics may achieve better performances with smaller size, weight, and power than electronic CS or conventional Nyquist rate sampling. The critical element in a CS system is the device that produces the CS measurement matrix (MM). We show that passive speckle patterns in multimode waveguides potentially provide excellent MMs for CS. We measure and calculate the MM for a multimode fiber and perform simulations using this MM in a CS system. We show that the speckle MM exhibits the sharp phase transition and coherence properties needed for CS and that these properties are similar to those of a sub-Gaussian MM with the same mean and standard deviation. We calculate the MM for a multimode planar waveguide and find dimensions of the planar guide that give a speckle MM with a performance similar to that of the multimode fiber. The CS simulations show that all measured and calculated speckle MMs exhibit a robust performance with equal amplitude signals that are sparse in time, in frequency, and in wavelets (Haar wavelet transform). The planar waveguide results indicate a path to a microwave photonic integrated circuit for measuring sparse gigahertz-band RF signals using CS.

Multi-spectral confocal microendoscope for in-vivo imaging

Science.gov (United States)

Rouse, Andrew Robert

The concept of in-vivo multi-spectral confocal microscopy is introduced. A slit-scanning multi-spectral confocal microendoscope (MCME) was built to demonstrate the technique. The MCME employs a flexible fiber-optic catheter coupled to a custom built slit-scan confocal microscope fitted with a custom built imaging spectrometer. The catheter consists of a fiber-optic imaging bundle linked to a miniature objective and focus assembly. The design and performance of the miniature objective and focus assembly are discussed. The 3mm diameter catheter may be used on its own or routed though the instrument channel of a commercial endoscope. The confocal nature of the system provides optical sectioning with 3mum lateral resolution and 30mum axial resolution. The prism based multi-spectral detection assembly is typically configured to collect 30 spectral samples over the visible chromatic range. The spectral sampling rate varies from 4nm/pixel at 490nm to 8nm/pixel at 660nm and the minimum resolvable wavelength difference varies from 7nm to 18nm over the same spectral range. Each of these characteristics are primarily dictated by the dispersive power of the prism. The MCME is designed to examine cellular structures during optical biopsy and to exploit the diagnostic information contained within the spectral domain. The primary applications for the system include diagnosis of disease in the gastro-intestinal tract and female reproductive system. Recent data from the grayscale imaging mode are presented. Preliminary multi-spectral results from phantoms, cell cultures, and excised human tissue are presented to demonstrate the potential of in-vivo multi-spectral imaging.

Development of a Framework for Multimodal Research: Creation of a Bibliographic Database

National Research Council Canada - National Science Library

Coovert, Michael D; Gray, Ashley A; Elliott, Linda R; Redden, Elizabeth S

2007-01-01

.... The results of the overall effort, the multimodal framework and article tracking sheet, bibliographic database, and searchable multimodal database make substantial and valuable contributions to the accumulation and interpretation of multimodal research. References collected in this effort are listed in the appendix.

Multimodal aspects of CSR communication related to gender empowerment and environmental protection

DEFF Research Database (Denmark)

Maier, Carmen Daniela

Purpose – This paper explores how the multimodal persuasive strategies of CSR communication related to Coca-Cola’s “5 by 20” succeed to highlight the company’s continuous commitment to gender empowerment and environmental protection. Launched in 2010, “5 by 20” is a program designed to empower 5...... as the usual textual focus is extended to a multimodal one. Shedding light on how the multimodal interplay contributes to communicate corporate commitment to gender empowerment and environmental protection, this model can also be employed in order to explore multimodally other areas of CSR communication....... a multimodal analysis model through which it is possible to map and explain the multimodal persuasive strategies employed by the company in their CSR communication. The paper is focused on the analysis of the video series that can be accessed at: http://www.coca-colacompany.com/stories/5by20. Based on a social...

Mode-multiplexed transmission over conventional graded-index multimode fibers

NARCIS (Netherlands)

Ryf, R.; Fontaine, N.K.; Chen, H.; Guan, B.; Huang, B.; Esmaeelpour, M.; Gnauck, A.H.; Randel, S.; Yoo, S.J.B.; Koonen, A.M.J.; Shubochkin, R.; Sun, Yi; Lingle, R.

2015-01-01

We present experimental results for combined mode-multiplexed and wavelength multiplexed transmission over conventional graded-index multimode fibers. We use mode-selective photonic lanterns as mode couplers to precisely excite a subset of the modes of the multimode fiber and additionally to

A Multimodal Database for Affect Recognition and Implicit Tagging

NARCIS (Netherlands)

Soleymani, Mohammad; Lichtenauer, Jeroen; Pun, Thierry; Pantic, Maja

MAHNOB-HCI is a multimodal database recorded in response to affective stimuli with the goal of emotion recognition and implicit tagging research. A multimodal setup was arranged for synchronized recording of face videos, audio signals, eye gaze data, and peripheral/central nervous system

CONFOCAL MICROSCOPY SYSTEM PERFORMANCE: FOUNDATIONS FOR QUANTIFYING CYTOMETRIC APPLICATIONS WITH SPECTROSCOPIC INSTRUMENTS

Science.gov (United States)

The confocal laser-scanning microscopy (CLSM) has enormous potential in many biological fields. The goal of a CLSM is to acquire and quantify fluorescence and in some instruments acquire spectral characterization of the emitted signal. The accuracy of these measurements demands t...

Quantifying Quality Aspects of Multimodal Interactive Systems

CERN Document Server

Kühnel, Christine

2012-01-01

This book systematically addresses the quantification of quality aspects of multimodal interactive systems. The conceptual structure is based on a schematic view on human-computer interaction where the user interacts with the system and perceives it via input and output interfaces. Thus, aspects of multimodal interaction are analyzed first, followed by a discussion of the evaluation of output and input and concluding with a view on the evaluation of a complete system.

Gold Nanoconstructs for Multimodal Diagnostic Imaging and Photothermal Cancer Therapy

Science.gov (United States)

Coughlin, Andrew James

Cancer accounts for nearly 1 out of every 4 deaths in the United States, and because conventional treatments are limited by morbidity and off-target toxicities, improvements in cancer management are needed. This thesis further develops nanoparticle-assisted photothermal therapy (NAPT) as a viable treatment option for cancer patients. NAPT enables localized ablation of disease because heat generation only occurs where tissue permissive near-infrared (NIR) light and absorbing nanoparticles are combined, leaving surrounding normal tissue unharmed. Two principle approaches were investigated to improve the specificity of this technique: multimodal imaging and molecular targeting. Multimodal imaging affords the ability to guide NIR laser application for site-specific NAPT and more holistic characterization of disease by combining the advantages of several diagnostic technologies. Towards the goal of image-guided NAPT, gadolinium-conjugated gold-silica nanoshells were engineered and demonstrated to enhance imaging contrast across a range of diagnostic modes, including T1-weighted magnetic resonance imaging, X-Ray, optical coherence tomography, reflective confocal microscopy, and two-photon luminescence in vitro as well as within an animal tumor model. Additionally, the nanoparticle conjugates were shown to effectively convert NIR light to heat for applications in photothermal therapy. Therefore, the broad utility of gadolinium-nanoshells for anatomic localization of tissue lesions, molecular characterization of malignancy, and mediators of ablation was established. Molecular targeting strategies may also improve NAPT by promoting nanoparticle uptake and retention within tumors and enhancing specificity when malignant and normal tissue interdigitate. Here, ephrinA1 protein ligands were conjugated to nanoshell surfaces for particle homing to overexpressed EphA2 receptors on prostate cancer cells. In vitro, successful targeting and subsequent photothermal ablation of

High energy supercontinuum sources using tapered photonic crystal fibers for multispectral photoacoustic microscopy

DEFF Research Database (Denmark)

Bondu, Magalie; Brooks, Christopher; Jakobsen, Christian

2016-01-01

We demonstrate a record bandwidth high energy supercontinuum source suitable for multispectral photoacoustic microscopy. The source has more than 150  nJ/10  nm150  nJ/10  nm bandwidth over a spectral range of 500 to 1600 nm. This performance is achieved using a carefully designed fiber taper...... with large-core input for improved power handling and small-core output that provides the desired spectral range of the supercontinuum source....

Gastric Adenocarcinoma: A Multimodal Approach

Directory of Open Access Journals (Sweden)

Humair S. Quadri

2017-08-01

Full Text Available Despite its declining incidence, gastric cancer (GC remains a leading cause of cancer-related deaths worldwide. A multimodal approach to GC is critical to ensure optimal patient outcomes. Pretherapy fine resolution contrast-enhanced cross-sectional imaging, endoscopic ultrasound and staging laparoscopy play an important role in patients with newly diagnosed ostensibly operable GC to avoid unnecessary non-therapeutic laparotomies. Currently, margin negative gastrectomy and adequate lymphadenectomy performed at high volume hospitals remain the backbone of GC treatment. Importantly, adequate GC surgery should be integrated in the setting of a multimodal treatment approach. Treatment for advanced GC continues to expand with the emergence of additional lines of systemic and targeted therapies.

Fluorescent magnetic hybrid nanoprobe for multimodal bioimaging

Energy Technology Data Exchange (ETDEWEB)

Koktysh, Dmitry [Department of Chemistry, Vanderbilt University, Station B 351822, Nashville, TN 37235 (United States); Bright, Vanessa; Pham, Wellington, E-mail: dmitry.koktysh@vanderbilt.edu, E-mail: wellington.pham@vanderbilt.edu [Institute of Imaging Science, Vanderbilt University, 1161 21st Avenue South AA, 1105 MCN, Nashville, TN 37232 (United States)

2011-07-08

A fluorescent magnetic hybrid imaging nanoprobe (HINP) was fabricated by the conjugation of superparamagnetic Fe{sub 3}O{sub 4} nanoparticles and visible light emitting ({approx}600 nm) fluorescent CdTe/CdS quantum dots (QDs). The assembly strategy used the covalent linking of the oxidized dextran shell of magnetic particles to the glutathione ligands of QDs. The synthesized HINP formed stable water-soluble colloidal dispersions. The structure and properties of the particles were characterized by transmission electron and atomic force microscopy, energy dispersive x-ray analysis and inductively coupled plasma optical emission spectroscopy, dynamic light scattering analysis, optical absorption and photoluminescence spectroscopy, and fluorescent imaging. The luminescence imaging region of the nanoprobe was extended to the near-infrared (NIR) ({approx}800 nm) by conjugation of the superparamagnetic nanoparticles with synthesized CdHgTe/CdS QDs. Cadmium, mercury based QDs in HINP can be easily replaced by novel water-soluble glutathione stabilized AgInS{sub 2}/ZnS QDs to present a new class of cadmium-free multimodal imaging agents. The observed NIR photoluminescence of fluorescent magnetic nanocomposites supports their use for bioimaging. The developed HINP provides dual-imaging channels for simultaneous optical and magnetic resonance imaging.

MULTIMODAL IMAGING OF MOSAIC RETINOPATHY IN CARRIERS OF HEREDITARY X-LINKED RECESSIVE DISEASES.

Science.gov (United States)

Wu, An-Lun; Wang, Jung-Pan; Tseng, Yun-Ju; Liu, Laura; Kang, Yu-Chuan; Chen, Kuan-Jen; Chao, An-Ning; Yeh, Lung-Kun; Chen, Tun-Lu; Hwang, Yih-Shiou; Wu, Wei-Chi; Lai, Chi-Chun; Wang, Nan-Kai

2018-05-01

To investigate the clinical features in carriers of X-linked retinitis pigmentosa, X-linked ocular albinism, and choroideremia (CHM) using multimodal imaging and to assess their diagnostic value in these three mosaic retinopathies. We prospectively examined 14 carriers of 3 X-linked recessive disorders (X-linked retinitis pigmentosa, X-linked ocular albinism, and CHM). Details of abnormalities of retinal morphology were evaluated using fundus photography, fundus autofluorescence (FAF) imaging, and spectral domain optical coherence tomography. In six X-linked retinitis pigmentosa carriers, fundus appearance varied from unremarkable to the presence of tapetal-like reflex and pigmentary changes. On FAF imaging, all carriers exhibited a bright radial reflex against a dark background. By spectral domain optical coherence tomography, loss of the ellipsoid zone in the macula was observed in 3 carriers (50%). Regarding the retinal laminar architecture, 4 carriers (66.7%) showed thinning of the outer nuclear layer and a dentate appearance of the outer plexiform layer. All five X-linked ocular albinism carriers showed a characteristic mud-splatter patterned fundus, dark radial streaks against a bright background on FAF imaging, and a normal-appearing retinal structure by spectral domain optical coherence tomography imaging. Two of the 3 CHM carriers (66.7%) showed a diffuse moth-eaten appearance of the fundus, and all 3 showed irregular hyper-FAF and hypo-FAF spots throughout the affected area. In the CHM carriers, the structural changes observed by spectral domain optical coherence tomography imaging were variable. Our findings in an Asian cohort suggest that FAF imaging is a practical diagnostic test for differentiating X-linked retinitis pigmentosa, X-linked ocular albinism, and CHM carriers. Wide-field FAF is an easy and helpful adjunct to testing for the correct diagnosis and identification of lyonization in carriers of these three mosaic retinopathies.

Multimodal Estimation of Distribution Algorithms.

Science.gov (United States)

Yang, Qiang; Chen, Wei-Neng; Li, Yun; Chen, C L Philip; Xu, Xiang-Min; Zhang, Jun

2016-02-15

Taking the advantage of estimation of distribution algorithms (EDAs) in preserving high diversity, this paper proposes a multimodal EDA. Integrated with clustering strategies for crowding and speciation, two versions of this algorithm are developed, which operate at the niche level. Then these two algorithms are equipped with three distinctive techniques: 1) a dynamic cluster sizing strategy; 2) an alternative utilization of Gaussian and Cauchy distributions to generate offspring; and 3) an adaptive local search. The dynamic cluster sizing affords a potential balance between exploration and exploitation and reduces the sensitivity to the cluster size in the niching methods. Taking advantages of Gaussian and Cauchy distributions, we generate the offspring at the niche level through alternatively using these two distributions. Such utilization can also potentially offer a balance between exploration and exploitation. Further, solution accuracy is enhanced through a new local search scheme probabilistically conducted around seeds of niches with probabilities determined self-adaptively according to fitness values of these seeds. Extensive experiments conducted on 20 benchmark multimodal problems confirm that both algorithms can achieve competitive performance compared with several state-of-the-art multimodal algorithms, which is supported by nonparametric tests. Especially, the proposed algorithms are very promising for complex problems with many local optima.

Player/Avatar Body Relations in Multimodal Augmented Reality Games

NARCIS (Netherlands)

Rosa, N.E.

2016-01-01

Augmented reality research is finally moving towards multimodal experiences: more and more applications do not only include visuals, but also audio and even haptics. The purpose of multimodality in these applications can be to increase realism or to increase the amount or quality of communicated

Composition at Washington State University: Building a Multimodal Bricolage

Science.gov (United States)

Ericsson, Patricia; Hunter, Leeann Downing; Macklin, Tialitha Michelle; Edwards, Elizabeth Sue

2016-01-01

Multimodal pedagogy is increasingly accepted among composition scholars. However, putting such pedagogy into practice presents significant challenges. In this profile of Washington State University's first-year composition program, we suggest a multi-vocal and multi-theoretical approach to addressing the challenges of multimodal pedagogy. Patricia…

Multifuel multimodal network design; Projeto de redes multicombustiveis multimodal

Energy Technology Data Exchange (ETDEWEB)

Lage, Carolina; Dias, Gustavo; Bahiense, Laura; Ferreira Filho, Virgilio J.M. [Universidade Federal do Rio de Janeiro (UFRJ), RJ (Brazil). Coordenacao dos Programas de Pos-graduacao de Engenharia (COPPE). Programa de Engenharia de Producao

2008-07-01

The objective of the Multi commodity Multimodal Network Project is the development of modeling tools and methodologies for the optimal sizing of production networks and multimodal distribution of multiple fuel and its incomes, considering investments and transportation costs. Given the inherently non-linear combinatory nature of the problem, the resolution of real instances by the complete model, in an exact way, becomes computationally intractable. Thus, the strategy for resolution should contain a combination of exacts and heuristics methods, that must be applied to subdivisions of the original problem. This paper deals with one of these subdivisions, tackling the problem of modeling a network of pipelines in order to drain the production of ethanol away from the producing plants. The objective consists in defining the best network topology, minimizing investment and operational costs, and attending the total demand. In order to do that, the network was considered a tree, where the nodes are the center of producing regions and the edges are the pipelines, trough where the ethanol produced by plants must be drained away. The main objective also includes the decision over the optimal diameter of each pipeline and the optimal size of the bombs, in order to minimize the pumping costs. (author)

MULTIMODAL FEEDBACK PROVISION IN IMPROVING PRE-SERVICE TEACHERS’ COMPETENCE

Directory of Open Access Journals (Sweden)

Fazri Nur Yusuf

2017-09-01

Full Text Available Studies on potentials of feedback over English language teaching seem not to have not been well-revealed, including studies on the use of feedback to improve English pre-service teachers’ competence. The present study investigates to what extent a multimodal feedback can influence pre-service teachers’ teaching, and which teaching aspects are influenced. Twenty five pre-service teachers taking Microteaching Course served as respondents supervised by a course advisor. The data were collected by teacher observation in a rating-scale form, self-appraisal, and interviews. The data were analyzed by using correlated sample t-test and the eight teaching components proposed by Brown (2001. The results showed that after multimodal feedback provision, pre-service teachers indicated an improvement significantly in seven out of eight teaching aspects. The provision of multimodal feedback could improve their teaching competence on preparation, instructional objective elicitation, mastery of instructional materials, use of media, and classroom management, including classroom language. But, the results do not indicate that they perform well on reflection and follow-up due to some reasons. In addition, the results evince that multimodal feedback provision could improve pre-service teachers’ pedagogical competence when the multimodal feedback is integrated with content, interpersonal relationship, and management.

Multimode optical fiber

Science.gov (United States)

Bigot-Astruc, Marianne; Molin, Denis; Sillard, Pierre

2014-11-04

A depressed graded-index multimode optical fiber includes a central core, an inner depressed cladding, a depressed trench, an outer depressed cladding, and an outer cladding. The central core has an alpha-index profile. The depressed claddings limit the impact of leaky modes on optical-fiber performance characteristics (e.g., bandwidth, core size, and/or numerical aperture).

Avaliação ocular multimodal em doenças heredodistróficas e degenerativas da retina Multimodal fundus imaging in heredodystrophic and degenerative diseases of the retina

Directory of Open Access Journals (Sweden)

Daniela Cavalcanti Ferrara

2009-10-01

Full Text Available A tomografia de coerência óptica incorporou-se gradativamente ao contemporâneo arsenal diagnóstico em Oftalmologia, passando a exercer papel fundamental na investigação e condução de doenças oculares, particularmente na especialidade de Retina e Vítreo. A disponibilização comercial da nova geração de aparelhos, chamada de tomografia de coerência óptica "espectral", baseada em conceito físico distinto que permite a aquisição de imagens em alta velocidade, marcou o início de uma nova era desta tecnologia de investigação auxiliar. Adicionalmente, sua recente combinação com o oftalmoscópio de varredura a laser confocal (confocal scanning laser ophthalmoscope vem propiciando a aquisição de imagens tomográficas guiadas em tempo real pelos diferentes modos de imagem (autofluorescência de fundo, reflectância com luz "infravermelha" e angiografia com fluoresceína ou indocianina verde. A avaliação ocular multimodal (multimodal fundus imaging permite a correlação real e minuciosa de achados da morfologia retiniana e do epitélio pigmentar com dados de estudos angiográficos e de autofluorescência ou reflectância, propiciando assim inferências valiosas sobre a fisiologia do tecido. Neste artigo, discutimos brevemente as possíveis implicações da avaliação ocular multimodal na prática da especialidade de Retina e Vítreo.Optical coherence tomography was progressively incorporated to the contemporary diagnostic arsenal in Ophthalmology, playing a crucial role in the diagnosis and management of eye diseases, particularly in the specialty of retina and vitreous. The commercial availability of the new generation of devices, coined "spectral" optical coherence tomography, which is based in a distinct physical concept that permits high-speed image acquisition, launched a new era for this investigative ancillary tool. In addition, the recent combination of this new technology with a confocal scanning laser ophthalmoscope

Multimodal versus Unimodal Instruction in a Complex Learning Context.

Science.gov (United States)

Gellevij, Mark; van der Meij, Hans; de Jong, Ton; Pieters, Jules

2002-01-01

Compared multimodal instruction with text and pictures with unimodal text-only instruction as 44 college students used a visual or textual manual to learn a complex software application. Results initially support dual coding theory and indicate that multimodal instruction led to better performance than unimodal instruction. (SLD)

The Big Five: Addressing Recurrent Multimodal Learning Data Challenges

NARCIS (Netherlands)

Di Mitri, Daniele; Schneider, Jan; Specht, Marcus; Drachsler, Hendrik

2018-01-01

The analysis of multimodal data in learning is a growing field of research, which has led to the development of different analytics solutions. However, there is no standardised approach to handle multimodal data. In this paper, we describe and outline a solution for five recurrent challenges in

Facilitating Multiple Intelligences Through Multimodal Learning Analytics

Directory of Open Access Journals (Sweden)

Ayesha PERVEEN

2018-01-01

Full Text Available This paper develops a theoretical framework for employing learning analytics in online education to trace multiple learning variations of online students by considering their potential of being multiple intelligences based on Howard Gardner’s 1983 theory of multiple intelligences. The study first emphasizes the need to facilitate students as multiple intelligences by online education systems and then suggests a framework of the advanced form of learning analytics i.e., multimodal learning analytics for tracing and facilitating multiple intelligences while they are engaged in online ubiquitous learning. As multimodal learning analytics is still an evolving area, it poses many challenges for technologists, educationists as well as organizational managers. Learning analytics make machines meet humans, therefore, the educationists with an expertise in learning theories can help technologists devise latest technological methods for multimodal learning analytics and organizational managers can implement them for the improvement of online education. Therefore, a careful instructional design based on a deep understanding of students’ learning abilities, is required to develop teaching plans and technological possibilities for monitoring students’ learning paths. This is how learning analytics can help design an adaptive instructional design based on a quick analysis of the data gathered. Based on that analysis, the academicians can critically reflect upon the quick or delayed implementation of the existing instructional design based on students’ cognitive abilities or even about the single or double loop learning design. The researcher concludes that the online education is multimodal in nature, has the capacity to endorse multiliteracies and, therefore, multiple intelligences can be tracked and facilitated through multimodal learning analytics in an online mode. However, online teachers’ training both in technological implementations and

The Stability of Multi-modal Traffic Network

International Nuclear Information System (INIS)

Han Linghui; Sun Huijun; Zhu Chengjuan; Jia Bin; Wu Jianjun

2013-01-01

There is an explicit and implicit assumption in multimodal traffic equilibrium models, that is, if the equilibrium exists, then it will also occur. The assumption is very idealized; in fact, it may be shown that the quite contrary could happen, because in multimodal traffic network, especially in mixed traffic conditions the interaction among traffic modes is asymmetric and the asymmetric interaction may result in the instability of traffic system. In this paper, to study the stability of multimodal traffic system, we respectively present the travel cost function in mixed traffic conditions and in traffic network with dedicated bus lanes. Based on a day-to-day dynamical model, we study the evolution of daily route choice of travelers in multimodal traffic network using 10000 random initial values for different cases. From the results of simulation, it can be concluded that the asymmetric interaction between the cars and buses in mixed traffic conditions can lead the traffic system to instability when traffic demand is larger. We also study the effect of travelers' perception error on the stability of multimodal traffic network. Although the larger perception error can alleviate the effect of interaction between cars and buses and improve the stability of traffic system in mixed traffic conditions, the traffic system also become instable when the traffic demand is larger than a number. For all cases simulated in this study, with the same parameters, traffic system with dedicated bus lane has better stability for traffic demand than that in mixed traffic conditions. We also find that the network with dedicated bus lane has higher portion of travelers by bus than it of mixed traffic network. So it can be concluded that building dedicated bus lane can improve the stability of traffic system and attract more travelers to choose bus reducing the traffic congestion. (general)

Analyzing Multimode Wireless Sensor Networks Using the Network Calculus

Directory of Open Access Journals (Sweden)

Xi Jin

2015-01-01

Full Text Available The network calculus is a powerful tool to analyze the performance of wireless sensor networks. But the original network calculus can only model the single-mode wireless sensor network. In this paper, we combine the original network calculus with the multimode model to analyze the maximum delay bound of the flow of interest in the multimode wireless sensor network. There are two combined methods A-MM and N-MM. The method A-MM models the whole network as a multimode component, and the method N-MM models each node as a multimode component. We prove that the maximum delay bound computed by the method A-MM is tighter than or equal to that computed by the method N-MM. Experiments show that our proposed methods can significantly decrease the analytical delay bound comparing with the separate flow analysis method. For the large-scale wireless sensor network with 32 thousands of sensor nodes, our proposed methods can decrease about 70% of the analytical delay bound.

Photoacoustic-Based Multimodal Nanoprobes: from Constructing to Biological Applications.

Science.gov (United States)

Gao, Duyang; Yuan, Zhen

2017-01-01

Multimodal nanoprobes have attracted intensive attentions since they can integrate various imaging modalities to obtain complementary merits of single modality. Meanwhile, recent interest in laser-induced photoacoustic imaging is rapidly growing due to its unique advantages in visualizing tissue structure and function with high spatial resolution and satisfactory imaging depth. In this review, we summarize multimodal nanoprobes involving photoacoustic imaging. In particular, we focus on the method to construct multimodal nanoprobes. We have divided the synthetic methods into two types. First, we call it "one for all" concept, which involves intrinsic properties of the element in a single particle. Second, "all in one" concept, which means integrating different functional blocks in one particle. Then, we simply introduce the applications of the multifunctional nanoprobes for in vivo imaging and imaging-guided tumor therapy. At last, we discuss the advantages and disadvantages of the present methods to construct the multimodal nanoprobes and share our viewpoints in this area.

Benign familial fleck retina: multimodal imaging including optical coherence tomography angiography.

Science.gov (United States)

Garcia, Jose Mauricio Botto de Barros; Isaac, David Leonardo Cruvinel; Sardeiro, Tainara; Aquino, Érika; Avila, Marcos

2017-01-01

This report presents multimodal imaging of a 27-year-old woman diagnosed with benign familial fleck retina (OMIM 228980), an uncommon disorder. Fundus photographs revealed retinal flecks that affected her post-equatorial retina but spared the macular area. Fundus autofluorescence and infrared imaging demonstrated a symmetrical pattern of yellow-white fleck lesions that affected both eyes. Her full-field electroretinogram and electrooculogram were normal. An optical coherence tomography B-scan was performed for both eyes, revealing increased thickness of the retinal pigmented epithelium leading to multiple small pigmented epithelium detachments. The outer retina remained intact in both eyes. Spectral-domain optical coherence tomography angiography with split-spectrum amplitude decorrelation algorithm and 3 × 3 mm structural en face optical coherence tomography did not show macular lesions. Benign familial fleck retina belongs to a heterogenous group of so-called flecked retina syndromes, and should be considered in patients with yellowish-white retinal lesions without involvement of the macula.

Benign familial fleck retina: multimodal imaging including optical coherence tomography angiography

Directory of Open Access Journals (Sweden)

Jose Mauricio Botto de Barros Garcia

Full Text Available ABSTRACT This report presents multimodal imaging of a 27-year-old woman diagnosed with benign familial fleck retina (OMIM 228980, an uncommon disorder. Fundus photographs revealed retinal flecks that affected her post-equatorial retina but spared the macular area. Fundus autofluorescence and infrared imaging demonstrated a symmetrical pattern of yellow-white fleck lesions that affected both eyes. Her full-field electroretinogram and electrooculogram were normal. An optical coherence tomography B-scan was performed for both eyes, revealing increased thickness of the retinal pigmented epithelium leading to multiple small pigmented epithelium detachments. The outer retina remained intact in both eyes. Spectral-domain optical coherence tomography angiography with split-spectrum amplitude decorrelation algorithm and 3 × 3 mm structural en face optical coherence tomography did not show macular lesions. Benign familial fleck retina belongs to a heterogenous group of so-called flecked retina syndromes, and should be considered in patients with yellowish-white retinal lesions without involvement of the macula.

PET-MRI and multimodal cancer imaging

International Nuclear Information System (INIS)

Wang Taisong; Zhao Jinhua; Song Jianhua

2011-01-01

Multimodality imaging, specifically PET-CT, brought a new perspective into the fields of clinical imaging. Clinical cases have shown that PET-CT has great value in clinical diagnosis and experimental research. But PET-CT still bears some limitations. A major drawback is that CT provides only limited soft tissue contrast and exposes the patient to a significant radiation dose. MRI overcome these limitations, it has excellent soft tissue contrast, high temporal and spatial resolution and no radiation damage. Additionally, since MRI provides also functional information, PET-MRI will show a new direction of multimodality imaging in the future. (authors)

Multimodal training between agents

DEFF Research Database (Denmark)

Rehm, Matthias

2003-01-01

In the system Locator1, agents are treated as individual and autonomous subjects that are able to adapt to heterogenous user groups. Applying multimodal information from their surroundings (visual and linguistic), they acquire the necessary concepts for a successful interaction. This approach has...

Multimodal chemo-magnetic control of self-propelling microbots

Science.gov (United States)

Singh, Amit Kumar; Dey, Krishna Kanti; Chattopadhyay, Arun; Mandal, Tapas Kumar; Bandyopadhyay, Dipankar

2014-01-01

the force-field required to arrest the chemotactic migration. The influence of the coupled internal and external fields could halt, steer or reverse the direction the motor inside a microchannel, rotate the motor around a target, and deliver the motor to a cluster of cells. This study showcases a multimodal chemical-magnetic field regulated migration of micro-machines for sensing, transport, and delivery inside a fluidic environment. Electronic supplementary information (ESI) available: Scanning electron microscopy, transmission electron microscopy, X-ray diffraction pattern, vibrating sample magnetometry (VSM) hysteresis loop of freshly prepared FeNP coated micromotor and movies of micromotor motion. See DOI: 10.1039/c3nr05294j

Fused oblique incidence reflectometry and confocal fluorescence microscopy

Science.gov (United States)

Risi, Matthew D.; Rouse, Andrew R.; Gmitro, Arthur F.

2011-03-01

Confocal microendoscopy provides real-time high resolution cellular level images via a minimally invasive procedure, but relies on exogenous fluorophores, has a relatively limited penetration depth (100 μm) and field of view (700 μm), and produces a high rate of detailed information to the user. A new catheter based multi-modal system has been designed that combines confocal imaging and oblique incidence reflectometry (OIR), which is a non-invasive method capable of rapidly extracting tissue absorption, μa, and reduced scattering, μ's, spectra from tissue. The system builds on previous developments of a custom slit-scan multi-spectral confocal microendoscope and is designed to rapidly switch between diffuse spectroscopy and confocal fluorescence imaging modes of operation. An experimental proof-of-principle catheter has been developed that consists of a fiber bundle for traditional confocal fluorescence imaging and a single OIR source fiber which is manually redirected at +/- 26 degrees. Diffusely scattered light from each orientation of the source fiber is collected via the fiber bundle, with a frame of data representing spectra collected at a range of distances from the OIR source point. Initial results with intralipid phantoms show good agreement to published data over the 550-650 nm spectral range. We successfully imaged and measured the optical properties of rodent cardiac muscle.

A Multimodal Discourse Analysis of Tmall's Double Eleven Advertisement

Science.gov (United States)

Hu, Chunyu; Luo, Mengxi

2016-01-01

From the 1990s, the multimodal turn in discourse studies makes multimodal discourse analysis a popular topic in linguistics and communication studies. An important approach to applying Systemic Functional Linguistics to non-verbal modes is Visual Grammar initially proposed by Kress and van Leeuwen (1996). Considering that commercial advertisement…

Spatial-temporal-spectral EEG patterns of BOLD functional network connectivity dynamics

Science.gov (United States)

Lamoš, Martin; Mareček, Radek; Slavíček, Tomáš; Mikl, Michal; Rektor, Ivan; Jan, Jiří

2018-06-01

Objective. Growing interest in the examination of large-scale brain network functional connectivity dynamics is accompanied by an effort to find the electrophysiological correlates. The commonly used constraints applied to spatial and spectral domains during electroencephalogram (EEG) data analysis may leave part of the neural activity unrecognized. We propose an approach that blindly reveals multimodal EEG spectral patterns that are related to the dynamics of the BOLD functional network connectivity. Approach. The blind decomposition of EEG spectrogram by parallel factor analysis has been shown to be a useful technique for uncovering patterns of neural activity. The simultaneously acquired BOLD fMRI data were decomposed by independent component analysis. Dynamic functional connectivity was computed on the component’s time series using a sliding window correlation, and between-network connectivity states were then defined based on the values of the correlation coefficients. ANOVA tests were performed to assess the relationships between the dynamics of between-network connectivity states and the fluctuations of EEG spectral patterns. Main results. We found three patterns related to the dynamics of between-network connectivity states. The first pattern has dominant peaks in the alpha, beta, and gamma bands and is related to the dynamics between the auditory, sensorimotor, and attentional networks. The second pattern, with dominant peaks in the theta and low alpha bands, is related to the visual and default mode network. The third pattern, also with peaks in the theta and low alpha bands, is related to the auditory and frontal network. Significance. Our previous findings revealed a relationship between EEG spectral pattern fluctuations and the hemodynamics of large-scale brain networks. In this study, we suggest that the relationship also exists at the level of functional connectivity dynamics among large-scale brain networks when no standard spatial and spectral

Agrupador de imágenes multimodal no supervisado

OpenAIRE

Pérez Hernando, Jesús

2013-01-01

Trabajo Fin de Máster donde se implementa un método multimodal para la clasificación de imágenes sin etiquetar y sin intervención humana. Treball Fi de Màster on s'implementa un mètode multimodal per a la classificació d'imatges sense etiquetar i sense intervenció humana. Master thesis for the Computer Science Engineering program.

Multimodal news framing effects

NARCIS (Netherlands)

Powell, T.E.

2017-01-01

Visuals in news media play a vital role in framing citizens’ political preferences. Yet, compared to the written word, visual images are undervalued in political communication research. Using framing theory, this thesis redresses the balance by studying the combined, or multimodal, effects of visual

Spectral decomposition of single-tone-driven quantum phase modulation

International Nuclear Information System (INIS)

Capmany, Jose; Fernandez-Pousa, Carlos R

2011-01-01

Electro-optic phase modulators driven by a single radio-frequency tone Ω can be described at the quantum level as scattering devices where input single-mode radiation undergoes energy changes in multiples of ℎΩ. In this paper, we study the spectral representation of the unitary, multimode scattering operator describing these devices. The eigenvalue equation, phase modulation being a process preserving the photon number, is solved at each subspace with definite number of photons. In the one-photon subspace F 1 , the problem is equivalent to the computation of the continuous spectrum of the Susskind-Glogower cosine operator of the harmonic oscillator. Using this analogy, the spectral decomposition in F 1 is constructed and shown to be equivalent to the usual Fock-space representation. The result is then generalized to arbitrary N-photon subspaces, where eigenvectors are symmetrized combinations of N one-photon eigenvectors and the continuous spectrum spans the entire unit circle. Approximate normalizable one-photon eigenstates are constructed in terms of London phase states truncated to optical bands. Finally, we show that synchronous ultrashort pulse trains represent classical field configurations with the same structure as these approximate eigenstates, and that they can be considered as approximate eigenvectors of the classical formulation of phase modulation.

Spectral decomposition of single-tone-driven quantum phase modulation

Energy Technology Data Exchange (ETDEWEB)

Capmany, Jose [ITEAM Research Institute, Univ. Politecnica de Valencia, 46022 Valencia (Spain); Fernandez-Pousa, Carlos R, E-mail: c.pousa@umh.es [Signal Theory and Communications, Department of Physics and Computer Science, Univ. Miguel Hernandez, 03202 Elche (Spain)

2011-02-14

Electro-optic phase modulators driven by a single radio-frequency tone {Omega} can be described at the quantum level as scattering devices where input single-mode radiation undergoes energy changes in multiples of {h_bar}{Omega}. In this paper, we study the spectral representation of the unitary, multimode scattering operator describing these devices. The eigenvalue equation, phase modulation being a process preserving the photon number, is solved at each subspace with definite number of photons. In the one-photon subspace F{sub 1}, the problem is equivalent to the computation of the continuous spectrum of the Susskind-Glogower cosine operator of the harmonic oscillator. Using this analogy, the spectral decomposition in F{sub 1} is constructed and shown to be equivalent to the usual Fock-space representation. The result is then generalized to arbitrary N-photon subspaces, where eigenvectors are symmetrized combinations of N one-photon eigenvectors and the continuous spectrum spans the entire unit circle. Approximate normalizable one-photon eigenstates are constructed in terms of London phase states truncated to optical bands. Finally, we show that synchronous ultrashort pulse trains represent classical field configurations with the same structure as these approximate eigenstates, and that they can be considered as approximate eigenvectors of the classical formulation of phase modulation.

Object recognition through a multi-mode fiber

Science.gov (United States)

Takagi, Ryosuke; Horisaki, Ryoichi; Tanida, Jun

2017-04-01

We present a method of recognizing an object through a multi-mode fiber. A number of speckle patterns transmitted through a multi-mode fiber are provided to a classifier based on machine learning. We experimentally demonstrated binary classification of face and non-face targets based on the method. The measurement process of the experimental setup was random and nonlinear because a multi-mode fiber is a typical strongly scattering medium and any reference light was not used in our setup. Comparisons between three supervised learning methods, support vector machine, adaptive boosting, and neural network, are also provided. All of those learning methods achieved high accuracy rates at about 90% for the classification. The approach presented here can realize a compact and smart optical sensor. It is practically useful for medical applications, such as endoscopy. Also our study indicated a promising utilization of artificial intelligence, which has rapidly progressed, for reducing optical and computational costs in optical sensing systems.

The dynamics of multimodal integration: The averaging diffusion model.

Science.gov (United States)

Turner, Brandon M; Gao, Juan; Koenig, Scott; Palfy, Dylan; L McClelland, James

2017-12-01

We combine extant theories of evidence accumulation and multi-modal integration to develop an integrated framework for modeling multimodal integration as a process that unfolds in real time. Many studies have formulated sensory processing as a dynamic process where noisy samples of evidence are accumulated until a decision is made. However, these studies are often limited to a single sensory modality. Studies of multimodal stimulus integration have focused on how best to combine different sources of information to elicit a judgment. These studies are often limited to a single time point, typically after the integration process has occurred. We address these limitations by combining the two approaches. Experimentally, we present data that allow us to study the time course of evidence accumulation within each of the visual and auditory domains as well as in a bimodal condition. Theoretically, we develop a new Averaging Diffusion Model in which the decision variable is the mean rather than the sum of evidence samples and use it as a base for comparing three alternative models of multimodal integration, allowing us to assess the optimality of this integration. The outcome reveals rich individual differences in multimodal integration: while some subjects' data are consistent with adaptive optimal integration, reweighting sources of evidence as their relative reliability changes during evidence integration, others exhibit patterns inconsistent with optimality.

Operative and economic evaluation of a 'Laser Printer Multimodality' System

International Nuclear Information System (INIS)

Battaglia, G.; Moscatelli, G.; Maroldi, R.; Chiesa, A.

1991-01-01

The increasing application of digital techniques to diagnostic imaging is causing significant changes in several related activities, such as a reproduction of digital images on film. In the Department of Diagnostic Imaging of the University of Brescia, about 70% of the whole of images are produced by digital techniques; at present, most of these images are reproduced on film with a Multimodality System interfacing CT, MR, DSA, and DR units with a single laser printer. Our analysis evaluates the operative and economics aspects of image reproduction, by comparing the 'single cassette' multiformat Camera and the Laser Printer Multimodality SAystem. Our results point out the advantages obtained by reproducing images with a Laser Printer Multimodality System: outstanding quality, reproduction of multiple originals, and marked reduction in the time needed for both image archiving and film handling. The Laser Printer Multimodality System allows over 5 hours/day to be saved -that is to say the working day of an operator, who can be thus shifted to other functions. The important economic aspect of the reproduction of digital images on film proves the Laser Printer Multimodality System to have some advantage over Cameras

Raman-in-SEM, a multimodal and multiscale analytical tool: performance for materials and expertise.

Science.gov (United States)

Wille, Guillaume; Bourrat, Xavier; Maubec, Nicolas; Lahfid, Abdeltif

2014-12-01

The availability of Raman spectroscopy in a powerful analytical scanning electron microscope (SEM) allows morphological, elemental, chemical, physical and electronic analysis without moving the sample between instruments. This paper documents the metrological performance of the SEMSCA commercial Raman interface operated in a low vacuum SEM. It provides multiscale and multimodal analyses as Raman/EDS, Raman/cathodoluminescence or Raman/STEM (STEM: scanning transmission electron microscopy) as well as Raman spectroscopy on nanomaterials. Since Raman spectroscopy in a SEM can be influenced by several SEM-related phenomena, this paper firstly presents a comparison of this new tool with a conventional micro-Raman spectrometer. Then, some possible artefacts are documented, which are due to the impact of electron beam-induced contamination or cathodoluminescence contribution to the Raman spectra, especially with geological samples. These effects are easily overcome by changing or adapting the Raman spectrometer and the SEM settings and methodology. The deletion of the adverse effect of cathodoluminescence is solved by using a SEM beam shutter during Raman acquisition. In contrast, this interface provides the ability to record the cathodoluminescence (CL) spectrum of a phase. In a second part, this study highlights the interest and efficiency of the coupling in characterizing micrometric phases at the same point. This multimodal approach is illustrated with various issues encountered in geosciences. Copyright © 2014 Elsevier Ltd. All rights reserved.

Strategy development management of Multimodal Transport Network

Directory of Open Access Journals (Sweden)

Nesterova Natalia S.

2016-01-01

Full Text Available The article gives a brief overview of works on the development of transport infrastructure for multimodal transportation and integration of Russian transport system into the international transport corridors. The technology for control of the strategy, that changes shape and capacity of Multi-modal Transport Network (MTN, is considered as part of the methodology for designing and development of MTN. This technology allows to carry out strategic and operational management of the strategy implementation based on the use of the balanced scorecard.

Multimodal Behavior Therapy: Case Study of a High School Student.

Science.gov (United States)

Seligman, Linda

1981-01-01

A case study of a high school student concerned with weight problems illustrates multimodal behavior therapy and its use in a high school setting. Multimodal therapy allows the school counselor to maximize referral sources while emphasizing growth and actualization. (JAC)

Acting rehearsal in collaborative multimodal mixed reality environments

OpenAIRE

Steptoe, William; Normand, Jean-Marie; Oyekoya, Oyewole; Pece, Fabrizio; Giannopoulos, Elias; Tecchia, Franco; Steed, Anthony; Weyrich, Tim; Kautz, Jan; Slater, Mel

2012-01-01

This paper presents the use of our multimodal mixed reality telecommunication system to support remote acting rehearsal. The rehearsals involved two actors, located in London and Barcelona, and a director in another location in London. This triadic audiovisual telecommunication was performed in a spatial and multimodal collaborative mixed reality environment based on the 'destination-visitor' paradigm, which we define and put into use. We detail our heterogeneous system architecture, which sp...

MIDA - Optimizing control room performance through multi-modal design

International Nuclear Information System (INIS)

Ronan, A. M.

2006-01-01

Multi-modal interfaces can support the integration of humans with information processing systems and computational devices to maximize the unique qualities that comprise a complex system. In a dynamic environment, such as a nuclear power plant control room, multi-modal interfaces, if designed correctly, can provide complementary interaction between the human operator and the system which can improve overall performance while reducing human error. Developing such interfaces can be difficult for a designer without explicit knowledge of Human Factors Engineering principles. The Multi-modal Interface Design Advisor (MIDA) was developed as a support tool for system designers and developers. It provides design recommendations based upon a combination of Human Factors principles, a knowledge base of historical research, and current interface technologies. MIDA's primary objective is to optimize available multi-modal technologies within a human computer interface in order to balance operator workload with efficient operator performance. The purpose of this paper is to demonstrate MIDA and illustrate its value as a design evaluation tool within the nuclear power industry. (authors)

A multimodal instrument for real-time in situ study of ultrasound and cavitation mediated drug delivery.

Science.gov (United States)

Bian, Shuning; Seth, Anjali; Daly, Dan; Carlisle, Robert; Stride, Eleanor

2017-03-01

The development of a multimodal instrument capable of real-time in situ measurements of cavitation activity and effect in tissue mimicking phantoms during ultrasound and cavitation mediated drug delivery experiments is described here. The instrument features an acoustic arm that can expose phantoms to high-intensity focused-ultrasound while measuring cavitation activity and an optical arm that monitors cavitation effect using confocal microscopy. This combination of modalities allows real-time in situ characterisation of drug delivery in tissue and tissue mimicking phantoms during ultrasound and cavitation mediated drug delivery experiments. A representative result, obtained with a tissue mimicking phantom and acoustically activated droplets, is presented here as a demonstration of the instrument's capabilities and potential applications.

Development of a multi-scale and multi-modality imaging system to characterize tumours and their microenvironment in vivo

Science.gov (United States)

Rouffiac, Valérie; Ser-Leroux, Karine; Dugon, Emilie; Leguerney, Ingrid; Polrot, Mélanie; Robin, Sandra; Salomé-Desnoulez, Sophie; Ginefri, Jean-Christophe; Sebrié, Catherine; Laplace-Builhé, Corinne

2015-03-01

In vivo high-resolution imaging of tumor development is possible through dorsal skinfold chamber implantable on mice model. However, current intravital imaging systems are weakly tolerated along time by mice and do not allow multimodality imaging. Our project aims to develop a new chamber for: 1- long-term micro/macroscopic visualization of tumor (vascular and cellular compartments) and tissue microenvironment; and 2- multimodality imaging (photonic, MRI and sonography). Our new experimental device was patented in March 2014 and was primarily assessed on 75 mouse engrafted with 4T1-Luc tumor cell line, and validated in confocal and multiphoton imaging after staining the mice vasculature using Dextran 155KDa-TRITC or Dextran 2000kDa-FITC. Simultaneously, a universal stage was designed for optimal removal of respiratory and cardiac artifacts during microscopy assays. Experimental results from optical, ultrasound (Bmode and pulse subtraction mode) and MRI imaging (anatomic sequences) showed that our patented design, unlike commercial devices, improves longitudinal monitoring over several weeks (35 days on average against 12 for the commercial chamber) and allows for a better characterization of the early and late tissue alterations due to tumour development. We also demonstrated the compatibility for multimodality imaging and the increase of mice survival was by a factor of 2.9, with our new skinfold chamber. Current developments include: 1- defining new procedures for multi-labelling of cells and tissue (screening of fluorescent molecules and imaging protocols); 2- developing ultrasound and MRI imaging procedures with specific probes; 3- correlating optical/ultrasound/MRI data for a complete mapping of tumour development and microenvironment.

Multimodal backside imaging of a microcontroller using confocal laser scanning and optical-beam-induced current imaging

Science.gov (United States)

Finkeldey, Markus; Göring, Lena; Schellenberg, Falk; Brenner, Carsten; Gerhardt, Nils C.; Hofmann, Martin

2017-02-01

Microscopy imaging with a single technology is usually restricted to a single contrast mechanism. Multimodal imaging is a promising technique to improve the structural information that could be obtained about a device under test (DUT). Due to the different contrast mechanisms of laser scanning microscopy (LSM), confocal laser scanning microscopy (CLSM) and optical beam induced current microscopy (OBICM), a combination could improve the detection of structures in integrated circuits (ICs) and helps to reveal their layout. While OBIC imaging is sensitive to the changes between differently doped areas and to semiconductor-metal transitions, CLSM imaging is mostly sensitive to changes in absorption and reflection. In this work we present the implementation of OBIC imaging into a CLSM. We show first results using industry standard Atmel microcontrollers (MCUs) with a feature size of about 250nm as DUTs. Analyzing these types of microcontrollers helps to improve in the field of side-channel attacks to find hardware Trojans, possible spots for laser fault attacks and for reverse engineering. For the experimental results the DUT is placed on a custom circuit board that allows us to measure the current while imaging it in our in-house built stage scanning microscope using a near infrared (NIR) laser diode as light source. The DUT is thinned and polished, allowing backside imaging through the Si-substrate. We demonstrate the possibilities using this optical setup by evaluating OBIC, LSM and CLSM images above and below the threshold of the laser source.

[Multimodal pain therapy - implementation of process management - an attempt to consider management approaches].

Science.gov (United States)

Dunkel, Marion; Kramp, Melanie

2012-07-01

The combination of medical and economical proceedings allows new perspectives in the illustration of medical workflows. Considering structural and developmental aspects multimodal therapy programs show similarities with typical subjects of economic process systems. By pointing out the strategic appearance of the multimodal pain therapy concept multimodal approaches can be described to some extent by using management approaches. E. g., an economic process landscape can be used to represent procedures of a multimodal pain therapy program. © Georg Thieme Verlag Stuttgart · New York.

Pattern recognition of neurotransmitters using multimode sensing.

Science.gov (United States)

Stefan-van Staden, Raluca-Ioana; Moldoveanu, Iuliana; van Staden, Jacobus Frederick

2014-05-30

Pattern recognition is essential in chemical analysis of biological fluids. Reliable and sensitive methods for neurotransmitters analysis are needed. Therefore, we developed for pattern recognition of neurotransmitters: dopamine, epinephrine, norepinephrine a method based on multimode sensing. Multimode sensing was performed using microsensors based on diamond paste modified with 5,10,15,20-tetraphenyl-21H,23H-porphyrine, hemin and protoporphyrin IX in stochastic and differential pulse voltammetry modes. Optimized working conditions: phosphate buffer solution of pH 3.01 and KCl 0.1mol/L (as electrolyte support), were determined using cyclic voltammetry and used in all measurements. The lowest limits of quantification were: 10(-10)mol/L for dopamine and epinephrine, and 10(-11)mol/L for norepinephrine. The multimode microsensors were selective over ascorbic and uric acids and the method facilitated reliable assay of neurotransmitters in urine samples, and therefore, the pattern recognition showed high reliability (RSDneurotransmitters on biological fluids at a lower determination level than chromatographic methods. The sampling of the biological fluids referees only to the buffering (1:1, v/v) with a phosphate buffer pH 3.01, while for chromatographic methods the sampling is laborious. Accordingly with the statistic evaluation of the results at 99.00% confidence level, both modes can be used for pattern recognition and quantification of neurotransmitters with high reliability. The best multimode microsensor was the one based on diamond paste modified with protoporphyrin IX. Copyright © 2014 Elsevier B.V. All rights reserved.

Content-based TV sports video retrieval using multimodal analysis

Science.gov (United States)

Yu, Yiqing; Liu, Huayong; Wang, Hongbin; Zhou, Dongru

2003-09-01

In this paper, we propose content-based video retrieval, which is a kind of retrieval by its semantical contents. Because video data is composed of multimodal information streams such as video, auditory and textual streams, we describe a strategy of using multimodal analysis for automatic parsing sports video. The paper first defines the basic structure of sports video database system, and then introduces a new approach that integrates visual stream analysis, speech recognition, speech signal processing and text extraction to realize video retrieval. The experimental results for TV sports video of football games indicate that the multimodal analysis is effective for video retrieval by quickly browsing tree-like video clips or inputting keywords within predefined domain.

Validation of a multimodal travel simulator with travel information provision

NARCIS (Netherlands)

Chorus, C.G.; Molin, E.J.E.; Arentze, T.A.; Hoogendoorn, S.P.; Timmermans, H.J.P.; Wee, van G.P.

2007-01-01

This paper presents a computer based travel simulator for collecting data concerning the use of next-generation ATIS and their effects on traveler decision making in a multimodal travel environment. The tool distinguishes itself by presenting a completely abstract multimodal transport network, where

Optimization of Quantum-Dot Molecular Beam Epitaxy for Broad Spectral Bandwidth Devices

KAUST Repository

Majid, Mohammed Abdul

2012-12-01

The optimization of the key growth parameters for broad spectral bandwidth devices based on quantum dots is reported. A combination of atomic force microscopy, photoluminescence of test samples, and optoelectronic characterization of superluminescent diodes (SLDs) is used to optimize the growth conditions to obtain high-quality devices with large spectral bandwidth, radiative efficiency (due to a reduced defective-dot density), and thus output power. The defective-dot density is highlighted as being responsible for the degradation of device performance. An SLD device with 160 nm of bandwidth centered at 1230 nm is demonstrated.

Optimization of Quantum-Dot Molecular Beam Epitaxy for Broad Spectral Bandwidth Devices

KAUST Repository

Majid, Mohammed Abdul; Hugues, M.; Vézian, S.; Childs, D. T. D.; Hogg, R. A.

2012-01-01

The optimization of the key growth parameters for broad spectral bandwidth devices based on quantum dots is reported. A combination of atomic force microscopy, photoluminescence of test samples, and optoelectronic characterization of superluminescent diodes (SLDs) is used to optimize the growth conditions to obtain high-quality devices with large spectral bandwidth, radiative efficiency (due to a reduced defective-dot density), and thus output power. The defective-dot density is highlighted as being responsible for the degradation of device performance. An SLD device with 160 nm of bandwidth centered at 1230 nm is demonstrated.

Label-free nonlinear optical microscopy detects early markers for osteogenic differentiation of human stem cells

Science.gov (United States)

Hofemeier, Arne D.; Hachmeister, Henning; Pilger, Christian; Schürmann, Matthias; Greiner, Johannes F. W.; Nolte, Lena; Sudhoff, Holger; Kaltschmidt, Christian; Huser, Thomas; Kaltschmidt, Barbara

2016-05-01

Tissue engineering by stem cell differentiation is a novel treatment option for bone regeneration. Most approaches for the detection of osteogenic differentiation are invasive or destructive and not compatible with live cell analysis. Here, non-destructive and label-free approaches of Raman spectroscopy, coherent anti-Stokes Raman scattering (CARS) and second harmonic generation (SHG) microscopy were used to detect and image osteogenic differentiation of human neural crest-derived inferior turbinate stem cells (ITSCs). Combined CARS and SHG microscopy was able to detect markers of osteogenesis within 14 days after osteogenic induction. This process increased during continued differentiation. Furthermore, Raman spectroscopy showed significant increases of the PO43- symmetric stretch vibrations at 959 cm-1 assigned to calcium hydroxyapatite between days 14 and 21. Additionally, CARS microscopy was able to image calcium hydroxyapatite deposits within 14 days following osteogenic induction, which was confirmed by Alizarin Red-Staining and RT- PCR. Taken together, the multimodal label-free analysis methods Raman spectroscopy, CARS and SHG microscopy can monitor osteogenic differentiation of adult human stem cells into osteoblasts with high sensitivity and spatial resolution in three dimensions. Our findings suggest a great potential of these optical detection methods for clinical applications including in vivo observation of bone tissue-implant-interfaces or disease diagnosis.

Development of a micromirror-scanned multimodal CARS miniaturized microscope for the in vivo study of spinal cord disorders

Science.gov (United States)

Murugkar, Sangeeta; Smith, Brett; Naji, Majid; Brideau, Craig; Stys, Peter; Anis, Hanan

2011-03-01

We discuss the design and implementation of a novel multimodal coherent anti-Stokes Raman scattering (CARS) miniaturized microscope for imaging of injured and recovering spinal cords in a single living animal. We demonstrate for the first time, the use of a biaxial microelectromechanical system (MEMS) mirror for scanning and diffraction limited multiple lens miniaturized objective for exciting a CARS signal. The miniaturized microscope design includes light delivery using a large mode area photonic crystal fiber (PCF), and multimode fiber for collection of the nonlinear optical signal. The basic design concept, major engineering challenges, solutions, and preliminary results are presented. We demonstrate CARS and two photon excitation fluorescence microscopy in a benchtop setup with the miniaturized optics and MEMS scanning. The light source is based on a single femtosecond laser (pump beam) and a supercontinuum generated in a nonlinear PCF (Stokes beam). This is coupled using free space optics onto the surface of a resonantly driven two dimensional scanning MEMS mirror that scans the excitation light in a Lissajous pattern. The novel design of the miniaturized microscope is expected to provide significant new information on the pathogenesis of demyelinating diseases such as Multiple Sclerosis and Spinal Cord Injury.

Joint sparse representation for robust multimodal biometrics recognition.

Science.gov (United States)

Shekhar, Sumit; Patel, Vishal M; Nasrabadi, Nasser M; Chellappa, Rama

2014-01-01

Traditional biometric recognition systems rely on a single biometric signature for authentication. While the advantage of using multiple sources of information for establishing the identity has been widely recognized, computational models for multimodal biometrics recognition have only recently received attention. We propose a multimodal sparse representation method, which represents the test data by a sparse linear combination of training data, while constraining the observations from different modalities of the test subject to share their sparse representations. Thus, we simultaneously take into account correlations as well as coupling information among biometric modalities. A multimodal quality measure is also proposed to weigh each modality as it gets fused. Furthermore, we also kernelize the algorithm to handle nonlinearity in data. The optimization problem is solved using an efficient alternative direction method. Various experiments show that the proposed method compares favorably with competing fusion-based methods.

OSM-ORIENTED METHOD OF MULTIMODAL ROUTE PLANNING

Directory of Open Access Journals (Sweden)

X. Li

2015-07-01

Full Text Available With the increasing pervasiveness of basic facilitate of transportation and information, the need of multimodal route planning is becoming more essential in the fields of communication and transportation, urban planning, logistics management, etc. This article mainly described an OSM-oriented method of multimodal route planning. Firstly, it introduced how to extract the information we need from OSM data and build proper network model and storage model; then it analysed the accustomed cost standard adopted by most travellers; finally, we used shortest path algorithm to calculate the best route with multiple traffic means.

Raman Microscopy: A Noninvasive Method to Visualize the Localizations of Biomolecules in the Cornea.

Science.gov (United States)

Kaji, Yuichi; Akiyama, Toshihiro; Segawa, Hiroki; Oshika, Tetsuro; Kano, Hideaki

2017-11-01

In vivo and in situ visualization of biomolecules without pretreatment will be important for diagnosis and treatment of ocular disorders in the future. Recently, multiphoton microscopy, based on the nonlinear interactions between molecules and photons, has been applied to reveal the localizations of various molecules in tissues. We aimed to use multimodal multiphoton microscopy to visualize the localizations of specific biomolecules in rat corneas. Multiphoton images of the corneas were obtained from nonlinear signals of coherent anti-Stokes Raman scattering, third-order sum frequency generation, and second-harmonic generation. The localizations of the adhesion complex-containing basement membrane and Bowman layer were clearly visible in the third-order sum frequency generation images. The fine structure of type I collagen was observed in the corneal stroma in the second-harmonic generation images. The localizations of lipids, proteins, and nucleic acids (DNA/RNA) was obtained in the coherent anti-Stokes Raman scattering images. Imaging technologies have progressed significantly and been applied in medical fields. Optical coherence tomography and confocal microscopy are widely used but do not provide information on the molecular structure of the cornea. By contrast, multiphoton microscopy provides information on the molecular structure of living tissues. Using this technique, we successfully visualized the localizations of various biomolecules including lipids, proteins, and nucleic acids in the cornea. We speculate that multiphoton microscopy will provide essential information on the physiological and pathological conditions of the cornea, as well as molecular localizations in tissues without pretreatment.

Measurement of chromatic dispersion of microstructured polymer fibers by white-light spectral interferometry

DEFF Research Database (Denmark)

Hlubina, Petr; Ciprian, Dalibor; Frosz, Michael Henoch

2009-01-01

We present a white-light spectral interferometric method for measuring the chromatic dispersion of microstructured fibers made of polymethyl methacrylate (PMMA). The method uses an unbalanced Mach-Zehnder interferometer with the fiber of known length placed in one of the interferometer arms...... of the method by measuring the wavelength dependence of the differential group refractive index of a pure silica fiber. We apply a five-term power series fit to the measured data and confirm by its differentiation that the chromatic dispersion of pure silica glass agrees well with theory. Second, we measure...... the chromatic dispersion for the fundamental mode supported by two different PMMA microstructured fibers, the multimode fiber and the large-mode area one....

An atlas-based multimodal registration method for 2D images with discrepancy structures.

Science.gov (United States)

Lv, Wenchao; Chen, Houjin; Peng, Yahui; Li, Yanfeng; Li, Jupeng

2018-06-04

An atlas-based multimodal registration method for 2-dimension images with discrepancy structures was proposed in this paper. Atlas was utilized for complementing the discrepancy structure information in multimodal medical images. The scheme includes three steps: floating image to atlas registration, atlas to reference image registration, and field-based deformation. To evaluate the performance, a frame model, a brain model, and clinical images were employed in registration experiments. We measured the registration performance by the squared sum of intensity differences. Results indicate that this method is robust and performs better than the direct registration for multimodal images with discrepancy structures. We conclude that the proposed method is suitable for multimodal images with discrepancy structures. Graphical Abstract An Atlas-based multimodal registration method schematic diagram.

A new piezoelectric energy harvesting design concept: multimodal energy harvesting skin.

Science.gov (United States)

Lee, Soobum; Youn, Byeng D

2011-03-01

This paper presents an advanced design concept for a piezoelectric energy harvesting (EH), referred to as multimodal EH skin. This EH design facilitates the use of multimodal vibration and enhances power harvesting efficiency. The multimodal EH skin is an extension of our previous work, EH skin, which was an innovative design paradigm for a piezoelectric energy harvester: a vibrating skin structure and an additional thin piezoelectric layer in one device. A computational (finite element) model of the multilayered assembly - the vibrating skin structure and piezoelectric layer - is constructed and the optimal topology and/or shape of the piezoelectric layer is found for maximum power generation from multiple vibration modes. A design rationale for the multimodal EH skin was proposed: designing a piezoelectric material distribution and external resistors. In the material design step, the piezoelectric material is segmented by inflection lines from multiple vibration modes of interests to minimize voltage cancellation. The inflection lines are detected using the voltage phase. In the external resistor design step, the resistor values are found for each segment to maximize power output. The presented design concept, which can be applied to any engineering system with multimodal harmonic-vibrating skins, was applied to two case studies: an aircraft skin and a power transformer panel. The excellent performance of multimodal EH skin was demonstrated, showing larger power generation than EH skin without segmentation or unimodal EH skin.

Increased discriminability of authenticity from multimodal laughter is driven by auditory information.

Science.gov (United States)

Lavan, Nadine; McGettigan, Carolyn

2017-10-01

We present an investigation of the perception of authenticity in audiovisual laughter, in which we contrast spontaneous and volitional samples and examine the contributions of unimodal affective information to multimodal percepts. In a pilot study, we demonstrate that listeners perceive spontaneous laughs as more authentic than volitional ones, both in unimodal (audio-only, visual-only) and multimodal contexts (audiovisual). In the main experiment, we show that the discriminability of volitional and spontaneous laughter is enhanced for multimodal laughter. Analyses of relationships between affective ratings and the perception of authenticity show that, while both unimodal percepts significantly predict evaluations of audiovisual laughter, it is auditory affective cues that have the greater influence on multimodal percepts. We discuss differences and potential mismatches in emotion signalling through voices and faces, in the context of spontaneous and volitional behaviour, and highlight issues that should be addressed in future studies of dynamic multimodal emotion processing.

Photonic bandpass filter characteristics of multimode SOI waveguides integrated with submicron gratings.

Science.gov (United States)

Sah, Parimal; Das, Bijoy Krishna

2018-03-20

It has been shown that a fundamental mode adiabatically launched into a multimode SOI waveguide with submicron grating offers well-defined flat-top bandpass filter characteristics in transmission. The transmitted spectral bandwidth is controlled by adjusting both waveguide and grating design parameters. The bandwidth is further narrowed down by cascading two gratings with detuned parameters. A semi-analytical model is used to analyze the filter characteristics (1500  nm≤λ≤1650  nm) of the device operating in transverse-electric polarization. The proposed devices were fabricated with an optimized set of design parameters in a SOI substrate with a device layer thickness of 250 nm. The pass bandwidth of waveguide devices integrated with single-stage gratings are measured to be ∼24  nm, whereas the device with two cascaded gratings with slightly detuned periods (ΔΛ=2  nm) exhibits a pass bandwidth down to ∼10  nm.

Real-time multimodal sensing in nano/bio environment

Science.gov (United States)

Song, Bo

As a sensing device in nano-scale, scanning probe microscopy (SPM) is a powerful tool for exploring nano world. Nevertheless two fundamental problems tackle the development and application of SPM based imaging and measurement: slow imaging/measurement speed and inaccuracy of motion or position control. Usually, SPM imaging/properties measuring speed is too slow to capture a dynamic observation on sample surface. In addition, Both SPM imaging and properties measurement always experience positioning inaccuracy problems caused by hysteresis and creep of the piezo scanner. This dissertation will try to solve these issues and proposed a SPM based real-time multimodal sensing system which can be used in nano/bio environment. First, a compressive sensing based video rate fast SPM imaging system is shown as an efficient method to dynamically capture the sample surface change with the imaging speed 1.5 frame/s with the scan size of 500 nm * 500 nm. Besides topography imaging, a new additional modal of SPM: vibration mode, will be introduced, and it is developed by us to investigate the subsurface mechanical properties of the elastic sample such as cells and bacteria. A followed up study of enzymatic hydrolysis will demonstrate the ability of in situ observation of single molecule event using video rate SPM. After that we will introduce another modal of this SPM sensing system: accurate electrical properties measurement. In this electrical properties measurement mode, a compressive feedbacks based non-vector space control approach is proposed in order to improve the accuracy of SPM based nanomanipulations. Instead of sensors, the local images are used as both the input and feedback of a non-vector space closed-loop controller. A followed up study will also be introduced to shown the important role of non-vector space control in the study of conductivity distribution of multi-wall carbon nanotubes. At the end of this dissertation, some future work will be also proposed to

Aspergillus infection monitored by multimodal imaging in a rat model.

Science.gov (United States)

Pluhacek, Tomas; Petrik, Milos; Luptakova, Dominika; Benada, Oldrich; Palyzova, Andrea; Lemr, Karel; Havlicek, Vladimir

2016-06-01

Although myriads of experimental approaches have been published in the field of fungal infection diagnostics, interestingly, in 21st century there is no satisfactory early noninvasive tool for Aspergillus diagnostics with good sensitivity and specificity. In this work, we for the first time described the fungal burden in rat lungs by multimodal imaging approach. The Aspergillus infection was monitored by positron emission tomography and light microscopy employing modified Grocott's methenamine silver staining and eosin counterstaining. Laser ablation inductively coupled plasma mass spectrometry imaging has revealed a dramatic iron increase in fungi-affected areas, which can be presumably attributed to microbial siderophores. Quantitative elemental data were inferred from matrix-matched standards prepared from rat lungs. The iron, silver, and gold MS images collected with variable laser foci revealed that particularly silver or gold can be used as excellent elements useful for sensitively tracking the Aspergillus infection. The limit of detection was determined for both (107) Ag and (197) Au as 0.03 μg/g (5 μm laser focus). The selective incorporation of (107) Ag and (197) Au into fungal cell bodies and low background noise from both elements were confirmed by energy dispersive X-ray scattering utilizing the submicron lateral resolving power of scanning electron microscopy. The low limits of detection and quantitation of both gold and silver make ICP-MS imaging monitoring a viable alternative to standard optical evaluation used in current clinical settings. © 2016 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Quantitative phase imaging with scanning holographic microscopy: an experimental assesment

Directory of Open Access Journals (Sweden)

Tada Yoshitaka

2006-11-01

Full Text Available Abstract This paper demonstrates experimentally how quantitative phase information can be obtained in scanning holographic microscopy. Scanning holography can operate in both coherent and incoherent modes, simultaneously if desired, with different detector geometries. A spatially integrating detector provides an incoherent hologram of the object's intensity distribution (absorption and/or fluorescence, for example, while a point detector in a conjugate plane of the pupil provides a coherent hologram of the object's complex amplitude, from which a quantitative measure of its phase distribution can be extracted. The possibility of capturing simultaneously holograms of three-dimensional specimens, leading to three-dimensional reconstructions with absorption contrast, reflectance contrast, fluorescence contrast, as was previously demonstrated, and quantitative phase contrast, as shown here for the first time, opens up new avenues for multimodal imaging in biological studies.

Interactivity in Educational Apps for Young Children: A Multimodal Analysis

Science.gov (United States)

Blitz-Raith, Alexandra H.; Liu, Jianxin

2017-01-01

Interactivity is an important indicator of an educational app's reception. Since most educational apps are multimodal, it justifies a methodological initiative to understand meaningful involvement of multimodality in enacting and even amplifying interactivity in an educational app. Yet research so far has largely concentrated on algorithm…

Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example

DEFF Research Database (Denmark)

Vidakis, Nikolas; Vlasopoulos, Anastasios; Kounalakis, Tsampikos

2013-01-01

This paper presents a natural user interface system based on multimodal human computer interaction, which operates as an intermediate module between the user and the operating system. The aim of this work is to demonstrate a multimodal system which gives users the ability to interact with desktop...

Applications of Elpasolites as a Multimode Radiation Sensor

Science.gov (United States)

Guckes, Amber

This study consists of both computational and experimental investigations. The computational results enabled detector design selections and confirmed experimental results. The experimental results determined that the CLYC scintillation detector can be applied as a functional and field-deployable multimode radiation sensor. The computational study utilized MCNP6 code to investigate the response of CLYC to various incident radiations and to determine the feasibility of its application as a handheld multimode sensor and as a single-scintillator collimated directional detection system. These simulations include: • Characterization of the response of the CLYC scintillator to gamma-rays and neutrons; • Study of the isotopic enrichment of 7Li versus 6Li in the CLYC for optimal detection of both thermal neutrons and fast neutrons; • Analysis of collimator designs to determine the optimal collimator for the single CLYC sensor directional detection system to assay gamma rays and neutrons; Simulations of a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system with the optimized collimator to determine the feasibility of detecting nuclear materials that could be encountered during field operations. These nuclear materials include depleted uranium, natural uranium, low-enriched uranium, highly-enriched uranium, reactor-grade plutonium, and weapons-grade plutonium. The experimental study includes the design, construction, and testing of both a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system. Both were designed in the Inventor CAD software and based on results of the computational study to optimize its performance. The handheld CLYC multimode sensor is modular, scalable, low?power, and optimized for high count rates. Commercial?off?the?shelf components were used where possible in order to optimize size, increase robustness, and minimize cost. The handheld CLYC multimode

Multimodal imaging of heterogeneous polymers at the nanoscale by AFM and scanning near-field ellipsometric microscopy

NARCIS (Netherlands)

Cumurcu, Aysegul; Duvigneau, Joost; Lindsay, I.D.; Schön, Peter Manfred; Vancso, Gyula J.

2013-01-01

Scanning near field ellipsometric microscopy (SNEM) was used to simultaneously obtain optical images and tapping mode topography images of the microphase separated morphology of PS-b-P2VP block copolymer thin films. Optical images revealed a spatial resolution well below the diffraction limit. The

Multimodality imaging of the postoperative shoulder

Energy Technology Data Exchange (ETDEWEB)

Woertler, Klaus [Technische Universitaet Muenchen, Department of Radiology, Munich (Germany)

2007-12-15

Multimodality imaging of the postoperative shoulder includes radiography, magnetic resonance (MR) imaging, MR arthrography, computed tomography (CT), CT arthrography, and ultrasound. Target-oriented evaluation of the postoperative shoulder necessitates familiarity with surgical techniques, their typical complications and sources of failure, knowledge of normal and abnormal postoperative findings, awareness of the advantages and weaknesses with the different radiologic techniques, and clinical information on current symptoms and function. This article reviews the most commonly used surgical procedures for treatment of anterior glenohumeral instability, lesions of the labral-bicipital complex, subacromial impingement, and rotator cuff lesions and highlights the significance of imaging findings with a view to detection of recurrent lesions and postoperative complications in a multimodality approach. (orig.)

A multimodal wave spectrum-based approach for statistical downscaling of local wave climate

Science.gov (United States)

Hegermiller, Christie; Antolinez, Jose A A; Rueda, Ana C.; Camus, Paula; Perez, Jorge; Erikson, Li; Barnard, Patrick; Mendez, Fernando J.

2017-01-01

Characterization of wave climate by bulk wave parameters is insufficient for many coastal studies, including those focused on assessing coastal hazards and long-term wave climate influences on coastal evolution. This issue is particularly relevant for studies using statistical downscaling of atmospheric fields to local wave conditions, which are often multimodal in large ocean basins (e.g. the Pacific). Swell may be generated in vastly different wave generation regions, yielding complex wave spectra that are inadequately represented by a single set of bulk wave parameters. Furthermore, the relationship between atmospheric systems and local wave conditions is complicated by variations in arrival time of wave groups from different parts of the basin. Here, we address these two challenges by improving upon the spatiotemporal definition of the atmospheric predictor used in statistical downscaling of local wave climate. The improved methodology separates the local wave spectrum into “wave families,” defined by spectral peaks and discrete generation regions, and relates atmospheric conditions in distant regions of the ocean basin to local wave conditions by incorporating travel times computed from effective energy flux across the ocean basin. When applied to locations with multimodal wave spectra, including Southern California and Trujillo, Peru, the new methodology improves the ability of the statistical model to project significant wave height, peak period, and direction for each wave family, retaining more information from the full wave spectrum. This work is the base of statistical downscaling by weather types, which has recently been applied to coastal flooding and morphodynamic applications.

New Technologies, New Possibilities for the Arts and Multimodality in English Language Arts

Science.gov (United States)

Williams, Wendy R.

2014-01-01

This article discusses the arts, multimodality, and new technologies in English language arts. It then turns to the example of the illuminated text--a multimodal book report consisting of animated text, music, and images--to consider how art, multimodality, and technology can work together to support students' reading of literature and inspire…

Multi-modal RGB–Depth–Thermal Human Body Segmentation

DEFF Research Database (Denmark)

Palmero, Cristina; Clapés, Albert; Bahnsen, Chris

2016-01-01

This work addresses the problem of human body segmentation from multi-modal visual cues as a first stage of automatic human behavior analysis. We propose a novel RGB-Depth-Thermal dataset along with a multi-modal seg- mentation baseline. The several modalities are registered us- ing a calibration...... to other state-of-the-art meth- ods, obtaining an overlap above 75% on the novel dataset when compared to the manually annotated ground-truth of human segmentations....

Multimodal Strategies of Theorization

DEFF Research Database (Denmark)

Cartel, Melodie; Colombero, Sylvain; Boxenbaum, Eva

This paper examines the role of multimodal strategies in processes of theorization. Empirically, we investigate the theorization process of a highly disruptive innovation in the history of architecture: reinforced concrete. Relying on archival data from a dominant French architectural journal from...... with well-known rhetorical strategies and develop a process model of theorization....

Quantitative multimodality imaging in cancer research and therapy.

Science.gov (United States)

Yankeelov, Thomas E; Abramson, Richard G; Quarles, C Chad

2014-11-01

Advances in hardware and software have enabled the realization of clinically feasible, quantitative multimodality imaging of tissue pathophysiology. Earlier efforts relating to multimodality imaging of cancer have focused on the integration of anatomical and functional characteristics, such as PET-CT and single-photon emission CT (SPECT-CT), whereas more-recent advances and applications have involved the integration of multiple quantitative, functional measurements (for example, multiple PET tracers, varied MRI contrast mechanisms, and PET-MRI), thereby providing a more-comprehensive characterization of the tumour phenotype. The enormous amount of complementary quantitative data generated by such studies is beginning to offer unique insights into opportunities to optimize care for individual patients. Although important technical optimization and improved biological interpretation of multimodality imaging findings are needed, this approach can already be applied informatively in clinical trials of cancer therapeutics using existing tools. These concepts are discussed herein.

Toward multimodal signal detection of adverse drug reactions.

Science.gov (United States)

Harpaz, Rave; DuMouchel, William; Schuemie, Martijn; Bodenreider, Olivier; Friedman, Carol; Horvitz, Eric; Ripple, Anna; Sorbello, Alfred; White, Ryen W; Winnenburg, Rainer; Shah, Nigam H

2017-12-01

Improving mechanisms to detect adverse drug reactions (ADRs) is key to strengthening post-marketing drug safety surveillance. Signal detection is presently unimodal, relying on a single information source. Multimodal signal detection is based on jointly analyzing multiple information sources. Building on, and expanding the work done in prior studies, the aim of the article is to further research on multimodal signal detection, explore its potential benefits, and propose methods for its construction and evaluation. Four data sources are investigated; FDA's adverse event reporting system, insurance claims, the MEDLINE citation database, and the logs of major Web search engines. Published methods are used to generate and combine signals from each data source. Two distinct reference benchmarks corresponding to well-established and recently labeled ADRs respectively are used to evaluate the performance of multimodal signal detection in terms of area under the ROC curve (AUC) and lead-time-to-detection, with the latter relative to labeling revision dates. Limited to our reference benchmarks, multimodal signal detection provides AUC improvements ranging from 0.04 to 0.09 based on a widely used evaluation benchmark, and a comparative added lead-time of 7-22 months relative to labeling revision dates from a time-indexed benchmark. The results support the notion that utilizing and jointly analyzing multiple data sources may lead to improved signal detection. Given certain data and benchmark limitations, the early stage of development, and the complexity of ADRs, it is currently not possible to make definitive statements about the ultimate utility of the concept. Continued development of multimodal signal detection requires a deeper understanding the data sources used, additional benchmarks, and further research on methods to generate and synthesize signals. Copyright © 2017 Elsevier Inc. All rights reserved.

Multimodal treatment for unresectable pancreatic cancer

International Nuclear Information System (INIS)

Katayama, Kanji; Iida, Atsushi; Fujita, Takashi; Kobayashi, Taizo; Shinmoto, Syuichi; Hirose, Kazuo; Yamaguchi, Akio; Yoshida, Masanori

1998-01-01

In order to improve in prognosis and quality of life (QOL), the multimodal treatment for unresectable pancreatic cancers were performed. Bypass surgery was carried out for unresectable pancreatic cancer with intraoperative irradiation (IOR). After surgery, patients were treated with the combination of CDDP (25 mg) and MMC (4 mg) administration, intravenously continuous injection of 5-FU (250 mg for 24 hours), external radiation by the high voltage X-ray (1.5 Gy per irradiation, 4 times a week, and during hyperthermia 3 Gy per irradiation) and hyperthermia using the Thermotron RF-8 warmer. Six out of 13 patients received hyperthermia at over 40degC, were obtained PR, and their survival periods were 22, 21, 19, 18, 11 and 8 months and they could return to work. For all patients with pain, the symptom was abolished or reduced. The survival periods in cases of the multimodal treatment were longer than those of only bypass-surgery or of the resective cases with the curability C. The multimodal treatment combined with radiation, hyperthermia and surgery is more useful for the removal of pain and the improvement of QOL, and also expected the improvement of the prognosis than pancreatectomy. And hyperthermia has an important role on the effect of this treatment. (K.H.)

Multimodal treatment for unresectable pancreatic cancer

Energy Technology Data Exchange (ETDEWEB)

Katayama, Kanji; Iida, Atsushi; Fujita, Takashi; Kobayashi, Taizo; Shinmoto, Syuichi; Hirose, Kazuo; Yamaguchi, Akio; Yoshida, Masanori [Fukui Medical School, Matsuoka (Japan)

1998-07-01

In order to improve in prognosis and quality of life (QOL), the multimodal treatment for unresectable pancreatic cancers were performed. Bypass surgery was carried out for unresectable pancreatic cancer with intraoperative irradiation (IOR). After surgery, patients were treated with the combination of CDDP (25 mg) and MMC (4 mg) administration, intravenously continuous injection of 5-FU (250 mg for 24 hours), external radiation by the high voltage X-ray (1.5 Gy per irradiation, 4 times a week, and during hyperthermia 3 Gy per irradiation) and hyperthermia using the Thermotron RF-8 warmer. Six out of 13 patients received hyperthermia at over 40degC, were obtained PR, and their survival periods were 22, 21, 19, 18, 11 and 8 months and they could return to work. For all patients with pain, the symptom was abolished or reduced. The survival periods in cases of the multimodal treatment were longer than those of only bypass-surgery or of the resective cases with the curability C. The multimodal treatment combined with radiation, hyperthermia and surgery is more useful for the removal of pain and the improvement of QOL, and also expected the improvement of the prognosis than pancreatectomy. And hyperthermia has an important role on the effect of this treatment. (K.H.)

Field-based dynamic light scattering microscopy: theory and numerical analysis.

Science.gov (United States)

Joo, Chulmin; de Boer, Johannes F

2013-11-01

We present a theoretical framework for field-based dynamic light scattering microscopy based on a spectral-domain optical coherence phase microscopy (SD-OCPM) platform. SD-OCPM is an interferometric microscope capable of quantitative measurement of amplitude and phase of scattered light with high phase stability. Field-based dynamic light scattering (F-DLS) analysis allows for direct evaluation of complex-valued field autocorrelation function and measurement of localized diffusive and directional dynamic properties of biological and material samples with high spatial resolution. In order to gain insight into the information provided by F-DLS microscopy, theoretical and numerical analyses are performed to evaluate the effect of numerical aperture of the imaging optics. We demonstrate that sharp focusing of fields affects the measured diffusive and transport velocity, which leads to smaller values for the dynamic properties in the sample. An approach for accurately determining the dynamic properties of the samples is discussed.

Cultural Shifts, Multimodal Representations, and Assessment Practices: A Case Study

Science.gov (United States)

Curwood, Jen Scott

2012-01-01

Multimodal texts involve the presence, absence, and co-occurrence of alphabetic text with visual, audio, tactile, gestural, and spatial representations. This article explores how teachers' evaluation of students' multimodal work can be understood in terms of cognition and culture. When teachers apply a paradigm of assessment rooted in print-based…

The Work of Comics Collaborations: Considerations of Multimodal Composition for Writing Scholarship and Pedagogy

Science.gov (United States)

Scanlon, Molly J.

2015-01-01

Though multimodality is increasingly incorporated into our pedagogies and scholarship, explorations of collaborative multimodal composition are lacking. Existing literature on collaborative writing focuses predominately on texts either composed in singular modes or by a single author, neglecting the ways in which multimodal texts are composed…

Determination of line edge roughness in low-dose top-down scanning electron microscopy images

NARCIS (Netherlands)

Verduin, T.; Kruit, P.; Hagen, C.W.

2014-01-01

We investigated the off-line metrology for line edge roughness (LER) determination by using the discrete power spectral density (PSD). The study specifically addresses low-dose scanning electron microscopy (SEM) images in order to reduce the acquisition time and the risk of resist shrinkage. The

Advanced Multimodal Solutions for Information Presentation

Science.gov (United States)

Wenzel, Elizabeth M.; Godfroy-Cooper, Martine

2018-01-01

High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during EVA (Extra-Vehicular Activity) and telerobotic operations, the sensory restrictions associated with a space environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. During EVA, the visual and auditory channels are likely to be the most utilized with tasks such as monitoring the visual environment, attending visual and auditory displays, and maintaining multichannel auditory communications. Previous studies have shown that compared to unimodal displays (spatial auditory or 2D visual), bimodal presentation of information can improve operator performance during simulated extravehicular activity on planetary surfaces for tasks as diverse as orientation, localization or docking, particularly when the visual environment is degraded or workload is increased. Tactile displays offer a third sensory channel that may both offload information processing effort and provide a means to capture attention when urgently required. For example, recent studies suggest that including tactile cues may result in increased orientation and alerting accuracy, improved task response time and decreased workload, as well as provide self-orientation cues in microgravity on the ISS (International Space Station). An important overall issue is that context-dependent factors like task complexity, sensory degradation, peripersonal vs. extrapersonal space operations, workload, experience level, and operator fatigue tend to vary greatly in complex real-world environments and it will be difficult to design a multimodal interface that performs well under all conditions. As a

The semiotics of typography in literary texts. A multimodal approach

DEFF Research Database (Denmark)

Nørgaard, Nina

2009-01-01

to multimodal discourse proposed, for instance, by Kress & Van Leeuwen (2001) and Baldry & Thibault (2006), and, more specifically, the multimodal approach to typography suggested by Van Leeuwen (2005b; 2006), in order to sketch out a methodological framework applicable to the description and analysis...... of the semiotic potential of typography in literary texts....

A Multimodal Search Engine for Medical Imaging Studies.

Science.gov (United States)

Pinho, Eduardo; Godinho, Tiago; Valente, Frederico; Costa, Carlos

2017-02-01

The use of digital medical imaging systems in healthcare institutions has increased significantly, and the large amounts of data in these systems have led to the conception of powerful support tools: recent studies on content-based image retrieval (CBIR) and multimodal information retrieval in the field hold great potential in decision support, as well as for addressing multiple challenges in healthcare systems, such as computer-aided diagnosis (CAD). However, the subject is still under heavy research, and very few solutions have become part of Picture Archiving and Communication Systems (PACS) in hospitals and clinics. This paper proposes an extensible platform for multimodal medical image retrieval, integrated in an open-source PACS software with profile-based CBIR capabilities. In this article, we detail a technical approach to the problem by describing its main architecture and each sub-component, as well as the available web interfaces and the multimodal query techniques applied. Finally, we assess our implementation of the engine with computational performance benchmarks.

Multimodal designs for learning in contexts of diversity

Directory of Open Access Journals (Sweden)

Arlene Archer

2014-12-01

Full Text Available This paper aims to identify multimodal designs for learning in diverse and developing contexts, where access to resources remains vastly unequal. Using case studies from South African education, the paper explores ways of surfacing the range of students’ resources which are often not noticed or valued in formal educational settings. The studies showcased here demonstrate how ethnographic and textually-based approaches can be combined. Opening up the semiotic space of the classroom through multimodal designs for learning is important for finding innovative ways of addressing access, diversity, and past inequalities. This is of relevance not only to South Africa, but a range of global contexts. The paper argues that multimodal designs for learning can involve interrogating the relation between ‘tradition’ and ‘modernity’; harnessing students’ creative practices as resources for pedagogy; developing metalanguages for critical reflection; creating less regulated pedagogical spaces in order to enable useful teaching and learning practices.

Study of internalization and viability of multimodal nanoparticles for labeling of human umbilical cord mesenchymal stem cells; Estudo de internalizacao e viabilidade de nanoparticulas multimodal para marcacao de celulas-tronco mesenquimais de cordao umbilical humano

Energy Technology Data Exchange (ETDEWEB)

Miyaki, Liza Aya Mabuchi [Faculdade de Enfermagem, Hospital Israelita Albert Einstein - HIAE, Sao Paulo, SP (Brazil); Sibov, Tatiana Tais; Pavon, Lorena Favaro; Mamani, Javier Bustamante; Gamarra, Lionel Fernel, E-mail: tatianats@einstein.br [Instituto do Cerebro - InCe, Hospital Israelita Albert Einstein - HIAE, Sao Paulo, SP (Brazil)

2012-04-15

Objective: To analyze multimodal magnetic nanoparticles-Rhodamine B in culture media for cell labeling, and to establish a study of multimodal magnetic nanoparticles-Rhodamine B detection at labeled cells evaluating they viability at concentrations of 10 {mu}g Fe/mL and 100{mu}g Fe/mL. Methods: We performed the analysis of stability of multimodal magnetic nanoparticles-Rhodamine B in different culture media; the mesenchymal stem cells labeling with multimodal magnetic nanoparticles-Rhodamine B; the intracellular detection of multimodal magnetic nanoparticles-Rhodamine B in mesenchymal stem cells, and assessment of the viability of labeled cells by kinetic proliferation. Results: The stability analysis showed that multimodal magnetic nanoparticles-Rhodamine B had good stability in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium. The mesenchymal stem cell with multimodal magnetic nanoparticles-Rhodamine B described location of intracellular nanoparticles, which were shown as blue granules co-localized in fluorescent clusters, thus characterizing magnetic and fluorescent properties of multimodal magnetic nanoparticles Rhodamine B. Conclusion: The stability of multimodal magnetic nanoparticles-Rhodamine B found in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium assured intracellular mesenchymal stem cells labeling. This cell labeling did not affect viability of labeled mesenchymal stem cells since they continued to proliferate for five days. (author)

High-energy x-ray microscopy with multilayer reflectors (invited)

International Nuclear Information System (INIS)

Underwood, J.H.

1986-01-01

A knowledge of the spatial distribution of the x rays emitted by the hot plasma region is a key element in the study of the physical processes occurring in laser-produced plasmas and complements other diagnostics such as spectroscopy and temporal studies. X-ray microscopy with reflection microscopes offers the most direct means of obtaining this information. Until recently, the two types of microscopes that had been developed for this purpose, the Kirkpatrick--Baez and the Wolter, operated at relatively low energies (about 4--5 keV) and had very little spectral selectivity, relying on filters for coarse spectral resolution. With the development of x-ray reflecting multilayer mirrors, the energy response of such microscopes can be extended to 10 keV or higher, with good spectral selectivity. In addition, it is possible to reduce some of the optical aberrations to obtain improved spatial resolution. This paper describes some of the recent progress in making and evaluating x-ray reflectors, and outlines the optical design considerations for multilayer-coated microscopes. Results from a prototype multilayer K--B microscope are presented

NicoLase-An open-source diode laser combiner, fiber launch, and sequencing controller for fluorescence microscopy.

Directory of Open Access Journals (Sweden)

Philip R Nicovich

Full Text Available Modern fluorescence microscopy requires software-controlled illumination sources with high power across a wide range of wavelengths. Diode lasers meet the power requirements and combining multiple units into a single fiber launch expands their capability across the required spectral range. We present the NicoLase, an open-source diode laser combiner, fiber launch, and software sequence controller for fluorescence microscopy and super-resolution microscopy applications. Two configurations are described, giving four or six output wavelengths and one or two single-mode fiber outputs, with all CAD files, machinist drawings, and controller source code openly available.

Optical sensor in planar configuration based on multimode interference

Science.gov (United States)

Blahut, Marek

2017-08-01

In the paper a numerical analysis of optical sensors based on multimode interference in planar one-dimensional step-index configuration is presented. The structure consists in single-mode input and output waveguides and multimode waveguide which guide only few modes. Material parameters discussed refer to a SU8 polymer waveguide on SiO2 substrate. The optical system described will be designed to the analysis of biological substances.

Multimodality imaging of pulmonary infarction

International Nuclear Information System (INIS)

Bray, T.J.P.; Mortensen, K.H.; Gopalan, D.

2014-01-01

Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis

Multimodality imaging of pulmonary infarction

Energy Technology Data Exchange (ETDEWEB)

Bray, T.J.P., E-mail: timothyjpbray@gmail.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); Mortensen, K.H., E-mail: mortensen@doctors.org.uk [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); University Department of Radiology, Addenbrookes Hospital, Cambridge University Hospitals NHS Foundation Trust, Hills Road, Box 318, Cambridge CB2 0QQ (United Kingdom); Gopalan, D., E-mail: deepa.gopalan@btopenworld.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom)

2014-12-15

Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis.

Probing surface plasmons in individual Ag nanoparticles in the ultra-violet spectral regime.

Science.gov (United States)

Chu, Ming-Wen; Sharma, Pradeep; Chang, Ching-Pin; Liou, Sz Chian; Tsai, Kun-Tong; Wang, Juen-Kai; Wang, Yuh-Lin; Chen, Cheng Hsuan

2009-06-10

Previous investigations of surface plasmons in Ag largely focused on their excitations in the visible spectral regime. Using scanning transmission electron microscopy with an electron beam of 0.2 nm in conjunction with electron energy-loss spectroscopy, we spectrally and spatially probe the surface plasmons in individual Ag nanoparticles (approximately 30 nm), grown on Si, in the ultra-violet spectral regime. The nanomaterials show respective sharp and broad surface-plasmon resonances at approximately 3.5 eV (approximately 355 nm) and approximately 7.0 eV (approximately 177 nm), and the correlated spectral calculations established their multipolar characteristics. The near-field distributions of the surface plasmons on the nanoparticles were also mapped out, revealing the predominant dipolar nature of the 3.5 eV excitation with obvious near-field enhancements at one end of the nano-object. The unveiled near-field enhancements have potential applications in plasmonics and molecular sensing.

Probing surface plasmons in individual Ag nanoparticles in the ultra-violet spectral regime

International Nuclear Information System (INIS)

Chu, M-W; Chang, C-P; Liou, S C; Wang, J-K; Chen, C H; Sharma, Pradeep; Tsai, K-T; Wang, Y-L

2009-01-01

Previous investigations of surface plasmons in Ag largely focused on their excitations in the visible spectral regime. Using scanning transmission electron microscopy with an electron beam of 0.2 nm in conjunction with electron energy-loss spectroscopy, we spectrally and spatially probe the surface plasmons in individual Ag nanoparticles (∼30 nm), grown on Si, in the ultra-violet spectral regime. The nanomaterials show respective sharp and broad surface-plasmon resonances at ∼3.5 eV (∼355 nm) and ∼7.0 eV (∼177 nm), and the correlated spectral calculations established their multipolar characteristics. The near-field distributions of the surface plasmons on the nanoparticles were also mapped out, revealing the predominant dipolar nature of the 3.5 eV excitation with obvious near-field enhancements at one end of the nano-object. The unveiled near-field enhancements have potential applications in plasmonics and molecular sensing.

Investigation of protein selectivity in multimodal chromatography using in silico designed Fab fragment variants.

Science.gov (United States)

Karkov, Hanne Sophie; Krogh, Berit Olsen; Woo, James; Parimal, Siddharth; Ahmadian, Haleh; Cramer, Steven M

2015-11-01

In this study, a unique set of antibody Fab fragments was designed in silico and produced to examine the relationship between protein surface properties and selectivity in multimodal chromatographic systems. We hypothesized that multimodal ligands containing both hydrophobic and charged moieties would interact strongly with protein surface regions where charged groups and hydrophobic patches were in close spatial proximity. Protein surface property characterization tools were employed to identify the potential multimodal ligand binding regions on the Fab fragment of a humanized antibody and to evaluate the impact of mutations on surface charge and hydrophobicity. Twenty Fab variants were generated by site-directed mutagenesis, recombinant expression, and affinity purification. Column gradient experiments were carried out with the Fab variants in multimodal, cation-exchange, and hydrophobic interaction chromatographic systems. The results clearly indicated that selectivity in the multimodal system was different from the other chromatographic modes examined. Column retention data for the reduced charge Fab variants identified a binding site comprising light chain CDR1 as the main electrostatic interaction site for the multimodal and cation-exchange ligands. Furthermore, the multimodal ligand binding was enhanced by additional hydrophobic contributions as evident from the results obtained with hydrophobic Fab variants. The use of in silico protein surface property analyses combined with molecular biology techniques, protein expression, and chromatographic evaluations represents a previously undescribed and powerful approach for investigating multimodal selectivity with complex biomolecules. © 2015 Wiley Periodicals, Inc.

Multimodal network design and assessment

NARCIS (Netherlands)

Brands, Ties; Alkim, T.P.; van Eck, Gijs; van Arem, Bart; Arentze, T.

2010-01-01

A framework is proposed for the design of an optimal multimodal transport network for the Randstad area. This research framework consists of a multi-objective optimization heuristic and a fast network assessment module, which results in a set of Pareto optimal solutions. Subsequently, a proper

Multimodal Hyper-connectivity Networks for MCI Classification.

Science.gov (United States)

Li, Yang; Gao, Xinqiang; Jie, Biao; Yap, Pew-Thian; Kim, Min-Jeong; Wee, Chong-Yaw; Shen, Dinggang

2017-09-01

Hyper-connectivity network is a network where every edge is connected to more than two nodes, and can be naturally denoted using a hyper-graph. Hyper-connectivity brain network, either based on structural or functional interactions among the brain regions, has been used for brain disease diagnosis. However, the conventional hyper-connectivity network is constructed solely based on single modality data, ignoring potential complementary information conveyed by other modalities. The integration of complementary information from multiple modalities has been shown to provide a more comprehensive representation about the brain disruptions. In this paper, a novel multimodal hyper-network modelling method was proposed for improving the diagnostic accuracy of mild cognitive impairment (MCI). Specifically, we first constructed a multimodal hyper-connectivity network by simultaneously considering information from diffusion tensor imaging and resting-state functional magnetic resonance imaging data. We then extracted different types of network features from the hyper-connectivity network, and further exploited a manifold regularized multi-task feature selection method to jointly select the most discriminative features. Our proposed multimodal hyper-connectivity network demonstrated a better MCI classification performance than the conventional single modality based hyper-connectivity networks.

Spectral gamuts and spectral gamut mapping

Science.gov (United States)

Rosen, Mitchell R.; Derhak, Maxim W.

2006-01-01

All imaging devices have two gamuts: the stimulus gamut and the response gamut. The response gamut of a print engine is typically described in CIE colorimetry units, a system derived to quantify human color response. More fundamental than colorimetric gamuts are spectral gamuts, based on radiance, reflectance or transmittance units. Spectral gamuts depend on the physics of light or on how materials interact with light and do not involve the human's photoreceptor integration or brain processing. Methods for visualizing a spectral gamut raise challenges as do considerations of how to utilize such a data-set for producing superior color reproductions. Recent work has described a transformation of spectra reduced to 6-dimensions called LabPQR. LabPQR was designed as a hybrid space with three explicit colorimetric axes and three additional spectral reconstruction axes. In this paper spectral gamuts are discussed making use of LabPQR. Also, spectral gamut mapping is considered in light of the colorimetric-spectral duality of the LabPQR space.

Diffractive elements performance in chromatic confocal microscopy

International Nuclear Information System (INIS)

Garzon, J; Duque, D; Alean, A; Toledo, M; Meneses, J; Gharbi, T

2011-01-01

The Confocal Laser Scanning Microscopy (CLSM) has been widely used in the semiconductor industry and biomedicine because of its depth discrimination capability. Subsequent to this technique has been developed in recent years Chromatic Confocal Microscopy. This method retains the same principle of confocal and offers the added advantage of removing the axial movement of the moving system. This advantage is usually accomplished with an optical element that generates a longitudinal chromatic aberration and a coding system that relates the axial position of each point of the sample with the wavelength that is focused on each. The present paper shows the performance of compact chromatic confocal microscope when some different diffractive elements are used for generation of longitudinal chromatic aberration. Diffractive elements, according to the process and manufacturing parameters, may have different diffraction efficiency and focus a specific wavelength in a specific focal position. The performance assessment is carried out with various light sources which exhibit an incoherent behaviour and a broad spectral width.

Multispectral detection of cutaneous lesions using spectroscopy and microscopy approaches

Science.gov (United States)

Borisova, E.; Genova-Hristova, Ts.; Troyanova, P.; Pavlova, E.; Terziev, I.; Semyachkina-Glushkovskaya, O.; Lomova, M.; Genina, E.; Stanciu, G.; Tranca, D.; Avramov, L.

2018-02-01

Autofluorescence, diffuse-reflectance and transmission spectral, and microscopic measurements were made on different cutaneous neoplastic lesions, namely basal cell carcinoma, squamous cell carcinoma, malignant melanoma, and dysplastic and benign lesions related. Spectroscopic measurements were made on ex vivo tissue samples, and confocal microscopy investigations were made on thin tissue slices. Fluorescence spectra obtained reveal statistically significant differences between the different benign, dysplastic and malignant lesions by the level of emission intensity, as well by spectral shape, which are fingerprints applicable for differentiation algorithms. In reflectance mode the most significant differences are related to the influence of skin pigments - melanin and hemoglobin. Transmission spectroscopy mode gave complementary optical properties information about the tissue samples investigated to that one of reflectance and absorption spectroscopy. Using autofluorescence detection of skin lesions we obtain very good diagnostic performance for distinguishing of nonmelanoma lesions. Using diffuse reflectance and transmission spectroscopy we obtain significant tool for pigmented pathologies differentiation, but it is a tool with moderate sensitivity for non-melanoma lesions detection. One could rapidly increase the diagnostic accuracy of the received combined "optical biopsy" method when several spectral detection techniques are applied in common algorithm for lesions' differentiation. Specific spectral features observed in each type of lesion investigated on micro and macro level would be presented and discussed. Correlation between the spectral data received and the microscopic features observed would be discussed in the report.

Cycling in multimodal transport behaviours: Exploring modality styles in the Danish population

DEFF Research Database (Denmark)

Olafsson, Anton Stahl; Nielsen, Thomas Alexander Sick; Carstensen, Trine Agervig

2016-01-01

and small towns. Thus, the way in which travel modes relate to the urban environment and variations in modality styles must serve as the starting point for policies aiming to fulfil the potential of multimodal transport behaviour and promote cycling. (C) 2016 Elsevier Ltd. All rights reserved....... explores how cycling forms part of multimodal transport behaviour based on survey data on transport modes and travel purposes and the weekly frequency of out-of-home activities and travel mode use in a representative sample of adult Danes (n = 1957). The following five distinct multimodal travel segments...... or 'modality styles' are identified: 'education transport'; 'public-based transport'; 'limited transport'; 'bicycle-based transport'; and 'car-based transport'. Travel behaviour is predominantly multimodal with few unimodal car-drivers being identified. Substantial cycling takes place in all modality styles...

Multimodality with Eye tracking and Haptics: A New Horizon for Serious Games?

Directory of Open Access Journals (Sweden)

Shujie Deng

2014-10-01

Full Text Available The goal of this review is to illustrate the emerging use of multimodal virtual reality that can benefit learning-based games. The review begins with an introduction to multimodal virtual reality in serious games and we provide a brief discussion of why cognitive processes involved in learning and training are enhanced under immersive virtual environments. We initially outline studies that have used eye tracking and haptic feedback independently in serious games, and then review some innovative applications that have already combined eye tracking and haptic devices in order to provide applicable multimodal frameworks for learning-based games. Finally, some general conclusions are identified and clarified in order to advance current understanding in multimodal serious game production as well as exploring possible areas for new applications.

Design, Performance and Optimization for Multimodal Radar Operation

Directory of Open Access Journals (Sweden)

Surendra S. Bhat

2012-09-01

Full Text Available This paper describes the underlying methodology behind an adaptive multimodal radar sensor that is capable of progressively optimizing its range resolution depending upon the target scattering features. It consists of a test-bed that enables the generation of linear frequency modulated waveforms of various bandwidths. This paper discusses a theoretical approach to optimizing the bandwidth used by the multimodal radar. It also discusses the various experimental results obtained from measurement. The resolution predicted from theory agrees quite well with that obtained from experiments for different target arrangements.

Interferometric and nonlinear-optical spectral-imaging techniques for outer space and live cells

Science.gov (United States)

Itoh, Kazuyoshi

2015-12-01

Multidimensional signals such as the spectral images allow us to have deeper insights into the natures of objects. In this paper the spectral imaging techniques that are based on optical interferometry and nonlinear optics are presented. The interferometric imaging technique is based on the unified theory of Van Cittert-Zernike and Wiener-Khintchine theorems and allows us to retrieve a spectral image of an object in the far zone from the 3D spatial coherence function. The retrieval principle is explained using a very simple object. The promising applications to space interferometers for astronomy that are currently in progress will also be briefly touched on. An interesting extension of interferometric spectral imaging is a 3D and spectral imaging technique that records 4D information of objects where the 3D and spectral information is retrieved from the cross-spectral density function of optical field. The 3D imaging is realized via the numerical inverse propagation of the cross-spectral density. A few techniques suggested recently are introduced. The nonlinear optical technique that utilizes stimulated Raman scattering (SRS) for spectral imaging of biomedical targets is presented lastly. The strong signals of SRS permit us to get vibrational information of molecules in the live cell or tissue in real time. The vibrational information of unstained or unlabeled molecules is crucial especially for medical applications. The 3D information due to the optical nonlinearity is also the attractive feature of SRS spectral microscopy.

Semiconductor laser using multimode interference principle

Science.gov (United States)

Gong, Zisu; Yin, Rui; Ji, Wei; Wu, Chonghao

2018-01-01

Multimode interference (MMI) structure is introduced in semiconductor laser used in optical communication system to realize higher power and better temperature tolerance. Using beam propagation method (BPM), Multimode interference laser diode (MMI-LD) is designed and fabricated in InGaAsP/InP based material. As a comparison, conventional semiconductor laser using straight single-mode waveguide is also fabricated in the same wafer. With a low injection current (about 230 mA), the output power of the implemented MMI-LD is up to 2.296 mW which is about four times higher than the output power of the conventional semiconductor laser. The implemented MMI-LD exhibits stable output operating at the wavelength of 1.52 μm and better temperature tolerance when the temperature varies from 283.15 K to 293.15 K.

Driver Education for New Multimodal Facilities

Science.gov (United States)

2016-05-24

Local and state transportation agencies are redesigning roads to accommodate multimodal travel, including the addition of new configurations, infrastructures, and rules that may be unfamiliar to current drivers and other road users. Education and out...

Cuticular Drusen: Clinical Phenotypes and Natural History Defined Using Multimodal Imaging.

Science.gov (United States)

Balaratnasingam, Chandrakumar; Cherepanoff, Svetlana; Dolz-Marco, Rosa; Killingsworth, Murray; Chen, Fred K; Mendis, Randev; Mrejen, Sarah; Too, Lay Khoon; Gal-Or, Orly; Curcio, Christine A; Freund, K Bailey; Yannuzzi, Lawrence A

2018-01-01

To define the range and life cycles of cuticular drusen phenotypes using multimodal imaging and to review the histologic characteristics of cuticular drusen. Retrospective, observational cohort study and experimental laboratory study. Two hundred forty eyes of 120 clinic patients with a cuticular drusen phenotype and 4 human donor eyes with cuticular drusen (n = 2), soft drusen (n = 1), and hard drusen (n = 1). We performed a retrospective review of clinical and multimodal imaging data of patients with a cuticular drusen phenotype. Patients had undergone imaging with various combinations of color photography, fluorescein angiography, indocyanine green angiography, near-infrared reflectance, fundus autofluorescence, high-resolution OCT, and ultrawide-field imaging. Human donor eyes underwent processing for high-resolution light and electron microscopy. Appearance of cuticular drusen in multimodal imaging and the topography of a cuticular drusen distribution; age-dependent variations in cuticular drusen phenotypes, including the occurrence of retinal pigment epithelium (RPE) abnormalities, choroidal neovascularization, acquired vitelliform lesions (AVLs), and geographic atrophy (GA); and ultrastructural and staining characteristics of druse subtypes. The mean age of patients at the first visit was 57.9±13.4 years. Drusen and RPE changes were seen in the peripheral retina, anterior to the vortex veins, in 21.8% of eyes. Of eyes with more than 5 years of follow-up, cuticular drusen disappeared from view in 58.3% of eyes, drusen coalescence was seen in 70.8% of eyes, and new RPE pigmentary changes developed in 56.2% of eyes. Retinal pigment epithelium abnormalities, AVLs, neovascularization, and GA occurred at a frequency of 47.5%, 24.2%, 12.5%, and 25%, respectively, and were significantly more common in patients older than 60 years of age (all P < 0.015). Occurrence of GA and neovascularization were important determinants of final visual acuity in eyes with the

Molecular spectral imaging system for quantitative immunohistochemical analysis of early diabetic retinopathy.

Science.gov (United States)

Li, Qingli; Zhang, Jingfa; Wang, Yiting; Xu, Guoteng

2009-12-01

A molecular spectral imaging system has been developed based on microscopy and spectral imaging technology. The system is capable of acquiring molecular spectral images from 400 nm to 800 nm with 2 nm wavelength increments. The basic principles, instrumental systems, and system calibration method as well as its applications for the calculation of the stain-uptake by tissues are introduced. As a case study, the system is used for determining the pathogenesis of diabetic retinopathy and evaluating the therapeutic effects of erythropoietin. Some molecular spectral images of retinal sections of normal, diabetic, and treated rats were collected and analyzed. The typical transmittance curves of positive spots stained for albumin and advanced glycation end products are retrieved from molecular spectral data with the spectral response calibration algorithm. To explore and evaluate the protective effect of erythropoietin (EPO) on retinal albumin leakage of streptozotocin-induced diabetic rats, an algorithm based on Beer-Lambert's law is presented. The algorithm can assess the uptake by histologic retinal sections of stains used in quantitative pathology to label albumin leakage and advanced glycation end products formation. Experimental results show that the system is helpful for the ophthalmologist to reveal the pathogenesis of diabetic retinopathy and explore the protective effect of erythropoietin on retinal cells of diabetic rats. It also highlights the potential of molecular spectral imaging technology to provide more effective and reliable diagnostic criteria in pathology.

Quantum-cascade lasers in the 7-8 μm spectral range with full top metallization

Science.gov (United States)

Kurochkin, A. S.; Babichev, A. V.; Denisov, D. V.; Karachinsky, L. Ya; Novikov, I. I.; Sofronov, A. N.; Firsov, D. A.; Vorobjev, L. E.; Bousseksou, A.; Egorov, A. Yu

2018-03-01

The paper demonstrates the generation of multistage quantum-cascade lasers (QCL) in the 7-8 μm spectral range in the pulse generation mode. The active region structure we used is based on a two-phonon resonance scheme. The QCL heterostructure based on a heteropair of In0.53Ga0.47As/Al0.48In0.52As solid alloys was grown by molecular beam epitaxy and includes 50 identical stages. A waveguide geometry with top cladding with full top metallization (surface- plasmon quantum-cascade lasers) has been used. The developed QCLs have demonstrated multimodal generation in the 7-8 μm spectral range in the pulse mode in the 78-250 K temperature range. The threshold current density for a 1.6 mm long laser and a 20 μm ridge width amounted to ˜ 2.8 kA/cm2 at a temperature of 78 К. A temperature increase to 250 K causes a long-wave shift of the wavelength from 7.6 to 7.9 μm and a jth increase to 5.0 kA/cm2.

Multimode-singlemode-multimode optical fiber sensor coated with novolac resin for detecting liquid phase alcohol

Science.gov (United States)

Marfu'ah, Amalia, Niza Rosyda; Hatta, Agus Muhamad; Pratama, Detak Yan

2018-04-01

Alcohol sensor based on multimode-singlemode-multimode (MSM) optical fiber with novolac resin as the external medium is proposed and demonstrated experimentally. Novolac resin swells when it is exposed by the alcohol. This effect causes a change in the polymer density leading to the refractive index's variation. The transmission light of the sensor depends on the refractive index of external medium. Based on the results, alcohol sensor based on MSM optical fiber structure using novolac resin has a higher sensitivity compared to the sensor without using novolac resin in the mixture of alcohol and distilled water. Alcohol sensor based on MSM optical fiber structure using novolac resin in the mixture of alcohol and distilled water with a singlemode fiber length of 5 mm has a sensitivity of 0.028972 dBm per % V/V, and in the mixture of alcohol and sugar solution of 10% w/w has a sensitivity of 0.005005 dBm per % V/V.

High-resolution multimodal clinical multiphoton tomography of skin

Science.gov (United States)

König, Karsten

2011-03-01

This review focuses on multimodal multiphoton tomography based on near infrared femtosecond lasers. Clinical multiphoton tomographs for 3D high-resolution in vivo imaging have been placed into the market several years ago. The second generation of this Prism-Award winning High-Tech skin imaging tool (MPTflex) was introduced in 2010. The same year, the world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph. In particular, non-fluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen has been imaged with submicron resolution in patients suffering from psoriasis. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution wide-field systems such as ultrasound, optoacoustical, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer, optimization of treatment strategies, and cosmetic research including long-term testing of sunscreen nanoparticles as well as anti-aging products.

Modelling multimodal expression of emotion in a virtual agent.

Science.gov (United States)

Pelachaud, Catherine

2009-12-12

Over the past few years we have been developing an expressive embodied conversational agent system. In particular, we have developed a model of multimodal behaviours that includes dynamism and complex facial expressions. The first feature refers to the qualitative execution of behaviours. Our model is based on perceptual studies and encompasses several parameters that modulate multimodal behaviours. The second feature, the model of complex expressions, follows a componential approach where a new expression is obtained by combining facial areas of other expressions. Lately we have been working on adding temporal dynamism to expressions. So far they have been designed statically, typically at their apex. Only full-blown expressions could be modelled. To overcome this limitation, we have defined a representation scheme that describes the temporal evolution of the expression of an emotion. It is no longer represented by a static definition but by a temporally ordered sequence of multimodal signals.

[Multimodal medical image registration using cubic spline interpolation method].

Science.gov (United States)

He, Yuanlie; Tian, Lianfang; Chen, Ping; Wang, Lifei; Ye, Guangchun; Mao, Zongyuan

2007-12-01

Based on the characteristic of the PET-CT multimodal image series, a novel image registration and fusion method is proposed, in which the cubic spline interpolation method is applied to realize the interpolation of PET-CT image series, then registration is carried out by using mutual information algorithm and finally the improved principal component analysis method is used for the fusion of PET-CT multimodal images to enhance the visual effect of PET image, thus satisfied registration and fusion results are obtained. The cubic spline interpolation method is used for reconstruction to restore the missed information between image slices, which can compensate for the shortage of previous registration methods, improve the accuracy of the registration, and make the fused multimodal images more similar to the real image. Finally, the cubic spline interpolation method has been successfully applied in developing 3D-CRT (3D Conformal Radiation Therapy) system.

Study on multimodal transport route under low carbon background

Science.gov (United States)

Liu, Lele; Liu, Jie

2018-06-01

Low-carbon environmental protection is the focus of attention around the world, scientists are constantly researching on production of carbon emissions and living carbon emissions. However, there is little literature about multimodal transportation based on carbon emission at home and abroad. Firstly, this paper introduces the theory of multimodal transportation, the multimodal transport models that didn't consider carbon emissions and consider carbon emissions are analyzed. On this basis, a multi-objective programming 0-1 programming model with minimum total transportation cost and minimum total carbon emission is proposed. The idea of weight is applied to Ideal point method for solving problem, multi-objective programming is transformed into a single objective function. The optimal solution of carbon emission to transportation cost under different weights is determined by a single objective function with variable weights. Based on the model and algorithm, an example is given and the results are analyzed.

Interactivity in Educational Apps for Young children: A Multimodal Analysis

Directory of Open Access Journals (Sweden)

Alexandra H. Blitz-Raith

2017-11-01

Full Text Available Interactivity is an important indicator of an educational app's reception. Since most educational apps are multimodal, it justifies a methodological initiative to understand meaningful involvement of multimodality in enacting and even amplifying interactivity in an educational app. Yet research so far has largely concentrated on algorithm construct and user feedback rather than on multimodal interactions, especially from a social semiotics perspective. Drawing from social semiotics approaches, this article proposes a multimodal analytic framework to examine three layers of mode in engendering interaction; namely, multiplicity, function, and relationship. Using the analytic framework in an analysis of The Farm Adventure for Kids, a popular educational app for pre-school children, we found that still images are dominant proportionally and are central in the interactive process. We also found that tapping still images of animals on screen is the main action, with other screen actions deliberately excluded. Such findings suggest that aligning children’s cognitive and physical capabilities to the use of mode become the primary consideration in educational app design and that consistent attendance to this alignment in mobilizing modes significantly affect an educational app’s interactivity, and consequently its reception by young children

MODELING PARTICLE SIZE DISTRIBUTION IN HETEROGENEOUS POLYMERIZATION SYSTEMS USING MULTIMODAL LOGNORMAL FUNCTION

Directory of Open Access Journals (Sweden)

J. C. Ferrari

Full Text Available Abstract This work evaluates the usage of the multimodal lognormal function to describe Particle Size Distributions (PSD of emulsion and suspension polymerization processes, including continuous reactions with particle re-nucleation leading to complex multimodal PSDs. A global optimization algorithm, namely Particle Swarm Optimization (PSO, was used for parameter estimation of the proposed model, minimizing the objective function defined by the mean squared errors. Statistical evaluation of the results indicated that the multimodal lognormal function could describe distinctive features of different types of PSDs with accuracy and consistency.

An evaluation framework for multimodal interaction determining quality aspects and modality choice

CERN Document Server

Wechsung, Ina

2014-01-01

This book presents (1) an exhaustive and empirically validated taxonomy of quality aspects of multimodal interaction as well as respective measurement methods, (2) a validated questionnaire specifically tailored to the evaluation of multimodal systems and covering most of the taxonomy‘s quality aspects, (3) insights on how the quality perceptions of multimodal systems relate to the quality perceptions of its individual components, (4) a set of empirically tested factors which influence modality choice, and (5) models regarding the relationship of the perceived quality of a modality and the actual usage of a modality.

Tunable thin-film optical filters for hyperspectral microscopy

Science.gov (United States)

Favreau, Peter F.; Rich, Thomas C.; Prabhat, Prashant; Leavesley, Silas J.

2013-02-01

Hyperspectral imaging was originally developed for use in remote sensing applications. More recently, it has been applied to biological imaging systems, such as fluorescence microscopes. The ability to distinguish molecules based on spectral differences has been especially advantageous for identifying fluorophores in highly autofluorescent tissues. A key component of hyperspectral imaging systems is wavelength filtering. Each filtering technology used for hyperspectral imaging has corresponding advantages and disadvantages. Recently, a new optical filtering technology has been developed that uses multi-layered thin-film optical filters that can be rotated, with respect to incident light, to control the center wavelength of the pass-band. Compared to the majority of tunable filter technologies, these filters have superior optical performance including greater than 90% transmission, steep spectral edges and high out-of-band blocking. Hence, tunable thin-film optical filters present optical characteristics that may make them well-suited for many biological spectral imaging applications. An array of tunable thin-film filters was implemented on an inverted fluorescence microscope (TE 2000, Nikon Instruments) to cover the full visible wavelength range. Images of a previously published model, GFP-expressing endothelial cells in the lung, were acquired using a charge-coupled device camera (Rolera EM-C2, Q-Imaging). This model sample presents fluorescently-labeled cells in a highly autofluorescent environment. Linear unmixing of hyperspectral images indicates that thin-film tunable filters provide equivalent spectral discrimination to our previous acousto-optic tunable filter-based approach, with increased signal-to-noise characteristics. Hence, tunable multi-layered thin film optical filters may provide greatly improved spectral filtering characteristics and therefore enable wider acceptance of hyperspectral widefield microscopy.

A portable confocal hyperspectral microscope without any scan or tube lens and its application in fluorescence and Raman spectral imaging

Science.gov (United States)

Li, Jingwei; Cai, Fuhong; Dong, Yongjiang; Zhu, Zhenfeng; Sun, Xianhe; Zhang, Hequn; He, Sailing

2017-06-01

In this study, a portable confocal hyperspectral microscope is developed. In traditional confocal laser scanning microscopes, scan lens and tube lens are utilized to achieve a conjugate relationship between the galvanometer and the back focal plane of the objective, in order to achieve a better resolution. However, these lenses make it difficult to scale down the volume of the system. In our portable confocal hyperspectral microscope (PCHM), the objective is placed directly next to the galvomirror. Thus, scan lens and tube lens are not included in our system and the size of this system is greatly reduced. Furthermore, the resolution is also acceptable in many biomedical and food-safety applications. Through reducing the optical length of the system, the signal detection efficiency is enhanced. This is conducive to realizing both the fluorescence and Raman hyperspectral imaging. With a multimode fiber as a pinhole, an improved image contrast is also achieved. Fluorescent spectral images for HeLa cells/fingers and Raman spectral images of kumquat pericarp are present. The spectral resolution and spatial resolutions are about 0.4 nm and 2.19 μm, respectively. These results demonstrate that this portable hyperspectral microscope can be used in in-vivo fluorescence imaging and in situ Raman spectral imaging.

Revealing t-tubules in striated muscle with new optical super-resolution microscopy techniques

Directory of Open Access Journals (Sweden)

Isuru D. Jayasinghe

2014-12-01

Full Text Available The t-tubular system plays a central role in the synchronisation of calcium signalling and excitation-contraction coupling in most striated muscle cells. Light microscopy has been used for imaging t-tubules for well over 100 years and together with electron microscopy (EM, has revealed the three-dimensional complexities of the t-system topology within cardiomyocytes and skeletal muscle fibres from a range of species. The emerging super-resolution single molecule localisation microscopy (SMLM techniques are offering a near 10-fold improvement over the resolution of conventional fluorescence light microscopy methods, with the ability to spectrally resolve nanometre scale distributions of multiple molecular targets. In conjunction with the next generation of electron microscopy, SMLM has allowed the visualisation and quantification of intricate t-tubule morphologies within large areas of muscle cells at an unprecedented level of detail. In this paper, we review recent advancements in the t-tubule structural biology with the utility of various microscopy techniques. We outline the technical considerations in adapting SMLM to study t-tubules and its potential to further our understanding of the molecular processes that underlie the sub-micron scale structural alterations observed in a range of muscle pathologies.

On the effects of multimodal information integration in multitasking.

Science.gov (United States)

Stock, Ann-Kathrin; Gohil, Krutika; Huster, René J; Beste, Christian

2017-07-07

There have recently been considerable advances in our understanding of the neuronal mechanisms underlying multitasking, but the role of multimodal integration for this faculty has remained rather unclear. We examined this issue by comparing different modality combinations in a multitasking (stop-change) paradigm. In-depth neurophysiological analyses of event-related potentials (ERPs) were conducted to complement the obtained behavioral data. Specifically, we applied signal decomposition using second order blind identification (SOBI) to the multi-subject ERP data and source localization. We found that both general multimodal information integration and modality-specific aspects (potentially related to task difficulty) modulate behavioral performance and associated neurophysiological correlates. Simultaneous multimodal input generally increased early attentional processing of visual stimuli (i.e. P1 and N1 amplitudes) as well as measures of cognitive effort and conflict (i.e. central P3 amplitudes). Yet, tactile-visual input caused larger impairments in multitasking than audio-visual input. General aspects of multimodal information integration modulated the activity in the premotor cortex (BA 6) as well as different visual association areas concerned with the integration of visual information with input from other modalities (BA 19, BA 21, BA 37). On top of this, differences in the specific combination of modalities also affected performance and measures of conflict/effort originating in prefrontal regions (BA 6).

The Multi-modal Australian ScienceS Imaging and Visualisation Environment (MASSIVE high performance computing infrastructure: applications in neuroscience and neuroinformatics research

Directory of Open Access Journals (Sweden)

Wojtek James eGoscinski

2014-03-01

Full Text Available The Multi-modal Australian ScienceS Imaging and Visualisation Environment (MASSIVE is a national imaging and visualisation facility established by Monash University, the Australian Synchrotron, the Commonwealth Scientific Industrial Research Organisation (CSIRO, and the Victorian Partnership for Advanced Computing (VPAC, with funding from the National Computational Infrastructure and the Victorian Government. The MASSIVE facility provides hardware, software and expertise to drive research in the biomedical sciences, particularly advanced brain imaging research using synchrotron x-ray and infrared imaging, functional and structural magnetic resonance imaging (MRI, x-ray computer tomography (CT, electron microscopy and optical microscopy. The development of MASSIVE has been based on best practice in system integration methodologies, frameworks, and architectures. The facility has: (i integrated multiple different neuroimaging analysis software components, (ii enabled cross-platform and cross-modality integration of neuroinformatics tools, and (iii brought together neuroimaging databases and analysis workflows. MASSIVE is now operational as a nationally distributed and integrated facility for neuroinfomatics and brain imaging research.

A noninvasive multimodal technique to monitor brain tumor vascularization

Science.gov (United States)

Saxena, Vishal; Gonzalez-Gomez, Ignacio; Laug, Walter E.

2007-09-01

Determination of tumor oxygenation at the microvascular level will provide important insight into tumor growth, angiogenesis, necrosis and therapeutic response and will facilitate to develop protocols for studying tumor behavior. The non-ionizing near infrared spectroscopy (NIRS) technique has the potential to differentiate lesion and hemoglobin dynamics; however, it has a limited spatial resolution. On the other hand, magnetic resonance imaging (MRI) has achieved high spatial resolution with excellent tissue discrimination but is more susceptible to limited ability to monitor the hemoglobin dynamics. In the present work, the vascular status and the pathophysiological changes that occur during tumor vascularization are studied in an orthotopic brain tumor model. A noninvasive multimodal approach based on the NIRS technique, namely steady state diffuse optical spectroscopy (SSDOS) along with MRI, is applied for monitoring the concentrations of oxyhemoglobin, deoxyhemoglobin and water within tumor region. The concentrations of oxyhemoglobin, deoxyhemoglobin and water within tumor vasculature are extracted at 15 discrete wavelengths in a spectral window of 675-780 nm. We found a direct correlation between tumor size, intratumoral microvessel density and tumor oxygenation. The relative decrease in tumor oxygenation with growth indicates that though blood vessels infiltrate and proliferate the tumor region, a hypoxic trend is clearly present.

A noninvasive multimodal technique to monitor brain tumor vascularization

International Nuclear Information System (INIS)

Saxena, Vishal; Gonzalez-Gomez, Ignacio; Laug, Walter E

2007-01-01

Determination of tumor oxygenation at the microvascular level will provide important insight into tumor growth, angiogenesis, necrosis and therapeutic response and will facilitate to develop protocols for studying tumor behavior. The non-ionizing near infrared spectroscopy (NIRS) technique has the potential to differentiate lesion and hemoglobin dynamics; however, it has a limited spatial resolution. On the other hand, magnetic resonance imaging (MRI) has achieved high spatial resolution with excellent tissue discrimination but is more susceptible to limited ability to monitor the hemoglobin dynamics. In the present work, the vascular status and the pathophysiological changes that occur during tumor vascularization are studied in an orthotopic brain tumor model. A noninvasive multimodal approach based on the NIRS technique, namely steady state diffuse optical spectroscopy (SSDOS) along with MRI, is applied for monitoring the concentrations of oxyhemoglobin, deoxyhemoglobin and water within tumor region. The concentrations of oxyhemoglobin, deoxyhemoglobin and water within tumor vasculature are extracted at 15 discrete wavelengths in a spectral window of 675-780 nm. We found a direct correlation between tumor size, intratumoral microvessel density and tumor oxygenation. The relative decrease in tumor oxygenation with growth indicates that though blood vessels infiltrate and proliferate the tumor region, a hypoxic trend is clearly present

Evaluation of selectivity in homologous multimodal chromatographic systems using in silico designed antibody fragment libraries.

Science.gov (United States)

Karkov, Hanne Sophie; Woo, James; Krogh, Berit Olsen; Ahmadian, Haleh; Cramer, Steven M

2015-12-24

This study describes the in silico design, surface property analyses, production and chromatographic evaluations of a diverse set of antibody Fab fragment variants. Based on previous findings, we hypothesized that the complementarity-determining regions (CDRs) constitute important binding sites for multimodal chromatographic ligands. Given that antibodies are highly diversified molecules and in particular the CDRs, we set out to examine the generality of this result. For this purpose, four different Fab fragments with different CDRs and/or framework regions of the variable domains were identified and related variants were designed in silico. The four Fab variant libraries were subsequently generated by site-directed mutagenesis and produced by recombinant expression and affinity purification to enable examination of their chromatographic retention behavior. The effects of geometric re-arrangement of the functional moieties on the multimodal resin ligands were also investigated with respect to Fab variant retention profiles by comparing two commercially available multimodal cation-exchange ligands, Capto MMC and Nuvia cPrime, and two novel multimodal ligand prototypes. Interestingly, the chromatographic data demonstrated distinct selectivity trends between the four Fab variant libraries. For three of the Fab libraries, the CDR regions appeared as major binding sites for all multimodal ligands. In contrast, the fourth Fab library displayed a distinctly different chromatographic behavior, where Nuvia cPrime and related multimodal ligand prototypes provided markedly improved selectivity over Capto MMC. Clearly, the results illustrate that the discriminating power of multimodal ligands differs between different Fab fragments. The results are promising indications that multimodal chromatography using the appropriate multimodal ligands can be employed in downstream bioprocessing for challenging selective separation of product related variants. Copyright © 2015 Elsevier B

EXPLICITATION AND ADDITION TECHNIQUES IN AUDIOVISUAL TRANSLATION: A MULTIMODAL APPROACH OF ENGLISHINDONESIAN SUBTITLES

Directory of Open Access Journals (Sweden)

Ichwan Suyudi

2017-12-01

Full Text Available In audiovisual translation, the multimodality of the audiovisual text is both a challenge and a resource for subtitlers. This paper illustrates how multi-modes provide information that helps subtitlers to gain a better understanding of meaning-making practices that will influence them to make a decision-making in translating a certain verbal text. Subtitlers may explicit, add, and condense the texts based on the multi-modes as seen on the visual frames. Subtitlers have to consider the distribution and integration of the meanings of multi-modes in order to create comprehensive equivalence between the source and target texts. Excerpts of visual frames in this paper are taken from English films Forrest Gump (drama, 1996, and James Bond (thriller, 2010.

Multimodal Representations: A Fifth-Grade Teacher Influences Students' Design and Production

Science.gov (United States)

Shanahan, Lynn E.

2013-01-01

The purpose of this interpretive case study is to explore--through a close analysis of one fifth-grade class project--teacher's scaffolding and students' use of visual and linguistic modes when composing multimodally. Using Kress and van Leeuwen's multimodal theory of communication as a framework, this case study examines why teachers, whose…

Characterization of printed pigment-based inks on ink-jet media using cross-sectional electron microscopy

International Nuclear Information System (INIS)

Almeida, P. de; Pataki, T.; Peeters, D.; Roost, C. van

2004-01-01

This paper reports on the microscopic assessment of representative specimen cross-sections prepared by microtomy and ultramicrotomy with emphasis in structure-property information using optical, scanning and transmission electron microscopy, namely, the absolute optical density δ, the measured effective printing coverage C-tilde, the averaged pigment-based ink layer thickness t-bar, and the morphology at 100% nominal printing coverage. This work shows that for different test patches printed at the same nominal printing coverage a number of different printing schemes yield a pre-defined absolute optical density δ which basically depends on the measured effective printing coverage C-tilde and the type of pigment-based inks used (spectral absorptivity m≠∞) and therefore on the averaged pigment-based ink layer thickness t-bar. A method for estimating the spectral absorptivity m is presented which combines the absolute optical density δ of the test patch and the averaged pigment-based ink layer thickness t-bar as measured from cross-sectional electron microscopy

Study of internalization and viability of multimodal nanoparticles for labeling of human umbilical cord mesenchymal stem cells

International Nuclear Information System (INIS)

Miyaki, Liza Aya Mabuchi; Sibov, Tatiana Tais; Pavon, Lorena Favaro; Mamani, Javier Bustamante; Gamarra, Lionel Fernel

2012-01-01

Objective: To analyze multimodal magnetic nanoparticles-Rhodamine B in culture media for cell labeling, and to establish a study of multimodal magnetic nanoparticles-Rhodamine B detection at labeled cells evaluating they viability at concentrations of 10 μg Fe/mL and 100μg Fe/mL. Methods: We performed the analysis of stability of multimodal magnetic nanoparticles-Rhodamine B in different culture media; the mesenchymal stem cells labeling with multimodal magnetic nanoparticles-Rhodamine B; the intracellular detection of multimodal magnetic nanoparticles-Rhodamine B in mesenchymal stem cells, and assessment of the viability of labeled cells by kinetic proliferation. Results: The stability analysis showed that multimodal magnetic nanoparticles-Rhodamine B had good stability in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium. The mesenchymal stem cell with multimodal magnetic nanoparticles-Rhodamine B described location of intracellular nanoparticles, which were shown as blue granules co-localized in fluorescent clusters, thus characterizing magnetic and fluorescent properties of multimodal magnetic nanoparticles Rhodamine B. Conclusion: The stability of multimodal magnetic nanoparticles-Rhodamine B found in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium assured intracellular mesenchymal stem cells labeling. This cell labeling did not affect viability of labeled mesenchymal stem cells since they continued to proliferate for five days. (author)

Multimodal approaches to use mobile, digital devices in learning practies

DEFF Research Database (Denmark)

Buhl, Mie

, anthropology, psychology and sociology) and outlines the prospect of a trans-disciplinary learning mode. The learning mode reflects the current society where knowledge production is social collaborative process and is produced in formal as well as informal and non-formal contexts. My discussion’s theoretical......In this paper, I discuss the potential of multimodal approaches to enhance learning processes. I draw on a case based on Danish Master Courses in ICT and didactic designs where multimodal approaches are in the center of students’ practical design experience as well as in generation of theoretical...... knowledge. The design of the master courses takes its starting point in the assumption that theoretical knowledge generates from practical experiences. Thus, the organization of the students’ learning processes revolves around practical multimodal experiences followed by iterative reflexive sessions...

Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval

Science.gov (United States)

Bonnici, Heidi M.; Richter, Franziska R.; Yazar, Yasemin

2016-01-01

Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. SIGNIFICANCE STATEMENT Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (An

Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval.

Science.gov (United States)

Bonnici, Heidi M; Richter, Franziska R; Yazar, Yasemin; Simons, Jon S

2016-05-18

Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (AnG) contribute to the retrieval of

Multi-Modal Intelligent Traffic Signal Systems GPS

Data.gov (United States)

Department of Transportation — Data were collected during the Multi-Modal Intelligent Transportation Signal Systems (MMITSS) study. MMITSS is a next-generation traffic signal system that seeks to...

Vibrational imaging and microspectroscopies based on coherent anti-Stokes Raman scattering microscopy

International Nuclear Information System (INIS)

Volkmer, Andreas

2005-01-01

For noninvasive characterization of chemical species or biological components within a complex heterogeneous system, their intrinsic molecular vibrational properties can be used in contrast mechanisms in optical microscopy. A series of recent advances have made coherent anti-Stokes Raman scattering (CARS) microscopy a powerful technique that allows vibrational imaging with high sensitivity, high spectral resolution and three-dimensional sectioning capability. In this review, we discuss theoretical and experimental aspects of CARS microscopy in a collinear excitation beam geometry. Particular attention is given to the underlying physical principles behind the new features of CARS signal generation under tight focusing conditions. We provide a brief overview of the instrumentation of CARS microscopy and its experimental characterization by means of imaging of model systems and live unstained cells. CARS microscopy offers the possibility of spatially resolved vibrational spectroscopy, providing chemical and physical structure information of molecular specimens on the sub-micrometre length scale. We review multiplex CARS microspectroscopy allowing fast acquisition of frequency-resolved CARS spectra, time-resolved CARS microspectroscopy recording ultrafast Raman free induction decays and CARS correlation spectroscopy probing dynamical processes with chemical selectivity. (topical review)

Theoretical extension and experimental demonstration of spectral compression in second-harmonic generation by Fresnel-inspired binary phase shaping

Science.gov (United States)

Li, Baihong; Dong, Ruifang; Zhou, Conghua; Xiang, Xiao; Li, Yongfang; Zhang, Shougang

2018-05-01

Selective two-photon microscopy and high-precision nonlinear spectroscopy rely on efficient spectral compression at the desired frequency. Previously, a Fresnel-inspired binary phase shaping (FIBPS) method was theoretically proposed for spectral compression of two-photon absorption and second-harmonic generation (SHG) with a square-chirped pulse. Here, we theoretically show that the FIBPS can introduce a negative quadratic frequency phase (negative chirp) by analogy with the spatial-domain phase function of Fresnel zone plate. Thus, the previous theoretical model can be extended to the case where the pulse can be transformed limited and in any symmetrical spectral shape. As an example, we experimentally demonstrate spectral compression in SHG by FIBPS for a Gaussian transform-limited pulse and show good agreement with the theory. Given the fundamental pulse bandwidth, a narrower SHG bandwidth with relatively high intensity can be obtained by simply increasing the number of binary phases. The experimental results also verify that our method is superior to that proposed in [Phys. Rev. A 46, 2749 (1992), 10.1103/PhysRevA.46.2749]. This method will significantly facilitate the applications of selective two-photon microscopy and spectroscopy. Moreover, as it can introduce negative dispersion, hence it can also be generalized to other applications in the field of dispersion compensation.

Exploring Multimodal Registers in and Across Organizations and Institutional Fields

DEFF Research Database (Denmark)

Meyer, Renate; Jancsary, Dennis; Höllerer, Markus

In this article, we develop methodology that enables a systematic analysis of the structuralaspects of multimodal discourse from larger amounts of data. While existing research in visualorganization studies has provided interesting insights into the content and meaning(s) of visualand multimodal ......Responsibility (CSR), a complex and multivocal management idea that touches a variety oftopics and incorporates multiple levels of audience engagement with regard to a substantialdiversity of audiences....

Approaching Athenian Graffiti as a Multimodal Genre with GIS Application

OpenAIRE

Stampoulidis, Georgios

2017-01-01

Graffiti as an ever-changing form of urban art and visual communication is naturally multimodal, focusing on text–image relations (Bateman 2014; Forceville 2008; Kress 2006), which owe their existence mainly to the sociocultural and historical knowledge of the represented world of our experience – Husserlian Lebenswelt [Lifeworld] (Sonesson 2008; 2015). These relations constitute an interesting challenge to multimodal interpretations, because both verbal and/or pictorial representations can i...

Analysis of pigments in polychromes by use of laser induced breakdown spectroscopy and Raman microscopy

Science.gov (United States)

Castillejo, M.; Martín, M.; Silva, D.; Stratoudaki, T.; Anglos, D.; Burgio, L.; Clark, R. J. H.

2000-09-01

Two laser-based analytical techniques, Laser Induced Breakdown Spectroscopy (LIBS) and Raman microscopy, have been used for the identification of pigments on a polychrome from the Rococo period. Detailed spectral data are presented from analyses performed on a fragment of a gilded altarpiece from the church of Escatrón, Zaragoza, Spain. LIBS measurements yielded elemental analytical data which suggest the presence of certain pigments and, in addition, provide information on the stratigraphy of the paint layers. Identification of most pigments and of the materials used in the preparation layer was performed by Raman microscopy.

Multimodal human-machine interaction for service robots in home-care environments

OpenAIRE

Goetze, Stefan; Fischer, S.; Moritz, Niko; Appell, Jens-E.; Wallhoff, Frank

2012-01-01

This contribution focuses on multimodal interaction techniques for a mobile communication and assistance system on a robot platform. The system comprises of acoustic, visual and haptic input modalities. Feedback is given to the user by a graphical user interface and a speech synthesis system. By this, multimodal and natural communication with the robot system is possible.

Mn-doped near-infrared quantum dots as multimodal targeted probes for pancreatic cancer imaging

Science.gov (United States)

Yong, Ken-Tye

2009-01-01

This work presents a novel approach to producing manganese (Mn)-doped quantum dots (Mnd-QDs) emitting in the near-infrared (NIR). Surface functionalization of Mnd-QDs with lysine makes them stably disperse in aqueous media and able to conjugate with targeting molecules. The nanoparticles were structurally and compositionally characterized and maintained a high photoluminescence quantum yield and displayed paramagnetism in water. The receptor-mediated delivery of bioconjugated Mnd-QDs into pancreatic cancer cells was demonstrated using the confocal microscopy technique. Cytotoxicity of Mnd-QDs on live cells has been evaluated. The NIR-emitting characteristic of the QDs has been exploited to acquire whole animal body imaging with high contrast signals. In addition, histological and blood analysis of mice have revealed that no long-term toxic effects arise from MnD-QDs. These studies suggest multimodal Mnd-QDs have the potentials as probes for early pancreatic cancer imaging and detection.

Combined FVTD/PSTD Schemes with Enhanced Spectral Accuracy for the Design of Large-Scale EMC Applications

Directory of Open Access Journals (Sweden)

N. V. Kantartzis

2012-10-01

Full Text Available A generalized conformal time-domain method with adjustable spectral accuracy is introduced in this paper for the consistent analysis of large-scale electromagnetic compatibility problems. The novel 3-D hybrid schemes blend a stencil-optimized finite-volume time-domain and a multimodal Fourier-Chebyshev pseudo-spectral time-domain algorithm that split the overall space into smaller and flexible areas. A key asset is that both techniques are updated independently and interconnected by robust boundary conditions. Also, combining a family of spatial derivative approximators with controllable precision in general curvilinear coordinates, the proposed method launches a conformal field flux formulation to derive electromagnetic quantities in regions with fine details. For advanced grid reliability at dissimilar media interfaces, dispersion-reduced adaptive operators, which assign the proper weights to each spatial increment, are developed. So, the resulting discretization yields highly rigorous and computationally affordable simulations, devoid of lattice errors. Numerical results, addressing detailed comparisons of various realistic applications with reference or measurement data verify our methodology and reveal its significant applicability.

EndoTOFPET-US: a novel multimodal tool for endoscopy and positron emission tomography

International Nuclear Information System (INIS)

Aubry, N; Fourmigue, J-M; Auffray, E; Mimoun, F B; Doroud, K; Fornaro, G; Frisch, B; Brillouet, N; Courday, P; Bugalho, R; Charbon, E; Charles, O; Damon, C; Cortinovis, D; Gadow, K; Cserkaszky, A; Fischer, J-M; Fürst, B; Gardiazabal, J; Garutti, E

2013-01-01

The EndoTOFPET-US project aims to develop a multimodal detector to foster the development of new biomarkers for prostate and pancreatic tumors. The detector will consist of two main components: an external plate, and a PET extension to an endoscopic ultrasound probe. The external plate is an array of LYSO crystals read out by silicon photomultipliers (SiPM) coupled to an Application Specific Integrated Circuit (ASIC). The internal probe will be an highly integrated and miniaturized detector made of LYSO crystals read out by a fully digital SiPM featuring photosensor elements and digital readout in the same chip. The position and orientation of the two detectors will be tracked with respect to the patient to allow the fusion of the metabolic image from the PET and the anatomic image from the ultrasound probe in the time frame of the medical procedure. The fused information can guide further interventions of the organ, such as biopsy or in vivo confocal microscopy.

A simple approach to spectrally resolved fluorescence and bright field microscopy over select regions of interest.

Science.gov (United States)

Dahlberg, Peter D; Boughter, Christopher T; Faruk, Nabil F; Hong, Lu; Koh, Young Hoon; Reyer, Matthew A; Shaiber, Alon; Sherani, Aiman; Zhang, Jiacheng; Jureller, Justin E; Hammond, Adam T

2016-11-01

A standard wide field inverted microscope was converted to a spatially selective spectrally resolved microscope through the addition of a polarizing beam splitter, a pair of polarizers, an amplitude-mode liquid crystal-spatial light modulator, and a USB spectrometer. The instrument is capable of simultaneously imaging and acquiring spectra over user defined regions of interest. The microscope can also be operated in a bright-field mode to acquire absorption spectra of micron scale objects. The utility of the instrument is demonstrated on three different samples. First, the instrument is used to resolve three differently labeled fluorescent beads in vitro. Second, the instrument is used to recover time dependent bleaching dynamics that have distinct spectral changes in the cyanobacteria, Synechococcus leopoliensis UTEX 625. Lastly, the technique is used to acquire the absorption spectra of CH 3 NH 3 PbBr 3 perovskites and measure differences between nanocrystal films and micron scale crystals.

A simple approach to spectrally resolved fluorescence and bright field microscopy over select regions of interest

Science.gov (United States)

Dahlberg, Peter D.; Boughter, Christopher T.; Faruk, Nabil F.; Hong, Lu; Koh, Young Hoon; Reyer, Matthew A.; Shaiber, Alon; Sherani, Aiman; Zhang, Jiacheng; Jureller, Justin E.; Hammond, Adam T.

2016-11-01

A standard wide field inverted microscope was converted to a spatially selective spectrally resolved microscope through the addition of a polarizing beam splitter, a pair of polarizers, an amplitude-mode liquid crystal-spatial light modulator, and a USB spectrometer. The instrument is capable of simultaneously imaging and acquiring spectra over user defined regions of interest. The microscope can also be operated in a bright-field mode to acquire absorption spectra of micron scale objects. The utility of the instrument is demonstrated on three different samples. First, the instrument is used to resolve three differently labeled fluorescent beads in vitro. Second, the instrument is used to recover time dependent bleaching dynamics that have distinct spectral changes in the cyanobacteria, Synechococcus leopoliensis UTEX 625. Lastly, the technique is used to acquire the absorption spectra of CH3NH3PbBr3 perovskites and measure differences between nanocrystal films and micron scale crystals.

Bi-objective optimization for multi-modal transportation routing planning problem based on Pareto optimality

Directory of Open Access Journals (Sweden)

Yan Sun

2015-09-01

Full Text Available Purpose: The purpose of study is to solve the multi-modal transportation routing planning problem that aims to select an optimal route to move a consignment of goods from its origin to its destination through the multi-modal transportation network. And the optimization is from two viewpoints including cost and time. Design/methodology/approach: In this study, a bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. Minimizing the total transportation cost and the total transportation time are set as the optimization objectives of the model. In order to balance the benefit between the two objectives, Pareto optimality is utilized to solve the model by gaining its Pareto frontier. The Pareto frontier of the model can provide the multi-modal transportation operator (MTO and customers with better decision support and it is gained by the normalized normal constraint method. Then, an experimental case study is designed to verify the feasibility of the model and Pareto optimality by using the mathematical programming software Lingo. Finally, the sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case. Findings: The calculation results indicate that the proposed model and Pareto optimality have good performance in dealing with the bi-objective optimization. The sensitivity analysis also shows the influence of the variation of the demand and supply on the multi-modal transportation organization clearly. Therefore, this method can be further promoted to the practice. Originality/value: A bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. The Pareto frontier based sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case.

Preferential loss of dorsal-hippocampus synapses underlies memory impairments provoked by short, multimodal stress.

Science.gov (United States)

Maras, P M; Molet, J; Chen, Y; Rice, C; Ji, S G; Solodkin, A; Baram, T Z

2014-07-01

The cognitive effects of stress are profound, yet it is unknown if the consequences of concurrent multiple stresses on learning and memory differ from those of a single stress of equal intensity and duration. We compared the effects on hippocampus-dependent memory of concurrent, hours-long light, loud noise, jostling and restraint (multimodal stress) with those of restraint or of loud noise alone. We then examined if differences in memory impairment following these two stress types might derive from their differential impact on hippocampal synapses, distinguishing dorsal and ventral hippocampus. Mice exposed to hours-long restraint or loud noise were modestly or minimally impaired in novel object recognition, whereas similar-duration multimodal stress provoked severe deficits. Differences in memory were not explained by differences in plasma corticosterone levels or numbers of Fos-labeled neurons in stress-sensitive hypothalamic neurons. However, although synapses in hippocampal CA3 were impacted by both restraint and multimodal stress, multimodal stress alone reduced synapse numbers severely in dorsal CA1, a region crucial for hippocampus-dependent memory. Ventral CA1 synapses were not significantly affected by either stress modality. Probing the basis of the preferential loss of dorsal synapses after multimodal stress, we found differential patterns of neuronal activation by the two stress types. Cross-correlation matrices, reflecting functional connectivity among activated regions, demonstrated that multimodal stress reduced hippocampal correlations with septum and thalamus and increased correlations with amygdala and BST. Thus, despite similar effects on plasma corticosterone and on hypothalamic stress-sensitive cells, multimodal and restraint stress differ in their activation of brain networks and in their impact on hippocampal synapses. Both of these processes might contribute to amplified memory impairments following short, multimodal stress.

Adhesion of multimode adhesives to enamel and dentin after one year of water storage.

Science.gov (United States)

Vermelho, Paulo Moreira; Reis, André Figueiredo; Ambrosano, Glaucia Maria Bovi; Giannini, Marcelo

2017-06-01

This study aimed to evaluate the ultramorphological characteristics of tooth-resin interfaces and the bond strength (BS) of multimode adhesive systems to enamel and dentin. Multimode adhesives (Scotchbond Universal (SBU) and All-Bond Universal) were tested in both self-etch and etch-and-rinse modes and compared to control groups (Optibond FL and Clearfil SE Bond (CSB)). Adhesives were applied to human molars and composite blocks were incrementally built up. Teeth were sectioned to obtain specimens for microtensile BS and TEM analysis. Specimens were tested after storage for either 24 h or 1 year. SEM analyses were performed to classify the failure pattern of beam specimens after BS testing. Etching increased the enamel BS of multimode adhesives; however, BS decreased after storage for 1 year. No significant differences in dentin BS were noted between multimode and control in either evaluation period. Storage for 1 year only reduced the dentin BS for SBU in self-etch mode. TEM analysis identified hybridization and interaction zones in dentin and enamel for all adhesives. Silver impregnation was detected on dentin-resin interfaces after storage of specimens for 1 year only with the SBU and CSB. Storage for 1 year reduced enamel BS when adhesives are applied on etched surface; however, BS of multimode adhesives did not differ from those of the control group. In dentin, no significant difference was noted between the multimode and control group adhesives, regardless of etching mode. In general, multimode adhesives showed similar behavior when compared to traditional adhesive techniques. Multimode adhesives are one-step self-etching adhesives that can also be used after enamel/dentin phosphoric acid etching, but each product may work better in specific conditions.

Preferential loss of dorsal-hippocampus synapses underlies memory impairments provoked by short, multimodal stress

Science.gov (United States)

Maras, P M; Molet, J; Chen, Y; Rice, C; Ji, S G; Solodkin, A; Baram, T Z

2014-01-01

The cognitive effects of stress are profound, yet it is unknown if the consequences of concurrent multiple stresses on learning and memory differ from those of a single stress of equal intensity and duration. We compared the effects on hippocampus-dependent memory of concurrent, hours-long light, loud noise, jostling and restraint (multimodal stress) with those of restraint or of loud noise alone. We then examined if differences in memory impairment following these two stress types might derive from their differential impact on hippocampal synapses, distinguishing dorsal and ventral hippocampus. Mice exposed to hours-long restraint or loud noise were modestly or minimally impaired in novel object recognition, whereas similar-duration multimodal stress provoked severe deficits. Differences in memory were not explained by differences in plasma corticosterone levels or numbers of Fos-labeled neurons in stress-sensitive hypothalamic neurons. However, although synapses in hippocampal CA3 were impacted by both restraint and multimodal stress, multimodal stress alone reduced synapse numbers severely in dorsal CA1, a region crucial for hippocampus-dependent memory. Ventral CA1 synapses were not significantly affected by either stress modality. Probing the basis of the preferential loss of dorsal synapses after multimodal stress, we found differential patterns of neuronal activation by the two stress types. Cross-correlation matrices, reflecting functional connectivity among activated regions, demonstrated that multimodal stress reduced hippocampal correlations with septum and thalamus and increased correlations with amygdala and BST. Thus, despite similar effects on plasma corticosterone and on hypothalamic stress-sensitive cells, multimodal and restraint stress differ in their activation of brain networks and in their impact on hippocampal synapses. Both of these processes might contribute to amplified memory impairments following short, multimodal stress. PMID:24589888

Alternative modalities – A Review of Graphic Encounters: Comics and the Sponsorship of Multimodal Literacy

Directory of Open Access Journals (Sweden)

Aaron Scott Humphrey

2014-05-01

Full Text Available Research exploring the multimodal characteristics of comics has recently flourished, and Dale Jacobs has been one of the early prolific authors on this topic. Jacobs expands these ideas further in 'Graphic Encounters: Comics and the Sponsorship of Multimodal Literacy', a monograph which engages with theories of multimodality, but shifts its focus primarily to literacy sponsorship.

Analysis and synthesis of multi-qubit, multi-mode quantum devices

Energy Technology Data Exchange (ETDEWEB)

Solgun, Firat

2015-03-27

In this thesis we propose new methods in multi-qubit multi-mode circuit quantum electrodynamics (circuit-QED) architectures. First we describe a direct parity measurement method for three qubits, which can be realized in 2D circuit-QED with a possible extension to four qubits in a 3D circuit-QED setup for the implementation of the surface code. In Chapter 3 we show how to derive Hamiltonians and compute relaxation rates of the multi-mode superconducting microwave circuits consisting of single Josephson junctions using an exact impedance synthesis technique (the Brune synthesis) and applying previous formalisms for lumped element circuit quantization. In the rest of the thesis we extend our method to multi-junction (multi-qubit) multi-mode circuits through the use of state-space descriptions which allows us to quantize any multiport microwave superconducting circuit with a reciprocal lossy impedance response.

X-ray imaging and spectroscopy of individual cobalt nanoparticles using photoemission electron microscopy

International Nuclear Information System (INIS)

Fraile Rodriguez, A.; Nolting, F.; Bansmann, J.; Kleibert, A.; Heyderman, L.J.

2007-01-01

Photoemission electron microscopy (PEEM) was employed for X-ray imaging and absorption spectroscopy of individual cobalt nanoparticles as small as 8 nm grown using an arc ion cluster source. Using lithographic markers on the samples we were able to identify the same particles with PEEM and scanning electron microscopy. Significant variations in the shape of the X-ray absorption spectra between different cobalt particles were detected. Furthermore, our data suggest that distinctive spectral information about the individual particles, such as the quenching of oxide-related features and changes in the cobalt L 3 -edge intensity, cancel out and cannot be detected in the measurement over an ensemble of particles

Multimodality image registration with software: state-of-the-art

International Nuclear Information System (INIS)

Slomka, Piotr J.; Baum, Richard P.

2009-01-01

Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

Experimental Study on Bioluminescence Tomography with Multimodality Fusion

Directory of Open Access Journals (Sweden)

Yujie Lv

2007-01-01

Full Text Available To verify the influence of a priori information on the nonuniqueness problem of bioluminescence tomography (BLT, the multimodality imaging fusion based BLT experiment is performed by multiview noncontact detection mode, which incorporates the anatomical information obtained by the microCT scanner and the background optical properties based on diffuse reflectance measurements. In the reconstruction procedure, the utilization of adaptive finite element methods (FEMs and a priori permissible source region refines the reconstructed results and improves numerical robustness and efficiency. The comparison between the absence and employment of a priori information shows that multimodality imaging fusion is essential to quantitative BLT reconstruction.

Multimodal medical information retrieval with unsupervised rank fusion.

Science.gov (United States)

Mourão, André; Martins, Flávio; Magalhães, João

2015-01-01

Modern medical information retrieval systems are paramount to manage the insurmountable quantities of clinical data. These systems empower health care experts in the diagnosis of patients and play an important role in the clinical decision process. However, the ever-growing heterogeneous information generated in medical environments poses several challenges for retrieval systems. We propose a medical information retrieval system with support for multimodal medical case-based retrieval. The system supports medical information discovery by providing multimodal search, through a novel data fusion algorithm, and term suggestions from a medical thesaurus. Our search system compared favorably to other systems in 2013 ImageCLEFMedical. Copyright © 2014 Elsevier Ltd. All rights reserved.

Current and future multimodal learning analytics data challenges

DEFF Research Database (Denmark)

Spikol, Daniel; Prieto, Luis P.; Rodriguez-Triana, M.J.

2017-01-01

Multimodal Learning Analytics (MMLA) captures, integrates and analyzes learning traces from different sources in order to obtain a more holistic understanding of the learning process, wherever it happens. MMLA leverages the increasingly widespread availability of diverse sensors, high......-frequency data collection technologies and sophisticated machine learning and artificial intelligence techniques. The aim of this workshop is twofold: first, to expose participants to, and develop, different multimodal datasets that reflect how MMLA can bring new insights and opportunities to investigate complex...... learning processes and environments; second, to collaboratively identify a set of grand challenges for further MMLA research, built upon the foundations of previous workshops on the topic....

Effects of Multimodal Presentation and Stimulus Familiarity on Auditory and Visual Processing

Science.gov (United States)

Robinson, Christopher W.; Sloutsky, Vladimir M.

2010-01-01

Two experiments examined the effects of multimodal presentation and stimulus familiarity on auditory and visual processing. In Experiment 1, 10-month-olds were habituated to either an auditory stimulus, a visual stimulus, or an auditory-visual multimodal stimulus. Processing time was assessed during the habituation phase, and discrimination of…

Multimodal Teacher Input and Science Learning in a Middle School Sheltered Classroom

Science.gov (United States)

Zhang, Ying

2016-01-01

This article reports the results of an ethnographic research about the multimodal science discourse in a sixth-grade sheltered classroom involving English Language Learners (ELLs) only. Drawing from the perspective of multimodality, this study examines how science learning is constructed in science lectures through multiple semiotic resources,…

Interaction between visual and chemical cues in a Liolaemus lizard: a multimodal approach.

Science.gov (United States)

Vicente, Natalin S; Halloy, Monique

2017-12-01

Multimodal communication involves the use of signals and cues across two or more sensory modalities. The genus Liolaemus (Iguania: Liolaemidae) offers a great potential for studies on the ecology and evolution of multimodal communication, including visual and chemical signals. In this study, we analyzed the response of male and female Liolaemus pacha to chemical, visual and combined (multimodal) stimuli. Using cue-isolation tests, we registered the number of tongue flicks and headbob displays from exposure to signals in each modality. Number of tongue flicks was greater when a chemical stimulus was presented alone than in the presence of visual or multimodal stimuli. In contrast, headbob displays were fewer in number with visual and chemical stimuli alone, but significantly higher in number when combined. Female signallers triggered significantly more tongue flicks than male signallers, suggesting that chemical cues are involved in sexual recognition. We did not find an inhibition between chemical and visual cues. On the contrary, we observed a dominance of the chemical modality, because when presented with visual stimuli, lizards also responded with more tongue flicks than headbob displays. The total response produced by multimodal stimuli was similar to that of the chemical stimuli alone, possibly suggesting non-redundancy. We discuss whether the visual component of a multimodal signal could attract attention at a distance, increasing the effectiveness of transmission and reception of the information in chemical cues. Copyright © 2017 Elsevier GmbH. All rights reserved.

Quantitative changes in human epithelial cancers and osteogenesis imperfecta disease detected using nonlinear multicontrast microscopy

Science.gov (United States)

Adur, Javier; Pelegati, Vitor B.; de Thomaz, Andre A.; D'Souza-Li, Lilia; Assunção, Maria do Carmo; Bottcher-Luiz, Fátima; Andrade, Liliana A. L. A.; Cesar, Carlos L.

2012-08-01

We show that combined multimodal nonlinear optical (NLO) microscopies, including two-photon excitation fluorescence, second-harmonic generation (SHG), third harmonic generation, and fluorescence lifetime imaging microscopy (FLIM) can be used to detect morphological and metabolic changes associated with stroma and epithelial transformation during the progression of cancer and osteogenesis imperfecta (OI) disease. NLO microscopes provide complementary information about tissue microstructure, showing distinctive patterns for different types of human breast cancer, mucinous ovarian tumors, and skin dermis of patients with OI. Using a set of scoring methods (anisotropy, correlation, uniformity, entropy, and lifetime components), we found significant differences in the content, distribution and organization of collagen fibrils in the stroma of breast and ovary as well as in the dermis of skin. We suggest that our results provide a framework for using NLO techniques as a clinical diagnostic tool for human cancer and OI. We further suggest that the SHG and FLIM metrics described could be applied to other connective or epithelial tissue disorders that are characterized by abnormal cells proliferation and collagen assembly.

Palmprint and face multi-modal biometric recognition based on SDA-GSVD and its kernelization.

Science.gov (United States)

Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

2012-01-01

When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

Science.gov (United States)

Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

2012-01-01

When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance. PMID:22778600

Microsphere imaging with confocal microscopy and two photon microscopy

International Nuclear Information System (INIS)

Chun, Hyung Su; An, Kyung Won; Lee, Jai Hyung

2002-01-01

We have acquired images of polystyrene and fused-silica microsphere by using conventional optical microscopy, confocal microscopy and two-photon microscopy, and performed comparative analysis of these images. Different from conventional optical microscopy, confocal and two-photon microscopy had good optical sectioning capability. In addition, confocal microscopy and two-photon microscopy had better lateral resolution than conventional optical microscopy. These results are attributed to confocality and nonlinearity of confocal microscopy and two photon microscopy, respectively.

Histochemical study of trans-polyisoprene accumulation by spectral confocal laser scanning microscopy and a specific dye showing fluorescence solvatochromism in the rubber-producing plant, Eucommia ulmoides Oliver.

Science.gov (United States)

Nakazawa, Yoshihisa; Takeda, Tsuyoshi; Suzuki, Nobuaki; Hayashi, Tatsushi; Harada, Yoko; Bamba, Takeshi; Kobayashi, Akio

2013-09-01

A microscopic technique combining spectral confocal laser scanning microscopy with a lipophilic fluorescent dye, Nile red, which can emit trans-polyisoprene specific fluorescence, was developed, and unmixed images of synthesized trans-polyisoprene in situ in Eucommia ulmoides were successfully obtained. The images showed that trans-polyisoprene was initially synthesized as granules in non-articulated laticifers that changed shape to fibers during laticifer maturation. Non-articulated laticifers are developed from single laticiferous cells, which are differentiated from surrounding parenchyma cells in the cambium. Therefore, these observations suggested that trans-polyisoprene biosynthesis first started in laticifer cells as granules and then the granules accumulated and fused in the inner space of the laticifers over time. Finally, laticifers were filled with the synthesized trans-polyisoprene, which formed a fibrous structure fitting the laticifers shape. Both trans- and cis-polyisoprene are among the most important polymers naturally produced by plants, and this microscopic technique combined with histological study should provide useful information in the fields of plant histology, bioindustry and phytochemistry.

Multimodal representations in collaborative history learning

NARCIS (Netherlands)

Prangsma, M.E.

2007-01-01

This dissertation focuses on the question: How does making and connecting different types of multimodal representations affect the collaborative learning process and the acquisition of a chronological frame of reference in 12 to 14-year olds in pre vocational education? A chronological frame of

Quantitative photoacoustic microscopy of optical absorption coefficients from acoustic spectra in the optical diffusive regime.

Science.gov (United States)

Guo, Zijian; Favazza, Christopher; Garcia-Uribe, Alejandro; Wang, Lihong V

2012-06-01

Photoacoustic (PA) microscopy (PAM) can image optical absorption contrast with ultrasonic spatial resolution in the optical diffusive regime. Conventionally, accurate quantification in PAM requires knowledge of the optical fluence attenuation, acoustic pressure attenuation, and detection bandwidth. We circumvent this requirement by quantifying the optical absorption coefficients from the acoustic spectra of PA signals acquired at multiple optical wavelengths. With the acoustic spectral method, the absorption coefficients of an oxygenated bovine blood phantom at 560, 565, 570, and 575 nm were quantified with errors of <3%. We also quantified the total hemoglobin concentration and hemoglobin oxygen saturation in a live mouse. Compared with the conventional amplitude method, the acoustic spectral method provides greater quantification accuracy in the optical diffusive regime. The limitations of the acoustic spectral method was also discussed.

Super-Gaussian, super-diffusive transport of multi-mode active matter

OpenAIRE

Hahn, Seungsoo; Song, Sanggeun; Kim, Dae Hyun; Yang, Gil-Suk; Lee, Kang Taek; Sung, Jaeyoung

2017-01-01

Living cells exhibit multi-mode transport that switches between an active, self-propelled motion and a seemingly passive, random motion. Cellular decision-making over transport mode switching is a stochastic process that depends on the dynamics of the intracellular chemical network regulating the cell migration process. Here, we propose a theory and an exactly solvable model of multi-mode active matter. Our exact model study shows that the reversible transition between a passive mode and an a...

Systemic multimodal approach to speech therapy treatment in autistic children.

Science.gov (United States)

Tamas, Daniela; Marković, Slavica; Milankov, Vesela

2013-01-01

Conditions in which speech therapy treatment is applied in autistic children are often not in accordance with characteristics of opinions and learning of people with autism. A systemic multimodal approach means motivating autistic people to develop their language speech skill through the procedure which allows reliving of their personal experience according to the contents that are presented in the their natural social environment. This research was aimed at evaluating the efficiency of speech treatment based on the systemic multimodal approach to the work with autistic children. The study sample consisted of 34 children, aged from 8 to 16 years, diagnosed to have different autistic disorders, whose results showed a moderate and severe clinical picture of autism on the Childhood Autism Rating Scale. The applied instruments for the evaluation of ability were the Childhood Autism Rating Scale and Ganzberg II test. The study subjects were divided into two groups according to the type of treatment: children who were covered by the continuing treatment and systemic multimodal approach in the treatment, and children who were covered by classical speech treatment. It is shown that the systemic multimodal approach in teaching autistic children affects the stimulation of communication, socialization, self-service and work as well as that the progress achieved in these areas of functioning was retainable after long time, too. By applying the systemic multimodal approach when dealing with autistic children and by comparing their achievements on tests applied before, during and after the application of this mode, it has been concluded that certain improvement has been achieved in the functionality within the diagnosed category. The results point to a possible direction in the creation of new methods, plans and programs in dealing with autistic children based on empirical and interactive learning.

Multimodality therapy of local regional esophageal cancer.

Science.gov (United States)

Kelsen, David P

2005-12-01

Recent trials regarding the use of multimodality therapy for patients with cancers of the esophagus and gastroesophageal junction have not conclusively shown benefit. Regimens containing cisplatin and fluorouracil administered preoperatively appear to be tolerable and do not increase operative morbidity or mortality when compared with surgery alone. Yet clinical trials have not clearly shown that such regimens improve outcome as measured by survival. Likewise, trials of postoperative chemoradiation have not reported a significant improvement in median or overall survival. The reasons for the lack of clinical benefit from multimodality therapy are not completely understood, but improvements in systemic therapy will probably be necessary before disease-free or overall survival improves substantially. Some new single agents such as the taxanes (docetaxel or paclitaxel) and the camptothecan analog irinotecan have shown modest activity for palliative therapy.

New two-port multimode interference reflectors

NARCIS (Netherlands)

Kleijn, E.; Smit, M.K.; Wale, M.J.; Leijtens, X.J.M.

2012-01-01

Multi-mode interference reflectors (MIRs) are versatile components. Two new MIR designs with a fixed 50/50 reflection to transmission ratio are introduced. Measurements on these new devices and on devices similar to those in [1] are presented and compared to the design values. Measured losses are

Influence of Blood Contamination During Multimode Adhesive ...

African Journals Online (AJOL)

2018-01-30

Jan 30, 2018 ... (μTBS) of multimode adhesives to dentin when using the self‑etch approach. Materials and Methods: ... adhesion, the collagen fibers collapse during the. Introduction ..... The failure mode was determined using an optical.

Multimodal mechanisms of food creaminess sensation.

Science.gov (United States)

Chen, Jianshe; Eaton, Louise

2012-12-01

In this work, the sensory creaminess of a set of four viscosity-matched fluid foods (single cream, evaporated milk, corn starch solution, and corn starch solution containing long chain free fatty acids) was tested by a panel of 16 assessors via controlled sensation mechanisms of smell only, taste only, taste and tactile, and integrated multimodal. It was found that all sensation channels were able to discriminate between creamy and non-creamy foods, but only the multimodal method gave creaminess ratings in agreement with the samples' fat content. Results from this study show that the presence of long chain free fatty acids has no influence on creaminess perception. It is certain that food creaminess is not a primary sensory property but an integrated sensory perception (or sensory experience) derived from combined sensations of visual, olfactory, gustatory, and tactile cues. Creamy colour, milky flavour, and smooth texture are probably the most important sensory features of food creaminess.

Multimodal 2D Brain Computer Interface.

Science.gov (United States)

Almajidy, Rand K; Boudria, Yacine; Hofmann, Ulrich G; Besio, Walter; Mankodiya, Kunal

2015-08-01

In this work we used multimodal, non-invasive brain signal recording systems, namely Near Infrared Spectroscopy (NIRS), disc electrode electroencephalography (EEG) and tripolar concentric ring electrodes (TCRE) electroencephalography (tEEG). 7 healthy subjects participated in our experiments to control a 2-D Brain Computer Interface (BCI). Four motor imagery task were performed, imagery motion of the left hand, the right hand, both hands and both feet. The signal slope (SS) of the change in oxygenated hemoglobin concentration measured by NIRS was used for feature extraction while the power spectrum density (PSD) of both EEG and tEEG in the frequency band 8-30Hz was used for feature extraction. Linear Discriminant Analysis (LDA) was used to classify different combinations of the aforementioned features. The highest classification accuracy (85.2%) was achieved by using features from all the three brain signals recording modules. The improvement in classification accuracy was highly significant (p = 0.0033) when using the multimodal signals features as compared to pure EEG features.

Multimodal interaction with W3C standards toward natural user interfaces to everything

CERN Document Server

2017-01-01

This book presents new standards for multimodal interaction published by the W3C and other standards bodies in straightforward and accessible language, while also illustrating the standards in operation through case studies and chapters on innovative implementations. The book illustrates how, as smart technology becomes ubiquitous, and appears in more and more different shapes and sizes, vendor-specific approaches to multimodal interaction become impractical, motivating the need for standards. This book covers standards for voice, emotion, natural language understanding, dialog, and multimodal architectures. The book describes the standards in a practical manner, making them accessible to developers, students, and researchers. Comprehensive resource that explains the W3C standards for multimodal interaction clear and straightforward way; Includes case studies of the use of the standards on a wide variety of devices, including mobile devices, tablets, wearables and robots, in applications such as assisted livi...

Gestures and multimodal input

OpenAIRE

Keates, Simeon; Robinson, Peter

1999-01-01

For users with motion impairments, the standard keyboard and mouse arrangement for computer access often presents problems. Other approaches have to be adopted to overcome this. In this paper, we will describe the development of a prototype multimodal input system based on two gestural input channels. Results from extensive user trials of this system are presented. These trials showed that the physical and cognitive loads on the user can quickly become excessive and detrimental to the interac...

MOBILTEL - Mobile Multimodal Telecommunications dialogue system based on VoIP telephony

Directory of Open Access Journals (Sweden)

Anton Čižmár

2009-10-01

Full Text Available In this paper the project MobilTel ispresented. The communication itself is becoming amultimodal interactive process. The MobilTel projectprovides research and development activities inmultimodal interfaces area. The result is a functionalarchitecture for mobile multimodal telecommunicationsystem running on handheld device. The MobilTelcommunicator is a multimodal Slovak speech andgraphical interface with integrated VoIP client. Theother possible modalities are pen – touch screeninteraction, keyboard, and display on which theinformation is more user friendly presented (icons,emoticons, etc., and provides hyperlink and scrollingmenu availability.We describe the method of interaction between mobileterminal (PDA and MobilTel multimodal PCcommunicator over a VoIP WLAN connection basedon SIP protocol. We also present the graphicalexamples of services that enable users to obtaininformation about weather or information about trainconnection between two train stations.

Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

Directory of Open Access Journals (Sweden)

Jing-Yu Yang

2012-04-01

Full Text Available When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person’s overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA. Specifically, one person’s different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

Multi-focus beam shaping of high power multimode lasers

Science.gov (United States)

Laskin, Alexander; Volpp, Joerg; Laskin, Vadim; Ostrun, Aleksei

2017-08-01

Beam shaping of powerful multimode fiber lasers, fiber-coupled solid-state and diode lasers is of great importance for improvements of industrial laser applications. Welding, cladding with millimetre scale working spots benefit from "inverseGauss" intensity profiles; performance of thick metal sheet cutting, deep penetration welding can be enhanced when distributing the laser energy along the optical axis as more efficient usage of laser energy, higher edge quality and reduction of the heat affected zone can be achieved. Building of beam shaping optics for multimode lasers encounters physical limitations due to the low beam spatial coherence of multimode fiber-coupled lasers resulting in big Beam Parameter Products (BPP) or M² values. The laser radiation emerging from a multimode fiber presents a mixture of wavefronts. The fiber end can be considered as a light source which optical properties are intermediate between a Lambertian source and a single mode laser beam. Imaging of the fiber end, using a collimator and a focusing objective, is a robust and widely used beam delivery approach. Beam shaping solutions are suggested in form of optics combining fiber end imaging and geometrical separation of focused spots either perpendicular to or along the optical axis. Thus, energy of high power lasers is distributed among multiple foci. In order to provide reliable operation with multi-kW lasers and avoid damages the optics are designed as refractive elements with smooth optical surfaces. The paper presents descriptions of multi-focus optics as well as examples of intensity profile measurements of beam caustics and application results.

Multimodality image registration with software: state-of-the-art

Energy Technology Data Exchange (ETDEWEB)

Slomka, Piotr J. [Cedars-Sinai Medical Center, AIM Program/Department of Imaging, Los Angeles, CA (United States); University of California, David Geffen School of Medicine, Los Angeles, CA (United States); Baum, Richard P. [Center for PET, Department of Nuclear Medicine, Bad Berka (Germany)

2009-03-15

Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

Marveling at "The Man Called Nova": Comics as Sponsors of Multimodal Literacy

Science.gov (United States)

Jacobs, Dale

2007-01-01

This essay theorizes the ways in which comics, and Marvel Comics in particular, acted as sponsors of multimodal literacy for the author. In doing so, the essay demonstrates the possibilities that exist in examining comics more closely and in thinking about how literacy sponsorship happens in multimodal texts. (Contains 1 figure and 13 notes.)

Microscopy Image Browser: A Platform for Segmentation and Analysis of Multidimensional Datasets.

Directory of Open Access Journals (Sweden)

Ilya Belevich

2016-01-01

Full Text Available Understanding the structure-function relationship of cells and organelles in their natural context requires multidimensional imaging. As techniques for multimodal 3-D imaging have become more accessible, effective processing, visualization, and analysis of large datasets are posing a bottleneck for the workflow. Here, we present a new software package for high-performance segmentation and image processing of multidimensional datasets that improves and facilitates the full utilization and quantitative analysis of acquired data, which is freely available from a dedicated website. The open-source environment enables modification and insertion of new plug-ins to customize the program for specific needs. We provide practical examples of program features used for processing, segmentation and analysis of light and electron microscopy datasets, and detailed tutorials to enable users to rapidly and thoroughly learn how to use the program.

Numerical modelling of multimode fibre-optic communication lines

Energy Technology Data Exchange (ETDEWEB)

Sidelnikov, O S; Fedoruk, M P [Novosibirsk State University, Novosibirsk (Russian Federation); Sygletos, S; Ferreira, F [Aston University, England, Birmingham, B4 7ET (United Kingdom)

2016-01-31

The results of numerical modelling of nonlinear propagation of an optical signal in multimode fibres with a small differential group delay are presented. It is found that the dependence of the error vector magnitude (EVM) on the differential group delay can be reduced by increasing the number of ADC samples per symbol in the numerical implementation of the differential group delay compensation algorithm in the receiver. The possibility of using multimode fibres with a small differential group delay for data transmission in modern digital communication systems is demonstrated. It is shown that with increasing number of modes the strong coupling regime provides a lower EVM level than the weak coupling one. (fibre-optic communication lines)

An estimation of the spatial coherency radius of a multimode laser beam by the spectral contrast

Energy Technology Data Exchange (ETDEWEB)

Sukhanov, I I

1983-01-01

The angular dependency of the spectral contrast behind a diffuser illuminated by an He/Ne laser beam at .63 micrometers on the number of transverse modes is investigated. It is demonstrated that over a wide range of scattering angles, the contrast is determined primarily by the number of transverse modes, i.e. by the radius of the spatial field correlation, and is only slightly dependent on the dimensions and shape of the beam as well as the intensity distribution in the beam. These results may be useful in developing a rapid indication method of the radius of the spatial correlation of laser beams.

Spectral Interferometry with Electron Microscopes

Science.gov (United States)

Talebi, Nahid

2016-01-01

Interference patterns are not only a defining characteristic of waves, but also have several applications; characterization of coherent processes and holography. Spatial holography with electron waves, has paved the way towards space-resolved characterization of magnetic domains and electrostatic potentials with angstrom spatial resolution. Another impetus in electron microscopy has been introduced by ultrafast electron microscopy which uses pulses of sub-picosecond durations for probing a laser induced excitation of the sample. However, attosecond temporal resolution has not yet been reported, merely due to the statistical distribution of arrival times of electrons at the sample, with respect to the laser time reference. This is however, the very time resolution which will be needed for performing time-frequency analysis. These difficulties are addressed here by proposing a new methodology to improve the synchronization between electron and optical excitations through introducing an efficient electron-driven photon source. We use focused transition radiation of the electron as a pump for the sample. Due to the nature of transition radiation, the process is coherent. This technique allows us to perform spectral interferometry with electron microscopes, with applications in retrieving the phase of electron-induced polarizations and reconstructing dynamics of the induced vector potential. PMID:27649932

Multimodal Imaging of Human Brain Activity: Rational, Biophysical Aspects and Modes of Integration

Science.gov (United States)

Blinowska, Katarzyna; Müller-Putz, Gernot; Kaiser, Vera; Astolfi, Laura; Vanderperren, Katrien; Van Huffel, Sabine; Lemieux, Louis

2009-01-01

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship. PMID:19547657

Experimental evaluation of user performance in a pursuit tracking task with multimodal feedback

Directory of Open Access Journals (Sweden)

Obrenović Željko

2004-01-01

Full Text Available In this paper we describe the results of experimental evaluation of user performance in a pursuit-tracking task with multimodal feedback. Our experimental results indicate that audio can significantly improve the accuracy of pursuit tracking. Experiments with 19 participants have shown that addition of acoustic modalities reduces the error during pursuit tracking for up to 19%. Moreover, experiments indicated the existence of perceptual boundaries of multimodal HCI for different scene complexity and target speeds. We have also shown that the most appealing paradigms are not the most effective ones, which necessitates a careful quantitative analysis of proposed multimodal HCI paradigms.

Three-dimensional holographic optical manipulation through a high-numerical-aperture soft-glass multimode fibre

Science.gov (United States)

Leite, Ivo T.; Turtaev, Sergey; Jiang, Xin; Šiler, Martin; Cuschieri, Alfred; Russell, Philip St. J.; Čižmár, Tomáš

2018-01-01

Holographic optical tweezers (HOT) hold great promise for many applications in biophotonics, allowing the creation and measurement of minuscule forces on biomolecules, molecular motors and cells. Geometries used in HOT currently rely on bulk optics, and their exploitation in vivo is compromised by the optically turbid nature of tissues. We present an alternative HOT approach in which multiple three-dimensional (3D) traps are introduced through a high-numerical-aperture multimode optical fibre, thus enabling an equally versatile means of manipulation through channels having cross-section comparable to the size of a single cell. Our work demonstrates real-time manipulation of 3D arrangements of micro-objects, as well as manipulation inside otherwise inaccessible cavities. We show that the traps can be formed over fibre lengths exceeding 100 mm and positioned with nanometric resolution. The results provide the basis for holographic manipulation and other high-numerical-aperture techniques, including advanced microscopy, through single-core-fibre endoscopes deep inside living tissues and other complex environments.

An Efficient Quality-Related Fault Diagnosis Method for Real-Time Multimode Industrial Process

Directory of Open Access Journals (Sweden)

Kaixiang Peng

2017-01-01

Full Text Available Focusing on quality-related complex industrial process performance monitoring, a novel multimode process monitoring method is proposed in this paper. Firstly, principal component space clustering is implemented under the guidance of quality variables. Through extraction of model tags, clustering information of original training data can be acquired. Secondly, according to multimode characteristics of process data, the monitoring model integrated Gaussian mixture model with total projection to latent structures is effective after building the covariance description form. The multimode total projection to latent structures (MTPLS model is the foundation of problem solving about quality-related monitoring for multimode processes. Then, a comprehensive statistics index is defined which is based on the posterior probability of the monitored samples belonging to each Gaussian component in the Bayesian theory. After that, a combined index is constructed for process monitoring. Finally, motivated by the application of traditional contribution plot in fault diagnosis, a gradient contribution rate is applied for analyzing the variation of variable contribution rate along samples. Our method can ensure the implementation of online fault monitoring and diagnosis for multimode processes. Performances of the whole proposed scheme are verified in a real industrial, hot strip mill process (HSMP compared with some existing methods.

Empowering Prospective Teachers to Become Active Sense-Makers: Multimodal Modeling of the Seasons

Science.gov (United States)

Kim, Mi Song

2015-10-01

Situating science concepts in concrete and authentic contexts, using information and communications technologies, including multimodal modeling tools, is important for promoting the development of higher-order thinking skills in learners. However, teachers often struggle to integrate emergent multimodal models into a technology-rich informal learning environment. Our design-based research co-designs and develops engaging, immersive, and interactive informal learning activities called "Embodied Modeling-Mediated Activities" (EMMA) to support not only Singaporean learners' deep learning of astronomy but also the capacity of teachers. As part of the research on EMMA, this case study describes two prospective teachers' co-design processes involving multimodal models for teaching and learning the concept of the seasons in a technology-rich informal learning setting. Our study uncovers four prominent themes emerging from our data concerning the contextualized nature of learning and teaching involving multimodal models in informal learning contexts: (1) promoting communication and emerging questions, (2) offering affordances through limitations, (3) explaining one concept involving multiple concepts, and (4) integrating teaching and learning experiences. This study has an implication for the development of a pedagogical framework for teaching and learning in technology-enhanced learning environments—that is empowering teachers to become active sense-makers using multimodal models.

Responsive Multimodal Transportation Management Strategies And IVHS

Science.gov (United States)

1995-02-01

THE PURPOSE OF THIS STUDY WAS TO INVESTIGATE NEW AND INNOVATIVE WAYS TO INCORPORATE IVHS TECHNOLOGIES INTO MULTIMODAL TRANSPORTATION MANAGEMENT STRATEGIES. MUCH OF THE IVHS RESEARCH DONE TO DATE HAS ADDRESSED THE MODES INDIVIDUALLY. THIS PROJECT FOCU...

The future of multimodal corpora O futuro dos corpora modais

Directory of Open Access Journals (Sweden)

Dawn Knight

2011-01-01

Full Text Available This paper takes stock of the current state-of-the-art in multimodal corpus linguistics, and proposes some projections of future developments in this field. It provides a critical overview of key multimodal corpora that have been constructed over the past decade and presents a wish-list of future technological and methodological advancements that may help to increase the availability, utility and functionality of such corpora for linguistic research.Este artigo apresenta um balanço do estado da arte da linguística de corpus multimodal e propõe a projeção de desenvolvimentos futuros nessa área. Um resumo crítico dos corpora multimodais-chave que foram construídos na última década é apresentado, assim como uma lista de desenvolvimentos tecnológicos e metodológicos futuros que podem auxiliar na disponibilização e utilização, bem como na funcionalidade, de tais corpora para a pesquisa linguística.

Chloroplast to chromoplast transition in tomato fruit: spectral confocal microscopy analyses of carotenoids and chlorophylls in isolated plastids and time-lapse recording on intact live tissue.

Science.gov (United States)

Egea, Isabel; Bian, Wanping; Barsan, Cristina; Jauneau, Alain; Pech, Jean-Claude; Latché, Alain; Li, Zhengguo; Chervin, Christian

2011-08-01

There are several studies suggesting that tomato (Solanum lycopersicum) chromoplasts arise from chloroplasts, but there is still no report showing the fluorescence of both chlorophylls and carotenoids in an intermediate plastid, and no video showing this transition phase. Pigment fluorescence within individual plastids, isolated from tomato fruit using sucrose gradients, was observed at different ripening stages, and an in situ real-time recording of pigment fluorescence was performed on live tomato fruit slices. At the mature green and red stages, homogenous fractions of chloroplasts and chromoplasts were obtained, respectively. At the breaker stage, spectral confocal microscopy showed that intermediate plastids contained both chlorophylls and carotenoids. Furthermore, an in situ real-time recording (a) showed that the chloroplast to chromoplast transition was synchronous for all plastids of a single cell; and (b) confirmed that all chromoplasts derived from pre-existing chloroplasts. These results give details of the early steps of tomato chromoplast biogenesis from chloroplasts, with the formation of intermediate plastids containing both carotenoids and chlorophylls. They provide information at the sub-cellular level on the synchronism of plastid transition and pigment changes.

Imaging chemical interfaces perpendicular to the optical axis with focus-engineered coherent anti-Stokes Raman scattering microscopy

International Nuclear Information System (INIS)

Krishnamachari, Vishnu Vardhan; Potma, Eric Olaf

2007-01-01

In vibrational microscopy, it is often necessary to distinguish between chemically distinct microscopic objects and to highlight the 'chemical interfaces' present in the sample under investigation. Here we apply the concept of focus engineering to enhance the sensitivity of coherent anti-Stokes Raman scattering (CARS) microscopy to these interfaces. Based on detailed numerical simulations, we show that using a focused Stokes field with a sharp phase jump along the longitudinal direction leads to the suppression of the signal from bulk regions and improves the signal contrast from vibrational resonant interfaces oriented perpendicular to the axis of beam propagation. We also demonstrate that the CARS spectral response from chemical interfaces exhibits a clean, Raman-like band-shape with such a phase-shaped excitation. This phenomenon of interface highlighting is a consequence of the coherent nature of CARS signal generation and it involves a complex interplay of the spectral phase of the sample and the spatial phase of the excitation fields

Spectral force analysis using atomic force microscopy reveals the importance of surface heterogeneity in bacterial and colloid adhesion to engineered surfaces.

Science.gov (United States)

Ma, Huilian; Winslow, Charles J; Logan, Bruce E

2008-04-01

Coatings developed to reduce biofouling of engineered surfaces do not always perform as expected based on their native properties. One reason is that a relatively small number of highly adhesive sites, or the heterogeneity of the coated surface, may control the overall response of the system to initial bacterial deposition. It is shown here using an approach we call spectral force analysis (SFA), based on force volume imaging of the surface with atomic force microscopy, that the behavior of surfaces and coatings can be better understood relative to bacterial adhesion. The application of vapor deposited TiO(2) metal oxide increased bacterial and colloid adhesion, but coating the surface with silica oxide reduced adhesion in a manner consistent with SFA based on analysis of the "stickiest" sites. Application of a TiO(2)-based paint to a surface produced a relatively non-fouling surface. Addition of a hydrophilic layer coating to this surface should have decreased fouling. However, it was observed that this coating actually increased fouling. Using SFA it was shown that the reason for the increased adhesion of bacteria and particles to the hydrophilic layer was that the surface produced by this coating was highly heterogeneous, resulting in a small number of sites that created a stickier surface. These results show that while it is important to manufacture surfaces with coatings that are relatively non-adhesive to bacteria, it is also essential that these coatings have a highly uniform surface chemistry.

Optimal design and fabrication of three-dimensional calibration specimens for scanning probe microscopy

Energy Technology Data Exchange (ETDEWEB)

Liu Xiaoning; Luo Tingting; Chen Yuhang; Huang Wenhao [Department of Precision Machinery and Instrumentation, University of Science and Technology of China, 230026 Hefei (China); Piaszenski, Guido [Raith GmbH, Konrad-Adenauer-Allee 8, 44263 Dortmund (Germany)

2012-05-15

Micro-/nano-scale roughness specimens are highly demanded to synthetically calibrate the scanning probe microscopy (SPM) instrument. In this study, three-dimensional (3D) specimens with controllable main surface evaluation parameters were designed. In order to improve the design accuracy, the genetic algorithm was introduced into the conventional digital filter method. A primary 3D calibration specimen with the dimension of 10 {mu}m x 10 {mu}m was fabricated by electron beam lithography. Atomic force microscopy characterizations demonstrated that the statistical and spectral parameters of the fabricated specimen match well with the designed values. Such a kind of 3D specimens has the potential to calibrate the SPM for applications in quantitative surface evaluations.

The Impact of Multimodal Texts on Reading Achievement: A Study of Iranian Secondary School Learners

Directory of Open Access Journals (Sweden)

Bahareh Baharani

2015-07-01

Full Text Available This study was designed to investigate the impact of multimodal text on reading comprehension test performance of Iranian intermediate learners. A total of 80 students participated in this study. All of them were Iranian female EFL learners with the age ranging from 16 to 18. They were selected from a boarding high school in Nasr Abad, Torbat Jam in Khorasan e Razavi, Iran. The students were randomly settled in four groups, who received different instructional approaches through using linear texts, multimodal printed texts, non-printed multimodal texts, and both multimodal printed and non-printed texts.  A pre-test and post-test were used to find out the differences before and after the experimental treatment.  The results reflected that the printed and non-printed multimodal texts had significant impact on reading comprehension test performance. In contrast, applying linear texts or traditional texts did not exert significant influence on reading comprehension ability of the participants. The findings provide useful hints for language instructors to improve effectiveness of instructional reading curriculums and reading ability of language learners. The participants who learned reading comprehension through using multimodal printed and non-printed texts enjoy reading programs and develop their intrinsic and extrinsic motivation for improving reading ability.

Calibration and analysis of a multimodal micro-CT and structured light imaging system for the evaluation of excised breast tissue

Science.gov (United States)

McClatchy, David M., III; Rizzo, Elizabeth J.; Meganck, Jeff; Kempner, Josh; Vicory, Jared; Wells, Wendy A.; Paulsen, Keith D.; Pogue, Brian W.

2017-12-01

A multimodal micro-computed tomography (CT) and multi-spectral structured light imaging (SLI) system is introduced and systematically analyzed to test its feasibility to aid in margin delineation during breast conserving surgery (BCS). Phantom analysis of the micro-CT yielded a signal-to-noise ratio of 34, a contrast of 1.64, and a minimum detectable resolution of 240 μm for a 1.2 min scan. The SLI system, spanning wavelengths 490 nm to 800 nm and spatial frequencies up to 1.37 mm-1 , was evaluated with aqueous tissue simulating phantoms having variations in particle size distribution, scatter density, and blood volume fraction. The reduced scattering coefficient, μs\\prime and phase function parameter, γ, were accurately recovered over all wavelengths independent of blood volume fractions from 0% to 4%, assuming a flat sample geometry perpendicular to the imaging plane. The resolution of the optical system was tested with a step phantom, from which the modulation transfer function was calculated yielding a maximum resolution of 3.78 cycles per mm. The three dimensional spatial co-registration between the CT and optical imaging space was tested and shown to be accurate within 0.7 mm. A freshly resected breast specimen, with lobular carcinoma, fibrocystic disease, and adipose, was imaged with the system. The micro-CT provided visualization of the tumor mass and its spiculations, and SLI yielded superficial quantification of light scattering parameters for the malignant and benign tissue types. These results appear to be the first demonstration of SLI combined with standard medical tomography for imaging excised tumor specimens. While further investigations are needed to determine and test the spectral, spatial, and CT features required to classify tissue, this study demonstrates the ability of multimodal CT/SLI to quantify, visualize, and spatially navigate breast tumor specimens, which could potentially aid in the assessment of tumor margin status during

Naming Block Structures: A Multimodal Approach

Science.gov (United States)

Cohen, Lynn; Uhry, Joanna

2011-01-01

This study describes symbolic representation in block play in a culturally diverse suburban preschool classroom. Block play is "multimodal" and can allow children to experiment with materials to represent the world in many forms of literacy. Combined qualitative and quantitative data from seventy-seven block structures were collected and analyzed.…

Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking.

Science.gov (United States)

Yu, Jun; Yang, Xiaokang; Gao, Fei; Tao, Dacheng

2017-12-01

How do we retrieve images accurately? Also, how do we rank a group of images precisely and efficiently for specific queries? These problems are critical for researchers and engineers to generate a novel image searching engine. First, it is important to obtain an appropriate description that effectively represent the images. In this paper, multimodal features are considered for describing images. The images unique properties are reflected by visual features, which are correlated to each other. However, semantic gaps always exist between images visual features and semantics. Therefore, we utilize click feature to reduce the semantic gap. The second key issue is learning an appropriate distance metric to combine these multimodal features. This paper develops a novel deep multimodal distance metric learning (Deep-MDML) method. A structured ranking model is adopted to utilize both visual and click features in distance metric learning (DML). Specifically, images and their related ranking results are first collected to form the training set. Multimodal features, including click and visual features, are collected with these images. Next, a group of autoencoders is applied to obtain initially a distance metric in different visual spaces, and an MDML method is used to assign optimal weights for different modalities. Next, we conduct alternating optimization to train the ranking model, which is used for the ranking of new queries with click features. Compared with existing image ranking methods, the proposed method adopts a new ranking model to use multimodal features, including click features and visual features in DML. We operated experiments to analyze the proposed Deep-MDML in two benchmark data sets, and the results validate the effects of the method.

Evaluation of multimodal ground cues

DEFF Research Database (Denmark)

Nordahl, Rolf; Lecuyer, Anatole; Serafin, Stefania

2012-01-01

This chapter presents an array of results on the perception of ground surfaces via multiple sensory modalities,with special attention to non visual perceptual cues, notably those arising from audition and haptics, as well as interactions between them. It also reviews approaches to combining...... synthetic multimodal cues, from vision, haptics, and audition, in order to realize virtual experiences of walking on simulated ground surfaces or other features....

Perspectives in Super-resolved Fluorescence Microscopy: What comes next?

Science.gov (United States)

Cremer, Christoph; Birk, Udo

2016-04-01

The Nobel Prize in Chemistry 2014 has been awarded to three scientists involved in the development of STED and PALM super-resolution fluorescence microscopy (SRM) methods. They have proven that it is possible to overcome the hundred year old theoretical limit for the resolution potential of light microscopy (of about 200 nm for visible light), which for decades has precluded a direct glimpse of the molecular machinery of life. None of the present-day super-resolution techniques have invalidated the Abbe limit for light optical detection; however, they have found clever ways around it. In this report, we discuss some of the challenges still to be resolved before arising SRM approaches will be fit to bring about the revolution in Biology and Medicine envisaged. Some of the challenges discussed are the applicability to image live and/or large samples, the further enhancement of resolution, future developments of labels, and multi-spectral approaches.

Real-time Near-infrared Virtual Intraoperative Surgical Photoacoustic Microscopy

Directory of Open Access Journals (Sweden)

Changho Lee

2015-09-01

Full Text Available We developed a near infrared (NIR virtual intraoperative surgical photoacoustic microscopy (NIR-VISPAM system that combines a conventional surgical microscope and an NIR light photoacoustic microscopy (PAM system. NIR-VISPAM can simultaneously visualize PA B-scan images at a maximum display rate of 45 Hz and display enlarged microscopic images on a surgeon's view plane through the ocular lenses of the surgical microscope as augmented reality. The use of the invisible NIR light eliminated the disturbance to the surgeon's vision caused by the visible PAM excitation laser in a previous report. Further, the maximum permissible laser pulse energy at this wavelength is approximately 5 times more than that at the visible spectral range. The use of a needle-type ultrasound transducer without any water bath for acoustic coupling can enhance convenience in an intraoperative environment. We successfully guided needle and injected carbon particles in biological tissues ex vivo and in melanoma-bearing mice in vivo.

Perspectives in Super-resolved Fluorescence Microscopy: What comes next?

Directory of Open Access Journals (Sweden)

Christoph eCremer

2016-04-01

Full Text Available The Nobel Prize in Chemistry 2014 has been awarded to three scientists involved in the development of STED and PALM super-resolution fluorescence microscopy (SRM methods. They have proven that it is possible to overcome the hundred year old theoretical limit for the resolution potential of light microscopy (of about 200 nm for visible light, which for decades has precluded a direct glimpse of the molecular machinery of life. None of the present-day super-resolution techniques have invalidated the Abbe limit for light optical detection; however, they have found clever ways around it. In this report, we discuss some of the challenges still to be resolved before arising SRM approaches will be fit to bring about the revolution in Biology and Medicine envisaged. Some of the challenges discussed are the applicability to image live and/or large samples, the further enhancement of resolution, future developments of labels, and multi-spectral approaches.

Teaching Poetry through Collaborative Art: An Analysis of Multimodal Ensembles for Transformative Learning

Science.gov (United States)

Wandera, David B.

2016-01-01

This study is anchored on two positions: that every communication is multimodal and that different modalities within multimodal communication have particular affordances. Written and oral language and other modalities, such as body language and audio/visual media, are interwoven in classroom communication. What might it look like to strategically…

Contemporary Multi-Modal Historical Representations and the Teaching of Disciplinary Understandings in History

Science.gov (United States)

Donnelly, Debra J.

2018-01-01

Traditional privileging of the printed text has been considerably eroded by rapid technological advancement and in Australia, as elsewhere, many History teaching programs feature an array of multi-modal historical representations. Research suggests that engagement with the visual and multi-modal constructs has the potential to enrich the pedagogy…

Multimodal retrieval of autobiographical memories: sensory information contributes differently to the recollection of events.

Science.gov (United States)

Willander, Johan; Sikström, Sverker; Karlsson, Kristina

2015-01-01

Previous studies on autobiographical memory have focused on unimodal retrieval cues (i.e., cues pertaining to one modality). However, from an ecological perspective multimodal cues (i.e., cues pertaining to several modalities) are highly important to investigate. In the present study we investigated age distributions and experiential ratings of autobiographical memories retrieved with unimodal and multimodal cues. Sixty-two participants were randomized to one of four cue-conditions: visual, olfactory, auditory, or multimodal. The results showed that the peak of the distributions depends on the modality of the retrieval cue. The results indicated that multimodal retrieval seemed to be driven by visual and auditory information to a larger extent and to a lesser extent by olfactory information. Finally, no differences were observed in the number of retrieved memories or experiential ratings across the four cue-conditions.

Multimodal Retrieval of Autobiographical Memories: Sensory Information Contributes Differently to the Recollection of Events

Directory of Open Access Journals (Sweden)

Johan eWillander

2015-11-01

Full Text Available Previous studies on autobiographical memory have focused on unimodal retrieval cues (i.e., cues pertaining to one modality. However, from an ecological perspective multimodal cues (i.e., cues pertaining to several modalities are highly important to investigate. In the present study we investigated age distributions and experiential ratings of autobiographical memories retrieved with unimodal and multimodal cues. Sixty-two participants were randomized to one of four cue-conditions: visual, olfactory, auditory, and multimodal. The results showed that the peak of the distributions depend on the modality of the retrieval cue. The results indicated that multimodal retrieval seemed to be driven by visual and auditory information to a larger extent and to a lesser extent by olfactory information. Finally, no differences were observed in the number of retrieved memories or experiential ratings across the four cue-conditions.

A Robust Multimodal Bio metric Authentication Scheme with Voice and Face Recognition

International Nuclear Information System (INIS)

Kasban, H.

2017-01-01

This paper proposes a multimodal biometric scheme for human authentication based on fusion of voice and face recognition. For voice recognition, three categories of features (statistical coefficients, cepstral coefficients and voice timbre) are used and compared. The voice identification modality is carried out using Gaussian Mixture Model (GMM). For face recognition, three recognition methods (Eigenface, Linear Discriminate Analysis (LDA), and Gabor filter) are used and compared. The combination of voice and face biometrics systems into a single multimodal biometrics system is performed using features fusion and scores fusion. This study shows that the best results are obtained using all the features (cepstral coefficients, statistical coefficients and voice timbre features) for voice recognition, LDA face recognition method and scores fusion for the multimodal biometrics system

Effect of Multimodal Pore Channels on Cargo Release from Mesoporous Silica Nanoparticles

Directory of Open Access Journals (Sweden)

Sushilkumar A. Jadhav

2016-01-01

Full Text Available Mesoporous silica nanoparticles (MSNs with multimodal pore channels were fully characterized by TEM, nitrogen adsorption-desorption, and DLS analyses. MSNs with average diameter of 200 nm with dual pore channel zones with pore diameters of 1.3–2.6 and 4 nm were tested for their use in drug delivery application. Important role of the multimodal pore systems present on MSNs on the quantitative release of model drug ibuprofen was investigated. The results obtained revealed that the release profile for ibuprofen clearly shows distinct zones which can be attributed to the respective porous channel zones present on the particles. The fluctuations in the concentration of ibuprofen during the prolonged release from MSNs were caused by the multimodal pore channel systems.

A 3D multi-mode geometry-independent RMP optimization method and its application to TCV

International Nuclear Information System (INIS)

Rossel, J X; Moret, J-M; Martin, Y

2010-01-01

Resonant magnetic perturbation (RMP) and error field correction (EFC) produced by toroidally and poloidally distributed coil systems can be optimized if each coil is powered with an independent power supply. A 3D multi-mode geometry-independent Lagrange method has been developed and appears to be an efficient way to minimize the parasitic spatial modes of the magnetic perturbation and the coil current requirements while imposing the amplitude and phase of a number of target modes. A figure of merit measuring the quality of a perturbation spectrum with respect to RMP independently of the considered coil system or plasma equilibrium is proposed. To ease the application of the Lagrange method, a spectral characterization of the system, based on a generalized discrete Fourier transform applied in current space, is performed to determine how spectral degeneracy and side-band creation limit the set of simultaneously controllable target modes. This characterization is also useful to quantify the efficiency of the coil system in each toroidal mode number and to know whether optimization is possible for a given number of target modes. The efficiency of the method is demonstrated in the special case of a multi-purpose saddle coil system proposed as part of a future upgrade of Tokamak a Configuration Variable (TCV). This system consists of three rows of eight internal coils, each coil having independent power supplies, and provides simultaneously EFC, RMP and fast vertical position control.

Sustained Spatial Attention in Touch: Modality-Specific and Multimodal Mechanisms

Directory of Open Access Journals (Sweden)

Chiara F. Sambo

2011-01-01

Full Text Available Sustained attention to a body location results in enhanced processing of tactile stimuli presented at that location compared to another unattended location. In this paper, we review studies investigating the neural correlates of sustained spatial attention in touch. These studies consistently show that activity within modality-specific somatosensory areas (SI and SII is modulated by sustained tactile-spatial attention. Recent evidence suggests that these somatosensory areas may be recruited as part of a larger cortical network,also including higher-level multimodal regions involved in spatial selection across modalities. We discuss, in turn, the following multimodal effects in sustained tactile-spatial attention tasks. First, cross-modal attentional links between touch and vision, reflected in enhanced processing of task-irrelevant visual stimuli at tactuallyattended locations, are mediated by common (multimodal representations of external space. Second, vision of the body modulates activity underlying sustained tactile-spatial attention, facilitating attentional modulation of tactile processing in between-hand (when hands are sufficiently far apart and impairing attentional modulation in within-hand selection tasks. Finally, body posture influences mechanisms of sustained tactile-spatial attention, relying, at least partly, on remapping of tactile stimuli in external, visuallydefined, spatial coordinates. Taken together, the findings reviewed in this paper indicate that sustained spatial attention in touch is subserved by both modality-specific and multimodal mechanisms. The interplay between these mechanisms allows flexible and efficient spatial selection within and across sensory modalities.

Multimodal imaging of lung cancer and its microenvironment (Conference Presentation)

Science.gov (United States)

Hariri, Lida P.; Niederst, Matthew J.; Mulvey, Hillary; Adams, David C.; Hu, Haichuan; Chico Calero, Isabel; Szabari, Margit V.; Vakoc, Benjamin J.; Hasan, Tayyaba; Bouma, Brett E.; Engelman, Jeffrey A.; Suter, Melissa J.

2016-03-01

Despite significant advances in targeted therapies for lung cancer, nearly all patients develop drug resistance within 6-12 months and prognosis remains poor. Developing drug resistance is a progressive process that involves tumor cells and their microenvironment. We hypothesize that microenvironment factors alter tumor growth and response to targeted therapy. We conducted in vitro studies in human EGFR-mutant lung carcinoma cells, and demonstrated that factors secreted from lung fibroblasts results in increased tumor cell survival during targeted therapy with EGFR inhibitor, gefitinib. We also demonstrated that increased environment stiffness results in increased tumor survival during gefitinib therapy. In order to test our hypothesis in vivo, we developed a multimodal optical imaging protocol for preclinical intravital imaging in mouse models to assess tumor and its microenvironment over time. We have successfully conducted multimodal imaging of dorsal skinfold chamber (DSC) window mice implanted with GFP-labeled human EGFR mutant lung carcinoma cells and visualized changes in tumor development and microenvironment facets over time. Multimodal imaging included structural OCT to assess tumor viability and necrosis, polarization-sensitive OCT to measure tissue birefringence for collagen/fibroblast detection, and Doppler OCT to assess tumor vasculature. Confocal imaging was also performed for high-resolution visualization of EGFR-mutant lung cancer cells labeled with GFP, and was coregistered with OCT. Our results demonstrated that stromal support and vascular growth are essential to tumor progression. Multimodal imaging is a useful tool to assess tumor and its microenvironment over time.

Spectral diffusion of quasi localized excitons in single silicon nanocrystals

Energy Technology Data Exchange (ETDEWEB)

Martin, Joerg; Cichos, Frank [Centre for nanostructured Materials and Analytics, Institute of Physics, Chemnitz University of Technology, Reichenhainer Street 70, 09107 Chemnitz (Germany); Borczyskowski, Christian von, E-mail: Borczyskowski@physik.tu-chemnitz.de [Centre for nanostructured Materials and Analytics, Institute of Physics, Chemnitz University of Technology, Reichenhainer Street 70, 09107 Chemnitz (Germany)

2012-08-15

Evolution in time of photoluminescence spectra of SiO{sub x} capped single silicon nanocrystals has been investigated by means of confocal optical spectroscopy at room temperature. Large spectral jumps between subsequent spectra of up to 40 meV have been detected leading to noticeable line broadening and variation in the electron-phonon coupling. Further, a correlation between emission energy and emission intensity has been found and discussed in terms of an intrinsic Stark effect. Anti-correlated variations of the electron-phonon coupling to Si and SiO{sub 2} phonons as a function of photoluminescence energy indicate that the nearly localized excition is to some extent coupled to phonons in the shell covering the silicon nanocrystal. However, coupling is reduced upon increasing Stark effect, while at the same time coupling to phonons of the Si core increases. - Highlights: Black-Right-Pointing-Pointer Single silicon nanocrystals are detected via confocal microscopy. Black-Right-Pointing-Pointer Photoluminescence energies fluctuate strongly in time. Black-Right-Pointing-Pointer Spectral fluctuation is described in the form of spectral diffusion. Black-Right-Pointing-Pointer Dynamic processes are strongly controlled by electron-phonon coupling.

Multimodal system for the planning and guidance of bronchoscopy

Science.gov (United States)

Higgins, William E.; Cheirsilp, Ronnarit; Zang, Xiaonan; Byrnes, Patrick

2015-03-01

Many technical innovations in multimodal radiologic imaging and bronchoscopy have emerged recently in the effort against lung cancer. Modern X-ray computed-tomography (CT) scanners provide three-dimensional (3D) high-resolution chest images, positron emission tomography (PET) scanners give complementary molecular imaging data, and new integrated PET/CT scanners combine the strengths of both modalities. State-of-the-art bronchoscopes permit minimally invasive tissue sampling, with vivid endobronchial video enabling navigation deep into the airway-tree periphery, while complementary endobronchial ultrasound (EBUS) reveals local views of anatomical structures outside the airways. In addition, image-guided intervention (IGI) systems have proven their utility for CT-based planning and guidance of bronchoscopy. Unfortunately, no IGI system exists that integrates all sources effectively through the complete lung-cancer staging work flow. This paper presents a prototype of a computer-based multimodal IGI system that strives to fill this need. The system combines a wide range of automatic and semi-automatic image-processing tools for multimodal data fusion and procedure planning. It also provides a flexible graphical user interface for follow-on guidance of bronchoscopy/EBUS. Human-study results demonstrate the system's potential.

Multimodality and children's participation in classrooms: Instances of ...

African Journals Online (AJOL)

Multimodality and children's participation in classrooms: Instances of research. ... deficit models of children, drawing on their everyday experiences and their existing ... It outlines the theoretical framework supporting the pedagogical approach, ...

A spectral approach for the quantitative description of cardiac collagen network from nonlinear optical imaging.

Science.gov (United States)

Masè, Michela; Cristoforetti, Alessandro; Avogaro, Laura; Tessarolo, Francesco; Piccoli, Federico; Caola, Iole; Pederzolli, Carlo; Graffigna, Angelo; Ravelli, Flavia

2015-01-01

The assessment of collagen structure in cardiac pathology, such as atrial fibrillation (AF), is essential for a complete understanding of the disease. This paper introduces a novel methodology for the quantitative description of collagen network properties, based on the combination of nonlinear optical microscopy with a spectral approach of image processing and analysis. Second-harmonic generation (SHG) microscopy was applied to atrial tissue samples from cardiac surgery patients, providing label-free, selective visualization of the collagen structure. The spectral analysis framework, based on 2D-FFT, was applied to the SHG images, yielding a multiparametric description of collagen fiber orientation (angle and anisotropy indexes) and texture scale (dominant wavelength and peak dispersion indexes). The proof-of-concept application of the methodology showed the capability of our approach to detect and quantify differences in the structural properties of the collagen network in AF versus sinus rhythm patients. These results suggest the potential of our approach in the assessment of collagen properties in cardiac pathologies related to a fibrotic structural component.

Elimination of mode coupling in multimode continuous-variable key distribution

International Nuclear Information System (INIS)

Filip, Radim; Mista, Ladislav; Marek, Petr

2005-01-01

A multimode channel can be utilized to substantially increase the capacity of quantum continuous-variable key distribution. Beyond losses in the channel, an uncontrollable coupling between the modes of the channel typically degrades the capacity of multimode channels. For the key distribution protocol with simultaneous measurement of both complementary quadratures we propose a feasible method to eliminate any undesirable mode coupling by only the receiver's appropriate measurement and data manipulation. It can be used to substantially increase the capacity of the channel, which has an important application in practical continuous-variable quantum cryptography

OpenLMD, multimodal monitoring and control of LMD processing

Science.gov (United States)

Rodríguez-Araújo, Jorge; García-Díaz, Antón

2017-02-01

This paper presents OpenLMD, a novel open-source solution for on-line multimodal monitoring of Laser Metal Deposition (LMD). The solution is also applicable to a wider range of laser-based applications that require on-line control (e.g. laser welding). OpenLMD is a middleware that enables the orchestration and virtualization of a LMD robot cell, using several open-source frameworks (e.g. ROS, OpenCV, PCL). The solution also allows reconfiguration by easy integration of multiple sensors and processing equipment. As a result, OpenLMD delivers significant advantages over existing monitoring and control approaches, such as improved scalability, and multimodal monitoring and data sharing capabilities.

Nonlinear optical spectroscopy and microscopy of model random and biological media

Science.gov (United States)

Guo, Yici

Nonlinear optical (NLO) spectroscopy and microscopy applied to biomedical science are emerging as new and rapidly growing areas which offer important insight into basic phenomena. Ultrafast NLO processes provide temporal, spectral and spatial sensitivities complementary or superior to those achieved through conventional linear optical approaches. The goal of this thesis is to explore the potential of two fundamental NLO processes to produce noninvasive histological maps of biological tissues. Within the goal of the thesis, steady state intensity, polarization and angular measurements of second- and third-harmonic generations (SHG, THG) have been performed on model random scattering and animal tissue samples. The nonlinear optical effects have been evaluated using models. Conversion efficiencies of SHG and THG from animal tissue interfaces have been determined, ranging from 10-7 to 10-10. The changes in the multiharmonic signals were found to depend on both local and overall histological structures of biological samples. The spectral signatures of two photon excitation induced fluorescence from intrinsic fluorophores have been acquired and used to characterize the physical state and types of tissues. Two dimensional scanning SHG and TPF tomographic images have been obtained from in vitro animal tissues, normal and diseased human breast tissues, and resolved subsurface layers and histo-chemical distributions. By combining consecutive 2D maps, a 3D image can be produced. The structure and morphology dependence of the SH signal has been utilized to image and evaluate subsurface tumor progression depth. Second harmonic microscopy in model random and biological cells has been studied using a CCD camera to obtain direct images from subcellular structures. Finally, near infrared (NIR) NLO spectroscopy and microscopy based on SHG and TPF have demonstrated high spatial resolution, deeper penetration depth, low level photo-damaging and enhanced morphological sensitivity for

3D hierarchical spatial representation and memory of multimodal sensory data

Science.gov (United States)

Khosla, Deepak; Dow, Paul A.; Huber, David J.

2009-04-01

This paper describes an efficient method and system for representing, processing and understanding multi-modal sensory data. More specifically, it describes a computational method and system for how to process and remember multiple locations in multimodal sensory space (e.g., visual, auditory, somatosensory, etc.). The multimodal representation and memory is based on a biologically-inspired hierarchy of spatial representations implemented with novel analogues of real representations used in the human brain. The novelty of the work is in the computationally efficient and robust spatial representation of 3D locations in multimodal sensory space as well as an associated working memory for storage and recall of these representations at the desired level for goal-oriented action. We describe (1) A simple and efficient method for human-like hierarchical spatial representations of sensory data and how to associate, integrate and convert between these representations (head-centered coordinate system, body-centered coordinate, etc.); (2) a robust method for training and learning a mapping of points in multimodal sensory space (e.g., camera-visible object positions, location of auditory sources, etc.) to the above hierarchical spatial representations; and (3) a specification and implementation of a hierarchical spatial working memory based on the above for storage and recall at the desired level for goal-oriented action(s). This work is most useful for any machine or human-machine application that requires processing of multimodal sensory inputs, making sense of it from a spatial perspective (e.g., where is the sensory information coming from with respect to the machine and its parts) and then taking some goal-oriented action based on this spatial understanding. A multi-level spatial representation hierarchy means that heterogeneous sensory inputs (e.g., visual, auditory, somatosensory, etc.) can map onto the hierarchy at different levels. When controlling various machine

Multimodality, politics and ideology

DEFF Research Database (Denmark)

Machin, David; Van Leeuwen, T.

2016-01-01

This journal's editorial statement is clear that political discourse should be studied not only as regards parliamentary type politics. In this introduction we argue precisely for the need to pay increasing attention to the way that political ideologies are infused into culture more widely...... of power, requires meanings and identities which can hold them in place. We explain the processes by which critical multimodal discourse analysis can best draw out this ideology as it is realized through different semiotics resources. © John Benjamins Publishing Company....

A data fusion environment for multimodal and multi-informational neuronavigation.

Science.gov (United States)

Jannin, P; Fleig, O J; Seigneuret, E; Grova, C; Morandi, X; Scarabin, J M

2000-01-01

Part of the planning and performance of neurosurgery consists of determining target areas, areas to be avoided, landmark areas, and trajectories, all of which are components of the surgical script. Nowadays, neurosurgeons have access to multimodal medical imaging to support the definition of the surgical script. The purpose of this paper is to present a software environment developed by the authors that allows full multimodal and multi-informational planning as well as neuronavigation for epilepsy and tumor surgery. We have developed a data fusion environment dedicated to neuronavigation around the Surgical Microscope Neuronavigator system (Carl Zeiss, Oberkochen, Germany). This environment includes registration, segmentation, 3D visualization, and interaction-applied tools. It provides the neuronavigation system with the multimodal information involved in the definition of the surgical script: lesional areas, sulci, ventricles segmented from magnetic resonance imaging (MRI), vessels segmented from magnetic resonance angiography (MRA), functional areas from magneto-encephalography (MEG), and functional magnetic resonance imaging (fMRI) for somatosensory, motor, or language activation. These data are considered to be relevant for the performance of the surgical procedure. The definition of each entity results from the same procedure: registration to the anatomical MRI data set (defined as the reference data set), segmentation, fused 3D display, selection of the relevant entities for the surgical step, encoding in 3D surface-based representation, and storage of the 3D surfaces in a file recognized by the neuronavigation software (STP 3.4, Leibinger; Freiburg, Germany). Multimodal neuronavigation is illustrated with two clinical cases for which multimodal information was introduced into the neuronavigation system. Lesional areas were used to define and follow the surgical path, sulci and vessels helped identify the anatomical environment of the surgical field, and

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer's Disease Diagnosis.

Science.gov (United States)

Liu, Manhua; Cheng, Danni; Wang, Kundong; Wang, Yaping

2018-03-23

Accurate and early diagnosis of Alzheimer's disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer's Disease Neuroimaging

Single versus multimodality training basic laparoscopic skills

NARCIS (Netherlands)

Brinkman, W.M.; Havermans, S.Y.; Buzink, S.N.; Botden, S.M.B.I.; Jakimowicz, J.J.; Schoot, B.C.

2012-01-01

Introduction - Even though literature provides compelling evidence of the value of simulators for training of basic laparoscopic skills, the best way to incorporate them into a surgical curriculum is unclear. This study compares the training outcome of single modality training with multimodality

The Multimodalities of Globalization: Teaching a YouTube Video in an EAP Classroom

Science.gov (United States)

Chun, Christian W.

2012-01-01

This article examines the ways in which a multimodal text--a YouTube video on globalization and business--was mediated in two English for Academic Purposes (EAP) classrooms, and how these mediations shaped the instructor's and her students' meaning-making in specific ways. I first explore the complex multimodal discourses involved with this…

Correlative Stochastic Optical Reconstruction Microscopy and Electron Microscopy

Science.gov (United States)

Kim, Doory; Deerinck, Thomas J.; Sigal, Yaron M.; Babcock, Hazen P.; Ellisman, Mark H.; Zhuang, Xiaowei

2015-01-01

Correlative fluorescence light microscopy and electron microscopy allows the imaging of spatial distributions of specific biomolecules in the context of cellular ultrastructure. Recent development of super-resolution fluorescence microscopy allows the location of molecules to be determined with nanometer-scale spatial resolution. However, correlative super-resolution fluorescence microscopy and electron microscopy (EM) still remains challenging because the optimal specimen preparation and imaging conditions for super-resolution fluorescence microscopy and EM are often not compatible. Here, we have developed several experiment protocols for correlative stochastic optical reconstruction microscopy (STORM) and EM methods, both for un-embedded samples by applying EM-specific sample preparations after STORM imaging and for embedded and sectioned samples by optimizing the fluorescence under EM fixation, staining and embedding conditions. We demonstrated these methods using a variety of cellular targets. PMID:25874453

Multimodal interaction in image and video applications

CERN Document Server

Sappa, Angel D

2013-01-01

Traditional Pattern Recognition (PR) and Computer Vision (CV) technologies have mainly focused on full automation, even though full automation often proves elusive or unnatural in many applications, where the technology is expected to assist rather than replace the human agents. However, not all the problems can be automatically solved being the human interaction the only way to tackle those applications. Recently, multimodal human interaction has become an important field of increasing interest in the research community. Advanced man-machine interfaces with high cognitive capabilities are a hot research topic that aims at solving challenging problems in image and video applications. Actually, the idea of computer interactive systems was already proposed on the early stages of computer science. Nowadays, the ubiquity of image sensors together with the ever-increasing computing performance has open new and challenging opportunities for research in multimodal human interaction. This book aims to show how existi...

Understanding Soliton Spectral Tunneling as a Spectral Coupling Effect

DEFF Research Database (Denmark)

Guo, Hairun; Wang, Shaofei; Zeng, Xianglong

2013-01-01

Soliton eigenstate is found corresponding to a dispersive phase profile under which the soliton phase changes induced by the dispersion and nonlinearity are instantaneously counterbalanced. Much like a waveguide coupler relying on a spatial refractive index profile that supports mode coupling...... between channels, here we suggest that the soliton spectral tunneling effect can be understood supported by a spectral phase coupler. The dispersive wave number in the spectral domain must have a coupler-like symmetric profile for soliton spectral tunneling to occur. We show that such a spectral coupler...

Photonic lantern with multimode fibers embedded

Science.gov (United States)

Yu, Hai-Jiao; Yan, Qi; Huang, Zong-Jun; Tian, He; Jiang, Yu; Liu, Yong-Jun; Zhang, Jian-Zhong; Sun, Wei-Min

2014-08-01

A photonic lantern is studied which is formed by seven multimode fibers inserted into a pure silica capillary tube. The core of the tapered end has a uniform refractive index because the polymer claddings are removed before the fibers are inserted. Consequently, the light distribution is also uniform. Two theories describing a slowly varying waveguide and multimode coupling are used to analyze the photonic lantern. The transmission loss decreases as the length of the tapered part increases. For a device with a taper length of 3.4 cm, the loss is about 1.06 dB on average for light propagating through the taper from an inserted fiber to the tapered end and 0.99 dB in the reverse direction. For a device with a taper length of 0.7 cm, the two loss values are 2.63 dB and 2.53 dB, respectively. The results show that it is possible to achieve a uniform light distribution with the tapered end and a low-loss transmission in the device if parameters related to the lantern are reasonably defined.

Photonic lantern with multimode fibers embedded

International Nuclear Information System (INIS)

Yu Hai-Jiao; Yan Qi; Huang Zong-Jun; Tian He; Jiang Yu; Liu Yong-Jun; Zhang Jian-Zhong; Sun Wei-Min

2014-01-01

A photonic lantern is studied which is formed by seven multimode fibers inserted into a pure silica capillary tube. The core of the tapered end has a uniform refractive index because the polymer claddings are removed before the fibers are inserted. Consequently, the light distribution is also uniform. Two theories describing a slowly varying waveguide and multimode coupling are used to analyze the photonic lantern. The transmission loss decreases as the length of the tapered part increases. For a device with a taper length of 3.4 cm, the loss is about 1.06 dB on average for light propagating through the taper from an inserted fiber to the tapered end and 0.99 dB in the reverse direction. For a device with a taper length of 0.7 cm, the two loss values are 2.63 dB and 2.53 dB, respectively. The results show that it is possible to achieve a uniform light distribution with the tapered end and a low-loss transmission in the device if parameters related to the lantern are reasonably defined. (research papers)

Adaptive Multiview Nonnegative Matrix Factorization Algorithm for Integration of Multimodal Biomedical Data

Directory of Open Access Journals (Sweden)

Bisakha Ray

2017-08-01

Full Text Available The amounts and types of available multimodal tumor data are rapidly increasing, and their integration is critical for fully understanding the underlying cancer biology and personalizing treatment. However, the development of methods for effectively integrating multimodal data in a principled manner is lagging behind our ability to generate the data. In this article, we introduce an extension to a multiview nonnegative matrix factorization algorithm (NNMF for dimensionality reduction and integration of heterogeneous data types and compare the predictive modeling performance of the method on unimodal and multimodal data. We also present a comparative evaluation of our novel multiview approach and current data integration methods. Our work provides an efficient method to extend an existing dimensionality reduction method. We report rigorous evaluation of the method on large-scale quantitative protein and phosphoprotein tumor data from the Clinical Proteomic Tumor Analysis Consortium (CPTAC acquired using state-of-the-art liquid chromatography mass spectrometry. Exome sequencing and RNA-Seq data were also available from The Cancer Genome Atlas for the same tumors. For unimodal data, in case of breast cancer, transcript levels were most predictive of estrogen and progesterone receptor status and copy number variation of human epidermal growth factor receptor 2 status. For ovarian and colon cancers, phosphoprotein and protein levels were most predictive of tumor grade and stage and residual tumor, respectively. When multiview NNMF was applied to multimodal data to predict outcomes, the improvement in performance is not overall statistically significant beyond unimodal data, suggesting that proteomics data may contain more predictive information regarding tumor phenotypes than transcript levels, probably due to the fact that proteins are the functional gene products and therefore a more direct measurement of the functional state of the tumor. Here, we

A community intervention trial of multimodal suicide prevention program in Japan: A Novel multimodal Community Intervention program to prevent suicide and suicide attempt in Japan, NOCOMIT-J

OpenAIRE

Ono, Yutaka; Awata, Shuichi; Iida, Hideharu; Ishida, Yasushi; Ishizuka, Naoki; Iwasa, Hiroto; Kamei, Yuichi; Motohashi, Yutaka; Nakagawa, Atsuo; Nakamura, Jun; Nishi, Nobuyuki; Otsuka, Kotaro; Oyama, Hirofumi; Sakai, Akio; Sakai, Hironori

2008-01-01

Abstract Background To respond to the rapid surge in the incidence of suicide in Japan, which appears to be an ongoing trend, the Japanese Multimodal Intervention Trials for Suicide Prevention (J-MISP) have launched a multimodal community-based suicide prevention program, NOCOMIT-J. The primary aim of this study is to examine whether NOCOMIT-J is effective in reducing suicidal behavior in the community. Methods/DesignThis study is a community intervention trial involving seven intervention re...

Using multimodal information for the segmentation of fluorescent micrographs with application to virology and microbiology.

Science.gov (United States)

Held, Christian; Wenzel, Jens; Webel, Rike; Marschall, Manfred; Lang, Roland; Palmisano, Ralf; Wittenberg, Thomas

2011-01-01

In order to improve reproducibility and objectivity of fluorescence microscopy based experiments and to enable the evaluation of large datasets, flexible segmentation methods are required which are able to adapt to different stainings and cell types. This adaption is usually achieved by the manual adjustment of the segmentation methods parameters, which is time consuming and challenging for biologists with no knowledge on image processing. To avoid this, parameters of the presented methods automatically adapt to user generated ground truth to determine the best method and the optimal parameter setup. These settings can then be used for segmentation of the remaining images. As robust segmentation methods form the core of such a system, the currently used watershed transform based segmentation routine is replaced by a fast marching level set based segmentation routine which incorporates knowledge on the cell nuclei. Our evaluations reveal that incorporation of multimodal information improves segmentation quality for the presented fluorescent datasets.

Construction of Common Interpretive Spaces through Intertextual Loops--How Teachers Interpret Multimodal Learning Materials

Science.gov (United States)

Poyas, Yael; Eilam, Billie

2012-01-01

This study draws on several theoretical domains: intertextuality, multimodality, and the pedagogy of multiliteracies. We introduced multimodal textbook materials to eleven experienced teachers and examined, through in-depth interviews, their approach to juxtapositions of literary texts and visual artwork. Our analysis revealed (a) three attitudes…

Self-interference fluorescence microscopy with three-phase detection for depth-resolved confocal epi-fluorescence imaging.

Science.gov (United States)

Braaf, Boy; de Boer, Johannes F

2017-03-20

Three-dimensional confocal fluorescence imaging of in vivo tissues is challenging due to sample motion and limited imaging speeds. In this paper a novel method is therefore presented for scanning confocal epi-fluorescence microscopy with instantaneous depth-sensing based on self-interference fluorescence microscopy (SIFM). A tabletop epi-fluorescence SIFM setup was constructed with an annular phase plate in the emission path to create a spectral self-interference signal that is phase-dependent on the axial position of a fluorescent sample. A Mach-Zehnder interferometer based on a 3 × 3 fiber-coupler was developed for a sensitive phase analysis of the SIFM signal with three photon-counter detectors instead of a spectrometer. The Mach-Zehnder interferometer created three intensity signals that alternately oscillated as a function of the SIFM spectral phase and therefore encoded directly for the axial sample position. Controlled axial translation of fluorescent microsphere layers showed a linear dependence of the SIFM spectral phase with sample depth over axial image ranges of 500 µm and 80 µm (3.9 × Rayleigh range) for 4 × and 10 × microscope objectives respectively. In addition, SIFM was in good agreement with optical coherence tomography depth measurements on a sample with indocyanine green dye filled capillaries placed at multiple depths. High-resolution SIFM imaging applications are demonstrated for fluorescence angiography on a dye-filled capillary blood vessel phantom and for autofluorescence imaging on an ex vivo fly eye.

The integration of emotional and symbolic components in multimodal communication

Directory of Open Access Journals (Sweden)

Marc eMehu

2015-07-01

Full Text Available Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g. verbal and denotative signals are well suited to transfer conceptual information, emotional components (e.g. nonverbal signals that are difficult to manipulate voluntarily likely take a function that is closer to social influence. I suggest that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by nonverbal signals. In this view, the effect of emotional processes on communication serve to change the quality of social signals to make them more efficient at producing responses in perceivers, whereas symbolic components increase the signals’ efficiency at interacting with the cognitive processes dedicated to the assessment of relevance. The interaction between symbolic and emotional components will be discussed in relation to the need for perceivers to evaluate the reliability of multimodal signals.

The integration of emotional and symbolic components in multimodal communication

Science.gov (United States)

Mehu, Marc

2015-01-01

Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g., verbal and denotative signals) are well suited to transfer conceptual information, emotional components (e.g., non-verbal signals that are difficult to manipulate voluntarily) likely take a function that is closer to social influence. I suggest that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by non-verbal signals. In this view, the effect of emotional processes on communication serve to change the quality of social signals to make them more efficient at producing responses in perceivers, whereas symbolic components increase the signals’ efficiency at interacting with the cognitive processes dedicated to the assessment of relevance. The interaction between symbolic and emotional components will be discussed in relation to the need for perceivers to evaluate the reliability of multimodal signals. PMID:26217280

A Novel Multimodal Biometrics Recognition Model Based on Stacked ELM and CCA Methods

Directory of Open Access Journals (Sweden)

Jucheng Yang

2018-04-01

Full Text Available Multimodal biometrics combine a variety of biological features to have a significant impact on identification performance, which is a newly developed trend in biometrics identification technology. This study proposes a novel multimodal biometrics recognition model based on the stacked extreme learning machines (ELMs and canonical correlation analysis (CCA methods. The model, which has a symmetric structure, is found to have high potential for multimodal biometrics. The model works as follows. First, it learns the hidden-layer representation of biological images using extreme learning machines layer by layer. Second, the canonical correlation analysis method is applied to map the representation to a feature space, which is used to reconstruct the multimodal image feature representation. Third, the reconstructed features are used as the input of a classifier for supervised training and output. To verify the validity and efficiency of the method, we adopt it for new hybrid datasets obtained from typical face image datasets and finger-vein image datasets. Our experimental results demonstrate that our model performs better than traditional methods.

Scenemash: multimodal route summarization for city exploration

NARCIS (Netherlands)

Berg, J. van den; Rudinac, S.; Worring, M.

2016-01-01

The potential of mining tourist information from social multimedia data gives rise to new applications offering much richer impressions of the city. In this paper we propose Scenemash, a system that generates multimodal summaries of multiple alternative routes between locations in a city. To get

An agent-based architecture for multimodal interaction

NARCIS (Netherlands)

Jonker, C.M.; Treur, J.; Wijngaards, W.C.A.

In this paper, an executable generic process model is proposed for combined verbal and non-verbal communication processes and their interaction. The agent-based architecture can be used to create multimodal interaction. The generic process model has been designed, implemented and used to simulate

An agent-based architecture for multimodal interaction

NARCIS (Netherlands)

Jonker, C.M.; Treur, J.; Wijngaards, W.C.A.

2001-01-01

In this paper, an executable generic process model is proposed for combined verbal and non-verbal communication processes and their interaction. The agent-based architecture can be used to create multimodal interaction. The generic process model has been designed, implemented and used to simulate

Academic Knowledge Construction and Multimodal Curriculum Development

Science.gov (United States)

Loveless, Douglas J., Ed.; Griffith, Bryant, Ed.; Bérci, Margaret E., Ed.; Ortlieb, Evan, Ed.; Sullivan, Pamela, Ed.

2014-01-01

While incorporating digital technologies into the classroom has offered new ways of teaching and learning into educational processes, it is essential to take a look at how the digital shift impacts teachers, school administration, and curriculum development. "Academic Knowledge Construction and Multimodal Curriculum Development" presents…

Outcome of transarterial chemoembolization-based multi-modal treatment in patients with unresectable hepatocellular carcinoma.

Science.gov (United States)

Song, Do Seon; Nam, Soon Woo; Bae, Si Hyun; Kim, Jin Dong; Jang, Jeong Won; Song, Myeong Jun; Lee, Sung Won; Kim, Hee Yeon; Lee, Young Joon; Chun, Ho Jong; You, Young Kyoung; Choi, Jong Young; Yoon, Seung Kew

2015-02-28

To investigate the efficacy and safety of transarterial chemoembolization (TACE)-based multimodal treatment in patients with large hepatocellular carcinoma (HCC). A total of 146 consecutive patients were included in the analysis, and their medical records and radiological data were reviewed retrospectively. In total, 119 patients received TACE-based multi-modal treatments, and the remaining 27 received conservative management. Overall survival (P<0.001) and objective tumor response (P=0.003) were significantly better in the treatment group than in the conservative group. After subgroup analysis, survival benefits were observed not only in the multi-modal treatment group compared with the TACE-only group (P=0.002) but also in the surgical treatment group compared with the loco-regional treatment-only group (P<0.001). Multivariate analysis identified tumor stage (P<0.001) and tumor type (P=0.009) as two independent pre-treatment factors for survival. After adjusting for significant pre-treatment prognostic factors, objective response (P<0.001), surgical treatment (P=0.009), and multi-modal treatment (P=0.002) were identified as independent post-treatment prognostic factors. TACE-based multi-modal treatments were safe and more beneficial than conservative management. Salvage surgery after successful downstaging resulted in long-term survival in patients with large, unresectable HCC.

Laser injury and in vivo multimodal imaging using a mouse model

Science.gov (United States)

Pocock, Ginger M.; Boretsky, Adam; Gupta, Praveena; Oliver, Jeff W.; Motamedi, Massoud

2011-03-01

Balb/c wild type mice were used to perform in vivo experiments of laser-induced thermal damage to the retina. A Heidelberg Spectralis HRA confocal scanning laser ophthalmoscope with a spectral domain optical coherence tomographer was used to obtain fundus and cross-sectional images of laser induced injury in the retina. Sub-threshold, threshold, and supra-threshold lesions were observed using optical coherence tomography (OCT), infrared reflectance, red-free reflectance, fluorescence angiography, and autofluorescence imaging modalities at different time points post-exposure. Lesions observed using all imaging modalities, except autofluorescence, were not visible immediately after exposure but did resolve within an hour and grew in size over a 24 hour period. There was a decrease in fundus autofluorescence at exposure sites immediately following exposure that developed into hyper-fluorescence 24-48 hours later. OCT images revealed threshold damage that was localized to the RPE but extended into the neural retina over a 24 hour period. Volumetric representations of the mouse retina were created to visualize the extent of damage within the retina over a 24 hour period. Multimodal imaging provides complementary information regarding damage mechanisms that may be used to quantify the extent of the damage as well as the effectiveness of treatments without need for histology.

Microscopy and Cathodoluminescence Spectroscopy Characterization of Quartz Exhibiting Different Alkali-Silica Reaction Potential.

Science.gov (United States)

Kuchařová, Aneta; Götze, Jens; Šachlová, Šárka; Pertold, Zdeněk; Přikryl, Richard

2016-02-01

Different quartz types from several localities in the Czech Republic and Sweden were examined by polarizing microscopy combined with cathodoluminescence (CL) microscopy, spectroscopy, and petrographic image analysis, and tested by use of an accelerated mortar bar test (following ASTM C1260). The highest alkali-silica reaction potential was indicated by very fine-grained chert, containing significant amounts of fine-grained to cryptocrystalline matrix. The chert exhibited a dark red CL emission band at ~640 nm with a low intensity. Fine-grained orthoquartzites, as well as fine-grained metamorphic vein quartz, separated from phyllite exhibited medium expansion values. The orthoquartzites showed various CL of quartz grains, from blue through violet, red, and brown. Two CL spectral bands at ~450 and ~630 nm, with various intensities, were detected. The quartz from phyllite displayed an inhomogeneous dark red CL with two CL spectral bands of low intensities at ~460 and ~640 nm. The massive coarse-grained pegmatite quartz from pegmatite was assessed to be nonreactive and displayed a typical short-lived blue CL (~480 nm). The higher reactivity of the fine-grained hydrothermal quartz may be connected with high concentrations of defect centers, and probably with amorphized micro-regions in the quartz, respectively; indicated by a yellow CL emission (~570 nm).

Multimodality localization of epileptic foci

Science.gov (United States)

Desco, Manuel; Pascau, Javier; Pozo, M. A.; Santos, Andres; Reig, Santiago; Gispert, Juan D.; Garcia-Barreno, Pedro

2001-05-01

This paper presents a multimodality approach for the localization of epileptic foci using PET, MRI and EEG combined without the need of external markers. Mutual Information algorithm is used for MRI-PET registration. Dipole coordinates (provided by BESA software) are projected onto the MRI using a specifically developed algorithm. The four anatomical references used for electrode positioning (nasion, inion and two preauricular points) are located on the MRI using a triplanar viewer combined with a surface-rendering tool. Geometric transformation using deformation of the ideal sphere used for dipole calculations is then applied to match the patient's brain size and shape. Eight treatment-refractory epileptic patients have been studied. The combination of the anatomical information from the MRI, hipoperfusion areas in PET and dipole position and orientation helped the physician in the diagnosis of epileptic focus location. Neurosurgery was not indicated for patients where PET and dipole results were inconsistent; in two cases it was clinically indicated despite the mismatch, showing a negative follow up. The multimodality approach presented does not require external markers for dipole projection onto the MRI, this being the main difference with previous methods. The proposed method may play an important role in the indication of surgery for treatment- refractory epileptic patients.

Multimodal transport and TransLoad facilities in Arkansas.

Science.gov (United States)

2015-01-01

National Priorities consist of building a clean and ecient 21st century : transportation sector, and Multimodal Transportation is one of ve : Transportation System Eciency strategies at the US Department of Energy. Six : locomotives co...

Impact of multimodality in reading comprehension of narrative texts in English as a foreign language (EFL in undergraduate students

Directory of Open Access Journals (Sweden)

Fernando Vera Millalén

2014-11-01

Full Text Available This research seeks to compare the effect that monomodal and multimodal tests have on the reading comprehension level of English-written narrative texts that EFL learners achieve at a private Chilean university. For this purpose, a quasi-experiment was performed, using a monomodal reading comprehension test and another multimodal one, with intact groups. The experimental group took the multimodal format test, while the control group took the monomodal format test. The interest of this research focused on the need to integrate multimodal texts in L2 reading comprehension. The results endorse the hypothesis that students reach higher comprehension levels in multimodal reading comprehension tests.

A Multimodal Communication Aid for Global Aphasia Patients

DEFF Research Database (Denmark)

Pedersen, Jakob Schou; Dalsgaard, Paul; Lindberg, Børge

2004-01-01

This paper presents the basic rationale behind the development and testing of a multimodal communication aid especially designed for people suffering from global aphasia, and thus having severe expressive difficulties. The principle of the aid is to trigger patient associations by presenting...... various multimodal representations of communicative expressions. The aid can in this way be seen as a conceptual continuation of previous research within the field of communication aids based on uni-modal (pictorial) representations of communicative expressions. As patients suffering from global aphasia...... expressions can be used to support patients with global aphasia in communicating by means of short sentences with their surroundings. Only a limited evaluation is carried out, and as such no statistically significant results are obtained. The tests however indicate that the aid is capable of supporting...

Alcohol sensor based on single-mode-multimode-single-mode fiber structure

Science.gov (United States)

Mefina Yulias, R.; Hatta, A. M.; Sekartedjo, Sekartedjo

2016-11-01

Alcohol sensor based on Single-mode -Multimode-Single-mode (SMS) fiber structure is being proposed to sense alcohol concentration in alcohol-water mixtures. This proposed sensor uses refractive index sensing as its sensing principle. Fabricated SMS fiber structure had 40 m of multimode length. With power input -6 dBm and wavelength 1550 nm, the proposed sensor showed good response with sensitivity 1,983 dB per % v/v with measurement range 05 % v/v and measurement span 0,5% v/v.

Piecewise spectrally band-pass for compressive coded aperture spectral imaging

International Nuclear Information System (INIS)

Qian Lu-Lu; Lü Qun-Bo; Huang Min; Xiang Li-Bin

2015-01-01

Coded aperture snapshot spectral imaging (CASSI) has been discussed in recent years. It has the remarkable advantages of high optical throughput, snapshot imaging, etc. The entire spatial-spectral data-cube can be reconstructed with just a single two-dimensional (2D) compressive sensing measurement. On the other hand, for less spectrally sparse scenes, the insufficiency of sparse sampling and aliasing in spatial-spectral images reduce the accuracy of reconstructed three-dimensional (3D) spectral cube. To solve this problem, this paper extends the improved CASSI. A band-pass filter array is mounted on the coded mask, and then the first image plane is divided into some continuous spectral sub-band areas. The entire 3D spectral cube could be captured by the relative movement between the object and the instrument. The principle analysis and imaging simulation are presented. Compared with peak signal-to-noise ratio (PSNR) and the information entropy of the reconstructed images at different numbers of spectral sub-band areas, the reconstructed 3D spectral cube reveals an observable improvement in the reconstruction fidelity, with an increase in the number of the sub-bands and a simultaneous decrease in the number of spectral channels of each sub-band. (paper)

Prussian blue nanocubes: multi-functional nanoparticles for multimodal imaging and image-guided therapy (Conference Presentation)

Science.gov (United States)

Cook, Jason R.; Dumani, Diego S.; Kubelick, Kelsey P.; Luci, Jeffrey; Emelianov, Stanislav Y.

2017-03-01

Imaging modalities utilize contrast agents to improve morphological visualization and to assess functional and molecular/cellular information. Here we present a new type of nanometer scale multi-functional particle that can be used for multi-modal imaging and therapeutic applications. Specifically, we synthesized monodisperse 20 nm Prussian Blue Nanocubes (PBNCs) with desired optical absorption in the near-infrared region and superparamagnetic properties. PBNCs showed excellent contrast in photoacoustic (700 nm wavelength) and MR (3T) imaging. Furthermore, photostability was assessed by exposing the PBNCs to nearly 1,000 laser pulses (5 ns pulse width) with up to 30 mJ/cm2 laser fluences. The PBNCs exhibited insignificant changes in photoacoustic signal, demonstrating enhanced robustness compared to the commonly used gold nanorods (substantial photodegradation with fluences greater than 5 mJ/cm2). Furthermore, the PBNCs exhibited superparamagnetism with a magnetic saturation of 105 emu/g, a 5x improvement over superparamagnetic iron-oxide (SPIO) nanoparticles. PBNCs exhibited enhanced T2 contrast measured using 3T clinical MRI. Because of the excellent optical absorption and magnetism, PBNCs have potential uses in other imaging modalities including optical tomography, microscopy, magneto-motive OCT/ultrasound, etc. In addition to multi-modal imaging, the PBNCs are multi-functional and, for example, can be used to enhance magnetic delivery and as therapeutic agents. Our initial studies show that stem cells can be labeled with PBNCs to perform image-guided magnetic delivery. Overall, PBNCs can act as imaging/therapeutic agents in diverse applications including cancer, cardiovascular disease, ophthalmology, and tissue engineering. Furthermore, PBNCs are based on FDA approved Prussian Blue thus potentially easing clinical translation of PBNCs.

Percorsi linguistici e semiotici: Critical Multimodal Analysis of Digital Discourse

OpenAIRE

edited by Ilaria Moschini

2014-01-01

The language section of LEA - edited by Ilaria Moschini - is dedicated to the Critical Multimodal Analysis of Digital Discourse, an approach that encompasses the linguistic and semiotic detailed investigation of texts within a socio-cultural perspective. It features an interview with Professor Theo van Leeuwen by Ilaria Moschini and four essays: “Retwitting, reposting, repinning; reshaping identities online: Towards a social semiotic multimodal analysis of digital remediation” by Elisabetta A...

The role of radiation therapy in multimodality treatment for renal-cell cancer

International Nuclear Information System (INIS)

Semikoz, N.G.; Kudryashov, O.G.; Ponomar'ov, V.V.; Osipenkov, R.A.; Anyishchenko, A.O.; Kudryashova, S.M.

2011-01-01

The authors report the results of multimodality treatment for renal-cell cancer (pT any, N any, M0) using pre- operative large-fraction irradiation. Our findings demonstrate that radiation therapy does not aggravate the conditions for surgery and improves long-term results. The data about efficacy of multimodality treatment (palliative nephrectomy with radiation therapy) in patients with primary metastatic kidney cancer T any, N any, M1) are also reported.

Squeezing in multi-mode nonlinear optical state truncation

International Nuclear Information System (INIS)

Said, R.S.; Wahiddin, M.R.B.; Umarov, B.A.

2007-01-01

In this Letter, we show that multi-mode qubit states produced via nonlinear optical state truncation driven by classical external pumpings exhibit squeezing condition. We restrict our discussions to the two- and three-mode cases

Going political – multimodal metaphor framings on a cover of the sports newspaper A Bola

Directory of Open Access Journals (Sweden)

Maria Clotilde Almeida

2016-12-01

Full Text Available This paper analyses a political-oriented multimodal metaphor on a cover of the sports newspaper A Bola, sequencing another study on multimodal metaphors deployed on the covers of the very same sports newspaper pertaining to the 2014 Football World Cup in Brazil (Almeida/Sousa, 2015 in the light of Forceville (2009, 2012. The fact that European politics is mapped onto football in multimodal metaphors on this sports newspaper cover draws on the interplay of conceptual metaphors, respectively in the visual mode and in the written mode. Furthermore, there is a relevant time-bound leitmotif which motivates the mapping of politics onto football in the sports newspaper A Bola, namely the upcoming football match between Portugal and Germany. In the multimodal framing of the story line under analysis. The visual mode apparently assumes preponderance, since a picture of Angela Merkel, a prominent leader of EU, is clearly overshadowed by a large picture of Cristiano Ronaldo, the captain of the Portuguese National Football team. However, the visual modality of Cristiano Ronaldo’s dominance over Angela Merkel is intertwined with the powerful metaphorical headline “Vamos expulsar a Alemanha do Euro” (“Let’s kick Germany out of the European Championship”, intended to boost the courage of the Portuguese national football team: “Go Portugal – you can win this time!”. Thus, differently from multimodal metaphors on other covers of the same newspaper, the visual modality in this case cannot be considered the dominant factor in multimodal meaning creation in this politically-oriented layout.Keywords: Multimodal Metaphors. Sports and Politics. Metaphors in Sports Newspapers.

Computer Aided Analysis of TM-Multimode Planar Graded-index Optical Waveguides

International Nuclear Information System (INIS)

Ashry, M.; Nasr, A.S.; Abou El-Fadl, A.A.

2000-01-01

An algorithm is developed for analysis TM-Multimode Planar graded-index optical waveguides. A Modified Impedance Boundary Method of Moments (MIBMOM) for the analysis of planar graded-index optical waveguide structures is presented. The algorithm is used to calculate the dispersion characteristics and the field distribution of TM-multimode planar graded-index optical waveguides. The technique is based on Galerkin s procedure and the exact boundary condition at the interfaces between the graded index region and the step index cladding. Legendre polynomials are used as basis functions. The efficiency of this algorithm is examined with waveguides having various index profiles such as exponential, Gaussian and complementary error functions. The advantage of the MIBMOM is the complete solution of TM-multimode as presented which is very difficult by the other methods. With this algorithm a minimum number of basis functions to give accurate results is used. The obtained results show good agreement with the experimental results

Magnetic Iron Oxide Nanoparticles for Multimodal Imaging and Therapy of Cancer

Directory of Open Access Journals (Sweden)

In-Kyu Park

2013-07-01

Full Text Available Superparamagnetic iron oxide nanoparticles (SPION have emerged as an MRI contrast agent for tumor imaging due to their efficacy and safety. Their utility has been proven in clinical applications with a series of marketed SPION-based contrast agents. Extensive research has been performed to study various strategies that could improve SPION by tailoring the surface chemistry and by applying additional therapeutic functionality. Research into the dual-modal contrast uses of SPION has developed because these applications can save time and effort by reducing the number of imaging sessions. In addition to multimodal strategies, efforts have been made to develop multifunctional nanoparticles that carry both diagnostic and therapeutic cargos specifically for cancer. This review provides an overview of recent advances in multimodality imaging agents and focuses on iron oxide based nanoparticles and their theranostic applications for cancer. Furthermore, we discuss the physiochemical properties and compare different synthesis methods of SPION for the development of multimodal contrast agents.

Co-constructing referential space in multimodal narratives

NARCIS (Netherlands)

Stec, Kashmiri; Huiskes, Mike

Meaning-making is a situated, multimodal process. Although most research has focused on conceptualization in individuals, recent work points to the way dynamic processes can affect both conceptualization and expression in multiple individuals (e.g. Özyürek 2002; Fusaroli and Tylén 2012; Narayan

Multimodal Dialogue Management - State of the art

NARCIS (Netherlands)

Bui Huu Trung, B.H.T.

This report is about the state of the art in dialogue management. We first introduce an overview of a multimodal dialogue system and its components. Second, four main approaches to dialogue management are described (finite-state and frame-based, information-state based and probabilistic, plan-based,

Multimodal Student Interaction Online: An Ecological Perspective

Science.gov (United States)

Berglund, Therese Ornberg

2009-01-01

This article describes the influence of tool and task design on student interaction in language learning at a distance. Interaction in a multimodal desktop video conferencing environment, FlashMeeting, is analyzed from an ecological perspective with two main foci: participation rates and conversational feedback strategies. The quantitative…

Detection of elemental mercury by multimode diode laser correlation spectroscopy.

Science.gov (United States)

Lou, Xiutao; Somesfalean, Gabriel; Svanberg, Sune; Zhang, Zhiguo; Wu, Shaohua

2012-02-27

We demonstrate a method for elemental mercury detection based on correlation spectroscopy employing UV laser radiation generated by sum-frequency mixing of two visible multimode diode lasers. Resonance matching of the multimode UV laser is achieved in a wide wavelength range and with good tolerance for various operating conditions. Large mode-hops provide an off-resonance baseline, eliminating interferences from other gas species with broadband absorption. A sensitivity of 1 μg/m3 is obtained for a 1-m path length and 30-s integration time. The performance of the system shows promise for mercury monitoring in industrial applications.

Multimodal and ubiquitous computing systems: supporting independent-living older users.

Science.gov (United States)

Perry, Mark; Dowdall, Alan; Lines, Lorna; Hone, Kate

2004-09-01

We document the rationale and design of a multimodal interface to a pervasive/ubiquitous computing system that supports independent living by older people in their own homes. The Millennium Home system involves fitting a resident's home with sensors--these sensors can be used to trigger sequences of interaction with the resident to warn them about dangerous events, or to check if they need external help. We draw lessons from the design process and conclude the paper with implications for the design of multimodal interfaces to ubiquitous systems developed for the elderly and in healthcare, as well as for more general ubiquitous computing applications.

Generalized uncertainty relations and characteristic invariants for the multimode states

International Nuclear Information System (INIS)

Sudarshan, E.C.G.; Chiu, C.B.; Bhamathi, G.

1995-01-01

The close relationship between the zero-point energy, the uncertainty relation, coherent states, squeezed states, and correlated states for one mode is investigated. This group theoretic perspective of the problem enables the parametrization and identification of their multimode generalization. A simple and efficient method of determining the canonical structure of the generalized correlated states is presented. Implication of canonical commutation relations for correlations are not exhausted by the Heisenberg uncertainty relation, not even by the Schroedinger-Robertson uncertainty inequality, but there are relations in the multimode case that are the generalization of the Schroedinger-Robertson relation

ULTRAVIOLET RAMAN SPECTRAL SIGNATURE ACQUISITION: UV RAMAN SPECTRAL FINGERPRINTS.

Energy Technology Data Exchange (ETDEWEB)

SEDLACEK,III, A.J.FINFROCK,C.

2002-09-01

As a member of the science-support part of the ITT-lead LISA development program, BNL is tasked with the acquisition of UV Raman spectral fingerprints and associated scattering cross-sections for those chemicals-of-interest to the program's sponsor. In support of this role, the present report contains the first installment of UV Raman spectral fingerprint data on the initial subset of chemicals. Because of the unique nature associated with the acquisition of spectral fingerprints for use in spectral pattern matching algorithms (i.e., CLS, PLS, ANN) great care has been undertaken to maximize the signal-to-noise and to minimize unnecessary spectral subtractions, in an effort to provide the highest quality spectral fingerprints. This report is divided into 4 sections. The first is an Experimental section that outlines how the Raman spectra are performed. This is then followed by a section on Sample Handling. Following this, the spectral fingerprints are presented in the Results section where the data reduction process is outlined. Finally, a Photographs section is included.

Multimodal location estimation of videos and images

CERN Document Server

Friedland, Gerald

2015-01-01

This book presents an overview of the field of multimodal location estimation, i.e. using acoustic, visual, and/or textual cues to estimate the shown location of a video recording. The authors' sample research results in this field in a unified way integrating research work on this topic that focuses on different modalities, viewpoints, and applications. The book describes fundamental methods of acoustic, visual, textual, social graph, and metadata processing as well as multimodal integration methods used for location estimation. In addition, the text covers benchmark metrics and explores the limits of the technology based on a human baseline. ·         Discusses localization of multimedia data; ·         Examines fundamental methods of establishing location metadata for images and videos (other than GPS tagging); ·         Covers Data-Driven as well as Semantic Location Estimation.

Multi-Modal Traveler Information System - Gateway Functional Requirements

Science.gov (United States)

1997-11-17

The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

Ex-vivo holographic microscopy and spectroscopic analysis of head and neck cancer

Science.gov (United States)

Holler, Stephen; Wurtz, Robert; Auyeung, Kelsey; Auyeung, Kris; Paspaley-Grbavac, Milan; Mulroe, Brigid; Sobrero, Maximiliano; Miles, Brett

2015-03-01

Optical probes to identify tumor margins in vivo would greatly reduce the time, effort and complexity in the surgical removal of malignant tissue in head and neck cancers. Current approaches involve visual microscopy of stained tissue samples to determine cancer margins, which results in the excision of excess of tissue to assure complete removal of the cancer. Such surgical procedures and follow-on chemotherapy can adversely affect the patient's recovery and subsequent quality of life. In order to reduce the complexity of the process and minimize adverse effects on the patient, we investigate ex vivo tissue samples (stained and unstained) using digital holographic microscopy in conjunction with spectroscopic analyses (reflectance and transmission spectroscopy) in order to determine label-free, optically identifiable characteristic features that may ultimately be used for in vivo processing of cancerous tissues. The tissue samples studied were squamous cell carcinomas and associated controls from patients of varying age, gender and race. Holographic microscopic imaging scans across both cancerous and non-cancerous tissue samples yielded amplitude and phase reconstructions that were correlated with spectral signatures. Though the holographic reconstructions and measured spectra indicate variations even among the same class of tissue, preliminary results indicate the existence of some discriminating features. Further analyses are presently underway to further this work and extract additional information from the imaging and spectral data that may prove useful for in vivo surgical identification.

Fluorescence microscopy.

Science.gov (United States)

Sanderson, Michael J; Smith, Ian; Parker, Ian; Bootman, Martin D

2014-10-01

Fluorescence microscopy is a major tool with which to monitor cell physiology. Although the concepts of fluorescence and its optical separation using filters remain similar, microscope design varies with the aim of increasing image contrast and spatial resolution. The basics of wide-field microscopy are outlined to emphasize the selection, advantages, and correct use of laser scanning confocal microscopy, two-photon microscopy, scanning disk confocal microscopy, total internal reflection, and super-resolution microscopy. In addition, the principles of how these microscopes form images are reviewed to appreciate their capabilities, limitations, and constraints for operation. © 2014 Cold Spring Harbor Laboratory Press.

Deterministic Integration of Quantum Dots into on-Chip Multimode Interference Beamsplitters Using in Situ Electron Beam Lithography.

Science.gov (United States)

Schnauber, Peter; Schall, Johannes; Bounouar, Samir; Höhne, Theresa; Park, Suk-In; Ryu, Geun-Hwan; Heindel, Tobias; Burger, Sven; Song, Jin-Dong; Rodt, Sven; Reitzenstein, Stephan

2018-04-11

The development of multinode quantum optical circuits has attracted great attention in recent years. In particular, interfacing quantum-light sources, gates, and detectors on a single chip is highly desirable for the realization of large networks. In this context, fabrication techniques that enable the deterministic integration of preselected quantum-light emitters into nanophotonic elements play a key role when moving forward to circuits containing multiple emitters. Here, we present the deterministic integration of an InAs quantum dot into a 50/50 multimode interference beamsplitter via in situ electron beam lithography. We demonstrate the combined emitter-gate interface functionality by measuring triggered single-photon emission on-chip with g (2) (0) = 0.13 ± 0.02. Due to its high patterning resolution as well as spectral and spatial control, in situ electron beam lithography allows for integration of preselected quantum emitters into complex photonic systems. Being a scalable single-step approach, it paves the way toward multinode, fully integrated quantum photonic chips.

Context-Aware Multimodal FIDO Authenticator for Sustainable IT Services

Directory of Open Access Journals (Sweden)

Seung-Hyun Kim

2018-05-01

Full Text Available Existing sustainable IT services have several problems related to user authentication such as the inefficiency of managing the system security, low security, and low usability. In this paper, we propose a Fast IDentity Online (FIDO authenticator that performs continuous authentication with implicit authentication based on user context and multimodal authentication. The proposed FIDO authenticator, a context-aware multimodal FIDO authentication (CAMFA method, combines information such as the user context, state of the mobile device, and user biometrics, then applies implicit and explicit authentication methods to meet the level of authentication required by the service provider. This reduces the user’s explicit authentication burden and continually authenticates users at risk during the session. Moreover, it is able to respond to attacks such as the theft of the authentication method or session hijacking. To study the effectiveness of CAMFA, we ran a user study by collecting data from 22 participants over 42 days of activity on a practical Android platform. The result of the user study demonstrates that the number of explicit authentication requests could be reduced by half. Based on the results of this study, an advanced user authentication that provides multimodal and continuous authentication could be applied to sustainable IT services.

An Efficient Human Identification through MultiModal Biometric System

Directory of Open Access Journals (Sweden)

K. Meena

Full Text Available ABSTRACT Human identification is essential for proper functioning of society. Human identification through multimodal biometrics is becoming an emerging trend, and one of the reasons is to improve recognition accuracy. Unimodal biometric systems are affected by various problemssuch as noisy sensor data,non-universality, lack of individuality, lack of invariant representation and susceptibility to circumvention.A unimodal system has limited accuracy. Hence, Multimodal biometric systems by combining more than one biometric feature in different levels are proposed in order to enhance the performance of the system. A supervisor module combines the different opinions or decisions delivered by each subsystem and then make a final decision. In this paper, a multimodal biometrics authentication is proposed by combining face, iris and finger features. Biometric features are extracted by Local Derivative Ternary Pattern (LDTP in Contourlet domain and an extensive evaluation of LDTP is done using Support Vector Machine and Nearest Neighborhood Classifier. The experimental evaluations are performed on a public dataset demonstrating the accuracy of the proposed system compared with the existing systems. It is observed that, the combination of face, fingerprint and iris gives better performance in terms of accuracy, False Acceptance Rate, False Rejection Rate with minimum computation time.

Reflection effects in multimode fiber systems utilizing laser transmitters

Science.gov (United States)

Bates, Harry E.

1991-11-01

A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.

Effects of Multimodal Analgesia on the Success of Mouse Embryo Transfer Surgery

Science.gov (United States)

Parker, John M.; Austin, Jamie; Wilkerson, James; Carbone, Larry

2011-01-01

Multimodal analgesia is promoted as the best practice pain management for invasive animal research procedures. Universal acceptance and incorporation of multimodal analgesia requires assessing potential effects on study outcome. The focus of this study was to assess effects on embryo survival after multimodal analgesia comprising an opioid and nonsteroidal antiinflammatory drug (NSAID) compared with opioid-only analgesia during embryo transfer procedures in transgenic mouse production. Mice were assigned to receive either carprofen (5 mg/kg) with buprenorphine (0.1 mg/kg; CB) or vehicle with buprenorphine (0.1 mg/kg; VB) in a prospective, double-blinded placebo controlled clinical trial. Data were analyzed in surgical sets of 1 to 3 female mice receiving embryos chimeric for a shared targeted embryonic stem-cell clone and host blastocyst cells. A total of 99 surgical sets were analyzed, comprising 199 Crl:CD1 female mice and their 996 offspring. Neither yield (pups weaned per embryo implanted in the surgical set) nor birth rate (average number of pups weaned per dam in the set) differed significantly between the CB and VB conditions. Multimodal opioid–NSAID analgesia appears to have no significant positive or negative effect on the success of producing novel lines of transgenic mice by blastocyst transfer. PMID:21838973

Advanced driver assistance systems: Using multimodal redundant warnings to enhance road safety.

Science.gov (United States)

Biondi, Francesco; Strayer, David L; Rossi, Riccardo; Gastaldi, Massimiliano; Mulatti, Claudio

2017-01-01

This study investigated whether multimodal redundant warnings presented by advanced assistance systems reduce brake response times. Warnings presented by assistance systems are designed to assist drivers by informing them that evasive driving maneuvers are needed in order to avoid a potential accident. If these warnings are poorly designed, they may distract drivers, slow their responses, and reduce road safety. In two experiments, participants drove a simulated vehicle equipped with a forward collision avoidance system. Auditory, vibrotactile, and multimodal warnings were presented when the time to collision was shorter than five seconds. The effects of these warnings were investigated with participants performing a concurrent cell phone conversation (Exp. 1) or driving in high-density traffic (Exp. 2). Braking times and subjective workload were measured. Multimodal redundant warnings elicited faster braking reaction times. These warnings were found to be effective even when talking on a cell phone (Exp. 1) or driving in dense traffic (Exp. 2). Multimodal warnings produced higher ratings of urgency, but ratings of frustration did not increase compared to other warnings. Findings obtained in these two experiments are important given that faster braking responses may reduce the potential for a collision. Copyright © 2016 Elsevier Ltd. All rights reserved.

CARS microscopy for the monitoring of lipid storage in C. elegans

Science.gov (United States)

Enejder, Annika; Brackmann, Christian; Axäng, Claes; Åkeson, Madeleine; Pilon, Marc

2008-02-01

After several years of proof-of-principle measurements and focus on technological development, it is timely to make full use of the capabilities of CARS microscopy within the biosciences. We have here identified an urgent biological problem, to which CARS microscopy provides unique insights and consequently may become a widely accepted experimental procedure. In order to improve present understanding of mechanisms underlying dysfunctional metabolism regulation reported for many of our most wide-spread diseases (obesity, diabetes, cardio-vascular diseases etc.), we have monitored genetic and environmental impacts on cellular lipid storage in the model organism C. elegans in vivo in a full-scale biological study. Important advantages of CARS microscopy could be demonstrated compared to present technology, i.e. fluorescence microscopy of labelled lipid stores. The fluorescence signal varies not only with the presence of lipids, but also with the systemic distribution of the fluorophore and the chemical properties of the surrounding medium. By instead probing high-density regions of CH bonds naturally occurring in the sample, the CARS process was shown to provide a consistent representation of the lipid stores. The increased accumulation of lipid stores in mutants with deficiencies in the insulin and transforming growth factor signalling pathways could hereby be visualized and quantified. Furthermore, spectral CARS microscopy measurements in the C-H bond region of 2780-2930 cm -1 provided the interesting observation that this accumulation comes with a shift in the ordering of the lipids from gel- to liquid phase. The present study illustrates that CARS microscopy has a strong potential to become an important instrument for systemic studies of lipid storage mechanisms in living organisms, providing new insights into the phenomena underlying metabolic disorders.

Influence of Blood Contamination During Multimode Adhesive ...

African Journals Online (AJOL)

Objectives: The present study evaluated the effects of blood contamination performed at different steps of bonding on the microtensile bond strength (μTBS) of multimode adhesives to dentin when using the self-etch approach. Materials and Methods: Seventy-five molars were randomly assigned to three adhesive groups ...

Meaning Making through Multiple Modalities in a Biology Classroom: A Multimodal Semiotics Discourse Analysis

Science.gov (United States)

Jaipal, Kamini

2010-01-01

The teaching of science is a complex process, involving the use of multiple modalities. This paper illustrates the potential of a multimodal semiotics discourse analysis framework to illuminate meaning-making possibilities during the teaching of a science concept. A multimodal semiotics analytical framework is developed and used to (1) analyze the…

Compact Spectrometer based on a silicon multimode waveguide

DEFF Research Database (Denmark)

Piels, Molly; Zibar, Darko

2017-01-01

A multimode waveguide spectrometer with 4 GHz resolution, 250 GHz usable range, and a 1.6 mm × 2.1 mm footprint is demonstrated. The operating range is greatly extended by including distinct mode-exciting elements on chip....

A simple approach to spectrally resolved fluorescence and bright field microscopy over select regions of interest

OpenAIRE

Dahlberg, Peter D.; Boughter, Christopher T.; Faruk, Nabil F.; Hong, Lu; Koh, Young Hoon; Reyer, Matthew A.; Shaiber, Alon; Sherani, Aiman; Zhang, Jiacheng; Jureller, Justin E.; Hammond, Adam T.

2016-01-01

A standard wide field inverted microscope was converted to a spatially selective spectrally resolved microscope through the addition of a polarizing beam splitter, a pair of polarizers, an amplitude-mode liquid crystal-spatial light modulator, and a USB spectrometer. The instrument is capable of simultaneously imaging and acquiring spectra over user defined regions of interest. The microscope can also be operated in a bright-field mode to acquire absorption spectra of micron scale objects. Th...

Frequency tripling with multimode-lasers

International Nuclear Information System (INIS)

Langer, H.; Roehr, H.; Wrobel, W.G.

1978-10-01

The presence of different modes with random phases in a laser beam leads to fluctuations in nonlinear optical interactions. This paper describes the influence of the linewidth of a dye laser on the generation of intensive Lyman-alpha radiation by frequency tripling. Using this Lyman-alpha source for resonance scattering on strongly doppler-broadened lines in fusion plasmas the detection limit of neutral hydrogen is nearly two orders higher with the multimode than the singlemode dye laser. (orig.) [de

Multimode polymer waveguides for high-speed optical interconnects

Science.gov (United States)

Bamiedakis, N.; Ingham, J. D.; Penty, R. V.; White, I. H.; DeGroot, J. V.; Clapp, T. V.

2017-11-01

Polymeric multimode waveguides are of particular interest for optical interconnections in short-reach data links. In some applications, for example in space-borne systems, the use of advanced materials with outstanding performance in extreme environments is required (temperature and radiation). In this paper therefore, we present novel siloxane polymers suitable for these applications. The materials are used to form straight, 90° bent and spiral polymer waveguides by low-cost conventional photolithographic techniques on FR4 substrates. The samples have been tested to investigate their propagation characteristics and demonstrate their potential for high-speed data links. Overall, there is strong evidence that these multimode waveguides can be successfully employed as high-speed short-reach data links. Their excellent thermal properties, their low cost and the simple fabrication process indicate their suitability for a wide range of space applications.

Effectiveness of a Multimodal Therapy for Patients with Chronic Low Back Pain Regarding Pre-Admission Healthcare Utilization

Science.gov (United States)

Borys, Constanze; Lutz, Johannes; Strauss, Bernhard; Altmann, Uwe

2015-01-01

Objective The aim of the study was to examine the effectiveness of an intensive inpatient three-week multimodal therapy. We focused especially on the impact on the multimodal therapy outcome of the pre-admission number of treatment types patients had received and of medical specialist groups patients had consulted. Methods 155 patients with chronic low back pain and indication for multimodal therapy were evaluated with respect to pain intensity, depression, anxiety, well-being, and pre-admission health care utilization. In our controlled clinical trial we compared N = 66 patients on the waiting list with N = 89 patients who received immediate treatment. The waiting list patients likewise attended multimodal therapy after the waiting period. Longitudinal post-treatment data for both were collected at three- and twelve-month follow-ups. The impact of pre-admission health care utilization on multimodal therapy outcome (post) was analysed by structural equation model. Results Compared to the control group, multimodal therapy patients’ pain intensity and psychological variables were significantly reduced. Longitudinal effects with respect to pre-measures were significant at three-month follow-up for pain intensity (ES = -0.48), well-being (ES = 0.78), anxiety (ES = -0.33), and depression (ES = -0.30). Effect sizes at twelve-month follow-up were small for anxiety (ES = -0.22), and moderate for general well-being (ES = 0.61). Structural equation model revealed that a higher number of pre-admission treatment types was associated with poorer post-treatment outcomes in pain intensity, well-being, and depression. Conclusion Multimodal therapy proved to be effective with regard to improvements in pain intensity, depression, anxiety, and well-being. The association between treatment effect and number of pre-admission pain treatment types suggests that patients would benefit more from attending multimodal therapy in an earlier stage of health care. PMID:26599232

Multimodal Imaging Brain Connectivity Analysis (MIBCA toolbox

Directory of Open Access Journals (Sweden)

Andre Santos Ribeiro

2015-07-01

Full Text Available Aim. In recent years, connectivity studies using neuroimaging data have increased the understanding of the organization of large-scale structural and functional brain networks. However, data analysis is time consuming as rigorous procedures must be assured, from structuring data and pre-processing to modality specific data procedures. Until now, no single toolbox was able to perform such investigations on truly multimodal image data from beginning to end, including the combination of different connectivity analyses. Thus, we have developed the Multimodal Imaging Brain Connectivity Analysis (MIBCA toolbox with the goal of diminishing time waste in data processing and to allow an innovative and comprehensive approach to brain connectivity.Materials and Methods. The MIBCA toolbox is a fully automated all-in-one connectivity toolbox that offers pre-processing, connectivity and graph theoretical analyses of multimodal image data such as diffusion-weighted imaging, functional magnetic resonance imaging (fMRI and positron emission tomography (PET. It was developed in MATLAB environment and pipelines well-known neuroimaging softwares such as Freesurfer, SPM, FSL, and Diffusion Toolkit. It further implements routines for the construction of structural, functional and effective or combined connectivity matrices, as well as, routines for the extraction and calculation of imaging and graph-theory metrics, the latter using also functions from the Brain Connectivity Toolbox. Finally, the toolbox performs group statistical analysis and enables data visualization in the form of matrices, 3D brain graphs and connectograms. In this paper the MIBCA toolbox is presented by illustrating its capabilities using multimodal image data from a group of 35 healthy subjects (19–73 years old with volumetric T1-weighted, diffusion tensor imaging, and resting state fMRI data, and 10 subjets with 18F-Altanserin PET data also.Results. It was observed both a high inter

Multimode nonlinear optical imaging of the dermis in ex vivo human skin based on the combination of multichannel mode and Lambda mode.

Science.gov (United States)

Zhuo, Shuangmu; Chen, Jianxin; Luo, Tianshu; Zou, Dingsong

2006-08-21

A Multimode nonlinear optical imaging technique based on the combination of multichannel mode and Lambda mode is developed to investigate human dermis. Our findings show that this technique not only improves the image contrast of the structural proteins of extracellular matrix (ECM) but also provides an image-guided spectral analysis method to identify both cellular and ECM intrinsic components including collagen, elastin, NAD(P)H and flavin. By the combined use of multichannel mode and Lambda mode in tandem, the obtained in-depth two photon-excited fluorescence (TPEF) and second-harmonic generation (SHG) imaging and TPEF/SHG signals depth-dependence decay can offer a sensitive tool for obtaining quantitative tissue structural and biochemical information. These results suggest that the technique has the potential to provide more accurate information for determining tissue physiological and pathological states.

Cortical inter-hemispheric circuits for multimodal vocal learning in songbirds.

Science.gov (United States)

Paterson, Amy K; Bottjer, Sarah W

2017-10-15

Vocal learning in songbirds and humans is strongly influenced by social interactions based on sensory inputs from several modalities. Songbird vocal learning is mediated by cortico-basal ganglia circuits that include the SHELL region of lateral magnocellular nucleus of the anterior nidopallium (LMAN), but little is known concerning neural pathways that could integrate multimodal sensory information with SHELL circuitry. In addition, cortical pathways that mediate the precise coordination between hemispheres required for song production have been little studied. In order to identify candidate mechanisms for multimodal sensory integration and bilateral coordination for vocal learning in zebra finches, we investigated the anatomical organization of two regions that receive input from SHELL: the dorsal caudolateral nidopallium (dNCL SHELL ) and a region within the ventral arcopallium (Av). Anterograde and retrograde tracing experiments revealed a topographically organized inter-hemispheric circuit: SHELL and dNCL SHELL , as well as adjacent nidopallial areas, send axonal projections to ipsilateral Av; Av in turn projects to contralateral SHELL, dNCL SHELL , and regions of nidopallium adjacent to each. Av on each side also projects directly to contralateral Av. dNCL SHELL and Av each integrate inputs from ipsilateral SHELL with inputs from sensory regions in surrounding nidopallium, suggesting that they function to integrate multimodal sensory information with song-related responses within LMAN-SHELL during vocal learning. Av projections share this integrated information from the ipsilateral hemisphere with contralateral sensory and song-learning regions. Our results suggest that the inter-hemispheric pathway through Av may function to integrate multimodal sensory feedback with vocal-learning circuitry and coordinate bilateral vocal behavior. © 2017 Wiley Periodicals, Inc.

Multispectral digital lensless holographic microscopy: from femtosecond laser to white light LED

International Nuclear Information System (INIS)

Garcia-Sucerquia, J

2015-01-01

The use of femtosecond laser radiation and super bright white LED in digital lensless holographic microscopy is presented. For the ultrafast laser radiation two different configurations of operation of the microscope are presented and the dissimilar performance of each one analyzed. The microscope operating with a super bright white light LED in combination with optical filters shows very competitive performance as it is compared with more expensive optical sources. The broadband emission of both radiation sources allows the multispectral imaging of biological samples to obtain spectral responses and/or full color images of the microscopic specimens; sections of the head of a Drosophila melanogaster fly are imaged in this contribution. The simple, solid, compact, lightweight, and reliable architecture of digital lensless holographic microscopy operating with broadband light sources to image biological specimens exhibiting micrometer-sized details is evaluated in the present contribution. (paper)

Multimodal imaging in health, disease, and man-made disasters

International Nuclear Information System (INIS)

Papineni, Rao V.L.

2012-01-01

Significant advances in the fields of molecular and functional imaging are rapidly emerging as potential advance research tools in health, Disease and drug discovery. Notable are the approaches utilizing multi-modal imaging strategies in preclinical studies that are becoming extremely useful in assessing the efficacy of the novel target molecules. This talk will focus on our efforts in bringing the multimodality to preclinical research with Optical, X-ray, and noninvasive nuclear imaging. The concepts and methods in molecular imaging to support drug targeting and drug discovery will be discussed along with a focus on its utilization in radiation induced changes in the bone physiology. Also, will discuss how such approaches can be employed in future as a biodosimetry for radiation disasters or in radiation threat. (author)

Pervasive Technologies and the Paradoxes of Multimodal Digital Communication

Directory of Open Access Journals (Sweden)

Sandra Petroni

2014-12-01

Full Text Available Contemporary societies are greatly challenged by paradoxes in all facets of life. Digital communication encodes and produces meaning by making use of these contradictory relations. In this contribution, three digital paradoxes will be presented. The first paradox is grounded in the process of remediation in digital settings which mirrors a contradictory double logic. Digital culture, in fact, wants both to multiply its media and to eliminate all traces of mediation. The second antinomy has its origins in the new concept of linguistic entropy: a structured information disorder that is regulated by usability and multimodality. In accordance with the second paradox, the third one stems from further processes that are framing, a multimodal resource, and linking, a hypertextual resource.

Performance characterization of the IEEE 802.11 signal transmission over a multimode fiber PON

Science.gov (United States)

Maksymiuk, L.; Siuzdak, J.

2014-11-01

In this paper there are presented measurements concerning performance analysis of the IEEE 802.11 signal distribution over multimode fiber based passive optical network. In the paper there are addressed three main sources of impairments: modal noise, frequency response fluctuation of the multimode fiber and non-linear distortion of the signal in the receiver.

Computer-aided psychotherapy based on multimodal elicitation, estimation and regulation of emotion.

Science.gov (United States)

Cosić, Krešimir; Popović, Siniša; Horvat, Marko; Kukolja, Davor; Dropuljić, Branimir; Kovač, Bernard; Jakovljević, Miro

2013-09-01

Contemporary psychiatry is looking at affective sciences to understand human behavior, cognition and the mind in health and disease. Since it has been recognized that emotions have a pivotal role for the human mind, an ever increasing number of laboratories and research centers are interested in affective sciences, affective neuroscience, affective psychology and affective psychopathology. Therefore, this paper presents multidisciplinary research results of Laboratory for Interactive Simulation System at Faculty of Electrical Engineering and Computing, University of Zagreb in the stress resilience. Patient's distortion in emotional processing of multimodal input stimuli is predominantly consequence of his/her cognitive deficit which is result of their individual mental health disorders. These emotional distortions in patient's multimodal physiological, facial, acoustic, and linguistic features related to presented stimulation can be used as indicator of patient's mental illness. Real-time processing and analysis of patient's multimodal response related to annotated input stimuli is based on appropriate machine learning methods from computer science. Comprehensive longitudinal multimodal analysis of patient's emotion, mood, feelings, attention, motivation, decision-making, and working memory in synchronization with multimodal stimuli provides extremely valuable big database for data mining, machine learning and machine reasoning. Presented multimedia stimuli sequence includes personalized images, movies and sounds, as well as semantically congruent narratives. Simultaneously, with stimuli presentation patient provides subjective emotional ratings of presented stimuli in terms of subjective units of discomfort/distress, discrete emotions, or valence and arousal. These subjective emotional ratings of input stimuli and corresponding physiological, speech, and facial output features provides enough information for evaluation of patient's cognitive appraisal deficit

Multimodal compared to pharmacologic treatments for chronic tension-type headache in adolescents.

Science.gov (United States)

Przekop, Peter; Przekop, Allison; Haviland, Mark G

2016-10-01

Chronic tension-type headache (CTTH) in children and adolescents is a serious medical condition, with considerable morbidity and few effective, evidence-based treatments. We performed a chart review of 83 adolescents (age range = 13-18 years; 67 girls and 16 boys) diagnosed with CTTH. Two treatment protocols were compared: multimodal (osteopathic manipulative treatments, mindfulness, and qi gong) and pharmacologic (amitriptyline or gabapentin). Four outcomes (headache frequency, pain intensity, general health, and health interference) were assessed at three time points (baseline, 3 months, and 6 months). A fifth outcome, number of bilateral tender points, was recorded at baseline and 6 months. All five were evaluated statistically with a linear mixed model. Although both multimodal and pharmacologic treatments were effective for CTTH (time effects for all measures were significant at p treatment (the five group by time interaction effects were significant at or below the p Headache frequency in the pharmacologic group, for example, reduced from a monthly average (95% Confidence Interval shown in parentheses) of 23.9 (21.8, 26.0) to 16.4 (14.3, 18.6) and in the multimodal group from 22.3 (20.1, 24.5) to 4.9 (2.6, 7.2) (a substantial group difference). Pain intensity (worst in the last 24 hours, 0-10 scale) was reduced in the pharmacologic group from 6.2 (5.6, 6.9) to 3.4 (2.7, 4.1) and from 6.1 (5.4, 6.8) to 2.0 (1.2, 2.7) in the multimodal group (a less substantial difference). Across the other three assessments, group differences were larger for general health and number of tender points and less so for pain restriction. Multimodal treatment for adolescent CTTH appears to be effective. Randomized controlled trials are needed to confirm these promising results. Copyright © 2015 Elsevier Ltd. All rights reserved.

Investigations of a Cretaceous limestone with spectral induced polarization and scanning electron microscopy

DEFF Research Database (Denmark)

Johansson, Sara; Sparrembom, Charlotte; Fiandaca, Gianluca

2017-01-01

limestone was carried out in the Kristianstad basin, Sweden. The time domain IP data was processed with a recently developed method in order to suppress noise from the challenging urban setting in the survey area. The processing also enabled extraction of early decay times resulting in broader spectra...... in early time ranges for bedrock characterization. The inverted sections showed variations within the limestone that could be caused by variations in texture and composition. Samples from a deep drilling in the Kristianstad basin were investigated with scanning electron microscopy and energy dispersive X......Characterization of varying bedrock properties is a common need in various contexts, ranging from large infrastructure pre-investigations to environmental protection. A direct current resistivity and time domain induced polarization (IP) survey aiming to characterize properties of a Cretaceous...

Recent Progress in Synthesis and Functionalization of Multimodal Fluorescent-Magnetic Nanoparticles for Biological Applications

Directory of Open Access Journals (Sweden)

Raquel Serrano García

2018-01-01

Full Text Available There is a great interest in the development of new nanomaterials for multimodal imaging applications in biology and medicine. Multimodal fluorescent-magnetic based nanomaterials deserve particular attention as they can be used as diagnostic and drug delivery tools, which could facilitate the diagnosis and treatment of cancer and many other diseases. This review focuses on the recent developments of magnetic-fluorescent nanocomposites and their biomedical applications. The recent advances in synthetic strategies and approaches for the preparation of fluorescent-magnetic nanocomposites are presented. The main biomedical uses of multimodal fluorescent-magnetic nanomaterials, including biological imaging, cancer therapy and drug delivery, are discussed, and prospects of this field are outlined.

Multimodal route choice models of public transport passengers in the Greater Copenhagen Area

DEFF Research Database (Denmark)

Anderson, Marie Karen; Nielsen, Otto Anker; Prato, Carlo Giacomo

2014-01-01

Understanding route choice behavior is crucial to explain travelers’ preferences and to predict traffic flows under different scenarios. A growing body of literature has concentrated on public transport users without, however, concentrating on multimodal public transport networks because......,641 public transport users in the Greater Copenhagen Area.A two-stage approach consisting of choice set generation and route choice model estimation allowed uncovering the preferences of the users of this multimodal large-scale public transport network. The results illustrate the rates of substitution...... not only of the in-vehicle times for different public transport modes, but also of the other time components (e.g., access, walking, waiting, transfer) composing the door-to-door experience of using a multimodal public transport network, differentiating by trip length and purpose, and accounting...

Correlated Light Microscopy and Electron Microscopy

NARCIS (Netherlands)

Sjollema, Klaas A.; Schnell, Ulrike; Kuipers, Jeroen; Kalicharan, Ruby; Giepmans, Ben N. G.; MullerReichert, T; Verkade, P

2012-01-01

Understanding where, when, and how biomolecules (inter)act is crucial to uncover fundamental mechanisms in cell biology. Recent developments in fluorescence light microscopy (FLM) allow protein imaging in living cells and at the near molecular level. However, fluorescence microscopy only reveals

MULTIMODAL ANALGESIA AFTER TOTAL HIP ARTHROPLASTY

Directory of Open Access Journals (Sweden)

I. G. Mukutsa

2012-01-01

Full Text Available Purpose - to assess the effect of multimodal analgesia in the early rehabilitation of patients after hip replacement. Materials and methods. A prospective single-centre randomized research, which included 32 patients. Patients of the 1st group received paracetamol, ketorolac and tramadol, the 2nd group of patients - ketorolac intravenously and the 3rd group of patients - etoricoxib and gabapentin. Patients of the 2nd and the 3rd groups underwent epidural analgesia with ropivacaine. Multimodal analgesia was carried out for 48 hours after the surgery. Assessment of pain intensity was performed by the VAS (visual analogue scale, a neuropathic pain component - on the DN4 questionnaire . Time was recorded during the first and second verticalization of patients, using the distance walkers and by fixing the distance covered with in 2 minutes. Results. The intensity of pain for more than 50 mm on VAS at movement at least once every 48 hours after the surgery was occurred among 9% of the 1st group, 22% of patients from the 2nd group and 8% of patients of the 3rd group. Number of patients with neuropathic pain component decreased from 25% to 3% (p ≤ 0.05. The first verticalization was performed 10 ± 8 hours after the surgery, the second - 21 ± 8 hours later. Two-minute walk distance was 5 ± 3 and 8 ± 4 m, respectively. It is noted more frequent adverse events in patients of the 1st group was noted compared to patients of the 2nd and the 3rd groups during first (91%, 33% and 25%, p ≤ 0.05 and the second verticalization (70%, 25% and 17%, p ≤ 0.05. Multimodal analgesia allows to proceed with the successful activation of patients after hip replacement with in the first day after the surgery. The 3rd group patients are noted with a tendency for the optimal combination of efficient and safe of analgetic therapy.

Coherent multimoded dielectric wakefield accelerators

International Nuclear Information System (INIS)

Power, J.

1998-01-01

There has recently been a study of the potential uses of multimode dielectric structures for wakefield acceleration [1]. This technique is based on adjusting the wakefield modes of the structure to constructively interfere at certain delays with respect to the drive bunch, thus providing an accelerating gradient enhancement over single mode devices. In this report we examine and attempt to clarify the issues raised by this work in the light of the present state of the art in wakefield acceleration

Multimodal imaging of vocal fold scarring in a rabbit model by multiphoton microscopy

Science.gov (United States)

Kazarine, Alexei; Bouhabel, Sarah; Douillette, Annie H.; Kost, Karen; Li-Jessen, Nicole Y. K.; Mongeau, Luc; Wiseman, Paul W.

2017-02-01

Vocal fold scarring as a result of injury or disease can lead to voice disorders which can significantly affect the quality of life. During the scarring process, the normally elastic tissue of the vocal fold lamina propria is replaced by a much stiffer collagen-based fibrotic tissue, which impacts the fold's ability to vibrate. Surgical removal of this tissue is often ineffective and can result in further scarring. Injectable biomaterials, a form of tissue engineering, have been proposed as a potential solution to reduce existing scars or prevent scarring altogether. In order to properly evaluate the effectiveness of these new materials, multiphoton microscopy emerges as an effective tool due to its intrinsic multiple label free contrast mechanisms that highlight extracellular matrix elements. In this study, we evaluate the spatial distribution of collagen and elastin fibers in a rabbit model using second harmonic generation (SHG), third harmonic generation (THG) and two photon autofluorescence (TPAF) applied to unlabeled tissue sections. In comparison to traditional methods that rely on histological staining or immunohistochemistry, SHG, THG and TPAF provide a more reliable detection of these native proteins. The evaluation of collagen levels allows us to follow the extent of scarring, while the presence of elastin fibers is thought to be indicative of the level of healing of the injured fold. Using these imaging modalities, we characterize the outcome of injectable biomaterial treatments in order to direct future treatments for tissue engineering.