Cardiac imaging. A multimodality approach

International Nuclear Information System (INIS)

Thelen, Manfred; Erbel, Raimund; Kreitner, Karl-Friedrich; Barkhausen, Joerg

2009-01-01

An excellent atlas on modern diagnostic imaging of the heart Written by an interdisciplinary team of experts, Cardiac Imaging: A Multimodality Approach features an in-depth introduction to all current imaging modalities for the diagnostic assessment of the heart as well as a clinical overview of cardiac diseases and main indications for cardiac imaging. With a particular emphasis on CT and MRI, the first part of the atlas also covers conventional radiography, echocardiography, angiography and nuclear medicine imaging. Leading specialists demonstrate the latest advances in the field, and compare the strengths and weaknesses of each modality. The book's second part features clinical chapters on heart defects, endocarditis, coronary heart disease, cardiomyopathies, myocarditis, cardiac tumors, pericardial diseases, pulmonary vascular diseases, and diseases of the thoracic aorta. The authors address anatomy, pathophysiology, and clinical features, and evaluate the various diagnostic options. Key features: - Highly regarded experts in cardiology and radiology off er image-based teaching of the latest techniques - Readers learn how to decide which modality to use for which indication - Visually highlighted tables and essential points allow for easy navigation through the text - More than 600 outstanding images show up-to-date technology and current imaging protocols Cardiac Imaging: A Multimodality Approach is a must-have desk reference for cardiologists and radiologists in practice, as well as a study guide for residents in both fields. It will also appeal to cardiac surgeons, general practitioners, and medical physicists with a special interest in imaging of the heart. (orig.)

Multimodality image registration with software: state-of-the-art

Energy Technology Data Exchange (ETDEWEB)

Slomka, Piotr J. [Cedars-Sinai Medical Center, AIM Program/Department of Imaging, Los Angeles, CA (United States); University of California, David Geffen School of Medicine, Los Angeles, CA (United States); Baum, Richard P. [Center for PET, Department of Nuclear Medicine, Bad Berka (Germany)

2009-03-15

Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

Discrimination of skin diseases using the multimodal imaging approach

Science.gov (United States)

Vogler, N.; Heuke, S.; Akimov, D.; Latka, I.; Kluschke, F.; Röwert-Huber, H.-J.; Lademann, J.; Dietzek, B.; Popp, J.

2012-06-01

Optical microspectroscopic tools reveal great potential for dermatologic diagnostics in the clinical day-to-day routine. To enhance the diagnostic value of individual nonlinear optical imaging modalities such as coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG) or two-photon excited fluorescence (TPF), the approach of multimodal imaging has recently been developed. Here, we present an application of nonlinear optical multimodal imaging with Raman-scattering microscopy to study sizable human-tissue cross-sections. The samples investigated contain both healthy tissue and various skin tumors. This contribution details the rich information content, which can be obtained from the multimodal approach: While CARS microscopy, which - in contrast to spontaneous Raman-scattering microscopy - is not hampered by single-photon excited fluorescence, is used to monitor the lipid and protein distribution in the samples, SHG imaging selectively highlights the distribution of collagen structures within the tissue. This is due to the fact, that SHG is only generated in structures which lack inversion geometry. Finally, TPF reveals the distribution of autofluorophores in tissue. The combination of these techniques, i.e. multimodal imaging, allows for recording chemical images of large area samples and is - as this contribution will highlight - of high clinically diagnostic value.

Quantitative multimodality imaging in cancer research and therapy.

Science.gov (United States)

Yankeelov, Thomas E; Abramson, Richard G; Quarles, C Chad

2014-11-01

Advances in hardware and software have enabled the realization of clinically feasible, quantitative multimodality imaging of tissue pathophysiology. Earlier efforts relating to multimodality imaging of cancer have focused on the integration of anatomical and functional characteristics, such as PET-CT and single-photon emission CT (SPECT-CT), whereas more-recent advances and applications have involved the integration of multiple quantitative, functional measurements (for example, multiple PET tracers, varied MRI contrast mechanisms, and PET-MRI), thereby providing a more-comprehensive characterization of the tumour phenotype. The enormous amount of complementary quantitative data generated by such studies is beginning to offer unique insights into opportunities to optimize care for individual patients. Although important technical optimization and improved biological interpretation of multimodality imaging findings are needed, this approach can already be applied informatively in clinical trials of cancer therapeutics using existing tools. These concepts are discussed herein.

Multispectral analysis of multimodal images

Energy Technology Data Exchange (ETDEWEB)

Kvinnsland, Yngve; Brekke, Njaal (Dept. of Surgical Sciences, Univ. of Bergen, Bergen (Norway)); Taxt, Torfinn M.; Gruener, Renate (Dept. of Biomedicine, Univ. of Bergen, Bergen (Norway))

2009-02-15

An increasing number of multimodal images represent a valuable increase in available image information, but at the same time it complicates the extraction of diagnostic information across the images. Multispectral analysis (MSA) has the potential to simplify this problem substantially as unlimited number of images can be combined, and tissue properties across the images can be extracted automatically. Materials and methods. We have developed a software solution for MSA containing two algorithms for unsupervised classification, an EM-algorithm finding multinormal class descriptions and the k-means clustering algorithm, and two for supervised classification, a Bayesian classifier using multinormal class descriptions and a kNN-algorithm. The software has an efficient user interface for the creation and manipulation of class descriptions, and it has proper tools for displaying the results. Results. The software has been tested on different sets of images. One application is to segment cross-sectional images of brain tissue (T1- and T2-weighted MR images) into its main normal tissues and brain tumors. Another interesting set of images are the perfusion maps and diffusion maps, derived images from raw MR images. The software returns segmentation that seem to be sensible. Discussion. The MSA software appears to be a valuable tool for image analysis with multimodal images at hand. It readily gives a segmentation of image volumes that visually seems to be sensible. However, to really learn how to use MSA, it will be necessary to gain more insight into what tissues the different segments contain, and the upcoming work will therefore be focused on examining the tissues through for example histological sections.

Cardiac imaging. A multimodality approach

Energy Technology Data Exchange (ETDEWEB)

Thelen, Manfred [Johannes Gutenberg University Hospital, Mainz (Germany); Erbel, Raimund [University Hospital Essen (Germany). Dept. of Cardiology; Kreitner, Karl-Friedrich [Johannes Gutenberg University Hospital, Mainz (Germany). Clinic and Polyclinic for Diagnostic and Interventional Radiology; Barkhausen, Joerg (eds.) [University Hospital Schleswig-Holstein, Luebeck (Germany). Dept. of Radiology and Nuclear Medicine

2009-07-01

An excellent atlas on modern diagnostic imaging of the heart Written by an interdisciplinary team of experts, Cardiac Imaging: A Multimodality Approach features an in-depth introduction to all current imaging modalities for the diagnostic assessment of the heart as well as a clinical overview of cardiac diseases and main indications for cardiac imaging. With a particular emphasis on CT and MRI, the first part of the atlas also covers conventional radiography, echocardiography, angiography and nuclear medicine imaging. Leading specialists demonstrate the latest advances in the field, and compare the strengths and weaknesses of each modality. The book's second part features clinical chapters on heart defects, endocarditis, coronary heart disease, cardiomyopathies, myocarditis, cardiac tumors, pericardial diseases, pulmonary vascular diseases, and diseases of the thoracic aorta. The authors address anatomy, pathophysiology, and clinical features, and evaluate the various diagnostic options. Key features: - Highly regarded experts in cardiology and radiology off er image-based teaching of the latest techniques - Readers learn how to decide which modality to use for which indication - Visually highlighted tables and essential points allow for easy navigation through the text - More than 600 outstanding images show up-to-date technology and current imaging protocols Cardiac Imaging: A Multimodality Approach is a must-have desk reference for cardiologists and radiologists in practice, as well as a study guide for residents in both fields. It will also appeal to cardiac surgeons, general practitioners, and medical physicists with a special interest in imaging of the heart. (orig.)

A Multimodal Search Engine for Medical Imaging Studies.

Science.gov (United States)

Pinho, Eduardo; Godinho, Tiago; Valente, Frederico; Costa, Carlos

2017-02-01

The use of digital medical imaging systems in healthcare institutions has increased significantly, and the large amounts of data in these systems have led to the conception of powerful support tools: recent studies on content-based image retrieval (CBIR) and multimodal information retrieval in the field hold great potential in decision support, as well as for addressing multiple challenges in healthcare systems, such as computer-aided diagnosis (CAD). However, the subject is still under heavy research, and very few solutions have become part of Picture Archiving and Communication Systems (PACS) in hospitals and clinics. This paper proposes an extensible platform for multimodal medical image retrieval, integrated in an open-source PACS software with profile-based CBIR capabilities. In this article, we detail a technical approach to the problem by describing its main architecture and each sub-component, as well as the available web interfaces and the multimodal query techniques applied. Finally, we assess our implementation of the engine with computational performance benchmarks.

Enhanced EDX images by fusion of multimodal SEM images using pansharpening techniques.

Science.gov (United States)

Franchi, G; Angulo, J; Moreaud, M; Sorbier, L

2018-01-01

The goal of this paper is to explore the potential interest of image fusion in the context of multimodal scanning electron microscope (SEM) imaging. In particular, we aim at merging the backscattered electron images that usually have a high spatial resolution but do not provide enough discriminative information to physically classify the nature of the sample, with energy-dispersive X-ray spectroscopy (EDX) images that have discriminative information but a lower spatial resolution. The produced images are named enhanced EDX. To achieve this goal, we have compared the results obtained with classical pansharpening techniques for image fusion with an original approach tailored for multimodal SEM fusion of information. Quantitative assessment is obtained by means of two SEM images and a simulated dataset produced by a software based on PENELOPE. © 2017 The Authors Journal of Microscopy © 2017 Royal Microscopical Society.

Registration of deformed multimodality medical images

International Nuclear Information System (INIS)

Moshfeghi, M.; Naidich, D.

1989-01-01

The registration and combination of images from different modalities have several potential applications, such as functional and anatomic studies, 3D radiation treatment planning, surgical planning, and retrospective studies. Image registration algorithms should correct for any local deformations caused by respiration, heart beat, imaging device distortions, and so forth. This paper reports on an elastic matching technique for registering deformed multimodality images. Correspondences between contours in the two images are used to stretch the deformed image toward its goal image. This process is repeated a number of times, with decreasing image stiffness. As the iterations continue, the stretched image better approximates its goal image

Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking.

Science.gov (United States)

Yu, Jun; Yang, Xiaokang; Gao, Fei; Tao, Dacheng

2017-12-01

How do we retrieve images accurately? Also, how do we rank a group of images precisely and efficiently for specific queries? These problems are critical for researchers and engineers to generate a novel image searching engine. First, it is important to obtain an appropriate description that effectively represent the images. In this paper, multimodal features are considered for describing images. The images unique properties are reflected by visual features, which are correlated to each other. However, semantic gaps always exist between images visual features and semantics. Therefore, we utilize click feature to reduce the semantic gap. The second key issue is learning an appropriate distance metric to combine these multimodal features. This paper develops a novel deep multimodal distance metric learning (Deep-MDML) method. A structured ranking model is adopted to utilize both visual and click features in distance metric learning (DML). Specifically, images and their related ranking results are first collected to form the training set. Multimodal features, including click and visual features, are collected with these images. Next, a group of autoencoders is applied to obtain initially a distance metric in different visual spaces, and an MDML method is used to assign optimal weights for different modalities. Next, we conduct alternating optimization to train the ranking model, which is used for the ranking of new queries with click features. Compared with existing image ranking methods, the proposed method adopts a new ranking model to use multimodal features, including click features and visual features in DML. We operated experiments to analyze the proposed Deep-MDML in two benchmark data sets, and the results validate the effects of the method.

Multimodal Imaging Brain Connectivity Analysis (MIBCA toolbox

Directory of Open Access Journals (Sweden)

Andre Santos Ribeiro

2015-07-01

Full Text Available Aim. In recent years, connectivity studies using neuroimaging data have increased the understanding of the organization of large-scale structural and functional brain networks. However, data analysis is time consuming as rigorous procedures must be assured, from structuring data and pre-processing to modality specific data procedures. Until now, no single toolbox was able to perform such investigations on truly multimodal image data from beginning to end, including the combination of different connectivity analyses. Thus, we have developed the Multimodal Imaging Brain Connectivity Analysis (MIBCA toolbox with the goal of diminishing time waste in data processing and to allow an innovative and comprehensive approach to brain connectivity.Materials and Methods. The MIBCA toolbox is a fully automated all-in-one connectivity toolbox that offers pre-processing, connectivity and graph theoretical analyses of multimodal image data such as diffusion-weighted imaging, functional magnetic resonance imaging (fMRI and positron emission tomography (PET. It was developed in MATLAB environment and pipelines well-known neuroimaging softwares such as Freesurfer, SPM, FSL, and Diffusion Toolkit. It further implements routines for the construction of structural, functional and effective or combined connectivity matrices, as well as, routines for the extraction and calculation of imaging and graph-theory metrics, the latter using also functions from the Brain Connectivity Toolbox. Finally, the toolbox performs group statistical analysis and enables data visualization in the form of matrices, 3D brain graphs and connectograms. In this paper the MIBCA toolbox is presented by illustrating its capabilities using multimodal image data from a group of 35 healthy subjects (19–73 years old with volumetric T1-weighted, diffusion tensor imaging, and resting state fMRI data, and 10 subjets with 18F-Altanserin PET data also.Results. It was observed both a high inter

Improving treatment planning accuracy through multimodality imaging

International Nuclear Information System (INIS)

Sailer, Scott L.; Rosenman, Julian G.; Soltys, Mitchel; Cullip, Tim J.; Chen, Jun

1996-01-01

Purpose: In clinical practice, physicians are constantly comparing multiple images taken at various times during the patient's treatment course. One goal of such a comparison is to accurately define the gross tumor volume (GTV). The introduction of three-dimensional treatment planning has greatly enhanced the ability to define the GTV, but there are times when the GTV is not visible on the treatment-planning computed tomography (CT) scan. We have modified our treatment-planning software to allow for interactive display of multiple, registered images that enhance the physician's ability to accurately determine the GTV. Methods and Materials: Images are registered using interactive tools developed at the University of North Carolina at Chapel Hill (UNC). Automated methods are also available. Images registered with the treatment-planning CT scan are digitized from film. After a physician has approved the registration, the registered images are made available to the treatment-planning software. Structures and volumes of interest are contoured on all images. In the beam's eye view, wire loop representations of these structures can be visualized from all image types simultaneously. Each registered image can be seamlessly viewed during the treatment-planning process, and all contours from all image types can be seen on any registered image. A beam may, therefore, be designed based on any contour. Results: Nineteen patients have been planned and treated using multimodality imaging from November 1993 through August 1994. All registered images were digitized from film, and many were from outside institutions. Brain has been the most common site (12), but the techniques of registration and image display have also been used for the thorax (4), abdomen (2), and extremity (1). The registered image has been an magnetic resonance (MR) scan in 15 cases and a diagnostic CT scan in 5 cases. In one case, sequential MRs, one before treatment and another after 30 Gy, were used to plan

A multimodal image sensor system for identifying water stress in grapevines

Science.gov (United States)

Zhao, Yong; Zhang, Qin; Li, Minzan; Shao, Yongni; Zhou, Jianfeng; Sun, Hong

2012-11-01

Water stress is one of the most common limitations of fruit growth. Water is the most limiting resource for crop growth. In grapevines, as well as in other fruit crops, fruit quality benefits from a certain level of water deficit which facilitates to balance vegetative and reproductive growth and the flow of carbohydrates to reproductive structures. A multi-modal sensor system was designed to measure the reflectance signature of grape plant surfaces and identify different water stress levels in this paper. The multi-modal sensor system was equipped with one 3CCD camera (three channels in R, G, and IR). The multi-modal sensor can capture and analyze grape canopy from its reflectance features, and identify the different water stress levels. This research aims at solving the aforementioned problems. The core technology of this multi-modal sensor system could further be used as a decision support system that combines multi-modal sensory data to improve plant stress detection and identify the causes of stress. The images were taken by multi-modal sensor which could output images in spectral bands of near-infrared, green and red channel. Based on the analysis of the acquired images, color features based on color space and reflectance features based on image process method were calculated. The results showed that these parameters had the potential as water stress indicators. More experiments and analysis are needed to validate the conclusion.

MO-DE-202-03: Image-Guided Surgery and Interventions in the Advanced Multimodality Image-Guided Operating (AMIGO) Suite

Energy Technology Data Exchange (ETDEWEB)

Kapur, T. [Brigham & Women’s Hospital (United States)

2016-06-15

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

MO-DE-202-03: Image-Guided Surgery and Interventions in the Advanced Multimodality Image-Guided Operating (AMIGO) Suite

International Nuclear Information System (INIS)

Kapur, T.

2016-01-01

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

Multimodal imaging of lung cancer and its microenvironment (Conference Presentation)

Science.gov (United States)

Hariri, Lida P.; Niederst, Matthew J.; Mulvey, Hillary; Adams, David C.; Hu, Haichuan; Chico Calero, Isabel; Szabari, Margit V.; Vakoc, Benjamin J.; Hasan, Tayyaba; Bouma, Brett E.; Engelman, Jeffrey A.; Suter, Melissa J.

2016-03-01

Despite significant advances in targeted therapies for lung cancer, nearly all patients develop drug resistance within 6-12 months and prognosis remains poor. Developing drug resistance is a progressive process that involves tumor cells and their microenvironment. We hypothesize that microenvironment factors alter tumor growth and response to targeted therapy. We conducted in vitro studies in human EGFR-mutant lung carcinoma cells, and demonstrated that factors secreted from lung fibroblasts results in increased tumor cell survival during targeted therapy with EGFR inhibitor, gefitinib. We also demonstrated that increased environment stiffness results in increased tumor survival during gefitinib therapy. In order to test our hypothesis in vivo, we developed a multimodal optical imaging protocol for preclinical intravital imaging in mouse models to assess tumor and its microenvironment over time. We have successfully conducted multimodal imaging of dorsal skinfold chamber (DSC) window mice implanted with GFP-labeled human EGFR mutant lung carcinoma cells and visualized changes in tumor development and microenvironment facets over time. Multimodal imaging included structural OCT to assess tumor viability and necrosis, polarization-sensitive OCT to measure tissue birefringence for collagen/fibroblast detection, and Doppler OCT to assess tumor vasculature. Confocal imaging was also performed for high-resolution visualization of EGFR-mutant lung cancer cells labeled with GFP, and was coregistered with OCT. Our results demonstrated that stromal support and vascular growth are essential to tumor progression. Multimodal imaging is a useful tool to assess tumor and its microenvironment over time.

Feature-based Alignment of Volumetric Multi-modal Images

Science.gov (United States)

Toews, Matthew; Zöllei, Lilla; Wells, William M.

2014-01-01

This paper proposes a method for aligning image volumes acquired from different imaging modalities (e.g. MR, CT) based on 3D scale-invariant image features. A novel method for encoding invariant feature geometry and appearance is developed, based on the assumption of locally linear intensity relationships, providing a solution to poor repeatability of feature detection in different image modalities. The encoding method is incorporated into a probabilistic feature-based model for multi-modal image alignment. The model parameters are estimated via a group-wise alignment algorithm, that iteratively alternates between estimating a feature-based model from feature data, then realigning feature data to the model, converging to a stable alignment solution with few pre-processing or pre-alignment requirements. The resulting model can be used to align multi-modal image data with the benefits of invariant feature correspondence: globally optimal solutions, high efficiency and low memory usage. The method is tested on the difficult RIRE data set of CT, T1, T2, PD and MP-RAGE brain images of subjects exhibiting significant inter-subject variability due to pathology. PMID:24683955

Multimodal imaging in health, disease, and man-made disasters

International Nuclear Information System (INIS)

Papineni, Rao V.L.

2012-01-01

Significant advances in the fields of molecular and functional imaging are rapidly emerging as potential advance research tools in health, Disease and drug discovery. Notable are the approaches utilizing multi-modal imaging strategies in preclinical studies that are becoming extremely useful in assessing the efficacy of the novel target molecules. This talk will focus on our efforts in bringing the multimodality to preclinical research with Optical, X-ray, and noninvasive nuclear imaging. The concepts and methods in molecular imaging to support drug targeting and drug discovery will be discussed along with a focus on its utilization in radiation induced changes in the bone physiology. Also, will discuss how such approaches can be employed in future as a biodosimetry for radiation disasters or in radiation threat. (author)

Multimodal Imaging of Human Brain Activity: Rational, Biophysical Aspects and Modes of Integration

Science.gov (United States)

Blinowska, Katarzyna; Müller-Putz, Gernot; Kaiser, Vera; Astolfi, Laura; Vanderperren, Katrien; Van Huffel, Sabine; Lemieux, Louis

2009-01-01

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship. PMID:19547657

NaGdF4:Nd3+/Yb3+ Nanoparticles as Multimodal Imaging Agents

Science.gov (United States)

Pedraza, Francisco; Rightsell, Chris; Kumar, Ga; Giuliani, Jason; Monton, Car; Sardar, Dhiraj

Medical imaging is a fundamental tool used for the diagnosis of numerous ailments. Each imaging modality has unique advantages; however, they possess intrinsic limitations. Some of which include low spatial resolution, sensitivity, penetration depth, and radiation damage. To circumvent this problem, the combination of imaging modalities, or multimodal imaging, has been proposed, such as Near Infrared Fluorescence imaging (NIRF) and Magnetic Resonance Imaging (MRI). Combining individual advantages, specificity and selectivity of NIRF with the deep penetration and high spatial resolution of MRI, it is possible to circumvent their shortcomings for a more robust imaging technique. In addition, both imaging modalities are very safe and minimally invasive. Fluorescent nanoparticles, such as NaGdF4:Nd3 +/Yb3 +, are excellent candidates for NIRF/MRI multimodal imaging. The dopants, Nd and Yb, absorb and emit within the biological window; where near infrared light is less attenuated by soft tissue. This results in less tissue damage and deeper tissue penetration making it a viable candidate in biological imaging. In addition, the inclusion of Gd results in paramagnetic properties, allowing their use as contrast agents in multimodal imaging. The work presented will include crystallographic results, as well as full optical and magnetic characterization to determine the nanoparticle's viability in multimodal imaging.

A spinal cord window chamber model for in vivo longitudinal multimodal optical and acoustic imaging in a murine model.

Directory of Open Access Journals (Sweden)

Sarah A Figley

Full Text Available In vivo and direct imaging of the murine spinal cord and its vasculature using multimodal (optical and acoustic imaging techniques could significantly advance preclinical studies of the spinal cord. Such intrinsically high resolution and complementary imaging technologies could provide a powerful means of quantitatively monitoring changes in anatomy, structure, physiology and function of the living cord over time after traumatic injury, onset of disease, or therapeutic intervention. However, longitudinal in vivo imaging of the intact spinal cord in rodent models has been challenging, requiring repeated surgeries to expose the cord for imaging or sacrifice of animals at various time points for ex vivo tissue analysis. To address these limitations, we have developed an implantable spinal cord window chamber (SCWC device and procedures in mice for repeated multimodal intravital microscopic imaging of the cord and its vasculature in situ. We present methodology for using our SCWC to achieve spatially co-registered optical-acoustic imaging performed serially for up to four weeks, without damaging the cord or induction of locomotor deficits in implanted animals. To demonstrate the feasibility, we used the SCWC model to study the response of the normal spinal cord vasculature to ionizing radiation over time using white light and fluorescence microscopy combined with optical coherence tomography (OCT in vivo. In vivo power Doppler ultrasound and photoacoustics were used to directly visualize the cord and vascular structures and to measure hemoglobin oxygen saturation through the complete spinal cord, respectively. The model was also used for intravital imaging of spinal micrometastases resulting from primary brain tumor using fluorescence and bioluminescence imaging. Our SCWC model overcomes previous in vivo imaging challenges, and our data provide evidence of the broader utility of hybridized optical-acoustic imaging methods for obtaining

Multimodality image analysis work station

International Nuclear Information System (INIS)

Ratib, O.; Huang, H.K.

1989-01-01

The goal of this project is to design and implement a PACS (picture archiving and communication system) workstation for quantitative analysis of multimodality images. The Macintosh II personal computer was selected for its friendly user interface, its popularity among the academic and medical community, and its low cost. The Macintosh operates as a stand alone workstation where images are imported from a central PACS server through a standard Ethernet network and saved on a local magnetic or optical disk. A video digitizer board allows for direct acquisition of images from sonograms or from digitized cine angiograms. The authors have focused their project on the exploration of new means of communicating quantitative data and information through the use of an interactive and symbolic user interface. The software developed includes a variety of image analysis, algorithms for digitized angiograms, sonograms, scintigraphic images, MR images, and CT scans

Multimodality optical coherence tomography and fluorescence confocal scanning laser ophthalmoscopy for image-guided feedback of intraocular injections in mouse models

Science.gov (United States)

Benavides, Oscar R.; Terrones, Benjamin D.; Leeburg, Kelsey C.; Mehanathan, Sankarathi B.; Levine, Edward M.; Tao, Yuankai K.

2018-02-01

Rodent models are robust tools for understanding human retinal disease and function because of their similarities with human physiology and anatomy and availability of genetic mutants. Optical coherence tomography (OCT) has been well-established for ophthalmic imaging in rodents and enables depth-resolved visualization of structures and image-based surrogate biomarkers of disease. Similarly, fluorescence confocal scanning laser ophthalmoscopy (cSLO) has demonstrated utility for imaging endogenous and exogenous fluorescence and scattering contrast in the mouse retina. Complementary volumetric scattering and en face fluorescence contrast from OCT and cSLO, respectively, enables cellular-resolution longitudinal imaging of changes in ophthalmic structure and function. We present a non-contact multimodal OCT+cSLO small animal imaging system with extended working distance to the pupil, which enables imaging during and after intraocular injection. While injections are routinely performed in mice to develop novel models of ophthalmic diseases and screen novel therapeutics, the location and volume delivered is not precisely controlled and difficult to reproduce. Animals were imaged using a custom-built OCT engine and scan-head combined with a modified commercial cSLO scan-head. Post-injection imaging showed structural changes associated with retinal puncture, including the injection track, a retinal elevation, and detachment of the posterior hyaloid. When combined with imagesegmentation, we believe OCT can be used to precisely identify injection locations and quantify injection volumes. Fluorescence cSLO can provide complementary contrast for either fluorescently labeled compounds or transgenic cells for improved specificity. Our non-contact OCT+cSLO system is uniquely-suited for concurrent imaging with intraocular injections, which may be used for real-time image-guided injections.

FWFusion: Fuzzy Whale Fusion model for MRI multimodal image ...

Indian Academy of Sciences (India)

Hanmant Venketrao Patil

2018-03-14

Mar 14, 2018 ... consider multi-modality medical images other than PET and MRI images. ... cipal component averaging based on DWT for fusing CT-. MRI and MRI ..... sub-band LH of the fused image, the distance measure is given based on the ...... sustainable integrated dynamic ship routing and scheduling optimization.

Recommendations on nuclear and multimodality imaging in IE and CIED infections.

Science.gov (United States)

Erba, Paola Anna; Lancellotti, Patrizio; Vilacosta, Isidre; Gaemperli, Oliver; Rouzet, Francois; Hacker, Marcus; Signore, Alberto; Slart, Riemer H J A; Habib, Gilbert

2018-05-24

In the latest update of the European Society of Cardiology (ESC) guidelines for the management of infective endocarditis (IE), imaging is positioned at the centre of the diagnostic work-up so that an early and accurate diagnosis can be reached. Besides echocardiography, contrast-enhanced CT (ce-CT), radiolabelled leucocyte (white blood cell, WBC) SPECT/CT and [ 18 F]FDG PET/CT are included as diagnostic tools in the diagnostic flow chart for IE. Following the clinical guidelines that provided a straightforward message on the role of multimodality imaging, we believe that it is highly relevant to produce specific recommendations on nuclear multimodality imaging in IE and cardiac implantable electronic device infections. In these procedural recommendations we therefore describe in detail the technical and practical aspects of WBC SPECT/CT and [ 18 F]FDG PET/CT, including ce-CT acquisition protocols. We also discuss the advantages and limitations of each procedure, specific pitfalls when interpreting images, and the most important results from the literature, and also provide recommendations on the appropriate use of multimodality imaging.

Multimodal interaction in image and video applications

CERN Document Server

Sappa, Angel D

2013-01-01

Traditional Pattern Recognition (PR) and Computer Vision (CV) technologies have mainly focused on full automation, even though full automation often proves elusive or unnatural in many applications, where the technology is expected to assist rather than replace the human agents. However, not all the problems can be automatically solved being the human interaction the only way to tackle those applications. Recently, multimodal human interaction has become an important field of increasing interest in the research community. Advanced man-machine interfaces with high cognitive capabilities are a hot research topic that aims at solving challenging problems in image and video applications. Actually, the idea of computer interactive systems was already proposed on the early stages of computer science. Nowadays, the ubiquity of image sensors together with the ever-increasing computing performance has open new and challenging opportunities for research in multimodal human interaction. This book aims to show how existi...

Superparamagnetic nanoparticles for enhanced magnetic resonance and multimodal imaging

Science.gov (United States)

Sikma, Elise Ann Schultz

Magnetic resonance imaging (MRI) is a powerful tool for noninvasive tomographic imaging of biological systems with high spatial and temporal resolution. Superparamagnetic (SPM) nanoparticles have emerged as highly effective MR contrast agents due to their biocompatibility, ease of surface modification and magnetic properties. Conventional nanoparticle contrast agents suffer from difficult synthetic reproducibility, polydisperse sizes and weak magnetism. Numerous synthetic techniques and nanoparticle formulations have been developed to overcome these barriers. However, there are still major limitations in the development of new nanoparticle-based probes for MR and multimodal imaging including low signal amplification and absence of biochemical reporters. To address these issues, a set of multimodal (T2/optical) and dual contrast (T1/T2) nanoparticle probes has been developed. Their unique magnetic properties and imaging capabilities were thoroughly explored. An enzyme-activatable contrast agent is currently being developed as an innovative means for early in vivo detection of cancer at the cellular level. Multimodal probes function by combining the strengths of multiple imaging techniques into a single agent. Co-registration of data obtained by multiple imaging modalities validates the data, enhancing its quality and reliability. A series of T2/optical probes were successfully synthesized by attachment of a fluorescent dye to the surface of different types of nanoparticles. The multimodal nanoparticles generated sufficient MR and fluorescence signal to image transplanted islets in vivo. Dual contrast T1/T2 imaging probes were designed to overcome disadvantages inherent in the individual T1 and T2 components. A class of T1/T2 agents was developed consisting of a gadolinium (III) complex (DTPA chelate or DO3A macrocycle) conjugated to a biocompatible silica-coated metal oxide nanoparticle through a disulfide linker. The disulfide linker has the ability to be reduced

Image recovery from defocused 2D fluorescent images in multimodal digital holographic microscopy.

Science.gov (United States)

Quan, Xiangyu; Matoba, Osamu; Awatsuji, Yasuhiro

2017-05-01

A technique of three-dimensional (3D) intensity retrieval from defocused, two-dimensional (2D) fluorescent images in the multimodal digital holographic microscopy (DHM) is proposed. In the multimodal DHM, 3D phase and 2D fluorescence distributions are obtained simultaneously by an integrated system of an off-axis DHM and a conventional epifluorescence microscopy, respectively. This gives us more information of the target; however, defocused fluorescent images are observed due to the short depth of field. In this Letter, we propose a method to recover the defocused images based on the phase compensation and backpropagation from the defocused plane to the focused plane using the distance information that is obtained from a 3D phase distribution. By applying Zernike polynomial phase correction, we brought back the fluorescence intensity to the focused imaging planes. The experimental demonstration using fluorescent beads is presented, and the expected applications are suggested.

Tumor image signatures and habitats: a processing pipeline of multimodality metabolic and physiological images.

Science.gov (United States)

You, Daekeun; Kim, Michelle M; Aryal, Madhava P; Parmar, Hemant; Piert, Morand; Lawrence, Theodore S; Cao, Yue

2018-01-01

To create tumor "habitats" from the "signatures" discovered from multimodality metabolic and physiological images, we developed a framework of a processing pipeline. The processing pipeline consists of six major steps: (1) creating superpixels as a spatial unit in a tumor volume; (2) forming a data matrix [Formula: see text] containing all multimodality image parameters at superpixels; (3) forming and clustering a covariance or correlation matrix [Formula: see text] of the image parameters to discover major image "signatures;" (4) clustering the superpixels and organizing the parameter order of the [Formula: see text] matrix according to the one found in step 3; (5) creating "habitats" in the image space from the superpixels associated with the "signatures;" and (6) pooling and clustering a matrix consisting of correlation coefficients of each pair of image parameters from all patients to discover subgroup patterns of the tumors. The pipeline was applied to a dataset of multimodality images in glioblastoma (GBM) first, which consisted of 10 image parameters. Three major image "signatures" were identified. The three major "habitats" plus their overlaps were created. To test generalizability of the processing pipeline, a second image dataset from GBM, acquired on the scanners different from the first one, was processed. Also, to demonstrate the clinical association of image-defined "signatures" and "habitats," the patterns of recurrence of the patients were analyzed together with image parameters acquired prechemoradiation therapy. An association of the recurrence patterns with image-defined "signatures" and "habitats" was revealed. These image-defined "signatures" and "habitats" can be used to guide stereotactic tissue biopsy for genetic and mutation status analysis and to analyze for prediction of treatment outcomes, e.g., patterns of failure.

Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain

Directory of Open Access Journals (Sweden)

Yong Yang

2014-01-01

Full Text Available Multimodal medical image fusion is a powerful tool in clinical applications such as noninvasive diagnosis, image-guided radiotherapy, and treatment planning. In this paper, a novel nonsubsampled Contourlet transform (NSCT based method for multimodal medical image fusion is presented, which is approximately shift invariant and can effectively suppress the pseudo-Gibbs phenomena. The source medical images are initially transformed by NSCT followed by fusing low- and high-frequency components. The phase congruency that can provide a contrast and brightness-invariant representation is applied to fuse low-frequency coefficients, whereas the Log-Gabor energy that can efficiently determine the frequency coefficients from the clear and detail parts is employed to fuse the high-frequency coefficients. The proposed fusion method has been compared with the discrete wavelet transform (DWT, the fast discrete curvelet transform (FDCT, and the dual tree complex wavelet transform (DTCWT based image fusion methods and other NSCT-based methods. Visually and quantitatively experimental results indicate that the proposed fusion method can obtain more effective and accurate fusion results of multimodal medical images than other algorithms. Further, the applicability of the proposed method has been testified by carrying out a clinical example on a woman affected with recurrent tumor images.

Gadolinium oxysulfide nanoprobes with both persistent luminescent and magnetic properties for multimodal imaging

OpenAIRE

ROSTICHER , C.; Viana , Bruno; Fortin , M.-A.; Lagueux , J.; Faucher , L.; Chanéac , Corinne

2016-01-01

International audience; Persistent luminescence and magnetic properties of Gd2O2S: Eu 3+ , Ti 4+ , Mg 2+ nanoparticles have been studied to attest the relevance of such nanoparticles as nanoprobes for multimodal imaging. The development of new imaging tools is required to improve the quality of medical images and then to diagnose some disorders as quickly as possible in order to ensure more effective treatment. Multimodal imaging agents here developed combine the high resolution abilities of ...

Multimodal nanoparticle imaging agents: design and applications

Science.gov (United States)

Burke, Benjamin P.; Cawthorne, Christopher; Archibald, Stephen J.

2017-10-01

Molecular imaging, where the location of molecules or nanoscale constructs can be tracked in the body to report on disease or biochemical processes, is rapidly expanding to include combined modality or multimodal imaging. No single imaging technique can offer the optimum combination of properties (e.g. resolution, sensitivity, cost, availability). The rapid technological advances in hardware to scan patients, and software to process and fuse images, are pushing the boundaries of novel medical imaging approaches, and hand-in-hand with this is the requirement for advanced and specific multimodal imaging agents. These agents can be detected using a selection from radioisotope, magnetic resonance and optical imaging, among others. Nanoparticles offer great scope in this area as they lend themselves, via facile modification procedures, to act as multifunctional constructs. They have relevance as therapeutics and drug delivery agents that can be tracked by molecular imaging techniques with the particular development of applications in optically guided surgery and as radiosensitizers. There has been a huge amount of research work to produce nanoconstructs for imaging, and the parameters for successful clinical translation and validation of therapeutic applications are now becoming much better understood. It is an exciting time of progress for these agents as their potential is closer to being realized with translation into the clinic. The coming 5-10 years will be critical, as we will see if the predicted improvement in clinical outcomes becomes a reality. Some of the latest advances in combination modality agents are selected and the progression pathway to clinical trials analysed. This article is part of the themed issue 'Challenges for chemistry in molecular imaging'.

Multimodal Imaging Nanoparticles Derived from Hyaluronic Acid for Integrated Preoperative and Intraoperative Cancer Imaging

Directory of Open Access Journals (Sweden)

William M. Payne

2017-01-01

Full Text Available Surgical resection remains the most promising treatment strategy for many types of cancer. Residual malignant tissue after surgery, a consequence in part due to positive margins, contributes to high mortality and disease recurrence. In this study, multimodal contrast agents for integrated preoperative magnetic resonance imaging (MRI and intraoperative fluorescence image-guided surgery (FIGS are developed. Self-assembled multimodal imaging nanoparticles (SAMINs were developed as a mixed micelle formulation using amphiphilic HA polymers functionalized with either GdDTPA for T1 contrast-enhanced MRI or Cy7.5, a near infrared fluorophore. To evaluate the relationship between MR and fluorescence signal from SAMINs, we employed simulated surgical phantoms that are routinely used to evaluate the depth at which near infrared (NIR imaging agents can be detected by FIGS. Finally, imaging agent efficacy was evaluated in a human breast tumor xenograft model in nude mice, which demonstrated contrast in both fluorescence and magnetic resonance imaging.

MO-DE-202-04: Multimodality Image-Guided Surgery and Intervention: For the Rest of Us

Energy Technology Data Exchange (ETDEWEB)

Shekhar, R. [Children’s National Health System (United States)

2016-06-15

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

MO-DE-202-04: Multimodality Image-Guided Surgery and Intervention: For the Rest of Us

International Nuclear Information System (INIS)

Shekhar, R.

2016-01-01

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

Magnetic Iron Oxide Nanoparticles for Multimodal Imaging and Therapy of Cancer

Directory of Open Access Journals (Sweden)

In-Kyu Park

2013-07-01

Full Text Available Superparamagnetic iron oxide nanoparticles (SPION have emerged as an MRI contrast agent for tumor imaging due to their efficacy and safety. Their utility has been proven in clinical applications with a series of marketed SPION-based contrast agents. Extensive research has been performed to study various strategies that could improve SPION by tailoring the surface chemistry and by applying additional therapeutic functionality. Research into the dual-modal contrast uses of SPION has developed because these applications can save time and effort by reducing the number of imaging sessions. In addition to multimodal strategies, efforts have been made to develop multifunctional nanoparticles that carry both diagnostic and therapeutic cargos specifically for cancer. This review provides an overview of recent advances in multimodality imaging agents and focuses on iron oxide based nanoparticles and their theranostic applications for cancer. Furthermore, we discuss the physiochemical properties and compare different synthesis methods of SPION for the development of multimodal contrast agents.

Exogenous Molecular Probes for Targeted Imaging in Cancer: Focus on Multi-modal Imaging

International Nuclear Information System (INIS)

Joshi, Bishnu P.; Wang, Thomas D.

2010-01-01

Cancer is one of the major causes of mortality and morbidity in our healthcare system. Molecular imaging is an emerging methodology for the early detection of cancer, guidance of therapy, and monitoring of response. The development of new instruments and exogenous molecular probes that can be labeled for multi-modality imaging is critical to this process. Today, molecular imaging is at a crossroad, and new targeted imaging agents are expected to broadly expand our ability to detect and manage cancer. This integrated imaging strategy will permit clinicians to not only localize lesions within the body but also to manage their therapy by visualizing the expression and activity of specific molecules. This information is expected to have a major impact on drug development and understanding of basic cancer biology. At this time, a number of molecular probes have been developed by conjugating various labels to affinity ligands for targeting in different imaging modalities. This review will describe the current status of exogenous molecular probes for optical, scintigraphic, MRI and ultrasound imaging platforms. Furthermore, we will also shed light on how these techniques can be used synergistically in multi-modal platforms and how these techniques are being employed in current research

Multimodal targeted high relaxivity thermosensitive liposome for in vivo imaging

Science.gov (United States)

Kuijten, Maayke M. P.; Hannah Degeling, M.; Chen, John W.; Wojtkiewicz, Gregory; Waterman, Peter; Weissleder, Ralph; Azzi, Jamil; Nicolay, Klaas; Tannous, Bakhos A.

2015-11-01

Liposomes are spherical, self-closed structures formed by lipid bilayers that can encapsulate drugs and/or imaging agents in their hydrophilic core or within their membrane moiety, making them suitable delivery vehicles. We have synthesized a new liposome containing gadolinium-DOTA lipid bilayer, as a targeting multimodal molecular imaging agent for magnetic resonance and optical imaging. We showed that this liposome has a much higher molar relaxivities r1 and r2 compared to a more conventional liposome containing gadolinium-DTPA-BSA lipid. By incorporating both gadolinium and rhodamine in the lipid bilayer as well as biotin on its surface, we used this agent for multimodal imaging and targeting of tumors through the strong biotin-streptavidin interaction. Since this new liposome is thermosensitive, it can be used for ultrasound-mediated drug delivery at specific sites, such as tumors, and can be guided by magnetic resonance imaging.

Multi-Modal Curriculum Learning for Semi-Supervised Image Classification.

Science.gov (United States)

Gong, Chen; Tao, Dacheng; Maybank, Stephen J; Liu, Wei; Kang, Guoliang; Yang, Jie

2016-07-01

Semi-supervised image classification aims to classify a large quantity of unlabeled images by typically harnessing scarce labeled images. Existing semi-supervised methods often suffer from inadequate classification accuracy when encountering difficult yet critical images, such as outliers, because they treat all unlabeled images equally and conduct classifications in an imperfectly ordered sequence. In this paper, we employ the curriculum learning methodology by investigating the difficulty of classifying every unlabeled image. The reliability and the discriminability of these unlabeled images are particularly investigated for evaluating their difficulty. As a result, an optimized image sequence is generated during the iterative propagations, and the unlabeled images are logically classified from simple to difficult. Furthermore, since images are usually characterized by multiple visual feature descriptors, we associate each kind of features with a teacher, and design a multi-modal curriculum learning (MMCL) strategy to integrate the information from different feature modalities. In each propagation, each teacher analyzes the difficulties of the currently unlabeled images from its own modality viewpoint. A consensus is subsequently reached among all the teachers, determining the currently simplest images (i.e., a curriculum), which are to be reliably classified by the multi-modal learner. This well-organized propagation process leveraging multiple teachers and one learner enables our MMCL to outperform five state-of-the-art methods on eight popular image data sets.

Application of Multimodality Imaging Fusion Technology in Diagnosis and Treatment of Malignant Tumors under the Precision Medicine Plan.

Science.gov (United States)

Wang, Shun-Yi; Chen, Xian-Xia; Li, Yi; Zhang, Yu-Ying

2016-12-20

The arrival of precision medicine plan brings new opportunities and challenges for patients undergoing precision diagnosis and treatment of malignant tumors. With the development of medical imaging, information on different modality imaging can be integrated and comprehensively analyzed by imaging fusion system. This review aimed to update the application of multimodality imaging fusion technology in the precise diagnosis and treatment of malignant tumors under the precision medicine plan. We introduced several multimodality imaging fusion technologies and their application to the diagnosis and treatment of malignant tumors in clinical practice. The data cited in this review were obtained mainly from the PubMed database from 1996 to 2016, using the keywords of "precision medicine", "fusion imaging", "multimodality", and "tumor diagnosis and treatment". Original articles, clinical practice, reviews, and other relevant literatures published in English were reviewed. Papers focusing on precision medicine, fusion imaging, multimodality, and tumor diagnosis and treatment were selected. Duplicated papers were excluded. Multimodality imaging fusion technology plays an important role in tumor diagnosis and treatment under the precision medicine plan, such as accurate location, qualitative diagnosis, tumor staging, treatment plan design, and real-time intraoperative monitoring. Multimodality imaging fusion systems could provide more imaging information of tumors from different dimensions and angles, thereby offing strong technical support for the implementation of precision oncology. Under the precision medicine plan, personalized treatment of tumors is a distinct possibility. We believe that multimodality imaging fusion technology will find an increasingly wide application in clinical practice.

Multimodality Imaging of Heart Valve Disease

International Nuclear Information System (INIS)

Rajani, Ronak; Khattar, Rajdeep; Chiribiri, Amedeo; Victor, Kelly; Chambers, John

2014-01-01

Unidentified heart valve disease is associated with a significant morbidity and mortality. It has therefore become important to accurately identify, assess and monitor patients with this condition in order that appropriate and timely intervention can occur. Although echocardiography has emerged as the predominant imaging modality for this purpose, recent advances in cardiac magnetic resonance and cardiac computed tomography indicate that they may have an important contribution to make. The current review describes the assessment of regurgitant and stenotic heart valves by multimodality imaging (echocardiography, cardiac computed tomography and cardiac magnetic resonance) and discusses their relative strengths and weaknesses

Multimodality Imaging of Heart Valve Disease

Energy Technology Data Exchange (ETDEWEB)

Rajani, Ronak, E-mail: Dr.R.Rajani@gmail.com [Department of Cardiology, St. Thomas’ Hospital, London (United Kingdom); Khattar, Rajdeep [Department of Cardiology, Royal Brompton Hospital, London (United Kingdom); Chiribiri, Amedeo [Divisions of Imaging Sciences, The Rayne Institute, St. Thomas' Hospital, London (United Kingdom); Victor, Kelly; Chambers, John [Department of Cardiology, St. Thomas’ Hospital, London (United Kingdom)

2014-09-15

Unidentified heart valve disease is associated with a significant morbidity and mortality. It has therefore become important to accurately identify, assess and monitor patients with this condition in order that appropriate and timely intervention can occur. Although echocardiography has emerged as the predominant imaging modality for this purpose, recent advances in cardiac magnetic resonance and cardiac computed tomography indicate that they may have an important contribution to make. The current review describes the assessment of regurgitant and stenotic heart valves by multimodality imaging (echocardiography, cardiac computed tomography and cardiac magnetic resonance) and discusses their relative strengths and weaknesses.

Image-based in vivo assessment of targeting accuracy of stereotactic brain surgery in experimental rodent models

Science.gov (United States)

Rangarajan, Janaki Raman; Vande Velde, Greetje; van Gent, Friso; de Vloo, Philippe; Dresselaers, Tom; Depypere, Maarten; van Kuyck, Kris; Nuttin, Bart; Himmelreich, Uwe; Maes, Frederik

2016-11-01

Stereotactic neurosurgery is used in pre-clinical research of neurological and psychiatric disorders in experimental rat and mouse models to engraft a needle or electrode at a pre-defined location in the brain. However, inaccurate targeting may confound the results of such experiments. In contrast to the clinical practice, inaccurate targeting in rodents remains usually unnoticed until assessed by ex vivo end-point histology. We here propose a workflow for in vivo assessment of stereotactic targeting accuracy in small animal studies based on multi-modal post-operative imaging. The surgical trajectory in each individual animal is reconstructed in 3D from the physical implant imaged in post-operative CT and/or its trace as visible in post-operative MRI. By co-registering post-operative images of individual animals to a common stereotaxic template, targeting accuracy is quantified. Two commonly used neuromodulation regions were used as targets. Target localization errors showed not only variability, but also inaccuracy in targeting. Only about 30% of electrodes were within the subnucleus structure that was targeted and a-specific adverse effects were also noted. Shifting from invasive/subjective 2D histology towards objective in vivo 3D imaging-based assessment of targeting accuracy may benefit a more effective use of the experimental data by excluding off-target cases early in the study.

Imaging arterial cells, atherosclerosis, and restenosis by multimodal nonlinear optical microscopy

Science.gov (United States)

Wang, Han-Wei; Simianu, Vlad; Locker, Matthew J.; Sturek, Michael; Cheng, Ji-Xin

2008-02-01

By integrating sum-frequency generation (SFG), and two-photon excitation fluorescence (TPEF) on a coherent anti-Stokes Raman scattering (CARS) microscope platform, multimodal nonlinear optical (NLO) imaging of arteries and atherosclerotic lesions was demonstrated. CARS signals arising from CH II-rich membranes allowed visualization of endothelial cells and smooth muscle cells in a carotid artery. Additionally, CARS microscopy allowed vibrational imaging of elastin and collagen fibrils which are rich in CH II bonds in their cross-linking residues. The extracellular matrix organization was further confirmed by TPEF signals arising from elastin's autofluorescence and SFG signals arising from collagen fibrils' non-centrosymmetric structure. The system is capable of identifying different atherosclerotic lesion stages with sub-cellular resolution. The stages of atherosclerosis, such as macrophage infiltration, lipid-laden foam cell accumulation, extracellular lipid distribution, fibrous tissue deposition, plaque establishment, and formation of other complicated lesions could be viewed by our multimodal CARS microscope. Collagen percentages in the region adjacent to coronary artery stents were resolved. High correlation between NLO and histology imaging evidenced the validity of the NLO imaging. The capability of imaging significant components of an arterial wall and distinctive stages of atherosclerosis in a label-free manner suggests the potential application of multimodal nonlinear optical microscopy to monitor the onset and progression of arterial diseases.

A Novel Technique for Prealignment in Multimodality Medical Image Registration

Directory of Open Access Journals (Sweden)

Wu Zhou

2014-01-01

Full Text Available Image pair is often aligned initially based on a rigid or affine transformation before a deformable registration method is applied in medical image registration. Inappropriate initial registration may compromise the registration speed or impede the convergence of the optimization algorithm. In this work, a novel technique was proposed for prealignment in both monomodality and multimodality image registration based on statistical correlation of gradient information. A simple and robust algorithm was proposed to determine the rotational differences between two images based on orientation histogram matching accumulated from local orientation of each pixel without any feature extraction. Experimental results showed that it was effective to acquire the orientation angle between two unregistered images with advantages over the existed method based on edge-map in multimodalities. Applying the orientation detection into the registration of CT/MR, T1/T2 MRI, and monomadality images with respect to rigid and nonrigid deformation improved the chances of finding the global optimization of the registration and reduced the search space of optimization.

In vivo microCT imaging of rodent cerebral vasculature

International Nuclear Information System (INIS)

Seo, Youngho; Hasegawa, Bruce H; Hashimoto, Tomoki; Nuki, Yoshitsugu

2008-01-01

Computed tomography (CT) remains a critical diagnostic tool for evaluating patients with cerebrovascular disease, and the advent of specialized systems for imaging rodents has extended these techniques to small animal models of these diseases. We therefore have evaluated in vivo methods of imaging rat models of hemorrhagic stroke using a high resolution compact computed tomography ('microCT') system (FLEX(tm) X-O(tm), Gamma Medica-Ideas, Northridge, CA). For all in vivo studies, the head of the anesthetized rat was secured in a custom immobilization device for microCT imaging with 512 projections over 2 min at 60 kVp and 0.530 mA (I tube x t/rotation = 63.6 mAs). First, imaging without iodinated contrast was performed (a) to differentiate the effect of contrast agent in contrast-enhanced CT and (b) to examine the effectiveness of the immobilization device between two time points of CT acquisitions. Then, contrast-enhanced CT was performed with continuous administration of iopromide (300 mgI ml -1 at 1.2 ml min -1 ) to visualize aneurysms and other vascular formations in the carotid and cerebral arteries that may precede subarachnoid hemorrhage. The accuracy of registration between the noncontrast and contrast-enhanced CT images with the immobilization device was compared against the images aligned with normalized mutual information using FMRIB's linear image registration tool (FLIRT). Translations and rotations were examined between the FLIRT-aligned noncontrast CT image and the nonaligned noncontrast CT image. These two data sets demonstrated translational and rotational differences of less than 0.5 voxel (∼85 μm) and 0.5 deg., respectively. Noncontrast CT demonstrated a very small volume (0.1 ml) of femoral arterial blood introduced surgically into the rodent brain. Continuous administration of iopromide during the CT acquisition produced consistent vascular contrast in the reconstructed CT images. As a result, carotid arteries and major cerebral blood vessels

In vivo microCT imaging of rodent cerebral vasculature

Energy Technology Data Exchange (ETDEWEB)

Seo, Youngho; Hasegawa, Bruce H [Center for Molecular and Functional Imaging, Department of Radiology, University of California, San Francisco, CA 94143 (United States); Hashimoto, Tomoki; Nuki, Yoshitsugu [Center for Cerebrovascular Research, Department of Anesthesia and Perioperative Care, University of California, San Francisco, CA 94143 (United States)], E-mail: youngho.seo@radiology.ucsf.edu

2008-04-07

Computed tomography (CT) remains a critical diagnostic tool for evaluating patients with cerebrovascular disease, and the advent of specialized systems for imaging rodents has extended these techniques to small animal models of these diseases. We therefore have evaluated in vivo methods of imaging rat models of hemorrhagic stroke using a high resolution compact computed tomography ('microCT') system (FLEX(tm) X-O(tm), Gamma Medica-Ideas, Northridge, CA). For all in vivo studies, the head of the anesthetized rat was secured in a custom immobilization device for microCT imaging with 512 projections over 2 min at 60 kVp and 0.530 mA (I{sub tube} x t/rotation = 63.6 mAs). First, imaging without iodinated contrast was performed (a) to differentiate the effect of contrast agent in contrast-enhanced CT and (b) to examine the effectiveness of the immobilization device between two time points of CT acquisitions. Then, contrast-enhanced CT was performed with continuous administration of iopromide (300 mgI ml{sup -1} at 1.2 ml min{sup -1}) to visualize aneurysms and other vascular formations in the carotid and cerebral arteries that may precede subarachnoid hemorrhage. The accuracy of registration between the noncontrast and contrast-enhanced CT images with the immobilization device was compared against the images aligned with normalized mutual information using FMRIB's linear image registration tool (FLIRT). Translations and rotations were examined between the FLIRT-aligned noncontrast CT image and the nonaligned noncontrast CT image. These two data sets demonstrated translational and rotational differences of less than 0.5 voxel ({approx}85 {mu}m) and 0.5 deg., respectively. Noncontrast CT demonstrated a very small volume (0.1 ml) of femoral arterial blood introduced surgically into the rodent brain. Continuous administration of iopromide during the CT acquisition produced consistent vascular contrast in the reconstructed CT images. As a result, carotid

Stereoscopic Integrated Imaging Goggles for Multimodal Intraoperative Image Guidance.

Directory of Open Access Journals (Sweden)

Christopher A Mela

Full Text Available We have developed novel stereoscopic wearable multimodal intraoperative imaging and display systems entitled Integrated Imaging Goggles for guiding surgeries. The prototype systems offer real time stereoscopic fluorescence imaging and color reflectance imaging capacity, along with in vivo handheld microscopy and ultrasound imaging. With the Integrated Imaging Goggle, both wide-field fluorescence imaging and in vivo microscopy are provided. The real time ultrasound images can also be presented in the goggle display. Furthermore, real time goggle-to-goggle stereoscopic video sharing is demonstrated, which can greatly facilitate telemedicine. In this paper, the prototype systems are described, characterized and tested in surgeries in biological tissues ex vivo. We have found that the system can detect fluorescent targets with as low as 60 nM indocyanine green and can resolve structures down to 0.25 mm with large FOV stereoscopic imaging. The system has successfully guided simulated cancer surgeries in chicken. The Integrated Imaging Goggle is novel in 4 aspects: it is (a the first wearable stereoscopic wide-field intraoperative fluorescence imaging and display system, (b the first wearable system offering both large FOV and microscopic imaging simultaneously,

Multimodal imaging in cerebral gliomas and its neuropathological correlation

Energy Technology Data Exchange (ETDEWEB)

Gempt, Jens, E-mail: jens.gempt@lrz.tum.de [Neurochirurgische Klinik und Poliklinik, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Soehngen, Eric [Abteilung für Neuroradiologie, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Abteilung für Neuropathologie des Instituts für Allgemeine Pathologie und Pathologische Anatomie, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Förster, Stefan [Nuklearmedizinische Klinik und Poliklinik, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Ryang, Yu-Mi [Neurochirurgische Klinik und Poliklinik, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Schlegel, Jürgen [Abteilung für Neuropathologie des Instituts für Allgemeine Pathologie und Pathologische Anatomie, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); and others

2014-05-15

Introduction: Concerning the preoperative clinical diagnostic work-up of glioma patients, tumor heterogeneity challenges the oncological therapy. The current study assesses the performance of a multimodal imaging approach to differentiate between areas in malignant gliomas and to investigate the extent to which such a combinatorial imaging approach might predict the underlying histology. Methods: Prior to surgical resection, patients harboring intracranial gliomas underwent MRIs (MR-S, PWI) and {sup 18}F-FET-PETs. Intratumoral and peritumoral biopsy targets were defined, by MRI only, by FET-PET only, and by MRI and FET-PET combined, and biopsied prior to surgical resection and which then received separate histopathological examinations. Results: In total, 38 tissue samples were acquired (seven glioblastomas, one anaplastic astrocytoma, one anaplastic oligoastrocytoma, one diffuse astrocytoma, and one oligoastrocytoma) and underwent histopathological analysis. The highest mean values of Mib1 and CD31 were found in the target point “T’ defined by MRI and FET-PET combined. A significant correlation between NAA/Cr and PET tracer uptake (−0.845, p < 0.05) as well as Cho/Cr ratio and cell density (0.742, p < 0.05) and NAA/Cr ratio and MIB-1 (−0761, p < 0.05) was disclosed for this target point, though not for target points defined by MRI and FET-PET alone. Conclusion: Multimodal-imaging-guided stereotactic biopsy correlated more with histological malignancy indices, such as cell density and MIB-1 labeling, than targets that were based solely on the highest amino acid uptake or contrast enhancement on MRI. The results of our study indicate that a combined PET-MR multimodal imaging approach bears potential benefits in detecting glioma heterogeneity.

Image fusion between whole body FDG PET images and whole body MRI images using a full-automatic mutual information-based multimodality image registration software

International Nuclear Information System (INIS)

Uchida, Yoshitaka; Nakano, Yoshitada; Fujibuchi, Toshiou; Isobe, Tomoko; Kazama, Toshiki; Ito, Hisao

2006-01-01

We attempted image fusion between whole body PET and whole body MRI of thirty patients using a full-automatic mutual information (MI) -based multimodality image registration software and evaluated accuracy of this method and impact of the coregistrated imaging on diagnostic accuracy. For 25 of 30 fused images in body area, translating gaps were within 6 mm in all axes and rotating gaps were within 2 degrees around all axes. In head and neck area, considerably much gaps caused by difference of head inclination at imaging occurred in 16 patients, however these gaps were able to decrease by fused separately. In 6 patients, diagnostic accuracy using PET/MRI fused images was superior compared by PET image alone. This work shows that whole body FDG PET images and whole body MRI images can be automatically fused using MI-based multimodality image registration software accurately and this technique can add useful information when evaluating FDG PET images. (author)

Multi-modal brain imaging software for guiding invasive treatment of epilepsy

NARCIS (Netherlands)

Ossenblok, P.P.W.; Marien, S.; Meesters, S.P.L.; Florack, L.M.J.; Hofman, P.; Schijns, O.E.M.G.; Colon, A.

2017-01-01

Purpose: The surgical treatment of patients with complex epilepsies is changing more and more from open, invasive surgery towards minimally invasive, image guided treatment. Multi-modal brain imaging procedures are developed to delineate preoperatively the region of the brain which is responsible

Image-guided intraocular injection using multimodality optical coherence tomography and fluorescence confocal scanning laser ophthalmoscopy in rodent ophthalmological models

Science.gov (United States)

Terrones, Benjamin D.; Benavides, Oscar R.; Leeburg, Kelsey C.; Mehanathan, Sankarathi B.; Levine, Edward M.; Tao, Yuankai K.

2018-02-01

Intraocular injections are routinely performed for delivery of anti-VEGF and anti-inflammatory therapies in humans. While these injections are also performed in mice to develop novel models of ophthalmic diseases and screen novel therapeutics, the injection location and volume are not well-controlled and reproducible. We overcome limitations of conventional injections methods by developing a multimodality, long working distance, non-contact optical coherence tomography (OCT) and fluorescence confocal scanning laser ophthalmoscopy (cSLO) system for retinal imaging before and after injections. Our OCT+cSLO system combines a custom-built spectraldomain OCT engine (875+/-85 nm) with 125 kHz line-rate with a modified commercial cSLO with a maximum frame-rate of 30 fps (512 x 512 pix.). The system was designed for an overlapping OCT+cSLO field-of-view of 1.1 mm with a 7.76 mm working distance to the pupil. cSLO excitation light sources and filters were optimized for simultaneous GFP and tdTomato imaging. Lateral resolution was 3.02 µm for OCT and 2.74 μm for cSLO. Intravitreal injections of 5%, 10%, and 20% intralipid with Alex Fluor 488 were manually injected intraocularly in C57BL/6 mice. Post-injection imaging showed structural changes associated with retinal puncture, including the injection track, a retinal elevation, and detachment of the posterior hyaloid. OCT enables quantitative analysis of injection location and volumes whereas complementary cSLO improves specificity for identifying fluorescently labeled injected compounds and transgenic cells. The long working distance of our non-contact OCT+cSLO system is uniquely-suited for concurrent imaging with intraocular injections and may be applied for imaging of ophthalmic surgical dynamics and real-time image-guided injections.

A multimodal parallel architecture: A cognitive framework for multimodal interactions.

Science.gov (United States)

Cohn, Neil

2016-01-01

Human communication is naturally multimodal, and substantial focus has examined the semantic correspondences in speech-gesture and text-image relationships. However, visual narratives, like those in comics, provide an interesting challenge to multimodal communication because the words and/or images can guide the overall meaning, and both modalities can appear in complicated "grammatical" sequences: sentences use a syntactic structure and sequential images use a narrative structure. These dual structures create complexity beyond those typically addressed by theories of multimodality where only a single form uses combinatorial structure, and also poses challenges for models of the linguistic system that focus on single modalities. This paper outlines a broad theoretical framework for multimodal interactions by expanding on Jackendoff's (2002) parallel architecture for language. Multimodal interactions are characterized in terms of their component cognitive structures: whether a particular modality (verbal, bodily, visual) is present, whether it uses a grammatical structure (syntax, narrative), and whether it "dominates" the semantics of the overall expression. Altogether, this approach integrates multimodal interactions into an existing framework of language and cognition, and characterizes interactions between varying complexity in the verbal, bodily, and graphic domains. The resulting theoretical model presents an expanded consideration of the boundaries of the "linguistic" system and its involvement in multimodal interactions, with a framework that can benefit research on corpus analyses, experimentation, and the educational benefits of multimodality. Copyright © 2015.

Multifocus confocal Raman microspectroscopy for fast multimode vibrational imaging of living cells.

Science.gov (United States)

Okuno, Masanari; Hamaguchi, Hiro-o

2010-12-15

We have developed a multifocus confocal Raman microspectroscopic system for the fast multimode vibrational imaging of living cells. It consists of an inverted microscope equipped with a microlens array, a pinhole array, a fiber bundle, and a multichannel Raman spectrometer. Forty-eight Raman spectra from 48 foci under the microscope are simultaneously obtained by using multifocus excitation and image-compression techniques. The multifocus confocal configuration suppresses the background generated from the cover glass and the cell culturing medium so that high-contrast images are obtainable with a short accumulation time. The system enables us to obtain multimode (10 different vibrational modes) vibrational images of living cells in tens of seconds with only 1 mW laser power at one focal point. This image acquisition time is more than 10 times faster than that in conventional single-focus Raman microspectroscopy.

Deep Convolutional Neural Networks for Multi-Modality Isointense Infant Brain Image Segmentation

Science.gov (United States)

Zhang, Wenlu; Li, Rongjian; Deng, Houtao; Wang, Li; Lin, Weili; Ji, Shuiwang; Shen, Dinggang

2015-01-01

The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development in health and disease. In the isointense stage (approximately 6–8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, making the tissue segmentation very challenging. Only a small number of existing methods have been designed for tissue segmentation in this isointense stage; however, they only used a single T1 or T2 images, or the combination of T1 and T2 images. In this paper, we propose to use deep convolutional neural networks (CNNs) for segmenting isointense stage brain tissues using multi-modality MR images. CNNs are a type of deep models in which trainable filters and local neighborhood pooling operations are applied alternatingly on the raw input images, resulting in a hierarchy of increasingly complex features. Specifically, we used multimodality information from T1, T2, and fractional anisotropy (FA) images as inputs and then generated the segmentation maps as outputs. The multiple intermediate layers applied convolution, pooling, normalization, and other operations to capture the highly nonlinear mappings between inputs and outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense stage brain images. Results showed that our proposed model significantly outperformed prior methods on infant brain tissue segmentation. In addition, our results indicated that integration of multi-modality images led to significant performance improvement. PMID:25562829

TU-C-BRD-01: Image Guided SBRT I: Multi-Modality 4D Imaging

International Nuclear Information System (INIS)

Cai, J; Mageras, G; Pan, T

2014-01-01

Motion management is one of the critical technical challenges for radiation therapy. 4D imaging has been rapidly adopted as essential tool to assess organ motion associated with respiratory breathing. A variety of 4D imaging techniques have been developed and are currently under development based on different imaging modalities such as CT, MRI, PET, and CBCT. Each modality provides specific and complementary information about organ and tumor respiratory motion. Effective use of each different technique or combined use of different techniques can introduce a comprehensive management of tumor motion. Specifically, these techniques have afforded tremendous opportunities to better define and delineate tumor volumes, more accurately perform patient positioning, and effectively apply highly conformal therapy techniques such as IMRT and SBRT. Successful implementation requires good understanding of not only each technique, including unique features, limitations, artifacts, imaging acquisition and process, but also how to systematically apply the information obtained from different imaging modalities using proper tools such as deformable image registration. Furthermore, it is important to understand the differences in the effects of breathing variation between different imaging modalities. A comprehensive motion management strategy using multi-modality 4D imaging has shown promise in improving patient care, but at the same time faces significant challenges. This session will focuses on the current status and advances in imaging respiration-induced organ motion with different imaging modalities: 4D-CT, 4D-MRI, 4D-PET, and 4D-CBCT/DTS. Learning Objectives: Understand the need and role of multimodality 4D imaging in radiation therapy. Understand the underlying physics behind each 4D imaging technique. Recognize the advantages and limitations of each 4D imaging technique

Modeling decision-making in single- and multi-modal medical images

Science.gov (United States)

Canosa, R. L.; Baum, K. G.

2009-02-01

This research introduces a mode-specific model of visual saliency that can be used to highlight likely lesion locations and potential errors (false positives and false negatives) in single-mode PET and MRI images and multi-modal fused PET/MRI images. Fused-modality digital images are a relatively recent technological improvement in medical imaging; therefore, a novel component of this research is to characterize the perceptual response to these fused images. Three different fusion techniques were compared to single-mode displays in terms of observer error rates using synthetic human brain images generated from an anthropomorphic phantom. An eye-tracking experiment was performed with naÃve (non-radiologist) observers who viewed the single- and multi-modal images. The eye-tracking data allowed the errors to be classified into four categories: false positives, search errors (false negatives never fixated), recognition errors (false negatives fixated less than 350 milliseconds), and decision errors (false negatives fixated greater than 350 milliseconds). A saliency model consisting of a set of differentially weighted low-level feature maps is derived from the known error and ground truth locations extracted from a subset of the test images for each modality. The saliency model shows that lesion and error locations attract visual attention according to low-level image features such as color, luminance, and texture.

Multimodal label-free microscopy

Directory of Open Access Journals (Sweden)

Nicolas Pavillon

2014-09-01

Full Text Available This paper reviews the different multimodal applications based on a large extent of label-free imaging modalities, ranging from linear to nonlinear optics, while also including spectroscopic measurements. We put specific emphasis on multimodal measurements going across the usual boundaries between imaging modalities, whereas most multimodal platforms combine techniques based on similar light interactions or similar hardware implementations. In this review, we limit the scope to focus on applications for biology such as live cells or tissues, since by their nature of being alive or fragile, we are often not free to take liberties with the image acquisition times and are forced to gather the maximum amount of information possible at one time. For such samples, imaging by a given label-free method usually presents a challenge in obtaining sufficient optical signal or is limited in terms of the types of observable targets. Multimodal imaging is then particularly attractive for these samples in order to maximize the amount of measured information. While multimodal imaging is always useful in the sense of acquiring additional information from additional modes, at times it is possible to attain information that could not be discovered using any single mode alone, which is the essence of the progress that is possible using a multimodal approach.

Predicting standard-dose PET image from low-dose PET and multimodal MR images using mapping-based sparse representation

International Nuclear Information System (INIS)

Wang, Yan; Zhou, Jiliu; Zhang, Pei; An, Le; Ma, Guangkai; Kang, Jiayin; Shi, Feng; Shen, Dinggang; Wu, Xi; Lalush, David S; Lin, Weili

2016-01-01

Positron emission tomography (PET) has been widely used in clinical diagnosis for diseases and disorders. To obtain high-quality PET images requires a standard-dose radionuclide (tracer) injection into the human body, which inevitably increases risk of radiation exposure. One possible solution to this problem is to predict the standard-dose PET image from its low-dose counterpart and its corresponding multimodal magnetic resonance (MR) images. Inspired by the success of patch-based sparse representation (SR) in super-resolution image reconstruction, we propose a mapping-based SR (m-SR) framework for standard-dose PET image prediction. Compared with the conventional patch-based SR, our method uses a mapping strategy to ensure that the sparse coefficients, estimated from the multimodal MR images and low-dose PET image, can be applied directly to the prediction of standard-dose PET image. As the mapping between multimodal MR images (or low-dose PET image) and standard-dose PET images can be particularly complex, one step of mapping is often insufficient. To this end, an incremental refinement framework is therefore proposed. Specifically, the predicted standard-dose PET image is further mapped to the target standard-dose PET image, and then the SR is performed again to predict a new standard-dose PET image. This procedure can be repeated for prediction refinement of the iterations. Also, a patch selection based dictionary construction method is further used to speed up the prediction process. The proposed method is validated on a human brain dataset. The experimental results show that our method can outperform benchmark methods in both qualitative and quantitative measures. (paper)

In vivo mapping of vascular inflammation using multimodal imaging.

Directory of Open Access Journals (Sweden)

Benjamin R Jarrett

2010-10-01

Full Text Available Plaque vulnerability to rupture has emerged as a critical correlate to risk of adverse coronary events but there is as yet no clinical method to assess plaque stability in vivo. In the search to identify biomarkers of vulnerable plaques an association has been found between macrophages and plaque stability--the density and pattern of macrophage localization in lesions is indicative of probability to rupture. In very unstable plaques, macrophages are found in high densities and concentrated in the plaque shoulders. Therefore, the ability to map macrophages in plaques could allow noninvasive assessment of plaque stability. We use a multimodality imaging approach to noninvasively map the distribution of macrophages in vivo. The use of multiple modalities allows us to combine the complementary strengths of each modality to better visualize features of interest. Our combined use of Positron Emission Tomography and Magnetic Resonance Imaging (PET/MRI allows high sensitivity PET screening to identify putative lesions in a whole body view, and high resolution MRI for detailed mapping of biomarker expression in the lesions.Macromolecular and nanoparticle contrast agents targeted to macrophages were developed and tested in three different mouse and rat models of atherosclerosis in which inflamed vascular plaques form spontaneously and/or are induced by injury. For multimodal detection, the probes were designed to contain gadolinium (T1 MRI or iron oxide (T2 MRI, and Cu-64 (PET. PET imaging was utilized to identify regions of macrophage accumulation; these regions were further probed by MRI to visualize macrophage distribution at high resolution. In both PET and MR images the probes enhanced contrast at sites of vascular inflammation, but not in normal vessel walls. MRI was able to identify discrete sites of inflammation that were blurred together at the low resolution of PET. Macrophage content in the lesions was confirmed by histology.The multimodal

PCANet-Based Structural Representation for Nonrigid Multimodal Medical Image Registration

Directory of Open Access Journals (Sweden)

Xingxing Zhu

2018-05-01

Full Text Available Nonrigid multimodal image registration remains a challenging task in medical image processing and analysis. The structural representation (SR-based registration methods have attracted much attention recently. However, the existing SR methods cannot provide satisfactory registration accuracy due to the utilization of hand-designed features for structural representation. To address this problem, the structural representation method based on the improved version of the simple deep learning network named PCANet is proposed for medical image registration. In the proposed method, PCANet is firstly trained on numerous medical images to learn convolution kernels for this network. Then, a pair of input medical images to be registered is processed by the learned PCANet. The features extracted by various layers in the PCANet are fused to produce multilevel features. The structural representation images are constructed for two input images based on nonlinear transformation of these multilevel features. The Euclidean distance between structural representation images is calculated and used as the similarity metrics. The objective function defined by the similarity metrics is optimized by L-BFGS method to obtain parameters of the free-form deformation (FFD model. Extensive experiments on simulated and real multimodal image datasets show that compared with the state-of-the-art registration methods, such as modality-independent neighborhood descriptor (MIND, normalized mutual information (NMI, Weber local descriptor (WLD, and the sum of squared differences on entropy images (ESSD, the proposed method provides better registration performance in terms of target registration error (TRE and subjective human vision.

Multimodal Image Alignment via Linear Mapping between Feature Modalities.

Science.gov (United States)

Jiang, Yanyun; Zheng, Yuanjie; Hou, Sujuan; Chang, Yuchou; Gee, James

2017-01-01

We propose a novel landmark matching based method for aligning multimodal images, which is accomplished uniquely by resolving a linear mapping between different feature modalities. This linear mapping results in a new measurement on similarity of images captured from different modalities. In addition, our method simultaneously solves this linear mapping and the landmark correspondences by minimizing a convex quadratic function. Our method can estimate complex image relationship between different modalities and nonlinear nonrigid spatial transformations even in the presence of heavy noise, as shown in our experiments carried out by using a variety of image modalities.

Multimodal location estimation of videos and images

CERN Document Server

Friedland, Gerald

2015-01-01

This book presents an overview of the field of multimodal location estimation, i.e. using acoustic, visual, and/or textual cues to estimate the shown location of a video recording. The authors' sample research results in this field in a unified way integrating research work on this topic that focuses on different modalities, viewpoints, and applications. The book describes fundamental methods of acoustic, visual, textual, social graph, and metadata processing as well as multimodal integration methods used for location estimation. In addition, the text covers benchmark metrics and explores the limits of the technology based on a human baseline. ·         Discusses localization of multimedia data; ·         Examines fundamental methods of establishing location metadata for images and videos (other than GPS tagging); ·         Covers Data-Driven as well as Semantic Location Estimation.

Multimodal imaging of bone metastases: From preclinical to clinical applications

Directory of Open Access Journals (Sweden)

Stephan Ellmann

2015-10-01

Full Text Available Metastases to the skeletal system are commonly observed in cancer patients, highly affecting the patients' quality of life. Imaging plays a major role in detection, follow-up, and molecular characterisation of metastatic disease. Thus, imaging techniques have been optimised and combined in a multimodal and multiparametric manner for assessment of complementary aspects in osseous metastases. This review summarises both application of the most relevant imaging techniques for bone metastasis in preclinical models and the clinical setting.

Design and Applications of a Multimodality Image Data Warehouse Framework

Science.gov (United States)

Wong, Stephen T.C.; Hoo, Kent Soo; Knowlton, Robert C.; Laxer, Kenneth D.; Cao, Xinhau; Hawkins, Randall A.; Dillon, William P.; Arenson, Ronald L.

2002-01-01

A comprehensive data warehouse framework is needed, which encompasses imaging and non-imaging information in supporting disease management and research. The authors propose such a framework, describe general design principles and system architecture, and illustrate a multimodality neuroimaging data warehouse system implemented for clinical epilepsy research. The data warehouse system is built on top of a picture archiving and communication system (PACS) environment and applies an iterative object-oriented analysis and design (OOAD) approach and recognized data interface and design standards. The implementation is based on a Java CORBA (Common Object Request Broker Architecture) and Web-based architecture that separates the graphical user interface presentation, data warehouse business services, data staging area, and backend source systems into distinct software layers. To illustrate the practicality of the data warehouse system, the authors describe two distinct biomedical applications—namely, clinical diagnostic workup of multimodality neuroimaging cases and research data analysis and decision threshold on seizure foci lateralization. The image data warehouse framework can be modified and generalized for new application domains. PMID:11971885

Advanced Contrast Agents for Multimodal Biomedical Imaging Based on Nanotechnology.

Science.gov (United States)

Calle, Daniel; Ballesteros, Paloma; Cerdán, Sebastián

2018-01-01

Clinical imaging modalities have reached a prominent role in medical diagnosis and patient management in the last decades. Different image methodologies as Positron Emission Tomography, Single Photon Emission Tomography, X-Rays, or Magnetic Resonance Imaging are in continuous evolution to satisfy the increasing demands of current medical diagnosis. Progress in these methodologies has been favored by the parallel development of increasingly more powerful contrast agents. These are molecules that enhance the intrinsic contrast of the images in the tissues where they accumulate, revealing noninvasively the presence of characteristic molecular targets or differential physiopathological microenvironments. The contrast agent field is currently moving to improve the performance of these molecules by incorporating the advantages that modern nanotechnology offers. These include, mainly, the possibilities to combine imaging and therapeutic capabilities over the same theranostic platform or improve the targeting efficiency in vivo by molecular engineering of the nanostructures. In this review, we provide an introduction to multimodal imaging methods in biomedicine, the sub-nanometric imaging agents previously used and the development of advanced multimodal and theranostic imaging agents based in nanotechnology. We conclude providing some illustrative examples from our own laboratories, including recent progress in theranostic formulations of magnetoliposomes containing ω-3 poly-unsaturated fatty acids to treat inflammatory diseases, or the use of stealth liposomes engineered with a pH-sensitive nanovalve to release their cargo specifically in the acidic extracellular pH microenvironment of tumors.

WE-H-206-02: Recent Advances in Multi-Modality Molecular Imaging of Small Animals

Energy Technology Data Exchange (ETDEWEB)

Tsui, B. [Johns Hopkins University (United States)

2016-06-15

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

WE-H-206-02: Recent Advances in Multi-Modality Molecular Imaging of Small Animals

International Nuclear Information System (INIS)

Tsui, B.

2016-01-01

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

Visual tracking for multi-modality computer-assisted image guidance

Science.gov (United States)

Basafa, Ehsan; Foroughi, Pezhman; Hossbach, Martin; Bhanushali, Jasmine; Stolka, Philipp

2017-03-01

With optical cameras, many interventional navigation tasks previously relying on EM, optical, or mechanical guidance can be performed robustly, quickly, and conveniently. We developed a family of novel guidance systems based on wide-spectrum cameras and vision algorithms for real-time tracking of interventional instruments and multi-modality markers. These navigation systems support the localization of anatomical targets, support placement of imaging probe and instruments, and provide fusion imaging. The unique architecture - low-cost, miniature, in-hand stereo vision cameras fitted directly to imaging probes - allows for an intuitive workflow that fits a wide variety of specialties such as anesthesiology, interventional radiology, interventional oncology, emergency medicine, urology, and others, many of which see increasing pressure to utilize medical imaging and especially ultrasound, but have yet to develop the requisite skills for reliable success. We developed a modular system, consisting of hardware (the Optical Head containing the mini cameras) and software (components for visual instrument tracking with or without specialized visual features, fully automated marker segmentation from a variety of 3D imaging modalities, visual observation of meshes of widely separated markers, instant automatic registration, and target tracking and guidance on real-time multi-modality fusion views). From these components, we implemented a family of distinct clinical and pre-clinical systems (for combinations of ultrasound, CT, CBCT, and MRI), most of which have international regulatory clearance for clinical use. We present technical and clinical results on phantoms, ex- and in-vivo animals, and patients.

Multimodality molecular imaging - from target description to clinical studies

International Nuclear Information System (INIS)

Schober, O.; Rahbar, K.; Riemann, B.

2009-01-01

This highlight lecture was presented at the closing session of the Annual Congress of the European Association of Nuclear Medicine (EANM) in Munich on 15 October 2008. The Congress was a great success: there were more than 4,000 participants, and 1,597 abstracts were submitted. Of these, 1,387 were accepted for oral or poster presentation, with a rejection rate of 14%. In this article a choice was made from 100 of the 500 lectures which received the highest scores by the scientific review panel. This article outlines the major findings and trends at the EANM 2008, and is only a brief summary of the large number of outstanding abstracts presented. Among the great number of oral and poster presentations covering nearly all fields of nuclear medicine some headlines have to be defined highlighting the development of nuclear medicine in the 21st century. This review focuses on the increasing impact of molecular and multimodality imaging in the field of nuclear medicine. In addition, the question may be asked as to whether the whole spectrum of nuclear medicine is nothing other than molecular imaging and therapy. Furthermore, molecular imaging will and has to go ahead to multimodality imaging. In view of this background the review was structured according to the single steps of molecular imaging, i.e. from target description to clinical studies. The following topics are addressed: targets, radiochemistry and radiopharmacy, devices and computer science, animals and preclinical evaluations, and patients and clinical evaluations. (orig.)

Evaluation of Multimodal Imaging Biomarkers of Prostate Cancer

Science.gov (United States)

2016-11-01

relationship prostate cancer growth, androgen receptor (AR) levels, hypoxia, and translocator protein (TSPO) levels. As described in the statement of work... bladder uptake) that enable robust detection of small prostate cancers . In contrast, high background and variable uptake of FDHT and FMISO confounded the...Award Number: W81XWH-12-1-0245 TITLE: Evaluation of Multimodal Imaging Biomarkers of Prostate Cancer PRINCIPAL INVESTIGATOR: Christopher Chad

Multimodality Registration without a Dedicated Multimodality Scanner

Directory of Open Access Journals (Sweden)

Bradley J. Beattie

2007-03-01

Full Text Available Multimodality scanners that allow the acquisition of both functional and structural image sets on a single system have recently become available for animal research use. Although the resultant registered functional/structural image sets can greatly enhance the interpretability of the functional data, the cost of multimodality systems can be prohibitive, and they are often limited to two modalities, which generally do not include magnetic resonance imaging. Using a thin plastic wrap to immobilize and fix a mouse or other small animal atop a removable bed, we are able to calculate registrations between all combinations of four different small animal imaging scanners (positron emission tomography, single-photon emission computed tomography, magnetic resonance, and computed tomography [CT] at our disposal, effectively equivalent to a quadruple-modality scanner. A comparison of serially acquired CT images, with intervening acquisitions on other scanners, demonstrates the ability of the proposed procedures to maintain the rigidity of an anesthetized mouse during transport between scanners. Movement of the bony structures of the mouse was estimated to be 0.62 mm. Soft tissue movement was predominantly the result of the filling (or emptying of the urinary bladder and thus largely constrained to this region. Phantom studies estimate the registration errors for all registration types to be less than 0.5 mm. Functional images using tracers targeted to known structures verify the accuracy of the functional to structural registrations. The procedures are easy to perform and produce robust and accurate results that rival those of dedicated multimodality scanners, but with more flexible registration combinations and while avoiding the expense and redundancy of multimodality systems.

The pivotal role of multimodality reporter sensors in drug discovery: from cell based assays to real time molecular imaging.

Science.gov (United States)

Ray, Pritha

2011-04-01

Development and marketing of new drugs require stringent validation that are expensive and time consuming. Non-invasive multimodality molecular imaging using reporter genes holds great potential to expedite these processes at reduced cost. New generations of smarter molecular imaging strategies such as Split reporter, Bioluminescence resonance energy transfer, Multimodality fusion reporter technologies will further assist to streamline and shorten the drug discovery and developmental process. This review illustrates the importance and potential of molecular imaging using multimodality reporter genes in drug development at preclinical phases.

Towards an ultra-thin medical endoscope: multimode fibre as a wide-field image transferring medium

Science.gov (United States)

Duriš, Miroslav; Bradu, Adrian; Podoleanu, Adrian; Hughes, Michael

2018-03-01

Multimode optical fibres are attractive for biomedical and industrial applications such as endoscopes because of the small cross section and imaging resolution they can provide in comparison to widely-used fibre bundles. However, the image is randomly scrambled by propagation through a multimode fibre. Even though the scrambling is unpredictable, it is deterministic, and therefore the scrambling can be reversed. To unscramble the image, we treat the multimode fibre as a linear, disordered scattering medium. To calibrate, we scan a focused beam of coherent light over thousands of different beam positions at the distal end and record complex fields at the proximal end of the fibre. This way, the inputoutput response of the system is determined, which then allows computational reconstruction of reflection-mode images. However, there remains the problem of illuminating the tissue via the fibre while avoiding back reflections from the proximal face. To avoid this drawback, we provide here the first preliminary confirmation that an image can be transferred through a 2x2 fibre coupler, with the sample at its distal port interrogated in reflection. Light is injected into one port for illumination and then collected from a second port for imaging.

A Pretargeted Approach for the Multimodal PET/NIRF Imaging of Colorectal Cancer.

Science.gov (United States)

Adumeau, Pierre; Carnazza, Kathryn E; Brand, Christian; Carlin, Sean D; Reiner, Thomas; Agnew, Brian J; Lewis, Jason S; Zeglis, Brian M

2016-01-01

The complementary nature of positron emission tomography (PET) and near-infrared fluorescence (NIRF) imaging makes the development of strategies for the multimodal PET/NIRF imaging of cancer a very enticing prospect. Indeed, in the context of colorectal cancer, a single multimodal PET/NIRF imaging agent could be used to stage the disease, identify candidates for surgical intervention, and facilitate the image-guided resection of the disease. While antibodies have proven to be highly effective vectors for the delivery of radioisotopes and fluorophores to malignant tissues, the use of radioimmunoconjugates labeled with long-lived nuclides such as 89 Zr poses two important clinical complications: high radiation doses to the patient and the need for significant lag time between imaging and surgery. In vivo pretargeting strategies that decouple the targeting vector from the radioactivity at the time of injection have the potential to circumvent these issues by facilitating the use of positron-emitting radioisotopes with far shorter half-lives. Here, we report the synthesis, characterization, and in vivo validation of a pretargeted strategy for the multimodal PET and NIRF imaging of colorectal carcinoma. This approach is based on the rapid and bioorthogonal ligation between a trans -cyclooctene- and fluorophore-bearing immunoconjugate of the huA33 antibody (huA33-Dye800-TCO) and a 64 Cu-labeled tetrazine radioligand ( 64 Cu-Tz-SarAr). In vivo imaging experiments in mice bearing A33 antigen-expressing SW1222 colorectal cancer xenografts clearly demonstrate that this approach enables the non-invasive visualization of tumors and the image-guided resection of malignant tissue, all at only a fraction of the radiation dose created by a directly labeled radioimmunoconjugate. Additional in vivo experiments in peritoneal and patient-derived xenograft models of colorectal carcinoma reinforce the efficacy of this methodology and underscore its potential as an innovative and useful

Multicomponent, peptide-targeted glycol chitosan nanoparticles containing ferrimagnetic iron oxide nanocubes for bladder cancer multimodal imaging

Directory of Open Access Journals (Sweden)

Key J

2016-08-01

Full Text Available Jaehong Key,1,2 Deepika Dhawan,3 Christy L Cooper,3,4 Deborah W Knapp,3 Kwangmeyung Kim,5 Ick Chan Kwon,5 Kuiwon Choi,5 Kinam Park,1,6 Paolo Decuzzi,7–9 James F Leary1,3,41Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN, USA; 2Department of Biomedical Engineering, Yonsei University, Wonju, Republic of Korea; 3School of Veterinary Medicine-Department of Basic Medical Sciences, Purdue University, West Lafayette, 4Birck Nanotechnology Center at Discovery Park, Purdue University, West Lafayette, IN, USA; 5Biomedical Research Center, Korea Institute of Science and Technology, Sungbook-Gu, Seoul, Republic of Korea; 6Department of Pharmaceutics, Purdue University, West Lafayette, IN, 7Department of Translational Imaging, 8Department of Nanomedicine, Houston Methodist Research Institute, Houston, TX USA; 9Laboratory of Nanotechnology for Precision Medicine, Fondazione Istituto Italiano di Tecnologia (IIT, Genova, Italy Abstract: While current imaging modalities, such as magnetic resonance imaging (MRI, computed tomography, and positron emission tomography, play an important role in detecting tumors in the body, no single-modality imaging possesses all the functions needed for a complete diagnostic imaging, such as spatial resolution, signal sensitivity, and tissue penetration depth. For this reason, multimodal imaging strategies have become promising tools for advanced biomedical research and cancer diagnostics and therapeutics. In designing multimodal nanoparticles, the physicochemical properties of the nanoparticles should be engineered so that they successfully accumulate at the tumor site and minimize nonspecific uptake by other organs. Finely altering the nano-scale properties can dramatically change the biodistribution and tumor accumulation of nanoparticles in the body. In this study, we engineered multimodal nanoparticles for both MRI, by using ferrimagnetic nanocubes (NCs, and near infrared fluorescence imaging

Development of a hardware-based registration system for the multimodal medical images by USB cameras

International Nuclear Information System (INIS)

Iwata, Michiaki; Minato, Kotaro; Watabe, Hiroshi; Koshino, Kazuhiro; Yamamoto, Akihide; Iida, Hidehiro

2009-01-01

There are several medical imaging scanners and each modality has different aspect for visualizing inside of human body. By combining these images, diagnostic accuracy could be improved, and therefore, several attempts for multimodal image registration have been implemented. One popular approach is to use hybrid image scanners such as positron emission tomography (PET)/CT and single photon emission computed tomography (SPECT)/CT. However, these hybrid scanners are expensive and not fully available. We developed multimodal image registration system with universal serial bus (USB) cameras, which is inexpensive and applicable to any combinations of existed conventional imaging scanners. The multiple USB cameras will determine the three dimensional positions of a patient while scanning. Using information of these positions and rigid body transformation, the acquired image is registered to the common coordinate which is shared with another scanner. For each scanner, reference marker is attached on gantry of the scanner. For observing the reference marker's position by the USB cameras, the location of the USB cameras can be arbitrary. In order to validate the system, we scanned a cardiac phantom with different positions by PET and MRI scanners. Using this system, images from PET and MRI were visually aligned, and good correlations between PET and MRI images were obtained after the registration. The results suggest this system can be inexpensively used for multimodal image registrations. (author)

Echocardiography in the Era of Multimodality Cardiovascular Imaging

Science.gov (United States)

Shah, Benoy Nalin

2013-01-01

Echocardiography remains the most frequently performed cardiac imaging investigation and is an invaluable tool for detailed and accurate evaluation of cardiac structure and function. Echocardiography, nuclear cardiology, cardiac magnetic resonance imaging, and cardiovascular-computed tomography comprise the subspeciality of cardiovascular imaging, and these techniques are often used together for a multimodality, comprehensive assessment of a number of cardiac diseases. This paper provides the general cardiologist and physician with an overview of state-of-the-art modern echocardiography, summarising established indications as well as highlighting advances in stress echocardiography, three-dimensional echocardiography, deformation imaging, and contrast echocardiography. Strengths and limitations of echocardiography are discussed as well as the growing role of real-time three-dimensional echocardiography in the guidance of structural heart interventions in the cardiac catheter laboratory. PMID:23878804

Extended feature-fusion guidelines to improve image-based multi-modal biometrics

CSIR Research Space (South Africa)

Brown, Dane

2016-09-01

Full Text Available The feature-level, unlike the match score-level, lacks multi-modal fusion guidelines. This work demonstrates a practical approach for improved image-based biometric feature-fusion. The approach extracts and combines the face, fingerprint...

Multi-Modality Medical Image Fusion Based on Wavelet Analysis and Quality Evaluation

Institute of Scientific and Technical Information of China (English)

无

2001-01-01

Multi-modality medical image fusion has more and more important applications in medical image analysisand understanding. In this paper, we develop and apply a multi-resolution method based on wavelet pyramid to fusemedical images from different modalities such as PET-MRI and CT-MRI. In particular, we evaluate the different fusionresults when applying different selection rules and obtain optimum combination of fusion parameters.

Metal complex-based templates and nanostructures for magnetic resonance/optical multimodal imaging agents

NARCIS (Netherlands)

Galindo Millan, Jealemy

2012-01-01

In this thesis, new approaches directed towards simple and functional imaging agents (IAs) for magnetic resonance (MR) and fluorescence multimodal imaging are proposed. In Chapter 3, hybrid silver nanostructures (hAgNSs), grown using a polyamino carboxylic acid scaffold, namely

Ethernet image communication performance in a multimodal PACS network

International Nuclear Information System (INIS)

Lou, S.L.; Valentino, D.J.; Chan, K.K.; Huang, H.K.

1989-01-01

The authors have evaluated the performance of an Ethernet network in a multimodal picture archiving and communications system (PACS) environment. The study included measurements between Sun workstations and PC- AT computers running communication software at the TCP level. First they initiated image transfers between two workstations, a server and a client. Next, they successively added clients to transfer images to the server and they measured degradation in network performance. Finally, they initiated image transfers between pairs of workstations and again measured performance degradation. The results of the authors' experiments indicate that Ethernet is suitable for image communication only in limited network situations. They discuss how to maximize network performance given these constraints

Improving supervised classification accuracy using non-rigid multimodal image registration: detecting prostate cancer

Science.gov (United States)

Chappelow, Jonathan; Viswanath, Satish; Monaco, James; Rosen, Mark; Tomaszewski, John; Feldman, Michael; Madabhushi, Anant

2008-03-01

Computer-aided diagnosis (CAD) systems for the detection of cancer in medical images require precise labeling of training data. For magnetic resonance (MR) imaging (MRI) of the prostate, training labels define the spatial extent of prostate cancer (CaP); the most common source for these labels is expert segmentations. When ancillary data such as whole mount histology (WMH) sections, which provide the gold standard for cancer ground truth, are available, the manual labeling of CaP can be improved by referencing WMH. However, manual segmentation is error prone, time consuming and not reproducible. Therefore, we present the use of multimodal image registration to automatically and accurately transcribe CaP from histology onto MRI following alignment of the two modalities, in order to improve the quality of training data and hence classifier performance. We quantitatively demonstrate the superiority of this registration-based methodology by comparing its results to the manual CaP annotation of expert radiologists. Five supervised CAD classifiers were trained using the labels for CaP extent on MRI obtained by the expert and 4 different registration techniques. Two of the registration methods were affi;ne schemes; one based on maximization of mutual information (MI) and the other method that we previously developed, Combined Feature Ensemble Mutual Information (COFEMI), which incorporates high-order statistical features for robust multimodal registration. Two non-rigid schemes were obtained by succeeding the two affine registration methods with an elastic deformation step using thin-plate splines (TPS). In the absence of definitive ground truth for CaP extent on MRI, classifier accuracy was evaluated against 7 ground truth surrogates obtained by different combinations of the expert and registration segmentations. For 26 multimodal MRI-WMH image pairs, all four registration methods produced a higher area under the receiver operating characteristic curve compared to that

Robust Multimodal Dictionary Learning

Science.gov (United States)

Cao, Tian; Jojic, Vladimir; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

2014-01-01

We propose a robust multimodal dictionary learning method for multimodal images. Joint dictionary learning for both modalities may be impaired by lack of correspondence between image modalities in training data, for example due to areas of low quality in one of the modalities. Dictionaries learned with such non-corresponding data will induce uncertainty about image representation. In this paper, we propose a probabilistic model that accounts for image areas that are poorly corresponding between the image modalities. We cast the problem of learning a dictionary in presence of problematic image patches as a likelihood maximization problem and solve it with a variant of the EM algorithm. Our algorithm iterates identification of poorly corresponding patches and re-finements of the dictionary. We tested our method on synthetic and real data. We show improvements in image prediction quality and alignment accuracy when using the method for multimodal image registration. PMID:24505674

Quantitative Assessment of Mammary Gland Density in Rodents Using Digital Image Analysis

Directory of Open Access Journals (Sweden)

Thompson Henry J

2011-06-01

Full Text Available Abstract Background Rodent models have been used extensively to study mammary gland development and for studies of toxicology and carcinogenesis. Mammary gland gross morphology can visualized via the excision of intact mammary gland chains following fixation and staining with carmine using a tissue preparation referred to as a whole mount. Methods are described for the automated collection of digital images from an entire mammary gland whole mount and for the interrogation of digital data using a "masking" technique available with Image-Pro® plus image analysis software (Mediacybernetics. Silver Spring, MD. Results Parallel to mammographic analysis in humans, measurements of rodent mammary gland density were derived from area-based or volume-based algorithms and included: total circumscribed mammary fat pad mass, mammary epithelial mass, and epithelium-free fat pad mass. These values permitted estimation of absolute mass of mammary epithelium as well as breast density. The biological plausibility of these measurements was evaluated in mammary whole mounts from rats and mice. During mammary gland development, absolute epithelial mass increased linearly without significant changes in mammographic density. Treatment of rodents with tamoxifen, 9-cis-retinoic acid, or ovariectomy, and occurrence of diet induced obesity decreased both absolute epithelial mass and mammographic density. The area and volumetric methods gave similar results. Conclusions Digital image analysis can be used for screening agents for potential impact on reproductive toxicity or carcinogenesis as well as for mechanistic studies, particularly for cumulative effects on mammary epithelial mass as well as translational studies of mechanisms that explain the relationship between epithelial mass and cancer risk.

Segmentation of rodent whole-body dynamic PET images: an unsupervised method based on voxel dynamics

DEFF Research Database (Denmark)

Maroy, Renaud; Boisgard, Raphaël; Comtat, Claude

2008-01-01

Positron emission tomography (PET) is a useful tool for pharmacokinetics studies in rodents during the preclinical phase of drug and tracer development. However, rodent organs are small as compared to the scanner's intrinsic resolution and are affected by physiological movements. We present a new...... method for the segmentation of rodent whole-body PET images that takes these two difficulties into account by estimating the pharmacokinetics far from organ borders. The segmentation method proved efficient on whole-body numerical rat phantom simulations, including 3-14 organs, together...

Multimodal nonlinear imaging of arabidopsis thaliana root cell

Science.gov (United States)

Jang, Bumjoon; Lee, Sung-Ho; Woo, Sooah; Park, Jong-Hyun; Lee, Myeong Min; Park, Seung-Han

2017-07-01

Nonlinear optical microscopy has enabled the possibility to explore inside the living organisms. It utilizes ultrashort laser pulse with long wavelength (greater than 800nm). Ultrashort pulse produces high peak power to induce nonlinear optical phenomenon such as two-photon excitation fluorescence (TPEF) and harmonic generations in the medium while maintaining relatively low average energy pre area. In plant developmental biology, confocal microscopy is widely used in plant cell imaging after the development of biological fluorescence labels in mid-1990s. However, fluorescence labeling itself affects the sample and the sample deviates from intact condition especially when labelling the entire cell. In this work, we report the dynamic images of Arabidopsis thaliana root cells. This demonstrates the multimodal nonlinear optical microscopy is an effective tool for long-term plant cell imaging.

Nuclear medicine and multimodality imaging of pediatric neuroblastoma

Energy Technology Data Exchange (ETDEWEB)

Mueller, Wolfgang Peter; Pfluger, Thomas [Ludwig-Maximilians-University of Munich, Department of Nuclear Medicine, Munich (Germany); Coppenrath, Eva [Ludwig-Maximilians-University of Munich, Department of Radiology, Munich (Germany)

2013-04-15

Neuroblastoma is an embryonic tumor of the peripheral sympathetic nervous system and is metastatic or high risk for relapse in nearly 50% of cases. Therefore, exact staging with radiological and nuclear medicine imaging methods is crucial for defining the adequate therapeutic choice. Tumor cells express the norepinephrine transporter, which makes metaiodobenzylguanidine (MIBG), an analogue of norepinephrine, an ideal tumor specific agent for imaging. MIBG imaging has several disadvantages, such as limited spatial resolution, limited sensitivity in small lesions and the need for two or even more acquisition sessions. Most of these limitations can be overcome with positron emission tomography (PET) using [F-18]2-fluoro-2-deoxyglucose [FDG]. Furthermore, new tracers, such as fluorodopa or somatostatin receptor agonists, have been tested for imaging neuroblastoma recently. However, MIBG scintigraphy and PET alone are not sufficient for operative or biopsy planning. In this regard, a combination with morphological imaging is indispensable. This article will discuss strategies for primary and follow-up diagnosis in neuroblastoma using different nuclear medicine and radiological imaging methods as well as multimodality imaging. (orig.)

Multi-Modality Registration And Fusion Of Medical Image Data

International Nuclear Information System (INIS)

Kassak, P.; Vencko, D.; Cerovsky, I.

2008-01-01

Digitalisation of health care providing facilities allows US to maximize the usage of digital data from one patient obtained by various modalities. Complex view on to the problem can be achieved from the site of morphology as well as functionality. Multi-modal registration and fusion of medical image data is one of the examples that provides improved insight and allows more precise approach and treatment. (author)

Compositional-prior-guided image reconstruction algorithm for multi-modality imaging

Science.gov (United States)

Fang, Qianqian; Moore, Richard H.; Kopans, Daniel B.; Boas, David A.

2010-01-01

The development of effective multi-modality imaging methods typically requires an efficient information fusion model, particularly when combining structural images with a complementary imaging modality that provides functional information. We propose a composition-based image segmentation method for X-ray digital breast tomosynthesis (DBT) and a structural-prior-guided image reconstruction for a combined DBT and diffuse optical tomography (DOT) breast imaging system. Using the 3D DBT images from 31 clinically measured healthy breasts, we create an empirical relationship between the X-ray intensities for adipose and fibroglandular tissue. We use this relationship to then segment another 58 healthy breast DBT images from 29 subjects into compositional maps of different tissue types. For each breast, we build a weighted-graph in the compositional space and construct a regularization matrix to incorporate the structural priors into a finite-element-based DOT image reconstruction. Use of the compositional priors enables us to fuse tissue anatomy into optical images with less restriction than when using a binary segmentation. This allows us to recover the image contrast captured by DOT but not by DBT. We show that it is possible to fine-tune the strength of the structural priors by changing a single regularization parameter. By estimating the optical properties for adipose and fibroglandular tissue using the proposed algorithm, we found the results are comparable or superior to those estimated with expert-segmentations, but does not involve the time-consuming manual selection of regions-of-interest. PMID:21258460

Multi-modality molecular imaging: pre-clinical laboratory configuration

Science.gov (United States)

Wu, Yanjun; Wellen, Jeremy W.; Sarkar, Susanta K.

2006-02-01

In recent years, the prevalence of in vivo molecular imaging applications has rapidly increased. Here we report on the construction of a multi-modality imaging facility in a pharmaceutical setting that is expected to further advance existing capabilities for in vivo imaging of drug distribution and the interaction with their target. The imaging instrumentation in our facility includes a microPET scanner, a four wavelength time-domain optical imaging scanner, a 9.4T/30cm MRI scanner and a SPECT/X-ray CT scanner. An electronics shop and a computer room dedicated to image analysis are additional features of the facility. The layout of the facility was designed with a central animal preparation room surrounded by separate laboratory rooms for each of the major imaging modalities to accommodate the work-flow of simultaneous in vivo imaging experiments. This report will focus on the design of and anticipated applications for our microPET and optical imaging laboratory spaces. Additionally, we will discuss efforts to maximize the daily throughput of animal scans through development of efficient experimental work-flows and the use of multiple animals in a single scanning session.

Multimodal image registration based on binary gradient angle descriptor.

Science.gov (United States)

Jiang, Dongsheng; Shi, Yonghong; Yao, Demin; Fan, Yifeng; Wang, Manning; Song, Zhijian

2017-12-01

Multimodal image registration plays an important role in image-guided interventions/therapy and atlas building, and it is still a challenging task due to the complex intensity variations in different modalities. The paper addresses the problem and proposes a simple, compact, fast and generally applicable modality-independent binary gradient angle descriptor (BGA) based on the rationale of gradient orientation alignment. The BGA can be easily calculated at each voxel by coding the quadrant in which a local gradient vector falls, and it has an extremely low computational complexity, requiring only three convolutions, two multiplication operations and two comparison operations. Meanwhile, the binarized encoding of the gradient orientation makes the BGA more resistant to image degradations compared with conventional gradient orientation methods. The BGA can extract similar feature descriptors for different modalities and enable the use of simple similarity measures, which makes it applicable within a wide range of optimization frameworks. The results for pairwise multimodal and monomodal registrations between various images (T1, T2, PD, T1c, Flair) consistently show that the BGA significantly outperforms localized mutual information. The experimental results also confirm that the BGA can be a reliable alternative to the sum of absolute difference in monomodal image registration. The BGA can also achieve an accuracy of [Formula: see text], similar to that of the SSC, for the deformable registration of inhale and exhale CT scans. Specifically, for the highly challenging deformable registration of preoperative MRI and 3D intraoperative ultrasound images, the BGA achieves a similar registration accuracy of [Formula: see text] compared with state-of-the-art approaches, with a computation time of 18.3 s per case. The BGA improves the registration performance in terms of both accuracy and time efficiency. With further acceleration, the framework has the potential for

Gold Nanoconstructs for Multimodal Diagnostic Imaging and Photothermal Cancer Therapy

Science.gov (United States)

Coughlin, Andrew James

Cancer accounts for nearly 1 out of every 4 deaths in the United States, and because conventional treatments are limited by morbidity and off-target toxicities, improvements in cancer management are needed. This thesis further develops nanoparticle-assisted photothermal therapy (NAPT) as a viable treatment option for cancer patients. NAPT enables localized ablation of disease because heat generation only occurs where tissue permissive near-infrared (NIR) light and absorbing nanoparticles are combined, leaving surrounding normal tissue unharmed. Two principle approaches were investigated to improve the specificity of this technique: multimodal imaging and molecular targeting. Multimodal imaging affords the ability to guide NIR laser application for site-specific NAPT and more holistic characterization of disease by combining the advantages of several diagnostic technologies. Towards the goal of image-guided NAPT, gadolinium-conjugated gold-silica nanoshells were engineered and demonstrated to enhance imaging contrast across a range of diagnostic modes, including T1-weighted magnetic resonance imaging, X-Ray, optical coherence tomography, reflective confocal microscopy, and two-photon luminescence in vitro as well as within an animal tumor model. Additionally, the nanoparticle conjugates were shown to effectively convert NIR light to heat for applications in photothermal therapy. Therefore, the broad utility of gadolinium-nanoshells for anatomic localization of tissue lesions, molecular characterization of malignancy, and mediators of ablation was established. Molecular targeting strategies may also improve NAPT by promoting nanoparticle uptake and retention within tumors and enhancing specificity when malignant and normal tissue interdigitate. Here, ephrinA1 protein ligands were conjugated to nanoshell surfaces for particle homing to overexpressed EphA2 receptors on prostate cancer cells. In vitro, successful targeting and subsequent photothermal ablation of

Multimodal Image-Based Virtual Reality Presurgical Simulation and Evaluation for Trigeminal Neuralgia and Hemifacial Spasm.

Science.gov (United States)

Yao, Shujing; Zhang, Jiashu; Zhao, Yining; Hou, Yuanzheng; Xu, Xinghua; Zhang, Zhizhong; Kikinis, Ron; Chen, Xiaolei

2018-05-01

To address the feasibility and predictive value of multimodal image-based virtual reality in detecting and assessing features of neurovascular confliction (NVC), particularly regarding the detection of offending vessels, degree of compression exerted on the nerve root, in patients who underwent microvascular decompression for nonlesional trigeminal neuralgia and hemifacial spasm (HFS). This prospective study includes 42 consecutive patients who underwent microvascular decompression for classic primary trigeminal neuralgia or HFS. All patients underwent preoperative 1.5-T magnetic resonance imaging (MRI) with T2-weighted three-dimensional (3D) sampling perfection with application-optimized contrasts by using different flip angle evolutions, 3D time-of-flight magnetic resonance angiography, and 3D T1-weighted gadolinium-enhanced sequences in combination, whereas 2 patients underwent extra experimental preoperative 7.0-T MRI scans with the same imaging protocol. Multimodal MRIs were then coregistered with open-source software 3D Slicer, followed by 3D image reconstruction to generate virtual reality (VR) images for detection of possible NVC in the cerebellopontine angle. Evaluations were performed by 2 reviewers and compared with the intraoperative findings. For detection of NVC, multimodal image-based VR sensitivity was 97.6% (40/41) and specificity was 100% (1/1). Compared with the intraoperative findings, the κ coefficients for predicting the offending vessel and the degree of compression were >0.75 (P < 0.001). The 7.0-T scans have a clearer view of vessels in the cerebellopontine angle, which may have significant impact on detection of small-caliber offending vessels with relatively slow flow speed in cases of HFS. Multimodal image-based VR using 3D sampling perfection with application-optimized contrasts by using different flip angle evolutions in combination with 3D time-of-flight magnetic resonance angiography sequences proved to be reliable in detecting NVC

Label-free imaging of arterial cells and extracellular matrix using a multimodal CARS microscope

Science.gov (United States)

Wang, Han-Wei; Le, Thuc T.; Cheng, Ji-Xin

2008-04-01

A multimodal nonlinear optical imaging system that integrates coherent anti-Stokes Raman scattering (CARS), sum-frequency generation (SFG), and two-photon excitation fluorescence (TPEF) on the same platform was developed and applied to visualize single cells and extracellular matrix in fresh carotid arteries. CARS signals arising from CH 2-rich membranes allowed visualization of endothelial cells and smooth muscle cells of the arterial wall. Additionally, CARS microscopy allowed vibrational imaging of elastin and collagen fibrils which are also rich in CH 2 bonds. The extracellular matrix organization was further confirmed by TPEF signals arising from elastin's autofluorescence and SFG signals arising from collagen fibrils' non-centrosymmetric structure. Label-free imaging of significant components of arterial tissues suggests the potential application of multimodal nonlinear optical microscopy to monitor onset and progression of arterial diseases.

Multimodal Discourse Analysis of the Movie "Argo"

Science.gov (United States)

Bo, Xu

2018-01-01

Based on multimodal discourse theory, this paper makes a multimodal discourse analysis of some shots in the movie "Argo" from the perspective of context of culture, context of situation and meaning of image. Results show that this movie constructs multimodal discourse through particular context, language and image, and successfully…

Multimodal imaging of vascular network and blood microcirculation by optical diagnostic techniques

International Nuclear Information System (INIS)

Kuznetsov, Yu L; Kalchenko, V V; Meglinski, I V

2011-01-01

We present a multimodal optical diagnostic approach for simultaneous non-invasive in vivo imaging of blood and lymphatic microvessels, utilising a combined use of fluorescence intravital microscopy and a method of dynamic light scattering. This approach makes it possible to renounce the use of fluorescent markers for visualisation of blood vessels and, therefore, significantly (tenfold) reduce the toxicity of the technique and minimise side effects caused by the use of contrast fluorescent markers. We demonstrate that along with the ability to obtain images of lymph and blood microvessels with a high spatial resolution, current multimodal approach allows one to observe in real time permeability of blood vessels. This technique appears to be promising in physiology studies of blood vessels, and especially in the study of peripheral cardiovascular system in vivo. (optical technologies in biophysics and medicine)

Introduction of a standardized multimodality image protocol for navigation-guided surgery of suspected low-grade gliomas.

Science.gov (United States)

Mert, Aygül; Kiesel, Barbara; Wöhrer, Adelheid; Martínez-Moreno, Mauricio; Minchev, Georgi; Furtner, Julia; Knosp, Engelbert; Wolfsberger, Stefan; Widhalm, Georg

2015-01-01

OBJECT Surgery of suspected low-grade gliomas (LGGs) poses a special challenge for neurosurgeons due to their diffusely infiltrative growth and histopathological heterogeneity. Consequently, neuronavigation with multimodality imaging data, such as structural and metabolic data, fiber tracking, and 3D brain visualization, has been proposed to optimize surgery. However, currently no standardized protocol has been established for multimodality imaging data in modern glioma surgery. The aim of this study was therefore to define a specific protocol for multimodality imaging and navigation for suspected LGG. METHODS Fifty-one patients who underwent surgery for a diffusely infiltrating glioma with nonsignificant contrast enhancement on MRI and available multimodality imaging data were included. In the first 40 patients with glioma, the authors retrospectively reviewed the imaging data, including structural MRI (contrast-enhanced T1-weighted, T2-weighted, and FLAIR sequences), metabolic images derived from PET, or MR spectroscopy chemical shift imaging, fiber tracking, and 3D brain surface/vessel visualization, to define standardized image settings and specific indications for each imaging modality. The feasibility and surgical relevance of this new protocol was subsequently prospectively investigated during surgery with the assistance of an advanced electromagnetic navigation system in the remaining 11 patients. Furthermore, specific surgical outcome parameters, including the extent of resection, histological analysis of the metabolic hotspot, presence of a new postoperative neurological deficit, and intraoperative accuracy of 3D brain visualization models, were assessed in each of these patients. RESULTS After reviewing these first 40 cases of glioma, the authors defined a specific protocol with standardized image settings and specific indications that allows for optimal and simultaneous visualization of structural and metabolic data, fiber tracking, and 3D brain

MMX-I: A data-processing software for multi-modal X-ray imaging and tomography

International Nuclear Information System (INIS)

Bergamaschi, A; Medjoubi, K; Somogyi, A; Messaoudi, C; Marco, S

2017-01-01

Scanning hard X-ray imaging allows simultaneous acquisition of multimodal information, including X-ray fluorescence, absorption, phase and dark-field contrasts, providing structural and chemical details of the samples. Combining these scanning techniques with the infrastructure developed for fast data acquisition at Synchrotron Soleil permits to perform multimodal imaging and tomography during routine user experiments at the Nanoscopium beamline. A main challenge of such imaging techniques is the online processing and analysis of the generated very large volume (several hundreds of Giga Bytes) multimodal data-sets. This is especially important for the wide user community foreseen at the user oriented Nanoscopium beamline (e.g. from the fields of Biology, Life Sciences, Geology, Geobiology), having no experience in such data-handling. MMX-I is a new multi-platform open-source freeware for the processing and reconstruction of scanning multi-technique X-ray imaging and tomographic datasets. The MMX-I project aims to offer, both expert users and beginners, the possibility of processing and analysing raw data, either on-site or off-site. Therefore we have developed a multi-platform (Mac, Windows and Linux 64bit) data processing tool, which is easy to install, comprehensive, intuitive, extendable and user-friendly. MMX-I is now routinely used by the Nanoscopium user community and has demonstrated its performance in treating big data. (paper)

MMX-I: A data-processing software for multi-modal X-ray imaging and tomography

Science.gov (United States)

Bergamaschi, A.; Medjoubi, K.; Messaoudi, C.; Marco, S.; Somogyi, A.

2017-06-01

Scanning hard X-ray imaging allows simultaneous acquisition of multimodal information, including X-ray fluorescence, absorption, phase and dark-field contrasts, providing structural and chemical details of the samples. Combining these scanning techniques with the infrastructure developed for fast data acquisition at Synchrotron Soleil permits to perform multimodal imaging and tomography during routine user experiments at the Nanoscopium beamline. A main challenge of such imaging techniques is the online processing and analysis of the generated very large volume (several hundreds of Giga Bytes) multimodal data-sets. This is especially important for the wide user community foreseen at the user oriented Nanoscopium beamline (e.g. from the fields of Biology, Life Sciences, Geology, Geobiology), having no experience in such data-handling. MMX-I is a new multi-platform open-source freeware for the processing and reconstruction of scanning multi-technique X-ray imaging and tomographic datasets. The MMX-I project aims to offer, both expert users and beginners, the possibility of processing and analysing raw data, either on-site or off-site. Therefore we have developed a multi-platform (Mac, Windows and Linux 64bit) data processing tool, which is easy to install, comprehensive, intuitive, extendable and user-friendly. MMX-I is now routinely used by the Nanoscopium user community and has demonstrated its performance in treating big data.

Prussian blue nanocubes: multi-functional nanoparticles for multimodal imaging and image-guided therapy (Conference Presentation)

Science.gov (United States)

Cook, Jason R.; Dumani, Diego S.; Kubelick, Kelsey P.; Luci, Jeffrey; Emelianov, Stanislav Y.

2017-03-01

Imaging modalities utilize contrast agents to improve morphological visualization and to assess functional and molecular/cellular information. Here we present a new type of nanometer scale multi-functional particle that can be used for multi-modal imaging and therapeutic applications. Specifically, we synthesized monodisperse 20 nm Prussian Blue Nanocubes (PBNCs) with desired optical absorption in the near-infrared region and superparamagnetic properties. PBNCs showed excellent contrast in photoacoustic (700 nm wavelength) and MR (3T) imaging. Furthermore, photostability was assessed by exposing the PBNCs to nearly 1,000 laser pulses (5 ns pulse width) with up to 30 mJ/cm2 laser fluences. The PBNCs exhibited insignificant changes in photoacoustic signal, demonstrating enhanced robustness compared to the commonly used gold nanorods (substantial photodegradation with fluences greater than 5 mJ/cm2). Furthermore, the PBNCs exhibited superparamagnetism with a magnetic saturation of 105 emu/g, a 5x improvement over superparamagnetic iron-oxide (SPIO) nanoparticles. PBNCs exhibited enhanced T2 contrast measured using 3T clinical MRI. Because of the excellent optical absorption and magnetism, PBNCs have potential uses in other imaging modalities including optical tomography, microscopy, magneto-motive OCT/ultrasound, etc. In addition to multi-modal imaging, the PBNCs are multi-functional and, for example, can be used to enhance magnetic delivery and as therapeutic agents. Our initial studies show that stem cells can be labeled with PBNCs to perform image-guided magnetic delivery. Overall, PBNCs can act as imaging/therapeutic agents in diverse applications including cancer, cardiovascular disease, ophthalmology, and tissue engineering. Furthermore, PBNCs are based on FDA approved Prussian Blue thus potentially easing clinical translation of PBNCs.

Mannan-based conjugates as a multimodal imaging platform for lymph nodes

Czech Academy of Sciences Publication Activity Database

Rabyk, Mariia; Galisová, A.; Jirátová, M.; Patsula, Vitalii; Srbová, Linda; Loukotová, Lenka; Parnica, Jozef; Jirák, D.; Štěpánek, Petr; Hrubý, Martin

2018-01-01

Roč. 6, č. 17 (2018), s. 2584-2596 ISSN 2050-750X R&D Projects: GA MZd(CZ) NV15-25781A Institutional support: RVO:61389013 Keywords : polysaccharide modification * mannan * multimodal imaging Subject RIV: FR - Pharmacology ; Medidal Chemistry OBOR OECD: Pharmacology and pharmacy Impact factor: 4.543, year: 2016

Neuronal pathology in deep grey matter structures: a multimodal imaging analysis combining PET and MRI

Energy Technology Data Exchange (ETDEWEB)

Bosque-Freeman, L.; Leroy, C.; Galanaud, D.; Sureau, F.; Assouad, R.; Tourbah, A.; Papeix, C.; Comtat, C.; Trebossen, R.; Lubetzki, C.; Delforge, J.; Bottlaender, M.; Stankoff, B. [Serv. Hosp. Frederic Joliot, Orsay (France)

2009-07-01

Objective: To assess neuronal damage in deep gray matter structures by positron emission tomography (PET) using [{sup 11}C]-flumazenil (FMZ), a specific central benzodiazepine receptor antagonist, and [{sup 18}F]-fluorodeoxyglucose (FDG), which reflects neuronal metabolism. To compare results obtained by PET and those with multimodal magnetic resonance imaging (MRI). Background: It is now accepted that neuronal injury plays a crucial role in the occurrence and progression of neurological disability in multiple sclerosis (MS). To date, available MRI techniques do not specifically assess neuronal damage, but early abnormalities, such as iron deposition or atrophy, have been described in deep gray matter structures. Whether those MRI modifications correspond to neuronal damage remains to be further investigated. Materials and methods: Nine healthy volunteers were compared to 10 progressive and 9 relapsing remitting (RR) MS patients. Each subject performed two PET examinations with [{sup 11}C]-FMZ and [{sup 18}F]-FDG, on a high resolution research tomograph dedicated to brain imaging (Siemens Medical Solution, spatial resolution of 2.5 mm). Deep gray matter regions were manually segmented on T1-weighted MR images with the mutual information algorithm (www.brainvisa.info), and co-registered with PET images. A multimodal MRI including T1 pre and post gadolinium, T2-proton density sequences, magnetization transfer, diffusion tensor, and protonic spectroscopy was also performed for each subject. Results: On PET with [{sup 11}C]-FMZ, there was a pronounced decrease in receptor density for RR patients in all deep gray matter structures investigated, whereas the density was unchanged or even increased in the same regions for progressive patients. Whether the different patterns between RR and progressive patients reflect distinct pathogenic mechanisms is currently investigated by comparing PET and multimodal MRI results. Conclusion: Combination of PET and multimodal MR imaging

Segmentation of rodent whole-body dynamic PET images: an unsupervised method based on voxel dynamics

International Nuclear Information System (INIS)

Maroy, R.; Boisgard, R.; Comtat, C.; Dolle, F.; Trebossen, R.; Tavitian, B.; Frouin, V.; Cathier, P.; Duchesnay, E.; D; Nielsen, P.E.

2008-01-01

Positron emission tomography (PET) is a useful tool for pharmacokinetics studies in rodents during the preclinical phase of drug and tracer development. However, rodent organs are small as compared to the scanner's intrinsic resolution and are affected by physiological movements. We present a new method for the segmentation of rodent whole-body PET images that takes these two difficulties into account by estimating the pharmacokinetics far from organ borders. The segmentation method proved efficient on whole-body numerical rat phantom simulations, including 3-14 organs, together with physiological movements (heart beating, breathing, and bladder filling). The method was resistant to spillover and physiological movements, while other methods failed to obtain a correct segmentation. The radioactivity concentrations calculated with this method also showed an excellent correlation with the manual delineation of organs in a large set of preclinical images. In addition, it was faster, detected more organs, and extracted organs' mean time activity curves with a better confidence on the measure than manual delineation. (authors)

Water-stable NaLuF4-based upconversion nanophosphors with long-term validity for multimodal lymphatic imaging.

Science.gov (United States)

Zhou, Jing; Zhu, Xingjun; Chen, Min; Sun, Yun; Li, Fuyou

2012-09-01

Multimodal imaging is rapidly becoming an important tool for biomedical applications because it can compensate for the deficiencies of individual imaging modalities. Herein, multifunctional NaLuF(4)-based upconversion nanoparticles (Lu-UCNPs) were synthesized though a facile one-step microemulsion method under ambient condition. The doping of lanthanide ions (Gd(3+), Yb(3+) and Er(3+)/Tm(3+)) endows the Lu-UCNPs with high T(1)-enhancement, bright upconversion luminescence (UCL) emissions, and excellent X-ray absorption coefficient. Moreover, the as-prepared Lu-UCNPs are stable in water for more than six months, due to the protection of sodium glutamate and diethylene triamine pentacetate acid (DTPA) coordinating ligands on the surface. Lu-UCNPs have been successfully applied to the trimodal CT/MR/UCL lymphatic imaging on the modal of small animals. It is worth noting that Lu-UCNPs could be used for imaging even after preserving for over six months. In vitro transmission electron microscope (TEM), methyl thiazolyl tetrazolium (MTT) assay and histological analysis demonstrated that Lu-UCNPs exhibited low toxicity on living systems. Therefore, Lu-UCNPs could be multimodal agents for CT/MR/UCL imaging, and the concept can be served as a platform technology for the next-generation of probes for multimodal imaging. Copyright © 2012 Elsevier Ltd. All rights reserved.

Multimodality imaging in macular telangiectasia 2: A clue to its pathogenesis

Directory of Open Access Journals (Sweden)

Lihteh Wu

2015-01-01

Full Text Available Macular telangiectasia type 2 also known as idiopathic perifoveal telangiectasia and juxtafoveolar retinal telangiectasis type 2A is an acquired bilateral neurodegenerative macular disease that manifests itself during the fifth or sixth decades of life. It is characterized by minimal dilatation of the parafoveal capillaries with graying of the retinal area involved, a lack of lipid exudation, right-angled retinal venules, refractile deposits in the superficial retina, hyperplasia of the retinal pigment epithelium, foveal atrophy, and subretinal neovascularization (SRNV. Our understanding of the disease has paralleled advances in multimodality imaging of the fundus. Optical coherence tomography (OCT images typically demonstrate the presence of intraretinal hyporeflective spaces that are usually not related to retinal thickening or fluorescein leakage. The typical fluorescein angiographic (FA finding is a deep intraretinal hyperfluorescent staining in the temporal parafoveal area. With time, the staining may involve the whole parafoveal area but does not extend to the center of the fovea. Long-term prognosis for central vision is poor, because of the development of SRNV or macular atrophy. Its pathogenesis remains unclear but multimodality imaging with FA, spectral domain OCT, adaptive optics, confocal blue reflectance and short wave fundus autofluorescence implicate Müller cells and macular pigment. Currently, there is no known treatment for this condition.

Evaluation of registration strategies for multi-modality images of rat brain slices

International Nuclear Information System (INIS)

Palm, Christoph; Vieten, Andrea; Salber, Dagmar; Pietrzyk, Uwe

2009-01-01

In neuroscience, small-animal studies frequently involve dealing with series of images from multiple modalities such as histology and autoradiography. The consistent and bias-free restacking of multi-modality image series is obligatory as a starting point for subsequent non-rigid registration procedures and for quantitative comparisons with positron emission tomography (PET) and other in vivo data. Up to now, consistency between 2D slices without cross validation using an inherent 3D modality is frequently presumed to be close to the true morphology due to the smooth appearance of the contours of anatomical structures. However, in multi-modality stacks consistency is difficult to assess. In this work, consistency is defined in terms of smoothness of neighboring slices within a single modality and between different modalities. Registration bias denotes the distortion of the registered stack in comparison to the true 3D morphology and shape. Based on these metrics, different restacking strategies of multi-modality rat brain slices are experimentally evaluated. Experiments based on MRI-simulated and real dual-tracer autoradiograms reveal a clear bias of the restacked volume despite quantitatively high consistency and qualitatively smooth brain structures. However, different registration strategies yield different inter-consistency metrics. If no genuine 3D modality is available, the use of the so-called SOP (slice-order preferred) or MOSOP (modality-and-slice-order preferred) strategy is recommended.

Facile Fabrication of Animal-Specific Positioning Molds For Multi-modality Molecular Imaging

International Nuclear Information System (INIS)

Park, Jeong Chan; Oh, Ji Eun; Woo, Seung Tae

2008-01-01

Recently multi-modal imaging system has become widely adopted in molecular imaging. We tried to fabricate animal-specific positioning molds for PET/MR fusion imaging using easily available molding clay and rapid foam. The animal-specific positioning molds provide immobilization and reproducible positioning of small animal. Herein, we have compared fiber-based molding clay with rapid foam in fabricating the molds of experimental animal. The round bottomed-acrylic frame, which fitted into microPET gantry, was prepared at first. The experimental mice was anesthetized and placed on the mold for positioning. Rapid foam and fiber-based clay were used to fabricate the mold. In case of both rapid foam and the clay, the experimental animal needs to be pushed down smoothly into the mold for positioning. However, after the mouse was removed, the fabricated clay needed to be dried completely at 60 .deg. C in oven overnight for hardening. Four sealed pipe tips containing [ 18 F]FDG solution were used as fiduciary markers. After injection of [ 18 F]FDG via tail vein, microPET scanning was performed. Successively, MRI scanning was followed in the same animal. Animal-specific positioning molds were fabricated using rapid foam and fiber-based molding clay for multimodality imaging. Functional and anatomical images were obtained with microPET and MRI, respectively. The fused PET/MR images were obtained using freely available AMIDE program. Animal-specific molds were successfully prepared using easily available rapid foam, molding clay and disposable pipet tips. Thanks to animal-specific molds, fusion images of PET and MR were co-registered with negligible misalignment

Multimodality imaging in Europe: a survey by the European Association of Nuclear Medicine (EANM) and the European Society of Radiology (ESR)

International Nuclear Information System (INIS)

Cuocolo, Alberto; Breatnach, Eamann

2010-01-01

Multimodality imaging represents an area of rapid growth with important professional implication for both nuclear medicine physicians and radiologists throughout Europe. As a preliminary step for future action aimed at improving the quality and accessibility of PET/SPECT/CT multimodality imaging practice in Europe, the European Association of Nuclear Medicine (EANM) and the European Society of Radiology (ESR) performed a survey among the individual membership of both societies to obtain information on the status of multimodality imaging in their facilities and their future visions on training for combined modalities. A questionnaire was forwarded to all individual members of the EANM and ESR. The main subject matter of the questionnaire related to: (1) study performance, current procedures, current equipment including its supervisory personnel at respondents' individual facilities and (2) vision of future practice, performance and the potential for combined interdisciplinary viewing and training for future professionals. The reporting and the billing procedures of multimodality imaging studies are very heterogeneous in European countries. The majority of the members of both societies believe that the proportion of PET/CT conducted as a full diagnostic CT with contrast enhancement will increase over time. As expected, 18 F-FDG is the most commonly used PET tracer for clinical applications. The large majority of respondents were in favour of an interdisciplinary training programme being developed on a European level together by the EANM and the ESR and the respective sections of the European Union of Medical Specialists. The results of this survey show that there is wide heterogeneity in the current practice of multimodality imaging in Europe. This situation may limit the full potential and integration of multimodality imaging within the clinical arena. There is a strong desire within both specialties for the development of interdisciplinary training to address some

Multimodal Imaging of Brain Connectivity Using the MIBCA Toolbox: Preliminary Application to Alzheimer's Disease

Science.gov (United States)

Ribeiro, André Santos; Lacerda, Luís Miguel; Silva, Nuno André da; Ferreira, Hugo Alexandre

2015-06-01

The Multimodal Imaging Brain Connectivity Analysis (MIBCA) toolbox is a fully automated all-in-one connectivity analysis toolbox that offers both pre-processing, connectivity, and graph theory analysis of multimodal images such as anatomical, diffusion, and functional MRI, and PET. In this work, the MIBCA functionalities were used to study Alzheimer's Disease (AD) in a multimodal MR/PET approach. Materials and Methods: Data from 12 healthy controls, and 36 patients with EMCI, LMCI and AD (12 patients for each group) were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu), including T1-weighted (T1-w), Diffusion Tensor Imaging (DTI) data, and 18F-AV-45 (florbetapir) dynamic PET data from 40-60 min post injection (4x5 min). Both MR and PET data were automatically pre-processed for all subjects using MIBCA. T1-w data was parcellated into cortical and subcortical regions-of-interest (ROIs), and the corresponding thicknesses and volumes were calculated. DTI data was used to compute structural connectivity matrices based on fibers connecting pairs of ROIs. Lastly, dynamic PET images were summed, and the relative Standard Uptake Values calculated for each ROI. Results: An overall higher uptake of 18F-AV-45, consistent with an increased deposition of beta-amyloid, was observed for the AD group. Additionally, patients showed significant cortical atrophy (thickness and volume) especially in the entorhinal cortex and temporal areas, and a significant increase in Mean Diffusivity (MD) in the hippocampus, amygdala and temporal areas. Furthermore, patients showed a reduction of fiber connectivity with the progression of the disease, especially for intra-hemispherical connections. Conclusion: This work shows the potential of the MIBCA toolbox for the study of AD, as findings were shown to be in agreement with the literature. Here, only structural changes and beta-amyloid accumulation were considered. Yet, MIBCA is further able to

Multimodal scanning laser ophthalmoscopy for image guided treatment of age-related macular degeneration

Science.gov (United States)

Hammer, Daniel X.; Ferguson, R. D.; Patel, Ankit H.; Iftimia, Nicusor V.; Mujat, Mircea; Husain, Deeba

2009-02-01

Subretinal neovascular membranes (SRNM) are a deleterious complication of laser eye injury and retinal diseases such as age-related macular degeneration (AMD), choroiditis, and myopic retinopathy. Photodynamic therapy (PDT) and anti-vascular endothelial growth factor (VEGF) drugs are approved treatment methods. PDT acts by selective dye accumulation, activation by laser light, and disruption and clotting of the new leaky vessels. However, PDT surgery is currently not image-guided, nor does it proceed in an efficient or automated manner. This may contribute to the high rate of re-treatment. We have developed a multimodal scanning laser ophthalmoscope (SLO) for automated diagnosis and image-guided treatment of SRNMs associated with AMD. The system combines line scanning laser ophthalmoscopy (LSLO), fluorescein angiography (FA), indocyanine green angiography (ICGA), PDT laser delivery, and retinal tracking in a compact, efficient platform. This paper describes the system hardware and software design, performance characterization, and automated patient imaging and treatment session procedures and algorithms. Also, we present initial imaging and tracking measurements on normal subjects and automated lesion demarcation and sizing analysis of previously acquired angiograms. Future pre-clinical testing includes line scanning angiography and PDT treatment of AMD subjects. The automated acquisition procedure, enhanced and expedited data post-processing, and innovative image visualization and interpretation tools provided by the multimodal retinal imager may eventually aid in the diagnosis, treatment, and prognosis of AMD and other retinal diseases.

Multimodality Imaging Approach towards Primary Aortic Sarcomas Arising after Endovascular Abdominal Aortic Aneurysm Repair: Case Series Report

Energy Technology Data Exchange (ETDEWEB)

Kamran, Mudassar, E-mail: kamranm@mir.wustl.edu; Fowler, Kathryn J., E-mail: fowlerk@mir.wustl.edu; Mellnick, Vincent M., E-mail: mellnickv@mir.wustl.edu [Washington University School of Medicine, Mallinckrodt Institute of Radiology (United States); Sicard, Gregorio A., E-mail: sicard@wudosis.wustl.edu [Washington University School of Medicine, Department of Surgery (United States); Narra, Vamsi R., E-mail: narrav@mir.wustl.edu [Washington University School of Medicine, Mallinckrodt Institute of Radiology (United States)

2016-06-15

Primary aortic neoplasms are rare. Aortic sarcoma arising after endovascular aneurysm repair (EVAR) is a scarce subset of primary aortic malignancies, reports of which are infrequent in the published literature. The diagnosis of aortic sarcoma is challenging due to its non-specific clinical presentation, and the prognosis is poor due to delayed diagnosis, rapid proliferation, and propensity for metastasis. Post-EVAR, aortic sarcomas may mimic other more common aortic processes on surveillance imaging. Radiologists are rarely knowledgeable about this rare entity for which multimodality imaging and awareness are invaluable in early diagnosis. A series of three pathologically confirmed cases are presented to display the multimodality imaging features and clinical presentations of aortic sarcoma arising after EVAR.

Transferring Biomarker into Molecular Probe: Melanin Nanoparticle as a Naturally Active Platform for Multimodality Imaging

OpenAIRE

Fan, Quli; Cheng, Kai; Hu, Xiang; Ma, Xiaowei; Zhang, Ruiping; Yang, Min; Lu, Xiaomei; Xing, Lei; Huang, Wei; Gambhir, Sanjiv Sam; Cheng, Zhen

2014-01-01

Developing multifunctional and easily prepared nanoplatforms with integrated different modalities is highly challenging for molecular imaging. Here, we report the successful transfer of an important molecular target, melanin, into a novel multimodality imaging nanoplatform. Melanin is abundantly expressed in melanotic melanomas and thus has been actively studied as a target for melanoma imaging. In our work, the multifunctional biopolymer nanoplatform based on ultrasmall (

STRUCTURAL AND FUNCTIONAL CHARACTERIZATION OF BENIGN FLECK RETINA USING MULTIMODAL IMAGING.

Science.gov (United States)

Neriyanuri, Srividya; Rao, Chetan; Raman, Rajiv

2017-01-01

To report structural and functional features in a case series of benign fleck retina using multimodal imaging. Four cases with benign fleck retina underwent complete ophthalmic examination that included detailed history, visual acuity, and refractive error testing, FM-100 hue test, dilated fundus evaluation, full field electroretinogram, fundus photography with autofluorescence, fundus fluorescein angiography, and swept-source optical coherence tomography. Age group of the cases ranged from 19 years to 35 years (3 males and 1 female). Parental consanguinity was reported in two cases. All of them were visually asymptomatic with best-corrected visual acuity of 20/20 (moderate astigmatism) in both the eyes. Low color discrimination was seen in two cases. Fundus photography showed pisciform flecks which were compactly placed on posterior pole and were discrete, diverging towards periphery. Lesions were seen as smaller dots within 1500 microns from fovea and were hyperfluorescent on autofluorescence. Palisading retinal pigment epithelium defects were seen in posterior pole on fundus fluorescein angiography imaging; irregular hyper fluorescence was also noted. One case had reduced cone responses on full field electroretinogram; the other three cases had normal electroretinogram. On optical coherence tomography, level of lesions varied from retinal pigment epithelium, inner segment to outer segment extending till external limiting membrane. Functional and structural deficits in benign fleck retina were picked up using multimodal imaging.

Spatiotemporal Analysis of RGB-D-T Facial Images for Multimodal Pain Level Recognition

DEFF Research Database (Denmark)

Irani, Ramin; Nasrollahi, Kamal; Oliu Simon, Marc

2015-01-01

facial images for pain detection and pain intensity level recognition. For this purpose, we extract energies released by facial pixels using a spatiotemporal filter. Experiments on a group of 12 elderly people applying the multimodal approach show that the proposed method successfully detects pain...

Use of multimodality imaging and artificial intelligence for diagnosis and prognosis of early stages of Alzheimer's disease.

Science.gov (United States)

Liu, Xiaonan; Chen, Kewei; Wu, Teresa; Weidman, David; Lure, Fleming; Li, Jing

2018-04-01

Alzheimer's disease (AD) is a major neurodegenerative disease and the most common cause of dementia. Currently, no treatment exists to slow down or stop the progression of AD. There is converging belief that disease-modifying treatments should focus on early stages of the disease, that is, the mild cognitive impairment (MCI) and preclinical stages. Making a diagnosis of AD and offering a prognosis (likelihood of converting to AD) at these early stages are challenging tasks but possible with the help of multimodality imaging, such as magnetic resonance imaging (MRI), fluorodeoxyglucose (FDG)-positron emission topography (PET), amyloid-PET, and recently introduced tau-PET, which provides different but complementary information. This article is a focused review of existing research in the recent decade that used statistical machine learning and artificial intelligence methods to perform quantitative analysis of multimodality image data for diagnosis and prognosis of AD at the MCI or preclinical stages. We review the existing work in 3 subareas: diagnosis, prognosis, and methods for handling modality-wise missing data-a commonly encountered problem when using multimodality imaging for prediction or classification. Factors contributing to missing data include lack of imaging equipment, cost, difficulty of obtaining patient consent, and patient drop-off (in longitudinal studies). Finally, we summarize our major findings and provide some recommendations for potential future research directions. Copyright © 2018 Elsevier Inc. All rights reserved.

Cuticular Drusen: Clinical Phenotypes and Natural History Defined Using Multimodal Imaging.

Science.gov (United States)

Balaratnasingam, Chandrakumar; Cherepanoff, Svetlana; Dolz-Marco, Rosa; Killingsworth, Murray; Chen, Fred K; Mendis, Randev; Mrejen, Sarah; Too, Lay Khoon; Gal-Or, Orly; Curcio, Christine A; Freund, K Bailey; Yannuzzi, Lawrence A

2018-01-01

To define the range and life cycles of cuticular drusen phenotypes using multimodal imaging and to review the histologic characteristics of cuticular drusen. Retrospective, observational cohort study and experimental laboratory study. Two hundred forty eyes of 120 clinic patients with a cuticular drusen phenotype and 4 human donor eyes with cuticular drusen (n = 2), soft drusen (n = 1), and hard drusen (n = 1). We performed a retrospective review of clinical and multimodal imaging data of patients with a cuticular drusen phenotype. Patients had undergone imaging with various combinations of color photography, fluorescein angiography, indocyanine green angiography, near-infrared reflectance, fundus autofluorescence, high-resolution OCT, and ultrawide-field imaging. Human donor eyes underwent processing for high-resolution light and electron microscopy. Appearance of cuticular drusen in multimodal imaging and the topography of a cuticular drusen distribution; age-dependent variations in cuticular drusen phenotypes, including the occurrence of retinal pigment epithelium (RPE) abnormalities, choroidal neovascularization, acquired vitelliform lesions (AVLs), and geographic atrophy (GA); and ultrastructural and staining characteristics of druse subtypes. The mean age of patients at the first visit was 57.9±13.4 years. Drusen and RPE changes were seen in the peripheral retina, anterior to the vortex veins, in 21.8% of eyes. Of eyes with more than 5 years of follow-up, cuticular drusen disappeared from view in 58.3% of eyes, drusen coalescence was seen in 70.8% of eyes, and new RPE pigmentary changes developed in 56.2% of eyes. Retinal pigment epithelium abnormalities, AVLs, neovascularization, and GA occurred at a frequency of 47.5%, 24.2%, 12.5%, and 25%, respectively, and were significantly more common in patients older than 60 years of age (all P < 0.015). Occurrence of GA and neovascularization were important determinants of final visual acuity in eyes with the

Multi-modality imaging of tumor phenotype and response to therapy

Science.gov (United States)

Nyflot, Matthew J.

2011-12-01

Imaging and radiation oncology have historically been closely linked. However, the vast majority of techniques used in the clinic involve anatomical imaging. Biological imaging offers the potential for innovation in the areas of cancer diagnosis and staging, radiotherapy target definition, and treatment response assessment. Some relevant imaging techniques are FDG PET (for imaging cellular metabolism), FLT PET (proliferation), CuATSM PET (hypoxia), and contrast-enhanced CT (vasculature and perfusion). Here, a technique for quantitative spatial correlation of tumor phenotype is presented for FDG PET, FLT PET, and CuATSM PET images. Additionally, multimodality imaging of treatment response with FLT PET, CuATSM, and dynamic contrast-enhanced CT is presented, in a trial of patients receiving an antiangiogenic agent (Avastin) combined with cisplatin and radiotherapy. Results are also presented for translational applications in animal models, including quantitative assessment of proliferative response to cetuximab with FLT PET and quantification of vascular volume with a blood-pool contrast agent (Fenestra). These techniques have clear applications to radiobiological research and optimized treatment strategies, and may eventually be used for personalized therapy for patients.

Diffusion Maps for Multimodal Registration

Directory of Open Access Journals (Sweden)

Gemma Piella

2014-06-01

Full Text Available Multimodal image registration is a difficult task, due to the significant intensity variations between the images. A common approach is to use sophisticated similarity measures, such as mutual information, that are robust to those intensity variations. However, these similarity measures are computationally expensive and, moreover, often fail to capture the geometry and the associated dynamics linked with the images. Another approach is the transformation of the images into a common space where modalities can be directly compared. Within this approach, we propose to register multimodal images by using diffusion maps to describe the geometric and spectral properties of the data. Through diffusion maps, the multimodal data is transformed into a new set of canonical coordinates that reflect its geometry uniformly across modalities, so that meaningful correspondences can be established between them. Images in this new representation can then be registered using a simple Euclidean distance as a similarity measure. Registration accuracy was evaluated on both real and simulated brain images with known ground-truth for both rigid and non-rigid registration. Results showed that the proposed approach achieved higher accuracy than the conventional approach using mutual information.

The value of multimodality imaging in the investigation of a PSA recurrence after radical prostatectomy in the Irish hospital setting.

Science.gov (United States)

McLoughlin, L C; Inder, S; Moran, D; O'Rourke, C; Manecksha, R P; Lynch, T H

2018-02-01

The diagnostic evaluation of a PSA recurrence after RP in the Irish hospital setting involves multimodality imaging with MRI, CT, and bone scanning, despite the low diagnostic yield from imaging at low PSA levels. We aim to investigate the value of multimodality imaging in PC patients after RP with a PSA recurrence. Forty-eight patients with a PSA recurrence after RP who underwent multimodality imaging were evaluated. Demographic data, postoperative PSA levels, and imaging studies performed at those levels were evaluated. Eight (21%) MRIs, 6 (33%) CTs, and 4 (9%) bone scans had PCa-specific findings. Three (12%) patients had a positive MRI with a PSA PSA ≥1.1 ng/ml (p = 0.05). Zero patient had a positive CT TAP at a PSA level PSA levels PSA levels PSA levels ≥1.1 ng/ml. MRI alone is of investigative value at PSA <1.0 ng/ml. The indication for CT, MRI, or isotope bone scanning should be carefully correlated with the clinical question and how it will affect further management.

Multimodal segmentation of optic disc and cup from stereo fundus and SD-OCT images

Science.gov (United States)

Miri, Mohammad Saleh; Lee, Kyungmoo; Niemeijer, Meindert; Abràmoff, Michael D.; Kwon, Young H.; Garvin, Mona K.

2013-03-01

Glaucoma is one of the major causes of blindness worldwide. One important structural parameter for the diagnosis and management of glaucoma is the cup-to-disc ratio (CDR), which tends to become larger as glaucoma progresses. While approaches exist for segmenting the optic disc and cup within fundus photographs, and more recently, within spectral-domain optical coherence tomography (SD-OCT) volumes, no approaches have been reported for the simultaneous segmentation of these structures within both modalities combined. In this work, a multimodal pixel-classification approach for the segmentation of the optic disc and cup within fundus photographs and SD-OCT volumes is presented. In particular, after segmentation of other important structures (such as the retinal layers and retinal blood vessels) and fundus-to-SD-OCT image registration, features are extracted from both modalities and a k-nearest-neighbor classification approach is used to classify each pixel as cup, rim, or background. The approach is evaluated on 70 multimodal image pairs from 35 subjects in a leave-10%-out fashion (by subject). A significant improvement in classification accuracy is obtained using the multimodal approach over that obtained from the corresponding unimodal approach (97.8% versus 95.2%; p < 0:05; paired t-test).

Versatile quantitative phase imaging system applied to high-speed, low noise and multimodal imaging (Conference Presentation)

Science.gov (United States)

Federici, Antoine; Aknoun, Sherazade; Savatier, Julien; Wattellier, Benoit F.

2017-02-01

Quadriwave lateral shearing interferometry (QWLSI) is a well-established quantitative phase imaging (QPI) technique based on the analysis of interference patterns of four diffraction orders by an optical grating set in front of an array detector [1]. As a QPI modality, this is a non-invasive imaging technique which allow to measure the optical path difference (OPD) of semi-transparent samples. We present a system enabling QWLSI with high-performance sCMOS cameras [2] and apply it to perform high-speed imaging, low noise as well as multimodal imaging. This modified QWLSI system contains a versatile optomechanical device which images the optical grating near the detector plane. Such a device is coupled with any kind of camera by varying its magnification. In this paper, we study the use of a sCMOS Zyla5.5 camera from Andor along with our modified QWLSI system. We will present high-speed live cell imaging, up to 200Hz frame rate, in order to follow intracellular fast motions while measuring the quantitative phase information. The structural and density information extracted from the OPD signal is complementary to the specific and localized fluorescence signal [2]. In addition, QPI detects cells even when the fluorophore is not expressed. This is very useful to follow a protein expression with time. The 10 µm spatial pixel resolution of our modified QWLSI associated to the high sensitivity of the Zyla5.5 enabling to perform high quality fluorescence imaging, we have carried out multimodal imaging revealing fine structures cells, like actin filaments, merged with the morphological information of the phase. References [1]. P. Bon, G. Maucort, B. Wattellier, and S. Monneret, "Quadriwave lateral shearing interferometry for quantitative phase microscopy of living cells," Opt. Express, vol. 17, pp. 13080-13094, 2009. [2] P. Bon, S. Lécart, E. Fort and S. Lévêque-Fort, "Fast label-free cytoskeletal network imaging in living mammalian cells," Biophysical journal, 106

The clinical utility of multimodal MR image-guided needle biopsy in cerebral gliomas.

Science.gov (United States)

Yao, Chengjun; Lv, Shunzeng; Chen, Hong; Tang, Weijun; Guo, Jun; Zhuang, Dongxiao; Chrisochoides, Nikos; Wu, Jinsong; Mao, Ying; Zhou, Liangfu

2016-01-01

Our aim was to evaluate the diagnostic value of multimodal Magnetic Resonance (MR) Image in the stereotactic biopsy of cerebral gliomas, and investigate its implications. Twenty-four patients with cerebral gliomas underwent (1)H Magnetic Resonance Spectroscopy ((1)H-MRS)- and intraoperative Magnetic Resonance Imaging (iMRI)-supported stereotactic biopsy, and 23 patients underwent only the preoperative MRI-guided biopsy. The diagnostic yield, morbidity and mortality rates were analyzed. In addition, 20 patients underwent subsequent tumor resection, thus the diagnostic accuracy of the biopsy was further evaluated. The diagnostic accuracies of biopsies evaluated by tumor resection in the trial groups were better than control groups (92.3% and 42.9%, respectively, p = 0.031). The diagnostic yield in the trial groups was better than the control groups, but the difference was not statistically significant (100% and 82.6%, respectively, p = 0.05). The morbidity and mortality rates were similar in both groups. Multimodal MR image-guided glioma biopsy is practical and valuable. This technique can increase the diagnostic accuracy in the stereotactic biopsy of cerebral gliomas. Besides, it is likely to increase the diagnostic yield but requires further validation.

Optical imaging of mitochondrial redox state in rodent model of retinitis pigmentosa

Science.gov (United States)

Maleki, Sepideh; Gopalakrishnan, Sandeep; Ghanian, Zahra; Sepehr, Reyhaneh; Schmitt, Heather; Eells, Janis; Ranji, Mahsa

2013-01-01

Oxidative stress (OS) and mitochondrial dysfunction contribute to photoreceptor cell loss in retinal degenerative disorders. The metabolic state of the retina in a rodent model of retinitis pigmentosa (RP) was investigated using a cryo-fluorescence imaging technique. The mitochondrial metabolic coenzymes nicotinamide adenine dinucleotide (NADH) and flavin adenine dinucleotide (FAD) are autofluorescent and can be monitored without exogenous labels using optical techniques. The cryo-fluorescence redox imaging technique provides a quantitative assessment of the metabolism. More specifically, the ratio of the fluorescence intensity of these fluorophores (NADH/FAD), the NADH redox ratio (RR), is a marker of the metabolic state of the tissue. The NADH RR and retinal function were examined in an established rodent model of RP, the P23H rat compared to that of nondystrophic Sprague-Dawley (SD) rats. The NADH RR mean values were 1.11±0.03 in the SD normal and 0.841±0.01 in the P23H retina, indicating increased OS in the P23H retina. Electroretinographic data revealed a significant reduction in photoreceptor function in P23H animals compared to SD nozrmal rats. Thus, cryo-fluorescence redox imaging was used as a quantitative marker of OS in eyes from transgenic rats and demonstrated that alterations in the oxidative state of eyes occur during the early stages of RP.

Transferring biomarker into molecular probe: melanin nanoparticle as a naturally active platform for multimodality imaging.

Science.gov (United States)

Fan, Quli; Cheng, Kai; Hu, Xiang; Ma, Xiaowei; Zhang, Ruiping; Yang, Min; Lu, Xiaomei; Xing, Lei; Huang, Wei; Gambhir, Sanjiv Sam; Cheng, Zhen

2014-10-29

Developing multifunctional and easily prepared nanoplatforms with integrated different modalities is highly challenging for molecular imaging. Here, we report the successful transfer of an important molecular target, melanin, into a novel multimodality imaging nanoplatform. Melanin is abundantly expressed in melanotic melanomas and thus has been actively studied as a target for melanoma imaging. In our work, the multifunctional biopolymer nanoplatform based on ultrasmall (passive nanoplatforms require complicated and time-consuming processes for prebuilding reporting moieties or chemical modifications using active groups to integrate different contrast properties into one entity. In comparison, utilizing functional biomarker melanin can greatly simplify the building process. We further conjugated αvβ3 integrins, cyclic c(RGDfC) peptide, to MNPs to allow for U87MG tumor accumulation due to its targeting property combined with the enhanced permeability and retention (EPR) effect. The multimodal properties of MNPs demonstrate the high potential of endogenous materials with multifunctions as nanoplatforms for molecular theranostics and clinical translation.

Detail-enhanced multimodality medical image fusion based on gradient minimization smoothing filter and shearing filter.

Science.gov (United States)

Liu, Xingbin; Mei, Wenbo; Du, Huiqian

2018-02-13

In this paper, a detail-enhanced multimodality medical image fusion algorithm is proposed by using proposed multi-scale joint decomposition framework (MJDF) and shearing filter (SF). The MJDF constructed with gradient minimization smoothing filter (GMSF) and Gaussian low-pass filter (GLF) is used to decompose source images into low-pass layers, edge layers, and detail layers at multiple scales. In order to highlight the detail information in the fused image, the edge layer and the detail layer in each scale are weighted combined into a detail-enhanced layer. As directional filter is effective in capturing salient information, so SF is applied to the detail-enhanced layer to extract geometrical features and obtain directional coefficients. Visual saliency map-based fusion rule is designed for fusing low-pass layers, and the sum of standard deviation is used as activity level measurement for directional coefficients fusion. The final fusion result is obtained by synthesizing the fused low-pass layers and directional coefficients. Experimental results show that the proposed method with shift-invariance, directional selectivity, and detail-enhanced property is efficient in preserving and enhancing detail information of multimodality medical images. Graphical abstract The detailed implementation of the proposed medical image fusion algorithm.

Polymer encapsulated upconversion nanoparticle/iron oxide nanocomposites for multimodal imaging and magnetic targeted drug delivery.

Science.gov (United States)

Xu, Huan; Cheng, Liang; Wang, Chao; Ma, Xinxing; Li, Yonggang; Liu, Zhuang

2011-12-01

Multimodal imaging and imaging-guided therapies have become a new trend in the current development of cancer theranostics. In this work, we encapsulate hydrophobic upconversion nanoparticles (UCNPs) together with iron oxide nanoparticles (IONPs) by using an amphiphilic block copolymer, poly (styrene-block-allyl alcohol) (PS(16)-b-PAA(10)), via a microemulsion method, obtaining an UC-IO@Polymer multi-functional nanocomposite system. Fluorescent dye and anti-cancer drug molecules can be further loaded inside the UC-IO@Polymer nanocomposite for additional functionalities. Utilizing the Squaraine (SQ) dye loaded nanocomposite (UC-IO@Polymer-SQ), triple-modal upconversion luminescence (UCL)/down-conversion fluorescence (FL)/magnetic resonance (MR) imaging is demonstrated in vitro and in vivo, and also applied for in vivo cancer cell tracking in mice. On the other hand, a chemotherapy drug, doxorubicin, is also loaded into the nanocomposite, forming an UC-IO@Polymer-DOX complex, which enables novel imaging-guided and magnetic targeted drug delivery. Our work provides a method to fabricate a nanocomposite system with highly integrated functionalities for multimodal biomedical imaging and cancer therapy. Copyright © 2011 Elsevier Ltd. All rights reserved.

Development of a multi-scale and multi-modality imaging system to characterize tumours and their microenvironment in vivo

Science.gov (United States)

Rouffiac, Valérie; Ser-Leroux, Karine; Dugon, Emilie; Leguerney, Ingrid; Polrot, Mélanie; Robin, Sandra; Salomé-Desnoulez, Sophie; Ginefri, Jean-Christophe; Sebrié, Catherine; Laplace-Builhé, Corinne

2015-03-01

In vivo high-resolution imaging of tumor development is possible through dorsal skinfold chamber implantable on mice model. However, current intravital imaging systems are weakly tolerated along time by mice and do not allow multimodality imaging. Our project aims to develop a new chamber for: 1- long-term micro/macroscopic visualization of tumor (vascular and cellular compartments) and tissue microenvironment; and 2- multimodality imaging (photonic, MRI and sonography). Our new experimental device was patented in March 2014 and was primarily assessed on 75 mouse engrafted with 4T1-Luc tumor cell line, and validated in confocal and multiphoton imaging after staining the mice vasculature using Dextran 155KDa-TRITC or Dextran 2000kDa-FITC. Simultaneously, a universal stage was designed for optimal removal of respiratory and cardiac artifacts during microscopy assays. Experimental results from optical, ultrasound (Bmode and pulse subtraction mode) and MRI imaging (anatomic sequences) showed that our patented design, unlike commercial devices, improves longitudinal monitoring over several weeks (35 days on average against 12 for the commercial chamber) and allows for a better characterization of the early and late tissue alterations due to tumour development. We also demonstrated the compatibility for multimodality imaging and the increase of mice survival was by a factor of 2.9, with our new skinfold chamber. Current developments include: 1- defining new procedures for multi-labelling of cells and tissue (screening of fluorescent molecules and imaging protocols); 2- developing ultrasound and MRI imaging procedures with specific probes; 3- correlating optical/ultrasound/MRI data for a complete mapping of tumour development and microenvironment.

Operative and economic evaluation of a 'Laser Printer Multimodality' System

International Nuclear Information System (INIS)

Battaglia, G.; Moscatelli, G.; Maroldi, R.; Chiesa, A.

1991-01-01

The increasing application of digital techniques to diagnostic imaging is causing significant changes in several related activities, such as a reproduction of digital images on film. In the Department of Diagnostic Imaging of the University of Brescia, about 70% of the whole of images are produced by digital techniques; at present, most of these images are reproduced on film with a Multimodality System interfacing CT, MR, DSA, and DR units with a single laser printer. Our analysis evaluates the operative and economics aspects of image reproduction, by comparing the 'single cassette' multiformat Camera and the Laser Printer Multimodality SAystem. Our results point out the advantages obtained by reproducing images with a Laser Printer Multimodality System: outstanding quality, reproduction of multiple originals, and marked reduction in the time needed for both image archiving and film handling. The Laser Printer Multimodality System allows over 5 hours/day to be saved -that is to say the working day of an operator, who can be thus shifted to other functions. The important economic aspect of the reproduction of digital images on film proves the Laser Printer Multimodality System to have some advantage over Cameras

Modern spinal instrumentation. Part 2: Multimodality imaging approach for assessment of complications

International Nuclear Information System (INIS)

Allouni, A.K.; Davis, W.; Mankad, K.; Rankine, J.; Davagnanam, I.

2013-01-01

Radiologists frequently encounter studies demonstrating spinal instrumentation, either as part of the patient's postoperative evaluation, or as incidental to a study performed for another purpose. It is important for the reporting radiologist to identify potential complications of commonly used spinal implants. Part 1 of this review examined both the surgical approaches used and the normal appearances of these spinal implants and bone grafting techniques. This second part of the review will focus on the multimodal imaging strategy adopted in the assessment of the instrumented spine and the demonstration of imaging findings of common postoperative complications.

Culture and magnetic resonance image of magnetospirillum magneticum AMB1 for the application as a vector for multimodal image reporter

International Nuclear Information System (INIS)

Tae, Seong Ho; Vu, Nguyen H.; Jung, Young Yeon; Min, Jung Joon

2007-01-01

Magnetospirillum magneticum AMB-1 synthesize uniform, nano-sized magnetite (Fe3O4) particles, which are referred to as bacterial magnetic particles (BacMPs). BacMPs have potential for various technological applications and the molecular mechanism of their formation is of particular interest. In this study, we established the culture method for M. magneticum AMB-1 and analysed it's growth property and magnetic resonance image. Magnetospirillum magneticum AMB-1 strain was obtained from ATCC and inoculated in Magnetospirillum growth medium (MSGM). M. magneticum was cultured at 26? with 60 rpm shaking and check the optical density (OD) in 600 nm every 6 hours. Cultured M. magneticum that reached to stataionary phase was collected by centrifugation and suspend in PBS. MR image was taken by 1.5T MRI machine. The growth of M. magneticum was reached up to 0.2 OD600 at 80 hours after inoculation. The bacterial suspension was made the concentration 2 X 10-11 CFU/ml and successfully taken MR image using by 1.5T MRI machine. M. magneticum AMB strain was successfully cultured in our laboratory condition and was shown intensive MR image. Now we can use this bacteria as a multimodal image vector if the M. magneticum is transformed with an bioluminescent or fluorescent reporter gene. Further study about the development of M. magneticum strain as a multimodal image is needed

Multimodal optical coherence tomography and fluorescence lifetime imaging with interleaved excitation sources for simultaneous endogenous and exogenous fluorescence.

Science.gov (United States)

Shrestha, Sebina; Serafino, Michael J; Rico-Jimenez, Jesus; Park, Jesung; Chen, Xi; Zhaorigetu, Siqin; Walton, Brian L; Jo, Javier A; Applegate, Brian E

2016-09-01

Multimodal imaging probes a variety of tissue properties in a single image acquisition by merging complimentary imaging technologies. Exploiting synergies amongst the data, algorithms can be developed that lead to better tissue characterization than could be accomplished by the constituent imaging modalities taken alone. The combination of optical coherence tomography (OCT) with fluorescence lifetime imaging microscopy (FLIM) provides access to detailed tissue morphology and local biochemistry. The optical system described here merges 1310 nm swept-source OCT with time-domain FLIM having excitation at 355 and 532 nm. The pulses from 355 and 532 nm lasers have been interleaved to enable simultaneous acquisition of endogenous and exogenous fluorescence signals, respectively. The multimodal imaging system was validated using tissue phantoms. Nonspecific tagging with Alexa Flour 532 in a Watanbe rabbit aorta and active tagging of the LOX-1 receptor in human coronary artery, demonstrate the capacity of the system for simultaneous acquisition of OCT, endogenous FLIM, and exogenous FLIM in tissues.

Photoacoustic-Based Multimodal Nanoprobes: from Constructing to Biological Applications.

Science.gov (United States)

Gao, Duyang; Yuan, Zhen

2017-01-01

Multimodal nanoprobes have attracted intensive attentions since they can integrate various imaging modalities to obtain complementary merits of single modality. Meanwhile, recent interest in laser-induced photoacoustic imaging is rapidly growing due to its unique advantages in visualizing tissue structure and function with high spatial resolution and satisfactory imaging depth. In this review, we summarize multimodal nanoprobes involving photoacoustic imaging. In particular, we focus on the method to construct multimodal nanoprobes. We have divided the synthetic methods into two types. First, we call it "one for all" concept, which involves intrinsic properties of the element in a single particle. Second, "all in one" concept, which means integrating different functional blocks in one particle. Then, we simply introduce the applications of the multifunctional nanoprobes for in vivo imaging and imaging-guided tumor therapy. At last, we discuss the advantages and disadvantages of the present methods to construct the multimodal nanoprobes and share our viewpoints in this area.

Novel method to calculate pulmonary compliance images in rodents from computed tomography acquired at constant pressures

International Nuclear Information System (INIS)

Guerrero, Thomas; Castillo, Richard; Sanders, Kevin; Price, Roger; Komaki, Ritsuko; Cody, Dianna

2006-01-01

Our goal was to develop a method for generating high-resolution three-dimensional pulmonary compliance images in rodents from computed tomography (CT) images acquired at a series of constant pressures in ventilated animals. One rat and one mouse were used to demonstrate this technique. A pre-clinical GE flat panel CT scanner (maximum 31 line-pairs cm -1 resolution) was utilized for image acquisition. The thorax of each animal was imaged with breath-holds at 2, 6, 10, 14 and 18 cm H 2 O pressure in triplicate. A deformable image registration algorithm was applied to each pair of CT images to map corresponding tissue elements. Pulmonary compliance was calculated on a voxel by voxel basis using adjacent pairs of CT images. Triplicate imaging was used to estimate the measurement error of this technique. The 3D pulmonary compliance images revealed regional heterogeneity of compliance. The maximum total lung compliance measured 0.080 (±0.007) ml air per cm H 2 O per ml of lung and 0.039 (±0.004) ml air per cm H 2 O per ml of lung for the rat and mouse, respectively. In this study, we have demonstrated a unique method of quantifying regional lung compliance from 4 to 16 cm H 2 O pressure with sub-millimetre spatial resolution in rodents

Novelty detection of foreign objects in food using multi-modal X-ray imaging

DEFF Research Database (Denmark)

Einarsdottir, Hildur; Emerson, Monica Jane; Clemmensen, Line Katrine Harder

2016-01-01

In this paper we demonstrate a method for novelty detection of foreign objects in food products using grating-based multimodal X-ray imaging. With this imaging technique three modalities are available with pixel correspondence, enhancing organic materials such as wood chips, insects and soft...... plastics not detectable by conventional X-ray absorption radiography. We conduct experiments, where several food products are imaged with common foreign objects typically found in the food processing industry. To evaluate the benefit from using this multi-contrast X-ray technique over conventional X......-ray absorption imaging, a novelty detection scheme based on well known image- and statistical analysis techniques is proposed. The results show that the presented method gives superior recognition results and highlights the advantage of grating-based imaging....

AMIDE: A Free Software Tool for Multimodality Medical Image Analysis

Directory of Open Access Journals (Sweden)

Andreas Markus Loening

2003-07-01

Full Text Available Amide's a Medical Image Data Examiner (AMIDE has been developed as a user-friendly, open-source software tool for displaying and analyzing multimodality volumetric medical images. Central to the package's abilities to simultaneously display multiple data sets (e.g., PET, CT, MRI and regions of interest is the on-demand data reslicing implemented within the program. Data sets can be freely shifted, rotated, viewed, and analyzed with the program automatically handling interpolation as needed from the original data. Validation has been performed by comparing the output of AMIDE with that of several existing software packages. AMIDE runs on UNIX, Macintosh OS X, and Microsoft Windows platforms, and it is freely available with source code under the terms of the GNU General Public License.

Multimodal Nonlinear Optical Imaging for Sensitive Detection of Multiple Pharmaceutical Solid-State Forms and Surface Transformations.

Science.gov (United States)

Novakovic, Dunja; Saarinen, Jukka; Rojalin, Tatu; Antikainen, Osmo; Fraser-Miller, Sara J; Laaksonen, Timo; Peltonen, Leena; Isomäki, Antti; Strachan, Clare J

2017-11-07

Two nonlinear imaging modalities, coherent anti-Stokes Raman scattering (CARS) and sum-frequency generation (SFG), were successfully combined for sensitive multimodal imaging of multiple solid-state forms and their changes on drug tablet surfaces. Two imaging approaches were used and compared: (i) hyperspectral CARS combined with principal component analysis (PCA) and SFG imaging and (ii) simultaneous narrowband CARS and SFG imaging. Three different solid-state forms of indomethacin-the crystalline gamma and alpha forms, as well as the amorphous form-were clearly distinguished using both approaches. Simultaneous narrowband CARS and SFG imaging was faster, but hyperspectral CARS and SFG imaging has the potential to be applied to a wider variety of more complex samples. These methodologies were further used to follow crystallization of indomethacin on tablet surfaces under two storage conditions: 30 °C/23% RH and 30 °C/75% RH. Imaging with (sub)micron resolution showed that the approach allowed detection of very early stage surface crystallization. The surfaces progressively crystallized to predominantly (but not exclusively) the gamma form at lower humidity and the alpha form at higher humidity. Overall, this study suggests that multimodal nonlinear imaging is a highly sensitive, solid-state (and chemically) specific, rapid, and versatile imaging technique for understanding and hence controlling (surface) solid-state forms and their complex changes in pharmaceuticals.

An integrated multimodality image-guided robot system for small-animal imaging research

International Nuclear Information System (INIS)

Hsu, Wen-Lin; Hsin Wu, Tung; Hsu, Shih-Ming; Chen, Chia-Lin; Lee, Jason J.S.; Huang, Yung-Hui

2011-01-01

We design and construct an image-guided robot system for use in small-animal imaging research. This device allows the use of co-registered small-animal PET-MRI images to guide the movements of robotic controllers, which will accurately place a needle probe at any predetermined location inside, for example, a mouse tumor, for biological readouts without sacrificing the animal. This system is composed of three major components: an automated robot device, a CCD monitoring mechanism, and a multimodality registration implementation. Specifically, the CCD monitoring mechanism was used for correction and validation of the robot device. To demonstrate the value of the proposed system, we performed a tumor hypoxia study that involved FMISO small-animal PET imaging and the delivering of a pO 2 probe into the mouse tumor using the image-guided robot system. During our evaluation, the needle positioning error was found to be within 0.153±0.042 mm of desired placement; the phantom simulation errors were within 0.693±0.128 mm. In small-animal studies, the pO 2 probe measurements in the corresponding hypoxia areas showed good correlation with significant, low tissue oxygen tensions (less than 6 mmHg). We have confirmed the feasibility of the system and successfully applied it to small-animal investigations. The system could be easily adapted to extend to other biomedical investigations in the future.

Fully automated rodent brain MR image processing pipeline on a Midas server: from acquired images to region-based statistics.

Science.gov (United States)

Budin, Francois; Hoogstoel, Marion; Reynolds, Patrick; Grauer, Michael; O'Leary-Moore, Shonagh K; Oguz, Ipek

2013-01-01

Magnetic resonance imaging (MRI) of rodent brains enables study of the development and the integrity of the brain under certain conditions (alcohol, drugs etc.). However, these images are difficult to analyze for biomedical researchers with limited image processing experience. In this paper we present an image processing pipeline running on a Midas server, a web-based data storage system. It is composed of the following steps: rigid registration, skull-stripping, average computation, average parcellation, parcellation propagation to individual subjects, and computation of region-based statistics on each image. The pipeline is easy to configure and requires very little image processing knowledge. We present results obtained by processing a data set using this pipeline and demonstrate how this pipeline can be used to find differences between populations.

Multimodal imaging analysis of single-photon emission computed tomography and magnetic resonance tomography for improving diagnosis of Parkinson's disease

International Nuclear Information System (INIS)

Barthel, H.; Georgi, P.; Slomka, P.; Dannenberg, C.; Kahn, T.

2000-01-01

Parkinson's disease (PD) is characterized by a degeneration of nigrostriated dopaminergic neurons, which can be imaged with 123 I-labeled 2β-carbomethoxy-3β-(4-iodophenyl) tropane ([ 123 I]β-CIT) and single-photon emission computed tomography (SPECT). However, the quality of the region of interest (ROI) technique used for quantitative analysis of SPECT data is compromised by limited anatomical information in the images. We investigated whether the diagnosis of PD can be improved by combining the use of SPECT images with morphological image data from magnetic resonance imaging (MRI)/computed tomography (CT). We examined 27 patients (8 men, 19 women; aged 55±13 years) with PD (Hoehn and Yahr stage 2.1±0.8) by high-resolution [ 123 I]β-CIT SPECT (185-200 MBq, Ceraspect camera). SPECT images were analyzed both by a unimodal technique (ROIs defined directly within the SPECT studies) and a multimodal technique (ROIs defined within individual MRI/CT studies and transferred to the corresponding interactively coregistered SPECT studies). [ 123 I]β-CIT binding ratios (cerebellum as reference), which were obtained for heads of caudate nuclei (CA), putamina (PU), and global striatal structures were compared with clinical parameters. Differences between contra- and ipsilateral (related to symptom dominance) striatal [ 123 I]β-CIT binding ratios proved to be larger in the multimodal ROI technique than in the unimodal approach (e.g., for PU: 1.2*** vs. 0.7**). Binding ratios obtained by the unimodal ROI technique were significantly correlated with those of the multimodal technique (e.g., for CA: y=0.97x+2.8; r=0.70; P com subscore (r=-0.49* vs. -0.32). These results show that the impact of [ 123 I]β-CIT SPECT for diagnosing PD is affected by the method used to analyze the SPECT images. The described multimodal approach, which is based on coregistration of SPECT and morphological imaging data, leads to improved determination of the degree of this dopaminergic disorder

White paper of the European Association of Nuclear Medicine (EANM) and the European Society of Radiology (ESR) on multimodality imaging

International Nuclear Information System (INIS)

Bischof Delaloye, Angelika; Carrio, Ignasi; Cuocolo, Alberto; Knapp, Wolfram; Gourtsoyiannis, Nicholas; McCall, Iain; Reiser, Maximilian; Silberman, Bruno

2007-01-01

New multimodality imaging systems bring together anatomical and molecular information and require the competency and accreditation of individuals from both nuclear medicine and radiology. This paper sets out the positions and aspirations of the European Association of Nuclear Medicine (EANM) and the European Society of Radiology (ESR) working together on an equal and constructive basis for the future benefit of both specialties. EANM and ESR recognise the importance of coordinating working practices for multimodality imaging systems and that undertaking the nuclear medicine and radiology components of imaging with hybrid systems requires different skills. It is important to provide adequate and appropriate training in the two disciplines in order to offer a proper service to the patient using hybrid systems. Training models are proposed with the overall objective of providing opportunities for acquisition of special competency certification in multimodality imaging. Both organisations plan to develop common procedural guidelines and recognise the importance of coordinating the purchasing and management of hybrid systems to maximise the benefits to both specialties and to ensure appropriate reimbursement of these examinations. European multimodality imaging research is operating in a highly competitive environment. The coming years will decide whether European research in this area manages to defend its leading position or whether it falls behind research in other leading economies. Since research teams in the Member States are not always sufficiently interconnected, more European input is necessary to create interdisciplinary bridges between research institutions in Europe and to stimulate excellence. EANM and ESR will work with the European Institute for Biomedical Imaging Research (EIBIR) to develop further research opportunities across Europe. European Union grant-funding bodies should allocate funds to joint research initiatives that encompass clinical research

White paper of the European Society of Radiology (ESR) and the European Association of Nuclear Medicine (EANM) on multimodality imaging

International Nuclear Information System (INIS)

Gourtsoyiannis, Nicholas; McCall, Iain; Reiser, Maximilian; Silberman, Bruno; Bischof Delaloye, Angelika; Carrio, Ignacio; Cuocolo, Alberto; Knapp, Wolfram

2007-01-01

New multimodality imaging systems bring together anatomical and molecular information and require the competency and accreditation of individuals from both radiology and nuclear medicine. This paper sets out the positions and aspirations of the European Society of Radiology (ESR) and the European Association of Nuclear Medicine (EANM) working together on an equal and constructive basis for the future benefit of both specialties. ESR and EANM recognise the importance of coordinating working practices for multimodality imaging systems and that undertaking the radiology and nuclear medicine components of imaging with hybrid systems requires different skills. It is important to provide adequate and appropriate training in the two disciplines in order to offer a proper service to the patient using hybrid systems. Training models are proposed with the overall objective of providing opportunities for acquisition of special competency certification in multimodality imaging. Both organisations plan to develop common procedural guidelines and recognise the importance of coordinating the purchasing and management of hybrid systems to maximise the benefits to both specialties and to ensure appropriate reimbursement of these examinations. European multimodality imaging research is operating in a highly competitive environment. The coming years will decide whether European research in this area manages to defend its leading position or whether it falls behind research in other leading economies. Since research teams in the member states are not always sufficiently interconnected, more European input is necessary to create interdisciplinary bridges between research institutions in Europe and to stimulate excellence. ESR and EANM will work with the European Institute for Biomedical Imaging Research (EIBIR) to develop further research opportunities across Europe. European Union grant-funding bodies should allocate funds to joint research initiatives that encompass clinical research

A Multimodal Imaging Approach for Longitudinal Evaluation of Bladder Tumor Development in an Orthotopic Murine Model.

Directory of Open Access Journals (Sweden)

Chantal Scheepbouwer

Full Text Available Bladder cancer is the fourth most common malignancy amongst men in Western industrialized countries with an initial response rate of 70% for the non-muscle invasive type, and improving therapy efficacy is highly needed. For this, an appropriate, reliable animal model is essential to gain insight into mechanisms of tumor growth for use in response monitoring of (new agents. Several animal models have been described in previous studies, but so far success has been hampered due to the absence of imaging methods to follow tumor growth non-invasively over time. Recent developments of multimodal imaging methods for use in animal research have substantially strengthened these options of in vivo visualization of tumor growth. In the present study, a multimodal imaging approach was addressed to investigate bladder tumor proliferation longitudinally. The complementary abilities of Bioluminescence, High Resolution Ultrasound and Photo-acoustic Imaging permit a better understanding of bladder tumor development. Hybrid imaging modalities allow the integration of individual strengths to enable sensitive and improved quantification and understanding of tumor biology, and ultimately, can aid in the discovery and development of new therapeutics.

Classification of ADHD children through multimodal Magnetic Resonance Imaging

Directory of Open Access Journals (Sweden)

Dai eDai

2012-09-01

Full Text Available Attention deficit/hyperactivity disorder (ADHD is one of the most common diseases in school-age children. To date, the diagnosis of ADHD is mainly subjective and studies of objective diagnostic method are of great importance. Although many efforts have been made recently to investigate the use of structural and functional brain images for the diagnosis purpose, few of them are related to ADHD. In this paper, we introduce an automatic classification framework based on brain imaging features of ADHD patients, and present in detail the feature extraction, feature selection and classifier training methods. The effects of using different features are compared against each other. In addition, we integrate multimodal image features using multi-kernel learning (MKL. The performance of our framework has been validated in the ADHD-200 Global Competition, which is a world-wide classification contest on the ADHD-200 datasets. In this competition, our classification framework using features of resting-state functional connectivity was ranked the 6th out of 21 participants under the competition scoring policy, and performed the best in terms of sensitivity and J-statistic.

Non-invasive imaging and monitoring of rodent retina using simultaneous dual-band optical coherence tomography

Science.gov (United States)

Cimalla, Peter; Burkhardt, Anke; Walther, Julia; Hoefer, Aline; Wittig, Dierk; Funk, Richard; Koch, Edmund

2011-03-01

Spectral domain dual-band optical coherence tomography for simultaneous imaging of rodent retina in the 0.8 μm and 1.3 μm wavelength region and non-invasive monitoring of the posterior eye microstructure in the field of retinal degeneration research is demonstrated. The system is illuminated by a supercontinuum laser source and allows three-dimensional imaging with high axial resolution better than 3.8 μm and 5.3 μm in tissue at 800 nm and 1250 nm, respectively, for precise retinal thickness measurements. A fan-shaped scanning pattern with the pivot point close to the eye's pupil and a contact lens are applied to obtain optical access to the eye's fundus. First in vivo experiments in a RCS (royal college of surgeons) rat model with gene-related degeneration of the photoreceptor cells show good visibility of the retinal microstructure with sufficient contrast for thickness measurement of individual retinal layers. An enhanced penetration depth at 1250 nm is clearly identifiable revealing sub-choroidal structures that are not visible at 800 nm. Furthermore, additional simultaneous imaging at 1250 nm improves image quality by frequency compounding speckle noise reduction. These results are encouraging for time course studies of the rodent retina concerning its development related to disease progression and treatment response.

Primary evaluation of a nickel-chlorophyll derivative as a multimodality agent for tumor imaging and photodynamic therapy

International Nuclear Information System (INIS)

Ozge Er; Fatma Yurt Lambrecht; Kasim Ocakoglu; Cagla Kayabasi; Cumhur Gunduz

2015-01-01

In this study, the biological potential of a nickel chlorophyll derivative (Ni-PH-A) as a multimodal agent for tumor imaging and photodynamic therapy (PDT) was investigated. Optimum conditions of labeling with 131 I were investigated and determined as pH 10 and 1 mg amount of iodogen. Biodistribution results of 131 I labeled Ni-PH-A in female rats indicated that radiolabeled Ni-PH-A maximum uptake in the liver, spleen and ovary was observed at 30 min. Intercellular uptake and PDT efficacy of Ni-PH-A were better in MDAH-2774 (human ovarian endometrioid adenocarcinoma) than in MCF-7 (human breast adenocarcinoma) cells. Ni-PH-A might be a promising multimodal agent for lung, ovary and liver tumor imaging and PDT. (author)

VoxelStats: A MATLAB Package for Multi-Modal Voxel-Wise Brain Image Analysis.

Science.gov (United States)

Mathotaarachchi, Sulantha; Wang, Seqian; Shin, Monica; Pascoal, Tharick A; Benedet, Andrea L; Kang, Min Su; Beaudry, Thomas; Fonov, Vladimir S; Gauthier, Serge; Labbe, Aurélie; Rosa-Neto, Pedro

2016-01-01

In healthy individuals, behavioral outcomes are highly associated with the variability on brain regional structure or neurochemical phenotypes. Similarly, in the context of neurodegenerative conditions, neuroimaging reveals that cognitive decline is linked to the magnitude of atrophy, neurochemical declines, or concentrations of abnormal protein aggregates across brain regions. However, modeling the effects of multiple regional abnormalities as determinants of cognitive decline at the voxel level remains largely unexplored by multimodal imaging research, given the high computational cost of estimating regression models for every single voxel from various imaging modalities. VoxelStats is a voxel-wise computational framework to overcome these computational limitations and to perform statistical operations on multiple scalar variables and imaging modalities at the voxel level. VoxelStats package has been developed in Matlab(®) and supports imaging formats such as Nifti-1, ANALYZE, and MINC v2. Prebuilt functions in VoxelStats enable the user to perform voxel-wise general and generalized linear models and mixed effect models with multiple volumetric covariates. Importantly, VoxelStats can recognize scalar values or image volumes as response variables and can accommodate volumetric statistical covariates as well as their interaction effects with other variables. Furthermore, this package includes built-in functionality to perform voxel-wise receiver operating characteristic analysis and paired and unpaired group contrast analysis. Validation of VoxelStats was conducted by comparing the linear regression functionality with existing toolboxes such as glim_image and RMINC. The validation results were identical to existing methods and the additional functionality was demonstrated by generating feature case assessments (t-statistics, odds ratio, and true positive rate maps). In summary, VoxelStats expands the current methods for multimodal imaging analysis by allowing the

Template based rodent brain extraction and atlas mapping.

Science.gov (United States)

Weimin Huang; Jiaqi Zhang; Zhiping Lin; Su Huang; Yuping Duan; Zhongkang Lu

2016-08-01

Accurate rodent brain extraction is the basic step for many translational studies using MR imaging. This paper presents a template based approach with multi-expert refinement to automatic rodent brain extraction. We first build the brain appearance model based on the learning exemplars. Together with the template matching, we encode the rodent brain position into the search space to reliably locate the rodent brain and estimate the rough segmentation. With the initial mask, a level-set segmentation and a mask-based template learning are implemented further to the brain region. The multi-expert fusion is used to generate a new mask. We finally combine the region growing based on the histogram distribution learning to delineate the final brain mask. A high-resolution rodent atlas is used to illustrate that the segmented low resolution anatomic image can be well mapped to the atlas. Tested on a public data set, all brains are located reliably and we achieve the mean Jaccard similarity score at 94.99% for brain segmentation, which is a statistically significant improvement compared to two other rodent brain extraction methods.

An embedded system for image segmentation and multimodal registration in noninvasive skin cancer screening.

Science.gov (United States)

Diaz, Silvana; Soto, Javier E; Inostroza, Fabian; Godoy, Sebastian E; Figueroa, Miguel

2017-07-01

We present a heterogeneous architecture for image registration and multimodal segmentation on an embedded system for noninvasive skin cancer screening. The architecture combines Otsu thresholding and the random walker algorithm to perform image segmentation, and features a hardware implementation of the Harris corner detection algorithm to perform region-of-interest detection and image registration. Running on a Xilinx XC7Z020 reconfigurable system-on-a-chip, our prototype computes the initial segmentation of a 400×400-pixel region of interest in the visible spectrum in 12.1 seconds, and registers infrared images against this region at 540 frames per second, while consuming 1.9W.

Multi-modality image reconstruction for dual-head small-animal PET

International Nuclear Information System (INIS)

Huang, Chang-Han; Chou, Cheng-Ying

2015-01-01

The hybrid positron emission tomography/computed tomography (PET/CT) or positron emission tomography/magnetic resonance imaging (PET/MRI) has become routine practice in clinics. The applications of multi-modality imaging can also benefit research advances. Consequently, dedicated small-imaging system like dual-head small-animal PET (DHAPET) that possesses the advantages of high detection sensitivity and high resolution can exploit the structural information from CT or MRI. It should be noted that the special detector arrangement in DHAPET leads to severe data truncation, thereby degrading the image quality. We proposed to take advantage of anatomical priors and total variation (TV) minimization methods to reconstruct PET activity distribution form incomplete measurement data. The objective is to solve the penalized least-squares function consisted of data fidelity term, TV norm and medium root priors. In this work, we employed the splitting-based fast iterative shrinkage/thresholding algorithm to split smooth and non-smooth functions in the convex optimization problems. Our simulations studies validated that the images reconstructed by use of the proposed method can outperform those obtained by use of conventional expectation maximization algorithms or that without considering the anatomical prior information. Additionally, the convergence rate is also accelerated.

Near-infrared light-triggered theranostics for tumor-specific enhanced multimodal imaging and photothermal therapy

Directory of Open Access Journals (Sweden)

Wu B

2017-06-01

Full Text Available Bo Wu,1,* Bing Wan,2,* Shu-Ting Lu,1 Kai Deng,3 Xiao-Qi Li,1 Bao-Lin Wu,1 Yu-Shuang Li,1 Ru-Fang Liao,1 Shi-Wen Huang,3 Hai-Bo Xu1,2 1Department of Radiology, Zhongnan Hospital of Wuhan University, 2Department of Radiology, Union Hospital of Tongji Medical College, Huazhong University of Science and Technology, 3Department of Chemistry, Key Laboratory of Biomedical Polymers, Ministry of Education, Wuhan University, Wuhan, People’s Republic of China *These authors contributed equally to this work Abstract: The major challenge in current clinic contrast agents (CAs and chemotherapy is the poor tumor selectivity and response. Based on the self-quench property of IR820 at high concentrations, and different contrast effect ability of Gd-DOTA between inner and outer of liposome, we developed “bomb-like” light-triggered CAs (LTCAs for enhanced CT/MRI/FI multimodal imaging, which can improve the signal-to-noise ratio of tumor tissue specifically. IR820, Iohexol and Gd-chelates were firstly encapsulated into the thermal-sensitive nanocarrier with a high concentration. This will result in protection and fluorescence quenching. Then, the release of CAs was triggered by near-infrared (NIR light laser irradiation, which will lead to fluorescence and MRI activation and enable imaging of inflammation. In vitro and in vivo experiments demonstrated that LTCAs with 808 nm laser irradiation have shorter T1 relaxation time in MRI and stronger intensity in FI compared to those without irradiation. Additionally, due to the high photothermal conversion efficiency of IR820, the injection of LTCAs was demonstrated to completely inhibit C6 tumor growth in nude mice up to 17 days after NIR laser irradiation. The results indicate that the LTCAs can serve as a promising platform for NIR-activated multimodal imaging and photothermal therapy. Keywords: light triggered, near-infrared light, tumor-specific, multimodal imaging, photothermal therapy, contrast agents

Nanodiamond Landmarks for Subcellular Multimodal Optical and Electron Imaging

Science.gov (United States)

Zurbuchen, Mark A.; Lake, Michael P.; Kohan, Sirus A.; Leung, Belinda; Bouchard, Louis-S.

2013-01-01

There is a growing need for biolabels that can be used in both optical and electron microscopies, are non-cytotoxic, and do not photobleach. Such biolabels could enable targeted nanoscale imaging of sub-cellular structures, and help to establish correlations between conjugation-delivered biomolecules and function. Here we demonstrate a sub-cellular multi-modal imaging methodology that enables localization of inert particulate probes, consisting of nanodiamonds having fluorescent nitrogen-vacancy centers. These are functionalized to target specific structures, and are observable by both optical and electron microscopies. Nanodiamonds targeted to the nuclear pore complex are rapidly localized in electron-microscopy diffraction mode to enable “zooming-in” to regions of interest for detailed structural investigations. Optical microscopies reveal nanodiamonds for in-vitro tracking or uptake-confirmation. The approach is general, works down to the single nanodiamond level, and can leverage the unique capabilities of nanodiamonds, such as biocompatibility, sensitive magnetometry, and gene and drug delivery. PMID:24036840

Multimodal Translation System Using Texture-Mapped Lip-Sync Images for Video Mail and Automatic Dubbing Applications

Science.gov (United States)

Morishima, Shigeo; Nakamura, Satoshi

2004-12-01

We introduce a multimodal English-to-Japanese and Japanese-to-English translation system that also translates the speaker's speech motion by synchronizing it to the translated speech. This system also introduces both a face synthesis technique that can generate any viseme lip shape and a face tracking technique that can estimate the original position and rotation of a speaker's face in an image sequence. To retain the speaker's facial expression, we substitute only the speech organ's image with the synthesized one, which is made by a 3D wire-frame model that is adaptable to any speaker. Our approach provides translated image synthesis with an extremely small database. The tracking motion of the face from a video image is performed by template matching. In this system, the translation and rotation of the face are detected by using a 3D personal face model whose texture is captured from a video frame. We also propose a method to customize the personal face model by using our GUI tool. By combining these techniques and the translated voice synthesis technique, an automatic multimodal translation can be achieved that is suitable for video mail or automatic dubbing systems into other languages.

Focusing and imaging with increased numerical apertures through multimode fibers with micro-fabricated optics.

Science.gov (United States)

Bianchi, S; Rajamanickam, V P; Ferrara, L; Di Fabrizio, E; Liberale, C; Di Leonardo, R

2013-12-01

The use of individual multimode optical fibers in endoscopy applications has the potential to provide highly miniaturized and noninvasive probes for microscopy and optical micromanipulation. A few different strategies have been proposed recently, but they all suffer from intrinsically low resolution related to the low numerical aperture of multimode fibers. Here, we show that two-photon polymerization allows for direct fabrication of micro-optics components on the fiber end, resulting in an increase of the numerical aperture to a value that is close to 1. Coupling light into the fiber through a spatial light modulator, we were able to optically scan a submicrometer spot (300 nm FWHM) over an extended region, facing the opposite fiber end. Fluorescence imaging with improved resolution is also demonstrated.

Tissue imaging using full field optical coherence microscopy with short multimode fiber probe

Science.gov (United States)

Sato, Manabu; Eto, Kai; Goto, Tetsuhiro; Kurotani, Reiko; Abe, Hiroyuki; Nishidate, Izumi

2018-03-01

In achieving minimally invasive accessibility to deeply located regions the size of the imaging probes is important. We demonstrated full-field optical coherence tomography (FF-OCM) using an ultrathin forward-imaging short multimode fiber (SMMF) probe of 50 μm core diameter, 125 μm diameter, and 7.4 mm length for optical communications. The axial resolution was measured to be 2.14 μm and the lateral resolution was also evaluated to be below 4.38 μm using a test pattern (TP). The spatial mode and polarization characteristics of SMMF were evaluated. Inserting SMMF to in vivo rat brain, 3D images were measured and 2D information of nerve fibers was obtained. The feasibility of an SMMF as an ultrathin forward-imaging probe in FF-OCM has been demonstrated.

Development of magneto-plasmonic nanoparticles for multimodal image-guided therapy to the brain

OpenAIRE

Tomitaka, Asahi; Arami, Hamed; Raymond, Andrea; Yndart, Adriana; Kaushik, Ajeet; Jayant, Rahul Dev; Takemura, Yasushi; Cai, Yong; Toborek, Michal; Nair, Madhavan

2017-01-01

Magneto-plasmonic nanoparticles are one of the emerging multi-functional materials in the field of nanomedicine. Their potential for targeting and multi-modal imaging is highly attractive. In this study, magnetic core / gold shell (MNP@Au) magneto-plasmonic nanoparticles were synthesized by citrate reduction of Au ion on magnetic nanoparticle seeds. Hydrodynamic size and optical property of magneto-plasmonic nanoparticles synthesized with the variation of Au ion and reducing agent concentrati...

Focusing and imaging with increased numerical apertures through multimode fibers with micro-fabricated optics

KAUST Repository

Bianchi, Silvio; Rajamanickam, V.; Ferrara, Lorenzo; Di Fabrizio, Enzo M.; Liberale, Carlo; Di Leonardo, Roberto

2013-01-01

The use of individual multimode optical fibers in endoscopy applications has the potential to provide highly miniaturized and noninvasive probes for microscopy and optical micromanipulation. A few different strategies have been proposed recently, but they all suffer from intrinsically low resolution related to the low numerical aperture of multimode fibers. Here, we show that two-photon polymerization allows for direct fabrication of micro-optics components on the fiber end, resulting in an increase of the numerical aperture to a value that is close to 1. Coupling light into the fiber through a spatial light modulator, we were able to optically scan a submicrometer spot (300 nm FWHM) over an extended region, facing the opposite fiber end. Fluorescence imaging with improved resolution is also demonstrated. © 2013 Optical Society of America.

ADMultiImg: a novel missing modality transfer learning based CAD system for diagnosis of MCI due to AD using incomplete multi-modality imaging data

Science.gov (United States)

Liu, Xiaonan; Chen, Kewei; Wu, Teresa; Weidman, David; Lure, Fleming; Li, Jing

2018-02-01

Alzheimer's Disease (AD) is the most common cause of dementia and currently has no cure. Treatments targeting early stages of AD such as Mild Cognitive Impairment (MCI) may be most effective to deaccelerate AD, thus attracting increasing attention. However, MCI has substantial heterogeneity in that it can be caused by various underlying conditions, not only AD. To detect MCI due to AD, NIA-AA published updated consensus criteria in 2011, in which the use of multi-modality images was highlighted as one of the most promising methods. It is of great interest to develop a CAD system based on automatic, quantitative analysis of multi-modality images and machine learning algorithms to help physicians more adequately diagnose MCI due to AD. The challenge, however, is that multi-modality images are not universally available for many patients due to cost, access, safety, and lack of consent. We developed a novel Missing Modality Transfer Learning (MMTL) algorithm capable of utilizing whatever imaging modalities are available for an MCI patient to diagnose the patient's likelihood of MCI due to AD. Furthermore, we integrated MMTL with radiomics steps including image processing, feature extraction, and feature screening, and a post-processing for uncertainty quantification (UQ), and developed a CAD system called "ADMultiImg" to assist clinical diagnosis of MCI due to AD using multi-modality images together with patient demographic and genetic information. Tested on ADNI date, our system can generate a diagnosis with high accuracy even for patients with only partially available image modalities (AUC=0.94), and therefore may have broad clinical utility.

Optical imaging of oxidative stress in retinitis pigmentosa (RP) in rodent model

Science.gov (United States)

Ghanian, Zahra; Maleki, Sepideh; Gopalakrishnan, Sandeep; Sepehr, Reyhaneh; Eells, Janis T.; Ranji, Mahsa

2013-02-01

Oxidative stress (OS), which increases during retinal degenerative disorders, contributes to photoreceptor cell loss. The objective of this study was to investigate the changes in the metabolic state of the eye tissue in rodent models of retinitis pigmentosa by using the cryofluorescence imaging technique. The mitochondrial metabolic coenzymes NADH and FADH2 are autofluorescent and can be monitored without exogenous labels using optical techniques. The NADH redox ratio (RR), which is the ratio of the fluorescence intensity of these fluorophores (NADH/FAD), was used as a quantitative diagnostic marker. The NADH RR was examined in an established rodent model of retinitis pigmentosa (RP), the P23H rat, and compared to that of control Sprague-Dawley (SD) rats and P23H NIR treated rats. Our results demonstrated 24% decrease in the mean NADH RR of the eyes from P23H transgenic rats compared to normal rats and 20% increase in the mean NADH RR of the eyes from the P23H NIR treated rats compared to P23H non-treated rats.

Intratumoral Administration of Holmium-166 Acetylacetonate Microspheres : Antitumor Efficacy and Feasibility of Multimodality Imaging in Renal Cancer

NARCIS (Netherlands)

Bult, Wouter; Kroeze, Stephanie G. C.; Elschot, Mattijs; Seevinck, Peter R.; Beekman, Freek J.; de Jong, Hugo W. A. M.; Uges, Donald R. A.; Kosterink, Jos G. W.; Luijten, Peter R.; Hennink, Wim E.; Schip, Alfred D. van Het; Bosch, J. L. H. Ruud; Nijsen, J. Frank W.; Jans, Judith J. M.

2013-01-01

Purpose: The increasing incidence of small renal tumors in an aging population with comorbidities has stimulated the development of minimally invasive treatments. This study aimed to assess the efficacy and demonstrate feasibility of multimodality imaging of intratumoral administration of

Multimodal Translation System Using Texture-Mapped Lip-Sync Images for Video Mail and Automatic Dubbing Applications

Directory of Open Access Journals (Sweden)

Nakamura Satoshi

2004-01-01

Full Text Available We introduce a multimodal English-to-Japanese and Japanese-to-English translation system that also translates the speaker's speech motion by synchronizing it to the translated speech. This system also introduces both a face synthesis technique that can generate any viseme lip shape and a face tracking technique that can estimate the original position and rotation of a speaker's face in an image sequence. To retain the speaker's facial expression, we substitute only the speech organ's image with the synthesized one, which is made by a 3D wire-frame model that is adaptable to any speaker. Our approach provides translated image synthesis with an extremely small database. The tracking motion of the face from a video image is performed by template matching. In this system, the translation and rotation of the face are detected by using a 3D personal face model whose texture is captured from a video frame. We also propose a method to customize the personal face model by using our GUI tool. By combining these techniques and the translated voice synthesis technique, an automatic multimodal translation can be achieved that is suitable for video mail or automatic dubbing systems into other languages.

vECTlab-A fully integrated multi-modality Monte Carlo simulation framework for the radiological imaging sciences

International Nuclear Information System (INIS)

Peter, Joerg; Semmler, Wolfhard

2007-01-01

Alongside and in part motivated by recent advances in molecular diagnostics, the development of dual-modality instruments for patient and dedicated small animal imaging has gained attention by diverse research groups. The desire for such systems is high not only to link molecular or functional information with the anatomical structures, but also for detecting multiple molecular events simultaneously at shorter total acquisition times. While PET and SPECT have been integrated successfully with X-ray CT, the advance of optical imaging approaches (OT) and the integration thereof into existing modalities carry a high application potential, particularly for imaging small animals. A multi-modality Monte Carlo (MC) simulation approach at present has been developed that is able to trace high-energy (keV) as well as optical (eV) photons concurrently within identical phantom representation models. We show that the involved two approaches for ray-tracing keV and eV photons can be integrated into a unique simulation framework which enables both photon classes to be propagated through various geometry models representing both phantoms and scanners. The main advantage of such integrated framework for our specific application is the investigation of novel tomographic multi-modality instrumentation intended for in vivo small animal imaging through time-resolved MC simulation upon identical phantom geometries. Design examples are provided for recently proposed SPECT-OT and PET-OT imaging systems

Comparison of two imaging protocols for acute stroke: unenhanced cranial CT versus a multimodality cranial CT protocol with perfusion imaging

International Nuclear Information System (INIS)

Langer, R. D.; Gorkom, K. Neidl van.; Kaabi, Ho Al.; Torab, F.; Czechowski, J.; Nagi, M.; Ashish, G. M.

2007-01-01

Full text: The aim of the study was to validate a multimodality cranial computed tomography (CCT) protocol for patients with acute stroke in the United Arab Emirates as a basic imaging procedure for a stroke unit. Therefore, a comparative study was conducted between two groups: retrospective, historical group 1 with early unenhanced CCT and prospective group 2 undergoing a multimodality CCT protocol. Follow-up unenhanced CCT >48 h served as gold standard in both groups. Group 1: Early unenhanced CCT of 50 patients were evaluated retrospectively, using Alberta Stroke Program Early CT Score, and compared with the definite infarction on follow-up CCT. Group 2: 50 patients underwent multimodality CCT (unenhanced CCT, perfusion studies: cerebral blood flow, cerebral blood volume, mean transit time and CT angiography) <8 h after clinical onset and follow-up studies. Modified National Institute of Health Stroke Scale was used clinically in both groups. Group 1 showed 38 men, 12 women, clinical onset 2-8 h before CCT and modified National Institute of Health Stroke Scale 0-28. Group 2 included 38 men, 12 women, onset 3-8 h before CCT, modified National Institute of Health Stroke Scale 0-28. Sensitivity was 58.3% in group 1 and 84.2% in group 2. Computed tomography angiography detected nine intracranial occlusions/stenoses. The higher sensitivity of the multimodality CCT protocol justifies its use as a basic diagnostic tool for the set-up of a first-stroke unit in the United Arab Emirates

Simultaneous in vivo imaging of melanin and lipofuscin in the retina with multimodal photoacoustic ophthalmoscopy

Science.gov (United States)

Zhang, Xiangyang; Zhang, Hao F.; Zhou, Lixiang; Jiao, Shuliang

2012-02-01

We combined photoacoustic ophthalmoscopy (PAOM) with autofluorescence imaging for simultaneous in vivo imaging of dual molecular contrasts in the retina using a single light source. The dual molecular contrasts come from melanin and lipofuscin in the retinal pigment epithelium (RPE). Melanin and lipofuscin are two types of pigments and are believed to play opposite roles (protective vs. exacerbate) in the RPE in the aging process. We successfully imaged the retina of pigmented and albino rats at different ages. The experimental results showed that multimodal PAOM system can be a potentially powerful tool in the study of age-related degenerative retinal diseases.

Multimodality medical image database for temporal lobe epilepsy

Science.gov (United States)

Siadat, Mohammad-Reza; Soltanian-Zadeh, Hamid; Fotouhi, Farshad A.; Elisevich, Kost

2003-05-01

This paper presents the development of a human brain multi-modality database for surgical candidacy determination in temporal lobe epilepsy. The focus of the paper is on content-based image management, navigation and retrieval. Several medical image-processing methods including our newly developed segmentation method are utilized for information extraction/correlation and indexing. The input data includes T1-, T2-Weighted and FLAIR MRI and ictal/interictal SPECT modalities with associated clinical data and EEG data analysis. The database can answer queries regarding issues such as the correlation between the attribute X of the entity Y and the outcome of a temporal lobe epilepsy surgery. The entity Y can be a brain anatomical structure such as the hippocampus. The attribute X can be either a functionality feature of the anatomical structure Y, calculated with SPECT modalities, such as signal average, or a volumetric/morphological feature of the entity Y such as volume or average curvature. The outcome of the surgery can be any surgery assessment such as non-verbal Wechsler memory quotient. A determination is made regarding surgical candidacy by analysis of both textual and image data. The current database system suggests a surgical determination for the cases with relatively small hippocampus and high signal intensity average on FLAIR images within the hippocampus. This indication matches the neurosurgeons expectations/observations. Moreover, as the database gets more populated with patient profiles and individual surgical outcomes, using data mining methods one may discover partially invisible correlations between the contents of different modalities of data and the outcome of the surgery.

Multimodal imaging evaluation in staging of rectal cancer

Science.gov (United States)

Heo, Suk Hee; Kim, Jin Woong; Shin, Sang Soo; Jeong, Yong Yeon; Kang, Heoung-Keun

2014-01-01

Rectal cancer is a common cancer and a major cause of mortality in Western countries. Accurate staging is essential for determining the optimal treatment strategies and planning appropriate surgical procedures to control rectal cancer. Endorectal ultrasonography (EUS) is suitable for assessing the extent of tumor invasion, particularly in early-stage or superficial rectal cancer cases. In advanced cases with distant metastases, computed tomography (CT) is the primary approach used to evaluate the disease. Magnetic resonance imaging (MRI) is often used to assess preoperative staging and the circumferential resection margin involvement, which assists in evaluating a patient’s risk of recurrence and their optimal therapeutic strategy. Positron emission tomography (PET)-CT may be useful in detecting occult synchronous tumors or metastases at the time of initial presentation. Restaging after neoadjuvant chemoradiotherapy (CRT) remains a challenge with all modalities because it is difficult to reliably differentiate between the tumor mass and other radiation-induced changes in the images. EUS does not appear to have a useful role in post-therapeutic response assessments. Although CT is most commonly used to evaluate treatment responses, its utility for identifying and following-up metastatic lesions is limited. Preoperative high-resolution MRI in combination with diffusion-weighted imaging, and/or PET-CT could provide valuable prognostic information for rectal cancer patients with locally advanced disease receiving preoperative CRT. Based on these results, we conclude that a combination of multimodal imaging methods should be used to precisely assess the restaging of rectal cancer following CRT. PMID:24764662

Multimodal imaging of language reorganization in patients with left temporal lobe epilepsy.

Science.gov (United States)

Chang, Yu-Hsuan A; Kemmotsu, Nobuko; Leyden, Kelly M; Kucukboyaci, N Erkut; Iragui, Vicente J; Tecoma, Evelyn S; Kansal, Leena; Norman, Marc A; Compton, Rachelle; Ehrlich, Tobin J; Uttarwar, Vedang S; Reyes, Anny; Paul, Brianna M; McDonald, Carrie R

2017-07-01

This study explored the relationships among multimodal imaging, clinical features, and language impairment in patients with left temporal lobe epilepsy (LTLE). Fourteen patients with LTLE and 26 controls underwent structural MRI, functional MRI, diffusion tensor imaging, and neuropsychological language tasks. Laterality indices were calculated for each imaging modality and a principal component (PC) was derived from language measures. Correlations were performed among imaging measures, as well as to the language PC. In controls, better language performance was associated with stronger left-lateralized temporo-parietal and temporo-occipital activations. In LTLE, better language performance was associated with stronger right-lateralized inferior frontal, temporo-parietal, and temporo-occipital activations. These right-lateralized activations in LTLE were associated with right-lateralized arcuate fasciculus fractional anisotropy. These data suggest that interhemispheric language reorganization in LTLE is associated with alterations to perisylvian white matter. These concurrent structural and functional shifts from left to right may help to mitigate language impairment in LTLE. Copyright © 2017 Elsevier Inc. All rights reserved.

Intraoperative high-field magnetic resonance imaging, multimodal neuronavigation, and intraoperative electrophysiological monitoring-guided surgery for treating supratentorial cavernomas.

Science.gov (United States)

Li, Fang-Ye; Chen, Xiao-Lei; Xu, Bai-Nan

2016-09-01

To determine the beneficial effects of intraoperative high-field magnetic resonance imaging (MRI), multimodal neuronavigation, and intraoperative electrophysiological monitoring-guided surgery for treating supratentorial cavernomas. Twelve patients with 13 supratentorial cavernomas were prospectively enrolled and operated while using a 1.5 T intraoperative MRI, multimodal neuronavigation, and intraoperative electrophysiological monitoring. All cavernomas were deeply located in subcortical areas or involved critical areas. Intraoperative high-field MRIs were obtained for the intraoperative "visualization" of surrounding eloquent structures, "brain shift" corrections, and navigational plan updates. All cavernomas were successfully resected with guidance from intraoperative MRI, multimodal neuronavigation, and intraoperative electrophysiological monitoring. In 5 cases with supratentorial cavernomas, intraoperative "brain shift" severely deterred locating of the lesions; however, intraoperative MRI facilitated precise locating of these lesions. During long-term (>3 months) follow-up, some or all presenting signs and symptoms improved or resolved in 4 cases, but were unchanged in 7 patients. Intraoperative high-field MRI, multimodal neuronavigation, and intraoperative electrophysiological monitoring are helpful in surgeries for the treatment of small deeply seated subcortical cavernomas.

Two Phase Non-Rigid Multi-Modal Image Registration Using Weber Local Descriptor-Based Similarity Metrics and Normalized Mutual Information

Directory of Open Access Journals (Sweden)

Feng Yang

2013-06-01

Full Text Available Non-rigid multi-modal image registration plays an important role in medical image processing and analysis. Existing image registration methods based on similarity metrics such as mutual information (MI and sum of squared differences (SSD cannot achieve either high registration accuracy or high registration efficiency. To address this problem, we propose a novel two phase non-rigid multi-modal image registration method by combining Weber local descriptor (WLD based similarity metrics with the normalized mutual information (NMI using the diffeomorphic free-form deformation (FFD model. The first phase aims at recovering the large deformation component using the WLD based non-local SSD (wldNSSD or weighted structural similarity (wldWSSIM. Based on the output of the former phase, the second phase is focused on getting accurate transformation parameters related to the small deformation using the NMI. Extensive experiments on T1, T2 and PD weighted MR images demonstrate that the proposed wldNSSD-NMI or wldWSSIM-NMI method outperforms the registration methods based on the NMI, the conditional mutual information (CMI, the SSD on entropy images (ESSD and the ESSD-NMI in terms of registration accuracy and computation efficiency.

Multimodal Imaging in Klippel-Trénaunay-Weber Syndrome: Clinical Photography, Computed Tomoangiography, Infrared Thermography, and 99mTc-Phytate Lymphoscintigraphy.

Science.gov (United States)

Kim, Su Wan; Song, Heesung

2017-12-01

We report the case of a 19-year-old man who presented with a 12-year history of progressive fatigue, feeling hot, excessive sweating, and numbness in the left arm. He had undergone multimodal imaging and was diagnosed as having Klippel-Trénaunay-Weber syndrome (KTWS). This is a rare congenital disease, defined by combinations of nevus flammeus, venous and lymphatic malformation, and hypertrophy of the affected limbs. Lower extremities are affected mostly. Conventional modalities for evaluating KTWS are ultrasonography, CT, MRI, lymphoscintigraphy, and angiography. There are few reports on multimodal imaging of upper extremities of KTWS patients, and this is the first report of an infrared thermography in KTWS.

Image evaluation of HIV encephalopathy: a multimodal approach using quantitative MR techniques

Energy Technology Data Exchange (ETDEWEB)

Prado, Paulo T.C.; Escorsi-Rosset, Sara [University of Sao Paulo, Radiology Section, Internal Medicine Department, Ribeirao Preto School of Medicine, Sao Paulo (Brazil); Cervi, Maria C. [University of Sao Paulo, Department of Pediatrics, Ribeirao Preto School of Medicine, Sao Paulo (Brazil); Santos, Antonio Carlos [University of Sao Paulo, Radiology Section, Internal Medicine Department, Ribeirao Preto School of Medicine, Sao Paulo (Brazil); Hospital das Clinicas da FMRP-USP, Ribeirao Preto, SP (Brazil)

2011-11-15

A multimodal approach of the human immunodeficiency virus (HIV) encephalopathy using quantitative magnetic resonance (MR) techniques can demonstrate brain changes not detectable only with conventional magnetic resonance imaging (MRI). The aim of this study was to compare conventional MRI and MR quantitative techniques, such as magnetic resonance spectroscopy (MRS) and relaxometry and to determine whether quantitative techniques are more sensitive than conventional imaging for brain changes caused by HIV infection. We studied prospectively nine HIV positive children (mean age 6 years, from 5 to 8 years old) and nine controls (mean age 7.3 years; from 3 to 10 years), using MRS and relaxometry. Examinations were carried on 1.5-T equipment. HIV-positive patients presented with only minor findings and all control patients had normal conventional MR findings. MRS findings showed an increase in choline to creatine (CHO/CRE) ratios bilaterally in both frontal gray and white matter, in the left parietal white matter, and in total CHO/CRE ratio. In contrast, N-acetylaspartate to creatine (NAA/CRE) ratios did not present with any significant difference between both groups. Relaxometry showed significant bilateral abnormalities, with lengthening of the relaxation time in HIV positive in many regions. Conventional MRI is not sensitive for early brain changes caused by HIV infection. Quantitative techniques such as MRS and relaxometry appear as valuable tools in the diagnosis of these early changes. Therefore, a multimodal quantitative study can be useful in demonstrating and understanding the physiopathology of the disease. (orig.)

MULTIMODAL IMAGING OF ANGIOID STREAKS ASSOCIATED WITH TURNER SYNDROME.

Science.gov (United States)

Chiu, Bing Q; Tsui, Edmund; Hussnain, Syed Amal; Barbazetto, Irene A; Smith, R Theodore

2018-02-13

To report multimodal imaging in a novel case of angioid streaks in a patient with Turner syndrome with 10-year follow-up. Case report of a patient with Turner syndrome and angioid streaks followed at Bellevue Hospital Eye Clinic from 2007 to 2017. Fundus photography, fluorescein angiography, and optical coherence tomography angiography were obtained. Angioid streaks with choroidal neovascularization were noted in this patient with Turner syndrome without other systemic conditions previously correlated with angioid streaks. We report a case of angioid streaks with choroidal neovascularization in a patient with Turner syndrome. We demonstrate that angioid streaks, previously associated with pseudoxanthoma elasticum, Ehlers-Danlos syndrome, Paget disease of bone, and hemoglobinopathies, may also be associated with Turner syndrome, and may continue to develop choroidal neovascularization, suggesting the need for careful ophthalmic examination in these patients.

Avaliação ocular multimodal em doenças heredodistróficas e degenerativas da retina Multimodal fundus imaging in heredodystrophic and degenerative diseases of the retina

Directory of Open Access Journals (Sweden)

Daniela Cavalcanti Ferrara

2009-10-01

Full Text Available A tomografia de coerência óptica incorporou-se gradativamente ao contemporâneo arsenal diagnóstico em Oftalmologia, passando a exercer papel fundamental na investigação e condução de doenças oculares, particularmente na especialidade de Retina e Vítreo. A disponibilização comercial da nova geração de aparelhos, chamada de tomografia de coerência óptica "espectral", baseada em conceito físico distinto que permite a aquisição de imagens em alta velocidade, marcou o início de uma nova era desta tecnologia de investigação auxiliar. Adicionalmente, sua recente combinação com o oftalmoscópio de varredura a laser confocal (confocal scanning laser ophthalmoscope vem propiciando a aquisição de imagens tomográficas guiadas em tempo real pelos diferentes modos de imagem (autofluorescência de fundo, reflectância com luz "infravermelha" e angiografia com fluoresceína ou indocianina verde. A avaliação ocular multimodal (multimodal fundus imaging permite a correlação real e minuciosa de achados da morfologia retiniana e do epitélio pigmentar com dados de estudos angiográficos e de autofluorescência ou reflectância, propiciando assim inferências valiosas sobre a fisiologia do tecido. Neste artigo, discutimos brevemente as possíveis implicações da avaliação ocular multimodal na prática da especialidade de Retina e Vítreo.Optical coherence tomography was progressively incorporated to the contemporary diagnostic arsenal in Ophthalmology, playing a crucial role in the diagnosis and management of eye diseases, particularly in the specialty of retina and vitreous. The commercial availability of the new generation of devices, coined "spectral" optical coherence tomography, which is based in a distinct physical concept that permits high-speed image acquisition, launched a new era for this investigative ancillary tool. In addition, the recent combination of this new technology with a confocal scanning laser ophthalmoscope

Mitral Valve Prolapse: Multimodality Imaging and Genetic Insights.

Science.gov (United States)

Parwani, Purvi; Avierinos, Jean-Francois; Levine, Robert A; Delling, Francesca N

Mitral valve prolapse (MVP) is a common heritable valvulopathy affecting approximately 2.4% of the population. It is the most important cause of primary mitral regurgitation (MR) requiring surgery. MVP is characterized by fibromyxomatous changes and displacement of one or both mitral leaflets into the left atrium. Echocardiography represents the primary diagnostic modality for assessment of MVP. Accurate quantitation of ventricular volumes and function for surgical planning in asymptomatic severe MR can be provided with both echocardiography and cardiac magnetic resonance. In addition, assessment of myocardial fibrosis using late gadolinium enhancement and T1 mapping allows better understanding of the impact of MVP on the myocardium. Imaging in MVP is important not only for diagnostic and prognostic purposes, but is also essential for detailed phenotyping in genetic studies. Genotype-phenotype studies in MVP pedigrees have allowed the identification of milder, non-diagnostic MVP morphologies by echocardiography. Such morphologies represent early expression of MVP in gene carriers. This review focuses on multimodality imaging and the phenotypic spectrum of MVP. Moreover, the review details the recent genetic discoveries that have increased our understanding of the pathophysiology of MVP, with clues to mechanisms and therapy. Copyright © 2017 Elsevier Inc. All rights reserved.

Modality prediction of biomedical literature images using multimodal feature representation

Directory of Open Access Journals (Sweden)

Pelka, Obioma

2016-08-01

Full Text Available This paper presents the modelling approaches performed to automatically predict the modality of images found in biomedical literature. Various state-of-the-art visual features such as Bag-of-Keypoints computed with dense SIFT descriptors, texture features and Joint Composite Descriptors were used for visual image representation. Text representation was obtained by vector quantisation on a Bag-of-Words dictionary generated using attribute importance derived from a χ-test. Computing the principal components separately on each feature, dimension reduction as well as computational load reduction was achieved. Various multiple feature fusions were adopted to supplement visual image information with corresponding text information. The improvement obtained when using multimodal features vs. visual or text features was detected, analysed and evaluated. Random Forest models with 100 to 500 deep trees grown by resampling, a multi class linear kernel SVM with C=0.05 and a late fusion of the two classifiers were used for modality prediction. A Random Forest classifier achieved a higher accuracy and computed Bag-of-Keypoints with dense SIFT descriptors proved to be a better approach than with Lowe SIFT.

MMX-I: data-processing software for multimodal X-ray imaging and tomography

Energy Technology Data Exchange (ETDEWEB)

Bergamaschi, Antoine, E-mail: antoine.bergamaschi@synchrotron-soleil.fr; Medjoubi, Kadda [Synchrotron SOLEIL, BP 48, Saint-Aubin, 91192 Gif sur Yvette (France); Messaoudi, Cédric; Marco, Sergio [Université Paris-Saclay, CNRS, Université Paris-Saclay, F-91405 Orsay (France); Institut Curie, INSERM, PSL Reseach University, F-91405 Orsay (France); Somogyi, Andrea [Synchrotron SOLEIL, BP 48, Saint-Aubin, 91192 Gif sur Yvette (France)

2016-04-12

The MMX-I open-source software has been developed for processing and reconstruction of large multimodal X-ray imaging and tomography datasets. The recent version of MMX-I is optimized for scanning X-ray fluorescence, phase-, absorption- and dark-field contrast techniques. This, together with its implementation in Java, makes MMX-I a versatile and friendly user tool for X-ray imaging. A new multi-platform freeware has been developed for the processing and reconstruction of scanning multi-technique X-ray imaging and tomography datasets. The software platform aims to treat different scanning imaging techniques: X-ray fluorescence, phase, absorption and dark field and any of their combinations, thus providing an easy-to-use data processing tool for the X-ray imaging user community. A dedicated data input stream copes with the input and management of large datasets (several hundred GB) collected during a typical multi-technique fast scan at the Nanoscopium beamline and even on a standard PC. To the authors’ knowledge, this is the first software tool that aims at treating all of the modalities of scanning multi-technique imaging and tomography experiments.

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer's Disease Diagnosis.

Science.gov (United States)

Liu, Manhua; Cheng, Danni; Wang, Kundong; Wang, Yaping

2018-03-23

Accurate and early diagnosis of Alzheimer's disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer's Disease Neuroimaging

Laser injury and in vivo multimodal imaging using a mouse model

Science.gov (United States)

Pocock, Ginger M.; Boretsky, Adam; Gupta, Praveena; Oliver, Jeff W.; Motamedi, Massoud

2011-03-01

Balb/c wild type mice were used to perform in vivo experiments of laser-induced thermal damage to the retina. A Heidelberg Spectralis HRA confocal scanning laser ophthalmoscope with a spectral domain optical coherence tomographer was used to obtain fundus and cross-sectional images of laser induced injury in the retina. Sub-threshold, threshold, and supra-threshold lesions were observed using optical coherence tomography (OCT), infrared reflectance, red-free reflectance, fluorescence angiography, and autofluorescence imaging modalities at different time points post-exposure. Lesions observed using all imaging modalities, except autofluorescence, were not visible immediately after exposure but did resolve within an hour and grew in size over a 24 hour period. There was a decrease in fundus autofluorescence at exposure sites immediately following exposure that developed into hyper-fluorescence 24-48 hours later. OCT images revealed threshold damage that was localized to the RPE but extended into the neural retina over a 24 hour period. Volumetric representations of the mouse retina were created to visualize the extent of damage within the retina over a 24 hour period. Multimodal imaging provides complementary information regarding damage mechanisms that may be used to quantify the extent of the damage as well as the effectiveness of treatments without need for histology.

Multi-Modality Imaging in the Evaluation and Treatment of Mitral Regurgitation.

Science.gov (United States)

Bouchard, Marc-André; Côté-Laroche, Claudia; Beaudoin, Jonathan

2017-10-13

Mitral regurgitation (MR) is frequent and associated with increased mortality and morbidity when severe. It may be caused by intrinsic valvular disease (primary MR) or ventricular deformation (secondary MR). Imaging has a critical role to document the severity, mechanism, and impact of MR on heart function as selected patients with MR may benefit from surgery whereas other will not. In patients planned for a surgical intervention, imaging is also important to select candidates for mitral valve (MV) repair over replacement and to predict surgical success. Although standard transthoracic echocardiography is the first-line modality to evaluate MR, newer imaging modalities like three-dimensional (3D) transesophageal echocardiography, stress echocardiography, cardiac magnetic resonance (CMR), and computed tomography (CT) are emerging and complementary tools for MR assessment. While some of these modalities can provide insight into MR severity, others will help to determine its mechanism. Understanding the advantages and limitations of each imaging modality is important to appreciate their respective role for MR assessment and help to resolve eventual discrepancies between different diagnostic methods. With the increasing use of transcatheter mitral procedures (repair or replacement) for high-surgical-risk patients, multimodality imaging has now become even more important to determine eligibility, preinterventional planning, and periprocedural guidance.

MR microscopy of the lung in small rodents

International Nuclear Information System (INIS)

Takahashi, Masaya; Kubo, Shigeto; Kiryu, Shigeru; Gee, James; Hatabu, Hiroto

2007-01-01

Understanding how the mammalian respiratory system works and how it changes in disease states and under the influence of drugs is frequently pursued in model systems such as small rodents. These have many advantages, including being easily obtained in large numbers as purebred strains. Studies in small rodents are valuable for proof of concept studies and for increasing our knowledge about disease mechanisms. Since the recent developments in the generation of genetically designed animal models of disease, one needs the ability to assess morphology and function in in vivo systems. In this article, we first review previous reports regarding thoracic imaging. We then discuss approaches to take in making use of small rodents to increase MR microscopic sensitivity for these studies and to establish MR methods for clinically relevant lung imaging

Workflow optimisation for multimodal imaging procedures: a case of combined X-ray and MRI-guided TACE.

Science.gov (United States)

Fernández-Gutiérrez, Fabiola; Wolska-Krawczyk, Malgorzata; Buecker, Arno; Houston, J Graeme; Melzer, Andreas

2017-02-01

This study presents a framework for workflow optimisation of multimodal image-guided procedures (MIGP) based on discrete event simulation (DES). A case of a combined X-Ray and magnetic resonance image-guided transarterial chemoembolisation (TACE) is presented to illustrate the application of this method. We used a ranking and selection optimisation algorithm to measure the performance of a number of proposed alternatives to improve a current scenario. A DES model was implemented with detail data collected from 59 TACE procedures and durations of magnetic resonance imaging (MRI) diagnostic procedures usually performed in a common MRI suite. Fourteen alternatives were proposed and assessed to minimise the waiting times and improve workflow. Data analysis observed an average of 20.68 (7.68) min of waiting between angiography and MRI for TACE patients in 71.19% of the cases. Following the optimisation analysis, an alternative was identified to reduce waiting times in angiography suite up to 48.74%. The model helped to understand and detect 'bottlenecks' during multimodal TACE procedures, identifying a better alternative to the current workflow and reducing waiting times. Simulation-based workflow analysis provides a cost-effective way to face some of the challenges of introducing MIGP in clinical radiology, highligthed in this study.

Can multimodality imaging using {sup 18}F-FDG/{sup 18}F-FLT PET/CT benefit the diagnosis and management of patients with pulmonary lesions?

Energy Technology Data Exchange (ETDEWEB)

Xu, Baixuan; Guan, Zhiwei; Liu, Changbin; Wang, Ruimin; Yin, Dayi; Zhang, Jinming; Chen, Yingmao; Yao, Shulin; Shao, Mingzhe; Wang, Hui; Tian, Jiahe [Chinese PLA General Hospital, Department of Nuclear Medicine, Beijing (China)

2011-02-15

Dual-tracer, {sup 18}F-fluorodeoxyglucose and {sup 18}F-fluorodeoxythymidine ({sup 18}F-FDG/{sup 18}F-FLT), dual-modality (positron emission tomography and computed tomography, PET/CT) imaging was used in a clinical trial on differentiation of pulmonary nodules. The aims of this trial were to investigate if multimodality imaging is of advantage and to what extent it could benefit the patients in real clinical settings. Seventy-three subjects in whom it was difficult to establish the diagnosis and determine management of their pulmonary lesions were prospectively enrolled in this clinical trial. All subjects underwent {sup 18}F-FDG and {sup 18}F-FLT PET/CT imaging sequentially. The images were interpreted with different strategies as either individual or combined modalities. The pathological or clinical evidence during a follow-up period of more than 22 months served as the standard of truth. The diagnostic performance of each interpretation and their impact on clinical decision making was investigated. {sup 18}F-FLT/{sup 18}F-FDG PET/CT was proven to be of clinical value in improving the diagnostic confidence in 28 lung tumours, 18 tuberculoses and 27 other benign lesions. The ratio between maximum standardized uptake values of {sup 18}F-FLT and {sup 18}F-FDG was found to be of great potential in separating the three subgroups of patients. The advantage could only be obtained with the full use of the multimodality interpretation. Multimodality imaging induced substantial change in clinical management in 31.5% of the study subjects and partial change in another 12.3%. Multimodality imaging using {sup 18}F-FDG/{sup 18}F-FLT PET/CT provided the best diagnostic efficacy and the opportunity for better management in this group of clinically challenging patients with pulmonary lesions. (orig.)

Multimodal backside imaging of a microcontroller using confocal laser scanning and optical-beam-induced current imaging

Science.gov (United States)

Finkeldey, Markus; Göring, Lena; Schellenberg, Falk; Brenner, Carsten; Gerhardt, Nils C.; Hofmann, Martin

2017-02-01

Microscopy imaging with a single technology is usually restricted to a single contrast mechanism. Multimodal imaging is a promising technique to improve the structural information that could be obtained about a device under test (DUT). Due to the different contrast mechanisms of laser scanning microscopy (LSM), confocal laser scanning microscopy (CLSM) and optical beam induced current microscopy (OBICM), a combination could improve the detection of structures in integrated circuits (ICs) and helps to reveal their layout. While OBIC imaging is sensitive to the changes between differently doped areas and to semiconductor-metal transitions, CLSM imaging is mostly sensitive to changes in absorption and reflection. In this work we present the implementation of OBIC imaging into a CLSM. We show first results using industry standard Atmel microcontrollers (MCUs) with a feature size of about 250nm as DUTs. Analyzing these types of microcontrollers helps to improve in the field of side-channel attacks to find hardware Trojans, possible spots for laser fault attacks and for reverse engineering. For the experimental results the DUT is placed on a custom circuit board that allows us to measure the current while imaging it in our in-house built stage scanning microscope using a near infrared (NIR) laser diode as light source. The DUT is thinned and polished, allowing backside imaging through the Si-substrate. We demonstrate the possibilities using this optical setup by evaluating OBIC, LSM and CLSM images above and below the threshold of the laser source.

Multimodality Cardiac Imaging in a Patient with Kawasaki Disease and Giant Aneurysms

Directory of Open Access Journals (Sweden)

Ranjini Srinivasan

2016-01-01

Full Text Available Kawasaki disease is a well-known cause of acquired cardiac disease in the pediatric and adult population, most prevalent in Japan but also seen commonly in the United States. In the era of intravenous immunoglobulin (IVIG treatment, the morbidity associated with this disease has decreased, but it remains a serious illness. Here we present the case of an adolescent, initially diagnosed with Kawasaki disease as an infant, that progressed to giant aneurysm formation and calcification of the coronary arteries. We review his case and the literature, focusing on the integral role of multimodality imaging in managing Kawasaki disease.

Hybrid of two-photon microscopy and optical multimodality imaging for multi-scale imaging of small animals

Science.gov (United States)

Li, Tianmeng; Hui, Hui; Ma, He; Yang, Xin; Tian, Jie

2018-02-01

Non-invasive imaging technologies, such as magnetic resonance imaging (MRI) and optical multimodality imaging methods, are commonly used for diagnosing and supervising the development of inflammatory bowel disease (IBD). These in vivo imaging methods can provide morphology changes information of IBD in macro-scale. However, it is difficult to investigate the intestinal wall in molecular and cellular level. State-of-art light-sheet and two-photon microscopy have the ability to acquire the changes for IBD in micro-scale. The aim of this work is to evaluate the size of the enterocoel and the thickness of colon wall using both MRI for in vivo imaging, and light-sheet and two-photon microscope for in vitro imaging. C57BL/6 mice were received 3.5% Dextran sodium sulfate (DSS) in the drinking water for 5 days to build IBD model. Mice were imaged with MRI on days 0, 6 to observe colitis progression. After MRI imaging, the mice were sacrificed to take colons for tissue clearing. Then, light-sheet and two-photon microscopies are used for in vitro imaging of the cleared samples. The experimental group showed symptoms of bloody stools, sluggishness and weight loss. It showed that the colon wall was thicker while the enterocoel was narrower compare to control group. The more details are observed using light-sheet and two-photon microscope. It is demonstrated that hybrid of MRI in macro-scale and light-sheet and two-photon microscopy in micro-scale imaging is feasible for colon inflammation diagnosing and supervising.

Benign familial fleck retina: multimodal imaging including optical coherence tomography angiography.

Science.gov (United States)

Garcia, Jose Mauricio Botto de Barros; Isaac, David Leonardo Cruvinel; Sardeiro, Tainara; Aquino, Érika; Avila, Marcos

2017-01-01

This report presents multimodal imaging of a 27-year-old woman diagnosed with benign familial fleck retina (OMIM 228980), an uncommon disorder. Fundus photographs revealed retinal flecks that affected her post-equatorial retina but spared the macular area. Fundus autofluorescence and infrared imaging demonstrated a symmetrical pattern of yellow-white fleck lesions that affected both eyes. Her full-field electroretinogram and electrooculogram were normal. An optical coherence tomography B-scan was performed for both eyes, revealing increased thickness of the retinal pigmented epithelium leading to multiple small pigmented epithelium detachments. The outer retina remained intact in both eyes. Spectral-domain optical coherence tomography angiography with split-spectrum amplitude decorrelation algorithm and 3 × 3 mm structural en face optical coherence tomography did not show macular lesions. Benign familial fleck retina belongs to a heterogenous group of so-called flecked retina syndromes, and should be considered in patients with yellowish-white retinal lesions without involvement of the macula.

Benign familial fleck retina: multimodal imaging including optical coherence tomography angiography

Directory of Open Access Journals (Sweden)

Jose Mauricio Botto de Barros Garcia

Full Text Available ABSTRACT This report presents multimodal imaging of a 27-year-old woman diagnosed with benign familial fleck retina (OMIM 228980, an uncommon disorder. Fundus photographs revealed retinal flecks that affected her post-equatorial retina but spared the macular area. Fundus autofluorescence and infrared imaging demonstrated a symmetrical pattern of yellow-white fleck lesions that affected both eyes. Her full-field electroretinogram and electrooculogram were normal. An optical coherence tomography B-scan was performed for both eyes, revealing increased thickness of the retinal pigmented epithelium leading to multiple small pigmented epithelium detachments. The outer retina remained intact in both eyes. Spectral-domain optical coherence tomography angiography with split-spectrum amplitude decorrelation algorithm and 3 × 3 mm structural en face optical coherence tomography did not show macular lesions. Benign familial fleck retina belongs to a heterogenous group of so-called flecked retina syndromes, and should be considered in patients with yellowish-white retinal lesions without involvement of the macula.

4D XCAT phantom for multimodality imaging research

Energy Technology Data Exchange (ETDEWEB)

Segars, W. P.; Sturgeon, G.; Mendonca, S.; Grimes, Jason; Tsui, B. M. W. [Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, Duke University Medical Center, 2424 Erwin Road, Hock Plaza, Suite 302, Durham, North Carolina 27705 (United States); Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, Duke University Medical Center, 2424 Erwin Road, Hock Plaza, Suite 302, Durham, North Carolina 27705 and Department of Biomedical Engineering, University of North Carolina, Chapel Hill, North Carolina 27599 (United States); Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, Duke University Medical Center, 2424 Erwin Road, Hock Plaza, Suite 302, Durham, North Carolina 27705 (United States); The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Medical Institutions, Baltimore, Maryland 21287 (United States)

2010-09-15

Purpose: The authors develop the 4D extended cardiac-torso (XCAT) phantom for multimodality imaging research. Methods: Highly detailed whole-body anatomies for the adult male and female were defined in the XCAT using nonuniform rational B-spline (NURBS) and subdivision surfaces based on segmentation of the Visible Male and Female anatomical datasets from the National Library of Medicine as well as patient datasets. Using the flexibility of these surfaces, the Visible Human anatomies were transformed to match body measurements and organ volumes for a 50th percentile (height and weight) male and female. The desired body measurements for the models were obtained using the PEOPLESIZE program that contains anthropometric dimensions categorized from 1st to the 99th percentile for US adults. The desired organ volumes were determined from ICRP Publication 89 [ICRP, ''Basic anatomical and physiological data for use in radiological protection: reference values,'' ICRP Publication 89 (International Commission on Radiological Protection, New York, NY, 2002)]. The male and female anatomies serve as standard templates upon which anatomical variations may be modeled in the XCAT through user-defined parameters. Parametrized models for the cardiac and respiratory motions were also incorporated into the XCAT based on high-resolution cardiac- and respiratory-gated multislice CT data. To demonstrate the usefulness of the phantom, the authors show example simulation studies in PET, SPECT, and CT using publicly available simulation packages. Results: As demonstrated in the pilot studies, the 4D XCAT (which includes thousands of anatomical structures) can produce realistic imaging data when combined with accurate models of the imaging process. With the flexibility of the NURBS surface primitives, any number of different anatomies, cardiac or respiratory motions or patterns, and spatial resolutions can be simulated to perform imaging research. Conclusions: With the

4D XCAT phantom for multimodality imaging research

International Nuclear Information System (INIS)

Segars, W. P.; Sturgeon, G.; Mendonca, S.; Grimes, Jason; Tsui, B. M. W.

2010-01-01

Purpose: The authors develop the 4D extended cardiac-torso (XCAT) phantom for multimodality imaging research. Methods: Highly detailed whole-body anatomies for the adult male and female were defined in the XCAT using nonuniform rational B-spline (NURBS) and subdivision surfaces based on segmentation of the Visible Male and Female anatomical datasets from the National Library of Medicine as well as patient datasets. Using the flexibility of these surfaces, the Visible Human anatomies were transformed to match body measurements and organ volumes for a 50th percentile (height and weight) male and female. The desired body measurements for the models were obtained using the PEOPLESIZE program that contains anthropometric dimensions categorized from 1st to the 99th percentile for US adults. The desired organ volumes were determined from ICRP Publication 89 [ICRP, ''Basic anatomical and physiological data for use in radiological protection: reference values,'' ICRP Publication 89 (International Commission on Radiological Protection, New York, NY, 2002)]. The male and female anatomies serve as standard templates upon which anatomical variations may be modeled in the XCAT through user-defined parameters. Parametrized models for the cardiac and respiratory motions were also incorporated into the XCAT based on high-resolution cardiac- and respiratory-gated multislice CT data. To demonstrate the usefulness of the phantom, the authors show example simulation studies in PET, SPECT, and CT using publicly available simulation packages. Results: As demonstrated in the pilot studies, the 4D XCAT (which includes thousands of anatomical structures) can produce realistic imaging data when combined with accurate models of the imaging process. With the flexibility of the NURBS surface primitives, any number of different anatomies, cardiac or respiratory motions or patterns, and spatial resolutions can be simulated to perform imaging research. Conclusions: With the ability to produce

MIDA: A Multimodal Imaging-Based Detailed Anatomical Model of the Human Head and Neck.

Directory of Open Access Journals (Sweden)

Maria Ida Iacono

Full Text Available Computational modeling and simulations are increasingly being used to complement experimental testing for analysis of safety and efficacy of medical devices. Multiple voxel- and surface-based whole- and partial-body models have been proposed in the literature, typically with spatial resolution in the range of 1-2 mm and with 10-50 different tissue types resolved. We have developed a multimodal imaging-based detailed anatomical model of the human head and neck, named "MIDA". The model was obtained by integrating three different magnetic resonance imaging (MRI modalities, the parameters of which were tailored to enhance the signals of specific tissues: i structural T1- and T2-weighted MRIs; a specific heavily T2-weighted MRI slab with high nerve contrast optimized to enhance the structures of the ear and eye; ii magnetic resonance angiography (MRA data to image the vasculature, and iii diffusion tensor imaging (DTI to obtain information on anisotropy and fiber orientation. The unique multimodal high-resolution approach allowed resolving 153 structures, including several distinct muscles, bones and skull layers, arteries and veins, nerves, as well as salivary glands. The model offers also a detailed characterization of eyes, ears, and deep brain structures. A special automatic atlas-based segmentation procedure was adopted to include a detailed map of the nuclei of the thalamus and midbrain into the head model. The suitability of the model to simulations involving different numerical methods, discretization approaches, as well as DTI-based tensorial electrical conductivity, was examined in a case-study, in which the electric field was generated by transcranial alternating current stimulation. The voxel- and the surface-based versions of the models are freely available to the scientific community.

Multimodality Imaging Probe for Positron Emission Tomography and Fluorescence Imaging Studies

Directory of Open Access Journals (Sweden)

Suresh K. Pandey

2014-05-01

Full Text Available Our goal is to develop multimodality imaging agents for use in cell tracking studies by positron emission tomography (PET and optical imaging (OI. For this purpose, bovine serum albumin (BSA was complexed with biotin (histologic studies, 5(6- carboxyfluorescein, succinimidyl ester (FAM SE (OI studies, and diethylenetriamine pentaacetic acid (DTPA for chelating gallium 68 (PET studies. For synthesis of BSA-biotin-FAM-DTPA, BSA was coupled to (+-biotin N-hydroxysuccinimide ester (biotin-NHSI. BSA- biotin was treated with DTPA-anhydride and biotin-BSA-DTPA was reacted with FAM. The biotin-BSA-DTPA-FAM was reacted with gallium chloride 3 to 5 mCi eluted from the generator using 0.1 N HCl and was passed through basic resin (AG 11 A8 and 150 mCi (100 μL, pH 7–8 was incubated with 0.1 mg of FAM conjugate (100 μL at room temperature for 15 minutes to give 66Ga-BSA-biotin-DTPA-FAM. A shaved C57 black mouse was injected with FAM conjugate (50 μL at one flank and FAM-68Ga (50 μL, 30 mCi at the other. Immediately after injection, the mouse was placed in a fluorescence imaging system (Kodak In-Vivo F, Bruker Biospin Co., Woodbridge, CT and imaged (Λex: 465 nm, Λem: 535 nm, time: 8 seconds, Xenon Light Source, Kodak. The same mouse was then placed under an Inveon microPET scanner (Siemens Medical Solutions, Knoxville, TN injected (intravenously with 25 μCi of 18F and after a half-hour (to allow sufficient bone uptake was imaged for 30 minutes. Molecular weight determined using matrix-associated laser desorption ionization (MALDI for the BSA sample was 66,485 Da and for biotin-BSA was 67,116 Da, indicating two biotin moieties per BSA molecule; for biotin-BSA-DTPA was 81,584 Da, indicating an average of 30 DTPA moieties per BSA molecule; and for FAM conjugate was 82,383 Da, indicating an average of 1.7 fluorescent moieties per BSA molecule. Fluorescence imaging clearly showed localization of FAM conjugate and FAM-68Ga at respective flanks of the mouse

Slotted cage resonator for high-field magnetic resonance imaging of rodents

Energy Technology Data Exchange (ETDEWEB)

Marrufo, O; Vasquez, F; Solis, S E; Rodriguez, A O, E-mail: arog@xanum.uam.mx [Departamento de Ingenieria Electrica, Universidad Autonoma Metropolitana Iztapalapa, Mexico, DF 09340 (Mexico)

2011-04-20

A variation of the high-frequency cavity resonator coil was experimentally developed according to the theoretical frame proposed by Mansfield in 1990. Circular slots were used instead of cavities to form the coil endplates and it was called the slotted cage resonator coil. The theoretical principles were validated via a coil equivalent circuit and also experimentally with a coil prototype. The radio frequency magnetic field, B1, produced by several coil configurations was numerically simulated using the finite-element approach to investigate their performances. A transceiver coil, 8 cm long and 7.6 cm in diameter, and composed of 4 circular slots with a 15 mm diameter on both endplates, was built to operate at 300 MHz and quadrature driven. Experimental results obtained with the slotted cage resonator coil were presented and showed very good agreement with the theoretical expectations for the resonant frequency as a function of the coil dimensions and slots. A standard birdcage coil was also built for performance comparison purposes. Phantom images were then acquired to compute the signal-to-noise ratio of both coils showing an important improvement of the slotted cage coil over the birdcage coil. The whole-body images of the mouse were also obtained showing high-quality images. Volume resonator coils can be reliably built following the physical principles of the cavity resonator design for high-field magnetic resonance imaging applications of rodents.

Multimodal news framing effects

NARCIS (Netherlands)

Powell, T.E.

2017-01-01

Visuals in news media play a vital role in framing citizens’ political preferences. Yet, compared to the written word, visual images are undervalued in political communication research. Using framing theory, this thesis redresses the balance by studying the combined, or multimodal, effects of visual

Multimodal imaging of the human knee down to the cellular level

Science.gov (United States)

Schulz, G.; Götz, C.; Müller-Gerbl, M.; Zanette, I.; Zdora, M.-C.; Khimchenko, A.; Deyhle, H.; Thalmann, P.; Müller, B.

2017-06-01

Computed tomography reaches the best spatial resolution for the three-dimensional visualization of human tissues among the available nondestructive clinical imaging techniques. Nowadays, sub-millimeter voxel sizes are regularly obtained. Regarding investigations on true micrometer level, lab-based micro-CT (μCT) has become gold standard. The aim of the present study is firstly the hierarchical investigation of a human knee post mortem using hard X-ray μCT and secondly a multimodal imaging using absorption and phase contrast modes in order to investigate hard (bone) and soft (cartilage) tissues on the cellular level. After the visualization of the entire knee using a clinical CT, a hierarchical imaging study was performed using the lab-system nanotom® m. First, the entire knee was measured with a pixel length of 65 μm. The highest resolution with a pixel length of 3 μm could be achieved after extracting cylindrically shaped plugs from the femoral bones. For the visualization of the cartilage, grating-based phase contrast μCT (I13-2, Diamond Light Source) was performed. With an effective voxel size of 2.3 μm it was possible to visualize individual chondrocytes within the cartilage.

Multimodal system for the planning and guidance of bronchoscopy

Science.gov (United States)

Higgins, William E.; Cheirsilp, Ronnarit; Zang, Xiaonan; Byrnes, Patrick

2015-03-01

Many technical innovations in multimodal radiologic imaging and bronchoscopy have emerged recently in the effort against lung cancer. Modern X-ray computed-tomography (CT) scanners provide three-dimensional (3D) high-resolution chest images, positron emission tomography (PET) scanners give complementary molecular imaging data, and new integrated PET/CT scanners combine the strengths of both modalities. State-of-the-art bronchoscopes permit minimally invasive tissue sampling, with vivid endobronchial video enabling navigation deep into the airway-tree periphery, while complementary endobronchial ultrasound (EBUS) reveals local views of anatomical structures outside the airways. In addition, image-guided intervention (IGI) systems have proven their utility for CT-based planning and guidance of bronchoscopy. Unfortunately, no IGI system exists that integrates all sources effectively through the complete lung-cancer staging work flow. This paper presents a prototype of a computer-based multimodal IGI system that strives to fill this need. The system combines a wide range of automatic and semi-automatic image-processing tools for multimodal data fusion and procedure planning. It also provides a flexible graphical user interface for follow-on guidance of bronchoscopy/EBUS. Human-study results demonstrate the system's potential.

Detection of relationships among multi-modal brain imaging meta-features via information flow.

Science.gov (United States)

Miller, Robyn L; Vergara, Victor M; Calhoun, Vince D

2018-01-15

Neuroscientists and clinical researchers are awash in data from an ever-growing number of imaging and other bio-behavioral modalities. This flow of brain imaging data, taken under resting and various task conditions, combines with available cognitive measures, behavioral information, genetic data plus other potentially salient biomedical and environmental information to create a rich but diffuse data landscape. The conditions being studied with brain imaging data are often extremely complex and it is common for researchers to employ more than one imaging, behavioral or biological data modality (e.g., genetics) in their investigations. While the field has advanced significantly in its approach to multimodal data, the vast majority of studies still ignore joint information among two or more features or modalities. We propose an intuitive framework based on conditional probabilities for understanding information exchange between features in what we are calling a feature meta-space; that is, a space consisting of many individual featurae spaces. Features can have any dimension and can be drawn from any data source or modality. No a priori assumptions are made about the functional form (e.g., linear, polynomial, exponential) of captured inter-feature relationships. We demonstrate the framework's ability to identify relationships between disparate features of varying dimensionality by applying it to a large multi-site, multi-modal clinical dataset, balance between schizophrenia patients and controls. In our application it exposes both expected (previously observed) relationships, and novel relationships rarely considered investigated by clinical researchers. To the best of our knowledge there is not presently a comparably efficient way to capture relationships of indeterminate functional form between features of arbitrary dimension and type. We are introducing this method as an initial foray into a space that remains relatively underpopulated. The framework we propose is

Aspergillus infection monitored by multimodal imaging in a rat model.

Science.gov (United States)

Pluhacek, Tomas; Petrik, Milos; Luptakova, Dominika; Benada, Oldrich; Palyzova, Andrea; Lemr, Karel; Havlicek, Vladimir

2016-06-01

Although myriads of experimental approaches have been published in the field of fungal infection diagnostics, interestingly, in 21st century there is no satisfactory early noninvasive tool for Aspergillus diagnostics with good sensitivity and specificity. In this work, we for the first time described the fungal burden in rat lungs by multimodal imaging approach. The Aspergillus infection was monitored by positron emission tomography and light microscopy employing modified Grocott's methenamine silver staining and eosin counterstaining. Laser ablation inductively coupled plasma mass spectrometry imaging has revealed a dramatic iron increase in fungi-affected areas, which can be presumably attributed to microbial siderophores. Quantitative elemental data were inferred from matrix-matched standards prepared from rat lungs. The iron, silver, and gold MS images collected with variable laser foci revealed that particularly silver or gold can be used as excellent elements useful for sensitively tracking the Aspergillus infection. The limit of detection was determined for both (107) Ag and (197) Au as 0.03 μg/g (5 μm laser focus). The selective incorporation of (107) Ag and (197) Au into fungal cell bodies and low background noise from both elements were confirmed by energy dispersive X-ray scattering utilizing the submicron lateral resolving power of scanning electron microscopy. The low limits of detection and quantitation of both gold and silver make ICP-MS imaging monitoring a viable alternative to standard optical evaluation used in current clinical settings. © 2016 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Dual CARS and SHG image acquisition scheme that combines single central fiber and multimode fiber bundle to collect and differentiate backward and forward generated photons

Science.gov (United States)

Weng, Sheng; Chen, Xu; Xu, Xiaoyun; Wong, Kelvin K.; Wong, Stephen T. C.

2016-01-01

In coherent anti-Stokes Raman scattering (CARS) and second harmonic generation (SHG) imaging, backward and forward generated photons exhibit different image patterns and thus capture salient intrinsic information of tissues from different perspectives. However, they are often mixed in collection using traditional image acquisition methods and thus are hard to interpret. We developed a multimodal scheme using a single central fiber and multimode fiber bundle to simultaneously collect and differentiate images formed by these two types of photons and evaluated the scheme in an endomicroscopy prototype. The ratio of these photons collected was calculated for the characterization of tissue regions with strong or weak epi-photon generation while different image patterns of these photons at different tissue depths were revealed. This scheme provides a new approach to extract and integrate information captured by backward and forward generated photons in dual CARS/SHG imaging synergistically for biomedical applications. PMID:27375938

Spinal focal lesion detection in multiple myeloma using multimodal image features

Science.gov (United States)

Fränzle, Andrea; Hillengass, Jens; Bendl, Rolf

2015-03-01

Multiple myeloma is a tumor disease in the bone marrow that affects the skeleton systemically, i.e. multiple lesions can occur in different sites in the skeleton. To quantify overall tumor mass for determining degree of disease and for analysis of therapy response, volumetry of all lesions is needed. Since the large amount of lesions in one patient impedes manual segmentation of all lesions, quantification of overall tumor volume is not possible until now. Therefore development of automatic lesion detection and segmentation methods is necessary. Since focal tumors in multiple myeloma show different characteristics in different modalities (changes in bone structure in CT images, hypointensity in T1 weighted MR images and hyperintensity in T2 weighted MR images), multimodal image analysis is necessary for the detection of focal tumors. In this paper a pattern recognition approach is presented that identifies focal lesions in lumbar vertebrae based on features from T1 and T2 weighted MR images. Image voxels within bone are classified using random forests based on plain intensities and intensity value derived features (maximum, minimum, mean, median) in a 5 x 5 neighborhood around a voxel from both T1 and T2 weighted MR images. A test data sample of lesions in 8 lumbar vertebrae from 4 multiple myeloma patients can be classified at an accuracy of 95% (using a leave-one-patient-out test). The approach provides a reasonable delineation of the example lesions. This is an important step towards automatic tumor volume quantification in multiple myeloma.

Multimodal adaptive optics for depth-enhanced high-resolution ophthalmic imaging

Science.gov (United States)

Hammer, Daniel X.; Mujat, Mircea; Iftimia, Nicusor V.; Lue, Niyom; Ferguson, R. Daniel

2010-02-01

We developed a multimodal adaptive optics (AO) retinal imager for diagnosis of retinal diseases, including glaucoma, diabetic retinopathy (DR), age-related macular degeneration (AMD), and retinitis pigmentosa (RP). The development represents the first ever high performance AO system constructed that combines AO-corrected scanning laser ophthalmoscopy (SLO) and swept source Fourier domain optical coherence tomography (SSOCT) imaging modes in a single compact clinical prototype platform. The SSOCT channel operates at a wavelength of 1 μm for increased penetration and visualization of the choriocapillaris and choroid, sites of major disease activity for DR and wet AMD. The system is designed to operate on a broad clinical population with a dual deformable mirror (DM) configuration that allows simultaneous low- and high-order aberration correction. The system also includes a wide field line scanning ophthalmoscope (LSO) for initial screening, target identification, and global orientation; an integrated retinal tracker (RT) to stabilize the SLO, OCT, and LSO imaging fields in the presence of rotational eye motion; and a high-resolution LCD-based fixation target for presentation to the subject of stimuli and other visual cues. The system was tested in a limited number of human subjects without retinal disease for performance optimization and validation. The system was able to resolve and quantify cone photoreceptors across the macula to within ~0.5 deg (~100-150 μm) of the fovea, image and delineate ten retinal layers, and penetrate to resolve targets deep into the choroid. In addition to instrument hardware development, analysis algorithms were developed for efficient information extraction from clinical imaging sessions, with functionality including automated image registration, photoreceptor counting, strip and montage stitching, and segmentation. The system provides clinicians and researchers with high-resolution, high performance adaptive optics imaging to help

High-resolution multimodal clinical multiphoton tomography of skin

Science.gov (United States)

König, Karsten

2011-03-01

This review focuses on multimodal multiphoton tomography based on near infrared femtosecond lasers. Clinical multiphoton tomographs for 3D high-resolution in vivo imaging have been placed into the market several years ago. The second generation of this Prism-Award winning High-Tech skin imaging tool (MPTflex) was introduced in 2010. The same year, the world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph. In particular, non-fluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen has been imaged with submicron resolution in patients suffering from psoriasis. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution wide-field systems such as ultrasound, optoacoustical, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer, optimization of treatment strategies, and cosmetic research including long-term testing of sunscreen nanoparticles as well as anti-aging products.

Integrated nanotechnology platform for tumor-targeted multimodal imaging and therapeutic cargo release.

Science.gov (United States)

Hosoya, Hitomi; Dobroff, Andrey S; Driessen, Wouter H P; Cristini, Vittorio; Brinker, Lina M; Staquicini, Fernanda I; Cardó-Vila, Marina; D'Angelo, Sara; Ferrara, Fortunato; Proneth, Bettina; Lin, Yu-Shen; Dunphy, Darren R; Dogra, Prashant; Melancon, Marites P; Stafford, R Jason; Miyazono, Kohei; Gelovani, Juri G; Kataoka, Kazunori; Brinker, C Jeffrey; Sidman, Richard L; Arap, Wadih; Pasqualini, Renata

2016-02-16

A major challenge of targeted molecular imaging and drug delivery in cancer is establishing a functional combination of ligand-directed cargo with a triggered release system. Here we develop a hydrogel-based nanotechnology platform that integrates tumor targeting, photon-to-heat conversion, and triggered drug delivery within a single nanostructure to enable multimodal imaging and controlled release of therapeutic cargo. In proof-of-concept experiments, we show a broad range of ligand peptide-based applications with phage particles, heat-sensitive liposomes, or mesoporous silica nanoparticles that self-assemble into a hydrogel for tumor-targeted drug delivery. Because nanoparticles pack densely within the nanocarrier, their surface plasmon resonance shifts to near-infrared, thereby enabling a laser-mediated photothermal mechanism of cargo release. We demonstrate both noninvasive imaging and targeted drug delivery in preclinical mouse models of breast and prostate cancer. Finally, we applied mathematical modeling to predict and confirm tumor targeting and drug delivery. These results are meaningful steps toward the design and initial translation of an enabling nanotechnology platform with potential for broad clinical applications.

Bone morphology of the hind limbs in two caviomorph rodents.

Science.gov (United States)

de Araújo, F A P; Sesoko, N F; Rahal, S C; Teixeira, C R; Müller, T R; Machado, M R F

2013-04-01

In order to evaluate the hind limbs of caviomorph rodents a descriptive analysis of the Cuniculus paca (Linnaeus, 1766) and Hydrochoerus hydrochaeris (Linnaeus, 1766) was performed using anatomical specimens, radiography, computed tomography (CT) and full-coloured prototype models to generate bone anatomy data. The appendicular skeleton of the two largest rodents of Neotropical America was compared with the previously reported anatomical features of Rattus norvegicus (Berkenhout, 1769) and domestic Cavia porcellus (Linnaeus, 1758). The structures were analyzed macroscopically and particular findings of each species reported. Features including the presence of articular fibular projection and lunulae were observed in the stifle joint of all rodents. Imaging aided in anatomical description and, specifically in the identification of bone structures in Cuniculus paca and Hydrochoerus hydrochaeris. The imaging findings were correlated with the anatomical structures observed. The data may be used in future studies comparing these animals to other rodents and mammalian species. © 2012 Blackwell Verlag GmbH.

Development of magneto-plasmonic nanoparticles for multimodal image-guided therapy to the brain.

Science.gov (United States)

Tomitaka, Asahi; Arami, Hamed; Raymond, Andrea; Yndart, Adriana; Kaushik, Ajeet; Jayant, Rahul Dev; Takemura, Yasushi; Cai, Yong; Toborek, Michal; Nair, Madhavan

2017-01-05

Magneto-plasmonic nanoparticles are one of the emerging multi-functional materials in the field of nanomedicine. Their potential for targeting and multi-modal imaging is highly attractive. In this study, magnetic core/gold shell (MNP@Au) magneto-plasmonic nanoparticles were synthesized by citrate reduction of Au ions on magnetic nanoparticle seeds. Hydrodynamic size and optical properties of magneto-plasmonic nanoparticles synthesized with the variation of Au ions and reducing agent concentrations were evaluated. The synthesized magneto-plasmonic nanoparticles exhibited superparamagnetic properties, and their magnetic properties contributed to the concentration-dependent contrast in magnetic resonance imaging (MRI). The imaging contrast from the gold shell part of the magneto-plasmonic nanoparticles was also confirmed by X-ray computed tomography (CT). The transmigration study of the magneto-plasmonic nanoparticles using an in vitro blood-brain barrier (BBB) model proved enhanced transmigration efficiency without disrupting the integrity of the BBB, and showed potential to be used for brain diseases and neurological disorders.

Evaluation of multimodality imaging using image fusion with ultrasound tissue elasticity imaging in an experimental animal model.

Science.gov (United States)

Paprottka, P M; Zengel, P; Cyran, C C; Ingrisch, M; Nikolaou, K; Reiser, M F; Clevert, D A

2014-01-01

To evaluate the ultrasound tissue elasticity imaging by comparison to multimodality imaging using image fusion with Magnetic Resonance Imaging (MRI) and conventional grey scale imaging with additional elasticity-ultrasound in an experimental small-animal-squamous-cell carcinoma-model for the assessment of tissue morphology. Human hypopharynx carcinoma cells were subcutaneously injected into the left flank of 12 female athymic nude rats. After 10 days (SD ± 2) of subcutaneous tumor growth, sonographic grey scale including elasticity imaging and MRI measurements were performed using a high-end ultrasound system and a 3T MR. For image fusion the contrast-enhanced MRI DICOM data set was uploaded in the ultrasonic device which has a magnetic field generator, a linear array transducer (6-15 MHz) and a dedicated software package (GE Logic E9), that can detect transducers by means of a positioning system. Conventional grey scale and elasticity imaging were integrated in the image fusion examination. After successful registration and image fusion the registered MR-images were simultaneously shown with the respective ultrasound sectional plane. Data evaluation was performed using the digitally stored video sequence data sets by two experienced radiologist using a modified Tsukuba Elasticity score. The colors "red and green" are assigned for an area of soft tissue, "blue" indicates hard tissue. In all cases a successful image fusion and plan registration with MRI and ultrasound imaging including grey scale and elasticity imaging was possible. The mean tumor volume based on caliper measurements in 3 dimensions was ~323 mm3. 4/12 rats were evaluated with Score I, 5/12 rates were evaluated with Score II, 3/12 rates were evaluated with Score III. There was a close correlation in the fused MRI with existing small necrosis in the tumor. None of the scored II or III lesions was visible by conventional grey scale. The comparison of ultrasound tissue elasticity imaging enables a

Multimodal ultrasound tomography for breast imaging: a prospective study of clinical feasibility.

Science.gov (United States)

Forte, S; Dellas, S; Stieltjes, B; Bongartz, B

2017-01-01

To describe the clinical set-up and evaluate the feasibility of multimodal ultrasound tomography (MUT) for breast imaging. Thirty-two consecutive patients referred for breast imaging and 24 healthy volunteers underwent MUT. In the 32 patients, the examination discomfort was compared to that of mammography (n = 31), handheld ultrasound (HUS) (n = 27) and magnetic resonance imaging (MRI) (n = 4) on a scale from 1 (lowest discomfort) to 10 (highest discomfort). MUT investigation time was recorded. Findings automatically detected by MUT were correlated with conventional imaging and biopsy results. Breast MUT was well tolerated by all 56 participants; 55 bilateral exams were uneventful. During one exam, the digitalisation card failed and the exam was successfully repeated within three days. Mean examination discomfort was 1.6 (range = 1-5) for MUT, 1.5 (range = 1-5) for HUS, 5.3 (range = 3-7) for MRI, and 6.3 (range = 1-10) for mammography. MUT examination time was 38 ± 6 min (mean ± standard deviation). In the patients referred for breast imaging, MUT detected four lesions and indicated malignancy in three of these cases. These findings were confirmed by additional imaging and biopsy. MUT is feasible in a clinical context considering examination time and patient acceptance. These interesting initial diagnostic findings warrant further studies.

Biodistribution of arctigenin-loaded nanoparticles designed for multimodal imaging.

Science.gov (United States)

Cui, Qingxin; Hou, Yuanyuan; Wang, Yanan; Li, Xu; Liu, Yang; Ma, Xiaoyao; Wang, Zengyong; Wang, Weiya; Tao, Jin; Wang, Qian; Jiang, Min; Chen, Dongyan; Feng, Xizeng; Bai, Gang

2017-04-07

Tracking targets of natural products is one of the most challenging issues in fields ranging from pharmacognosy to biomedicine. It is widely recognized that the biocompatible nanoparticle (NP) could function as a "key" that opens the target "lock". We report a functionalized poly-lysine NP technique that can monitor the target protein of arctigenin (ATG) in vivo non-invasively. The NPs were synthesized, and their morphologies and surface chemical properties were characterized by transmission electron microscopy (TEM), laser particle size analysis and atomic force microscopy (AFM). In addition, we studied the localization of ATG at the level of the cell and the whole animal (zebrafish and mice). We demonstrated that fluorescent NPs could be ideal carriers in the development of a feasible method for target identification. The distributions of the target proteins were found to be consistent with the pharmacological action of ATG at the cellular and whole-organism levels. The results indicated that functionalized poly-lysine NPs could be valuable in the multimodal imaging of arctigenin.

Comparative imaging study in ultrasound, MRI, CT, and DSA using a multimodality renal artery phantom

Energy Technology Data Exchange (ETDEWEB)

King, Deirdre M.; Fagan, Andrew J.; Moran, Carmel M.; Browne, Jacinta E. [Medical Ultrasound Physics and Technology Group, School of Physics, Dublin Institute of Technology, Dublin 8 (Ireland); Centre for Advanced Medical Imaging (CAMI), St James' s Hospital, Dublin 8 (Ireland); Department of Medical Physics, University of Edinburgh, Edinburgh EH16 4TJ (United Kingdom); Medical Ultrasound Physics and Technology Group, School of Physics, Dublin Institute of Technology, Dublin 8 (Ireland)

2011-02-15

Purpose: A range of anatomically realistic multimodality renal artery phantoms consisting of vessels with varying degrees of stenosis was developed and evaluated using four imaging techniques currently used to detect renal artery stenosis (RAS). The spatial resolution required to visualize vascular geometry and the velocity detection performance required to adequately characterize blood flow in patients suffering from RAS are currently ill-defined, with the result that no one imaging modality has emerged as a gold standard technique for screening for this disease. Methods: The phantoms, which contained a range of stenosis values (0%, 30%, 50%, 70%, and 85%), were designed for use with ultrasound, magnetic resonance imaging, x-ray computed tomography, and x-ray digital subtraction angiography. The construction materials used were optimized with respect to their ultrasonic speed of sound and attenuation coefficient, MR relaxometry (T{sub 1},T{sub 2}) properties, and Hounsfield number/x-ray attenuation coefficient, with a design capable of tolerating high-pressure pulsatile flow. Fiducial targets, incorporated into the phantoms to allow for registration of images among modalities, were chosen to minimize geometric distortions. Results: High quality distortion-free images of the phantoms with good contrast between vessel lumen, fiducial markers, and background tissue to visualize all stenoses were obtained with each modality. Quantitative assessments of the grade of stenosis revealed significant discrepancies between modalities, with each underestimating the stenosis severity for the higher-stenosed phantoms (70% and 85%) by up to 14%, with the greatest discrepancy attributable to DSA. Conclusions: The design and construction of a range of anatomically realistic renal artery phantoms containing varying degrees of stenosis is described. Images obtained using the main four diagnostic techniques used to detect RAS were free from artifacts and exhibited adequate contrast

Comparative imaging study in ultrasound, MRI, CT, and DSA using a multimodality renal artery phantom

International Nuclear Information System (INIS)

King, Deirdre M.; Fagan, Andrew J.; Moran, Carmel M.; Browne, Jacinta E.

2011-01-01

Purpose: A range of anatomically realistic multimodality renal artery phantoms consisting of vessels with varying degrees of stenosis was developed and evaluated using four imaging techniques currently used to detect renal artery stenosis (RAS). The spatial resolution required to visualize vascular geometry and the velocity detection performance required to adequately characterize blood flow in patients suffering from RAS are currently ill-defined, with the result that no one imaging modality has emerged as a gold standard technique for screening for this disease. Methods: The phantoms, which contained a range of stenosis values (0%, 30%, 50%, 70%, and 85%), were designed for use with ultrasound, magnetic resonance imaging, x-ray computed tomography, and x-ray digital subtraction angiography. The construction materials used were optimized with respect to their ultrasonic speed of sound and attenuation coefficient, MR relaxometry (T 1 ,T 2 ) properties, and Hounsfield number/x-ray attenuation coefficient, with a design capable of tolerating high-pressure pulsatile flow. Fiducial targets, incorporated into the phantoms to allow for registration of images among modalities, were chosen to minimize geometric distortions. Results: High quality distortion-free images of the phantoms with good contrast between vessel lumen, fiducial markers, and background tissue to visualize all stenoses were obtained with each modality. Quantitative assessments of the grade of stenosis revealed significant discrepancies between modalities, with each underestimating the stenosis severity for the higher-stenosed phantoms (70% and 85%) by up to 14%, with the greatest discrepancy attributable to DSA. Conclusions: The design and construction of a range of anatomically realistic renal artery phantoms containing varying degrees of stenosis is described. Images obtained using the main four diagnostic techniques used to detect RAS were free from artifacts and exhibited adequate contrast to allow

Dermatological Feasibility of Multimodal Facial Color Imaging Modality for Cross-Evaluation of Facial Actinic Keratosis

Science.gov (United States)

Bae, Youngwoo; Son, Taeyoon; Nelson, J. Stuart; Kim, Jae-Hong; Choi, Eung Ho; Jung, Byungjo

2010-01-01

Background/Purpose Digital color image analysis is currently considered as a routine procedure in dermatology. In our previous study, a multimodal facial color imaging modality (MFCIM), which provides a conventional, parallel- and cross-polarization, and fluorescent color image, was introduced for objective evaluation of various facial skin lesions. This study introduces a commercial version of MFCIM, DermaVision-PRO, for routine clinical use in dermatology and demonstrates its dermatological feasibility for cross-evaluation of skin lesions. Methods/Results Sample images of subjects with actinic keratosis or non-melanoma skin cancers were obtained at four different imaging modes. Various image analysis methods were applied to cross-evaluate the skin lesion and, finally, extract valuable diagnostic information. DermaVision-PRO is potentially a useful tool as an objective macroscopic imaging modality for quick prescreening and cross-evaluation of facial skin lesions. Conclusion DermaVision-PRO may be utilized as a useful tool for cross-evaluation of widely distributed facial skin lesions and an efficient database management of patient information. PMID:20923462

Automated Registration of Multimodal Optic Disc Images: Clinical Assessment of Alignment Accuracy.

Science.gov (United States)

Ng, Wai Siene; Legg, Phil; Avadhanam, Venkat; Aye, Kyaw; Evans, Steffan H P; North, Rachel V; Marshall, Andrew D; Rosin, Paul; Morgan, James E

2016-04-01

To determine the accuracy of automated alignment algorithms for the registration of optic disc images obtained by 2 different modalities: fundus photography and scanning laser tomography. Images obtained with the Heidelberg Retina Tomograph II and paired photographic optic disc images of 135 eyes were analyzed. Three state-of-the-art automated registration techniques Regional Mutual Information, rigid Feature Neighbourhood Mutual Information (FNMI), and nonrigid FNMI (NRFNMI) were used to align these image pairs. Alignment of each composite picture was assessed on a 5-point grading scale: "Fail" (no alignment of vessels with no vessel contact), "Weak" (vessels have slight contact), "Good" (vessels with 50% contact), and "Excellent" (complete alignment). Custom software generated an image mosaic in which the modalities were interleaved as a series of alternate 5×5-pixel blocks. These were graded independently by 3 clinically experienced observers. A total of 810 image pairs were assessed. All 3 registration techniques achieved a score of "Good" or better in >95% of the image sets. NRFNMI had the highest percentage of "Excellent" (mean: 99.6%; range, 95.2% to 99.6%), followed by Regional Mutual Information (mean: 81.6%; range, 86.3% to 78.5%) and FNMI (mean: 73.1%; range, 85.2% to 54.4%). Automated registration of optic disc images by different modalities is a feasible option for clinical application. All 3 methods provided useful levels of alignment, but the NRFNMI technique consistently outperformed the others and is recommended as a practical approach to the automated registration of multimodal disc images.

Self-imaging effect of TM modes in photonic crystal multimode waveguides only exhibiting band gaps for TE modes

International Nuclear Information System (INIS)

Yu Tianbao; Jiang Xiaoqing; Yang Jianyi; Zhou Haifeng; Liao Qinghua; Wang Minghua

2007-01-01

This Letter presents the properties of transverse-magnetic (TM) modes in multimode photonic crystal waveguides (PCWs), which only exhibit photonic band gaps for transverse-electric (TE) modes. A good equivalent model is applied to analysis the designed structures on the basis of multimode interference effect and self-imaging principle. The performance shows that the TM modes can also be propagated with high efficiency, and resemble index-guided modes owing to the combination of total internal reflection (TIR) and distribution Bragg reflection. It provides a novel way to realize the components for both TM and TE polarizations by combining PBG and TIR effect in PCWs. As one of potential applications, polarization-insensitive power splitter based on the proposed structures can be designed

A fully automatic approach for multimodal PET and MR image segmentation in gamma knife treatment planning.

Science.gov (United States)

Rundo, Leonardo; Stefano, Alessandro; Militello, Carmelo; Russo, Giorgio; Sabini, Maria Gabriella; D'Arrigo, Corrado; Marletta, Francesco; Ippolito, Massimo; Mauri, Giancarlo; Vitabile, Salvatore; Gilardi, Maria Carla

2017-06-01

Nowadays, clinical practice in Gamma Knife treatments is generally based on MRI anatomical information alone. However, the joint use of MRI and PET images can be useful for considering both anatomical and metabolic information about the lesion to be treated. In this paper we present a co-segmentation method to integrate the segmented Biological Target Volume (BTV), using [ 11 C]-Methionine-PET (MET-PET) images, and the segmented Gross Target Volume (GTV), on the respective co-registered MR images. The resulting volume gives enhanced brain tumor information to be used in stereotactic neuro-radiosurgery treatment planning. GTV often does not match entirely with BTV, which provides metabolic information about brain lesions. For this reason, PET imaging is valuable and it could be used to provide complementary information useful for treatment planning. In this way, BTV can be used to modify GTV, enhancing Clinical Target Volume (CTV) delineation. A novel fully automatic multimodal PET/MRI segmentation method for Leksell Gamma Knife ® treatments is proposed. This approach improves and combines two computer-assisted and operator-independent single modality methods, previously developed and validated, to segment BTV and GTV from PET and MR images, respectively. In addition, the GTV is utilized to combine the superior contrast of PET images with the higher spatial resolution of MRI, obtaining a new BTV, called BTV MRI . A total of 19 brain metastatic tumors, undergone stereotactic neuro-radiosurgery, were retrospectively analyzed. A framework for the evaluation of multimodal PET/MRI segmentation is also presented. Overlap-based and spatial distance-based metrics were considered to quantify similarity concerning PET and MRI segmentation approaches. Statistics was also included to measure correlation among the different segmentation processes. Since it is not possible to define a gold-standard CTV according to both MRI and PET images without treatment response assessment

Multimodal imaging Gd-nanoparticles functionalized with Pittsburgh compound B or a nanobody for amyloid plaques targeting.

Science.gov (United States)

Pansieri, Jonathan; Plissonneau, Marie; Stransky-Heilkron, Nathalie; Dumoulin, Mireille; Heinrich-Balard, Laurence; Rivory, Pascaline; Morfin, Jean-François; Toth, Eva; Saraiva, Maria Joao; Allémann, Eric; Tillement, Olivier; Forge, Vincent; Lux, François; Marquette, Christel

2017-07-01

Gadolinium-based nanoparticles were functionalized with either the Pittsburgh compound B or a nanobody (B10AP) in order to create multimodal tools for an early diagnosis of amyloidoses. The ability of the functionalized nanoparticles to target amyloid fibrils made of β-amyloid peptide, amylin or Val30Met-mutated transthyretin formed in vitro or from pathological tissues was investigated by a range of spectroscopic and biophysics techniques including fluorescence microscopy. Nanoparticles functionalized by both probes efficiently interacted with the three types of amyloid fibrils, with K D values in 10 micromolar and 10 nanomolar range for, respectively, Pittsburgh compound B and B10AP nanoparticles. Moreover, they allowed the detection of amyloid deposits on pathological tissues. Such functionalized nanoparticles could represent promising flexible and multimodal imaging tools for the early diagnostic of amyloid diseases, in other words, Alzheimer's disease, Type 2 diabetes mellitus and the familial amyloidotic polyneuropathy.

Size selectivity of magnetite core- (Ag/Au) shell nanoparticles for multimodal imaging applications

Science.gov (United States)

Singh, Pinki; Upadhyay, Chandan

2017-10-01

The magnetic and optical properties of nanomaterials play a significant role in the selection of the materials to be used for contrast enhancement in different biological and cell imaging techniques. These nanoparticles can also be used as drug delivery agents. The calculation of absorption efficiency and surface plasmon resonance wavelength has been performed using Mie theory and MATLAB programs. The study of spectrum calculated indicates the dependence of several optical properties such as resonance and absorption efficiency peak on ratio of core radius to the thickness of shell. A systematic study on the effect of nanoparticle dimension has been presented which clearly indicates that the optical properties can be modulated across the visible and near infrared range by changing these parameters. These properties of nanomaterials make them suitable for their application as multimodal imaging agents as they are also magnetically active and biocompatible.

A Novel Multimodal Biometrics Recognition Model Based on Stacked ELM and CCA Methods

Directory of Open Access Journals (Sweden)

Jucheng Yang

2018-04-01

Full Text Available Multimodal biometrics combine a variety of biological features to have a significant impact on identification performance, which is a newly developed trend in biometrics identification technology. This study proposes a novel multimodal biometrics recognition model based on the stacked extreme learning machines (ELMs and canonical correlation analysis (CCA methods. The model, which has a symmetric structure, is found to have high potential for multimodal biometrics. The model works as follows. First, it learns the hidden-layer representation of biological images using extreme learning machines layer by layer. Second, the canonical correlation analysis method is applied to map the representation to a feature space, which is used to reconstruct the multimodal image feature representation. Third, the reconstructed features are used as the input of a classifier for supervised training and output. To verify the validity and efficiency of the method, we adopt it for new hybrid datasets obtained from typical face image datasets and finger-vein image datasets. Our experimental results demonstrate that our model performs better than traditional methods.

Polarization-Sensitive Hyperspectral Imaging in vivo: A Multimode Dermoscope for Skin Analysis

Science.gov (United States)

Vasefi, Fartash; MacKinnon, Nicholas; Saager, Rolf B.; Durkin, Anthony J.; Chave, Robert; Lindsley, Erik H.; Farkas, Daniel L.

2014-05-01

Attempts to understand the changes in the structure and physiology of human skin abnormalities by non-invasive optical imaging are aided by spectroscopic methods that quantify, at the molecular level, variations in tissue oxygenation and melanin distribution. However, current commercial and research systems to map hemoglobin and melanin do not correlate well with pathology for pigmented lesions or darker skin. We developed a multimode dermoscope that combines polarization and hyperspectral imaging with an efficient analytical model to map the distribution of specific skin bio-molecules. This corrects for the melanin-hemoglobin misestimation common to other systems, without resorting to complex and computationally intensive tissue optical models. For this system's proof of concept, human skin measurements on melanocytic nevus, vitiligo, and venous occlusion conditions were performed in volunteers. The resulting molecular distribution maps matched physiological and anatomical expectations, confirming a technologic approach that can be applied to next generation dermoscopes and having biological plausibility that is likely to appeal to dermatologists.

New Technologies, New Possibilities for the Arts and Multimodality in English Language Arts

Science.gov (United States)

Williams, Wendy R.

2014-01-01

This article discusses the arts, multimodality, and new technologies in English language arts. It then turns to the example of the illuminated text--a multimodal book report consisting of animated text, music, and images--to consider how art, multimodality, and technology can work together to support students' reading of literature and inspire…

Characterizing the inflammatory tissue response to acute myocardial infarction by clinical multimodality noninvasive imaging.

Science.gov (United States)

Wollenweber, Tim; Roentgen, Philipp; Schäfer, Andreas; Schatka, Imke; Zwadlo, Caroline; Brunkhorst, Thomas; Berding, Georg; Bauersachs, Johann; Bengel, Frank M

2014-09-01

Myocardial infarction (MI) triggers a systemic inflammatory response which determines subsequent healing. Experimentally, cardiac positron emission tomography and magnetic resonance imaging have been used successfully to obtain mechanistic insights. We explored the translational potential in patients early after MI. Positron emission tomography/computed tomography and cardiac magnetic resonance were performed in 15 patients sources of inflammatory cells. Positron emission tomography and cardiac magnetic resonance multimodality characterization of the acutely infarcted, inflamed myocardium may provide multiparametric end points for clinical studies aiming at support of infarct healing. © 2014 American Heart Association, Inc.

Vision 20/20: Simultaneous CT-MRI — Next chapter of multimodality imaging

International Nuclear Information System (INIS)

Wang, Ge; Xi, Yan; Gjesteby, Lars; Getzin, Matthew; Yang, Qingsong; Cong, Wenxiang; Kalra, Mannudeep; Murugan, Venkatesh; Vannier, Michael

2015-01-01

Multimodality imaging systems such as positron emission tomography-computed tomography (PET-CT) and MRI-PET are widely available, but a simultaneous CT-MRI instrument has not been developed. Synergies between independent modalities, e.g., CT, MRI, and PET/SPECT can be realized with image registration, but such postprocessing suffers from registration errors that can be avoided with synchronized data acquisition. The clinical potential of simultaneous CT-MRI is significant, especially in cardiovascular and oncologic applications where studies of the vulnerable plaque, response to cancer therapy, and kinetic and dynamic mechanisms of targeted agents are limited by current imaging technologies. The rationale, feasibility, and realization of simultaneous CT-MRI are described in this perspective paper. The enabling technologies include interior tomography, unique gantry designs, open magnet and RF sequences, and source and detector adaptation. Based on the experience with PET-CT, PET-MRI, and MRI-LINAC instrumentation where hardware innovation and performance optimization were instrumental to construct commercial systems, the authors provide top-level concepts for simultaneous CT-MRI to meet clinical requirements and new challenges. Simultaneous CT-MRI fills a major gap of modality coupling and represents a key step toward the so-called “omnitomography” defined as the integration of all relevant imaging modalities for systems biology and precision medicine

Vision 20/20: Simultaneous CT-MRI — Next chapter of multimodality imaging

Energy Technology Data Exchange (ETDEWEB)

Wang, Ge, E-mail: wangg6@rpi.edu; Xi, Yan; Gjesteby, Lars; Getzin, Matthew; Yang, Qingsong; Cong, Wenxiang [Biomedical Imaging Center/Cluster, Rensselaer Polytechnic Institute, Troy, New York 12180 (United States); Kalra, Mannudeep; Murugan, Venkatesh [Department of Imaging, Massachusetts General Hospital, 55 Fruit Street, Boston, Massachusetts 02114 (United States); Vannier, Michael [Department of Radiology, University of Chicago, Chicago, Illinois 60637 (United States)

2015-10-15

Multimodality imaging systems such as positron emission tomography-computed tomography (PET-CT) and MRI-PET are widely available, but a simultaneous CT-MRI instrument has not been developed. Synergies between independent modalities, e.g., CT, MRI, and PET/SPECT can be realized with image registration, but such postprocessing suffers from registration errors that can be avoided with synchronized data acquisition. The clinical potential of simultaneous CT-MRI is significant, especially in cardiovascular and oncologic applications where studies of the vulnerable plaque, response to cancer therapy, and kinetic and dynamic mechanisms of targeted agents are limited by current imaging technologies. The rationale, feasibility, and realization of simultaneous CT-MRI are described in this perspective paper. The enabling technologies include interior tomography, unique gantry designs, open magnet and RF sequences, and source and detector adaptation. Based on the experience with PET-CT, PET-MRI, and MRI-LINAC instrumentation where hardware innovation and performance optimization were instrumental to construct commercial systems, the authors provide top-level concepts for simultaneous CT-MRI to meet clinical requirements and new challenges. Simultaneous CT-MRI fills a major gap of modality coupling and represents a key step toward the so-called “omnitomography” defined as the integration of all relevant imaging modalities for systems biology and precision medicine.

Mesh-to-raster region-of-interest-based nonrigid registration of multimodal images.

Science.gov (United States)

Tatano, Rosalia; Berkels, Benjamin; Deserno, Thomas M

2017-10-01

Region of interest (RoI) alignment in medical images plays a crucial role in diagnostics, procedure planning, treatment, and follow-up. Frequently, a model is represented as triangulated mesh while the patient data is provided from computed axial tomography scanners as pixel or voxel data. Previously, we presented a 2-D method for curve-to-pixel registration. This paper contributes (i) a general mesh-to-raster framework to register RoIs in multimodal images; (ii) a 3-D surface-to-voxel application, and (iii) a comprehensive quantitative evaluation in 2-D using ground truth (GT) provided by the simultaneous truth and performance level estimation (STAPLE) method. The registration is formulated as a minimization problem, where the objective consists of a data term, which involves the signed distance function of the RoI from the reference image and a higher order elastic regularizer for the deformation. The evaluation is based on quantitative light-induced fluoroscopy (QLF) and digital photography (DP) of decalcified teeth. STAPLE is computed on 150 image pairs from 32 subjects, each showing one corresponding tooth in both modalities. The RoI in each image is manually marked by three experts (900 curves in total). In the QLF-DP setting, our approach significantly outperforms the mutual information-based registration algorithm implemented with the Insight Segmentation and Registration Toolkit and Elastix.

Highlights lecture EANM 2016: "Embracing molecular imaging and multi-modal imaging: a smart move for nuclear medicine towards personalized medicine".

Science.gov (United States)

Aboagye, Eric O; Kraeber-Bodéré, Françoise

2017-08-01

The 2016 EANM Congress took place in Barcelona, Spain, from 15 to 19 October under the leadership of Prof. Wim Oyen, chair of the EANM Scientific Committee. With more than 6,000 participants, this congress was the most important European event in nuclear medicine, bringing together a multidisciplinary community involved in the different fields of nuclear medicine. There were over 600 oral and 1,200 poster or e-Poster presentations with an overwhelming focus on development and application of imaging for personalized care, which is timely for the community. Beyond FDG PET, major highlights included progress in the use of PSMA and SSTR receptor-targeted radiopharmaceuticals and associated theranostics in oncology. Innovations in radiopharmaceuticals for imaging pathologies of the brain and cardiovascular system, as well as infection and inflammation, were also highlighted. In the areas of physics and instrumentation, multimodality imaging and radiomics were highlighted as promising areas of research.

Experimental Study on Bioluminescence Tomography with Multimodality Fusion

Directory of Open Access Journals (Sweden)

Yujie Lv

2007-01-01

Full Text Available To verify the influence of a priori information on the nonuniqueness problem of bioluminescence tomography (BLT, the multimodality imaging fusion based BLT experiment is performed by multiview noncontact detection mode, which incorporates the anatomical information obtained by the microCT scanner and the background optical properties based on diffuse reflectance measurements. In the reconstruction procedure, the utilization of adaptive finite element methods (FEMs and a priori permissible source region refines the reconstructed results and improves numerical robustness and efficiency. The comparison between the absence and employment of a priori information shows that multimodality imaging fusion is essential to quantitative BLT reconstruction.

Single myelin fiber imaging in living rodents without labeling by deep optical coherence microscopy

Science.gov (United States)

Ben Arous, Juliette; Binding, Jonas; Léger, Jean-François; Casado, Mariano; Topilko, Piotr; Gigan, Sylvain; Claude Boccara, A.; Bourdieu, Laurent

2011-11-01

Myelin sheath disruption is responsible for multiple neuropathies in the central and peripheral nervous system. Myelin imaging has thus become an important diagnosis tool. However, in vivo imaging has been limited to either low-resolution techniques unable to resolve individual fibers or to low-penetration imaging of single fibers, which cannot provide quantitative information about large volumes of tissue, as required for diagnostic purposes. Here, we perform myelin imaging without labeling and at micron-scale resolution with >300-μm penetration depth on living rodents. This was achieved with a prototype [termed deep optical coherence microscopy (deep-OCM)] of a high-numerical aperture infrared full-field optical coherence microscope, which includes aberration correction for the compensation of refractive index mismatch and high-frame-rate interferometric measurements. We were able to measure the density of individual myelinated fibers in the rat cortex over a large volume of gray matter. In the peripheral nervous system, deep-OCM allows, after minor surgery, in situ imaging of single myelinated fibers over a large fraction of the sciatic nerve. This allows quantitative comparison of normal and Krox20 mutant mice, in which myelination in the peripheral nervous system is impaired. This opens promising perspectives for myelin chronic imaging in demyelinating diseases and for minimally invasive medical diagnosis.

Single myelin fiber imaging in living rodents without labeling by deep optical coherence microscopy.

Science.gov (United States)

Ben Arous, Juliette; Binding, Jonas; Léger, Jean-François; Casado, Mariano; Topilko, Piotr; Gigan, Sylvain; Boccara, A Claude; Bourdieu, Laurent

2011-11-01

Myelin sheath disruption is responsible for multiple neuropathies in the central and peripheral nervous system. Myelin imaging has thus become an important diagnosis tool. However, in vivo imaging has been limited to either low-resolution techniques unable to resolve individual fibers or to low-penetration imaging of single fibers, which cannot provide quantitative information about large volumes of tissue, as required for diagnostic purposes. Here, we perform myelin imaging without labeling and at micron-scale resolution with >300-μm penetration depth on living rodents. This was achieved with a prototype [termed deep optical coherence microscopy (deep-OCM)] of a high-numerical aperture infrared full-field optical coherence microscope, which includes aberration correction for the compensation of refractive index mismatch and high-frame-rate interferometric measurements. We were able to measure the density of individual myelinated fibers in the rat cortex over a large volume of gray matter. In the peripheral nervous system, deep-OCM allows, after minor surgery, in situ imaging of single myelinated fibers over a large fraction of the sciatic nerve. This allows quantitative comparison of normal and Krox20 mutant mice, in which myelination in the peripheral nervous system is impaired. This opens promising perspectives for myelin chronic imaging in demyelinating diseases and for minimally invasive medical diagnosis.

Markerless registration for image guided surgery. Preoperative image, intraoperative video image, and patient

International Nuclear Information System (INIS)

Kihara, Tomohiko; Tanaka, Yuko

1998-01-01

Real-time and volumetric acquisition of X-ray CT, MR, and SPECT is the latest trend of the medical imaging devices. A clinical challenge is to use these multi-modality volumetric information complementary on patient in the entire diagnostic and surgical processes. The intraoperative image and patient integration intents to establish a common reference frame by image in diagnostic and surgical processes. This provides a quantitative measure during surgery, for which we have been relied mostly on doctors' skills and experiences. The intraoperative image and patient integration involves various technologies, however, we think one of the most important elements is the development of markerless registration, which should be efficient and applicable to the preoperative multi-modality data sets, intraoperative image, and patient. We developed a registration system which integrates preoperative multi-modality images, intraoperative video image, and patient. It consists of a real-time registration of video camera for intraoperative use, a markerless surface sampling matching of patient and image, our previous works of markerless multi-modality image registration of X-ray CT, MR, and SPECT, and an image synthesis on video image. We think these techniques can be used in many applications which involve video camera like devices such as video camera, microscope, and image Intensifier. (author)

A small animal holding fixture system with positional reproducibility for longitudinal multimodal imaging

Energy Technology Data Exchange (ETDEWEB)

Kokuryo, Daisuke; Kimura, Yuichi; Obata, Takayuki; Yamaya, Taiga; Kawamura, Kazunori; Zhang, Ming-Rong; Kanno, Iwao; Aoki, Ichio, E-mail: ukimura@ieee.or [Molecular Imaging Center, National Institute of Radiological Sciences, 4-9-1 Anagawa, Inage, Chiba 263-8555 (Japan)

2010-07-21

This study presents a combined small animal holding fixture system, termed a 'bridge capsule', which provides for small animal re-fixation with positional reproducibility. This system comprises separate holding fixtures for the head and lower body and a connecting part to a gas anesthesia system. A mouse is fixed in place by the combination of a head fixture with a movable part made from polyacetal resin, a lower body fixture made from vinyl-silicone and a holder for the legs and tail. For re-fixation, a similar posture could be maintained by the same holding fixtures and a constant distance between the head and lower body fixtures is maintained. Artifacts caused by the bridge capsule system were not observed on magnetic resonance (MRI) and positron emission tomography (PET) images. The average position differences of the spinal column and the iliac body before and after re-fixation for the same modality were approximately 1.1 mm. The difference between the MRI and PET images was approximately 1.8 mm for the lower body fixture after image registration using fiducial markers. This system would be useful for longitudinal, repeated and multimodal imaging experiments requiring similar animal postures.

Multi-modal imaging, model-based tracking, and mixed reality visualisation for orthopaedic surgery

Science.gov (United States)

Fuerst, Bernhard; Tateno, Keisuke; Johnson, Alex; Fotouhi, Javad; Osgood, Greg; Tombari, Federico; Navab, Nassir

2017-01-01

Orthopaedic surgeons are still following the decades old workflow of using dozens of two-dimensional fluoroscopic images to drill through complex 3D structures, e.g. pelvis. This Letter presents a mixed reality support system, which incorporates multi-modal data fusion and model-based surgical tool tracking for creating a mixed reality environment supporting screw placement in orthopaedic surgery. A red–green–blue–depth camera is rigidly attached to a mobile C-arm and is calibrated to the cone-beam computed tomography (CBCT) imaging space via iterative closest point algorithm. This allows real-time automatic fusion of reconstructed surface and/or 3D point clouds and synthetic fluoroscopic images obtained through CBCT imaging. An adapted 3D model-based tracking algorithm with automatic tool segmentation allows for tracking of the surgical tools occluded by hand. This proposed interactive 3D mixed reality environment provides an intuitive understanding of the surgical site and supports surgeons in quickly localising the entry point and orienting the surgical tool during screw placement. The authors validate the augmentation by measuring target registration error and also evaluate the tracking accuracy in the presence of partial occlusion. PMID:29184659

Gestational Trophoblastic Disease: A Multimodality Imaging Approach with Impact on Diagnosis and Management

Directory of Open Access Journals (Sweden)

Sunita Dhanda

2014-01-01

Full Text Available Gestational trophoblastic disease is a condition of uncertain etiology, comprised of hydatiform mole (complete and partial, invasive mole, choriocarcinoma, and placental site trophoblastic tumor. It arises from abnormal proliferation of trophoblastic tissue. Early diagnosis of gestational trophoblastic disease and its potential complications is important for timely and successful management of the condition with preservation of fertility. Initial diagnosis is based on a multimodality approach: encompassing clinical features, serial quantitative β-hCG titers, and pelvic ultrasonography. Pelvic magnetic resonance imaging (MRI is sometimes used as a problem-solving tool to assess the depth of myometrial invasion and extrauterine disease spread in equivocal and complicated cases. Chest radiography, body computed tomography (CT, and brain MRI have been recommended as investigative tools for overall disease staging. Angiography has a role in management of disease complications and metastases. Efficacy of PET (positron emission tomography and PET/CT in the evaluation of recurrent or metastatic disease has not been adequately investigated yet. This paper discusses the imaging features of gestational trophoblastic disease on various imaging modalities and the role of different imaging techniques in the diagnosis and management of this entity.

New developments in multimodal clinical multiphoton tomography

Science.gov (United States)

König, Karsten

2011-03-01

80 years ago, the PhD student Maria Goeppert predicted in her thesis in Goettingen, Germany, two-photon effects. It took 30 years to prove her theory, and another three decades to realize the first two-photon microscope. With the beginning of this millennium, first clinical multiphoton tomographs started operation in research institutions, hospitals, and in the cosmetic industry. The multiphoton tomograph MPTflexTM with its miniaturized flexible scan head became the Prism-Award 2010 winner in the category Life Sciences. Multiphoton tomographs with its superior submicron spatial resolution can be upgraded to 5D imaging tools by adding spectral time-correlated single photon counting units. Furthermore, multimodal hybrid tomographs provide chemical fingerprinting and fast wide-field imaging. The world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph in spring 2010. In particular, nonfluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen have been imaged in patients with dermatological disorders. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution imaging tools such as ultrasound, optoacoustic, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer (malignant melanoma), optimization of treatment strategies (wound healing, dermatitis), and cosmetic research including long-term biosafety tests of ZnO sunscreen nanoparticles and the measurement of the stimulated biosynthesis of collagen by anti-ageing products.

In-situ Multimodal Imaging and Spectroscopy of Mg Electrodeposition at Electrode-Electrolyte Interfaces

Science.gov (United States)

Wu, Yimin A.; Yin, Zuwei; Farmand, Maryam; Yu, Young-Sang; Shapiro, David A.; Liao, Hong-Gang; Liang, Wen-I.; Chu, Ying-Hao; Zheng, Haimei

2017-02-01

We report the study of Mg cathodic electrochemical deposition on Ti and Au electrode using a multimodal approach by examining the sample area in-situ using liquid cell transmission electron microscopy (TEM), scanning transmission X-ray microscopy (STXM) and X-ray absorption spectroscopy (XAS). Magnesium Aluminum Chloride Complex was synthesized and utilized as electrolyte, where non-reversible features during in situ charging-discharging cycles were observed. During charging, a uniform Mg film was deposited on the electrode, which is consistent with the intrinsic non-dendritic nature of Mg deposition in Mg ion batteries. The Mg thin film was not dissolvable during the following discharge process. We found that such Mg thin film is hexacoordinated Mg compounds by in-situ STXM and XAS. This study provides insights on the non-reversibility issue and failure mechanism of Mg ion batteries. Also, our method provides a novel generic method to understand the in situ battery chemistry without any further sample processing, which can preserve the original nature of battery materials or electrodeposited materials. This multimodal in situ imaging and spectroscopy provides many opportunities to attack complex problems that span orders of magnitude in length and time scale, which can be applied to a broad range of the energy storage systems.

Multimodal breast cancer imaging using coregistered dynamic diffuse optical tomography and digital breast tomosynthesis

Science.gov (United States)

Zimmermann, Bernhard B.; Deng, Bin; Singh, Bhawana; Martino, Mark; Selb, Juliette; Fang, Qianqian; Sajjadi, Amir Y.; Cormier, Jayne; Moore, Richard H.; Kopans, Daniel B.; Boas, David A.; Saksena, Mansi A.; Carp, Stefan A.

2017-04-01

Diffuse optical tomography (DOT) is emerging as a noninvasive functional imaging method for breast cancer diagnosis and neoadjuvant chemotherapy monitoring. In particular, the multimodal approach of combining DOT with x-ray digital breast tomosynthesis (DBT) is especially synergistic as DBT prior information can be used to enhance the DOT reconstruction. DOT, in turn, provides a functional information overlay onto the mammographic images, increasing sensitivity and specificity to cancer pathology. We describe a dynamic DOT apparatus designed for tight integration with commercial DBT scanners and providing a fast (up to 1 Hz) image acquisition rate to enable tracking hemodynamic changes induced by the mammographic breast compression. The system integrates 96 continuous-wave and 24 frequency-domain source locations as well as 32 continuous wave and 20 frequency-domain detection locations into low-profile plastic plates that can easily mate to the DBT compression paddle and x-ray detector cover, respectively. We demonstrate system performance using static and dynamic tissue-like phantoms as well as in vivo images acquired from the pool of patients recalled for breast biopsies at the Massachusetts General Hospital Breast Imaging Division.

Cell-permeable Ln(III) chelate-functionalized InP quantum dots as multimodal imaging agents.

Science.gov (United States)

Stasiuk, Graeme J; Tamang, Sudarsan; Imbert, Daniel; Poillot, Cathy; Giardiello, Marco; Tisseyre, Céline; Barbier, Emmanuel L; Fries, Pascal Henry; de Waard, Michel; Reiss, Peter; Mazzanti, Marinella

2011-10-25

Quantum dots (QDs) are ideal scaffolds for the development of multimodal imaging agents, but their application in clinical diagnostics is limited by the toxicity of classical CdSe QDs. A new bimodal MRI/optical nanosized contrast agent with high gadolinium payload has been prepared through direct covalent attachment of up to 80 Gd(III) chelates on fluorescent nontoxic InP/ZnS QDs. It shows a high relaxivity of 900 mM(-1) s(-1) (13 mM(-1 )s(-1) per Gd ion) at 35 MHz (0.81 T) and 298 K, while the bright luminescence of the QDs is preserved. Eu(III) and Tb(III) chelates were also successfully grafted to the InP/ZnS QDs. The absence of energy transfer between the QD and lanthanide emitting centers results in a multicolor system. Using this convenient direct grafting strategy additional targeting ligands can be included on the QD. Here a cell-penetrating peptide has been co-grafted in a one-pot reaction to afford a cell-permeable multimodal multimeric MRI contrast agent that reports cellular localization by fluorescence and provides high relaxivity and increased tissue retention with respect to commercial contrast agents.

Meet interesting abbreviations in clinical mass spectrometry: from compound classification by REIMS to multimodal and mass spectrometry imaging (MSI)

Czech Academy of Sciences Publication Activity Database

Luptáková, Dominika; Pluháček, Tomáš; Palyzová, Andrea; Přichystal, Jakub; Balogh, J.; Lemr, Karel; Juránek, I.; Havlíček, Vladimír

2017-01-01

Roč. 61, č. 3 (2017), s. 353-360 ISSN 0001-723X R&D Projects: GA MŠk(CZ) LO1509; GA ČR(CZ) GA16-20229S Institutional support: RVO:61388971 Keywords : REIMS * multimodal * mass spectrometry imaging Subject RIV: EE - Microbiology, Virology OBOR OECD: Microbiology Impact factor: 0.673, year: 2016

Brain Abnormalities in Congenital Fibrosis of the Extraocular Muscles Type 1: A Multimodal MRI Imaging Study.

Science.gov (United States)

Miao, Wen; Man, Fengyuan; Wu, Shaoqin; Lv, Bin; Wang, Zhenchang; Xian, Junfang; Sabel, Bernhard A; He, Huiguang; Jiao, Yonghong

2015-01-01

To explore the possible brain structural and functional alterations in congenital fibrosis of extraocular muscles type 1 (CFEOM1) patients using multimodal MRI imaging. T1-weighted, diffusion tensor images and functional MRI data were obtained from 9 KIF21A positive patients and 19 age- and gender-matched healthy controls. Voxel based morphometry and tract based spatial statistics were applied to the T1-weighted and diffusion tensor images, respectively. Amplitude of low frequency fluctuations and regional homogeneity were used to process the functional MRI data. We then compared these multimodal characteristics between CFEOM1 patients and healthy controls. Compared with healthy controls, CFEOM1 patients demonstrated increased grey matter volume in bilateral frontal orbital cortex and in the right temporal pole. No diffusion indices changes were detected, indicating unaffected white matter microstructure. In addition, from resting state functional MRI data, trend of amplitude of low-frequency fluctuations increases were noted in the right inferior parietal lobe and in the right frontal cortex, and a trend of ReHo increase (pleft precentral gyrus, left orbital frontal cortex, temporal pole and cingulate gyrus. CFEOM1 patients had structural and functional changes in grey matter, but the white matter was unaffected. These alterations in the brain may be due to the abnormality of extraocular muscles and their innervating nerves. Future studies should consider the possible correlations between brain morphological/functional findings and clinical data, especially pertaining to eye movements, to obtain more precise answers about the role of brain area changes and their functional consequence in CFEOM1.

Brain Abnormalities in Congenital Fibrosis of the Extraocular Muscles Type 1: A Multimodal MRI Imaging Study

Science.gov (United States)

Wu, Shaoqin; Lv, Bin; Wang, Zhenchang; Xian, Junfang; Sabel, Bernhard A.; He, Huiguang; Jiao, Yonghong

2015-01-01

Purpose To explore the possible brain structural and functional alterations in congenital fibrosis of extraocular muscles type 1 (CFEOM1) patients using multimodal MRI imaging. Methods T1-weighted, diffusion tensor images and functional MRI data were obtained from 9 KIF21A positive patients and 19 age- and gender- matched healthy controls. Voxel based morphometry and tract based spatial statistics were applied to the T1-weighted and diffusion tensor images, respectively. Amplitude of low frequency fluctuations and regional homogeneity were used to process the functional MRI data. We then compared these multimodal characteristics between CFEOM1 patients and healthy controls. Results Compared with healthy controls, CFEOM1 patients demonstrated increased grey matter volume in bilateral frontal orbital cortex and in the right temporal pole. No diffusion indices changes were detected, indicating unaffected white matter microstructure. In addition, from resting state functional MRI data, trend of amplitude of low-frequency fluctuations increases were noted in the right inferior parietal lobe and in the right frontal cortex, and a trend of ReHo increase (pleft precentral gyrus, left orbital frontal cortex, temporal pole and cingulate gyrus. Conclusions CFEOM1 patients had structural and functional changes in grey matter, but the white matter was unaffected. These alterations in the brain may be due to the abnormality of extraocular muscles and their innervating nerves. Future studies should consider the possible correlations between brain morphological/functional findings and clinical data, especially pertaining to eye movements, to obtain more precise answers about the role of brain area changes and their functional consequence in CFEOM1. PMID:26186732

2017 multimodality appropriate use criteria for noninvasive cardiac imaging: Export consensus of the Asian society of cardiovascular imaging

Energy Technology Data Exchange (ETDEWEB)

Beck, Kyong Min Sarah [Dept. of Radiology, Seoul St. Mary' s Hospital, College of Medicine, The Catholic University of Korea, Seoul (Korea, Republic of); Kim, Jeong A [Dept. of Radiology, Ilsan Paik Hospital, Inje University College of Medicine, Goyang (Korea, Republic of); Choe, Yeon Hyeon [Dept. of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul (Korea, Republic of); and others

2017-11-15

In 2010, the Asian Society of Cardiovascular Imaging (ASCI) provided recommendations for cardiac CT and MRI, and this document reflects an update of the 2010 ASCI appropriate use criteria (AUC). In 2016, the ASCI formed a new working group for revision of AUC for noninvasive cardiac imaging. A major change that we made in this document is the rating of various noninvasive tests (exercise electrocardiogram, echocardiography, positron emission tomography, single-photon emission computed tomography, radionuclide imaging, cardiac magnetic resonance, and cardiac computed tomography/angiography), compared side by side for their applications in various clinical scenarios. Ninety-five clinical scenarios were developed from eight selected pre-existing guidelines and classified into four sections as follows: 1) detection of coronary artery disease, symptomatic or asymptomatic; 2) cardiac evaluation in various clinical scenarios; 3) use of imaging modality according to prior testing; and 4) evaluation of cardiac structure and function. The clinical scenarios were scored by a separate rating committee on a scale of 1–9 to designate appropriate use, uncertain use, or inappropriate use according to a modified Delphi method. Overall, the AUC ratings for CT were higher than those of previous guidelines. These new AUC provide guidance for clinicians choosing among available testing modalities for various cardiac diseases and are also unique, given that most previous AUC for noninvasive imaging include only one imaging technique. As cardiac imaging is multimodal in nature, we believe that these AUC will be more useful for clinical decision making.

Spectral embedding-based registration (SERg) for multimodal fusion of prostate histology and MRI

Science.gov (United States)

Hwuang, Eileen; Rusu, Mirabela; Karthigeyan, Sudha; Agner, Shannon C.; Sparks, Rachel; Shih, Natalie; Tomaszewski, John E.; Rosen, Mark; Feldman, Michael; Madabhushi, Anant

2014-03-01

Multi-modal image registration is needed to align medical images collected from different protocols or imaging sources, thereby allowing the mapping of complementary information between images. One challenge of multimodal image registration is that typical similarity measures rely on statistical correlations between image intensities to determine anatomical alignment. The use of alternate image representations could allow for mapping of intensities into a space or representation such that the multimodal images appear more similar, thus facilitating their co-registration. In this work, we present a spectral embedding based registration (SERg) method that uses non-linearly embedded representations obtained from independent components of statistical texture maps of the original images to facilitate multimodal image registration. Our methodology comprises the following main steps: 1) image-derived textural representation of the original images, 2) dimensionality reduction using independent component analysis (ICA), 3) spectral embedding to generate the alternate representations, and 4) image registration. The rationale behind our approach is that SERg yields embedded representations that can allow for very different looking images to appear more similar, thereby facilitating improved co-registration. Statistical texture features are derived from the image intensities and then reduced to a smaller set by using independent component analysis to remove redundant information. Spectral embedding generates a new representation by eigendecomposition from which only the most important eigenvectors are selected. This helps to accentuate areas of salience based on modality-invariant structural information and therefore better identifies corresponding regions in both the template and target images. The spirit behind SERg is that image registration driven by these areas of salience and correspondence should improve alignment accuracy. In this work, SERg is implemented using Demons

Single-pulse CARS based multimodal nonlinear optical microscope for bioimaging.

Science.gov (United States)

Kumar, Sunil; Kamali, Tschackad; Levitte, Jonathan M; Katz, Ori; Hermann, Boris; Werkmeister, Rene; Považay, Boris; Drexler, Wolfgang; Unterhuber, Angelika; Silberberg, Yaron

2015-05-18

Noninvasive label-free imaging of biological systems raises demand not only for high-speed three-dimensional prescreening of morphology over a wide-field of view but also it seeks to extract the microscopic functional and molecular details within. Capitalizing on the unique advantages brought out by different nonlinear optical effects, a multimodal nonlinear optical microscope can be a powerful tool for bioimaging. Bringing together the intensity-dependent contrast mechanisms via second harmonic generation, third harmonic generation and four-wave mixing for structural-sensitive imaging, and single-beam/single-pulse coherent anti-Stokes Raman scattering technique for chemical sensitive imaging in the finger-print region, we have developed a simple and nearly alignment-free multimodal nonlinear optical microscope that is based on a single wide-band Ti:Sapphire femtosecond pulse laser source. Successful imaging tests have been realized on two exemplary biological samples, a canine femur bone and collagen fibrils harvested from a rat tail. Since the ultra-broad band-width femtosecond laser is a suitable source for performing high-resolution optical coherence tomography, a wide-field optical coherence tomography arm can be easily incorporated into the presented multimodal microscope making it a versatile optical imaging tool for noninvasive label-free bioimaging.

Development of comprehensive image processing technique for differential diagnosis of liver disease by using multi-modality images. Pixel-based cross-correlation method using a profile

International Nuclear Information System (INIS)

Inoue, Akira; Okura, Yasuhiko; Akiyama, Mitoshi; Ishida, Takayuki; Kawashita, Ikuo; Ito, Katsuyoshi; Matsunaga, Naofumi; Sanada, Taizo

2009-01-01

Imaging techniques such as high magnetic field imaging and multidetector-row CT have been markedly improved recently. The final image-reading systems easily produce more than a thousand diagnostic images per patient. Therefore, we developed a comprehensive cross-correlation processing technique using multi-modality images, in order to decrease the considerable time and effort involved in the interpretation of a radiogram (multi-formatted display and/or stack display method, etc). In this scheme, the criteria of an attending radiologist for the differential diagnosis of liver cyst, hemangioma of liver, hepatocellular carcinoma, and metastatic liver cancer on magnetic resonance images with various sequences and CT images with and without contrast enhancement employ a cross-correlation coefficient. Using a one-dimensional cross-correlation method, comprehensive image processing could be also adapted for various artifacts (some depending on modality imaging, and some on patients), which may be encountered at the clinical scene. This comprehensive image-processing technique could assist radiologists in the differential diagnosis of liver diseases. (author)

Gastric Adenocarcinoma: A Multimodal Approach

Directory of Open Access Journals (Sweden)

Humair S. Quadri

2017-08-01

Full Text Available Despite its declining incidence, gastric cancer (GC remains a leading cause of cancer-related deaths worldwide. A multimodal approach to GC is critical to ensure optimal patient outcomes. Pretherapy fine resolution contrast-enhanced cross-sectional imaging, endoscopic ultrasound and staging laparoscopy play an important role in patients with newly diagnosed ostensibly operable GC to avoid unnecessary non-therapeutic laparotomies. Currently, margin negative gastrectomy and adequate lymphadenectomy performed at high volume hospitals remain the backbone of GC treatment. Importantly, adequate GC surgery should be integrated in the setting of a multimodal treatment approach. Treatment for advanced GC continues to expand with the emergence of additional lines of systemic and targeted therapies.

Multimodal Hyper-connectivity Networks for MCI Classification.

Science.gov (United States)

Li, Yang; Gao, Xinqiang; Jie, Biao; Yap, Pew-Thian; Kim, Min-Jeong; Wee, Chong-Yaw; Shen, Dinggang

2017-09-01

Hyper-connectivity network is a network where every edge is connected to more than two nodes, and can be naturally denoted using a hyper-graph. Hyper-connectivity brain network, either based on structural or functional interactions among the brain regions, has been used for brain disease diagnosis. However, the conventional hyper-connectivity network is constructed solely based on single modality data, ignoring potential complementary information conveyed by other modalities. The integration of complementary information from multiple modalities has been shown to provide a more comprehensive representation about the brain disruptions. In this paper, a novel multimodal hyper-network modelling method was proposed for improving the diagnostic accuracy of mild cognitive impairment (MCI). Specifically, we first constructed a multimodal hyper-connectivity network by simultaneously considering information from diffusion tensor imaging and resting-state functional magnetic resonance imaging data. We then extracted different types of network features from the hyper-connectivity network, and further exploited a manifold regularized multi-task feature selection method to jointly select the most discriminative features. Our proposed multimodal hyper-connectivity network demonstrated a better MCI classification performance than the conventional single modality based hyper-connectivity networks.

Multimodality Cardiac Imaging for the Assessment of Left Atrial Function and the Association With Atrial Arrhythmias

DEFF Research Database (Denmark)

Olsen, Flemming Javier; Bertelsen, Litten; de Knegt, Martina Chantal

2016-01-01

Several cardiac imaging modalities are able to visualize the left atrium (LA) and, therefore, allow for quantification of both structural and functional properties of this cardiac chamber. In echocardiography, only the maximal LA volume is included in the assessment of diastolic function at the c......Several cardiac imaging modalities are able to visualize the left atrium (LA) and, therefore, allow for quantification of both structural and functional properties of this cardiac chamber. In echocardiography, only the maximal LA volume is included in the assessment of diastolic function...... atrial fibrillation, which will be a point of focus in this review. Pivotal cardiac magnetic resonance imaging studies have revealed high correlation between LA fibrosis and risk of atrial fibrillation recurrence after catheter ablation, and subsequent multimodality imaging studies have uncovered...... an inverse relationship between LA reservoir function and degree of LA fibrosis. This has sparked an increased interest into the application of advanced imaging modalities, including both speckle tracking echocardiography and tissue tracking by cardiac magnetic resonance imaging. Even though increasing...

Computer-based image analysis in radiological diagnostics and image-guided therapy: 3D-Reconstruction, contrast medium dynamics, surface analysis, radiation therapy and multi-modal image fusion

International Nuclear Information System (INIS)

Beier, J.

2001-01-01

This book deals with substantial subjects of postprocessing and analysis of radiological image data, a particular emphasis was put on pulmonary themes. For a multitude of purposes the developed methods and procedures can directly be transferred to other non-pulmonary applications. The work presented here is structured in 14 chapters, each describing a selected complex of research. The chapter order reflects the sequence of the processing steps starting from artefact reduction, segmentation, visualization, analysis, therapy planning and image fusion up to multimedia archiving. In particular, this includes virtual endoscopy with three different scene viewers (Chap. 6), visualizations of the lung disease bronchiectasis (Chap. 7), surface structure analysis of pulmonary tumors (Chap. 8), quantification of contrast medium dynamics from temporal 2D and 3D image sequences (Chap. 9) as well as multimodality image fusion of arbitrary tomographical data using several visualization techniques (Chap. 12). Thus, the software systems presented cover the majority of image processing applications necessary in radiology and were entirely developed, implemented and validated in the clinical routine of a university medical school. (orig.) [de

IMAGING WITH MULTIMODAL ADAPTIVE-OPTICS OPTICAL COHERENCE TOMOGRAPHY IN MULTIPLE EVANESCENT WHITE DOT SYNDROME: THE STRUCTURE AND FUNCTIONAL RELATIONSHIP.

Science.gov (United States)

Labriola, Leanne T; Legarreta, Andrew D; Legarreta, John E; Nadler, Zach; Gallagher, Denise; Hammer, Daniel X; Ferguson, R Daniel; Iftimia, Nicusor; Wollstein, Gadi; Schuman, Joel S

2016-01-01

To elucidate the location of pathological changes in multiple evanescent white dot syndrome (MEWDS) with the use of multimodal adaptive optics (AO) imaging. A 5-year observational case study of a 24-year-old female with recurrent MEWDS. Full examination included history, Snellen chart visual acuity, pupil assessment, intraocular pressures, slit lamp evaluation, dilated fundoscopic exam, imaging with Fourier-domain optical coherence tomography (FD-OCT), blue-light fundus autofluorescence (FAF), fundus photography, fluorescein angiography, and adaptive-optics optical coherence tomography. Three distinct acute episodes of MEWDS occurred during the period of follow-up. Fourier-domain optical coherence tomography and adaptive-optics imaging showed disturbance in the photoreceptor outer segments (PR OS) in the posterior pole with each flare. The degree of disturbance at the photoreceptor level corresponded to size and extent of the visual field changes. All findings were transient with delineation of the photoreceptor recovery from the outer edges of the lesion inward. Hyperautofluorescence was seen during acute flares. Increase in choroidal thickness did occur with each active flare but resolved. Although changes in the choroid and RPE can be observed in MEWDS, Fourier-domain optical coherence tomography, and multimodal adaptive optics imaging localized the visually significant changes seen in this disease at the level of the photoreceptors. These transient retinal changes specifically occur at the level of the inner segment ellipsoid and OS/RPE line. En face optical coherence tomography imaging provides a detailed, yet noninvasive method for following the convalescence of MEWDS and provides insight into the structural and functional relationship of this transient inflammatory retinal disease.

Multimodal nonlinear imaging of atherosclerotic plaques differentiation of triglyceride and cholesterol deposits

Directory of Open Access Journals (Sweden)

Christian Matthäus

2014-09-01

Full Text Available Cardiovascular diseases in general and atherothrombosis as the most common of its individual disease entities is the leading cause of death in the developed countries. Therefore, visualization and characterization of inner arterial plaque composition is of vital diagnostic interest, especially for the early recognition of vulnerable plaques. Established clinical techniques provide valuable morphological information but cannot deliver information about the chemical composition of individual plaques. Therefore, spectroscopic imaging techniques have recently drawn considerable attention. Based on the spectroscopic properties of the individual plaque components, as for instance different types of lipids, the composition of atherosclerotic plaques can be analyzed qualitatively as well as quantitatively. Here, we compare the feasibility of multimodal nonlinear imaging combining two-photon fluorescence (TPF, coherent anti-Stokes Raman scattering (CARS and second-harmonic generation (SHG microscopy to contrast composition and morphology of lipid deposits against the surrounding matrix of connective tissue with diffraction limited spatial resolution. In this contribution, the spatial distribution of major constituents of the arterial wall and atherosclerotic plaques like elastin, collagen, triglycerides and cholesterol can be simultaneously visualized by a combination of nonlinear imaging methods, providing a powerful label-free complement to standard histopathological methods with great potential for in vivo application.

Multimodal microscopy and the stepwise multi-photon activation fluorescence of melanin

Science.gov (United States)

Lai, Zhenhua

The author's work is divided into three aspects: multimodal microscopy, stepwise multi-photon activation fluorescence (SMPAF) of melanin, and customized-profile lenses (CPL) for on-axis laser scanners, which will be introduced respectively. A multimodal microscope provides the ability to image samples with multiple modalities on the same stage, which incorporates the benefits of all modalities. The multimodal microscopes developed in this dissertation are the Keck 3D fusion multimodal microscope 2.0 (3DFM 2.0), upgraded from the old 3DFM with improved performance and flexibility, and the multimodal microscope for targeting small particles (the "Target" system). The control systems developed for both microscopes are low-cost and easy-to-build, with all components off-the-shelf. The control system have not only significantly decreased the complexity and size of the microscope, but also increased the pixel resolution and flexibility. The SMPAF of melanin, activated by a continuous-wave (CW) mode near-infrared (NIR) laser, has potential applications for a low-cost and reliable method of detecting melanin. The photophysics of melanin SMPAF has been studied by theoretical analysis of the excitation process and investigation of the spectra, activation threshold, and photon number absorption of melanin SMPAF. SMPAF images of melanin in mouse hair and skin, mouse melanoma, and human black and white hairs are compared with images taken by conventional multi-photon fluorescence microscopy (MPFM) and confocal reflectance microscopy (CRM). SMPAF images significantly increase specificity and demonstrate the potential to increase sensitivity for melanin detection compared to MPFM images and CRM images. Employing melanin SMPAF imaging to detect melanin inside human skin in vivo has been demonstrated, which proves the effectiveness of melanin detection using SMPAF for medical purposes. Selective melanin ablation with micrometer resolution has been presented using the Target system

A magnetic nanoparticle stabilized gas containing emulsion for multimodal imaging and triggered drug release.

Science.gov (United States)

Guo, Wei; Li, Diancheng; Zhu, Jia-an; Wei, Xiaohui; Men, Weiwei; Yin, Dazhi; Fan, Mingxia; Xu, Yuhong

2014-06-01

To develop a multimodal imaging guided and triggered drug delivery system based on a novel emulsion formulation composed of iron oxide nanoparticles, nanoscopic bubbles, and oil containing drugs. Iron oxide paramagnetic nanoparticles were synthesized and modified with surface conjugation of polyethylenimide (PEI) or Bovine Serum Albumin (BSA). Both particles were used to disperse and stabilize oil in water emulsions containing coumarin-6 as the model drug. Sulfur hexafluoride was introduced into the oil phase to form nanoscopic bubbles inside the emulsions. The resulted gas containing emulsions were evaluated for their magnetic resonance (MR) and ultrasound (US) imaging properties. The drug release profile triggered by ultrasound was also examined. We have successfully prepared the highly integrated multi-component emulsion system using the surface modified iron oxide nanoparticles to stabilize the interfaces. The resulted structure had distinctive MR and US imaging properties. Upon application of ultrasound waves, the gas containing emulsion would burst and encapsulated drug could be released. The integrated emulsion formulation was multifunctional with paramagnetic, sono-responsive and drug-carrying characteristics, which may have potential applications for disease diagnosis and imaging guided drug release.

Advances in the behavioural testing and network imaging of rodent recognition memory

Science.gov (United States)

Kinnavane, Lisa; Albasser, Mathieu M.; Aggleton, John P.

2015-01-01

Research into object recognition memory has been galvanised by the introduction of spontaneous preference tests for rodents. The standard task, however, contains a number of inherent shortcomings that reduce its power. Particular issues include the problem that individual trials are time consuming, so limiting the total number of trials in any condition. In addition, the spontaneous nature of the behaviour and the variability between test objects add unwanted noise. To combat these issues, the ‘bow-tie maze’ was introduced. Although still based on the spontaneous preference of novel over familiar stimuli, the ability to give multiple trials within a session without handling the rodents, as well as using the same objects as both novel and familiar samples on different trials, overcomes key limitations in the standard task. Giving multiple trials within a single session also creates new opportunities for functional imaging of object recognition memory. A series of studies are described that examine the expression of the immediate-early gene, c-fos. Object recognition memory is associated with increases in perirhinal cortex and area Te2 c-fos activity. When rats explore novel objects the pathway from the perirhinal cortex to lateral entorhinal cortex, and then to the dentate gyrus and CA3, is engaged. In contrast, when familiar objects are explored the pathway from the perirhinal cortex to lateral entorhinal cortex, and then to CA1, takes precedence. The switch to the perforant pathway (novel stimuli) from the temporoammonic pathway (familiar stimuli) may assist the enhanced associative learning promoted by novel stimuli. PMID:25106740

Interactivity in Educational Apps for Young children: A Multimodal Analysis

Directory of Open Access Journals (Sweden)

Alexandra H. Blitz-Raith

2017-11-01

Full Text Available Interactivity is an important indicator of an educational app's reception. Since most educational apps are multimodal, it justifies a methodological initiative to understand meaningful involvement of multimodality in enacting and even amplifying interactivity in an educational app. Yet research so far has largely concentrated on algorithm construct and user feedback rather than on multimodal interactions, especially from a social semiotics perspective. Drawing from social semiotics approaches, this article proposes a multimodal analytic framework to examine three layers of mode in engendering interaction; namely, multiplicity, function, and relationship. Using the analytic framework in an analysis of The Farm Adventure for Kids, a popular educational app for pre-school children, we found that still images are dominant proportionally and are central in the interactive process. We also found that tapping still images of animals on screen is the main action, with other screen actions deliberately excluded. Such findings suggest that aligning children’s cognitive and physical capabilities to the use of mode become the primary consideration in educational app design and that consistent attendance to this alignment in mobilizing modes significantly affect an educational app’s interactivity, and consequently its reception by young children

Brain Abnormalities in Congenital Fibrosis of the Extraocular Muscles Type 1: A Multimodal MRI Imaging Study.

Directory of Open Access Journals (Sweden)

Wen Miao

Full Text Available To explore the possible brain structural and functional alterations in congenital fibrosis of extraocular muscles type 1 (CFEOM1 patients using multimodal MRI imaging.T1-weighted, diffusion tensor images and functional MRI data were obtained from 9 KIF21A positive patients and 19 age- and gender-matched healthy controls. Voxel based morphometry and tract based spatial statistics were applied to the T1-weighted and diffusion tensor images, respectively. Amplitude of low frequency fluctuations and regional homogeneity were used to process the functional MRI data. We then compared these multimodal characteristics between CFEOM1 patients and healthy controls.Compared with healthy controls, CFEOM1 patients demonstrated increased grey matter volume in bilateral frontal orbital cortex and in the right temporal pole. No diffusion indices changes were detected, indicating unaffected white matter microstructure. In addition, from resting state functional MRI data, trend of amplitude of low-frequency fluctuations increases were noted in the right inferior parietal lobe and in the right frontal cortex, and a trend of ReHo increase (p<0.001 uncorrected in the left precentral gyrus, left orbital frontal cortex, temporal pole and cingulate gyrus.CFEOM1 patients had structural and functional changes in grey matter, but the white matter was unaffected. These alterations in the brain may be due to the abnormality of extraocular muscles and their innervating nerves. Future studies should consider the possible correlations between brain morphological/functional findings and clinical data, especially pertaining to eye movements, to obtain more precise answers about the role of brain area changes and their functional consequence in CFEOM1.

Linking variability in brain chemistry and circuit function through multimodal human neuroimaging

DEFF Research Database (Denmark)

Fisher, Patrick M; Hariri, A R

2012-01-01

and dopamine system and its effects on threat- and reward-related brain function, we review evidence for how such a multimodal neuroimaging strategy can be successfully implemented. Furthermore, we discuss how multimodal PET-fMRI can be integrated with techniques such as imaging genetics, pharmacological......Identifying neurobiological mechanisms mediating the emergence of individual differences in behavior is critical for advancing our understanding of relative risk for psychopathology. Neuroreceptor positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) can be used...

Mn-doped near-infrared quantum dots as multimodal targeted probes for pancreatic cancer imaging

Science.gov (United States)

Yong, Ken-Tye

2009-01-01

This work presents a novel approach to producing manganese (Mn)-doped quantum dots (Mnd-QDs) emitting in the near-infrared (NIR). Surface functionalization of Mnd-QDs with lysine makes them stably disperse in aqueous media and able to conjugate with targeting molecules. The nanoparticles were structurally and compositionally characterized and maintained a high photoluminescence quantum yield and displayed paramagnetism in water. The receptor-mediated delivery of bioconjugated Mnd-QDs into pancreatic cancer cells was demonstrated using the confocal microscopy technique. Cytotoxicity of Mnd-QDs on live cells has been evaluated. The NIR-emitting characteristic of the QDs has been exploited to acquire whole animal body imaging with high contrast signals. In addition, histological and blood analysis of mice have revealed that no long-term toxic effects arise from MnD-QDs. These studies suggest multimodal Mnd-QDs have the potentials as probes for early pancreatic cancer imaging and detection.

Tractography-Based Score for Learning Effective Connectivity From Multimodal Imaging Data Using Dynamic Bayesian Networks.

Science.gov (United States)

Dang, Shilpa; Chaudhury, Santanu; Lall, Brejesh; Roy, Prasun K

2018-05-01

Effective connectivity (EC) is the methodology for determining functional-integration among the functionally active segregated regions of the brain. By definition EC is "the causal influence exerted by one neuronal group on another" which is constrained by anatomical connectivity (AC) (axonal connections). AC is necessary for EC but does not fully determine it, because synaptic communication occurs dynamically in a context-dependent fashion. Although there is a vast emerging evidence of structure-function relationship using multimodal imaging studies, till date only a few studies have done joint modeling of the two modalities: functional MRI (fMRI) and diffusion tensor imaging (DTI). We aim to propose a unified probabilistic framework that combines information from both sources to learn EC using dynamic Bayesian networks (DBNs). DBNs are probabilistic graphical temporal models that learn EC in an exploratory fashion. Specifically, we propose a novel anatomically informed (AI) score that evaluates fitness of a given connectivity structure to both DTI and fMRI data simultaneously. The AI score is employed in structure learning of DBN given the data. Experiments with synthetic-data demonstrate the face validity of structure learning with our AI score over anatomically uninformed counterpart. Moreover, real-data results are cross-validated by performing classification-experiments. EC inferred on real fMRI-DTI datasets is found to be consistent with previous literature and show promising results in light of the AC present as compared to other classically used techniques such as Granger-causality. Multimodal analyses provide a more reliable basis for differentiating brain under abnormal/diseased conditions than the single modality analysis.

Performance study of a fan beam collimator designed for a multi-modality small animal imaging device

International Nuclear Information System (INIS)

Sabbir Ahmed, ASM; Kramer, Gary H.; Semmler, Wolfrad; Peter, Jorg

2011-01-01

This paper describes the methodology to design and conduct the performances of a fan beam collimator. This fan beam collimator was designed to use with a multi-modality small animal imaging device and the performance of the collimator was studied for a 3D geometry. Analytical expressions were formulated to calculate the parameters for the collimator. A Monte Carlo model was developed to analyze the scattering and image noises for a 3D object. The results showed that the performance of the fan beam collimator was strongly dependent on the source distribution and position. The fan beam collimator showed increased counting efficiency in comparison to a parallel hole collimator. Inside attenuating medium, the increased attenuating effect outweighed the fan beam increased counting efficiency.

Multimodal ophthalmic imaging using handheld spectrally encoded coherence tomography and reflectometry (SECTR)

Science.gov (United States)

Leeburg, Kelsey C.; El-Haddad, Mohamed T.; Malone, Joseph D.; Terrones, Benjamin D.; Tao, Yuankai K.

2018-02-01

Scanning laser ophthalmoscopy (SLO) provides high-speed, noninvasive en face imaging of the retinal fundus. Optical coherence tomography (OCT) is the current "gold-standard" for ophthalmic diagnostic imaging and enables depth-resolved visualization of ophthalmic structures and image-based surrogate biomarkers of disease. We present a compact optical and mechanical design for handheld spectrally encoded coherence tomography and reflectometry (SECTR) for multimodality en face spectrally encoded reflectometry (SER) and cross-sectional OCT imaging. We custom-designed a double-pass telecentric scan lens, which halves the size of 4-f optical relays and allowed us to reduce the footprint of our SECTR scan-head by a factor of >2.7x (volume) over our previous design. The double-pass scan lens was optimized for diffraction-limited performance over a +/-10° scan field. SECTR optics and optomechanics were combined in a compact rapid-prototyped enclosure with dimensions 87 x 141.8 x 137 mm (w x h x d). SECTR was implemented using a custom-built 400 kHz 1050 nm swept-source. OCT and SER were simultaneously digitized on dual input channels of a 4 GS/s digitizer at 1.4 GS/s per channel. In vivo human en face SER and cross-sectional OCT images were acquired at 350 fps. OCT volumes of 1000 B-scans were acquired in 2.86 s. We believe clinical translation of our compact handheld design will benefit point-of-care ophthalmic diagnostics in patients who are unable to be imaged on conventional slit-lamp based systems, such as infants and the bedridden. When combined with multi-volumetric registration methods, handheld SECTR will have advantages in motion-artifact free imaging over existing handheld technologies.

Prostate multimodality image registration based on B-splines and quadrature local energy.

Science.gov (United States)

Mitra, Jhimli; Martí, Robert; Oliver, Arnau; Lladó, Xavier; Ghose, Soumya; Vilanova, Joan C; Meriaudeau, Fabrice

2012-05-01

Needle biopsy of the prostate is guided by Transrectal Ultrasound (TRUS) imaging. The TRUS images do not provide proper spatial localization of malignant tissues due to the poor sensitivity of TRUS to visualize early malignancy. Magnetic Resonance Imaging (MRI) has been shown to be sensitive for the detection of early stage malignancy, and therefore, a novel 2D deformable registration method that overlays pre-biopsy MRI onto TRUS images has been proposed. The registration method involves B-spline deformations with Normalized Mutual Information (NMI) as the similarity measure computed from the texture images obtained from the amplitude responses of the directional quadrature filter pairs. Registration accuracy of the proposed method is evaluated by computing the Dice Similarity coefficient (DSC) and 95% Hausdorff Distance (HD) values for 20 patients prostate mid-gland slices and Target Registration Error (TRE) for 18 patients only where homologous structures are visible in both the TRUS and transformed MR images. The proposed method and B-splines using NMI computed from intensities provide average TRE values of 2.64 ± 1.37 and 4.43 ± 2.77 mm respectively. Our method shows statistically significant improvement in TRE when compared with B-spline using NMI computed from intensities with Student's t test p = 0.02. The proposed method shows 1.18 times improvement over thin-plate splines registration with average TRE of 3.11 ± 2.18 mm. The mean DSC and the mean 95% HD values obtained with the proposed method of B-spline with NMI computed from texture are 0.943 ± 0.039 and 4.75 ± 2.40 mm respectively. The texture energy computed from the quadrature filter pairs provides better registration accuracy for multimodal images than raw intensities. Low TRE values of the proposed registration method add to the feasibility of it being used during TRUS-guided biopsy.

Toward in vivo diagnosis of skin cancer using multimode imaging dermoscopy: (II) molecular mapping of highly pigmented lesions

Science.gov (United States)

Vasefi, Fartash; MacKinnon, Nicholas; Farkas, Daniel L.

2014-03-01

We have developed a multimode imaging dermoscope that combines polarization and hyperspectral imaging with a computationally rapid analytical model. This approach employs specific spectral ranges of visible and near infrared wavelengths for mapping the distribution of specific skin bio-molecules. This corrects for the melanin-hemoglobin misestimation common to other systems, without resorting to complex and computationally intensive tissue optical models that are prone to inaccuracies due to over-modeling. Various human skin measurements including a melanocytic nevus, and venous occlusion conditions were investigated and compared with other ratiometric spectral imaging approaches. Access to the broad range of hyperspectral data in the visible and near-infrared range allows our algorithm to flexibly use different wavelength ranges for chromophore estimation while minimizing melanin-hemoglobin optical signature cross-talk.

Late effects of high-dose adjuvant chemotherapy on white and gray matter in breast cancer survivors: Converging results from multimodal magnetic resonance imaging

NARCIS (Netherlands)

de Ruiter, Michiel B.; Reneman, Liesbeth; Boogerd, Willem; Veltman, Dick J.; Caan, Matthan; Douaud, Gwenaëlle; Lavini, Cristina; Linn, Sabine C.; Boven, Epie; van Dam, Frits S. A. M.; Schagen, Sanne B.

2012-01-01

The neural substrate underlying cognitive impairments after chemotherapy is largely unknown. Here, we investigated very late (>9 years) effects of adjuvant high-dose chemotherapy on brain white and gray matter in primary breast cancer survivors (n = 17) with multimodal magnetic resonance imaging

Novel multimodality segmentation using level sets and Jensen-Renyi divergence

NARCIS (Netherlands)

Markel, Daniel; Zaidi, Habib; El Naqa, Issam

2013-01-01

Purpose: Positron emission tomography (PET) is playing an increasing role in radiotherapy treatment planning. However, despite progress, robust algorithms for PET and multimodal image segmentation are still lacking, especially if the algorithm were extended to image-guided and adaptive radiotherapy

Learning of Multimodal Representations With Random Walks on the Click Graph.

Science.gov (United States)

Wu, Fei; Lu, Xinyan; Song, Jun; Yan, Shuicheng; Zhang, Zhongfei Mark; Rui, Yong; Zhuang, Yueting

2016-02-01

In multimedia information retrieval, most classic approaches tend to represent different modalities of media in the same feature space. With the click data collected from the users' searching behavior, existing approaches take either one-to-one paired data (text-image pairs) or ranking examples (text-query-image and/or image-query-text ranking lists) as training examples, which do not make full use of the click data, particularly the implicit connections among the data objects. In this paper, we treat the click data as a large click graph, in which vertices are images/text queries and edges indicate the clicks between an image and a query. We consider learning a multimodal representation from the perspective of encoding the explicit/implicit relevance relationship between the vertices in the click graph. By minimizing both the truncated random walk loss as well as the distance between the learned representation of vertices and their corresponding deep neural network output, the proposed model which is named multimodal random walk neural network (MRW-NN) can be applied to not only learn robust representation of the existing multimodal data in the click graph, but also deal with the unseen queries and images to support cross-modal retrieval. We evaluate the latent representation learned by MRW-NN on a public large-scale click log data set Clickture and further show that MRW-NN achieves much better cross-modal retrieval performance on the unseen queries/images than the other state-of-the-art methods.

Approaching Athenian Graffiti as a Multimodal Genre with GIS Application

OpenAIRE

Stampoulidis, Georgios

2017-01-01

Graffiti as an ever-changing form of urban art and visual communication is naturally multimodal, focusing on text–image relations (Bateman 2014; Forceville 2008; Kress 2006), which owe their existence mainly to the sociocultural and historical knowledge of the represented world of our experience – Husserlian Lebenswelt [Lifeworld] (Sonesson 2008; 2015). These relations constitute an interesting challenge to multimodal interpretations, because both verbal and/or pictorial representations can i...

Coronary plaque morphology on multi-modality imagining and periprocedural myocardial infarction after percutaneous coronary intervention

Directory of Open Access Journals (Sweden)

Akira Sato

2016-06-01

Full Text Available Percutaneous coronary intervention (PCI may be complicated by periprocedural myocardial infarction (PMI as manifested by elevated cardiac biomarkers such as creatine kinase (CK-MB or troponin T. The occurrence of PMI has been shown to be associated with worse short- and long-term clinical outcome. However, recent studies suggest that PMI defined by biomarker levels alone is a marker of atherosclerosis burden and procedural complexity but in most cases does not have independent prognostic significance. Diagnostic multi-modality imaging such as intravascular ultrasound, optical coherence tomography, coronary angioscopy, near-infrared spectroscopy, multidetector computed tomography, and magnetic resonance imaging can be used to closely investigate the atherosclerotic lesion in order to detect morphological markers of unstable and vulnerable plaques in the patients undergoing PCI. With the improvement of technical aspects of multimodality coronary imaging, clinical practice and research are increasingly shifting toward defining the clinical implication of plaque morphology and patients outcomes. There were numerous published data regarding the relationship between pre-PCI lesion subsets on multi-modality imaging and post-PCI biomarker levels. In this review, we discuss the relationship between coronary plaque morphology estimated by invasive or noninvasive coronary imaging and the occurrence of PMI. Furthermore, this review underlies that the value of the multimodality coronary imaging approach will become the gold standard for invasive or noninvasive prediction of PMI in clinical practice.

Gestational Trophoblastic Disease: A Multimodality Imaging Approach with Impact on Diagnosis and Management

International Nuclear Information System (INIS)

Dhanda, S.; Ramani, S.; Dhanda, S.; Ramani, S.; Thakur, M.

2014-01-01

Gestational trophoblastic disease is a condition of uncertain etiology, comprised of hydatiform mole (complete and partial), invasive mole, choriocarcinoma, and placental site trophoblastic tumor. It arises from abnormal proliferation of trophoblastic tissue. Early diagnosis of gestational trophoblastic disease and its potential complications is important for timely and successful management of the condition with preservation of fertility. Initial diagnosis is based on a multimodality approach: encompassing clinical features, serial quantitative β-hCG titers, and pelvic ultrasonography. Pelvic magnetic resonance imaging (MRI) is sometimes used as a problem-solving tool to assess the depth of myometrial invasion and extra uterine disease spread in equivocal and complicated cases. Chest radiography, body computed tomography (CT), and brain MRI have been recommended as investigative tools for overall disease staging. Angiography has a role in management of disease complications and metastases. Efficacy of PET (positron emission tomography) and PET/CT in the evaluation of recurrent or metastatic disease has not been adequately investigated yet. This paper discusses the imaging features of gestational trophoblastic disease on various imaging modalities and the role of different imaging techniques in the diagnosis and management of this entity. 1. Introduction Gestational trophoblastic disease (GTD) refers to an abnormal trophoblastic proliferation composed of a broad spectrum of lesions ranging from benign, albeit pre malignant hydatiform mole (complete and partial), through to the aggressive invasive mole, choriocarcinoma

A multifunctional probe for ICP-MS determination and multimodal imaging of cancer cells.

Science.gov (United States)

Yang, Bin; Zhang, Yuan; Chen, Beibei; He, Man; Yin, Xiao; Wang, Han; Li, Xiaoting; Hu, Bin

2017-10-15

Inductively coupled plasma-mass spectrometry (ICP-MS) based bioassay and multimodal imaging have attracted increasing attention in the current development of cancer research and theranostics. Herein, a sensitive, simple, timesaving, and reliable immunoassay for cancer cells counting and dual-modal imaging was proposed by using ICP-MS detection and down-conversion fluorescence (FL)/upconversion luminescence (UCL) with the aid of a multifunctional probe for the first time. The probe consisted of a recognition unit of goat anti-mouse IgG to label the anti-EpCAM antibody attached cells, a fluorescent dye (Cy3) moiety for FL imaging as well as upconversion nanoparticles (UCNPs) tag for both ICP-MS quantification and UCL imaging of cancer cells. Under the optimized conditions, an excellent linearity and sensitivity were achieved owing to the signal amplification effect of nanoparticles and low spectral interference. Accordingly, a limit of detection (3σ) of 1×10 2 HepG2 cells and a relative standard deviation of 7.1% for seven replicate determinations of 1×10 3 HepG2 cells were obtained. This work proposed a method to employ UCNPs with highly integrated functionalities enabling us not only to count but also to see the cancer cells, opening a promising avenue for biological research and clinical theranostics. Copyright © 2017 Elsevier B.V. All rights reserved.

Feature-Fusion Guidelines for Image-Based Multi-Modal Biometric Fusion

Directory of Open Access Journals (Sweden)

Dane Brown

2017-07-01

Full Text Available The feature level, unlike the match score level, lacks multi-modal fusion guidelines. This work demonstrates a new approach for improved image-based biometric feature-fusion. The approach extracts and combines the face, fingerprint and palmprint at the feature level for improved human identification accuracy. Feature-fusion guidelines, proposed in our recent work, are extended by adding a new face segmentation method and the support vector machine classifier. The new face segmentation method improves the face identification equal error rate (EER by 10%. The support vector machine classifier combined with the new feature selection approach, proposed in our recent work, outperforms other classifiers when using a single training sample. Feature-fusion guidelines take the form of strengths and weaknesses as observed in the applied feature processing modules during preliminary experiments. The guidelines are used to implement an effective biometric fusion system at the feature level, using a novel feature-fusion methodology, reducing the EER of two groups of three datasets namely: SDUMLA face, SDUMLA fingerprint and IITD palmprint; MUCT Face, MCYT Fingerprint and CASIA Palmprint.

Advances in the behavioural testing and network imaging of rodent recognition memory.

Science.gov (United States)

Kinnavane, Lisa; Albasser, Mathieu M; Aggleton, John P

2015-05-15

Research into object recognition memory has been galvanised by the introduction of spontaneous preference tests for rodents. The standard task, however, contains a number of inherent shortcomings that reduce its power. Particular issues include the problem that individual trials are time consuming, so limiting the total number of trials in any condition. In addition, the spontaneous nature of the behaviour and the variability between test objects add unwanted noise. To combat these issues, the 'bow-tie maze' was introduced. Although still based on the spontaneous preference of novel over familiar stimuli, the ability to give multiple trials within a session without handling the rodents, as well as using the same objects as both novel and familiar samples on different trials, overcomes key limitations in the standard task. Giving multiple trials within a single session also creates new opportunities for functional imaging of object recognition memory. A series of studies are described that examine the expression of the immediate-early gene, c-fos. Object recognition memory is associated with increases in perirhinal cortex and area Te2 c-fos activity. When rats explore novel objects the pathway from the perirhinal cortex to lateral entorhinal cortex, and then to the dentate gyrus and CA3, is engaged. In contrast, when familiar objects are explored the pathway from the perirhinal cortex to lateral entorhinal cortex, and then to CA1, takes precedence. The switch to the perforant pathway (novel stimuli) from the temporoammonic pathway (familiar stimuli) may assist the enhanced associative learning promoted by novel stimuli. Copyright © 2014 The Authors. Published by Elsevier B.V. All rights reserved.

Urban resident attitudes toward rodents, rodent control products, and environmental effects

Science.gov (United States)

Rodent control in urban areas can result in the inadvertent mortality of non-target species (e.g., bobcats). However, there is little detailed information about rodent control practices of urban residents. Our objective was to evaluate urban rodent control behaviors in two area...

Second-harmonic generation and fluorescence lifetime imaging microscopy through a rodent mammary imaging window

Science.gov (United States)

Young, Pamela A.; Nazir, Muhammad; Szulczewski, Michael J.; Keely, Patricia J.; Eliceiri, Kevin W.

2012-03-01

Tumor-Associated Collagen Signatures (TACS) have been identified that manifest in specific ways during breast tumor progression and that correspond to patient outcome. There are also compelling metabolic changes associated with carcinoma invasion and progression. We have characterized the difference in the autofluorescent properties of metabolic co-factors, NADH and FAD, between normal and carcinoma breast cell lines. Also, we have shown in vitro that increased collagen density alters metabolic genes which are associated with glycolysis and leads to a more invasive phenotype. Establishing the relationship between collagen density, cellular metabolism, and metastasis in physiologically relevant cancer models is crucial for developing cancer therapies. To study cellular metabolism with respect to collagen density in vivo, we use multiphoton fluorescence excitation microscopy (MPM) in conjunction with a rodent mammary imaging window implanted in defined mouse cancer models. These models are ideal for the study of collagen changes in vivo, allowing determination of corresponding metabolic changes in breast cancer invasion and progression. To measure cellular metabolism, we collect fluorescence lifetime (FLIM) signatures of NADH and FAD, which are known to change based on the microenvironment of the cells. Additionally, MPM systems are capable of collecting second harmonic generation (SHG) signals which are a nonlinear optical property of collagen. Therefore, MPM, SHG, and FLIM are powerful tools with great potential for characterizing key features of breast carcinoma in vivo. Below we present the current efforts of our collaborative group to develop intravital approaches based on these imaging techniques to look at defined mouse mammary models.

Multimodality pH imaging in a mouse dorsal skin fold window chamber model

Science.gov (United States)

Leung, Hui Min; Schafer, Rachel; Pagel, Mark M.; Robey, Ian F.; Gmitro, Arthur F.

2013-03-01

Upregulate levels of expression and activity of membrane H+ ion pumps in cancer cells drives the extracellular pH (pHe,) to values lower than normal. Furthermore, disregulated pH is indicative of the changes in glycolytic metabolism in tumor cells and has been shown to facilitate extracellular tissue remodeling during metastasis Therefore, measurement of pHe could be a useful cancer biomarker for diagnostic and therapy monitoring evaluation. Multimodality in-vivo imaging of pHe in tumorous tissue in a mouse dorsal skin fold window chamber (DSFWC) model is described. A custom-made plastic window chamber structure was developed that is compatible with both imaging optical and MR imaging modalities and provides a model system for continuous study of the same tissue microenvironment on multiple imaging platforms over a 3-week period. For optical imaging of pHe, SNARF-1 carboxylic acid is injected intravenously into a SCID mouse with an implanted tumor. A ratiometric measurement of the fluorescence signal captured on a confocal microscope reveals the pHe of the tissue visible within the window chamber. This imaging method was used in a preliminary study to evaluate sodium bicarbonate as a potential drug treatment to reverse tissue acidosis. For MR imaging of pHe the chemical exchange saturation transfer (CEST) was used as an alternative way of measuring pHe in a DSFWC model. ULTRAVIST®, a FDA approved x-ray/CT contrast agent has been shown to have a CEST effect that is pH dependent. A ratiometric analysis of water saturation at 5.6 and 4.2 ppm chemical shift provides a means to estimate the local pHe.

Recent Progress in Synthesis and Functionalization of Multimodal Fluorescent-Magnetic Nanoparticles for Biological Applications

Directory of Open Access Journals (Sweden)

Raquel Serrano García

2018-01-01

Full Text Available There is a great interest in the development of new nanomaterials for multimodal imaging applications in biology and medicine. Multimodal fluorescent-magnetic based nanomaterials deserve particular attention as they can be used as diagnostic and drug delivery tools, which could facilitate the diagnosis and treatment of cancer and many other diseases. This review focuses on the recent developments of magnetic-fluorescent nanocomposites and their biomedical applications. The recent advances in synthetic strategies and approaches for the preparation of fluorescent-magnetic nanocomposites are presented. The main biomedical uses of multimodal fluorescent-magnetic nanomaterials, including biological imaging, cancer therapy and drug delivery, are discussed, and prospects of this field are outlined.

Multimodality imaging of 131I uptake in nude mice thyroid based on Cerenkov radiation

International Nuclear Information System (INIS)

Hu Zhenhua; Liang Jimin; Qu Xiaochao; Yang Weidong; Ma Xiaowei; Wang Jing; Tian Jie

2012-01-01

Objective: To perform the multimodality 131 I thyroid imaging using Cerenkov luminescence tomography (CLT) and gamma imaging, and to compare the results of CLT and gamma imaging. Methods The nude mice (n=4, mass: (21 ±3) g) were injected with 1.67 ×10 7 Bq 131 I. CLT and gamma imaging were acquired at 0.5, 3, 12 and 24 h after the injection. Three-dimensional biodistribution of 131 I uptake in thyroid was reconstructed using Cerenkov source reconstruction method based on the diffusion equation (DE), and the reconstructed power of 131 I in different acquisition time points was obtained. Additionally, the ROIs were drawn over the gamma images of the mouse neck, and the counts were read. The correlation between the reconstructed power of CLT and gamma ray counts of gamma imaging was analyzed. Results: The power of 131 I uptake in thyroid at 0.5, 3, 12 and 24 h were 7.80 ×10 -13 , 1.62×10 -12 , 2.20×10 -12 and 2.68 × 10 -12 W, respectively. CLT results showed that reconstructed power increased with the increasing of acquisition time. Gamma imaging results indicated that 131 I uptake decreased in abdomen and increased in thyroid with the collection time. The results of CLT were consistent with that of gamma imaging (r 2 =0.7620, P<0.05). Conclusion: CLT has the potential to identify and monitor functioning thyroid tissue at before and (or) after 131 I treatment. (authors)

Multimodality cardiac imaging of a ventricular septal rupture post myocardial infarction: a case report

Directory of Open Access Journals (Sweden)

Dhaliwal Surinder

2012-10-01

Full Text Available Abstract Background Ventricular septal rupture (VSR, a mechanical complication following an acute myocardial infarction (MI, is thought to result from coagulation necrosis due to lack of collateral reperfusion. Although the gold standard test to confirm left-to-right shunting between ventricular cavities remains invasive ventriculography, two-dimensional transthoracic echocardiography (TTE with color flow Doppler and cardiac MRI (CMR are reliable tests for the non-invasive diagnosis of VSR. Case presentation A 62-year-old Caucasian female presented with a late case of a VSR post inferior MI diagnosed by multimodality cardiac imaging including TTE, CMR and ventriculography. Conclusion We review the presentation, diagnosis and management of VSR post MI.

Multifunctional Fe3O4 @ Au core/shell nanostars: a unique platform for multimode imaging and photothermal therapy of tumors

Science.gov (United States)

Hu, Yong; Wang, Ruizhi; Wang, Shige; Ding, Ling; Li, Jingchao; Luo, Yu; Wang, Xiaolin; Shen, Mingwu; Shi, Xiangyang

2016-01-01

We herein report the development of multifunctional folic acid (FA)-targeted Fe3O4 @ Au nanostars (NSs) for targeted multi-mode magnetic resonance (MR)/computed tomography (CT)/photoacoustic (PA) imaging and photothermal therapy (PTT) of tumors. In this present work, citric acid-stabilized Fe3O4/Ag composite nanoparticles prepared by a mild reduction route were utilized as seeds and exposed to the Au growth solution to induce the formation of Fe3O4 @ Au core/shell NSs. Followed by successive decoration of thiolated polyethyleneimine (PEI-SH), FA via a polyethylene glycol spacer, and acetylation of the residual PEI amines, multifunctional Fe3O4 @ Au NSs were formed. The designed multifunctional NSs possess excellent colloidal stability, good cytocompatibility in a given concentration range, and specific recognition to cancer cells overexpressing FA receptors. Due to co-existence of Fe3O4 core and star-shaped Au shell, the NSs can be used for MR and CT imaging of tumors, respectively. Likewise, the near infrared plasmonic absorption feature also enables the NSs to be used for PA imaging and PTT of tumors. Our study clearly demonstrates a unique theranostic nanoplatform that can be used for high performance multi-mode imaging-guided PTT of tumors, which may be extendable for theranostics of different diseases in translational medicine. PMID:27325015

Preclinical Magnetic Resonance Fingerprinting (MRF) at 7 T: Effective Quantitative Imaging for Rodent Disease Models

Science.gov (United States)

Gao, Ying; Chen, Yong; Ma, Dan; Jiang, Yun; Herrmann, Kelsey A.; Vincent, Jason A.; Dell, Katherine M.; Drumm, Mitchell L.; Brady-Kalnay, Susann M.; Griswold, Mark A.; Flask, Chris A.; Lu, Lan

2015-01-01

High field, preclinical magnetic resonance imaging (MRI) scanners are now commonly used to quantitatively assess disease status and efficacy of novel therapies in a wide variety of rodent models. Unfortunately, conventional MRI methods are highly susceptible to respiratory and cardiac motion artifacts resulting in potentially inaccurate and misleading data. We have developed an initial preclinical, 7.0 T MRI implementation of the highly novel Magnetic Resonance Fingerprinting (MRF) methodology that has been previously described for clinical imaging applications. The MRF technology combines a priori variation in the MRI acquisition parameters with dictionary-based matching of acquired signal evolution profiles to simultaneously generate quantitative maps of T1 and T2 relaxation times and proton density. This preclinical MRF acquisition was constructed from a Fast Imaging with Steady-state Free Precession (FISP) MRI pulse sequence to acquire 600 MRF images with both evolving T1 and T2 weighting in approximately 30 minutes. This initial high field preclinical MRF investigation demonstrated reproducible and differentiated estimates of in vitro phantoms with different relaxation times. In vivo preclinical MRF results in mouse kidneys and brain tumor models demonstrated an inherent resistance to respiratory motion artifacts as well as sensitivity to known pathology. These results suggest that MRF methodology may offer the opportunity for quantification of numerous MRI parameters for a wide variety of preclinical imaging applications. PMID:25639694

Default-mode-like network activation in awake rodents.

Directory of Open Access Journals (Sweden)

Jaymin Upadhyay

Full Text Available During wakefulness and in absence of performing tasks or sensory processing, the default-mode network (DMN, an intrinsic central nervous system (CNS network, is in an active state. Non-human primate and human CNS imaging studies have identified the DMN in these two species. Clinical imaging studies have shown that the pattern of activity within the DMN is often modulated in various disease states (e.g., Alzheimer's, schizophrenia or chronic pain. However, whether the DMN exists in awake rodents has not been characterized. The current data provides evidence that awake rodents also possess 'DMN-like' functional connectivity, but only subsequent to habituation to what is initially a novel magnetic resonance imaging (MRI environment as well as physical restraint. Specifically, the habituation process spanned across four separate scanning sessions (Day 2, 4, 6 and 8. At Day 8, significant (p<0.05 functional connectivity was observed amongst structures such as the anterior cingulate (seed region, retrosplenial, parietal, and hippocampal cortices. Prior to habituation (Day 2, functional connectivity was only detected (p<0.05 amongst CNS structures known to mediate anxiety (i.e., anterior cingulate (seed region, posterior hypothalamic area, amygdala and parabracial nucleus. In relating functional connectivity between cingulate-default-mode and cingulate-anxiety structures across Days 2-8, a significant inverse relationship (r = -0.65, p = 0.0004 was observed between these two functional interactions such that increased cingulate-DMN connectivity corresponded to decreased cingulate anxiety network connectivity. This investigation demonstrates that the cingulate is an important component of both the rodent DMN-like and anxiety networks.

MO-DE-202-02: Advances in Image Registration and Reconstruction for Image-Guided Neurosurgery

Energy Technology Data Exchange (ETDEWEB)

Siewerdsen, J. [Johns Hopkins University (United States)

2016-06-15

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

MO-DE-202-02: Advances in Image Registration and Reconstruction for Image-Guided Neurosurgery

International Nuclear Information System (INIS)

Siewerdsen, J.

2016-01-01

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

Multimodal in vivo MRI and NIRF imaging of bladder tumor using peptide conjugated glycol chitosan nanoparticles

Science.gov (United States)

Key, Jaehong; Dhawan, Deepika; Knapp, Deborah W.; Kim, Kwangmeyung; Kwon, Ick Chan; Choi, Kuiwon; Leary, James F.

2012-03-01

Exact detection and complete removal of cancer is a key point to minimize cancer recurrence. However, it is currently very difficult to detect small tumors inside human body and continuously monitor tumors using a non-invasive imaging modality. Presently, positron emission tomography (PET) can provide the most sensitive cancer images in the human body. However, PET imaging has very limited imaging time because they typically use isotopes with short halflives. PET imaging cannot also visualize anatomical information. Magnetic resonance imaging (MRI) can provide highresolution images inside the body but it has a low sensitivity, so MRI contrast agents are necessary to enhance the contrast of tumor. Near infrared fluorescent (NIRF) imaging has a good sensitivity to visualize tumor using optical probes, but it has a very limited tissue penetration depth. Therefore, we developed multi-modality nanoparticles for MRI based diagnosis and NIRF imaging based surgery of cancer. We utilized glycol chitosan of 350 nm as a vehicle for MRI contrast agents and NIRF probes. The glycol chitosan nanoparticles were conjugated with NIRF dye, Cy5.5 and bladder cancer targeting peptides to increase the internalization of cancer. For MR contrast effects, iron oxide based 22 nm nanocubes were physically loaded into the glycol chitosan nanoparticles. The nanoparticles were characterized and evaluated in bladder tumor bearing mice. Our study suggests the potential of our nanoparticles by both MRI and NIRF imaging for tumor diagnosis and real-time NIRF image-guided tumor surgery.

Papillary fibroelastoma diagnosed through multimodality cardiac imaging: a rare tumour in an uncommon location with review of literature.

Science.gov (United States)

Anand, Senthil; Sydow, Nicole; Janardhanan, Rajesh

2017-08-08

We describe the case of a woman presenting with transient ischaemic attack, who was found to have a papillary fibroelastoma arising from the aortic wall, an extremely rare location. We describe the multimodality imaging techniques used in diagnosing this patient and review the most recent literature on evaluation and management of patients with cardiac papillary fibroelastomas. © BMJ Publishing Group Ltd (unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

MULTIMODAL IMAGING OF MOSAIC RETINOPATHY IN CARRIERS OF HEREDITARY X-LINKED RECESSIVE DISEASES.

Science.gov (United States)

Wu, An-Lun; Wang, Jung-Pan; Tseng, Yun-Ju; Liu, Laura; Kang, Yu-Chuan; Chen, Kuan-Jen; Chao, An-Ning; Yeh, Lung-Kun; Chen, Tun-Lu; Hwang, Yih-Shiou; Wu, Wei-Chi; Lai, Chi-Chun; Wang, Nan-Kai

2018-05-01

To investigate the clinical features in carriers of X-linked retinitis pigmentosa, X-linked ocular albinism, and choroideremia (CHM) using multimodal imaging and to assess their diagnostic value in these three mosaic retinopathies. We prospectively examined 14 carriers of 3 X-linked recessive disorders (X-linked retinitis pigmentosa, X-linked ocular albinism, and CHM). Details of abnormalities of retinal morphology were evaluated using fundus photography, fundus autofluorescence (FAF) imaging, and spectral domain optical coherence tomography. In six X-linked retinitis pigmentosa carriers, fundus appearance varied from unremarkable to the presence of tapetal-like reflex and pigmentary changes. On FAF imaging, all carriers exhibited a bright radial reflex against a dark background. By spectral domain optical coherence tomography, loss of the ellipsoid zone in the macula was observed in 3 carriers (50%). Regarding the retinal laminar architecture, 4 carriers (66.7%) showed thinning of the outer nuclear layer and a dentate appearance of the outer plexiform layer. All five X-linked ocular albinism carriers showed a characteristic mud-splatter patterned fundus, dark radial streaks against a bright background on FAF imaging, and a normal-appearing retinal structure by spectral domain optical coherence tomography imaging. Two of the 3 CHM carriers (66.7%) showed a diffuse moth-eaten appearance of the fundus, and all 3 showed irregular hyper-FAF and hypo-FAF spots throughout the affected area. In the CHM carriers, the structural changes observed by spectral domain optical coherence tomography imaging were variable. Our findings in an Asian cohort suggest that FAF imaging is a practical diagnostic test for differentiating X-linked retinitis pigmentosa, X-linked ocular albinism, and CHM carriers. Wide-field FAF is an easy and helpful adjunct to testing for the correct diagnosis and identification of lyonization in carriers of these three mosaic retinopathies.

Highlights lecture EANM 2016: ''Embracing molecular imaging and multi-modal imaging: a smart move for nuclear medicine towards personalized medicine''

Energy Technology Data Exchange (ETDEWEB)

Aboagye, Eric O. [Imperial College London, Cancer Imaging Centre, Department of Surgery and Cancer, London (United Kingdom); Kraeber-Bodere, Francoise [Hotel Dieu University Hospital, Nuclear Medicine, Nantes (France); CRCINA, Inserm U1232, Nantes (France); ICO Cancer Center, Nuclear Medicine, Saint-Herblain (France)

2017-08-15

The 2016 EANM Congress took place in Barcelona, Spain, from 15 to 19 October under the leadership of Prof. Wim Oyen, chair of the EANM Scientific Committee. With more than 6,000 participants, this congress was the most important European event in nuclear medicine, bringing together a multidisciplinary community involved in the different fields of nuclear medicine. There were over 600 oral and 1,200 poster or e-Poster presentations with an overwhelming focus on development and application of imaging for personalized care, which is timely for the community. Beyond FDG PET, major highlights included progress in the use of PSMA and SSTR receptor-targeted radiopharmaceuticals and associated theranostics in oncology. Innovations in radiopharmaceuticals for imaging pathologies of the brain and cardiovascular system, as well as infection and inflammation, were also highlighted. In the areas of physics and instrumentation, multimodality imaging and radiomics were highlighted as promising areas of research. (orig.)

A data fusion environment for multimodal and multi-informational neuronavigation.

Science.gov (United States)

Jannin, P; Fleig, O J; Seigneuret, E; Grova, C; Morandi, X; Scarabin, J M

2000-01-01

Part of the planning and performance of neurosurgery consists of determining target areas, areas to be avoided, landmark areas, and trajectories, all of which are components of the surgical script. Nowadays, neurosurgeons have access to multimodal medical imaging to support the definition of the surgical script. The purpose of this paper is to present a software environment developed by the authors that allows full multimodal and multi-informational planning as well as neuronavigation for epilepsy and tumor surgery. We have developed a data fusion environment dedicated to neuronavigation around the Surgical Microscope Neuronavigator system (Carl Zeiss, Oberkochen, Germany). This environment includes registration, segmentation, 3D visualization, and interaction-applied tools. It provides the neuronavigation system with the multimodal information involved in the definition of the surgical script: lesional areas, sulci, ventricles segmented from magnetic resonance imaging (MRI), vessels segmented from magnetic resonance angiography (MRA), functional areas from magneto-encephalography (MEG), and functional magnetic resonance imaging (fMRI) for somatosensory, motor, or language activation. These data are considered to be relevant for the performance of the surgical procedure. The definition of each entity results from the same procedure: registration to the anatomical MRI data set (defined as the reference data set), segmentation, fused 3D display, selection of the relevant entities for the surgical step, encoding in 3D surface-based representation, and storage of the 3D surfaces in a file recognized by the neuronavigation software (STP 3.4, Leibinger; Freiburg, Germany). Multimodal neuronavigation is illustrated with two clinical cases for which multimodal information was introduced into the neuronavigation system. Lesional areas were used to define and follow the surgical path, sulci and vessels helped identify the anatomical environment of the surgical field, and

BNU-LSVED: a multimodal spontaneous expression database in educational environment

Science.gov (United States)

Sun, Bo; Wei, Qinglan; He, Jun; Yu, Lejun; Zhu, Xiaoming

2016-09-01

In the field of pedagogy or educational psychology, emotions are treated as very important factors, which are closely associated with cognitive processes. Hence, it is meaningful for teachers to analyze students' emotions in classrooms, thus adjusting their teaching activities and improving students ' individual development. To provide a benchmark for different expression recognition algorithms, a large collection of training and test data in classroom environment has become an acute problem that needs to be resolved. In this paper, we present a multimodal spontaneous database in real learning environment. To collect the data, students watched seven kinds of teaching videos and were simultaneously filmed by a camera. Trained coders made one of the five learning expression labels for each image sequence extracted from the captured videos. This subset consists of 554 multimodal spontaneous expression image sequences (22,160 frames) recorded in real classrooms. There are four main advantages in this database. 1) Due to recorded in the real classroom environment, viewer's distance from the camera and the lighting of the database varies considerably between image sequences. 2) All the data presented are natural spontaneous responses to teaching videos. 3) The multimodal database also contains nonverbal behavior including eye movement, head posture and gestures to infer a student ' s affective state during the courses. 4) In the video sequences, there are different kinds of temporal activation patterns. In addition, we have demonstrated the labels for the image sequences are in high reliability through Cronbach's alpha method.

A multi-modality concept for radiotherapy planning with imaging techniques

International Nuclear Information System (INIS)

Schultze, J.

1993-01-01

The reported multi-modality concept of radiotherapy planning in the LAN can be realised in any hospital with standard equipment, although in some cases by way of auxiliary configurations. A software is currently developed as a tool for reducing the entire planning work. The heart of any radiotherapy planning is the therapy simulator, which has to be abreast with the requirements of modern radiotherapy. Integration of tomograpy, digitalisation, and electronic data processing has added important modalities to therapy planning which allow more precise target volume definition, and better biophysical planning. This is what is needed in order to achieve well differentiated radiotherapy for treatment of the manifold tumors, and the quality standards expected by the supervisory quality assurance regime and the population. At present, the CT data still are transferred indirect, on storage media, to the EDP processing system of the radiotherapy planning system. Based on the tomographic slices given by the imaging data, the contours and technical problem solutions are derived automatically, either for multi-field radiotherapy or moving field irradiation, depending on the anatomy or the targets to be protected from ionizing radiation. (orig./VHE) [de

A low-cost multimodal head-mounted display system for neuroendoscopic surgery.

Science.gov (United States)

Xu, Xinghua; Zheng, Yi; Yao, Shujing; Sun, Guochen; Xu, Bainan; Chen, Xiaolei

2018-01-01

With rapid advances in technology, wearable devices as head-mounted display (HMD) have been adopted for various uses in medical science, ranging from simply aiding in fitness to assisting surgery. We aimed to investigate the feasibility and practicability of a low-cost multimodal HMD system in neuroendoscopic surgery. A multimodal HMD system, mainly consisted of a HMD with two built-in displays, an action camera, and a laptop computer displaying reconstructed medical images, was developed to assist neuroendoscopic surgery. With this intensively integrated system, the neurosurgeon could freely switch between endoscopic image, three-dimensional (3D) reconstructed virtual endoscopy images, and surrounding environment images. Using a leap motion controller, the neurosurgeon could adjust or rotate the 3D virtual endoscopic images at a distance to better understand the positional relation between lesions and normal tissues at will. A total of 21 consecutive patients with ventricular system diseases underwent neuroendoscopic surgery with the aid of this system. All operations were accomplished successfully, and no system-related complications occurred. The HMD was comfortable to wear and easy to operate. Screen resolution of the HMD was high enough for the neurosurgeon to operate carefully. With the system, the neurosurgeon might get a better comprehension on lesions by freely switching among images of different modalities. The system had a steep learning curve, which meant a quick increment of skill with it. Compared with commercially available surgical assistant instruments, this system was relatively low-cost. The multimodal HMD system is feasible, practical, helpful, and relatively cost efficient in neuroendoscopic surgery.

Compressive multi-mode superresolution display

KAUST Repository

Heide, Felix

2014-01-01

Compressive displays are an emerging technology exploring the co-design of new optical device configurations and compressive computation. Previously, research has shown how to improve the dynamic range of displays and facilitate high-quality light field or glasses-free 3D image synthesis. In this paper, we introduce a new multi-mode compressive display architecture that supports switching between 3D and high dynamic range (HDR) modes as well as a new super-resolution mode. The proposed hardware consists of readily-available components and is driven by a novel splitting algorithm that computes the pixel states from a target high-resolution image. In effect, the display pixels present a compressed representation of the target image that is perceived as a single, high resolution image. © 2014 Optical Society of America.

Patient-tailored multimodal neuroimaging, visualization and quantification of human intra-cerebral hemorrhage

Science.gov (United States)

Goh, Sheng-Yang M.; Irimia, Andrei; Vespa, Paul M.; Van Horn, John D.

2016-03-01

In traumatic brain injury (TBI) and intracerebral hemorrhage (ICH), the heterogeneity of lesion sizes and types necessitates a variety of imaging modalities to acquire a comprehensive perspective on injury extent. Although it is advantageous to combine imaging modalities and to leverage their complementary benefits, there are difficulties in integrating information across imaging types. Thus, it is important that efforts be dedicated to the creation and sustained refinement of resources for multimodal data integration. Here, we propose a novel approach to the integration of neuroimaging data acquired from human patients with TBI/ICH using various modalities; we also demonstrate the integrated use of multimodal magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI) data for TBI analysis based on both visual observations and quantitative metrics. 3D models of healthy-appearing tissues and TBIrelated pathology are generated, both of which are derived from multimodal imaging data. MRI volumes acquired using FLAIR, SWI, and T2 GRE are used to segment pathology. Healthy tissues are segmented using user-supervised tools, and results are visualized using a novel graphical approach called a `connectogram', where brain connectivity information is depicted within a circle of radially aligned elements. Inter-region connectivity and its strength are represented by links of variable opacities drawn between regions, where opacity reflects the percentage longitudinal change in brain connectivity density. Our method for integrating, analyzing and visualizing structural brain changes due to TBI and ICH can promote knowledge extraction and enhance the understanding of mechanisms underlying recovery.

Evaluation of texture parameters for the quantitative description of multimodal nonlinear optical images from atherosclerotic rabbit arteries

Energy Technology Data Exchange (ETDEWEB)

Mostaco-Guidolin, Leila B; Ko, Alex C-T; Popescu, Dan P; Smith, Michael S D; Kohlenberg, Elicia K; Sowa, Michael G [Institute for Biodiagnostics, National Research Council Canada, Winnipeg, R3B 1Y6 (Canada); Shiomi, Masashi [Institute of Experimental Animals, School of Medicine, Kobe University, Kobe 650-0017 (Japan); Major, Arkady [Department Electrical and Computer Engineering, University of Manitoba, E3-559 Engineering Building, Winnipeg, R3T 5V6 (Canada)

2011-08-21

The composition and structure of atherosclerotic lesions can be directly related to the risk they pose to the patient. Multimodal nonlinear optical (NLO) microscopy provides a powerful means to visualize the major extracellular components of the plaque that critically determine its structure. Textural features extracted from NLO images were investigated for their utility in providing quantitative descriptors of structural and compositional changes associated with plaque development. Ten texture parameters derived from the image histogram and gray level co-occurrence matrix were examined that highlight specific structural and compositional motifs that distinguish early and late stage plaques. Tonal-texture parameters could be linked to key histological features that characterize vulnerable plaque: the thickness and density of the fibrous cap, size of the atheroma, and the level of inflammation indicated through lipid deposition. Tonal and texture parameters from NLO images provide objective metrics that correspond to structural and biochemical changes that occur within the vessel wall in early and late stage atherosclerosis.

A novel image fusion algorithm based on 2D scale-mixing complex wavelet transform and Bayesian MAP estimation for multimodal medical images

Directory of Open Access Journals (Sweden)

Abdallah Bengueddoudj

2017-05-01

Full Text Available In this paper, we propose a new image fusion algorithm based on two-dimensional Scale-Mixing Complex Wavelet Transform (2D-SMCWT. The fusion of the detail 2D-SMCWT coefficients is performed via a Bayesian Maximum a Posteriori (MAP approach by considering a trivariate statistical model for the local neighboring of 2D-SMCWT coefficients. For the approximation coefficients, a new fusion rule based on the Principal Component Analysis (PCA is applied. We conduct several experiments using three different groups of multimodal medical images to evaluate the performance of the proposed method. The obtained results prove the superiority of the proposed method over the state of the art fusion methods in terms of visual quality and several commonly used metrics. Robustness of the proposed method is further tested against different types of noise. The plots of fusion metrics establish the accuracy of the proposed fusion method.

Pseudo-HE images derived from CARS/TPEF/SHG multimodal imaging in combination with Raman-spectroscopy as a pathological screening tool

International Nuclear Information System (INIS)

Bocklitz, Thomas W.; Salah, Firas Subhi; Vogler, Nadine; Heuke, Sandro; Chernavskaia, Olga; Schmidt, Carsten; Waldner, Maximilian J.; Greten, Florian R.; Bräuer, Rolf; Schmitt, Michael; Stallmach, Andreas; Petersen, Iver; Popp, Jürgen

2016-01-01

Due to the steadily increasing number of cancer patients worldwide the early diagnosis and treatment of cancer is a major field of research. The diagnosis of cancer is mostly performed by an experienced pathologist via the visual inspection of histo-pathological stained tissue sections. To save valuable time, low quality cryosections are frequently analyzed with diagnostic accuracies that are below those of high quality embedded tissue sections. Thus, alternative means have to be found that enable for fast and accurate diagnosis as the basis of following clinical decision making. In this contribution we will show that the combination of the three label-free non-linear imaging modalities CARS (coherent anti-Stokes Raman-scattering), TPEF (two-photon excited autofluorescence) and SHG (second harmonic generation) yields information that can be translated into computational hematoxylin and eosin (HE) images by multivariate statistics. Thereby, a computational HE stain is generated resulting in pseudo-HE overview images that allow for identification of suspicious regions. The latter are analyzed further by Raman-spectroscopy retrieving the tissue’s molecular fingerprint. The results suggest that the combination of non-linear multimodal imaging and Raman-spectroscopy possesses the potential as a precise and fast tool in routine histopathology. As the key advantage, both optical methods are non-invasive enabling for further pathological investigations of the same tissue section, e.g. a direct comparison with the current pathological gold-standard

Multimodal ophthalmic imaging using spectrally encoded scanning laser ophthalmoscopy and optical coherence tomography

Science.gov (United States)

El-Haddad, Mohamed T.; Malone, Joseph D.; Li, Jianwei D.; Bozic, Ivan; Arquitola, Amber M.; Joos, Karen M.; Patel, Shriji N.; Tao, Yuankai K.

2017-08-01

Ophthalmic surgery involves manipulation of delicate, layered tissue structures on milli- to micrometer scales. Traditional surgical microscopes provide an inherently two-dimensional view of the surgical field with limited depth perception which precludes accurate depth-resolved visualization of these tissue layers, and limits the development of novel surgical techniques. We demonstrate multimodal swept-source spectrally encoded scanning laser ophthalmoscopy and optical coherence tomography (SS-SESLO-OCT) to address current limitations of image-guided ophthalmic microsurgery. SS-SESLO-OCT provides inherently co-registered en face and cross-sectional field-of-views (FOVs) at a line rate of 400 kHz and >2 GPix/s throughput. We show in vivo imaging of the anterior segment and retinal fundus of a healthy volunteer, and preliminary results of multi-volumetric mosaicking for ultrawide-field retinal imaging with 90° FOV. Additionally, a scan-head was rapid-prototyped with a modular architecture which enabled integration of SS-SESLO-OCT with traditional surgical microscope and slit-lamp imaging optics. Ex vivo surgical maneuvers were simulated in cadaveric porcine eyes. The system throughput enabled volumetric acquisition at 10 volumes-per-second (vps) and allowed visualization of surgical dynamics in corneal sweeps, compressions, and dissections, and retinal sweeps, compressions, and elevations. SESLO en face images enabled simple real-time co-registration with the surgical microscope FOV, and OCT cross-sections provided depth-resolved visualization of instrument-tissue interactions. Finally, we demonstrate novel augmented-reality integration with the surgical view using segmentation overlays to aid surgical guidance. SS-SESLO-OCT may benefit clinical diagnostics by enabling aiming, registration, and mosaicking; and intraoperative imaging by allowing for real-time surgical feedback, instrument tracking, and overlays of computationally extracted biomarkers of disease.

Multimode optical dermoscopy (SkinSpect) analysis for skin with melanocytic nevus

Science.gov (United States)

Vasefi, Fartash; MacKinnon, Nicholas; Saager, Rolf; Kelly, Kristen M.; Maly, Tyler; Chave, Robert; Booth, Nicholas; Durkin, Anthony J.; Farkas, Daniel L.

2016-04-01

We have developed a multimode dermoscope (SkinSpect™) capable of illuminating human skin samples in-vivo with spectrally-programmable linearly-polarized light at 33 wavelengths between 468nm and 857 nm. Diffusely reflected photons are separated into collinear and cross-polarized image paths and images captured for each illumination wavelength. In vivo human skin nevi (N = 20) were evaluated with the multimode dermoscope and melanin and hemoglobin concentrations were compared with Spatially Modulated Quantitative Spectroscopy (SMoQS) measurements. Both systems show low correlation between their melanin and hemoglobin concentrations, demonstrating the ability of the SkinSpect™ to separate these molecular signatures and thus act as a biologically plausible device capable of early onset melanoma detection.

Multimodal medical information retrieval with unsupervised rank fusion.

Science.gov (United States)

Mourão, André; Martins, Flávio; Magalhães, João

2015-01-01

Modern medical information retrieval systems are paramount to manage the insurmountable quantities of clinical data. These systems empower health care experts in the diagnosis of patients and play an important role in the clinical decision process. However, the ever-growing heterogeneous information generated in medical environments poses several challenges for retrieval systems. We propose a medical information retrieval system with support for multimodal medical case-based retrieval. The system supports medical information discovery by providing multimodal search, through a novel data fusion algorithm, and term suggestions from a medical thesaurus. Our search system compared favorably to other systems in 2013 ImageCLEFMedical. Copyright © 2014 Elsevier Ltd. All rights reserved.

Multimodal Task-Driven Dictionary Learning for Image Classification

Science.gov (United States)

2015-12-18

recognition, multi-view face recognition, multi-view action recognition, and multimodal biometric recognition. It is also shown that, compared to the...improvement in several multi-task learning applications such as target classification, biometric recognitions, and multiview face recognition [12], [14], [17...relevant samples from other modalities for a given unimodal query. However, α1 α2 …αS D1 … Index finger Thumb finger … Iris x1 x2 xS D2 DS … … … J o in

Multimodal sensing and imaging technology by integrated scanning electron, force, and nearfield microwave microscopy and its application to submicrometer studies

OpenAIRE

Hänßler, Olaf C.

2018-01-01

The work covers a multimodal microscope technology for the analysis, manipulation and transfer of materials and objects in the submicrometer range. An atomic force microscope (AFM) allows imaging of the surface topography and a Scanning Microwave Microscope (SMM) detects electromagnetic properties, both operating in a Scanning Electron Microscope (SEM). The described technology demonstrator allows to observe the region-of-interest live with the SEM, while at the same time a characterization w...

Progress on molecular imaging

International Nuclear Information System (INIS)

Chen Quan; Zhang Yongxue

2011-01-01

Molecular imaging is a new era of medical imaging,which can non-invasively monitor biological processes at the cellular and molecular level in vivo, including molecular imaging of nuclear medicine, magnetic resonance molecular imaging, ultrasound molecular imaging,optical molecular imaging and molecular imaging with X-ray. Recently, with the development of multi-subjects amalgamation, multimodal molecular imaging technology has been applied in clinical imaging, such as PET-CT and PET-MRI. We believe that with development of molecular probe and multi-modal imaging, more and more molecular imaging techniques will be applied in clinical diagnosis and treatment. (authors)

Multi-focus beam shaping of high power multimode lasers

Science.gov (United States)

Laskin, Alexander; Volpp, Joerg; Laskin, Vadim; Ostrun, Aleksei

2017-08-01

Beam shaping of powerful multimode fiber lasers, fiber-coupled solid-state and diode lasers is of great importance for improvements of industrial laser applications. Welding, cladding with millimetre scale working spots benefit from "inverseGauss" intensity profiles; performance of thick metal sheet cutting, deep penetration welding can be enhanced when distributing the laser energy along the optical axis as more efficient usage of laser energy, higher edge quality and reduction of the heat affected zone can be achieved. Building of beam shaping optics for multimode lasers encounters physical limitations due to the low beam spatial coherence of multimode fiber-coupled lasers resulting in big Beam Parameter Products (BPP) or M² values. The laser radiation emerging from a multimode fiber presents a mixture of wavefronts. The fiber end can be considered as a light source which optical properties are intermediate between a Lambertian source and a single mode laser beam. Imaging of the fiber end, using a collimator and a focusing objective, is a robust and widely used beam delivery approach. Beam shaping solutions are suggested in form of optics combining fiber end imaging and geometrical separation of focused spots either perpendicular to or along the optical axis. Thus, energy of high power lasers is distributed among multiple foci. In order to provide reliable operation with multi-kW lasers and avoid damages the optics are designed as refractive elements with smooth optical surfaces. The paper presents descriptions of multi-focus optics as well as examples of intensity profile measurements of beam caustics and application results.

Manifold regularized multi-task feature selection for multi-modality classification in Alzheimer's disease.

Science.gov (United States)

Jie, Biao; Zhang, Daoqiang; Cheng, Bo; Shen, Dinggang

2013-01-01

Accurate diagnosis of Alzheimer's disease (AD), as well as its prodromal stage (i.e., mild cognitive impairment, MCI), is very important for possible delay and early treatment of the disease. Recently, multi-modality methods have been used for fusing information from multiple different and complementary imaging and non-imaging modalities. Although there are a number of existing multi-modality methods, few of them have addressed the problem of joint identification of disease-related brain regions from multi-modality data for classification. In this paper, we proposed a manifold regularized multi-task learning framework to jointly select features from multi-modality data. Specifically, we formulate the multi-modality classification as a multi-task learning framework, where each task focuses on the classification based on each modality. In order to capture the intrinsic relatedness among multiple tasks (i.e., modalities), we adopted a group sparsity regularizer, which ensures only a small number of features to be selected jointly. In addition, we introduced a new manifold based Laplacian regularization term to preserve the geometric distribution of original data from each task, which can lead to the selection of more discriminative features. Furthermore, we extend our method to the semi-supervised setting, which is very important since the acquisition of a large set of labeled data (i.e., diagnosis of disease) is usually expensive and time-consuming, while the collection of unlabeled data is relatively much easier. To validate our method, we have performed extensive evaluations on the baseline Magnetic resonance imaging (MRI) and fluorodeoxyglucose positron emission tomography (FDG-PET) data of Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Our experimental results demonstrate the effectiveness of the proposed method.

Multimodal nonlinear microscopy: A powerful label-free method for supporting standard diagnostics on biological tissues

Directory of Open Access Journals (Sweden)

Riccardo Cicchi

2014-09-01

Full Text Available The large use of nonlinear laser scanning microscopy in the past decade paved the way for potential clinical application of this imaging technique. Modern nonlinear microscopy techniques offer promising label-free solutions to improve diagnostic performances on tissues. In particular, the combination of multiple nonlinear imaging techniques in the same microscope allows integrating morphological with functional information in a morpho-functional scheme. Such approach provides a high-resolution label-free alternative to both histological and immunohistochemical examination of tissues and is becoming increasingly popular among the clinical community. Nevertheless, several technical improvements, including automatic scanning and image analysis, are required before the technique represents a standard diagnostic method. In this review paper, we highlight the capabilities of multimodal nonlinear microscopy for tissue imaging, by providing various examples on colon, arterial and skin tissues. The comparison between images acquired using multimodal nonlinear microscopy and histology shows a good agreement between the two methods. The results demonstrate that multimodal nonlinear microscopy is a powerful label-free alternative to standard histopathological methods and has the potential to find a stable place in the clinical setting in the near future.

Multimodal MEMPRAGE, FLAIR, and R2* Segmentation to Resolve Dura and Vessels from Cortical Gray Matter

Directory of Open Access Journals (Sweden)

Roberto Viviani

2017-05-01

Full Text Available While widely in use in automated segmentation approaches for the detection of group differences or of changes associated with continuous predictors in gray matter volume, T1-weighted images are known to represent dura and cortical vessels with signal intensities similar to those of gray matter. By considering multiple signal sources at once, multimodal segmentation approaches may be able to resolve these different tissue classes and address this potential confound. We explored here the simultaneous use of FLAIR and apparent transverse relaxation rates (a signal related to T2* relaxation maps and having similar contrast with T1-weighted images. Relative to T1-weighted images alone, multimodal segmentation had marked positive effects on 1. the separation of gray matter from dura, 2. the exclusion of vessels from the gray matter compartment, and 3. the contrast with extracerebral connective tissue. While obtainable together with the T1-weighted images without increasing scanning times, apparent transverse relaxation rates were less effective than added FLAIR images in providing the above mentioned advantages. FLAIR images also improved the detection of cortical matter in areas prone to susceptibility artifacts in standard MPRAGE T1-weighted images, while the addition of transverse relaxation maps exacerbated the effect of these artifacts on segmentation. Our results confirm that standard MPRAGE segmentation may overestimate gray matter volume by wrongly assigning vessels and dura to this compartment and show that multimodal approaches may greatly improve the specificity of cortical segmentation. Since multimodal segmentation is easily implemented, these benefits are immediately available to studies focusing on translational applications of structural imaging.

MR image features predicting hemorrhagic transformation in acute cerebral infarction: a multimodal study

International Nuclear Information System (INIS)

Liu, Chunming; Xu, Liang; Dong, Longchun; Liu, Zhenxing; Yang, Jun; Liu, Jun; Dong, Zhengchao; Khursheed, Aiman

2015-01-01

The aims of this study were to observe magnetic resonance imaging (MRI) features and the frequency of hemorrhagic transformation (HT) in patients with acute cerebral infarction and to identify the risk factors of HT. We first performed multimodal MRI (anatomical, diffusion weighted, and susceptibility weighted) scans on 87 patients with acute cerebral infarction within 24 hours after symptom onset and documented the image findings. We then performed follow-up examinations 3 days to 2 weeks after the onset or whenever the conditions of the patients worsened within 3 days. We utilized univariate statistics to identify the correlations between HT and image features and used multivariate logistical regression to correct for confounding factors to determine relevant independent image features of HT. HT was observed in 17 out of total 87 patients (19.5 %). The infarct size (p = 0.021), cerebral microbleeds (CMBs) (p = 0.004), relative apparent diffusion (rADC) (p = 0.023), and venous anomalies (p = 0.000) were significantly related with HT in the univariate statistics. Multivariate analysis demonstrated that CMBs (odd ratio (OR) = 0.082; 95 % confidence interval (CI) = 0.011-0.597; p = 0.014), rADC (OR = 0.000; 95 % CI = 0.000-0.692; p = 0.041), and venous anomalies (OR = 0.066; 95 % CI = 0.011-0.403; p = 0.003) were independent risk factors for HT. The frequency of HT is 19.5 % in this study. CMBs, rADC, and venous anomalies are independent risk factors for HT of acute cerebral infarction. (orig.)

MR image features predicting hemorrhagic transformation in acute cerebral infarction: a multimodal study

Energy Technology Data Exchange (ETDEWEB)

Liu, Chunming; Xu, Liang; Dong, Longchun; Liu, Zhenxing; Yang, Jun; Liu, Jun [Tianjin Union Medicine Centre, Department of Radiology, Tianjin (China); Dong, Zhengchao [Columbia University, Translational Imaging and MRI Unit, Department of Psychiatry, New York, NY (United States); New York State Psychiatric Institute, New York, NY (United States); Khursheed, Aiman [Tianjin Medical University, International Medical School, Tianjin (China)

2015-11-15

The aims of this study were to observe magnetic resonance imaging (MRI) features and the frequency of hemorrhagic transformation (HT) in patients with acute cerebral infarction and to identify the risk factors of HT. We first performed multimodal MRI (anatomical, diffusion weighted, and susceptibility weighted) scans on 87 patients with acute cerebral infarction within 24 hours after symptom onset and documented the image findings. We then performed follow-up examinations 3 days to 2 weeks after the onset or whenever the conditions of the patients worsened within 3 days. We utilized univariate statistics to identify the correlations between HT and image features and used multivariate logistical regression to correct for confounding factors to determine relevant independent image features of HT. HT was observed in 17 out of total 87 patients (19.5 %). The infarct size (p = 0.021), cerebral microbleeds (CMBs) (p = 0.004), relative apparent diffusion (rADC) (p = 0.023), and venous anomalies (p = 0.000) were significantly related with HT in the univariate statistics. Multivariate analysis demonstrated that CMBs (odd ratio (OR) = 0.082; 95 % confidence interval (CI) = 0.011-0.597; p = 0.014), rADC (OR = 0.000; 95 % CI = 0.000-0.692; p = 0.041), and venous anomalies (OR = 0.066; 95 % CI = 0.011-0.403; p = 0.003) were independent risk factors for HT. The frequency of HT is 19.5 % in this study. CMBs, rADC, and venous anomalies are independent risk factors for HT of acute cerebral infarction. (orig.)

Full-Field Optical Coherence Tomography as a Diagnosis Tool: Recent Progress with Multimodal Imaging

Directory of Open Access Journals (Sweden)

Olivier Thouvenin

2017-03-01

Full Text Available Full-field optical coherence tomography (FF-OCT is a variant of OCT that is able to register 2D en face views of scattering samples at a given depth. Thanks to its superior resolution, it can quickly reveal information similar to histology without the need to physically section the sample. Sensitivity and specificity levels of diagnosis performed with FF-OCT are 80% to 95% of the equivalent histological diagnosis performances and could therefore benefit from improvement. Therefore, multimodal systems have been designed to increase the diagnostic performance of FF-OCT. In this paper, we will discuss which contrasts can be measured with such multimodal systems in the context of ex vivo biological tissue examination. We will particularly emphasize three multimodal combinations to measure the tissue mechanics, dynamics, and molecular content respectively.

Positron imaging feasibility studies: characteristics of 2-deoxyglucose uptake in rodent and canine neoplasms

International Nuclear Information System (INIS)

Larson, S.M.; Weiden, P.L.; Grunbaum, J.

1981-01-01

Uptake of [ 3 H]2-deoxyglucose was studied in BALB/c mice with EMT-6 sarcoma, in Buffalo rats with Morris 7777 hepatoma, and in eight dogs with spontaneous neoplasms: five osteosarcomas and three diffuse lymphomas. High tumor-to-tissue ratios were observed for all tumor types studies. In rodents, peak levels of uptake occurred between 30 min and 1 hr, with a slow loss from the tumor of about 10% per hour thereafter. In dogs there was considerable variability in uptake, both between individuals and at different tumor sites within an individual. Necrotic tumor did not take up the radiotracer. Absolute uptakes, when normalized for body weight, were similar for spontaneous and transplanted neoplasms. These studies provide additional support for the concept that positron emission tomography can be used to obtain functional images of important metabolic processes of tumors, including glycolysis

Morphological, functional and metabolic imaging biomarkers: assessment of vascular-disrupting effect on rodent liver tumours

International Nuclear Information System (INIS)

Wang, Huaijun; Li, Junjie; Keyzer, Frederik De; Yu, Jie; Feng, Yuanbo; Marchal, Guy; Ni, Yicheng; Chen, Feng; Nuyts, Johan

2010-01-01

To evaluate effects of a vascular-disrupting agent on rodent tumour models. Twenty rats with liver rhabdomyosarcomas received ZD6126 intravenously at 20 mg/kg, and 10 vehicle-treated rats were used as controls. Multiple sequences, including diffusion-weighted imaging (DWI) and dynamic contrast-enhanced MRI (DCE-MRI) with the microvascular permeability constant (K), were acquired at baseline, 1 h, 24 h and 48 h post-treatment by using 1.5-T MRI. [ 18 F]fluorodeoxyglucose micro-positron emission tomography ( 18 F-FDG μPET) was acquired pre- and post-treatment. The imaging biomarkers including tumour volume, enhancement ratio, necrosis ratio, apparent diffusion coefficient (ADC) and K from MRI, and maximal standardised uptake value (SUV max ) from FDG μPET were quantified and correlated with postmortem microangiography and histopathology. In the ZD6126-treated group, tumours grew slower with higher necrosis ratio at 48 h (P max dropped at 24 h (P < 0.01). Relative K of tumour versus liver at 48 h correlated with relative vascular density on microangiography (r = 0.93, P < 0.05). The imaging biomarkers allowed morphological, functional and metabolic quantifications of vascular shutdown, necrosis formation and tumour relapse shortly after treatment. A single dose of ZD6126 significantly diminished tumour blood supply and growth until 48 h post-treatment. (orig.)

Unifying framework for multimodal brain MRI segmentation based on Hidden Markov Chains.

Science.gov (United States)

Bricq, S; Collet, Ch; Armspach, J P

2008-12-01

In the frame of 3D medical imaging, accurate segmentation of multimodal brain MR images is of interest for many brain disorders. However, due to several factors such as noise, imaging artifacts, intrinsic tissue variation and partial volume effects, tissue classification remains a challenging task. In this paper, we present a unifying framework for unsupervised segmentation of multimodal brain MR images including partial volume effect, bias field correction, and information given by a probabilistic atlas. Here-proposed method takes into account neighborhood information using a Hidden Markov Chain (HMC) model. Due to the limited resolution of imaging devices, voxels may be composed of a mixture of different tissue types, this partial volume effect is included to achieve an accurate segmentation of brain tissues. Instead of assigning each voxel to a single tissue class (i.e., hard classification), we compute the relative amount of each pure tissue class in each voxel (mixture estimation). Further, a bias field estimation step is added to the proposed algorithm to correct intensity inhomogeneities. Furthermore, atlas priors were incorporated using probabilistic brain atlas containing prior expectations about the spatial localization of different tissue classes. This atlas is considered as a complementary sensor and the proposed method is extended to multimodal brain MRI without any user-tunable parameter (unsupervised algorithm). To validate this new unifying framework, we present experimental results on both synthetic and real brain images, for which the ground truth is available. Comparison with other often used techniques demonstrates the accuracy and the robustness of this new Markovian segmentation scheme.

Multimodality and Ambient Intelligence

NARCIS (Netherlands)

Nijholt, Antinus; Verhaegh, W.; Aarts, E.; Korst, J.

2004-01-01

In this chapter we discuss multimodal interface technology. We present eexamples of multimodal interfaces and show problems and opportunities. Fusion of modalities is discussed and some roadmap discussions on research in multimodality are summarized. This chapter also discusses future developments

Prospective, longitudinal, multi-modal functional imaging for radical chemo-IMRT treatment of locally advanced head and neck cancer: the INSIGHT study

International Nuclear Information System (INIS)

Welsh, Liam; Panek, Rafal; McQuaid, Dualta; Dunlop, Alex; Schmidt, Maria; Riddell, Angela; Koh, Dow-Mu; Doran, Simon; Murray, Iain; Du, Yong; Chua, Sue; Hansen, Vibeke; Wong, Kee H.; Dean, Jamie; Gulliford, Sarah; Bhide, Shreerang; Leach, Martin O.; Nutting, Christopher; Harrington, Kevin; Newbold, Kate

2015-01-01

Radical chemo-radiotherapy (CRT) is an effective organ-sparing treatment option for patients with locally advanced head and neck cancer (LAHNC). Despite advances in treatment for LAHNC, a significant minority of these patients continue to fail to achieve complete response with standard CRT. By constructing a multi-modality functional imaging (FI) predictive biomarker for CRT outcome for patients with LAHNC we hope to be able to reliably identify those patients at high risk of failing standard CRT. Such a biomarker would in future enable CRT to be tailored to the specific biological characteristics of each patients’ tumour, potentially leading to improved treatment outcomes. The INSIGHT study is a single-centre, prospective, longitudinal multi-modality imaging study using functional MRI and FDG-PET/CT for patients with LAHNC squamous cell carcinomas receiving radical CRT. Two cohorts of patients are being recruited: one treated with, and another treated without, induction chemotherapy. All patients receive radical intensity modulated radiotherapy with concurrent chemotherapy. Patients undergo functional imaging before, during and 3 months after completion of radiotherapy, as well as at the time of relapse, should that occur within the first two years after treatment. Serum samples are collected from patients at the same time points as the FI scans for analysis of a panel of serum markers of tumour hypoxia. The primary aim of the INSIGHT study is to acquire a prospective multi-parametric longitudinal data set comprising functional MRI, FDG PET/CT, and serum biomarker data from patients with LAHNC undergoing primary radical CRT. This data set will be used to construct a predictive imaging biomarker for outcome after CRT for LAHNC. This predictive imaging biomarker will be used in future studies of functional imaging based treatment stratification for patients with LAHNC. Additional objectives are: defining the reproducibility of FI parameters; determining robust

The Multi-modal Australian ScienceS Imaging and Visualisation Environment (MASSIVE high performance computing infrastructure: applications in neuroscience and neuroinformatics research

Directory of Open Access Journals (Sweden)

Wojtek James eGoscinski

2014-03-01

Full Text Available The Multi-modal Australian ScienceS Imaging and Visualisation Environment (MASSIVE is a national imaging and visualisation facility established by Monash University, the Australian Synchrotron, the Commonwealth Scientific Industrial Research Organisation (CSIRO, and the Victorian Partnership for Advanced Computing (VPAC, with funding from the National Computational Infrastructure and the Victorian Government. The MASSIVE facility provides hardware, software and expertise to drive research in the biomedical sciences, particularly advanced brain imaging research using synchrotron x-ray and infrared imaging, functional and structural magnetic resonance imaging (MRI, x-ray computer tomography (CT, electron microscopy and optical microscopy. The development of MASSIVE has been based on best practice in system integration methodologies, frameworks, and architectures. The facility has: (i integrated multiple different neuroimaging analysis software components, (ii enabled cross-platform and cross-modality integration of neuroinformatics tools, and (iii brought together neuroimaging databases and analysis workflows. MASSIVE is now operational as a nationally distributed and integrated facility for neuroinfomatics and brain imaging research.

Manifold Regularized Multi-Task Feature Selection for Multi-Modality Classification in Alzheimer’s Disease

Science.gov (United States)

Jie, Biao; Cheng, Bo

2014-01-01

Accurate diagnosis of Alzheimer’s disease (AD), as well as its pro-dromal stage (i.e., mild cognitive impairment, MCI), is very important for possible delay and early treatment of the disease. Recently, multi-modality methods have been used for fusing information from multiple different and complementary imaging and non-imaging modalities. Although there are a number of existing multi-modality methods, few of them have addressed the problem of joint identification of disease-related brain regions from multi-modality data for classification. In this paper, we proposed a manifold regularized multi-task learning framework to jointly select features from multi-modality data. Specifically, we formulate the multi-modality classification as a multi-task learning framework, where each task focuses on the classification based on each modality. In order to capture the intrinsic relatedness among multiple tasks (i.e., modalities), we adopted a group sparsity regularizer, which ensures only a small number of features to be selected jointly. In addition, we introduced a new manifold based Laplacian regularization term to preserve the geometric distribution of original data from each task, which can lead to the selection of more discriminative features. Furthermore, we extend our method to the semi-supervised setting, which is very important since the acquisition of a large set of labeled data (i.e., diagnosis of disease) is usually expensive and time-consuming, while the collection of unlabeled data is relatively much easier. To validate our method, we have performed extensive evaluations on the baseline Magnetic resonance imaging (MRI) and fluorodeoxyglucose positron emission tomography (FDG-PET) data of Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. Our experimental results demonstrate the effectiveness of the proposed method. PMID:24505676

Speech Perception as a Multimodal Phenomenon

OpenAIRE

Rosenblum, Lawrence D.

2008-01-01

Speech perception is inherently multimodal. Visual speech (lip-reading) information is used by all perceivers and readily integrates with auditory speech. Imaging research suggests that the brain treats auditory and visual speech similarly. These findings have led some researchers to consider that speech perception works by extracting amodal information that takes the same form across modalities. From this perspective, speech integration is a property of the input information itself. Amodal s...

Quantitative magnetization transfer imaging of rodent glioma using selective inversion recovery.

Science.gov (United States)

Xu, Junzhong; Li, Ke; Zu, Zhongliang; Li, Xia; Gochberg, Daniel F; Gore, John C

2014-03-01

Magnetization transfer (MT) provides an indirect means to detect noninvasively variations in macromolecular contents in biological tissues, but, so far, there have been only a few quantitative MT (qMT) studies reported in cancer, all of which used off-resonance pulsed saturation methods. This article describes the first implementation of a different qMT approach, selective inversion recovery (SIR), for the characterization of tumor in vivo using a rodent glioma model. The SIR method is an on-resonance method capable of fitting qMT parameters and T1 relaxation time simultaneously without mapping B0 and B1 , which is very suitable for high-field qMT measurements because of the lower saturation absorption rate. The results show that the average pool size ratio (PSR, the macromolecular pool versus the free water pool) in rat 9 L glioma (5.7%) is significantly lower than that in normal rat gray matter (9.2%) and white matter (17.4%), which suggests that PSR is potentially a sensitive imaging biomarker for the assessment of brain tumor. Despite being less robust, the estimated MT exchange rates also show clear differences from normal tissues (19.7 Hz for tumors versus 14.8 and 10.2 Hz for gray and white mater, respectively). In addition, the influence of confounding effects, e.g. B1 inhomogeneity, on qMT parameter estimates is investigated with numerical simulations. These findings not only help to better understand the changes in the macromolecular contents of tumors, but are also important for the interpretation of other imaging contrasts, such as chemical exchange saturation transfer of tumors. Copyright © 2013 John Wiley & Sons, Ltd.

Multimodal imaging of spike propagation: a technical case report.

Science.gov (United States)

Tanaka, N; Grant, P E; Suzuki, N; Madsen, J R; Bergin, A M; Hämäläinen, M S; Stufflebeam, S M

2012-06-01

We report an 11-year-old boy with intractable epilepsy, who had cortical dysplasia in the right superior frontal gyrus. Spatiotemporal source analysis of MEG and EEG spikes demonstrated a similar time course of spike propagation from the superior to inferior frontal gyri, as observed on intracranial EEG. The tractography reconstructed from DTI showed a fiber connection between these areas. Our multimodal approach demonstrates spike propagation and a white matter tract guiding the propagation.

Molecular imaging in oncology

Energy Technology Data Exchange (ETDEWEB)

Schober, Otmar; Riemann, Burkhard (eds.) [Universitaetsklinikum Muenster (Germany). Klinik fuer Nuklearmedizin

2013-02-01

Considers in detail all aspects of molecular imaging in oncology, ranging from basic research to clinical applications in the era of evidence-based medicine. Examines technological issues and probe design. Discusses preclinical studies in detail, with particular attention to multimodality imaging. Presents current clinical use of PET/CT, SPECT/CT, and optical imagingWritten by acknowledged experts. The impact of molecular imaging on diagnostics, therapy, and follow-up in oncology is increasing significantly. The process of molecular imaging includes key biotarget identification, design of specific molecular imaging probes, and their preclinical evaluation, e.g., in vivo using small animal studies. A multitude of such innovative molecular imaging probes have already entered clinical diagnostics in oncology. There is no doubt that in future the emphasis will be on multimodality imaging in which morphological, functional, and molecular imaging techniques are combined in a single clinical investigation that will optimize diagnostic processes. This handbook addresses all aspects of molecular imaging in oncology, ranging from basic research to clinical applications in the era of evidence-based medicine. The first section is devoted to technology and probe design, and examines a variety of PET and SPECT tracers as well as multimodality probes. Preclinical studies are then discussed in detail, with particular attention to multimodality imaging. In the third section, diverse clinical applications are presented, and the book closes by looking at future challenges. This handbook will be of value to all who are interested in the revolution in diagnostic oncology that is being brought about by molecular imaging.

Molecular imaging in oncology

International Nuclear Information System (INIS)

Schober, Otmar; Riemann, Burkhard

2013-01-01

Considers in detail all aspects of molecular imaging in oncology, ranging from basic research to clinical applications in the era of evidence-based medicine. Examines technological issues and probe design. Discusses preclinical studies in detail, with particular attention to multimodality imaging. Presents current clinical use of PET/CT, SPECT/CT, and optical imagingWritten by acknowledged experts. The impact of molecular imaging on diagnostics, therapy, and follow-up in oncology is increasing significantly. The process of molecular imaging includes key biotarget identification, design of specific molecular imaging probes, and their preclinical evaluation, e.g., in vivo using small animal studies. A multitude of such innovative molecular imaging probes have already entered clinical diagnostics in oncology. There is no doubt that in future the emphasis will be on multimodality imaging in which morphological, functional, and molecular imaging techniques are combined in a single clinical investigation that will optimize diagnostic processes. This handbook addresses all aspects of molecular imaging in oncology, ranging from basic research to clinical applications in the era of evidence-based medicine. The first section is devoted to technology and probe design, and examines a variety of PET and SPECT tracers as well as multimodality probes. Preclinical studies are then discussed in detail, with particular attention to multimodality imaging. In the third section, diverse clinical applications are presented, and the book closes by looking at future challenges. This handbook will be of value to all who are interested in the revolution in diagnostic oncology that is being brought about by molecular imaging.

Multimode nonlinear optical imaging of the dermis in ex vivo human skin based on the combination of multichannel mode and Lambda mode.

Science.gov (United States)

Zhuo, Shuangmu; Chen, Jianxin; Luo, Tianshu; Zou, Dingsong

2006-08-21

A Multimode nonlinear optical imaging technique based on the combination of multichannel mode and Lambda mode is developed to investigate human dermis. Our findings show that this technique not only improves the image contrast of the structural proteins of extracellular matrix (ECM) but also provides an image-guided spectral analysis method to identify both cellular and ECM intrinsic components including collagen, elastin, NAD(P)H and flavin. By the combined use of multichannel mode and Lambda mode in tandem, the obtained in-depth two photon-excited fluorescence (TPEF) and second-harmonic generation (SHG) imaging and TPEF/SHG signals depth-dependence decay can offer a sensitive tool for obtaining quantitative tissue structural and biochemical information. These results suggest that the technique has the potential to provide more accurate information for determining tissue physiological and pathological states.

Drug-related webpages classification based on multi-modal local decision fusion

Science.gov (United States)

Hu, Ruiguang; Su, Xiaojing; Liu, Yanxin

2018-03-01

In this paper, multi-modal local decision fusion is used for drug-related webpages classification. First, meaningful text are extracted through HTML parsing, and effective images are chosen by the FOCARSS algorithm. Second, six SVM classifiers are trained for six kinds of drug-taking instruments, which are represented by PHOG. One SVM classifier is trained for the cannabis, which is represented by the mid-feature of BOW model. For each instance in a webpage, seven SVMs give seven labels for its image, and other seven labels are given by searching the names of drug-taking instruments and cannabis in its related text. Concatenating seven labels of image and seven labels of text, the representation of those instances in webpages are generated. Last, Multi-Instance Learning is used to classify those drugrelated webpages. Experimental results demonstrate that the classification accuracy of multi-instance learning with multi-modal local decision fusion is much higher than those of single-modal classification.

Calibration and analysis of a multimodal micro-CT and structured light imaging system for the evaluation of excised breast tissue

Science.gov (United States)

McClatchy, David M., III; Rizzo, Elizabeth J.; Meganck, Jeff; Kempner, Josh; Vicory, Jared; Wells, Wendy A.; Paulsen, Keith D.; Pogue, Brian W.

2017-12-01

A multimodal micro-computed tomography (CT) and multi-spectral structured light imaging (SLI) system is introduced and systematically analyzed to test its feasibility to aid in margin delineation during breast conserving surgery (BCS). Phantom analysis of the micro-CT yielded a signal-to-noise ratio of 34, a contrast of 1.64, and a minimum detectable resolution of 240 μm for a 1.2 min scan. The SLI system, spanning wavelengths 490 nm to 800 nm and spatial frequencies up to 1.37 mm-1 , was evaluated with aqueous tissue simulating phantoms having variations in particle size distribution, scatter density, and blood volume fraction. The reduced scattering coefficient, μs\\prime and phase function parameter, γ, were accurately recovered over all wavelengths independent of blood volume fractions from 0% to 4%, assuming a flat sample geometry perpendicular to the imaging plane. The resolution of the optical system was tested with a step phantom, from which the modulation transfer function was calculated yielding a maximum resolution of 3.78 cycles per mm. The three dimensional spatial co-registration between the CT and optical imaging space was tested and shown to be accurate within 0.7 mm. A freshly resected breast specimen, with lobular carcinoma, fibrocystic disease, and adipose, was imaged with the system. The micro-CT provided visualization of the tumor mass and its spiculations, and SLI yielded superficial quantification of light scattering parameters for the malignant and benign tissue types. These results appear to be the first demonstration of SLI combined with standard medical tomography for imaging excised tumor specimens. While further investigations are needed to determine and test the spectral, spatial, and CT features required to classify tissue, this study demonstrates the ability of multimodal CT/SLI to quantify, visualize, and spatially navigate breast tumor specimens, which could potentially aid in the assessment of tumor margin status during

Learning multimodal dictionaries.

Science.gov (United States)

Monaci, Gianluca; Jost, Philippe; Vandergheynst, Pierre; Mailhé, Boris; Lesage, Sylvain; Gribonval, Rémi

2007-09-01

Real-world phenomena involve complex interactions between multiple signal modalities. As a consequence, humans are used to integrate at each instant perceptions from all their senses in order to enrich their understanding of the surrounding world. This paradigm can be also extremely useful in many signal processing and computer vision problems involving mutually related signals. The simultaneous processing of multimodal data can, in fact, reveal information that is otherwise hidden when considering the signals independently. However, in natural multimodal signals, the statistical dependencies between modalities are in general not obvious. Learning fundamental multimodal patterns could offer deep insight into the structure of such signals. In this paper, we present a novel model of multimodal signals based on their sparse decomposition over a dictionary of multimodal structures. An algorithm for iteratively learning multimodal generating functions that can be shifted at all positions in the signal is proposed, as well. The learning is defined in such a way that it can be accomplished by iteratively solving a generalized eigenvector problem, which makes the algorithm fast, flexible, and free of user-defined parameters. The proposed algorithm is applied to audiovisual sequences and it is able to discover underlying structures in the data. The detection of such audio-video patterns in audiovisual clips allows to effectively localize the sound source on the video in presence of substantial acoustic and visual distractors, outperforming state-of-the-art audiovisual localization algorithms.

Multimodality

DEFF Research Database (Denmark)

Buhl, Mie

2010-01-01

In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal' communication, which should not be confused with the term ‘multimedia'. While multimedia...... on their teaching and learning situations. The choices they make involve e-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very...

Nanocrystal core high-density lipoproteins: a multimodality contrast agent platform

NARCIS (Netherlands)

Cormode, David P.; Skajaa, Torjus; van Schooneveld, Matti M.; Koole, Rolf; Jarzyna, Peter; Lobatto, Mark E.; Calcagno, Claudia; Barazza, Alessandra; Gordon, Ronald E.; Zanzonico, Pat; Fisher, Edward A.; Fayad, Zahi A.; Mulder, Willem J. M.

2008-01-01

High density lipoprotein (HDL) is an important natural nanoparticle that may be modified for biomedical imaging purposes. Here we developed a novel technique to create unique multimodality HDL mimicking nanoparticles by incorporation of gold, iron oxide, or quantum dot nanocrystals for computed

Reading Multimodal Texts for Learning – a Model for Cultivating Multimodal Literacy

Directory of Open Access Journals (Sweden)

Kristina Danielsson

2016-08-01

Full Text Available The re-conceptualisation of texts over the last 20 years, as well as the development of a multimodal understanding of communication and representation of knowledge, has profound consequences for the reading and understanding of multimodal texts, not least in educational contexts. However, if teachers and students are given tools to “unwrap” multimodal texts, they can develop a deeper understanding of texts, information structures, and the textual organisation of knowledge. This article presents a model for working with multimodal texts in education with the intention to highlight mutual multimodal text analysis in relation to the subject content. Examples are taken from a Singaporean science textbook as well as a Chilean science textbook, in order to demonstrate that the framework is versatile and applicable across different cultural contexts. The model takes into account the following aspects of texts: the general structure, how different semiotic resources operate, the ways in which different resources are combined (including coherence, the use of figurative language, and explicit/implicit values. Since learning operates on different dimensions – such as social and affective dimensions besides the cognitive ones – our inclusion of figurative language and values as components for textual analysis is a contribution to multimodal text analysis for learning.

MO-DE-202-00: Image-Guided Interventions: Advances in Intraoperative Imaging, Guidance, and An Emerging Role for Medical Physics in Surgery

Energy Technology Data Exchange (ETDEWEB)

NONE

2016-06-15

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

Prospective respiratory-gated micro-CT of free breathing rodents

International Nuclear Information System (INIS)

Ford, Nancy L.; Nikolov, Hristo N.; Norley, Chris J.D.; Thornton, Michael M.; Foster, Paula J.; Drangova, Maria; Holdsworth, David W.

2005-01-01

Microcomputed tomography (Micro-CT) has the potential to noninvasively image the structure of organs in rodent models with high spatial resolution and relatively short image acquisition times. However, motion artifacts associated with the normal respiratory motion of the animal may arise when imaging the abdomen or thorax. To reduce these artifacts and the accompanying loss of spatial resolution, we propose a prospective respiratory gating technique for use with anaesthetized, free-breathing rodents. A custom-made bed with an embedded pressure chamber was connected to a pressure transducer. Anaesthetized animals were placed in the prone position on the bed with their abdomens located over the chamber. During inspiration, the motion of the diaphragm caused an increase in the chamber pressure, which was converted into a voltage signal by the transducer. An output voltage was used to trigger image acquisition at any desired time point in the respiratory cycle. Digital radiographic images were acquired of anaesthetized, free-breathing rats with a digital radiographic system to correlate the respiratory wave form with respiration-induced organ motion. The respiratory wave form was monitored and recorded simultaneously with the x-ray radiation pulses, and an imaging window was defined, beginning at end expiration. Phantom experiments were performed to verify that the respiratory gating apparatus was triggering the micro-CT system. Attached to the distensible phantom were 100 μm diameter copper wires and the measured full width at half maximum was used to assess differences in image quality between respiratory-gated and ungated imaging protocols. This experiment allowed us to quantify the improvement in the spatial resolution, and the reduction of motion artifacts caused by moving structures, in the images resulting from respiratory-gated image acquisitions. The measured wire diameters were 0.135 mm for the stationary phantom image, 0.137 mm for the image gated at end

Technical Note: Characterization of custom 3D printed multimodality imaging phantoms

International Nuclear Information System (INIS)

Bieniosek, Matthew F.; Lee, Brian J.; Levin, Craig S.

2015-01-01

Purpose: Imaging phantoms are important tools for researchers and technicians, but they can be costly and difficult to customize. Three dimensional (3D) printing is a widely available rapid prototyping technique that enables the fabrication of objects with 3D computer generated geometries. It is ideal for quickly producing customized, low cost, multimodal, reusable imaging phantoms. This work validates the use of 3D printed phantoms by comparing CT and PET scans of a 3D printed phantom and a commercial “Micro Deluxe” phantom. This report also presents results from a customized 3D printed PET/MRI phantom, and a customized high resolution imaging phantom with sub-mm features. Methods: CT and PET scans of a 3D printed phantom and a commercial Micro Deluxe (Data Spectrum Corporation, USA) phantom with 1.2, 1.6, 2.4, 3.2, 4.0, and 4.8 mm diameter hot rods were acquired. The measured PET and CT rod sizes, activities, and attenuation coefficients were compared. A PET/MRI scan of a custom 3D printed phantom with hot and cold rods was performed, with photon attenuation and normalization measurements performed with a separate 3D printed normalization phantom. X-ray transmission scans of a customized two level high resolution 3D printed phantom with sub-mm features were also performed. Results: Results show very good agreement between commercial and 3D printed micro deluxe phantoms with less than 3% difference in CT measured rod diameter, less than 5% difference in PET measured rod diameter, and a maximum of 6.2% difference in average rod activity from a 10 min, 333 kBq/ml (9 μCi/ml) Siemens Inveon (Siemens Healthcare, Germany) PET scan. In all cases, these differences were within the measurement uncertainties of our setups. PET/MRI scans successfully identified 3D printed hot and cold rods on PET and MRI modalities. X-ray projection images of a 3D printed high resolution phantom identified features as small as 350 μm wide. Conclusions: This work shows that 3D printed

Technical Note: Characterization of custom 3D printed multimodality imaging phantoms

Energy Technology Data Exchange (ETDEWEB)

Bieniosek, Matthew F. [Department of Electrical Engineering, Stanford University, 350 Serra Mall, Stanford, California 94305 (United States); Lee, Brian J. [Department of Mechanical Engineering, Stanford University, 440 Escondido Mall, Stanford, California 94305 (United States); Levin, Craig S., E-mail: cslevin@stanford.edu [Departments of Radiology, Physics, Bioengineering and Electrical Engineering, Stanford University, 300 Pasteur Dr., Stanford, California 94305-5128 (United States)

2015-10-15

Purpose: Imaging phantoms are important tools for researchers and technicians, but they can be costly and difficult to customize. Three dimensional (3D) printing is a widely available rapid prototyping technique that enables the fabrication of objects with 3D computer generated geometries. It is ideal for quickly producing customized, low cost, multimodal, reusable imaging phantoms. This work validates the use of 3D printed phantoms by comparing CT and PET scans of a 3D printed phantom and a commercial “Micro Deluxe” phantom. This report also presents results from a customized 3D printed PET/MRI phantom, and a customized high resolution imaging phantom with sub-mm features. Methods: CT and PET scans of a 3D printed phantom and a commercial Micro Deluxe (Data Spectrum Corporation, USA) phantom with 1.2, 1.6, 2.4, 3.2, 4.0, and 4.8 mm diameter hot rods were acquired. The measured PET and CT rod sizes, activities, and attenuation coefficients were compared. A PET/MRI scan of a custom 3D printed phantom with hot and cold rods was performed, with photon attenuation and normalization measurements performed with a separate 3D printed normalization phantom. X-ray transmission scans of a customized two level high resolution 3D printed phantom with sub-mm features were also performed. Results: Results show very good agreement between commercial and 3D printed micro deluxe phantoms with less than 3% difference in CT measured rod diameter, less than 5% difference in PET measured rod diameter, and a maximum of 6.2% difference in average rod activity from a 10 min, 333 kBq/ml (9 μCi/ml) Siemens Inveon (Siemens Healthcare, Germany) PET scan. In all cases, these differences were within the measurement uncertainties of our setups. PET/MRI scans successfully identified 3D printed hot and cold rods on PET and MRI modalities. X-ray projection images of a 3D printed high resolution phantom identified features as small as 350 μm wide. Conclusions: This work shows that 3D printed

Technical Note: Characterization of custom 3D printed multimodality imaging phantoms.

Science.gov (United States)

Bieniosek, Matthew F; Lee, Brian J; Levin, Craig S

2015-10-01

Imaging phantoms are important tools for researchers and technicians, but they can be costly and difficult to customize. Three dimensional (3D) printing is a widely available rapid prototyping technique that enables the fabrication of objects with 3D computer generated geometries. It is ideal for quickly producing customized, low cost, multimodal, reusable imaging phantoms. This work validates the use of 3D printed phantoms by comparing CT and PET scans of a 3D printed phantom and a commercial "Micro Deluxe" phantom. This report also presents results from a customized 3D printed PET/MRI phantom, and a customized high resolution imaging phantom with sub-mm features. CT and PET scans of a 3D printed phantom and a commercial Micro Deluxe (Data Spectrum Corporation, USA) phantom with 1.2, 1.6, 2.4, 3.2, 4.0, and 4.8 mm diameter hot rods were acquired. The measured PET and CT rod sizes, activities, and attenuation coefficients were compared. A PET/MRI scan of a custom 3D printed phantom with hot and cold rods was performed, with photon attenuation and normalization measurements performed with a separate 3D printed normalization phantom. X-ray transmission scans of a customized two level high resolution 3D printed phantom with sub-mm features were also performed. Results show very good agreement between commercial and 3D printed micro deluxe phantoms with less than 3% difference in CT measured rod diameter, less than 5% difference in PET measured rod diameter, and a maximum of 6.2% difference in average rod activity from a 10 min, 333 kBq/ml (9 μCi/ml) Siemens Inveon (Siemens Healthcare, Germany) PET scan. In all cases, these differences were within the measurement uncertainties of our setups. PET/MRI scans successfully identified 3D printed hot and cold rods on PET and MRI modalities. X-ray projection images of a 3D printed high resolution phantom identified features as small as 350 μm wide. This work shows that 3D printed phantoms can be functionally equivalent to

High numerical aperture imaging by using multimode fibers with micro-fabricated optics

KAUST Repository

Bianchi, Silvio; Rajamanickam, V.; Ferrara, Lorenzo; Di Fabrizio, Enzo M.; Di Leonardo, Roberto; Liberale, Carlo

2014-01-01

Controlling light propagation into multimode optical fibers through spatial light modulators provides highly miniaturized endoscopes and optical micromanipulation probes. We increase the numerical aperture up to nearly 1 by micro-optics fabricated on the fiber-end.

Differential diagnosis of left ventricular hypertrophy: usefulness of multimodality imaging and tissue characterization with cardiac magnetic resonance.

Science.gov (United States)

Izgi, Cemil; Vassiliou, Vassilis; Baksi, A John; Prasad, Sanjay K

2016-11-01

Differential diagnosis of asymmetrical left ventricular hypertrophy may be challenging, particularly in patients with history of hypertension. A middle-aged man underwent an echocardiographic examination during workup for hypertension, which unexpectedly showed significant asymmetrical septal hypertrophy and raised suspicion for hypertrophic cardiomyopathy. Cardiovascular magnetic resonance confirmed the asymmetrical hypertrophy. No myocardial late gadolinium contrast enhancement was seen. However, precontrast T1 mapping revealed a low native myocardial T1 value. This was highly suggestive of Anderson-Fabry disease, which was subsequently proved with very low alpha galactosidase enzyme levels and mutation analysis. The case illustrates clinical usefulness of multimodality imaging and the novel tissue characterization techniques for assessment of left ventricular hypertrophy. © 2016, Wiley Periodicals, Inc.

Dual Channel Pulse Coupled Neural Network Algorithm for Fusion of Multimodality Brain Images with Quality Analysis

Directory of Open Access Journals (Sweden)

Kavitha SRINIVASAN

2014-09-01

Full Text Available Background: In the review of medical imaging techniques, an important fact that emerged is that radiologists and physicians still are in a need of high-resolution medical images with complementary information from different modalities to ensure efficient analysis. This requirement should have been sorted out using fusion techniques with the fused image being used in image-guided surgery, image-guided radiotherapy and non-invasive diagnosis. Aim: This paper focuses on Dual Channel Pulse Coupled Neural Network (PCNN Algorithm for fusion of multimodality brain images and the fused image is further analyzed using subjective (human perception and objective (statistical measures for the quality analysis. Material and Methods: The modalities used in fusion are CT, MRI with subtypes T1/T2/PD/GAD, PET and SPECT, since the information from each modality is complementary to one another. The objective measures selected for evaluation of fused image were: Information Entropy (IE - image quality, Mutual Information (MI – deviation in fused to the source images and Signal to Noise Ratio (SNR – noise level, for analysis. Eight sets of brain images with different modalities (T2 with T1, T2 with CT, PD with T2, PD with GAD, T2 with GAD, T2 with SPECT-Tc, T2 with SPECT-Ti, T2 with PET are chosen for experimental purpose and the proposed technique is compared with existing fusion methods such as the Average method, the Contrast pyramid, the Shift Invariant Discrete Wavelet Transform (SIDWT with Harr and the Morphological pyramid, using the selected measures to ascertain relative performance. Results: The IE value and SNR value of the fused image derived from dual channel PCNN is higher than other fusion methods, shows that the quality is better with less noise. Conclusion: The fused image resulting from the proposed method retains the contrast, shape and texture as in source images without false information or information loss.

Critical Analysis of Multimodal Discourse

DEFF Research Database (Denmark)

van Leeuwen, Theo

2013-01-01

This is an encyclopaedia article which defines the fields of critical discourse analysis and multimodality studies, argues that within critical discourse analysis more attention should be paid to multimodality, and within multimodality to critical analysis, and ends reviewing a few examples of re...

Multimodality imaging of osteomyelitis

Energy Technology Data Exchange (ETDEWEB)

Elgazzar, A.H. [Cincinnati Univ. Medical Center, OH (United States); Abdel-Dayem, H.M. [Dept. Radiology, New York Medical College, Valhalla, NY (United States)]|[Dept. of Radiology, St. Vinvent`s Hospital and Medical Center, New York, NY (United States); Clark, J.D. [Cincinnati Univ. Medical Center, OH (United States); Maxon, H.R. [Cincinnati Univ. Medical Center, OH (United States)

1995-09-01

After a brief introduction outlining some basic principles regarding the diagnosis of osteomyelitis, pathophysiologic aspects are reviewed. Advantages and disadvantages of each imaging modality and their applications in different forms of osteomyelitis are discussed. The use of different imaging modalities in the diagnosis of special forms of osteomyelitis, including chronic, diabetic foot, and vertebral osteomyelitis, and osteomyelitis associated with orthopedic appliances and sickle cell disease is reviewed. Taking into account the site of suspected osteomyelitis and the presence or absence of underlying pathologic changes and their nature, an algorithm summarizing the use of various imaging modalities in the diagnosis of osteomyelitis is presented. (orig.). With 13 figs., 9 tabs.

Performance characterization of the Inveon preclinical small-animal PET/SPECT/CT system for multimodality imaging

International Nuclear Information System (INIS)

Magota, Keiichi; Kubo, Naoki; Kuge, Yuji; Nishijima, Ken-ichi; Zhao, Songji; Tamaki, Nagara

2011-01-01

We investigated the performance of the Inveon small-animal PET/SPECT/CT system and compared the imaging capabilities of the SPECT and PET components. For SPECT, the energy resolution, tomographic spatial resolution and system sensitivity were evaluated with a 99m Tc solution using a single pinhole collimator. For PET, the spatial resolution, absolute sensitivity, scatter fraction and peak noise equivalent count were evaluated. Phantoms and a normal rat were scanned to compare the imaging capabilities of SPECT and PET. The SPECT spatial resolution was 0.84 mm full-width at half-maximum (FWHM) at a radius of rotation of 25 mm using a 0.5-mm pinhole aperture collimator, while the PET spatial resolution was 1.63 mm FWHM at the centre. The SPECT system sensitivity at a radius of rotation of 25 mm was 35.3 cps/MBq (4 x 10 -3 %) using the 0.5-mm pinhole aperture, while the PET absolute sensitivity was 3.2% for 350-650 keV and 3.432 ns. Accordingly, the volume sensitivity of PET was three orders of magnitude higher than that of SPECT. This integrated PET/SPECT/CT system showed high performance with excellent spatial resolution for SPECT and sensitivity for PET. Based on the tracer availability and system performance, SPECT and PET have complementary roles in multimodality small-animal imaging. (orig.)

COBRA: A prospective multimodal imaging study of dopamine, brain structure and function, and cognition.

Science.gov (United States)

Nevalainen, N; Riklund, K; Andersson, M; Axelsson, J; Ögren, M; Lövdén, M; Lindenberger, U; Bäckman, L; Nyberg, L

2015-07-01

Cognitive decline is a characteristic feature of normal human aging. Previous work has demonstrated marked interindividual variability in onset and rate of decline. Such variability has been linked to factors such as maintenance of functional and structural brain integrity, genetics, and lifestyle. Still, few, if any, studies have combined a longitudinal design with repeated multimodal imaging and a comprehensive assessment of cognition as well as genetic and lifestyle factors. The present paper introduces the Cognition, Brain, and Aging (COBRA) study, in which cognitive performance and brain structure and function are measured in a cohort of 181 older adults aged 64 to 68 years at baseline. Participants will be followed longitudinally over a 10-year period, resulting in a total of three equally spaced measurement occasions. The measurement protocol at each occasion comprises a comprehensive set of behavioral and imaging measures. Cognitive performance is evaluated via computerized testing of working memory, episodic memory, perceptual speed, motor speed, implicit sequence learning, and vocabulary. Brain imaging is performed using positron emission tomography with [(11)C]-raclopride to assess dopamine D2/D3 receptor availability. Structural magnetic resonance imaging (MRI) is used for assessment of white and gray-matter integrity and cerebrovascular perfusion, and functional MRI maps brain activation during rest and active task conditions. Lifestyle descriptives are collected, and blood samples are obtained and stored for future evaluation. Here, we present selected results from the baseline assessment along with a discussion of sample characteristics and methodological considerations that determined the design of the study. This article is part of a Special Issue entitled SI: Memory & Aging. Copyright © 2014 The Authors. Published by Elsevier B.V. All rights reserved.

Fast multi-core based multimodal registration of 2D cross-sections and 3D datasets.

Science.gov (United States)

Scharfe, Michael; Pielot, Rainer; Schreiber, Falk

2010-01-11

Solving bioinformatics tasks often requires extensive computational power. Recent trends in processor architecture combine multiple cores into a single chip to improve overall performance. The Cell Broadband Engine (CBE), a heterogeneous multi-core processor, provides power-efficient and cost-effective high-performance computing. One application area is image analysis and visualisation, in particular registration of 2D cross-sections into 3D image datasets. Such techniques can be used to put different image modalities into spatial correspondence, for example, 2D images of histological cuts into morphological 3D frameworks. We evaluate the CBE-driven PlayStation 3 as a high performance, cost-effective computing platform by adapting a multimodal alignment procedure to several characteristic hardware properties. The optimisations are based on partitioning, vectorisation, branch reducing and loop unrolling techniques with special attention to 32-bit multiplies and limited local storage on the computing units. We show how a typical image analysis and visualisation problem, the multimodal registration of 2D cross-sections and 3D datasets, benefits from the multi-core based implementation of the alignment algorithm. We discuss several CBE-based optimisation methods and compare our results to standard solutions. More information and the source code are available from http://cbe.ipk-gatersleben.de. The results demonstrate that the CBE processor in a PlayStation 3 accelerates computational intensive multimodal registration, which is of great importance in biological/medical image processing. The PlayStation 3 as a low cost CBE-based platform offers an efficient option to conventional hardware to solve computational problems in image processing and bioinformatics.

Separating Bulk and Surface Contributions to Electronic Excited-State Processes in Hybrid Mixed Perovskite Thin Films via Multimodal All-Optical Imaging.

Science.gov (United States)

Simpson, Mary Jane; Doughty, Benjamin; Das, Sanjib; Xiao, Kai; Ma, Ying-Zhong

2017-07-20

A comprehensive understanding of electronic excited-state phenomena underlying the impressive performance of solution-processed hybrid halide perovskite solar cells requires access to both spatially resolved electronic processes and corresponding sample morphological characteristics. Here, we demonstrate an all-optical multimodal imaging approach that enables us to obtain both electronic excited-state and morphological information on a single optical microscope platform with simultaneous high temporal and spatial resolution. Specifically, images were acquired for the same region of interest in thin films of chloride containing mixed lead halide perovskites (CH 3 NH 3 PbI 3-x Cl x ) using femtosecond transient absorption, time-integrated photoluminescence, confocal reflectance, and transmission microscopies. Comprehensive image analysis revealed the presence of surface- and bulk-dominated contributions to the various images, which describe either spatially dependent electronic excited-state properties or morphological variations across the probed region of the thin films. These results show that PL probes effectively the species near or at the film surface.

A multimodal 3D framework for fire characteristics estimation

Science.gov (United States)

Toulouse, T.; Rossi, L.; Akhloufi, M. A.; Pieri, A.; Maldague, X.

2018-02-01

In the last decade we have witnessed an increasing interest in using computer vision and image processing in forest fire research. Image processing techniques have been successfully used in different fire analysis areas such as early detection, monitoring, modeling and fire front characteristics estimation. While the majority of the work deals with the use of 2D visible spectrum images, recent work has introduced the use of 3D vision in this field. This work proposes a new multimodal vision framework permitting the extraction of the three-dimensional geometrical characteristics of fires captured by multiple 3D vision systems. The 3D system is a multispectral stereo system operating in both the visible and near-infrared (NIR) spectral bands. The framework supports the use of multiple stereo pairs positioned so as to capture complementary views of the fire front during its propagation. Multimodal registration is conducted using the captured views in order to build a complete 3D model of the fire front. The registration process is achieved using multisensory fusion based on visual data (2D and NIR images), GPS positions and IMU inertial data. Experiments were conducted outdoors in order to show the performance of the proposed framework. The obtained results are promising and show the potential of using the proposed framework in operational scenarios for wildland fire research and as a decision management system in fighting.

Intraoperative laser speckle contrast imaging improves the stability of rodent middle cerebral artery occlusion model

Science.gov (United States)

Yuan, Lu; Li, Yao; Li, Hangdao; Lu, Hongyang; Tong, Shanbao

2015-09-01

Rodent middle cerebral artery occlusion (MCAO) model is commonly used in stroke research. Creating a stable infarct volume has always been challenging for technicians due to the variances of animal anatomy and surgical operations. The depth of filament suture advancement strongly influences the infarct volume as well. We investigated the cerebral blood flow (CBF) changes in the affected cortex using laser speckle contrast imaging when advancing suture during MCAO surgery. The relative CBF drop area (CBF50, i.e., the percentage area with CBF less than 50% of the baseline) showed an increase from 20.9% to 69.1% when the insertion depth increased from 1.6 to 1.8 cm. Using the real-time CBF50 marker to guide suture insertion during the surgery, our animal experiments showed that intraoperative CBF-guided surgery could significantly improve the stability of MCAO with a more consistent infarct volume and less mortality.

Multimodal imaging NMR-{sup 99m}Tc-MIBI Spect to guide stereotactic biopsy: a case report; A propos d'un cas d'intervention neurochirurgicale guidee par l'imagerie multi-modalite IRM-TEMP au {sup 99m}Tc-MIBI

Energy Technology Data Exchange (ETDEWEB)

Prigent-Le Jeune, F.; Coste, E.; Perez, S.; Lecouffe, P.; Steinling, M. [Hopital Roger Salengro, CHRU, Service Central de Medecine Nucleaire, UF de Neurologie, 59 - Lille (France); Dubois, F.; Blond, S. [Hopital Roger Salengro, CHRU, Service de Neurologie, 59 - Lille (France)

2001-03-01

Multimodal imaging is the simultaneous and co-registered use of images issued from different modalities in order to improve the information quality and the pathology diagnosis. We have developed a registration method between cerebral {sup 99m}Tc-MIBI tomo-scintigraphy and MRI, easy to use in standard clinical practice for cerebral glioma follow up. This paper presents the follow-up of a patient, having an abnormal tracer uptake without any clinical or neuro-morphological disorder. The registered images helped the neurosurgeon to define the stereotactic biopsy trajectory according to the abnormal uptake area position. The histological analysis demonstrated a high grade recurrence. This clinical case confirms the contribution of the multimodal imaging, in the pre-operative planning of neurosurgical stereotactic biopsy, in order to accurately localize the tumour recurrence on the anatomical images. (authors)

Multimodality multiparametric imaging of early tumor response to a novel antiangiogenic therapy based on anticalins.

Directory of Open Access Journals (Sweden)

Reinhard Meier

Full Text Available Anticalins are a novel class of targeted protein therapeutics. The PEGylated Anticalin Angiocal (PRS-050-PEG40 is directed against VEGF-A. The purpose of our study was to compare the performance of diffusion weighted imaging (DWI, dynamic contrast enhanced magnetic resonance imaging (DCE-MRI and positron emission tomography with the tracer [18F]fluorodeoxyglucose (FDG-PET for monitoring early response to antiangiogenic therapy with PRS-050-PEG40. 31 mice were implanted subcutaneously with A673 rhabdomyosarcoma xenografts and underwent DWI, DCE-MRI and FDG-PET before and 2 days after i.p. injection of PRS-050-PEG40 (n = 13, Avastin (n = 6 or PBS (n = 12. Tumor size was measured manually with a caliper. Imaging results were correlated with histopathology. In the results, the tumor size was not significantly different in the treatment groups when compared to the control group on day 2 after therapy onset (P = 0.09. In contrast the imaging modalities DWI, DCE-MRI and FDG-PET showed significant differences between the therapeutic compared to the control group as early as 2 days after therapy onset (P<0.001. There was a strong correlation of the early changes in DWI, DCE-MRI and FDG-PET at day 2 after therapy onset and the change in tumor size at the end of therapy (r = -0.58, 0.71 and 0.67 respectively. The imaging results were confirmed by histopathology, showing early necrosis and necroptosis in the tumors. Thus multimodality multiparametric imaging was able to predict therapeutic success of PRS-050-PEG40 and Avastin as early as 2 days after onset of therapy and thus promising for monitoring early response of antiangiogenic therapy.

Development of ClearPEM-Sonic, a multimodal mammography system for PET and Ultrasound

Science.gov (United States)

Cucciati, G.; Auffray, E.; Bugalho, R.; Cao, L.; Di Vara, N.; Farina, F.; Felix, N.; Frisch, B.; Ghezzi, A.; Juhan, V.; Jun, D.; Lasaygues, P.; Lecoq, P.; Mensah, S.; Mundler, O.; Neves, J.; Paganoni, M.; Peter, J.; Pizzichemi, M.; Siles, P.; Silva, J. C.; Silva, R.; Tavernier, S.; Tessonnier, L.; Varela, J.

2014-03-01

ClearPEM-Sonic is an innovative imaging device specifically developed for breast cancer. The possibility to work in PEM-Ultrasound multimodality allows to obtain metabolic and morphological information increasing the specificity of the exam. The ClearPEM detector is developed to maximize the sensitivity and the spatial resolution as compared to Whole-Body PET scanners. It is coupled with a 3D ultrasound system, the SuperSonic Imagine Aixplorer that improves the specificity of the exam by providing a tissue elasticity map. This work describes the ClearPEM-Sonic project focusing on the technological developments it has required, the technical merits (and limits) and the first multimodal images acquired on a dedicated phantom. It finally presents selected clinical case studies that confirm the value of PEM information.

Development of ClearPEM-Sonic, a multimodal mammography system for PET and Ultrasound

International Nuclear Information System (INIS)

Cucciati, G; Vara, N Di; Ghezzi, A; Paganoni, M; Pizzichemi, M; Auffray, E; Frisch, B; Lecoq, P; Bugalho, R; Neves, J; Cao, L; Peter, J; Farina, F; Felix, N; Juhan, V; Mundler, O; Siles, P; Jun, D; Lasaygues, P; Mensah, S

2014-01-01

ClearPEM-Sonic is an innovative imaging device specifically developed for breast cancer. The possibility to work in PEM-Ultrasound multimodality allows to obtain metabolic and morphological information increasing the specificity of the exam. The ClearPEM detector is developed to maximize the sensitivity and the spatial resolution as compared to Whole-Body PET scanners. It is coupled with a 3D ultrasound system, the SuperSonic Imagine Aixplorer that improves the specificity of the exam by providing a tissue elasticity map. This work describes the ClearPEM-Sonic project focusing on the technological developments it has required, the technical merits (and limits) and the first multimodal images acquired on a dedicated phantom. It finally presents selected clinical case studies that confirm the value of PEM information

On-road anomaly detection by multimodal sensor analysis and multimedia processing

Science.gov (United States)

Orhan, Fatih; Eren, P. E.

2014-03-01

The use of smartphones in Intelligent Transportation Systems is gaining popularity, yet many challenges exist in developing functional applications. Due to the dynamic nature of transportation, vehicular social applications face complexities such as developing robust sensor management, performing signal and image processing tasks, and sharing information among users. This study utilizes a multimodal sensor analysis framework which enables the analysis of sensors in multimodal aspect. It also provides plugin-based analyzing interfaces to develop sensor and image processing based applications, and connects its users via a centralized application as well as to social networks to facilitate communication and socialization. With the usage of this framework, an on-road anomaly detector is being developed and tested. The detector utilizes the sensors of a mobile device and is able to identify anomalies such as hard brake, pothole crossing, and speed bump crossing. Upon such detection, the video portion containing the anomaly is automatically extracted in order to enable further image processing analysis. The detection results are shared on a central portal application for online traffic condition monitoring.

A multimodality vascular imaging phantom of an abdominal aortic aneurysm with a visible thrombus

Energy Technology Data Exchange (ETDEWEB)

Allard, Louise; Chayer, Boris; Qin Zhao [Laboratory of Biorheology and Medical Ultrasonics, Research Center, University of Montreal Hospital (CRCHUM), Quebec H2L 2W5 (Canada); Soulez, Gilles [Department of Radiology, University of Montreal Hospital (CHUM), Quebec H2L 2M1 (Canada); Department of Radiology, Radio-Oncology and Nuclear Medicine, University of Montreal, Quebec H3T 1J4 (Canada); Institute of Biomedical Engineering, University of Montreal, Quebec H3T 1J4 (Canada); Roy, David [Institute of Biomedical Engineering, University of Montreal, Quebec H3T 1J4 (Canada); Cloutier, Guy [Laboratory of Biorheology and Medical Ultrasonics, Research Center, University of Montreal Hospital (CRCHUM), Quebec H2L 2W5 (Canada); Department of Radiology, Radio-Oncology and Nuclear Medicine, University of Montreal, Quebec H3T 1J4 (Canada); Institute of Biomedical Engineering, University of Montreal, Quebec H3T 1J4 (Canada)

2013-06-15

Purpose: With the continuous development of new stent grafts and implantation techniques, it has now become technically feasible to treat abdominal aortic aneurysms (AAA) with challenging anatomy using endovascular repair with standard, fenestrated, or branched stent-grafts. In vitro experimentations are very useful to improve stent-graft design and conformability or imaging guidance for stent-graft delivery or follow-up. Vascular replicas also help to better understand the limitation of endovascular approaches in challenging anatomy and possibly improve surgical planning or training by practicing high risk clinical procedures in the laboratory to improve outcomes in the operating room. Most AAA phantoms available have a very basic anatomy, which is not representative of the clinical reality. This paper presents a method of fabrication of a realistic AAA phantom with a visible thrombus, as well as some mechanical properties characterizing such phantom. Methods: A realistic AAA geometry replica of a real patient anatomy taken from a multidetector computed tomography (CT) scan was manufactured. To demonstrate the multimodality imaging capability of this new phantom with a thrombus visible in magnetic resonance (MR) angiography, CT angiography (CTA), digital subtraction angiography (DSA), and ultrasound, image acquisitions with all these modalities were performed by using standard clinical protocols. Potential use of this phantom for stent deployment was also tested. A rheometer allowed defining hyperelastic and viscoelastic properties of phantom materials. Results: MR imaging measurements of SNR and CNR values on T1 and T2-weighted sequences and MR angiography indicated reasonable agreement with published values of AAA thrombus and abdominal components in vivo. X-ray absorption also lay within normal ranges of AAA patients and was representative of findings observed on CTA, fluoroscopy, and DSA. Ultrasound propagation speeds for developed materials were also in

A multimodality vascular imaging phantom of an abdominal aortic aneurysm with a visible thrombus

International Nuclear Information System (INIS)

Allard, Louise; Chayer, Boris; Qin Zhao; Soulez, Gilles; Roy, David; Cloutier, Guy

2013-01-01

Purpose: With the continuous development of new stent grafts and implantation techniques, it has now become technically feasible to treat abdominal aortic aneurysms (AAA) with challenging anatomy using endovascular repair with standard, fenestrated, or branched stent-grafts. In vitro experimentations are very useful to improve stent-graft design and conformability or imaging guidance for stent-graft delivery or follow-up. Vascular replicas also help to better understand the limitation of endovascular approaches in challenging anatomy and possibly improve surgical planning or training by practicing high risk clinical procedures in the laboratory to improve outcomes in the operating room. Most AAA phantoms available have a very basic anatomy, which is not representative of the clinical reality. This paper presents a method of fabrication of a realistic AAA phantom with a visible thrombus, as well as some mechanical properties characterizing such phantom. Methods: A realistic AAA geometry replica of a real patient anatomy taken from a multidetector computed tomography (CT) scan was manufactured. To demonstrate the multimodality imaging capability of this new phantom with a thrombus visible in magnetic resonance (MR) angiography, CT angiography (CTA), digital subtraction angiography (DSA), and ultrasound, image acquisitions with all these modalities were performed by using standard clinical protocols. Potential use of this phantom for stent deployment was also tested. A rheometer allowed defining hyperelastic and viscoelastic properties of phantom materials. Results: MR imaging measurements of SNR and CNR values on T1 and T2-weighted sequences and MR angiography indicated reasonable agreement with published values of AAA thrombus and abdominal components in vivo. X-ray absorption also lay within normal ranges of AAA patients and was representative of findings observed on CTA, fluoroscopy, and DSA. Ultrasound propagation speeds for developed materials were also in

The Multimodal Possibilities of Online Instructions

DEFF Research Database (Denmark)

Kampf, Constance

2006-01-01

The WWW simplifies the process of delivering online instructions through multimodal channels because of the ease of use for voice, video, pictures, and text modes of communication built into it.  Given that instructions are being produced in multimodal format for the WWW, how do multi-modal analy......The WWW simplifies the process of delivering online instructions through multimodal channels because of the ease of use for voice, video, pictures, and text modes of communication built into it.  Given that instructions are being produced in multimodal format for the WWW, how do multi...

Development of positron sensor for multi-modal endoscopy

Energy Technology Data Exchange (ETDEWEB)

Shimazoe, Kenji, E-mail: shimazoe@it-club.jp [Department of Bioengineering, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656 (Japan); Takahashi, Hiroyuki [Department of Nuclear Engineering and Management, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656 (Japan); Fujita, Kaoru [Japan Atomic Energy Agency, 4-29 Tokaimura, 319-1184 Ibaraki (Japan); Mori, Hiroshi; Momose, Toshimitsu [Department of Bioengineering, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656 (Japan)

2011-08-21

Endoscopy is an important inspection device to detect cancers in the human body, but there exists the case of cancer that is hard to detect with only an optical device. Double inspection with optical and radio images is preferable for high accuracy diagnosis, and real time radio imaging is also promising for real time surgery with an endoscope. We have simulated, designed and fabricated a Si-based positron imaging probe for more accurate cancer detection in multi-modality endoscope systems. The fabricated Si-based detector with 2 mm diameter and 1 mm thickness was tested with gamma and positron sources, and also tested to detect cancers in a tumor bearing mouse. The direct positron imaging could have an advantage over gamma imaging in its high sensitivity and resolution.

Registration for Optical Multimodal Remote Sensing Images Based on FAST Detection, Window Selection, and Histogram Specification

Directory of Open Access Journals (Sweden)

Xiaoyang Zhao

2018-04-01

. The results from this study indicate that the proposed method can be effective for registering optical multimodal remote sensing images that have been captured with different imaging sensors.

21 CFR 1250.96 - Rodent control.

Science.gov (United States)

2010-04-01

... 21 Food and Drugs 8 2010-04-01 2010-04-01 false Rodent control. 1250.96 Section 1250.96 Food and... SANITATION Sanitation Facilities and Conditions on Vessels § 1250.96 Rodent control. Vessels shall be... of rodent control. ...

MINERVA - a multi-modal radiation treatment planning system

Energy Technology Data Exchange (ETDEWEB)

Wemple, C.A. E-mail: cew@enel.gov; Wessol, D.E.; Nigg, D.W.; Cogliati, J.J.; Milvich, M.L.; Frederickson, C.; Perkins, M.; Harkin, G.J

2004-11-01

Researchers at the Idaho National Engineering and Environmental Laboratory and Montana State University have undertaken development of MINERVA, a patient-centric, multi-modal, radiation treatment planning system. This system can be used for planning and analyzing several radiotherapy modalities, either singly or combined, using common modality independent image and geometry construction and dose reporting and guiding. It employs an integrated, lightweight plugin architecture to accommodate multi-modal treatment planning using standard interface components. The MINERVA design also facilitates the future integration of improved planning technologies. The code is being developed with the Java Virtual Machine for interoperability. A full computation path has been established for molecular targeted radiotherapy treatment planning, with the associated transport plugin developed by researchers at the Lawrence Livermore National Laboratory. Development of the neutron transport plugin module is proceeding rapidly, with completion expected later this year. Future development efforts will include development of deformable registration methods, improved segmentation methods for patient model definition, and three-dimensional visualization of the patient images, geometry, and dose data. Transport and source plugins will be created for additional treatment modalities, including brachytherapy, external beam proton radiotherapy, and the EGSnrc/BEAMnrc codes for external beam photon and electron radiotherapy.

Assessment of rigid multi-modality image registration consistency using the multiple sub-volume registration (MSR) method

International Nuclear Information System (INIS)

Ceylan, C; Heide, U A van der; Bol, G H; Lagendijk, J J W; Kotte, A N T J

2005-01-01

Registration of different imaging modalities such as CT, MRI, functional MRI (fMRI), positron (PET) and single photon (SPECT) emission tomography is used in many clinical applications. Determining the quality of any automatic registration procedure has been a challenging part because no gold standard is available to evaluate the registration. In this note we present a method, called the 'multiple sub-volume registration' (MSR) method, for assessing the consistency of a rigid registration. This is done by registering sub-images of one data set on the other data set, performing a crude non-rigid registration. By analysing the deviations (local deformations) of the sub-volume registrations from the full registration we get a measure of the consistency of the rigid registration. Registration of 15 data sets which include CT, MR and PET images for brain, head and neck, cervix, prostate and lung was performed utilizing a rigid body registration with normalized mutual information as the similarity measure. The resulting registrations were classified as good or bad by visual inspection. The resulting registrations were also classified using our MSR method. The results of our MSR method agree with the classification obtained from visual inspection for all cases (p < 0.02 based on ANOVA of the good and bad groups). The proposed method is independent of the registration algorithm and similarity measure. It can be used for multi-modality image data sets and different anatomic sites of the patient. (note)

From Grey Scale B-Mode to Elastosonography: Multimodal Ultrasound Imaging in Meningioma Surgery-Pictorial Essay and Literature Review.

Science.gov (United States)

Prada, Francesco; Del Bene, Massimiliano; Moiraghi, Alessandro; Casali, Cecilia; Legnani, Federico Giuseppe; Saladino, Andrea; Perin, Alessandro; Vetrano, Ignazio Gaspare; Mattei, Luca; Richetta, Carla; Saini, Marco; DiMeco, Francesco

2015-01-01

The main goal in meningioma surgery is to achieve complete tumor removal, when possible, while improving or preserving patient neurological functions. Intraoperative imaging guidance is one fundamental tool for such achievement. In this regard, intra-operative ultrasound (ioUS) is a reliable solution to obtain real-time information during surgery and it has been applied in many different aspect of neurosurgery. In the last years, different ioUS modalities have been described: B-mode, Fusion Imaging with pre-operative acquired MRI, Doppler, contrast enhanced ultrasound (CEUS), and elastosonography. In this paper, we present our US based multimodal approach in meningioma surgery. We describe all the most relevant ioUS modalities and their intraoperative application to obtain precise and specific information regarding the lesion for a tailored approach in meningioma surgery. For each modality, we perform a review of the literature accompanied by a pictorial essay based on our routinely use of ioUS for meningioma resection.

Automated diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks

Science.gov (United States)

Le, Minh Hung; Chen, Jingyu; Wang, Liang; Wang, Zhiwei; Liu, Wenyu; (Tim Cheng, Kwang-Ting; Yang, Xin

2017-08-01

Automated methods for prostate cancer (PCa) diagnosis in multi-parametric magnetic resonance imaging (MP-MRIs) are critical for alleviating requirements for interpretation of radiographs while helping to improve diagnostic accuracy (Artan et al 2010 IEEE Trans. Image Process. 19 2444-55, Litjens et al 2014 IEEE Trans. Med. Imaging 33 1083-92, Liu et al 2013 SPIE Medical Imaging (International Society for Optics and Photonics) p 86701G, Moradi et al 2012 J. Magn. Reson. Imaging 35 1403-13, Niaf et al 2014 IEEE Trans. Image Process. 23 979-91, Niaf et al 2012 Phys. Med. Biol. 57 3833, Peng et al 2013a SPIE Medical Imaging (International Society for Optics and Photonics) p 86701H, Peng et al 2013b Radiology 267 787-96, Wang et al 2014 BioMed. Res. Int. 2014). This paper presents an automated method based on multimodal convolutional neural networks (CNNs) for two PCa diagnostic tasks: (1) distinguishing between cancerous and noncancerous tissues and (2) distinguishing between clinically significant (CS) and indolent PCa. Specifically, our multimodal CNNs effectively fuse apparent diffusion coefficients (ADCs) and T2-weighted MP-MRI images (T2WIs). To effectively fuse ADCs and T2WIs we design a new similarity loss function to enforce consistent features being extracted from both ADCs and T2WIs. The similarity loss is combined with the conventional classification loss functions and integrated into the back-propagation procedure of CNN training. The similarity loss enables better fusion results than existing methods as the feature learning processes of both modalities are mutually guided, jointly facilitating CNN to ‘see’ the true visual patterns of PCa. The classification results of multimodal CNNs are further combined with the results based on handcrafted features using a support vector machine classifier. To achieve a satisfactory accuracy for clinical use, we comprehensively investigate three critical factors which could greatly affect the performance of our

Virtual reality systems for rodents.

Science.gov (United States)

Thurley, Kay; Ayaz, Aslı

2017-02-01

Over the last decade virtual reality (VR) setups for rodents have been developed and utilized to investigate the neural foundations of behavior. Such VR systems became very popular since they allow the use of state-of-the-art techniques to measure neural activity in behaving rodents that cannot be easily used with classical behavior setups. Here, we provide an overview of rodent VR technologies and review recent results from related research. We discuss commonalities and differences as well as merits and issues of different approaches. A special focus is given to experimental (behavioral) paradigms in use. Finally we comment on possible use cases that may further exploit the potential of VR in rodent research and hence inspire future studies.

Fast multi-core based multimodal registration of 2D cross-sections and 3D datasets

Directory of Open Access Journals (Sweden)

Pielot Rainer

2010-01-01

Full Text Available Abstract Background Solving bioinformatics tasks often requires extensive computational power. Recent trends in processor architecture combine multiple cores into a single chip to improve overall performance. The Cell Broadband Engine (CBE, a heterogeneous multi-core processor, provides power-efficient and cost-effective high-performance computing. One application area is image analysis and visualisation, in particular registration of 2D cross-sections into 3D image datasets. Such techniques can be used to put different image modalities into spatial correspondence, for example, 2D images of histological cuts into morphological 3D frameworks. Results We evaluate the CBE-driven PlayStation 3 as a high performance, cost-effective computing platform by adapting a multimodal alignment procedure to several characteristic hardware properties. The optimisations are based on partitioning, vectorisation, branch reducing and loop unrolling techniques with special attention to 32-bit multiplies and limited local storage on the computing units. We show how a typical image analysis and visualisation problem, the multimodal registration of 2D cross-sections and 3D datasets, benefits from the multi-core based implementation of the alignment algorithm. We discuss several CBE-based optimisation methods and compare our results to standard solutions. More information and the source code are available from http://cbe.ipk-gatersleben.de. Conclusions The results demonstrate that the CBE processor in a PlayStation 3 accelerates computational intensive multimodal registration, which is of great importance in biological/medical image processing. The PlayStation 3 as a low cost CBE-based platform offers an efficient option to conventional hardware to solve computational problems in image processing and bioinformatics.

Three-dimensional whole-brain perfused blood volume imaging with multimodal CT for evaluation of acute ischaemic stroke

International Nuclear Information System (INIS)

Lu, J.; Zhang, M.; Cao, Y.; Ma, Q.; Chen, J.; Ji, X.; Li, K.

2011-01-01

Aim: To determine the diagnostic value of integrating three-dimensional perfused blood volume (3D PBV) with multimodal computed tomography (CT) [non-enhanced CT (NECT), CT perfusion (CTP), and CT angiography (CTA)] in acute ischaemic stroke. Materials and methods: NECT, CTP, and CTA were performed in 25 acute ischaemic stroke patients. The ischaemia detection rate of 3D PBV was compared with the results of baseline NECT and CTP. The correlation of ischaemic lesion volume between 3D PBV, CTP images, and follow-up NECT were analysed. Results: NECT demonstrated ischaemic signs in 12 of 25 patients with proven infarction. CTP maps of cerebral blood flow (CBF), cerebral blood volume (CBV), and time to peak (TTP) all demonstrated perfusion deficits in 21 of 25 patients. However, 3D PBV demonstrated perfusion deficits in all of the 25 patients. Among the 25 patients, a strong correlation was found between PBV and the follow-up NECT infarct (r = 0.858). The correlation between CTP and the follow-up NECT infarct as following: CBF (r = 0.718), CBV (r = 0.785), and TTP (r = 0.569). In 14 thrombolytic patients, strong correlation was found between the ischaemic volume on 3D PBV and follow-up NECT (r = 0.798). Conclusion: In acute stroke patients, the combination of 3D PBV and multimodal CT (NECT, CTP, and CTA) can improve the detection rate of ischaemia and enable assessment of the full extent of ischaemia, which correlates well with follow-up NECT.

Tinnitus Multimodal Imaging

Science.gov (United States)

2016-12-01

those next steps, we can start to unravel how alterations in connectivity affect perceptual, attentional, and emotional aspects of tinnitus among...Coleman Memorial and Hearing Research, Inc, endowment funds. REFERENCES Ashburner, J. (2007). A fast diffeomorphic image registration algorithm. Neuroimage...Jiao, Y., et al. (2015). Tinnitus and hyperacusis involve hyperactivity and enhanced connectivity in auditory- limbic- arousal -cerebellar network

Real-time multimodal sensing in nano/bio environment

Science.gov (United States)

Song, Bo

As a sensing device in nano-scale, scanning probe microscopy (SPM) is a powerful tool for exploring nano world. Nevertheless two fundamental problems tackle the development and application of SPM based imaging and measurement: slow imaging/measurement speed and inaccuracy of motion or position control. Usually, SPM imaging/properties measuring speed is too slow to capture a dynamic observation on sample surface. In addition, Both SPM imaging and properties measurement always experience positioning inaccuracy problems caused by hysteresis and creep of the piezo scanner. This dissertation will try to solve these issues and proposed a SPM based real-time multimodal sensing system which can be used in nano/bio environment. First, a compressive sensing based video rate fast SPM imaging system is shown as an efficient method to dynamically capture the sample surface change with the imaging speed 1.5 frame/s with the scan size of 500 nm * 500 nm. Besides topography imaging, a new additional modal of SPM: vibration mode, will be introduced, and it is developed by us to investigate the subsurface mechanical properties of the elastic sample such as cells and bacteria. A followed up study of enzymatic hydrolysis will demonstrate the ability of in situ observation of single molecule event using video rate SPM. After that we will introduce another modal of this SPM sensing system: accurate electrical properties measurement. In this electrical properties measurement mode, a compressive feedbacks based non-vector space control approach is proposed in order to improve the accuracy of SPM based nanomanipulations. Instead of sensors, the local images are used as both the input and feedback of a non-vector space closed-loop controller. A followed up study will also be introduced to shown the important role of non-vector space control in the study of conductivity distribution of multi-wall carbon nanotubes. At the end of this dissertation, some future work will be also proposed to

Metawidgets in the multimodal interface

Energy Technology Data Exchange (ETDEWEB)

Blattner, M.M. (Lawrence Livermore National Lab., CA (United States) Anderson (M.D.) Cancer Center, Houston, TX (United States)); Glinert, E.P.; Jorge, J.A.; Ormsby, G.R. (Rensselaer Polytechnic Inst., Troy, NY (United States). Dept. of Computer Science)

1991-01-01

We analyze two intertwined and fundamental issues concerning computer-to-human communication in the multimodal interfaces: the interplay between sound and graphics, and the role of object persistence. Our observations lead us to introduce metawidgets as abstract entities capable of manifesting themselves to users as image, as sound, or as various combinations and/or sequences of the two media. We show examples of metawidgets in action, and discuss mechanisms for choosing among alternative media for metawidget instantiation. Finally, we describe a couple of experimental microworlds we have implemented to test out some of our ideas. 17 refs., 7 figs.

MO-DE-202-01: Image-Guided Focused Ultrasound Surgery and Therapy

Energy Technology Data Exchange (ETDEWEB)

Farahani, K. [National Cancer Institute (United States)

2016-06-15

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

MO-DE-202-01: Image-Guided Focused Ultrasound Surgery and Therapy

International Nuclear Information System (INIS)

Farahani, K.

2016-01-01

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

Single Photon Emission Computed Tomography/Positron Emission Tomography Imaging and Targeted Radionuclide Therapy of Melanoma: New Multimodal Fluorinated and Iodinated Radiotracers

International Nuclear Information System (INIS)

Maisonial, A.; Papon, J.; Bayle, M.; Vidal, A.; Auzeloux, Ph.; Rbah, L.; Bonnet-Duquennoy, M.; Miot-Noirault, E.; Galmier, M.J.; Borel, M.; Madelmont, J.C.; Moins, N.; Chezal, J.M.; Kuhnast, B.; Boisgard, R.; Dolle, F.; Tavitian, B.; Boisgard, R.; Tavitian, B.; Askienazy, S.

2011-01-01

This study reports a series of 14 new iodinated and fluorinated compounds offering both early imaging ( 123 I, 124 I, 18 F) and systemic treatment ( 131 I) of melanoma potentialities. The biodistribution of each 125 I-labeled tracer was evaluated in a model of melanoma B16F0-bearing mice, using in vivo serial γ scintigraphic imaging. Among this series, [ 125 I]56 emerged as the most promising compound in terms of specific tumoral uptake and in vivo kinetic profile. To validate our multimodality concept, the radiosynthesis of [ 18 F]56 was then optimized and this radiotracer has been successfully investigated for in vivo PET imaging of melanoma in B16F0- and B16F10-bearing mouse model. The therapeutic efficacy of [ 131 I]56 was then evaluated in mice bearing subcutaneous B16F0 melanoma, and a significant slow down in tumoral growth was demonstrated. These data support further development of 56 for PET imaging ( 18 F, 124 I) and targeted radionuclide therapy ( 131 I) of melanoma using a single chemical structure. (authors)

Tissue is more important than time: insights into acute ischemic stroke from modern brain imaging.

Science.gov (United States)

Bivard, Andrew; Parsons, Mark

2018-02-01

The clinical practice of acute ischemic stroke treatment has undergone a major change over the last 5 years, as multimodal imaging becomes more accessible, and evidence mounts that individualized treatment is possible. Multimodal imaging performed before treatment provides invaluable information to treating clinicians, which includes confirmation of the diagnosis, and provides guidance on the appropriateness and the likely outcome of intravenous or endovascular treatment for individual patients (and their families). However, often health systems struggle to keep pace with science; thus, a one-size fits all protocol-driven basic imaging approach is still the norm in many stroke centers. Comprehensive multimodal computed tomography (CT) (incorporating noncontrast CT, CT angiography, and perfusion CT) provides rapid, reliable information about stroke pathophysiology that cannot be provided by more limited imaging prior to treatment. Multimodal CT identifies treatment responders for both intravenous thrombolysis and endovascular therapy. Now we are in the era of thrombectomy, the use of multimodal imaging routinely to guide treatment can no longer be avoided. In light of the ground breaking thrombectomy trial results and previous studies validating the use of multimodal imaging, there is now a strong rationale for performing comprehensive multimodal CT assessments before treatment as a standard of care for all stroke patients.

Multimodality in organization studies

DEFF Research Database (Denmark)

Van Leeuwen, Theo

2017-01-01

This afterword reviews the chapters in this volume and reflects on the synergies between organization and management studies and multimodality studies that emerge from the volume. These include the combination of strong sociological theorizing and detailed multimodal analysis, a focus on material...

In situ 3D characterization of historical coatings and wood using multimodal nonlinear optical microscopy.

Science.gov (United States)

Latour, Gaël; Echard, Jean-Philippe; Didier, Marie; Schanne-Klein, Marie-Claire

2012-10-22

We demonstrate multimodal nonlinear optical imaging of historical artifacts by combining Second Harmonic Generation (SHG) and Two-Photon Excited Fluorescence (2PEF) microscopies. We first identify the nonlinear optical response of materials commonly encountered in coatings of cultural heritage artifacts by analyzing one- and multi-layered model samples. We observe 2PEF signals from cochineal lake and sandarac and show that pigments and varnish films can be discriminated by exploiting their different emission spectral ranges as in luminescence linear spectroscopy. We then demonstrate SHG imaging of a filler, plaster, composed of bassanite particles which exhibit a non centrosymmetric crystal structure. We also show that SHG/2PEF imaging enables the visualization of wood microstructure through typically 60 µm-thick coatings by revealing crystalline cellulose (SHG signal) and lignin (2PEF signal) in the wood cell walls. Finally, in situ multimodal nonlinear imaging is demonstrated in a historical violin. SHG/2PEF imaging thus appears as a promising non-destructive and contactless tool for in situ 3D investigation of historical coatings and more generally for wood characterization and coating analysis at micrometer scale.

PET/SPECT/CT multimodal imaging in a transgenic mouse model of breast cancer

Energy Technology Data Exchange (ETDEWEB)

Boisgard, R.; Alberini, J.L.; Jego, B.; Siquier, K.; Theze, B.; Guillermet, S.; Tavitian, B. [Service Hospitalier Frederic Joliot, Institut d' Imagerie BioMedicale, CEA, 91 - Orsay (France); Inserm, U803, 91 - Orsay (France)

2008-02-15

Background. - In the therapy monitoring of breast cancer, conventional imaging methods include ultrasound, mammography, CT and MRI, which are essentially based on tumor size modifications. However these modifications represent a late consequence of the biological response and fail to differentiate scar or necrotic tissue from residual viable tumoral tissue. Therefore, a current objective is to develop tools able to predict early response to treatment. Positron Emission Tomography (PET) and Single Photon Emission Computerized Tomography (SPECT) are imaging modalities able to provide extremely sensitive quantitative molecular data and are widely used in humans and animals. Results. - Mammary epithelial cells of female transgenic mice expressing the polyoma middle T onco-protein (Py M.T.), undergo four distinct stages of tumour progression, from pre malignant to malignant stages. Stages are identifiable in the mammary tissue and can lead to the development of distant metastases Longitudinal studies by dynamic whole body acquisitions by multimodal imaging including PET, SPECT and Computed Tomography (CT) allow following the tumoral evolution in Py M.T. mice in comparison with the histopathological analysis. At four weeks of age, mammary hyperplasia was identified by histopathology, but no abnormalities were found by palpation or detected by PET with 2-deoxy-2-[{sup 18}F]fluoro-D-glucose. Such as in some human mammary cancers, the sodium iodide sym-porter (N.I.S.) in tumoral mammary epithelial cells is expressed in this mouse model. In order to investigate the expression of N.I.S. in the Py M.T. mice mammary tumours, [{sup 99m}Tc]TcO{sub 4} imaging was performed with a dedicated SPECT/CT system camera (B.I.O.S.P.A.C.E. Gamma Imager/CT). Local uptake of [{sup 99m}Tc]TcO{sub 4} was detected as early as four weeks of age. The efficacy of chemotherapy was evaluated in this mouse model using a conventional regimen (Doxorubicine, 100 mg/ kg) administered weekly from nine to

Modality. Commitment, Truth Value and Reality Claims Across Modes in Multimodal Novels

DEFF Research Database (Denmark)

Nørgaard, Nina

2010-01-01

to the description and analysis of literary texts which – in addition to wording – make use of other semiotic modes such as typography, visual images, colour and layout for their meaning-making. The approach to multimodality deployed and examined is that proposed, for instance, by Kress and van Leeuwen (e.g. 1996...... to the analysis of two explicitly multimodal novels, with particular focus on the realisation of modality in visual images and typography. The texts put up for analysis are Alexander Masters’ Stuart. A Life Backwards and Jonathan Safran Foer’s Extremely Loud and Incredibly Close. While Kress and van Leeuwen...... of Masters’ and Foer’s sporadic use of special typography, in turn, reveals that although some of Kress and van Leeuwen’s modality parameters may be applicable to typography, the descriptive system is clearly less adequate in a typographic context where further work is needed before workable tools can...

The impact of fMRI on multimodal navigation in surgery of cerebral lesions: four years clinical experience

International Nuclear Information System (INIS)

Wurm, Gabriele; Schnizer, Mathilde; Fellner, Claudia

2008-01-01

Neuronavigation with display of intraoperative structures, instrument locations, orientation and relationships to nearby structures can increase anatomic precision while enhancing the surgeon's confidence and his/her perception of safety. Combination of neuronavigation with functional imaging provides multimodal guidance for surgery of cerebral lesions. We evaluated the impact of functional MRI (fMRI) on surgical decision making and outcome. A neuronavigational device (StealthStation (tm), Medtronic Inc.) was used as platform to merge fMRI data with anatomic images, and to implement intraoperative multimodal guidance. In a 52-month period, where 977 surgical procedures were performed with the aid of neuronavigation, 88 patients underwent image-guided procedures using multimodal guidance. Patient, surgical and outcome data of this series was prospectively collected. Evaluation of 88 procedures on cerebral lesions in complex regions where fMRI data were integrated using the navigation system demonstrated that the additional information was presented in a user-friendly way. Computer assisted fMRI integration was found to be especially helpful in planning the best approach, in assessing alternative approaches, and in defining the extent of the surgical exposure. Furthermore, the surgeons found it more effective to interpret fMRI information when shown in a navigation system as compared to the traditional display on a light board or monitor. Multimodal navigation enhanced by fMRI was judged useful for optimization of surgery of cerebral lesions, especially in and around eloquent regions by experienced neurosurgeons. (orig.)

Practical multimodal care for cancer cachexia.

Science.gov (United States)

Maddocks, Matthew; Hopkinson, Jane; Conibear, John; Reeves, Annie; Shaw, Clare; Fearon, Ken C H

2016-12-01

Cancer cachexia is common and reduces function, treatment tolerability and quality of life. Given its multifaceted pathophysiology a multimodal approach to cachexia management is advocated for, but can be difficult to realise in practice. We use a case-based approach to highlight practical approaches to the multimodal management of cachexia for patients across the cancer trajectory. Four cases with lung cancer spanning surgical resection, radical chemoradiotherapy, palliative chemotherapy and no anticancer treatment are presented. We propose multimodal care approaches that incorporate nutritional support, exercise, and anti-inflammatory agents, on a background of personalized oncology care and family-centred education. Collectively, the cases reveal that multimodal care is part of everyone's remit, often focuses on supported self-management, and demands buy-in from the patient and their family. Once operationalized, multimodal care approaches can be tested pragmatically, including alongside emerging pharmacological cachexia treatments. We demonstrate that multimodal care for cancer cachexia can be achieved using simple treatments and without a dedicated team of specialists. The sharing of advice between health professionals can help build collective confidence and expertise, moving towards a position in which every team member feels they can contribute towards multimodal care.

Label-free evaluation of hepatic microvesicular steatosis with multimodal coherent anti-Stokes Raman scattering microscopy.

Directory of Open Access Journals (Sweden)

Thuc T Le

Full Text Available Hepatic microvesicular steatosis is a hallmark of drug-induced hepatotoxicity and early-stage fatty liver disease. Current histopathology techniques are inadequate for the clinical evaluation of hepatic microvesicular steatosis. In this paper, we explore the use of multimodal coherent anti-Stokes Raman scattering (CARS microscopy for the detection and characterization of hepatic microvesicular steatosis. We show that CARS microscopy is more sensitive than Oil Red O histology for the detection of microvesicular steatosis. Computer-assisted analysis of liver lipid level based on CARS signal intensity is consistent with triglyceride measurement using a standard biochemical assay. Most importantly, in a single measurement procedure on unprocessed and unstained liver tissues, multimodal CARS imaging provides a wealth of critical information including the detection of microvesicular steatosis and quantitation of liver lipid content, number and size of lipid droplets, and lipid unsaturation and packing order of lipid droplets. Such information can only be assessed by multiple different methods on processed and stained liver tissues or tissue extracts using current standard analytical techniques. Multimodal CARS microscopy also permits label-free identification of lipid-rich non-parenchymal cells. In addition, label-free and non-perturbative CARS imaging allow rapid screening of mitochondrial toxins-induced microvesicular steatosis in primary hepatocyte cultures. With its sensitivity and versatility, multimodal CARS microscopy should be a powerful tool for the clinical evaluation of hepatic microvesicular steatosis.

Multidimensional and Multimodal Separations by HPTLC in Phytochemistry

Science.gov (United States)

Ciesla, Lukasz; Waksmundzka-Hajnos, Monika

HPTLC is one of the most widely applied methods in phytochemical analysis. It is due to its numerous advantages, e.g., it is the only chromatographic method offering the option of presenting the results as an image. Other advantages include simplicity, low costs, parallel analysis of samples, high sample capacity, rapidly obtained results, and possibility of multiple detection. HPTLC provides identification as well as quantitative results. It also enables the identification of adulterants. In case of complex samples, the resolving power of traditional one-dimensional chromatography is usually inadequate, hence special modes of development are required. Multidimensional and multimodal HPTLC techniques include those realized in one direction (UMD, IMD, GMD, BMD, AMD) as well as typical two-dimensional methods realized on mono- or bi-layers. In this manuscript, an overview on variable multidimensional and multimodal methods, applied in the analysis of phytochemical samples, is presented.

Advancing Cardiovascular, Neurovascular and Renal Magnetic Resonance Imaging in Small Rodents Using Cryogenic Radiofrequency Coil Technology

Directory of Open Access Journals (Sweden)

Thoralf eNiendorf

2015-11-01

Full Text Available Research in pathologies of the brain, heart and kidney have gained immensely from the plethora of studies that have helped shape new methods in magnetic resonance (MR for characterizing preclinical disease models. Methodical probing into preclinical animal models by MR is invaluable since it allows a careful interpretation and extrapolation of data derived from these models to human disease. In this review we will focus on the applications of cryogenic radiofrequency (RF coils in small animal MR as a means of boosting image quality (e.g. by supporting MR microscopy and making data acquisition more efficient (e.g. by reducing measuring time; both being important constituents for thorough investigational studies on animal models of disease. This review attempts to make the (biomedical imaging, molecular medicine and pharmaceutical communities aware of this productive ferment and its outstanding significance for anatomical and functional MR in small rodents. The goal is to inspire a more intense interdisciplinary collaboration across the fields to further advance and progress non-invasive MR methods that ultimately support thorough (pathophysiological characterization of animal disease models. In this review, current and potential future applications for the RF coil technology in cardiovascular, neurovascular and renal disease will be discussed.

Acute calcific tendinopathy of the popliteus tendon: a rare case diagnosed using a multimodality imaging approach and treated conservatively

Energy Technology Data Exchange (ETDEWEB)

Doucet, Cedric; Gotra, Akshat; Reddy, Santhosh Mauvva Venkatesh; Boily, Mathieu [McGill University, Royal Victoria Hospital, Department of Radiology, Montreal, QC (Canada)

2017-07-15

Acute calcific tendinopathy of the popliteus tendon is a rare medical entity associated with significant patient discomfort. We present the case of a previously healthy 48-year-old female who presented to the emergency department with acute onset of left knee pain. Initial radiographs revealed calcifications within the posterolateral compartment of the knee. Ultrasound imaging demonstrated a swollen and hypoechoic popliteus tendon with an increased color Doppler signal at the periphery of the tendon as well as calcification in the tendon and adjacent soft tissues. Subsequently performed MRI revealed a thickened and heterogeneous popliteus tendon near its femoral attachment with marked edematous changes surrounding the tendon. Local ultrasound-guided glucocorticoid injection had successful clinical results with no recurrence at 8-month follow-up. In this case report we review the literature for similar previously reported cases. This case report of popliteus tendon calcific tendinopathy provides comprehensive multimodality imaging findings and a description of its non-surgical management. (orig.)

Multimodal MRI for early diabetic mild cognitive impairment: study protocol of a prospective diagnostic trial

International Nuclear Information System (INIS)

Yu, Ying; Sun, Qian; Yan, Lin-Feng; Hu, Yu-Chuan; Nan, Hai-Yan; Yang, Yang; Liu, Zhi-Cheng; Wang, Wen; Cui, Guang-Bin

2016-01-01

Type 2 diabetes mellitus (T2DM) is a risk factor for dementia. Mild cognitive impairment (MCI), an intermediary state between normal cognition and dementia, often occurs during the prodromal diabetic stage, making early diagnosis and intervention of MCI very important. Latest neuroimaging techniques revealed some underlying microstructure alterations for diabetic MCI, from certain aspects. But there still lacks an integrated multimodal MRI system to detect early neuroimaging changes in diabetic MCI patients. Thus, we intended to conduct a diagnostic trial using multimodal MRI techniques to detect early diabetic MCI that is determined by the Montreal Cognitive Assessment (MoCA). In this study, healthy controls, prodromal diabetes and diabetes subjects (53 subjects/group) aged 40-60 years will be recruited from the physical examination center of Tangdu Hospital. The neuroimaging and psychometric measurements will be repeated at a 0.5 year-interval for 2.5 years’ follow-up. The primary outcome measures are 1) Microstructural and functional alterations revealed with multimodal MRI scans including structure magnetic resonance imaging (sMRI), resting state functional magnetic resonance imaging (rs-fMRI), diffusion kurtosis imaging (DKI), and three-dimensional pseudo-continuous arterial spin labeling (3D-pCASL); 2) Cognition evaluation with MoCA. The second outcome measures are obesity, metabolic characteristics, lifestyle and quality of life. The study will provide evidence for the potential use of multimodal MRI techniques with psychometric evaluation in diagnosing MCI at prodromal diabetic stage so as to help decision making in early intervention and improve the prognosis of T2DM. This study has been registered to ClinicalTrials.gov (NCT02420470) on April 2, 2015 and published on July 29, 2015

Investigation of Biophysical Mechanisms in Gold Nanoparticle Mediated Laser Manipulation of Cells Using a Multimodal Holographic and Fluorescence Imaging Setup

Science.gov (United States)

Rakoski, Mirko S.; Heinemann, Dag; Schomaker, Markus; Ripken, Tammo; Meyer, Heiko

2015-01-01

Laser based cell manipulation has proven to be a versatile tool in biomedical applications. In this context, combining weakly focused laser pulses and nanostructures, e.g. gold nanoparticles, promises to be useful for high throughput cell manipulation, such as transfection and photothermal therapy. Interactions between laser pulses and gold nanoparticles are well understood. However, it is still necessary to study cell behavior in gold nanoparticle mediated laser manipulation. While parameters like cell viability or perforation efficiency are commonly addressed, the influence of the manipulation process on other essential cell parameters is not sufficiently investigated yet. Thus, we set out to study four relevant cell properties: cell volume and area, ion exchange and cytoskeleton structure after gold nanoparticle based laser manipulation. For this, we designed a multimodal imaging and manipulation setup. 200 nm gold nanoparticles were attached unspecifically to canine cells and irradiated by weakly focused 850 ps laser pulses. Volume and area change in the first minute post laser manipulation was monitored using digital holography. Calcium imaging and cells expressing a marker for filamentous actin (F-actin) served to analyze the ion exchange and the cytoskeleton, respectively. High radiant exposures led to cells exhibiting a tendency to shrink in volume and area, possibly due to outflow of cytoplasm. An intracellular raise in calcium was observed and accompanied by an intercellular calcium wave. This multimodal approach enabled for the first time a comprehensive analysis of the cell behavior in gold nanoparticle mediated cell manipulation. Additionally, this work can pave the way for a better understanding and the evaluation of new applications in the context of cell transfection or photothermal therapy. PMID:25909631

Investigation of biophysical mechanisms in gold nanoparticle mediated laser manipulation of cells using a multimodal holographic and fluorescence imaging setup.

Directory of Open Access Journals (Sweden)

Stefan Kalies

Full Text Available Laser based cell manipulation has proven to be a versatile tool in biomedical applications. In this context, combining weakly focused laser pulses and nanostructures, e.g. gold nanoparticles, promises to be useful for high throughput cell manipulation, such as transfection and photothermal therapy. Interactions between laser pulses and gold nanoparticles are well understood. However, it is still necessary to study cell behavior in gold nanoparticle mediated laser manipulation. While parameters like cell viability or perforation efficiency are commonly addressed, the influence of the manipulation process on other essential cell parameters is not sufficiently investigated yet. Thus, we set out to study four relevant cell properties: cell volume and area, ion exchange and cytoskeleton structure after gold nanoparticle based laser manipulation. For this, we designed a multimodal imaging and manipulation setup. 200 nm gold nanoparticles were attached unspecifically to canine cells and irradiated by weakly focused 850 ps laser pulses. Volume and area change in the first minute post laser manipulation was monitored using digital holography. Calcium imaging and cells expressing a marker for filamentous actin (F-actin served to analyze the ion exchange and the cytoskeleton, respectively. High radiant exposures led to cells exhibiting a tendency to shrink in volume and area, possibly due to outflow of cytoplasm. An intracellular raise in calcium was observed and accompanied by an intercellular calcium wave. This multimodal approach enabled for the first time a comprehensive analysis of the cell behavior in gold nanoparticle mediated cell manipulation. Additionally, this work can pave the way for a better understanding and the evaluation of new applications in the context of cell transfection or photothermal therapy.

Semiautomated Multimodal Breast Image Registration

Directory of Open Access Journals (Sweden)

Charlotte Curtis

2012-01-01

However, due to the highly deformable nature of breast tissues, comparison of 3D and 2D modalities is a challenge. To enable this comparison, a registration technique was developed to map features from 2D mammograms to locations in the 3D image space. This technique was developed and tested using magnetic resonance (MR images as a reference 3D modality, as MR breast imaging is an established technique in clinical practice. The algorithm was validated using a numerical phantom then successfully tested on twenty-four image pairs. Dice's coefficient was used to measure the external goodness of fit, resulting in an excellent overall average of 0.94. Internal agreement was evaluated by examining internal features in consultation with a radiologist, and subjective assessment concludes that reasonable alignment was achieved.

Structure with improved self-imaging in its graded-index multimode interference region

International Nuclear Information System (INIS)

Yin Rui; Jiang Xiaoqing; Yang Jianyi; Wang Minghua

2002-01-01

Propagation constant errors (PCEs) of guided modes in regions of multimode interference in optical networks were analyzed. Results show that a graded-index waveguide can effectively decrease the PCEs. An example based on an exponential function is presented. Numerical results show that addition of a graded-index waveguide greatly improves device performance in this structure