Recent developments in multimodality fluorescence imaging probes

Directory of Open Access Journals (Sweden)

Jianhong Zhao

2018-05-01

Full Text Available Multimodality optical imaging probes have emerged as powerful tools that improve detection sensitivity and accuracy, important in disease diagnosis and treatment. In this review, we focus on recent developments of optical fluorescence imaging (OFI probe integration with other imaging modalities such as X-ray computed tomography (CT, magnetic resonance imaging (MRI, positron emission tomography (PET, single-photon emission computed tomography (SPECT, and photoacoustic imaging (PAI. The imaging technologies are briefly described in order to introduce the strengths and limitations of each techniques and the need for further multimodality optical imaging probe development. The emphasis of this account is placed on how design strategies are currently implemented to afford physicochemically and biologically compatible multimodality optical fluorescence imaging probes. We also present studies that overcame intrinsic disadvantages of each imaging technique by multimodality approach with improved detection sensitivity and accuracy. KEY WORDS: Optical imaging, Fluorescence, Multimodality, Near-infrared fluorescence, Nanoprobe, Computed tomography, Magnetic resonance imaging, Positron emission tomography, Single-photon emission computed tomography, Photoacoustic imaging

The development of nuclear medicine molecular imaging: An era of multiparametric imaging

International Nuclear Information System (INIS)

Zhu Yuyuan; Huang Gang

2010-01-01

Nuclear medical molecular imaging is developing toward a multimodality and multitracer future. Abundant complementary data generated from different tracers in different modalities are successfully serving the biological research and clinical treatment. Among the others, PER-MRI has the greatest potential and will be a research of interest in the near future. This article focused on the evolution history on nuclear medicine from single modality to multimodality, single tracer to multitracer. It also gave a brief summary to the identifications, differences, pros and consofmultimodality, multitracer, multiparametric molecular imaging. Issues, problems and challenges concerned with her development and recognition are also discussed. (authors)

Multimodal targeted high relaxivity thermosensitive liposome for in vivo imaging

Science.gov (United States)

Kuijten, Maayke M. P.; Hannah Degeling, M.; Chen, John W.; Wojtkiewicz, Gregory; Waterman, Peter; Weissleder, Ralph; Azzi, Jamil; Nicolay, Klaas; Tannous, Bakhos A.

2015-11-01

Liposomes are spherical, self-closed structures formed by lipid bilayers that can encapsulate drugs and/or imaging agents in their hydrophilic core or within their membrane moiety, making them suitable delivery vehicles. We have synthesized a new liposome containing gadolinium-DOTA lipid bilayer, as a targeting multimodal molecular imaging agent for magnetic resonance and optical imaging. We showed that this liposome has a much higher molar relaxivities r1 and r2 compared to a more conventional liposome containing gadolinium-DTPA-BSA lipid. By incorporating both gadolinium and rhodamine in the lipid bilayer as well as biotin on its surface, we used this agent for multimodal imaging and targeting of tumors through the strong biotin-streptavidin interaction. Since this new liposome is thermosensitive, it can be used for ultrasound-mediated drug delivery at specific sites, such as tumors, and can be guided by magnetic resonance imaging.

Multimodal imaging of bone metastases: From preclinical to clinical applications

Directory of Open Access Journals (Sweden)

Stephan Ellmann

2015-10-01

Full Text Available Metastases to the skeletal system are commonly observed in cancer patients, highly affecting the patients' quality of life. Imaging plays a major role in detection, follow-up, and molecular characterisation of metastatic disease. Thus, imaging techniques have been optimised and combined in a multimodal and multiparametric manner for assessment of complementary aspects in osseous metastases. This review summarises both application of the most relevant imaging techniques for bone metastasis in preclinical models and the clinical setting.

Gold Nanoconstructs for Multimodal Diagnostic Imaging and Photothermal Cancer Therapy

Science.gov (United States)

Coughlin, Andrew James

Cancer accounts for nearly 1 out of every 4 deaths in the United States, and because conventional treatments are limited by morbidity and off-target toxicities, improvements in cancer management are needed. This thesis further develops nanoparticle-assisted photothermal therapy (NAPT) as a viable treatment option for cancer patients. NAPT enables localized ablation of disease because heat generation only occurs where tissue permissive near-infrared (NIR) light and absorbing nanoparticles are combined, leaving surrounding normal tissue unharmed. Two principle approaches were investigated to improve the specificity of this technique: multimodal imaging and molecular targeting. Multimodal imaging affords the ability to guide NIR laser application for site-specific NAPT and more holistic characterization of disease by combining the advantages of several diagnostic technologies. Towards the goal of image-guided NAPT, gadolinium-conjugated gold-silica nanoshells were engineered and demonstrated to enhance imaging contrast across a range of diagnostic modes, including T1-weighted magnetic resonance imaging, X-Ray, optical coherence tomography, reflective confocal microscopy, and two-photon luminescence in vitro as well as within an animal tumor model. Additionally, the nanoparticle conjugates were shown to effectively convert NIR light to heat for applications in photothermal therapy. Therefore, the broad utility of gadolinium-nanoshells for anatomic localization of tissue lesions, molecular characterization of malignancy, and mediators of ablation was established. Molecular targeting strategies may also improve NAPT by promoting nanoparticle uptake and retention within tumors and enhancing specificity when malignant and normal tissue interdigitate. Here, ephrinA1 protein ligands were conjugated to nanoshell surfaces for particle homing to overexpressed EphA2 receptors on prostate cancer cells. In vitro, successful targeting and subsequent photothermal ablation of

Advanced Contrast Agents for Multimodal Biomedical Imaging Based on Nanotechnology.

Science.gov (United States)

Calle, Daniel; Ballesteros, Paloma; Cerdán, Sebastián

2018-01-01

Clinical imaging modalities have reached a prominent role in medical diagnosis and patient management in the last decades. Different image methodologies as Positron Emission Tomography, Single Photon Emission Tomography, X-Rays, or Magnetic Resonance Imaging are in continuous evolution to satisfy the increasing demands of current medical diagnosis. Progress in these methodologies has been favored by the parallel development of increasingly more powerful contrast agents. These are molecules that enhance the intrinsic contrast of the images in the tissues where they accumulate, revealing noninvasively the presence of characteristic molecular targets or differential physiopathological microenvironments. The contrast agent field is currently moving to improve the performance of these molecules by incorporating the advantages that modern nanotechnology offers. These include, mainly, the possibilities to combine imaging and therapeutic capabilities over the same theranostic platform or improve the targeting efficiency in vivo by molecular engineering of the nanostructures. In this review, we provide an introduction to multimodal imaging methods in biomedicine, the sub-nanometric imaging agents previously used and the development of advanced multimodal and theranostic imaging agents based in nanotechnology. We conclude providing some illustrative examples from our own laboratories, including recent progress in theranostic formulations of magnetoliposomes containing ω-3 poly-unsaturated fatty acids to treat inflammatory diseases, or the use of stealth liposomes engineered with a pH-sensitive nanovalve to release their cargo specifically in the acidic extracellular pH microenvironment of tumors.

Acoustic multimode interference and self-imaging phenomena realized in multimodal phononic crystal waveguides

International Nuclear Information System (INIS)

Zou, Qiushun; Yu, Tianbao; Liu, Jiangtao; Wang, Tongbiao; Liao, Qinghua; Liu, Nianhua

2015-01-01

We report an acoustic multimode interference effect and self-imaging phenomena in an acoustic multimode waveguide system which consists of M parallel phononic crystal waveguides (M-PnCWs). Results show that the self-imaging principle remains applicable for acoustic waveguides just as it does for optical multimode waveguides. To achieve the dispersions and replicas of the input acoustic waves produced along the propagation direction, we performed the finite element method on M-PnCWs, which support M guided modes within the target frequency range. The simulation results show that single images (including direct and mirrored images) and N-fold images (N is an integer) are identified along the propagation direction with asymmetric and symmetric incidence discussed separately. The simulated positions of the replicas agree well with the calculated values that are theoretically decided by self-imaging conditions based on the guided mode propagation analysis. Moreover, the potential applications based on this self-imaging effect for acoustic wavelength de-multiplexing and beam splitting in the acoustic field are also presented. (paper)

PET-MRI and multimodal cancer imaging

International Nuclear Information System (INIS)

Wang Taisong; Zhao Jinhua; Song Jianhua

2011-01-01

Multimodality imaging, specifically PET-CT, brought a new perspective into the fields of clinical imaging. Clinical cases have shown that PET-CT has great value in clinical diagnosis and experimental research. But PET-CT still bears some limitations. A major drawback is that CT provides only limited soft tissue contrast and exposes the patient to a significant radiation dose. MRI overcome these limitations, it has excellent soft tissue contrast, high temporal and spatial resolution and no radiation damage. Additionally, since MRI provides also functional information, PET-MRI will show a new direction of multimodality imaging in the future. (authors)

Multimodality imaging of pulmonary infarction

International Nuclear Information System (INIS)

Bray, T.J.P.; Mortensen, K.H.; Gopalan, D.

2014-01-01

Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis

Multimodality imaging of pulmonary infarction

Energy Technology Data Exchange (ETDEWEB)

Bray, T.J.P., E-mail: timothyjpbray@gmail.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); Mortensen, K.H., E-mail: mortensen@doctors.org.uk [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); University Department of Radiology, Addenbrookes Hospital, Cambridge University Hospitals NHS Foundation Trust, Hills Road, Box 318, Cambridge CB2 0QQ (United Kingdom); Gopalan, D., E-mail: deepa.gopalan@btopenworld.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom)

2014-12-15

Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis.

Multimodal quantitative phase and fluorescence imaging of cell apoptosis

Science.gov (United States)

Fu, Xinye; Zuo, Chao; Yan, Hao

2017-06-01

Fluorescence microscopy, utilizing fluorescence labeling, has the capability to observe intercellular changes which transmitted and reflected light microscopy techniques cannot resolve. However, the parts without fluorescence labeling are not imaged. Hence, the processes simultaneously happen in these parts cannot be revealed. Meanwhile, fluorescence imaging is 2D imaging where information in the depth is missing. Therefore the information in labeling parts is also not complete. On the other hand, quantitative phase imaging is capable to image cells in 3D in real time through phase calculation. However, its resolution is limited by the optical diffraction and cannot observe intercellular changes below 200 nanometers. In this work, fluorescence imaging and quantitative phase imaging are combined to build a multimodal imaging system. Such system has the capability to simultaneously observe the detailed intercellular phenomenon and 3D cell morphology. In this study the proposed multimodal imaging system is used to observe the cell behavior in the cell apoptosis. The aim is to highlight the limitations of fluorescence microscopy and to point out the advantages of multimodal quantitative phase and fluorescence imaging. The proposed multimodal quantitative phase imaging could be further applied in cell related biomedical research, such as tumor.

UPAR targeted molecular imaging of cancers with small molecule-based probes.

Science.gov (United States)

Ding, Feng; Chen, Seng; Zhang, Wanshu; Tu, Yufeng; Sun, Yao

2017-10-15

Molecular imaging can allow the non-invasive characterization and measurement of biological and biochemical processes at the molecular and cellular levels in living subjects. The imaging of specific molecular targets that are associated with cancers could allow for the earlier diagnosis and better treatment of diseases. Small molecule-based probes play prominent roles in biomedical research and have high clinical translation ability. Here, with an emphasis on small molecule-based probes, we review some recent developments in biomarkers, imaging techniques and multimodal imaging in molecular imaging and highlight the successful applications for molecular imaging of cancers. Copyright © 2017 Elsevier Ltd. All rights reserved.

Drusen Characterization with Multimodal Imaging

Science.gov (United States)

Spaide, Richard F.; Curcio, Christine A.

2010-01-01

Summary Multimodal imaging findings and histological demonstration of soft drusen, cuticular drusen, and subretinal drusenoid deposits provided information used to develop a model explaining their imaging characteristics. Purpose To characterize the known appearance of cuticular drusen, subretinal drusenoid deposits (reticular pseudodrusen), and soft drusen as revealed by multimodal fundus imaging; to create an explanatory model that accounts for these observations. Methods Reported color, fluorescein angiographic, autofluorescence, and spectral domain optical coherence tomography (SD-OCT) images of patients with cuticular drusen, soft drusen, and subretinal drusenoid deposits were reviewed, as were actual images from affected eyes. Representative histological sections were examined. The geometry, location, and imaging characteristics of these lesions were evaluated. A hypothesis based on the Beer-Lambert Law of light absorption was generated to fit these observations. Results Cuticular drusen appear as numerous uniform round yellow-white punctate accumulations under the retinal pigment epithelium (RPE). Soft drusen are larger yellow-white dome-shaped mounds of deposit under the RPE. Subretinal drusenoid deposits are polymorphous light-grey interconnected accumulations above the RPE. Based on the model, both cuticular and soft drusen appear yellow due to the removal of shorter wavelength light by a double pass through the RPE. Subretinal drusenoid deposits, which are located on the RPE, are not subjected to short wavelength attenuation and therefore are more prominent when viewed with blue light. The location and morphology of extracellular material in relationship to the RPE, and associated changes to RPE morphology and pigmentation, appeared to be primary determinants of druse appearance in different imaging modalities. Conclusion Although cuticular drusen, subretinal drusenoid deposits, and soft drusen are composed of common components, they are distinguishable

Multimodality imaging of the postoperative shoulder

Energy Technology Data Exchange (ETDEWEB)

Woertler, Klaus [Technische Universitaet Muenchen, Department of Radiology, Munich (Germany)

2007-12-15

Multimodality imaging of the postoperative shoulder includes radiography, magnetic resonance (MR) imaging, MR arthrography, computed tomography (CT), CT arthrography, and ultrasound. Target-oriented evaluation of the postoperative shoulder necessitates familiarity with surgical techniques, their typical complications and sources of failure, knowledge of normal and abnormal postoperative findings, awareness of the advantages and weaknesses with the different radiologic techniques, and clinical information on current symptoms and function. This article reviews the most commonly used surgical procedures for treatment of anterior glenohumeral instability, lesions of the labral-bicipital complex, subacromial impingement, and rotator cuff lesions and highlights the significance of imaging findings with a view to detection of recurrent lesions and postoperative complications in a multimodality approach. (orig.)

Molecular imaging: current status and emerging strategies

International Nuclear Information System (INIS)

Pysz, M.A.; Gambhir, S.S.; Willmann, J.K.

2010-01-01

In vivo molecular imaging has a great potential to impact medicine by detecting diseases in early stages (screening), identifying extent of disease, selecting disease- and patient-specific treatment (personalized medicine), applying a directed or targeted therapy, and measuring molecular-specific effects of treatment. Current clinical molecular imaging approaches primarily use positron-emission tomography (PET) or single photon-emission computed tomography (SPECT)-based techniques. In ongoing preclinical research, novel molecular targets of different diseases are identified and, sophisticated and multifunctional contrast agents for imaging these molecular targets are developed along with new technologies and instrumentation for multi-modality molecular imaging. Contrast-enhanced molecular ultrasound (US) with molecularly-targeted contrast microbubbles is explored as a clinically translatable molecular imaging strategy for screening, diagnosing, and monitoring diseases at the molecular level. Optical imaging with fluorescent molecular probes and US imaging with molecularly-targeted microbubbles are attractive strategies as they provide real-time imaging, are relatively inexpensive, produce images with high spatial resolution, and do not involve exposure to ionizing irradiation. Raman spectroscopy/microscopy has emerged as a molecular optical imaging strategy for ultrasensitive detection of multiple biomolecules/biochemicals with both in vivo and ex vivo versatility. Photoacoustic imaging is a hybrid of optical and US techniques involving optically-excitable molecularly-targeted contrast agents and quantitative detection of resulting oscillatory contrast agent movement with US. Current preclinical findings and advances in instrumentation, such as endoscopes and microcatheters, suggest that these molecular imaging methods have numerous potential clinical applications and will be translated into clinical use in the near future.

[Multimodal medical image registration using cubic spline interpolation method].

Science.gov (United States)

He, Yuanlie; Tian, Lianfang; Chen, Ping; Wang, Lifei; Ye, Guangchun; Mao, Zongyuan

2007-12-01

Based on the characteristic of the PET-CT multimodal image series, a novel image registration and fusion method is proposed, in which the cubic spline interpolation method is applied to realize the interpolation of PET-CT image series, then registration is carried out by using mutual information algorithm and finally the improved principal component analysis method is used for the fusion of PET-CT multimodal images to enhance the visual effect of PET image, thus satisfied registration and fusion results are obtained. The cubic spline interpolation method is used for reconstruction to restore the missed information between image slices, which can compensate for the shortage of previous registration methods, improve the accuracy of the registration, and make the fused multimodal images more similar to the real image. Finally, the cubic spline interpolation method has been successfully applied in developing 3D-CRT (3D Conformal Radiation Therapy) system.

Simultaneous in vivo imaging of melanin and lipofuscin in the retina with multimodal photoacoustic ophthalmoscopy

Science.gov (United States)

Zhang, Xiangyang; Zhang, Hao F.; Zhou, Lixiang; Jiao, Shuliang

2012-02-01

We combined photoacoustic ophthalmoscopy (PAOM) with autofluorescence imaging for simultaneous in vivo imaging of dual molecular contrasts in the retina using a single light source. The dual molecular contrasts come from melanin and lipofuscin in the retinal pigment epithelium (RPE). Melanin and lipofuscin are two types of pigments and are believed to play opposite roles (protective vs. exacerbate) in the RPE in the aging process. We successfully imaged the retina of pigmented and albino rats at different ages. The experimental results showed that multimodal PAOM system can be a potentially powerful tool in the study of age-related degenerative retinal diseases.

Multimodality image registration with software: state-of-the-art

International Nuclear Information System (INIS)

Slomka, Piotr J.; Baum, Richard P.

2009-01-01

Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

An atlas-based multimodal registration method for 2D images with discrepancy structures.

Science.gov (United States)

Lv, Wenchao; Chen, Houjin; Peng, Yahui; Li, Yanfeng; Li, Jupeng

2018-06-04

An atlas-based multimodal registration method for 2-dimension images with discrepancy structures was proposed in this paper. Atlas was utilized for complementing the discrepancy structure information in multimodal medical images. The scheme includes three steps: floating image to atlas registration, atlas to reference image registration, and field-based deformation. To evaluate the performance, a frame model, a brain model, and clinical images were employed in registration experiments. We measured the registration performance by the squared sum of intensity differences. Results indicate that this method is robust and performs better than the direct registration for multimodal images with discrepancy structures. We conclude that the proposed method is suitable for multimodal images with discrepancy structures. Graphical Abstract An Atlas-based multimodal registration method schematic diagram.

Cardiac imaging. A multimodality approach

International Nuclear Information System (INIS)

Thelen, Manfred; Erbel, Raimund; Kreitner, Karl-Friedrich; Barkhausen, Joerg

2009-01-01

An excellent atlas on modern diagnostic imaging of the heart Written by an interdisciplinary team of experts, Cardiac Imaging: A Multimodality Approach features an in-depth introduction to all current imaging modalities for the diagnostic assessment of the heart as well as a clinical overview of cardiac diseases and main indications for cardiac imaging. With a particular emphasis on CT and MRI, the first part of the atlas also covers conventional radiography, echocardiography, angiography and nuclear medicine imaging. Leading specialists demonstrate the latest advances in the field, and compare the strengths and weaknesses of each modality. The book's second part features clinical chapters on heart defects, endocarditis, coronary heart disease, cardiomyopathies, myocarditis, cardiac tumors, pericardial diseases, pulmonary vascular diseases, and diseases of the thoracic aorta. The authors address anatomy, pathophysiology, and clinical features, and evaluate the various diagnostic options. Key features: - Highly regarded experts in cardiology and radiology off er image-based teaching of the latest techniques - Readers learn how to decide which modality to use for which indication - Visually highlighted tables and essential points allow for easy navigation through the text - More than 600 outstanding images show up-to-date technology and current imaging protocols Cardiac Imaging: A Multimodality Approach is a must-have desk reference for cardiologists and radiologists in practice, as well as a study guide for residents in both fields. It will also appeal to cardiac surgeons, general practitioners, and medical physicists with a special interest in imaging of the heart. (orig.)

vECTlab-A fully integrated multi-modality Monte Carlo simulation framework for the radiological imaging sciences

International Nuclear Information System (INIS)

Peter, Joerg; Semmler, Wolfhard

2007-01-01

Alongside and in part motivated by recent advances in molecular diagnostics, the development of dual-modality instruments for patient and dedicated small animal imaging has gained attention by diverse research groups. The desire for such systems is high not only to link molecular or functional information with the anatomical structures, but also for detecting multiple molecular events simultaneously at shorter total acquisition times. While PET and SPECT have been integrated successfully with X-ray CT, the advance of optical imaging approaches (OT) and the integration thereof into existing modalities carry a high application potential, particularly for imaging small animals. A multi-modality Monte Carlo (MC) simulation approach at present has been developed that is able to trace high-energy (keV) as well as optical (eV) photons concurrently within identical phantom representation models. We show that the involved two approaches for ray-tracing keV and eV photons can be integrated into a unique simulation framework which enables both photon classes to be propagated through various geometry models representing both phantoms and scanners. The main advantage of such integrated framework for our specific application is the investigation of novel tomographic multi-modality instrumentation intended for in vivo small animal imaging through time-resolved MC simulation upon identical phantom geometries. Design examples are provided for recently proposed SPECT-OT and PET-OT imaging systems

Multimodality image registration with software: state-of-the-art

Energy Technology Data Exchange (ETDEWEB)

Slomka, Piotr J. [Cedars-Sinai Medical Center, AIM Program/Department of Imaging, Los Angeles, CA (United States); University of California, David Geffen School of Medicine, Los Angeles, CA (United States); Baum, Richard P. [Center for PET, Department of Nuclear Medicine, Bad Berka (Germany)

2009-03-15

Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

Discrimination of skin diseases using the multimodal imaging approach

Science.gov (United States)

Vogler, N.; Heuke, S.; Akimov, D.; Latka, I.; Kluschke, F.; Röwert-Huber, H.-J.; Lademann, J.; Dietzek, B.; Popp, J.

2012-06-01

Optical microspectroscopic tools reveal great potential for dermatologic diagnostics in the clinical day-to-day routine. To enhance the diagnostic value of individual nonlinear optical imaging modalities such as coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG) or two-photon excited fluorescence (TPF), the approach of multimodal imaging has recently been developed. Here, we present an application of nonlinear optical multimodal imaging with Raman-scattering microscopy to study sizable human-tissue cross-sections. The samples investigated contain both healthy tissue and various skin tumors. This contribution details the rich information content, which can be obtained from the multimodal approach: While CARS microscopy, which - in contrast to spontaneous Raman-scattering microscopy - is not hampered by single-photon excited fluorescence, is used to monitor the lipid and protein distribution in the samples, SHG imaging selectively highlights the distribution of collagen structures within the tissue. This is due to the fact, that SHG is only generated in structures which lack inversion geometry. Finally, TPF reveals the distribution of autofluorophores in tissue. The combination of these techniques, i.e. multimodal imaging, allows for recording chemical images of large area samples and is - as this contribution will highlight - of high clinically diagnostic value.

Quantitative multimodality imaging in cancer research and therapy.

Science.gov (United States)

Yankeelov, Thomas E; Abramson, Richard G; Quarles, C Chad

2014-11-01

Advances in hardware and software have enabled the realization of clinically feasible, quantitative multimodality imaging of tissue pathophysiology. Earlier efforts relating to multimodality imaging of cancer have focused on the integration of anatomical and functional characteristics, such as PET-CT and single-photon emission CT (SPECT-CT), whereas more-recent advances and applications have involved the integration of multiple quantitative, functional measurements (for example, multiple PET tracers, varied MRI contrast mechanisms, and PET-MRI), thereby providing a more-comprehensive characterization of the tumour phenotype. The enormous amount of complementary quantitative data generated by such studies is beginning to offer unique insights into opportunities to optimize care for individual patients. Although important technical optimization and improved biological interpretation of multimodality imaging findings are needed, this approach can already be applied informatively in clinical trials of cancer therapeutics using existing tools. These concepts are discussed herein.

Multispectral analysis of multimodal images

Energy Technology Data Exchange (ETDEWEB)

Kvinnsland, Yngve; Brekke, Njaal (Dept. of Surgical Sciences, Univ. of Bergen, Bergen (Norway)); Taxt, Torfinn M.; Gruener, Renate (Dept. of Biomedicine, Univ. of Bergen, Bergen (Norway))

2009-02-15

An increasing number of multimodal images represent a valuable increase in available image information, but at the same time it complicates the extraction of diagnostic information across the images. Multispectral analysis (MSA) has the potential to simplify this problem substantially as unlimited number of images can be combined, and tissue properties across the images can be extracted automatically. Materials and methods. We have developed a software solution for MSA containing two algorithms for unsupervised classification, an EM-algorithm finding multinormal class descriptions and the k-means clustering algorithm, and two for supervised classification, a Bayesian classifier using multinormal class descriptions and a kNN-algorithm. The software has an efficient user interface for the creation and manipulation of class descriptions, and it has proper tools for displaying the results. Results. The software has been tested on different sets of images. One application is to segment cross-sectional images of brain tissue (T1- and T2-weighted MR images) into its main normal tissues and brain tumors. Another interesting set of images are the perfusion maps and diffusion maps, derived images from raw MR images. The software returns segmentation that seem to be sensible. Discussion. The MSA software appears to be a valuable tool for image analysis with multimodal images at hand. It readily gives a segmentation of image volumes that visually seems to be sensible. However, to really learn how to use MSA, it will be necessary to gain more insight into what tissues the different segments contain, and the upcoming work will therefore be focused on examining the tissues through for example histological sections.

Cardiac imaging. A multimodality approach

Energy Technology Data Exchange (ETDEWEB)

Thelen, Manfred [Johannes Gutenberg University Hospital, Mainz (Germany); Erbel, Raimund [University Hospital Essen (Germany). Dept. of Cardiology; Kreitner, Karl-Friedrich [Johannes Gutenberg University Hospital, Mainz (Germany). Clinic and Polyclinic for Diagnostic and Interventional Radiology; Barkhausen, Joerg (eds.) [University Hospital Schleswig-Holstein, Luebeck (Germany). Dept. of Radiology and Nuclear Medicine

2009-07-01

An excellent atlas on modern diagnostic imaging of the heart Written by an interdisciplinary team of experts, Cardiac Imaging: A Multimodality Approach features an in-depth introduction to all current imaging modalities for the diagnostic assessment of the heart as well as a clinical overview of cardiac diseases and main indications for cardiac imaging. With a particular emphasis on CT and MRI, the first part of the atlas also covers conventional radiography, echocardiography, angiography and nuclear medicine imaging. Leading specialists demonstrate the latest advances in the field, and compare the strengths and weaknesses of each modality. The book's second part features clinical chapters on heart defects, endocarditis, coronary heart disease, cardiomyopathies, myocarditis, cardiac tumors, pericardial diseases, pulmonary vascular diseases, and diseases of the thoracic aorta. The authors address anatomy, pathophysiology, and clinical features, and evaluate the various diagnostic options. Key features: - Highly regarded experts in cardiology and radiology off er image-based teaching of the latest techniques - Readers learn how to decide which modality to use for which indication - Visually highlighted tables and essential points allow for easy navigation through the text - More than 600 outstanding images show up-to-date technology and current imaging protocols Cardiac Imaging: A Multimodality Approach is a must-have desk reference for cardiologists and radiologists in practice, as well as a study guide for residents in both fields. It will also appeal to cardiac surgeons, general practitioners, and medical physicists with a special interest in imaging of the heart. (orig.)

Progress in Molecular Imaging in Endoscopy and Endomicroscopy for Cancer Imaging

Directory of Open Access Journals (Sweden)

Supang Khondee

2013-01-01

Full Text Available Imaging is an essential tool for effective cancer management. Endoscopes are important medical instruments for performing in vivo imaging in hollow organs. Early detection of cancer can be achieved with surveillance using endoscopy, and has been shown to reduce mortality and to improve outcomes. Recently, great advancements have been made in endoscopic instruments, including new developments in optical designs, light sources, optical fibers, miniature scanners, and multimodal systems, allowing for improved resolution, greater tissue penetration, and multispectral imaging. In addition, progress has been made in the development of highly-specific optical probes, allowing for improved specificity for molecular targets. Integration of these new endoscopic instruments with molecular probes provides a unique opportunity for significantly improving patient outcomes and has potential to further improve early detection, image guided therapy, targeted therapy, and personalized medicine. This work summarizes current and evolving endoscopic technologies, and provides an overview of various promising optical molecular probes.

A Multimodal Search Engine for Medical Imaging Studies.

Science.gov (United States)

Pinho, Eduardo; Godinho, Tiago; Valente, Frederico; Costa, Carlos

2017-02-01

The use of digital medical imaging systems in healthcare institutions has increased significantly, and the large amounts of data in these systems have led to the conception of powerful support tools: recent studies on content-based image retrieval (CBIR) and multimodal information retrieval in the field hold great potential in decision support, as well as for addressing multiple challenges in healthcare systems, such as computer-aided diagnosis (CAD). However, the subject is still under heavy research, and very few solutions have become part of Picture Archiving and Communication Systems (PACS) in hospitals and clinics. This paper proposes an extensible platform for multimodal medical image retrieval, integrated in an open-source PACS software with profile-based CBIR capabilities. In this article, we detail a technical approach to the problem by describing its main architecture and each sub-component, as well as the available web interfaces and the multimodal query techniques applied. Finally, we assess our implementation of the engine with computational performance benchmarks.

Clinical applications of perfluorocarbon nanoparticles for molecular imaging and targeted therapeutics.

Science.gov (United States)

Tran, Trung D; Caruthers, Shelton D; Hughes, Michael; Marsh, John N; Cyrus, Tillmann; Winter, Patrick M; Neubauer, Anne M; Wickline, Samuel A; Lanza, Gregory M

2007-01-01

Molecular imaging is a novel tool that has allowed non-invasive diagnostic imaging to transition from gross anatomical description to identification of specific tissue epitopes and observation of biological processes at the cellular level. This technique has been confined to the field of nuclear imaging; however, recent advances in nanotechnology have extended this research to include ultrasound (US) and magnetic resonance (MR) imaging. The exploitation of nanotechnology for MR and US molecular imaging has generated several candidate contrast agents. One multimodality platform, targeted perfluorocarbon (PFC) nanoparticles, is useful for noninvasive detection with US and MR, targeted drug delivery, and quantification.

Enhanced EDX images by fusion of multimodal SEM images using pansharpening techniques.

Science.gov (United States)

Franchi, G; Angulo, J; Moreaud, M; Sorbier, L

2018-01-01

The goal of this paper is to explore the potential interest of image fusion in the context of multimodal scanning electron microscope (SEM) imaging. In particular, we aim at merging the backscattered electron images that usually have a high spatial resolution but do not provide enough discriminative information to physically classify the nature of the sample, with energy-dispersive X-ray spectroscopy (EDX) images that have discriminative information but a lower spatial resolution. The produced images are named enhanced EDX. To achieve this goal, we have compared the results obtained with classical pansharpening techniques for image fusion with an original approach tailored for multimodal SEM fusion of information. Quantitative assessment is obtained by means of two SEM images and a simulated dataset produced by a software based on PENELOPE. © 2017 The Authors Journal of Microscopy © 2017 Royal Microscopical Society.

Registration of deformed multimodality medical images

International Nuclear Information System (INIS)

Moshfeghi, M.; Naidich, D.

1989-01-01

The registration and combination of images from different modalities have several potential applications, such as functional and anatomic studies, 3D radiation treatment planning, surgical planning, and retrospective studies. Image registration algorithms should correct for any local deformations caused by respiration, heart beat, imaging device distortions, and so forth. This paper reports on an elastic matching technique for registering deformed multimodality images. Correspondences between contours in the two images are used to stretch the deformed image toward its goal image. This process is repeated a number of times, with decreasing image stiffness. As the iterations continue, the stretched image better approximates its goal image

Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking.

Science.gov (United States)

Yu, Jun; Yang, Xiaokang; Gao, Fei; Tao, Dacheng

2017-12-01

How do we retrieve images accurately? Also, how do we rank a group of images precisely and efficiently for specific queries? These problems are critical for researchers and engineers to generate a novel image searching engine. First, it is important to obtain an appropriate description that effectively represent the images. In this paper, multimodal features are considered for describing images. The images unique properties are reflected by visual features, which are correlated to each other. However, semantic gaps always exist between images visual features and semantics. Therefore, we utilize click feature to reduce the semantic gap. The second key issue is learning an appropriate distance metric to combine these multimodal features. This paper develops a novel deep multimodal distance metric learning (Deep-MDML) method. A structured ranking model is adopted to utilize both visual and click features in distance metric learning (DML). Specifically, images and their related ranking results are first collected to form the training set. Multimodal features, including click and visual features, are collected with these images. Next, a group of autoencoders is applied to obtain initially a distance metric in different visual spaces, and an MDML method is used to assign optimal weights for different modalities. Next, we conduct alternating optimization to train the ranking model, which is used for the ranking of new queries with click features. Compared with existing image ranking methods, the proposed method adopts a new ranking model to use multimodal features, including click features and visual features in DML. We operated experiments to analyze the proposed Deep-MDML in two benchmark data sets, and the results validate the effects of the method.

Prussian blue nanocubes: multi-functional nanoparticles for multimodal imaging and image-guided therapy (Conference Presentation)

Science.gov (United States)

Cook, Jason R.; Dumani, Diego S.; Kubelick, Kelsey P.; Luci, Jeffrey; Emelianov, Stanislav Y.

2017-03-01

Imaging modalities utilize contrast agents to improve morphological visualization and to assess functional and molecular/cellular information. Here we present a new type of nanometer scale multi-functional particle that can be used for multi-modal imaging and therapeutic applications. Specifically, we synthesized monodisperse 20 nm Prussian Blue Nanocubes (PBNCs) with desired optical absorption in the near-infrared region and superparamagnetic properties. PBNCs showed excellent contrast in photoacoustic (700 nm wavelength) and MR (3T) imaging. Furthermore, photostability was assessed by exposing the PBNCs to nearly 1,000 laser pulses (5 ns pulse width) with up to 30 mJ/cm2 laser fluences. The PBNCs exhibited insignificant changes in photoacoustic signal, demonstrating enhanced robustness compared to the commonly used gold nanorods (substantial photodegradation with fluences greater than 5 mJ/cm2). Furthermore, the PBNCs exhibited superparamagnetism with a magnetic saturation of 105 emu/g, a 5x improvement over superparamagnetic iron-oxide (SPIO) nanoparticles. PBNCs exhibited enhanced T2 contrast measured using 3T clinical MRI. Because of the excellent optical absorption and magnetism, PBNCs have potential uses in other imaging modalities including optical tomography, microscopy, magneto-motive OCT/ultrasound, etc. In addition to multi-modal imaging, the PBNCs are multi-functional and, for example, can be used to enhance magnetic delivery and as therapeutic agents. Our initial studies show that stem cells can be labeled with PBNCs to perform image-guided magnetic delivery. Overall, PBNCs can act as imaging/therapeutic agents in diverse applications including cancer, cardiovascular disease, ophthalmology, and tissue engineering. Furthermore, PBNCs are based on FDA approved Prussian Blue thus potentially easing clinical translation of PBNCs.

Multimodal Imaging Brain Connectivity Analysis (MIBCA toolbox

Directory of Open Access Journals (Sweden)

Andre Santos Ribeiro

2015-07-01

Full Text Available Aim. In recent years, connectivity studies using neuroimaging data have increased the understanding of the organization of large-scale structural and functional brain networks. However, data analysis is time consuming as rigorous procedures must be assured, from structuring data and pre-processing to modality specific data procedures. Until now, no single toolbox was able to perform such investigations on truly multimodal image data from beginning to end, including the combination of different connectivity analyses. Thus, we have developed the Multimodal Imaging Brain Connectivity Analysis (MIBCA toolbox with the goal of diminishing time waste in data processing and to allow an innovative and comprehensive approach to brain connectivity.Materials and Methods. The MIBCA toolbox is a fully automated all-in-one connectivity toolbox that offers pre-processing, connectivity and graph theoretical analyses of multimodal image data such as diffusion-weighted imaging, functional magnetic resonance imaging (fMRI and positron emission tomography (PET. It was developed in MATLAB environment and pipelines well-known neuroimaging softwares such as Freesurfer, SPM, FSL, and Diffusion Toolkit. It further implements routines for the construction of structural, functional and effective or combined connectivity matrices, as well as, routines for the extraction and calculation of imaging and graph-theory metrics, the latter using also functions from the Brain Connectivity Toolbox. Finally, the toolbox performs group statistical analysis and enables data visualization in the form of matrices, 3D brain graphs and connectograms. In this paper the MIBCA toolbox is presented by illustrating its capabilities using multimodal image data from a group of 35 healthy subjects (19–73 years old with volumetric T1-weighted, diffusion tensor imaging, and resting state fMRI data, and 10 subjets with 18F-Altanserin PET data also.Results. It was observed both a high inter

Improving treatment planning accuracy through multimodality imaging

International Nuclear Information System (INIS)

Sailer, Scott L.; Rosenman, Julian G.; Soltys, Mitchel; Cullip, Tim J.; Chen, Jun

1996-01-01

Purpose: In clinical practice, physicians are constantly comparing multiple images taken at various times during the patient's treatment course. One goal of such a comparison is to accurately define the gross tumor volume (GTV). The introduction of three-dimensional treatment planning has greatly enhanced the ability to define the GTV, but there are times when the GTV is not visible on the treatment-planning computed tomography (CT) scan. We have modified our treatment-planning software to allow for interactive display of multiple, registered images that enhance the physician's ability to accurately determine the GTV. Methods and Materials: Images are registered using interactive tools developed at the University of North Carolina at Chapel Hill (UNC). Automated methods are also available. Images registered with the treatment-planning CT scan are digitized from film. After a physician has approved the registration, the registered images are made available to the treatment-planning software. Structures and volumes of interest are contoured on all images. In the beam's eye view, wire loop representations of these structures can be visualized from all image types simultaneously. Each registered image can be seamlessly viewed during the treatment-planning process, and all contours from all image types can be seen on any registered image. A beam may, therefore, be designed based on any contour. Results: Nineteen patients have been planned and treated using multimodality imaging from November 1993 through August 1994. All registered images were digitized from film, and many were from outside institutions. Brain has been the most common site (12), but the techniques of registration and image display have also been used for the thorax (4), abdomen (2), and extremity (1). The registered image has been an magnetic resonance (MR) scan in 15 cases and a diagnostic CT scan in 5 cases. In one case, sequential MRs, one before treatment and another after 30 Gy, were used to plan

A multimodal image sensor system for identifying water stress in grapevines

Science.gov (United States)

Zhao, Yong; Zhang, Qin; Li, Minzan; Shao, Yongni; Zhou, Jianfeng; Sun, Hong

2012-11-01

Water stress is one of the most common limitations of fruit growth. Water is the most limiting resource for crop growth. In grapevines, as well as in other fruit crops, fruit quality benefits from a certain level of water deficit which facilitates to balance vegetative and reproductive growth and the flow of carbohydrates to reproductive structures. A multi-modal sensor system was designed to measure the reflectance signature of grape plant surfaces and identify different water stress levels in this paper. The multi-modal sensor system was equipped with one 3CCD camera (three channels in R, G, and IR). The multi-modal sensor can capture and analyze grape canopy from its reflectance features, and identify the different water stress levels. This research aims at solving the aforementioned problems. The core technology of this multi-modal sensor system could further be used as a decision support system that combines multi-modal sensory data to improve plant stress detection and identify the causes of stress. The images were taken by multi-modal sensor which could output images in spectral bands of near-infrared, green and red channel. Based on the analysis of the acquired images, color features based on color space and reflectance features based on image process method were calculated. The results showed that these parameters had the potential as water stress indicators. More experiments and analysis are needed to validate the conclusion.

Accuracy and reproducibility of tumor positioning during prolonged and multi-modality animal imaging studies

International Nuclear Information System (INIS)

Zhang Mutian; Huang Minming; Le, Carl; Zanzonico, Pat B; Ling, C Clifton; Koutcher, Jason A; Humm, John L; Claus, Filip; Kolbert, Katherine S; Martin, Kyle

2008-01-01

Dedicated small-animal imaging devices, e.g. positron emission tomography (PET), computed tomography (CT) and magnetic resonance imaging (MRI) scanners, are being increasingly used for translational molecular imaging studies. The objective of this work was to determine the positional accuracy and precision with which tumors in situ can be reliably and reproducibly imaged on dedicated small-animal imaging equipment. We designed, fabricated and tested a custom rodent cradle with a stereotactic template to facilitate registration among image sets. To quantify tumor motion during our small-animal imaging protocols, 'gold standard' multi-modality point markers were inserted into tumor masses on the hind limbs of rats. Three types of imaging examination were then performed with the animals continuously anesthetized and immobilized: (i) consecutive microPET and MR images of tumor xenografts in which the animals remained in the same scanner for 2 h duration, (ii) multi-modality imaging studies in which the animals were transported between distant imaging devices and (iii) serial microPET scans in which the animals were repositioned in the same scanner for subsequent images. Our results showed that the animal tumor moved by less than 0.2-0.3 mm over a continuous 2 h microPET or MR imaging session. The process of transporting the animal between instruments introduced additional errors of ∼0.2 mm. In serial animal imaging studies, the positioning reproducibility within ∼0.8 mm could be obtained.

MO-DE-202-03: Image-Guided Surgery and Interventions in the Advanced Multimodality Image-Guided Operating (AMIGO) Suite

Energy Technology Data Exchange (ETDEWEB)

Kapur, T. [Brigham & Women’s Hospital (United States)

2016-06-15

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

MO-DE-202-03: Image-Guided Surgery and Interventions in the Advanced Multimodality Image-Guided Operating (AMIGO) Suite

International Nuclear Information System (INIS)

Kapur, T.

2016-01-01

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

Multimodal imaging of lung cancer and its microenvironment (Conference Presentation)

Science.gov (United States)

Hariri, Lida P.; Niederst, Matthew J.; Mulvey, Hillary; Adams, David C.; Hu, Haichuan; Chico Calero, Isabel; Szabari, Margit V.; Vakoc, Benjamin J.; Hasan, Tayyaba; Bouma, Brett E.; Engelman, Jeffrey A.; Suter, Melissa J.

2016-03-01

Despite significant advances in targeted therapies for lung cancer, nearly all patients develop drug resistance within 6-12 months and prognosis remains poor. Developing drug resistance is a progressive process that involves tumor cells and their microenvironment. We hypothesize that microenvironment factors alter tumor growth and response to targeted therapy. We conducted in vitro studies in human EGFR-mutant lung carcinoma cells, and demonstrated that factors secreted from lung fibroblasts results in increased tumor cell survival during targeted therapy with EGFR inhibitor, gefitinib. We also demonstrated that increased environment stiffness results in increased tumor survival during gefitinib therapy. In order to test our hypothesis in vivo, we developed a multimodal optical imaging protocol for preclinical intravital imaging in mouse models to assess tumor and its microenvironment over time. We have successfully conducted multimodal imaging of dorsal skinfold chamber (DSC) window mice implanted with GFP-labeled human EGFR mutant lung carcinoma cells and visualized changes in tumor development and microenvironment facets over time. Multimodal imaging included structural OCT to assess tumor viability and necrosis, polarization-sensitive OCT to measure tissue birefringence for collagen/fibroblast detection, and Doppler OCT to assess tumor vasculature. Confocal imaging was also performed for high-resolution visualization of EGFR-mutant lung cancer cells labeled with GFP, and was coregistered with OCT. Our results demonstrated that stromal support and vascular growth are essential to tumor progression. Multimodal imaging is a useful tool to assess tumor and its microenvironment over time.

Feature-based Alignment of Volumetric Multi-modal Images

Science.gov (United States)

Toews, Matthew; Zöllei, Lilla; Wells, William M.

2014-01-01

This paper proposes a method for aligning image volumes acquired from different imaging modalities (e.g. MR, CT) based on 3D scale-invariant image features. A novel method for encoding invariant feature geometry and appearance is developed, based on the assumption of locally linear intensity relationships, providing a solution to poor repeatability of feature detection in different image modalities. The encoding method is incorporated into a probabilistic feature-based model for multi-modal image alignment. The model parameters are estimated via a group-wise alignment algorithm, that iteratively alternates between estimating a feature-based model from feature data, then realigning feature data to the model, converging to a stable alignment solution with few pre-processing or pre-alignment requirements. The resulting model can be used to align multi-modal image data with the benefits of invariant feature correspondence: globally optimal solutions, high efficiency and low memory usage. The method is tested on the difficult RIRE data set of CT, T1, T2, PD and MP-RAGE brain images of subjects exhibiting significant inter-subject variability due to pathology. PMID:24683955

Optical Molecular Imaging Frontiers in Oncology: The Pursuit of Accuracy and Sensitivity

Directory of Open Access Journals (Sweden)

Kun Wang

2015-09-01

Full Text Available Cutting-edge technologies in optical molecular imaging have ushered in new frontiers in cancer research, clinical translation, and medical practice, as evidenced by recent advances in optical multimodality imaging, Cerenkov luminescence imaging (CLI, and optical image-guided surgeries. New abilities allow in vivo cancer imaging with sensitivity and accuracy that are unprecedented in conventional imaging approaches. The visualization of cellular and molecular behaviors and events within tumors in living subjects is improving our deeper understanding of tumors at a systems level. These advances are being rapidly used to acquire tumor-to-tumor molecular heterogeneity, both dynamically and quantitatively, as well as to achieve more effective therapeutic interventions with the assistance of real-time imaging. In the era of molecular imaging, optical technologies hold great promise to facilitate the development of highly sensitive cancer diagnoses as well as personalized patient treatment—one of the ultimate goals of precision medicine.

Multimodal Imaging of Human Brain Activity: Rational, Biophysical Aspects and Modes of Integration

Science.gov (United States)

Blinowska, Katarzyna; Müller-Putz, Gernot; Kaiser, Vera; Astolfi, Laura; Vanderperren, Katrien; Van Huffel, Sabine; Lemieux, Louis

2009-01-01

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship. PMID:19547657

NaGdF4:Nd3+/Yb3+ Nanoparticles as Multimodal Imaging Agents

Science.gov (United States)

Pedraza, Francisco; Rightsell, Chris; Kumar, Ga; Giuliani, Jason; Monton, Car; Sardar, Dhiraj

Medical imaging is a fundamental tool used for the diagnosis of numerous ailments. Each imaging modality has unique advantages; however, they possess intrinsic limitations. Some of which include low spatial resolution, sensitivity, penetration depth, and radiation damage. To circumvent this problem, the combination of imaging modalities, or multimodal imaging, has been proposed, such as Near Infrared Fluorescence imaging (NIRF) and Magnetic Resonance Imaging (MRI). Combining individual advantages, specificity and selectivity of NIRF with the deep penetration and high spatial resolution of MRI, it is possible to circumvent their shortcomings for a more robust imaging technique. In addition, both imaging modalities are very safe and minimally invasive. Fluorescent nanoparticles, such as NaGdF4:Nd3 +/Yb3 +, are excellent candidates for NIRF/MRI multimodal imaging. The dopants, Nd and Yb, absorb and emit within the biological window; where near infrared light is less attenuated by soft tissue. This results in less tissue damage and deeper tissue penetration making it a viable candidate in biological imaging. In addition, the inclusion of Gd results in paramagnetic properties, allowing their use as contrast agents in multimodal imaging. The work presented will include crystallographic results, as well as full optical and magnetic characterization to determine the nanoparticle's viability in multimodal imaging.

Polarization-Sensitive Hyperspectral Imaging in vivo: A Multimode Dermoscope for Skin Analysis

Science.gov (United States)

Vasefi, Fartash; MacKinnon, Nicholas; Saager, Rolf B.; Durkin, Anthony J.; Chave, Robert; Lindsley, Erik H.; Farkas, Daniel L.

2014-05-01

Attempts to understand the changes in the structure and physiology of human skin abnormalities by non-invasive optical imaging are aided by spectroscopic methods that quantify, at the molecular level, variations in tissue oxygenation and melanin distribution. However, current commercial and research systems to map hemoglobin and melanin do not correlate well with pathology for pigmented lesions or darker skin. We developed a multimode dermoscope that combines polarization and hyperspectral imaging with an efficient analytical model to map the distribution of specific skin bio-molecules. This corrects for the melanin-hemoglobin misestimation common to other systems, without resorting to complex and computationally intensive tissue optical models. For this system's proof of concept, human skin measurements on melanocytic nevus, vitiligo, and venous occlusion conditions were performed in volunteers. The resulting molecular distribution maps matched physiological and anatomical expectations, confirming a technologic approach that can be applied to next generation dermoscopes and having biological plausibility that is likely to appeal to dermatologists.

Multimodality image analysis work station

International Nuclear Information System (INIS)

Ratib, O.; Huang, H.K.

1989-01-01

The goal of this project is to design and implement a PACS (picture archiving and communication system) workstation for quantitative analysis of multimodality images. The Macintosh II personal computer was selected for its friendly user interface, its popularity among the academic and medical community, and its low cost. The Macintosh operates as a stand alone workstation where images are imported from a central PACS server through a standard Ethernet network and saved on a local magnetic or optical disk. A video digitizer board allows for direct acquisition of images from sonograms or from digitized cine angiograms. The authors have focused their project on the exploration of new means of communicating quantitative data and information through the use of an interactive and symbolic user interface. The software developed includes a variety of image analysis, algorithms for digitized angiograms, sonograms, scintigraphic images, MR images, and CT scans

Culture and magnetic resonance image of magnetospirillum magneticum AMB1 for the application as a vector for multimodal image reporter

International Nuclear Information System (INIS)

Tae, Seong Ho; Vu, Nguyen H.; Jung, Young Yeon; Min, Jung Joon

2007-01-01

Magnetospirillum magneticum AMB-1 synthesize uniform, nano-sized magnetite (Fe3O4) particles, which are referred to as bacterial magnetic particles (BacMPs). BacMPs have potential for various technological applications and the molecular mechanism of their formation is of particular interest. In this study, we established the culture method for M. magneticum AMB-1 and analysed it's growth property and magnetic resonance image. Magnetospirillum magneticum AMB-1 strain was obtained from ATCC and inoculated in Magnetospirillum growth medium (MSGM). M. magneticum was cultured at 26? with 60 rpm shaking and check the optical density (OD) in 600 nm every 6 hours. Cultured M. magneticum that reached to stataionary phase was collected by centrifugation and suspend in PBS. MR image was taken by 1.5T MRI machine. The growth of M. magneticum was reached up to 0.2 OD600 at 80 hours after inoculation. The bacterial suspension was made the concentration 2 X 10-11 CFU/ml and successfully taken MR image using by 1.5T MRI machine. M. magneticum AMB strain was successfully cultured in our laboratory condition and was shown intensive MR image. Now we can use this bacteria as a multimodal image vector if the M. magneticum is transformed with an bioluminescent or fluorescent reporter gene. Further study about the development of M. magneticum strain as a multimodal image is needed

FWFusion: Fuzzy Whale Fusion model for MRI multimodal image ...

Indian Academy of Sciences (India)

Hanmant Venketrao Patil

2018-03-14

Mar 14, 2018 ... consider multi-modality medical images other than PET and MRI images. ... cipal component averaging based on DWT for fusing CT-. MRI and MRI ..... sub-band LH of the fused image, the distance measure is given based on the ...... sustainable integrated dynamic ship routing and scheduling optimization.

Recommendations on nuclear and multimodality imaging in IE and CIED infections.

Science.gov (United States)

Erba, Paola Anna; Lancellotti, Patrizio; Vilacosta, Isidre; Gaemperli, Oliver; Rouzet, Francois; Hacker, Marcus; Signore, Alberto; Slart, Riemer H J A; Habib, Gilbert

2018-05-24

In the latest update of the European Society of Cardiology (ESC) guidelines for the management of infective endocarditis (IE), imaging is positioned at the centre of the diagnostic work-up so that an early and accurate diagnosis can be reached. Besides echocardiography, contrast-enhanced CT (ce-CT), radiolabelled leucocyte (white blood cell, WBC) SPECT/CT and [ 18 F]FDG PET/CT are included as diagnostic tools in the diagnostic flow chart for IE. Following the clinical guidelines that provided a straightforward message on the role of multimodality imaging, we believe that it is highly relevant to produce specific recommendations on nuclear multimodality imaging in IE and cardiac implantable electronic device infections. In these procedural recommendations we therefore describe in detail the technical and practical aspects of WBC SPECT/CT and [ 18 F]FDG PET/CT, including ce-CT acquisition protocols. We also discuss the advantages and limitations of each procedure, specific pitfalls when interpreting images, and the most important results from the literature, and also provide recommendations on the appropriate use of multimodality imaging.

Multimodal interaction in image and video applications

CERN Document Server

Sappa, Angel D

2013-01-01

Traditional Pattern Recognition (PR) and Computer Vision (CV) technologies have mainly focused on full automation, even though full automation often proves elusive or unnatural in many applications, where the technology is expected to assist rather than replace the human agents. However, not all the problems can be automatically solved being the human interaction the only way to tackle those applications. Recently, multimodal human interaction has become an important field of increasing interest in the research community. Advanced man-machine interfaces with high cognitive capabilities are a hot research topic that aims at solving challenging problems in image and video applications. Actually, the idea of computer interactive systems was already proposed on the early stages of computer science. Nowadays, the ubiquity of image sensors together with the ever-increasing computing performance has open new and challenging opportunities for research in multimodal human interaction. This book aims to show how existi...

Superparamagnetic nanoparticles for enhanced magnetic resonance and multimodal imaging

Science.gov (United States)

Sikma, Elise Ann Schultz

Magnetic resonance imaging (MRI) is a powerful tool for noninvasive tomographic imaging of biological systems with high spatial and temporal resolution. Superparamagnetic (SPM) nanoparticles have emerged as highly effective MR contrast agents due to their biocompatibility, ease of surface modification and magnetic properties. Conventional nanoparticle contrast agents suffer from difficult synthetic reproducibility, polydisperse sizes and weak magnetism. Numerous synthetic techniques and nanoparticle formulations have been developed to overcome these barriers. However, there are still major limitations in the development of new nanoparticle-based probes for MR and multimodal imaging including low signal amplification and absence of biochemical reporters. To address these issues, a set of multimodal (T2/optical) and dual contrast (T1/T2) nanoparticle probes has been developed. Their unique magnetic properties and imaging capabilities were thoroughly explored. An enzyme-activatable contrast agent is currently being developed as an innovative means for early in vivo detection of cancer at the cellular level. Multimodal probes function by combining the strengths of multiple imaging techniques into a single agent. Co-registration of data obtained by multiple imaging modalities validates the data, enhancing its quality and reliability. A series of T2/optical probes were successfully synthesized by attachment of a fluorescent dye to the surface of different types of nanoparticles. The multimodal nanoparticles generated sufficient MR and fluorescence signal to image transplanted islets in vivo. Dual contrast T1/T2 imaging probes were designed to overcome disadvantages inherent in the individual T1 and T2 components. A class of T1/T2 agents was developed consisting of a gadolinium (III) complex (DTPA chelate or DO3A macrocycle) conjugated to a biocompatible silica-coated metal oxide nanoparticle through a disulfide linker. The disulfide linker has the ability to be reduced

Image recovery from defocused 2D fluorescent images in multimodal digital holographic microscopy.

Science.gov (United States)

Quan, Xiangyu; Matoba, Osamu; Awatsuji, Yasuhiro

2017-05-01

A technique of three-dimensional (3D) intensity retrieval from defocused, two-dimensional (2D) fluorescent images in the multimodal digital holographic microscopy (DHM) is proposed. In the multimodal DHM, 3D phase and 2D fluorescence distributions are obtained simultaneously by an integrated system of an off-axis DHM and a conventional epifluorescence microscopy, respectively. This gives us more information of the target; however, defocused fluorescent images are observed due to the short depth of field. In this Letter, we propose a method to recover the defocused images based on the phase compensation and backpropagation from the defocused plane to the focused plane using the distance information that is obtained from a 3D phase distribution. By applying Zernike polynomial phase correction, we brought back the fluorescence intensity to the focused imaging planes. The experimental demonstration using fluorescent beads is presented, and the expected applications are suggested.

Tumor image signatures and habitats: a processing pipeline of multimodality metabolic and physiological images.

Science.gov (United States)

You, Daekeun; Kim, Michelle M; Aryal, Madhava P; Parmar, Hemant; Piert, Morand; Lawrence, Theodore S; Cao, Yue

2018-01-01

To create tumor "habitats" from the "signatures" discovered from multimodality metabolic and physiological images, we developed a framework of a processing pipeline. The processing pipeline consists of six major steps: (1) creating superpixels as a spatial unit in a tumor volume; (2) forming a data matrix [Formula: see text] containing all multimodality image parameters at superpixels; (3) forming and clustering a covariance or correlation matrix [Formula: see text] of the image parameters to discover major image "signatures;" (4) clustering the superpixels and organizing the parameter order of the [Formula: see text] matrix according to the one found in step 3; (5) creating "habitats" in the image space from the superpixels associated with the "signatures;" and (6) pooling and clustering a matrix consisting of correlation coefficients of each pair of image parameters from all patients to discover subgroup patterns of the tumors. The pipeline was applied to a dataset of multimodality images in glioblastoma (GBM) first, which consisted of 10 image parameters. Three major image "signatures" were identified. The three major "habitats" plus their overlaps were created. To test generalizability of the processing pipeline, a second image dataset from GBM, acquired on the scanners different from the first one, was processed. Also, to demonstrate the clinical association of image-defined "signatures" and "habitats," the patterns of recurrence of the patients were analyzed together with image parameters acquired prechemoradiation therapy. An association of the recurrence patterns with image-defined "signatures" and "habitats" was revealed. These image-defined "signatures" and "habitats" can be used to guide stereotactic tissue biopsy for genetic and mutation status analysis and to analyze for prediction of treatment outcomes, e.g., patterns of failure.

Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain

Directory of Open Access Journals (Sweden)

Yong Yang

2014-01-01

Full Text Available Multimodal medical image fusion is a powerful tool in clinical applications such as noninvasive diagnosis, image-guided radiotherapy, and treatment planning. In this paper, a novel nonsubsampled Contourlet transform (NSCT based method for multimodal medical image fusion is presented, which is approximately shift invariant and can effectively suppress the pseudo-Gibbs phenomena. The source medical images are initially transformed by NSCT followed by fusing low- and high-frequency components. The phase congruency that can provide a contrast and brightness-invariant representation is applied to fuse low-frequency coefficients, whereas the Log-Gabor energy that can efficiently determine the frequency coefficients from the clear and detail parts is employed to fuse the high-frequency coefficients. The proposed fusion method has been compared with the discrete wavelet transform (DWT, the fast discrete curvelet transform (FDCT, and the dual tree complex wavelet transform (DTCWT based image fusion methods and other NSCT-based methods. Visually and quantitatively experimental results indicate that the proposed fusion method can obtain more effective and accurate fusion results of multimodal medical images than other algorithms. Further, the applicability of the proposed method has been testified by carrying out a clinical example on a woman affected with recurrent tumor images.

Gadolinium oxysulfide nanoprobes with both persistent luminescent and magnetic properties for multimodal imaging

OpenAIRE

ROSTICHER , C.; Viana , Bruno; Fortin , M.-A.; Lagueux , J.; Faucher , L.; Chanéac , Corinne

2016-01-01

International audience; Persistent luminescence and magnetic properties of Gd2O2S: Eu 3+ , Ti 4+ , Mg 2+ nanoparticles have been studied to attest the relevance of such nanoparticles as nanoprobes for multimodal imaging. The development of new imaging tools is required to improve the quality of medical images and then to diagnose some disorders as quickly as possible in order to ensure more effective treatment. Multimodal imaging agents here developed combine the high resolution abilities of ...

Multimodal Imaging Nanoparticles Derived from Hyaluronic Acid for Integrated Preoperative and Intraoperative Cancer Imaging

Directory of Open Access Journals (Sweden)

William M. Payne

2017-01-01

Full Text Available Surgical resection remains the most promising treatment strategy for many types of cancer. Residual malignant tissue after surgery, a consequence in part due to positive margins, contributes to high mortality and disease recurrence. In this study, multimodal contrast agents for integrated preoperative magnetic resonance imaging (MRI and intraoperative fluorescence image-guided surgery (FIGS are developed. Self-assembled multimodal imaging nanoparticles (SAMINs were developed as a mixed micelle formulation using amphiphilic HA polymers functionalized with either GdDTPA for T1 contrast-enhanced MRI or Cy7.5, a near infrared fluorophore. To evaluate the relationship between MR and fluorescence signal from SAMINs, we employed simulated surgical phantoms that are routinely used to evaluate the depth at which near infrared (NIR imaging agents can be detected by FIGS. Finally, imaging agent efficacy was evaluated in a human breast tumor xenograft model in nude mice, which demonstrated contrast in both fluorescence and magnetic resonance imaging.

Emerging Themes in Image Informatics and Molecular Analysis for Digital Pathology.

Science.gov (United States)

Bhargava, Rohit; Madabhushi, Anant

2016-07-11

Pathology is essential for research in disease and development, as well as for clinical decision making. For more than 100 years, pathology practice has involved analyzing images of stained, thin tissue sections by a trained human using an optical microscope. Technological advances are now driving major changes in this paradigm toward digital pathology (DP). The digital transformation of pathology goes beyond recording, archiving, and retrieving images, providing new computational tools to inform better decision making for precision medicine. First, we discuss some emerging innovations in both computational image analytics and imaging instrumentation in DP. Second, we discuss molecular contrast in pathology. Molecular DP has traditionally been an extension of pathology with molecularly specific dyes. Label-free, spectroscopic images are rapidly emerging as another important information source, and we describe the benefits and potential of this evolution. Third, we describe multimodal DP, which is enabled by computational algorithms and combines the best characteristics of structural and molecular pathology. Finally, we provide examples of application areas in telepathology, education, and precision medicine. We conclude by discussing challenges and emerging opportunities in this area.

MO-DE-202-04: Multimodality Image-Guided Surgery and Intervention: For the Rest of Us

Energy Technology Data Exchange (ETDEWEB)

Shekhar, R. [Children’s National Health System (United States)

2016-06-15

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

MO-DE-202-04: Multimodality Image-Guided Surgery and Intervention: For the Rest of Us

International Nuclear Information System (INIS)

Shekhar, R.

2016-01-01

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

Magnetic Iron Oxide Nanoparticles for Multimodal Imaging and Therapy of Cancer

Directory of Open Access Journals (Sweden)

In-Kyu Park

2013-07-01

Full Text Available Superparamagnetic iron oxide nanoparticles (SPION have emerged as an MRI contrast agent for tumor imaging due to their efficacy and safety. Their utility has been proven in clinical applications with a series of marketed SPION-based contrast agents. Extensive research has been performed to study various strategies that could improve SPION by tailoring the surface chemistry and by applying additional therapeutic functionality. Research into the dual-modal contrast uses of SPION has developed because these applications can save time and effort by reducing the number of imaging sessions. In addition to multimodal strategies, efforts have been made to develop multifunctional nanoparticles that carry both diagnostic and therapeutic cargos specifically for cancer. This review provides an overview of recent advances in multimodality imaging agents and focuses on iron oxide based nanoparticles and their theranostic applications for cancer. Furthermore, we discuss the physiochemical properties and compare different synthesis methods of SPION for the development of multimodal contrast agents.

Multi-Modal Curriculum Learning for Semi-Supervised Image Classification.

Science.gov (United States)

Gong, Chen; Tao, Dacheng; Maybank, Stephen J; Liu, Wei; Kang, Guoliang; Yang, Jie

2016-07-01

Semi-supervised image classification aims to classify a large quantity of unlabeled images by typically harnessing scarce labeled images. Existing semi-supervised methods often suffer from inadequate classification accuracy when encountering difficult yet critical images, such as outliers, because they treat all unlabeled images equally and conduct classifications in an imperfectly ordered sequence. In this paper, we employ the curriculum learning methodology by investigating the difficulty of classifying every unlabeled image. The reliability and the discriminability of these unlabeled images are particularly investigated for evaluating their difficulty. As a result, an optimized image sequence is generated during the iterative propagations, and the unlabeled images are logically classified from simple to difficult. Furthermore, since images are usually characterized by multiple visual feature descriptors, we associate each kind of features with a teacher, and design a multi-modal curriculum learning (MMCL) strategy to integrate the information from different feature modalities. In each propagation, each teacher analyzes the difficulties of the currently unlabeled images from its own modality viewpoint. A consensus is subsequently reached among all the teachers, determining the currently simplest images (i.e., a curriculum), which are to be reliably classified by the multi-modal learner. This well-organized propagation process leveraging multiple teachers and one learner enables our MMCL to outperform five state-of-the-art methods on eight popular image data sets.

Application of Multimodality Imaging Fusion Technology in Diagnosis and Treatment of Malignant Tumors under the Precision Medicine Plan.

Science.gov (United States)

Wang, Shun-Yi; Chen, Xian-Xia; Li, Yi; Zhang, Yu-Ying

2016-12-20

The arrival of precision medicine plan brings new opportunities and challenges for patients undergoing precision diagnosis and treatment of malignant tumors. With the development of medical imaging, information on different modality imaging can be integrated and comprehensively analyzed by imaging fusion system. This review aimed to update the application of multimodality imaging fusion technology in the precise diagnosis and treatment of malignant tumors under the precision medicine plan. We introduced several multimodality imaging fusion technologies and their application to the diagnosis and treatment of malignant tumors in clinical practice. The data cited in this review were obtained mainly from the PubMed database from 1996 to 2016, using the keywords of "precision medicine", "fusion imaging", "multimodality", and "tumor diagnosis and treatment". Original articles, clinical practice, reviews, and other relevant literatures published in English were reviewed. Papers focusing on precision medicine, fusion imaging, multimodality, and tumor diagnosis and treatment were selected. Duplicated papers were excluded. Multimodality imaging fusion technology plays an important role in tumor diagnosis and treatment under the precision medicine plan, such as accurate location, qualitative diagnosis, tumor staging, treatment plan design, and real-time intraoperative monitoring. Multimodality imaging fusion systems could provide more imaging information of tumors from different dimensions and angles, thereby offing strong technical support for the implementation of precision oncology. Under the precision medicine plan, personalized treatment of tumors is a distinct possibility. We believe that multimodality imaging fusion technology will find an increasingly wide application in clinical practice.

White paper of the European Association of Nuclear Medicine (EANM) and the European Society of Radiology (ESR) on multimodality imaging

International Nuclear Information System (INIS)

Bischof Delaloye, Angelika; Carrio, Ignasi; Cuocolo, Alberto; Knapp, Wolfram; Gourtsoyiannis, Nicholas; McCall, Iain; Reiser, Maximilian; Silberman, Bruno

2007-01-01

New multimodality imaging systems bring together anatomical and molecular information and require the competency and accreditation of individuals from both nuclear medicine and radiology. This paper sets out the positions and aspirations of the European Association of Nuclear Medicine (EANM) and the European Society of Radiology (ESR) working together on an equal and constructive basis for the future benefit of both specialties. EANM and ESR recognise the importance of coordinating working practices for multimodality imaging systems and that undertaking the nuclear medicine and radiology components of imaging with hybrid systems requires different skills. It is important to provide adequate and appropriate training in the two disciplines in order to offer a proper service to the patient using hybrid systems. Training models are proposed with the overall objective of providing opportunities for acquisition of special competency certification in multimodality imaging. Both organisations plan to develop common procedural guidelines and recognise the importance of coordinating the purchasing and management of hybrid systems to maximise the benefits to both specialties and to ensure appropriate reimbursement of these examinations. European multimodality imaging research is operating in a highly competitive environment. The coming years will decide whether European research in this area manages to defend its leading position or whether it falls behind research in other leading economies. Since research teams in the Member States are not always sufficiently interconnected, more European input is necessary to create interdisciplinary bridges between research institutions in Europe and to stimulate excellence. EANM and ESR will work with the European Institute for Biomedical Imaging Research (EIBIR) to develop further research opportunities across Europe. European Union grant-funding bodies should allocate funds to joint research initiatives that encompass clinical research

White paper of the European Society of Radiology (ESR) and the European Association of Nuclear Medicine (EANM) on multimodality imaging

International Nuclear Information System (INIS)

Gourtsoyiannis, Nicholas; McCall, Iain; Reiser, Maximilian; Silberman, Bruno; Bischof Delaloye, Angelika; Carrio, Ignacio; Cuocolo, Alberto; Knapp, Wolfram

2007-01-01

New multimodality imaging systems bring together anatomical and molecular information and require the competency and accreditation of individuals from both radiology and nuclear medicine. This paper sets out the positions and aspirations of the European Society of Radiology (ESR) and the European Association of Nuclear Medicine (EANM) working together on an equal and constructive basis for the future benefit of both specialties. ESR and EANM recognise the importance of coordinating working practices for multimodality imaging systems and that undertaking the radiology and nuclear medicine components of imaging with hybrid systems requires different skills. It is important to provide adequate and appropriate training in the two disciplines in order to offer a proper service to the patient using hybrid systems. Training models are proposed with the overall objective of providing opportunities for acquisition of special competency certification in multimodality imaging. Both organisations plan to develop common procedural guidelines and recognise the importance of coordinating the purchasing and management of hybrid systems to maximise the benefits to both specialties and to ensure appropriate reimbursement of these examinations. European multimodality imaging research is operating in a highly competitive environment. The coming years will decide whether European research in this area manages to defend its leading position or whether it falls behind research in other leading economies. Since research teams in the member states are not always sufficiently interconnected, more European input is necessary to create interdisciplinary bridges between research institutions in Europe and to stimulate excellence. ESR and EANM will work with the European Institute for Biomedical Imaging Research (EIBIR) to develop further research opportunities across Europe. European Union grant-funding bodies should allocate funds to joint research initiatives that encompass clinical research

Multimodality Imaging of Heart Valve Disease

International Nuclear Information System (INIS)

Rajani, Ronak; Khattar, Rajdeep; Chiribiri, Amedeo; Victor, Kelly; Chambers, John

2014-01-01

Unidentified heart valve disease is associated with a significant morbidity and mortality. It has therefore become important to accurately identify, assess and monitor patients with this condition in order that appropriate and timely intervention can occur. Although echocardiography has emerged as the predominant imaging modality for this purpose, recent advances in cardiac magnetic resonance and cardiac computed tomography indicate that they may have an important contribution to make. The current review describes the assessment of regurgitant and stenotic heart valves by multimodality imaging (echocardiography, cardiac computed tomography and cardiac magnetic resonance) and discusses their relative strengths and weaknesses

Multimodality Imaging of Heart Valve Disease

Energy Technology Data Exchange (ETDEWEB)

Rajani, Ronak, E-mail: Dr.R.Rajani@gmail.com [Department of Cardiology, St. Thomas’ Hospital, London (United Kingdom); Khattar, Rajdeep [Department of Cardiology, Royal Brompton Hospital, London (United Kingdom); Chiribiri, Amedeo [Divisions of Imaging Sciences, The Rayne Institute, St. Thomas' Hospital, London (United Kingdom); Victor, Kelly; Chambers, John [Department of Cardiology, St. Thomas’ Hospital, London (United Kingdom)

2014-09-15

Unidentified heart valve disease is associated with a significant morbidity and mortality. It has therefore become important to accurately identify, assess and monitor patients with this condition in order that appropriate and timely intervention can occur. Although echocardiography has emerged as the predominant imaging modality for this purpose, recent advances in cardiac magnetic resonance and cardiac computed tomography indicate that they may have an important contribution to make. The current review describes the assessment of regurgitant and stenotic heart valves by multimodality imaging (echocardiography, cardiac computed tomography and cardiac magnetic resonance) and discusses their relative strengths and weaknesses.

Synthesis of a novel iron oxide contrast agent as a platform for multimodal molecular imaging

International Nuclear Information System (INIS)

Borny, R.

2014-01-01

��hairy layer” was visualized by electron tomography and provided additional information about the architecture of iron oxide particles. Biological targets can be easily addressed by further functionalization of the available attachment sites. In future, the particles will be adapted to serve as a platform for multimodal molecular imaging and targeted radiation therapy. (author) [de

Imaging arterial cells, atherosclerosis, and restenosis by multimodal nonlinear optical microscopy

Science.gov (United States)

Wang, Han-Wei; Simianu, Vlad; Locker, Matthew J.; Sturek, Michael; Cheng, Ji-Xin

2008-02-01

By integrating sum-frequency generation (SFG), and two-photon excitation fluorescence (TPEF) on a coherent anti-Stokes Raman scattering (CARS) microscope platform, multimodal nonlinear optical (NLO) imaging of arteries and atherosclerotic lesions was demonstrated. CARS signals arising from CH II-rich membranes allowed visualization of endothelial cells and smooth muscle cells in a carotid artery. Additionally, CARS microscopy allowed vibrational imaging of elastin and collagen fibrils which are rich in CH II bonds in their cross-linking residues. The extracellular matrix organization was further confirmed by TPEF signals arising from elastin's autofluorescence and SFG signals arising from collagen fibrils' non-centrosymmetric structure. The system is capable of identifying different atherosclerotic lesion stages with sub-cellular resolution. The stages of atherosclerosis, such as macrophage infiltration, lipid-laden foam cell accumulation, extracellular lipid distribution, fibrous tissue deposition, plaque establishment, and formation of other complicated lesions could be viewed by our multimodal CARS microscope. Collagen percentages in the region adjacent to coronary artery stents were resolved. High correlation between NLO and histology imaging evidenced the validity of the NLO imaging. The capability of imaging significant components of an arterial wall and distinctive stages of atherosclerosis in a label-free manner suggests the potential application of multimodal nonlinear optical microscopy to monitor the onset and progression of arterial diseases.

Highlights lecture EANM 2016: "Embracing molecular imaging and multi-modal imaging: a smart move for nuclear medicine towards personalized medicine".

Science.gov (United States)

Aboagye, Eric O; Kraeber-Bodéré, Françoise

2017-08-01

The 2016 EANM Congress took place in Barcelona, Spain, from 15 to 19 October under the leadership of Prof. Wim Oyen, chair of the EANM Scientific Committee. With more than 6,000 participants, this congress was the most important European event in nuclear medicine, bringing together a multidisciplinary community involved in the different fields of nuclear medicine. There were over 600 oral and 1,200 poster or e-Poster presentations with an overwhelming focus on development and application of imaging for personalized care, which is timely for the community. Beyond FDG PET, major highlights included progress in the use of PSMA and SSTR receptor-targeted radiopharmaceuticals and associated theranostics in oncology. Innovations in radiopharmaceuticals for imaging pathologies of the brain and cardiovascular system, as well as infection and inflammation, were also highlighted. In the areas of physics and instrumentation, multimodality imaging and radiomics were highlighted as promising areas of research.

A Novel Technique for Prealignment in Multimodality Medical Image Registration

Directory of Open Access Journals (Sweden)

Wu Zhou

2014-01-01

Full Text Available Image pair is often aligned initially based on a rigid or affine transformation before a deformable registration method is applied in medical image registration. Inappropriate initial registration may compromise the registration speed or impede the convergence of the optimization algorithm. In this work, a novel technique was proposed for prealignment in both monomodality and multimodality image registration based on statistical correlation of gradient information. A simple and robust algorithm was proposed to determine the rotational differences between two images based on orientation histogram matching accumulated from local orientation of each pixel without any feature extraction. Experimental results showed that it was effective to acquire the orientation angle between two unregistered images with advantages over the existed method based on edge-map in multimodalities. Applying the orientation detection into the registration of CT/MR, T1/T2 MRI, and monomadality images with respect to rigid and nonrigid deformation improved the chances of finding the global optimization of the registration and reduced the search space of optimization.

The Center for Integrated Molecular Brain Imaging (Cimbi) database

DEFF Research Database (Denmark)

Knudsen, Gitte M.; Jensen, Peter S.; Erritzoe, David

2016-01-01

We here describe a multimodality neuroimaging containing data from healthy volunteers and patients, acquired within the Lundbeck Foundation Center for Integrated Molecular Brain Imaging (Cimbi) in Copenhagen, Denmark. The data is of particular relevance for neurobiological research questions rela...... currently contains blood and in some instances saliva samples from about 500 healthy volunteers and 300 patients with e.g., major depression, dementia, substance abuse, obesity, and impulsive aggression. Data continue to be added to the Cimbi database and biobank....

Bench to bedside molecular functional imaging in translational cancer medicine: to image or to imagine?

International Nuclear Information System (INIS)

Mahajan, A.; Goh, V.; Basu, S.; Vaish, R.; Weeks, A.J.; Thakur, M.H.; Cook, G.J.

2015-01-01

Ongoing research on malignant and normal cell biology has substantially enhanced the understanding of the biology of cancer and carcinogenesis. This has led to the development of methods to image the evolution of cancer, target specific biological molecules, and study the anti-tumour effects of novel therapeutic agents. At the same time, there has been a paradigm shift in the field of oncological imaging from purely structural or functional imaging to combined multimodal structure–function approaches that enable the assessment of malignancy from all aspects (including molecular and functional level) in a single examination. The evolving molecular functional imaging using specific molecular targets (especially with combined positron-emission tomography [PET] computed tomography [CT] using 2- [ 18 F]-fluoro-2-deoxy-D-glucose [FDG] and other novel PET tracers) has great potential in translational research, giving specific quantitative information with regard to tumour activity, and has been of pivotal importance in diagnoses and therapy tailoring. Furthermore, molecular functional imaging has taken a key place in the present era of translational cancer research, producing an important tool to study and evolve newer receptor-targeted therapies, gene therapies, and in cancer stem cell research, which could form the basis to translate these agents into clinical practice, popularly termed “theranostics”. Targeted molecular imaging needs to be developed in close association with biotechnology, information technology, and basic translational scientists for its best utility. This article reviews the current role of molecular functional imaging as one of the main pillars of translational research. -- Highlights: •Molecular functional imaging (MFI) gives insight into the tumor biology and intratumoral heterogeneity. •It has potential role in identifying radiomic signatures associated with underlying gene-expression. •Radiomics can be used to create a road map

The research progress of dual-modality probes for molecular imaging

International Nuclear Information System (INIS)

Cao Feng; Chen Yue

2010-01-01

Various imaging modalities have been exploited to investigate the anatomic or functional dissemination of tissues in the body. However, no single imaging modality allows overall structural, functional, and molecular information as each imaging modality has its own unique strengths and weaknesses. The combination of two imaging modalities that investigates the strengths of different methods might offer the prospect of improved diagnostic abilities. As more and more dual-modality imaging system have become clinically adopted, significant progress has been made toward the creation of dual-modality imaging probes, which can be used as novel tools for future multimodality systems. These all-in-one probes take full advantage of two different imaging modalities and could provide comprehensive information for clinical diagnostics. This review discusses the advantages and challenges in developing dual-modality imaging probes. (authors)

Stereoscopic Integrated Imaging Goggles for Multimodal Intraoperative Image Guidance.

Directory of Open Access Journals (Sweden)

Christopher A Mela

Full Text Available We have developed novel stereoscopic wearable multimodal intraoperative imaging and display systems entitled Integrated Imaging Goggles for guiding surgeries. The prototype systems offer real time stereoscopic fluorescence imaging and color reflectance imaging capacity, along with in vivo handheld microscopy and ultrasound imaging. With the Integrated Imaging Goggle, both wide-field fluorescence imaging and in vivo microscopy are provided. The real time ultrasound images can also be presented in the goggle display. Furthermore, real time goggle-to-goggle stereoscopic video sharing is demonstrated, which can greatly facilitate telemedicine. In this paper, the prototype systems are described, characterized and tested in surgeries in biological tissues ex vivo. We have found that the system can detect fluorescent targets with as low as 60 nM indocyanine green and can resolve structures down to 0.25 mm with large FOV stereoscopic imaging. The system has successfully guided simulated cancer surgeries in chicken. The Integrated Imaging Goggle is novel in 4 aspects: it is (a the first wearable stereoscopic wide-field intraoperative fluorescence imaging and display system, (b the first wearable system offering both large FOV and microscopic imaging simultaneously,

Multimodal imaging in cerebral gliomas and its neuropathological correlation

Energy Technology Data Exchange (ETDEWEB)

Gempt, Jens, E-mail: jens.gempt@lrz.tum.de [Neurochirurgische Klinik und Poliklinik, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Soehngen, Eric [Abteilung für Neuroradiologie, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Abteilung für Neuropathologie des Instituts für Allgemeine Pathologie und Pathologische Anatomie, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Förster, Stefan [Nuklearmedizinische Klinik und Poliklinik, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Ryang, Yu-Mi [Neurochirurgische Klinik und Poliklinik, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); Schlegel, Jürgen [Abteilung für Neuropathologie des Instituts für Allgemeine Pathologie und Pathologische Anatomie, Technische Universität München, Ismaninger Str. 22, 81675 München (Germany); and others

2014-05-15

Introduction: Concerning the preoperative clinical diagnostic work-up of glioma patients, tumor heterogeneity challenges the oncological therapy. The current study assesses the performance of a multimodal imaging approach to differentiate between areas in malignant gliomas and to investigate the extent to which such a combinatorial imaging approach might predict the underlying histology. Methods: Prior to surgical resection, patients harboring intracranial gliomas underwent MRIs (MR-S, PWI) and {sup 18}F-FET-PETs. Intratumoral and peritumoral biopsy targets were defined, by MRI only, by FET-PET only, and by MRI and FET-PET combined, and biopsied prior to surgical resection and which then received separate histopathological examinations. Results: In total, 38 tissue samples were acquired (seven glioblastomas, one anaplastic astrocytoma, one anaplastic oligoastrocytoma, one diffuse astrocytoma, and one oligoastrocytoma) and underwent histopathological analysis. The highest mean values of Mib1 and CD31 were found in the target point “T’ defined by MRI and FET-PET combined. A significant correlation between NAA/Cr and PET tracer uptake (−0.845, p < 0.05) as well as Cho/Cr ratio and cell density (0.742, p < 0.05) and NAA/Cr ratio and MIB-1 (−0761, p < 0.05) was disclosed for this target point, though not for target points defined by MRI and FET-PET alone. Conclusion: Multimodal-imaging-guided stereotactic biopsy correlated more with histological malignancy indices, such as cell density and MIB-1 labeling, than targets that were based solely on the highest amino acid uptake or contrast enhancement on MRI. The results of our study indicate that a combined PET-MR multimodal imaging approach bears potential benefits in detecting glioma heterogeneity.

Image fusion between whole body FDG PET images and whole body MRI images using a full-automatic mutual information-based multimodality image registration software

International Nuclear Information System (INIS)

Uchida, Yoshitaka; Nakano, Yoshitada; Fujibuchi, Toshiou; Isobe, Tomoko; Kazama, Toshiki; Ito, Hisao

2006-01-01

We attempted image fusion between whole body PET and whole body MRI of thirty patients using a full-automatic mutual information (MI) -based multimodality image registration software and evaluated accuracy of this method and impact of the coregistrated imaging on diagnostic accuracy. For 25 of 30 fused images in body area, translating gaps were within 6 mm in all axes and rotating gaps were within 2 degrees around all axes. In head and neck area, considerably much gaps caused by difference of head inclination at imaging occurred in 16 patients, however these gaps were able to decrease by fused separately. In 6 patients, diagnostic accuracy using PET/MRI fused images was superior compared by PET image alone. This work shows that whole body FDG PET images and whole body MRI images can be automatically fused using MI-based multimodality image registration software accurately and this technique can add useful information when evaluating FDG PET images. (author)

Toward in vivo diagnosis of skin cancer using multimode imaging dermoscopy: (II) molecular mapping of highly pigmented lesions

Science.gov (United States)

Vasefi, Fartash; MacKinnon, Nicholas; Farkas, Daniel L.

2014-03-01

We have developed a multimode imaging dermoscope that combines polarization and hyperspectral imaging with a computationally rapid analytical model. This approach employs specific spectral ranges of visible and near infrared wavelengths for mapping the distribution of specific skin bio-molecules. This corrects for the melanin-hemoglobin misestimation common to other systems, without resorting to complex and computationally intensive tissue optical models that are prone to inaccuracies due to over-modeling. Various human skin measurements including a melanocytic nevus, and venous occlusion conditions were investigated and compared with other ratiometric spectral imaging approaches. Access to the broad range of hyperspectral data in the visible and near-infrared range allows our algorithm to flexibly use different wavelength ranges for chromophore estimation while minimizing melanin-hemoglobin optical signature cross-talk.

Multi-modal brain imaging software for guiding invasive treatment of epilepsy

NARCIS (Netherlands)

Ossenblok, P.P.W.; Marien, S.; Meesters, S.P.L.; Florack, L.M.J.; Hofman, P.; Schijns, O.E.M.G.; Colon, A.

2017-01-01

Purpose: The surgical treatment of patients with complex epilepsies is changing more and more from open, invasive surgery towards minimally invasive, image guided treatment. Multi-modal brain imaging procedures are developed to delineate preoperatively the region of the brain which is responsible

A multimodal parallel architecture: A cognitive framework for multimodal interactions.

Science.gov (United States)

Cohn, Neil

2016-01-01

Human communication is naturally multimodal, and substantial focus has examined the semantic correspondences in speech-gesture and text-image relationships. However, visual narratives, like those in comics, provide an interesting challenge to multimodal communication because the words and/or images can guide the overall meaning, and both modalities can appear in complicated "grammatical" sequences: sentences use a syntactic structure and sequential images use a narrative structure. These dual structures create complexity beyond those typically addressed by theories of multimodality where only a single form uses combinatorial structure, and also poses challenges for models of the linguistic system that focus on single modalities. This paper outlines a broad theoretical framework for multimodal interactions by expanding on Jackendoff's (2002) parallel architecture for language. Multimodal interactions are characterized in terms of their component cognitive structures: whether a particular modality (verbal, bodily, visual) is present, whether it uses a grammatical structure (syntax, narrative), and whether it "dominates" the semantics of the overall expression. Altogether, this approach integrates multimodal interactions into an existing framework of language and cognition, and characterizes interactions between varying complexity in the verbal, bodily, and graphic domains. The resulting theoretical model presents an expanded consideration of the boundaries of the "linguistic" system and its involvement in multimodal interactions, with a framework that can benefit research on corpus analyses, experimentation, and the educational benefits of multimodality. Copyright © 2015.

Multifocus confocal Raman microspectroscopy for fast multimode vibrational imaging of living cells.

Science.gov (United States)

Okuno, Masanari; Hamaguchi, Hiro-o

2010-12-15

We have developed a multifocus confocal Raman microspectroscopic system for the fast multimode vibrational imaging of living cells. It consists of an inverted microscope equipped with a microlens array, a pinhole array, a fiber bundle, and a multichannel Raman spectrometer. Forty-eight Raman spectra from 48 foci under the microscope are simultaneously obtained by using multifocus excitation and image-compression techniques. The multifocus confocal configuration suppresses the background generated from the cover glass and the cell culturing medium so that high-contrast images are obtainable with a short accumulation time. The system enables us to obtain multimode (10 different vibrational modes) vibrational images of living cells in tens of seconds with only 1 mW laser power at one focal point. This image acquisition time is more than 10 times faster than that in conventional single-focus Raman microspectroscopy.

Deep Convolutional Neural Networks for Multi-Modality Isointense Infant Brain Image Segmentation

Science.gov (United States)

Zhang, Wenlu; Li, Rongjian; Deng, Houtao; Wang, Li; Lin, Weili; Ji, Shuiwang; Shen, Dinggang

2015-01-01

The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development in health and disease. In the isointense stage (approximately 6–8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, making the tissue segmentation very challenging. Only a small number of existing methods have been designed for tissue segmentation in this isointense stage; however, they only used a single T1 or T2 images, or the combination of T1 and T2 images. In this paper, we propose to use deep convolutional neural networks (CNNs) for segmenting isointense stage brain tissues using multi-modality MR images. CNNs are a type of deep models in which trainable filters and local neighborhood pooling operations are applied alternatingly on the raw input images, resulting in a hierarchy of increasingly complex features. Specifically, we used multimodality information from T1, T2, and fractional anisotropy (FA) images as inputs and then generated the segmentation maps as outputs. The multiple intermediate layers applied convolution, pooling, normalization, and other operations to capture the highly nonlinear mappings between inputs and outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense stage brain images. Results showed that our proposed model significantly outperformed prior methods on infant brain tissue segmentation. In addition, our results indicated that integration of multi-modality images led to significant performance improvement. PMID:25562829

Integrated nanotechnology platform for tumor-targeted multimodal imaging and therapeutic cargo release.

Science.gov (United States)

Hosoya, Hitomi; Dobroff, Andrey S; Driessen, Wouter H P; Cristini, Vittorio; Brinker, Lina M; Staquicini, Fernanda I; Cardó-Vila, Marina; D'Angelo, Sara; Ferrara, Fortunato; Proneth, Bettina; Lin, Yu-Shen; Dunphy, Darren R; Dogra, Prashant; Melancon, Marites P; Stafford, R Jason; Miyazono, Kohei; Gelovani, Juri G; Kataoka, Kazunori; Brinker, C Jeffrey; Sidman, Richard L; Arap, Wadih; Pasqualini, Renata

2016-02-16

A major challenge of targeted molecular imaging and drug delivery in cancer is establishing a functional combination of ligand-directed cargo with a triggered release system. Here we develop a hydrogel-based nanotechnology platform that integrates tumor targeting, photon-to-heat conversion, and triggered drug delivery within a single nanostructure to enable multimodal imaging and controlled release of therapeutic cargo. In proof-of-concept experiments, we show a broad range of ligand peptide-based applications with phage particles, heat-sensitive liposomes, or mesoporous silica nanoparticles that self-assemble into a hydrogel for tumor-targeted drug delivery. Because nanoparticles pack densely within the nanocarrier, their surface plasmon resonance shifts to near-infrared, thereby enabling a laser-mediated photothermal mechanism of cargo release. We demonstrate both noninvasive imaging and targeted drug delivery in preclinical mouse models of breast and prostate cancer. Finally, we applied mathematical modeling to predict and confirm tumor targeting and drug delivery. These results are meaningful steps toward the design and initial translation of an enabling nanotechnology platform with potential for broad clinical applications.

TU-C-BRD-01: Image Guided SBRT I: Multi-Modality 4D Imaging

International Nuclear Information System (INIS)

Cai, J; Mageras, G; Pan, T

2014-01-01

Motion management is one of the critical technical challenges for radiation therapy. 4D imaging has been rapidly adopted as essential tool to assess organ motion associated with respiratory breathing. A variety of 4D imaging techniques have been developed and are currently under development based on different imaging modalities such as CT, MRI, PET, and CBCT. Each modality provides specific and complementary information about organ and tumor respiratory motion. Effective use of each different technique or combined use of different techniques can introduce a comprehensive management of tumor motion. Specifically, these techniques have afforded tremendous opportunities to better define and delineate tumor volumes, more accurately perform patient positioning, and effectively apply highly conformal therapy techniques such as IMRT and SBRT. Successful implementation requires good understanding of not only each technique, including unique features, limitations, artifacts, imaging acquisition and process, but also how to systematically apply the information obtained from different imaging modalities using proper tools such as deformable image registration. Furthermore, it is important to understand the differences in the effects of breathing variation between different imaging modalities. A comprehensive motion management strategy using multi-modality 4D imaging has shown promise in improving patient care, but at the same time faces significant challenges. This session will focuses on the current status and advances in imaging respiration-induced organ motion with different imaging modalities: 4D-CT, 4D-MRI, 4D-PET, and 4D-CBCT/DTS. Learning Objectives: Understand the need and role of multimodality 4D imaging in radiation therapy. Understand the underlying physics behind each 4D imaging technique. Recognize the advantages and limitations of each 4D imaging technique

Modeling decision-making in single- and multi-modal medical images

Science.gov (United States)

Canosa, R. L.; Baum, K. G.

2009-02-01

This research introduces a mode-specific model of visual saliency that can be used to highlight likely lesion locations and potential errors (false positives and false negatives) in single-mode PET and MRI images and multi-modal fused PET/MRI images. Fused-modality digital images are a relatively recent technological improvement in medical imaging; therefore, a novel component of this research is to characterize the perceptual response to these fused images. Three different fusion techniques were compared to single-mode displays in terms of observer error rates using synthetic human brain images generated from an anthropomorphic phantom. An eye-tracking experiment was performed with naÃve (non-radiologist) observers who viewed the single- and multi-modal images. The eye-tracking data allowed the errors to be classified into four categories: false positives, search errors (false negatives never fixated), recognition errors (false negatives fixated less than 350 milliseconds), and decision errors (false negatives fixated greater than 350 milliseconds). A saliency model consisting of a set of differentially weighted low-level feature maps is derived from the known error and ground truth locations extracted from a subset of the test images for each modality. The saliency model shows that lesion and error locations attract visual attention according to low-level image features such as color, luminance, and texture.

Multimodal label-free microscopy

Directory of Open Access Journals (Sweden)

Nicolas Pavillon

2014-09-01

Full Text Available This paper reviews the different multimodal applications based on a large extent of label-free imaging modalities, ranging from linear to nonlinear optics, while also including spectroscopic measurements. We put specific emphasis on multimodal measurements going across the usual boundaries between imaging modalities, whereas most multimodal platforms combine techniques based on similar light interactions or similar hardware implementations. In this review, we limit the scope to focus on applications for biology such as live cells or tissues, since by their nature of being alive or fragile, we are often not free to take liberties with the image acquisition times and are forced to gather the maximum amount of information possible at one time. For such samples, imaging by a given label-free method usually presents a challenge in obtaining sufficient optical signal or is limited in terms of the types of observable targets. Multimodal imaging is then particularly attractive for these samples in order to maximize the amount of measured information. While multimodal imaging is always useful in the sense of acquiring additional information from additional modes, at times it is possible to attain information that could not be discovered using any single mode alone, which is the essence of the progress that is possible using a multimodal approach.

Molecular Imaging: A Useful Tool for the Development of Natural Killer Cell-Based Immunotherapies

Directory of Open Access Journals (Sweden)

Prakash Gangadaran

2017-09-01

Full Text Available Molecular imaging is a relatively new discipline that allows visualization, characterization, and measurement of the biological processes in living subjects, including humans, at a cellular and molecular level. The interaction between cancer cells and natural killer (NK cells is complex and incompletely understood. Despite our limited knowledge, progress in the search for immune cell therapies against cancer could be significantly improved by dynamic and non-invasive visualization and tracking of immune cells and by visualization of the response of cancer cells to therapies in preclinical and clinical studies. Molecular imaging is an essential tool for these studies, and a multimodal molecular imaging approach can be applied to monitor immune cells in vivo, for instance, to visualize therapeutic effects. In this review, we discuss the usefulness of NK cells in cancer therapies and the preclinical and clinical usefulness of molecular imaging in NK cell-based therapies. Furthermore, we discuss different molecular imaging modalities for use with NK cell-based therapies, and their preclinical and clinical applications in animal and human subjects. Molecular imaging has contributed to the development of NK cell-based therapies against cancers in animal models and to the refinement of current cell-based cancer immunotherapies. Developing sensitive and reproducible non-invasive molecular imaging technologies for in vivo NK cell monitoring and for real-time assessment of therapeutic effects will accelerate the development of NK cell therapies.

Multimodal system for the planning and guidance of bronchoscopy

Science.gov (United States)

Higgins, William E.; Cheirsilp, Ronnarit; Zang, Xiaonan; Byrnes, Patrick

2015-03-01

Many technical innovations in multimodal radiologic imaging and bronchoscopy have emerged recently in the effort against lung cancer. Modern X-ray computed-tomography (CT) scanners provide three-dimensional (3D) high-resolution chest images, positron emission tomography (PET) scanners give complementary molecular imaging data, and new integrated PET/CT scanners combine the strengths of both modalities. State-of-the-art bronchoscopes permit minimally invasive tissue sampling, with vivid endobronchial video enabling navigation deep into the airway-tree periphery, while complementary endobronchial ultrasound (EBUS) reveals local views of anatomical structures outside the airways. In addition, image-guided intervention (IGI) systems have proven their utility for CT-based planning and guidance of bronchoscopy. Unfortunately, no IGI system exists that integrates all sources effectively through the complete lung-cancer staging work flow. This paper presents a prototype of a computer-based multimodal IGI system that strives to fill this need. The system combines a wide range of automatic and semi-automatic image-processing tools for multimodal data fusion and procedure planning. It also provides a flexible graphical user interface for follow-on guidance of bronchoscopy/EBUS. Human-study results demonstrate the system's potential.

Predicting standard-dose PET image from low-dose PET and multimodal MR images using mapping-based sparse representation

International Nuclear Information System (INIS)

Wang, Yan; Zhou, Jiliu; Zhang, Pei; An, Le; Ma, Guangkai; Kang, Jiayin; Shi, Feng; Shen, Dinggang; Wu, Xi; Lalush, David S; Lin, Weili

2016-01-01

Positron emission tomography (PET) has been widely used in clinical diagnosis for diseases and disorders. To obtain high-quality PET images requires a standard-dose radionuclide (tracer) injection into the human body, which inevitably increases risk of radiation exposure. One possible solution to this problem is to predict the standard-dose PET image from its low-dose counterpart and its corresponding multimodal magnetic resonance (MR) images. Inspired by the success of patch-based sparse representation (SR) in super-resolution image reconstruction, we propose a mapping-based SR (m-SR) framework for standard-dose PET image prediction. Compared with the conventional patch-based SR, our method uses a mapping strategy to ensure that the sparse coefficients, estimated from the multimodal MR images and low-dose PET image, can be applied directly to the prediction of standard-dose PET image. As the mapping between multimodal MR images (or low-dose PET image) and standard-dose PET images can be particularly complex, one step of mapping is often insufficient. To this end, an incremental refinement framework is therefore proposed. Specifically, the predicted standard-dose PET image is further mapped to the target standard-dose PET image, and then the SR is performed again to predict a new standard-dose PET image. This procedure can be repeated for prediction refinement of the iterations. Also, a patch selection based dictionary construction method is further used to speed up the prediction process. The proposed method is validated on a human brain dataset. The experimental results show that our method can outperform benchmark methods in both qualitative and quantitative measures. (paper)

In vivo mapping of vascular inflammation using multimodal imaging.

Directory of Open Access Journals (Sweden)

Benjamin R Jarrett

2010-10-01

Full Text Available Plaque vulnerability to rupture has emerged as a critical correlate to risk of adverse coronary events but there is as yet no clinical method to assess plaque stability in vivo. In the search to identify biomarkers of vulnerable plaques an association has been found between macrophages and plaque stability--the density and pattern of macrophage localization in lesions is indicative of probability to rupture. In very unstable plaques, macrophages are found in high densities and concentrated in the plaque shoulders. Therefore, the ability to map macrophages in plaques could allow noninvasive assessment of plaque stability. We use a multimodality imaging approach to noninvasively map the distribution of macrophages in vivo. The use of multiple modalities allows us to combine the complementary strengths of each modality to better visualize features of interest. Our combined use of Positron Emission Tomography and Magnetic Resonance Imaging (PET/MRI allows high sensitivity PET screening to identify putative lesions in a whole body view, and high resolution MRI for detailed mapping of biomarker expression in the lesions.Macromolecular and nanoparticle contrast agents targeted to macrophages were developed and tested in three different mouse and rat models of atherosclerosis in which inflamed vascular plaques form spontaneously and/or are induced by injury. For multimodal detection, the probes were designed to contain gadolinium (T1 MRI or iron oxide (T2 MRI, and Cu-64 (PET. PET imaging was utilized to identify regions of macrophage accumulation; these regions were further probed by MRI to visualize macrophage distribution at high resolution. In both PET and MR images the probes enhanced contrast at sites of vascular inflammation, but not in normal vessel walls. MRI was able to identify discrete sites of inflammation that were blurred together at the low resolution of PET. Macrophage content in the lesions was confirmed by histology.The multimodal

PCANet-Based Structural Representation for Nonrigid Multimodal Medical Image Registration

Directory of Open Access Journals (Sweden)

Xingxing Zhu

2018-05-01

Full Text Available Nonrigid multimodal image registration remains a challenging task in medical image processing and analysis. The structural representation (SR-based registration methods have attracted much attention recently. However, the existing SR methods cannot provide satisfactory registration accuracy due to the utilization of hand-designed features for structural representation. To address this problem, the structural representation method based on the improved version of the simple deep learning network named PCANet is proposed for medical image registration. In the proposed method, PCANet is firstly trained on numerous medical images to learn convolution kernels for this network. Then, a pair of input medical images to be registered is processed by the learned PCANet. The features extracted by various layers in the PCANet are fused to produce multilevel features. The structural representation images are constructed for two input images based on nonlinear transformation of these multilevel features. The Euclidean distance between structural representation images is calculated and used as the similarity metrics. The objective function defined by the similarity metrics is optimized by L-BFGS method to obtain parameters of the free-form deformation (FFD model. Extensive experiments on simulated and real multimodal image datasets show that compared with the state-of-the-art registration methods, such as modality-independent neighborhood descriptor (MIND, normalized mutual information (NMI, Weber local descriptor (WLD, and the sum of squared differences on entropy images (ESSD, the proposed method provides better registration performance in terms of target registration error (TRE and subjective human vision.

Multimodal Image Alignment via Linear Mapping between Feature Modalities.

Science.gov (United States)

Jiang, Yanyun; Zheng, Yuanjie; Hou, Sujuan; Chang, Yuchou; Gee, James

2017-01-01

We propose a novel landmark matching based method for aligning multimodal images, which is accomplished uniquely by resolving a linear mapping between different feature modalities. This linear mapping results in a new measurement on similarity of images captured from different modalities. In addition, our method simultaneously solves this linear mapping and the landmark correspondences by minimizing a convex quadratic function. Our method can estimate complex image relationship between different modalities and nonlinear nonrigid spatial transformations even in the presence of heavy noise, as shown in our experiments carried out by using a variety of image modalities.

Multimodal location estimation of videos and images

CERN Document Server

Friedland, Gerald

2015-01-01

This book presents an overview of the field of multimodal location estimation, i.e. using acoustic, visual, and/or textual cues to estimate the shown location of a video recording. The authors' sample research results in this field in a unified way integrating research work on this topic that focuses on different modalities, viewpoints, and applications. The book describes fundamental methods of acoustic, visual, textual, social graph, and metadata processing as well as multimodal integration methods used for location estimation. In addition, the text covers benchmark metrics and explores the limits of the technology based on a human baseline. ·         Discusses localization of multimedia data; ·         Examines fundamental methods of establishing location metadata for images and videos (other than GPS tagging); ·         Covers Data-Driven as well as Semantic Location Estimation.

Hybrid of two-photon microscopy and optical multimodality imaging for multi-scale imaging of small animals

Science.gov (United States)

Li, Tianmeng; Hui, Hui; Ma, He; Yang, Xin; Tian, Jie

2018-02-01

Non-invasive imaging technologies, such as magnetic resonance imaging (MRI) and optical multimodality imaging methods, are commonly used for diagnosing and supervising the development of inflammatory bowel disease (IBD). These in vivo imaging methods can provide morphology changes information of IBD in macro-scale. However, it is difficult to investigate the intestinal wall in molecular and cellular level. State-of-art light-sheet and two-photon microscopy have the ability to acquire the changes for IBD in micro-scale. The aim of this work is to evaluate the size of the enterocoel and the thickness of colon wall using both MRI for in vivo imaging, and light-sheet and two-photon microscope for in vitro imaging. C57BL/6 mice were received 3.5% Dextran sodium sulfate (DSS) in the drinking water for 5 days to build IBD model. Mice were imaged with MRI on days 0, 6 to observe colitis progression. After MRI imaging, the mice were sacrificed to take colons for tissue clearing. Then, light-sheet and two-photon microscopies are used for in vitro imaging of the cleared samples. The experimental group showed symptoms of bloody stools, sluggishness and weight loss. It showed that the colon wall was thicker while the enterocoel was narrower compare to control group. The more details are observed using light-sheet and two-photon microscope. It is demonstrated that hybrid of MRI in macro-scale and light-sheet and two-photon microscopy in micro-scale imaging is feasible for colon inflammation diagnosing and supervising.

Design and Applications of a Multimodality Image Data Warehouse Framework

Science.gov (United States)

Wong, Stephen T.C.; Hoo, Kent Soo; Knowlton, Robert C.; Laxer, Kenneth D.; Cao, Xinhau; Hawkins, Randall A.; Dillon, William P.; Arenson, Ronald L.

2002-01-01

A comprehensive data warehouse framework is needed, which encompasses imaging and non-imaging information in supporting disease management and research. The authors propose such a framework, describe general design principles and system architecture, and illustrate a multimodality neuroimaging data warehouse system implemented for clinical epilepsy research. The data warehouse system is built on top of a picture archiving and communication system (PACS) environment and applies an iterative object-oriented analysis and design (OOAD) approach and recognized data interface and design standards. The implementation is based on a Java CORBA (Common Object Request Broker Architecture) and Web-based architecture that separates the graphical user interface presentation, data warehouse business services, data staging area, and backend source systems into distinct software layers. To illustrate the practicality of the data warehouse system, the authors describe two distinct biomedical applications—namely, clinical diagnostic workup of multimodality neuroimaging cases and research data analysis and decision threshold on seizure foci lateralization. The image data warehouse framework can be modified and generalized for new application domains. PMID:11971885

Visual tracking for multi-modality computer-assisted image guidance

Science.gov (United States)

Basafa, Ehsan; Foroughi, Pezhman; Hossbach, Martin; Bhanushali, Jasmine; Stolka, Philipp

2017-03-01

With optical cameras, many interventional navigation tasks previously relying on EM, optical, or mechanical guidance can be performed robustly, quickly, and conveniently. We developed a family of novel guidance systems based on wide-spectrum cameras and vision algorithms for real-time tracking of interventional instruments and multi-modality markers. These navigation systems support the localization of anatomical targets, support placement of imaging probe and instruments, and provide fusion imaging. The unique architecture - low-cost, miniature, in-hand stereo vision cameras fitted directly to imaging probes - allows for an intuitive workflow that fits a wide variety of specialties such as anesthesiology, interventional radiology, interventional oncology, emergency medicine, urology, and others, many of which see increasing pressure to utilize medical imaging and especially ultrasound, but have yet to develop the requisite skills for reliable success. We developed a modular system, consisting of hardware (the Optical Head containing the mini cameras) and software (components for visual instrument tracking with or without specialized visual features, fully automated marker segmentation from a variety of 3D imaging modalities, visual observation of meshes of widely separated markers, instant automatic registration, and target tracking and guidance on real-time multi-modality fusion views). From these components, we implemented a family of distinct clinical and pre-clinical systems (for combinations of ultrasound, CT, CBCT, and MRI), most of which have international regulatory clearance for clinical use. We present technical and clinical results on phantoms, ex- and in-vivo animals, and patients.

Evaluation of Multimodal Imaging Biomarkers of Prostate Cancer

Science.gov (United States)

2016-11-01

relationship prostate cancer growth, androgen receptor (AR) levels, hypoxia, and translocator protein (TSPO) levels. As described in the statement of work... bladder uptake) that enable robust detection of small prostate cancers . In contrast, high background and variable uptake of FDHT and FMISO confounded the...Award Number: W81XWH-12-1-0245 TITLE: Evaluation of Multimodal Imaging Biomarkers of Prostate Cancer PRINCIPAL INVESTIGATOR: Christopher Chad

Multimodality Registration without a Dedicated Multimodality Scanner

Directory of Open Access Journals (Sweden)

Bradley J. Beattie

2007-03-01

Full Text Available Multimodality scanners that allow the acquisition of both functional and structural image sets on a single system have recently become available for animal research use. Although the resultant registered functional/structural image sets can greatly enhance the interpretability of the functional data, the cost of multimodality systems can be prohibitive, and they are often limited to two modalities, which generally do not include magnetic resonance imaging. Using a thin plastic wrap to immobilize and fix a mouse or other small animal atop a removable bed, we are able to calculate registrations between all combinations of four different small animal imaging scanners (positron emission tomography, single-photon emission computed tomography, magnetic resonance, and computed tomography [CT] at our disposal, effectively equivalent to a quadruple-modality scanner. A comparison of serially acquired CT images, with intervening acquisitions on other scanners, demonstrates the ability of the proposed procedures to maintain the rigidity of an anesthetized mouse during transport between scanners. Movement of the bony structures of the mouse was estimated to be 0.62 mm. Soft tissue movement was predominantly the result of the filling (or emptying of the urinary bladder and thus largely constrained to this region. Phantom studies estimate the registration errors for all registration types to be less than 0.5 mm. Functional images using tracers targeted to known structures verify the accuracy of the functional to structural registrations. The procedures are easy to perform and produce robust and accurate results that rival those of dedicated multimodality scanners, but with more flexible registration combinations and while avoiding the expense and redundancy of multimodality systems.

Multifunctional Gold Nanostars for Molecular Imaging and Cancer Therapy

Science.gov (United States)

Liu, Yang; Yuan, Hsiangkuo; Fales, Andrew; Register, Janna; Vo-Dinh, Tuan

2015-08-01

Plasmonics-active gold nanoparticles offer excellent potential in molecular imaging and cancer therapy. Among them, gold nanostars (AuNS) exhibit cross-platform flexibility as multimodal contrast agents for macroscopic X-ray computer tomography (CT), magnetic resonance imaging (MRI), positron emission tomography (PET), as well as nanoprobes for photoacoustic tomography (PAT), two-photon photoluminescence (TPL) and surface-enhanced Raman spectroscopy (SERS). Their surfactant-free surface enables versatile functionalization to enhance cancer targeting, and allow triggered drug release. AuNS can also be used as an efficient platform for drug carrying, photothermal therapy, and photodynamic therapy. This review paper presents the latest progress regarding AuNS as a promising nanoplatform for cancer nanotheranostics. Future research directions with AuNS for biomedical applications will also be discussed.

Towards an ultra-thin medical endoscope: multimode fibre as a wide-field image transferring medium

Science.gov (United States)

Duriš, Miroslav; Bradu, Adrian; Podoleanu, Adrian; Hughes, Michael

2018-03-01

Multimode optical fibres are attractive for biomedical and industrial applications such as endoscopes because of the small cross section and imaging resolution they can provide in comparison to widely-used fibre bundles. However, the image is randomly scrambled by propagation through a multimode fibre. Even though the scrambling is unpredictable, it is deterministic, and therefore the scrambling can be reversed. To unscramble the image, we treat the multimode fibre as a linear, disordered scattering medium. To calibrate, we scan a focused beam of coherent light over thousands of different beam positions at the distal end and record complex fields at the proximal end of the fibre. This way, the inputoutput response of the system is determined, which then allows computational reconstruction of reflection-mode images. However, there remains the problem of illuminating the tissue via the fibre while avoiding back reflections from the proximal face. To avoid this drawback, we provide here the first preliminary confirmation that an image can be transferred through a 2x2 fibre coupler, with the sample at its distal port interrogated in reflection. Light is injected into one port for illumination and then collected from a second port for imaging.

A Pretargeted Approach for the Multimodal PET/NIRF Imaging of Colorectal Cancer.

Science.gov (United States)

Adumeau, Pierre; Carnazza, Kathryn E; Brand, Christian; Carlin, Sean D; Reiner, Thomas; Agnew, Brian J; Lewis, Jason S; Zeglis, Brian M

2016-01-01

The complementary nature of positron emission tomography (PET) and near-infrared fluorescence (NIRF) imaging makes the development of strategies for the multimodal PET/NIRF imaging of cancer a very enticing prospect. Indeed, in the context of colorectal cancer, a single multimodal PET/NIRF imaging agent could be used to stage the disease, identify candidates for surgical intervention, and facilitate the image-guided resection of the disease. While antibodies have proven to be highly effective vectors for the delivery of radioisotopes and fluorophores to malignant tissues, the use of radioimmunoconjugates labeled with long-lived nuclides such as 89 Zr poses two important clinical complications: high radiation doses to the patient and the need for significant lag time between imaging and surgery. In vivo pretargeting strategies that decouple the targeting vector from the radioactivity at the time of injection have the potential to circumvent these issues by facilitating the use of positron-emitting radioisotopes with far shorter half-lives. Here, we report the synthesis, characterization, and in vivo validation of a pretargeted strategy for the multimodal PET and NIRF imaging of colorectal carcinoma. This approach is based on the rapid and bioorthogonal ligation between a trans -cyclooctene- and fluorophore-bearing immunoconjugate of the huA33 antibody (huA33-Dye800-TCO) and a 64 Cu-labeled tetrazine radioligand ( 64 Cu-Tz-SarAr). In vivo imaging experiments in mice bearing A33 antigen-expressing SW1222 colorectal cancer xenografts clearly demonstrate that this approach enables the non-invasive visualization of tumors and the image-guided resection of malignant tissue, all at only a fraction of the radiation dose created by a directly labeled radioimmunoconjugate. Additional in vivo experiments in peritoneal and patient-derived xenograft models of colorectal carcinoma reinforce the efficacy of this methodology and underscore its potential as an innovative and useful

Multicomponent, peptide-targeted glycol chitosan nanoparticles containing ferrimagnetic iron oxide nanocubes for bladder cancer multimodal imaging

Directory of Open Access Journals (Sweden)

Key J

2016-08-01

Full Text Available Jaehong Key,1,2 Deepika Dhawan,3 Christy L Cooper,3,4 Deborah W Knapp,3 Kwangmeyung Kim,5 Ick Chan Kwon,5 Kuiwon Choi,5 Kinam Park,1,6 Paolo Decuzzi,7–9 James F Leary1,3,41Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN, USA; 2Department of Biomedical Engineering, Yonsei University, Wonju, Republic of Korea; 3School of Veterinary Medicine-Department of Basic Medical Sciences, Purdue University, West Lafayette, 4Birck Nanotechnology Center at Discovery Park, Purdue University, West Lafayette, IN, USA; 5Biomedical Research Center, Korea Institute of Science and Technology, Sungbook-Gu, Seoul, Republic of Korea; 6Department of Pharmaceutics, Purdue University, West Lafayette, IN, 7Department of Translational Imaging, 8Department of Nanomedicine, Houston Methodist Research Institute, Houston, TX USA; 9Laboratory of Nanotechnology for Precision Medicine, Fondazione Istituto Italiano di Tecnologia (IIT, Genova, Italy Abstract: While current imaging modalities, such as magnetic resonance imaging (MRI, computed tomography, and positron emission tomography, play an important role in detecting tumors in the body, no single-modality imaging possesses all the functions needed for a complete diagnostic imaging, such as spatial resolution, signal sensitivity, and tissue penetration depth. For this reason, multimodal imaging strategies have become promising tools for advanced biomedical research and cancer diagnostics and therapeutics. In designing multimodal nanoparticles, the physicochemical properties of the nanoparticles should be engineered so that they successfully accumulate at the tumor site and minimize nonspecific uptake by other organs. Finely altering the nano-scale properties can dramatically change the biodistribution and tumor accumulation of nanoparticles in the body. In this study, we engineered multimodal nanoparticles for both MRI, by using ferrimagnetic nanocubes (NCs, and near infrared fluorescence imaging

Development of a hardware-based registration system for the multimodal medical images by USB cameras

International Nuclear Information System (INIS)

Iwata, Michiaki; Minato, Kotaro; Watabe, Hiroshi; Koshino, Kazuhiro; Yamamoto, Akihide; Iida, Hidehiro

2009-01-01

There are several medical imaging scanners and each modality has different aspect for visualizing inside of human body. By combining these images, diagnostic accuracy could be improved, and therefore, several attempts for multimodal image registration have been implemented. One popular approach is to use hybrid image scanners such as positron emission tomography (PET)/CT and single photon emission computed tomography (SPECT)/CT. However, these hybrid scanners are expensive and not fully available. We developed multimodal image registration system with universal serial bus (USB) cameras, which is inexpensive and applicable to any combinations of existed conventional imaging scanners. The multiple USB cameras will determine the three dimensional positions of a patient while scanning. Using information of these positions and rigid body transformation, the acquired image is registered to the common coordinate which is shared with another scanner. For each scanner, reference marker is attached on gantry of the scanner. For observing the reference marker's position by the USB cameras, the location of the USB cameras can be arbitrary. In order to validate the system, we scanned a cardiac phantom with different positions by PET and MRI scanners. Using this system, images from PET and MRI were visually aligned, and good correlations between PET and MRI images were obtained after the registration. The results suggest this system can be inexpensively used for multimodal image registrations. (author)

Echocardiography in the Era of Multimodality Cardiovascular Imaging

Science.gov (United States)

Shah, Benoy Nalin

2013-01-01

Echocardiography remains the most frequently performed cardiac imaging investigation and is an invaluable tool for detailed and accurate evaluation of cardiac structure and function. Echocardiography, nuclear cardiology, cardiac magnetic resonance imaging, and cardiovascular-computed tomography comprise the subspeciality of cardiovascular imaging, and these techniques are often used together for a multimodality, comprehensive assessment of a number of cardiac diseases. This paper provides the general cardiologist and physician with an overview of state-of-the-art modern echocardiography, summarising established indications as well as highlighting advances in stress echocardiography, three-dimensional echocardiography, deformation imaging, and contrast echocardiography. Strengths and limitations of echocardiography are discussed as well as the growing role of real-time three-dimensional echocardiography in the guidance of structural heart interventions in the cardiac catheter laboratory. PMID:23878804

Extended feature-fusion guidelines to improve image-based multi-modal biometrics

CSIR Research Space (South Africa)

Brown, Dane

2016-09-01

Full Text Available The feature-level, unlike the match score-level, lacks multi-modal fusion guidelines. This work demonstrates a practical approach for improved image-based biometric feature-fusion. The approach extracts and combines the face, fingerprint...

Multi-Modality Medical Image Fusion Based on Wavelet Analysis and Quality Evaluation

Institute of Scientific and Technical Information of China (English)

无

2001-01-01

Multi-modality medical image fusion has more and more important applications in medical image analysisand understanding. In this paper, we develop and apply a multi-resolution method based on wavelet pyramid to fusemedical images from different modalities such as PET-MRI and CT-MRI. In particular, we evaluate the different fusionresults when applying different selection rules and obtain optimum combination of fusion parameters.

Metal complex-based templates and nanostructures for magnetic resonance/optical multimodal imaging agents

NARCIS (Netherlands)

Galindo Millan, Jealemy

2012-01-01

In this thesis, new approaches directed towards simple and functional imaging agents (IAs) for magnetic resonance (MR) and fluorescence multimodal imaging are proposed. In Chapter 3, hybrid silver nanostructures (hAgNSs), grown using a polyamino carboxylic acid scaffold, namely

Ethernet image communication performance in a multimodal PACS network

International Nuclear Information System (INIS)

Lou, S.L.; Valentino, D.J.; Chan, K.K.; Huang, H.K.

1989-01-01

The authors have evaluated the performance of an Ethernet network in a multimodal picture archiving and communications system (PACS) environment. The study included measurements between Sun workstations and PC- AT computers running communication software at the TCP level. First they initiated image transfers between two workstations, a server and a client. Next, they successively added clients to transfer images to the server and they measured degradation in network performance. Finally, they initiated image transfers between pairs of workstations and again measured performance degradation. The results of the authors' experiments indicate that Ethernet is suitable for image communication only in limited network situations. They discuss how to maximize network performance given these constraints

Improving supervised classification accuracy using non-rigid multimodal image registration: detecting prostate cancer

Science.gov (United States)

Chappelow, Jonathan; Viswanath, Satish; Monaco, James; Rosen, Mark; Tomaszewski, John; Feldman, Michael; Madabhushi, Anant

2008-03-01

Computer-aided diagnosis (CAD) systems for the detection of cancer in medical images require precise labeling of training data. For magnetic resonance (MR) imaging (MRI) of the prostate, training labels define the spatial extent of prostate cancer (CaP); the most common source for these labels is expert segmentations. When ancillary data such as whole mount histology (WMH) sections, which provide the gold standard for cancer ground truth, are available, the manual labeling of CaP can be improved by referencing WMH. However, manual segmentation is error prone, time consuming and not reproducible. Therefore, we present the use of multimodal image registration to automatically and accurately transcribe CaP from histology onto MRI following alignment of the two modalities, in order to improve the quality of training data and hence classifier performance. We quantitatively demonstrate the superiority of this registration-based methodology by comparing its results to the manual CaP annotation of expert radiologists. Five supervised CAD classifiers were trained using the labels for CaP extent on MRI obtained by the expert and 4 different registration techniques. Two of the registration methods were affi;ne schemes; one based on maximization of mutual information (MI) and the other method that we previously developed, Combined Feature Ensemble Mutual Information (COFEMI), which incorporates high-order statistical features for robust multimodal registration. Two non-rigid schemes were obtained by succeeding the two affine registration methods with an elastic deformation step using thin-plate splines (TPS). In the absence of definitive ground truth for CaP extent on MRI, classifier accuracy was evaluated against 7 ground truth surrogates obtained by different combinations of the expert and registration segmentations. For 26 multimodal MRI-WMH image pairs, all four registration methods produced a higher area under the receiver operating characteristic curve compared to that

Robust Multimodal Dictionary Learning

Science.gov (United States)

Cao, Tian; Jojic, Vladimir; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

2014-01-01

We propose a robust multimodal dictionary learning method for multimodal images. Joint dictionary learning for both modalities may be impaired by lack of correspondence between image modalities in training data, for example due to areas of low quality in one of the modalities. Dictionaries learned with such non-corresponding data will induce uncertainty about image representation. In this paper, we propose a probabilistic model that accounts for image areas that are poorly corresponding between the image modalities. We cast the problem of learning a dictionary in presence of problematic image patches as a likelihood maximization problem and solve it with a variant of the EM algorithm. Our algorithm iterates identification of poorly corresponding patches and re-finements of the dictionary. We tested our method on synthetic and real data. We show improvements in image prediction quality and alignment accuracy when using the method for multimodal image registration. PMID:24505674

Single-pulse CARS based multimodal nonlinear optical microscope for bioimaging.

Science.gov (United States)

Kumar, Sunil; Kamali, Tschackad; Levitte, Jonathan M; Katz, Ori; Hermann, Boris; Werkmeister, Rene; Považay, Boris; Drexler, Wolfgang; Unterhuber, Angelika; Silberberg, Yaron

2015-05-18

Noninvasive label-free imaging of biological systems raises demand not only for high-speed three-dimensional prescreening of morphology over a wide-field of view but also it seeks to extract the microscopic functional and molecular details within. Capitalizing on the unique advantages brought out by different nonlinear optical effects, a multimodal nonlinear optical microscope can be a powerful tool for bioimaging. Bringing together the intensity-dependent contrast mechanisms via second harmonic generation, third harmonic generation and four-wave mixing for structural-sensitive imaging, and single-beam/single-pulse coherent anti-Stokes Raman scattering technique for chemical sensitive imaging in the finger-print region, we have developed a simple and nearly alignment-free multimodal nonlinear optical microscope that is based on a single wide-band Ti:Sapphire femtosecond pulse laser source. Successful imaging tests have been realized on two exemplary biological samples, a canine femur bone and collagen fibrils harvested from a rat tail. Since the ultra-broad band-width femtosecond laser is a suitable source for performing high-resolution optical coherence tomography, a wide-field optical coherence tomography arm can be easily incorporated into the presented multimodal microscope making it a versatile optical imaging tool for noninvasive label-free bioimaging.

Multimode optical dermoscopy (SkinSpect) analysis for skin with melanocytic nevus

Science.gov (United States)

Vasefi, Fartash; MacKinnon, Nicholas; Saager, Rolf; Kelly, Kristen M.; Maly, Tyler; Chave, Robert; Booth, Nicholas; Durkin, Anthony J.; Farkas, Daniel L.

2016-04-01

We have developed a multimode dermoscope (SkinSpect™) capable of illuminating human skin samples in-vivo with spectrally-programmable linearly-polarized light at 33 wavelengths between 468nm and 857 nm. Diffusely reflected photons are separated into collinear and cross-polarized image paths and images captured for each illumination wavelength. In vivo human skin nevi (N = 20) were evaluated with the multimode dermoscope and melanin and hemoglobin concentrations were compared with Spatially Modulated Quantitative Spectroscopy (SMoQS) measurements. Both systems show low correlation between their melanin and hemoglobin concentrations, demonstrating the ability of the SkinSpect™ to separate these molecular signatures and thus act as a biologically plausible device capable of early onset melanoma detection.

Multimodal nonlinear imaging of arabidopsis thaliana root cell

Science.gov (United States)

Jang, Bumjoon; Lee, Sung-Ho; Woo, Sooah; Park, Jong-Hyun; Lee, Myeong Min; Park, Seung-Han

2017-07-01

Nonlinear optical microscopy has enabled the possibility to explore inside the living organisms. It utilizes ultrashort laser pulse with long wavelength (greater than 800nm). Ultrashort pulse produces high peak power to induce nonlinear optical phenomenon such as two-photon excitation fluorescence (TPEF) and harmonic generations in the medium while maintaining relatively low average energy pre area. In plant developmental biology, confocal microscopy is widely used in plant cell imaging after the development of biological fluorescence labels in mid-1990s. However, fluorescence labeling itself affects the sample and the sample deviates from intact condition especially when labelling the entire cell. In this work, we report the dynamic images of Arabidopsis thaliana root cells. This demonstrates the multimodal nonlinear optical microscopy is an effective tool for long-term plant cell imaging.

Highlights lecture EANM 2016: ''Embracing molecular imaging and multi-modal imaging: a smart move for nuclear medicine towards personalized medicine''

Energy Technology Data Exchange (ETDEWEB)

Aboagye, Eric O. [Imperial College London, Cancer Imaging Centre, Department of Surgery and Cancer, London (United Kingdom); Kraeber-Bodere, Francoise [Hotel Dieu University Hospital, Nuclear Medicine, Nantes (France); CRCINA, Inserm U1232, Nantes (France); ICO Cancer Center, Nuclear Medicine, Saint-Herblain (France)

2017-08-15

The 2016 EANM Congress took place in Barcelona, Spain, from 15 to 19 October under the leadership of Prof. Wim Oyen, chair of the EANM Scientific Committee. With more than 6,000 participants, this congress was the most important European event in nuclear medicine, bringing together a multidisciplinary community involved in the different fields of nuclear medicine. There were over 600 oral and 1,200 poster or e-Poster presentations with an overwhelming focus on development and application of imaging for personalized care, which is timely for the community. Beyond FDG PET, major highlights included progress in the use of PSMA and SSTR receptor-targeted radiopharmaceuticals and associated theranostics in oncology. Innovations in radiopharmaceuticals for imaging pathologies of the brain and cardiovascular system, as well as infection and inflammation, were also highlighted. In the areas of physics and instrumentation, multimodality imaging and radiomics were highlighted as promising areas of research. (orig.)

Nuclear medicine and multimodality imaging of pediatric neuroblastoma

Energy Technology Data Exchange (ETDEWEB)

Mueller, Wolfgang Peter; Pfluger, Thomas [Ludwig-Maximilians-University of Munich, Department of Nuclear Medicine, Munich (Germany); Coppenrath, Eva [Ludwig-Maximilians-University of Munich, Department of Radiology, Munich (Germany)

2013-04-15

Neuroblastoma is an embryonic tumor of the peripheral sympathetic nervous system and is metastatic or high risk for relapse in nearly 50% of cases. Therefore, exact staging with radiological and nuclear medicine imaging methods is crucial for defining the adequate therapeutic choice. Tumor cells express the norepinephrine transporter, which makes metaiodobenzylguanidine (MIBG), an analogue of norepinephrine, an ideal tumor specific agent for imaging. MIBG imaging has several disadvantages, such as limited spatial resolution, limited sensitivity in small lesions and the need for two or even more acquisition sessions. Most of these limitations can be overcome with positron emission tomography (PET) using [F-18]2-fluoro-2-deoxyglucose [FDG]. Furthermore, new tracers, such as fluorodopa or somatostatin receptor agonists, have been tested for imaging neuroblastoma recently. However, MIBG scintigraphy and PET alone are not sufficient for operative or biopsy planning. In this regard, a combination with morphological imaging is indispensable. This article will discuss strategies for primary and follow-up diagnosis in neuroblastoma using different nuclear medicine and radiological imaging methods as well as multimodality imaging. (orig.)

Multi-Modality Registration And Fusion Of Medical Image Data

International Nuclear Information System (INIS)

Kassak, P.; Vencko, D.; Cerovsky, I.

2008-01-01

Digitalisation of health care providing facilities allows US to maximize the usage of digital data from one patient obtained by various modalities. Complex view on to the problem can be achieved from the site of morphology as well as functionality. Multi-modal registration and fusion of medical image data is one of the examples that provides improved insight and allows more precise approach and treatment. (author)

Multimodality Molecular Imaging of [18F]-Fluorinated Carboplatin Derivative Encapsulated in [111In]-Labeled Liposomes

Science.gov (United States)

Lamichhane, Narottam

Platinum based chemotherapy is amongst the mainstream DNA-damaging agents used in clinical cancer therapy today. Agents such as cisplatin, carboplatin are clinically prescribed for the treatment of solid tumors either as single agents, in combination, or as part of multi-modality treatment strategy. Despite the potent anti-tumor activity of these drugs, overall effectiveness is still hampered by inadequate delivery and retention of drug in tumor and unwanted normal tissue toxicity, induced by non-selective accumulation of drug in normal cells and tissues. Utilizing molecular imaging and nanoparticle technologies, this thesis aims to contribute to better understanding of how to improve the profile of platinum based therapy. By developing a novel fluorinated derivative of carboplatin, incorporating a Flourine-18 (18F) moiety as an inherent part of the molecule, quantitative measures of drug concentration in tumors and normal tissues can be directly determined in vivo and within the intact individual environment. A potential impact of this knowledge will be helpful in predicting the overall response of individual patients to the treatment. Specifically, the aim of this project, therefore, is the development of a fluorinated carboplatin drug derivative with an inherent positron emission tomography (PET) imaging capability, so that the accumulation of the drug in the tumor and normal organs can be studied during the course of therapy . A secondary objective of this research is to develop a proof of concept for simultaneous imaging of a PET radiolabeled drug with a SPECT radiolabeled liposomal formulation, enabling thereby bi-modal imaging of drug and delivery vehicle in vivo. The approach is challenging because it involves development in PET radiochemistry, PET and SPECT imaging, drug liposomal encapsulation, and a dual-modal imaging of radiolabeled drug and radiolabeled vehicle. The principal development is the synthesis of fluorinated carboplatin 19F-FCP using 2

Compositional-prior-guided image reconstruction algorithm for multi-modality imaging

Science.gov (United States)

Fang, Qianqian; Moore, Richard H.; Kopans, Daniel B.; Boas, David A.

2010-01-01

The development of effective multi-modality imaging methods typically requires an efficient information fusion model, particularly when combining structural images with a complementary imaging modality that provides functional information. We propose a composition-based image segmentation method for X-ray digital breast tomosynthesis (DBT) and a structural-prior-guided image reconstruction for a combined DBT and diffuse optical tomography (DOT) breast imaging system. Using the 3D DBT images from 31 clinically measured healthy breasts, we create an empirical relationship between the X-ray intensities for adipose and fibroglandular tissue. We use this relationship to then segment another 58 healthy breast DBT images from 29 subjects into compositional maps of different tissue types. For each breast, we build a weighted-graph in the compositional space and construct a regularization matrix to incorporate the structural priors into a finite-element-based DOT image reconstruction. Use of the compositional priors enables us to fuse tissue anatomy into optical images with less restriction than when using a binary segmentation. This allows us to recover the image contrast captured by DOT but not by DBT. We show that it is possible to fine-tune the strength of the structural priors by changing a single regularization parameter. By estimating the optical properties for adipose and fibroglandular tissue using the proposed algorithm, we found the results are comparable or superior to those estimated with expert-segmentations, but does not involve the time-consuming manual selection of regions-of-interest. PMID:21258460

Multimodal image registration based on binary gradient angle descriptor.

Science.gov (United States)

Jiang, Dongsheng; Shi, Yonghong; Yao, Demin; Fan, Yifeng; Wang, Manning; Song, Zhijian

2017-12-01

Multimodal image registration plays an important role in image-guided interventions/therapy and atlas building, and it is still a challenging task due to the complex intensity variations in different modalities. The paper addresses the problem and proposes a simple, compact, fast and generally applicable modality-independent binary gradient angle descriptor (BGA) based on the rationale of gradient orientation alignment. The BGA can be easily calculated at each voxel by coding the quadrant in which a local gradient vector falls, and it has an extremely low computational complexity, requiring only three convolutions, two multiplication operations and two comparison operations. Meanwhile, the binarized encoding of the gradient orientation makes the BGA more resistant to image degradations compared with conventional gradient orientation methods. The BGA can extract similar feature descriptors for different modalities and enable the use of simple similarity measures, which makes it applicable within a wide range of optimization frameworks. The results for pairwise multimodal and monomodal registrations between various images (T1, T2, PD, T1c, Flair) consistently show that the BGA significantly outperforms localized mutual information. The experimental results also confirm that the BGA can be a reliable alternative to the sum of absolute difference in monomodal image registration. The BGA can also achieve an accuracy of [Formula: see text], similar to that of the SSC, for the deformable registration of inhale and exhale CT scans. Specifically, for the highly challenging deformable registration of preoperative MRI and 3D intraoperative ultrasound images, the BGA achieves a similar registration accuracy of [Formula: see text] compared with state-of-the-art approaches, with a computation time of 18.3 s per case. The BGA improves the registration performance in terms of both accuracy and time efficiency. With further acceleration, the framework has the potential for

Multimodal Image-Based Virtual Reality Presurgical Simulation and Evaluation for Trigeminal Neuralgia and Hemifacial Spasm.

Science.gov (United States)

Yao, Shujing; Zhang, Jiashu; Zhao, Yining; Hou, Yuanzheng; Xu, Xinghua; Zhang, Zhizhong; Kikinis, Ron; Chen, Xiaolei

2018-05-01

To address the feasibility and predictive value of multimodal image-based virtual reality in detecting and assessing features of neurovascular confliction (NVC), particularly regarding the detection of offending vessels, degree of compression exerted on the nerve root, in patients who underwent microvascular decompression for nonlesional trigeminal neuralgia and hemifacial spasm (HFS). This prospective study includes 42 consecutive patients who underwent microvascular decompression for classic primary trigeminal neuralgia or HFS. All patients underwent preoperative 1.5-T magnetic resonance imaging (MRI) with T2-weighted three-dimensional (3D) sampling perfection with application-optimized contrasts by using different flip angle evolutions, 3D time-of-flight magnetic resonance angiography, and 3D T1-weighted gadolinium-enhanced sequences in combination, whereas 2 patients underwent extra experimental preoperative 7.0-T MRI scans with the same imaging protocol. Multimodal MRIs were then coregistered with open-source software 3D Slicer, followed by 3D image reconstruction to generate virtual reality (VR) images for detection of possible NVC in the cerebellopontine angle. Evaluations were performed by 2 reviewers and compared with the intraoperative findings. For detection of NVC, multimodal image-based VR sensitivity was 97.6% (40/41) and specificity was 100% (1/1). Compared with the intraoperative findings, the κ coefficients for predicting the offending vessel and the degree of compression were >0.75 (P < 0.001). The 7.0-T scans have a clearer view of vessels in the cerebellopontine angle, which may have significant impact on detection of small-caliber offending vessels with relatively slow flow speed in cases of HFS. Multimodal image-based VR using 3D sampling perfection with application-optimized contrasts by using different flip angle evolutions in combination with 3D time-of-flight magnetic resonance angiography sequences proved to be reliable in detecting NVC

Label-free imaging of arterial cells and extracellular matrix using a multimodal CARS microscope

Science.gov (United States)

Wang, Han-Wei; Le, Thuc T.; Cheng, Ji-Xin

2008-04-01

A multimodal nonlinear optical imaging system that integrates coherent anti-Stokes Raman scattering (CARS), sum-frequency generation (SFG), and two-photon excitation fluorescence (TPEF) on the same platform was developed and applied to visualize single cells and extracellular matrix in fresh carotid arteries. CARS signals arising from CH 2-rich membranes allowed visualization of endothelial cells and smooth muscle cells of the arterial wall. Additionally, CARS microscopy allowed vibrational imaging of elastin and collagen fibrils which are also rich in CH 2 bonds. The extracellular matrix organization was further confirmed by TPEF signals arising from elastin's autofluorescence and SFG signals arising from collagen fibrils' non-centrosymmetric structure. Label-free imaging of significant components of arterial tissues suggests the potential application of multimodal nonlinear optical microscopy to monitor onset and progression of arterial diseases.

Multimodal Discourse Analysis of the Movie "Argo"

Science.gov (United States)

Bo, Xu

2018-01-01

Based on multimodal discourse theory, this paper makes a multimodal discourse analysis of some shots in the movie "Argo" from the perspective of context of culture, context of situation and meaning of image. Results show that this movie constructs multimodal discourse through particular context, language and image, and successfully…

Multimodal imaging of vascular network and blood microcirculation by optical diagnostic techniques

International Nuclear Information System (INIS)

Kuznetsov, Yu L; Kalchenko, V V; Meglinski, I V

2011-01-01

We present a multimodal optical diagnostic approach for simultaneous non-invasive in vivo imaging of blood and lymphatic microvessels, utilising a combined use of fluorescence intravital microscopy and a method of dynamic light scattering. This approach makes it possible to renounce the use of fluorescent markers for visualisation of blood vessels and, therefore, significantly (tenfold) reduce the toxicity of the technique and minimise side effects caused by the use of contrast fluorescent markers. We demonstrate that along with the ability to obtain images of lymph and blood microvessels with a high spatial resolution, current multimodal approach allows one to observe in real time permeability of blood vessels. This technique appears to be promising in physiology studies of blood vessels, and especially in the study of peripheral cardiovascular system in vivo. (optical technologies in biophysics and medicine)

Introduction of a standardized multimodality image protocol for navigation-guided surgery of suspected low-grade gliomas.

Science.gov (United States)

Mert, Aygül; Kiesel, Barbara; Wöhrer, Adelheid; Martínez-Moreno, Mauricio; Minchev, Georgi; Furtner, Julia; Knosp, Engelbert; Wolfsberger, Stefan; Widhalm, Georg

2015-01-01

OBJECT Surgery of suspected low-grade gliomas (LGGs) poses a special challenge for neurosurgeons due to their diffusely infiltrative growth and histopathological heterogeneity. Consequently, neuronavigation with multimodality imaging data, such as structural and metabolic data, fiber tracking, and 3D brain visualization, has been proposed to optimize surgery. However, currently no standardized protocol has been established for multimodality imaging data in modern glioma surgery. The aim of this study was therefore to define a specific protocol for multimodality imaging and navigation for suspected LGG. METHODS Fifty-one patients who underwent surgery for a diffusely infiltrating glioma with nonsignificant contrast enhancement on MRI and available multimodality imaging data were included. In the first 40 patients with glioma, the authors retrospectively reviewed the imaging data, including structural MRI (contrast-enhanced T1-weighted, T2-weighted, and FLAIR sequences), metabolic images derived from PET, or MR spectroscopy chemical shift imaging, fiber tracking, and 3D brain surface/vessel visualization, to define standardized image settings and specific indications for each imaging modality. The feasibility and surgical relevance of this new protocol was subsequently prospectively investigated during surgery with the assistance of an advanced electromagnetic navigation system in the remaining 11 patients. Furthermore, specific surgical outcome parameters, including the extent of resection, histological analysis of the metabolic hotspot, presence of a new postoperative neurological deficit, and intraoperative accuracy of 3D brain visualization models, were assessed in each of these patients. RESULTS After reviewing these first 40 cases of glioma, the authors defined a specific protocol with standardized image settings and specific indications that allows for optimal and simultaneous visualization of structural and metabolic data, fiber tracking, and 3D brain

Full-Field Optical Coherence Tomography as a Diagnosis Tool: Recent Progress with Multimodal Imaging

Directory of Open Access Journals (Sweden)

Olivier Thouvenin

2017-03-01

Full Text Available Full-field optical coherence tomography (FF-OCT is a variant of OCT that is able to register 2D en face views of scattering samples at a given depth. Thanks to its superior resolution, it can quickly reveal information similar to histology without the need to physically section the sample. Sensitivity and specificity levels of diagnosis performed with FF-OCT are 80% to 95% of the equivalent histological diagnosis performances and could therefore benefit from improvement. Therefore, multimodal systems have been designed to increase the diagnostic performance of FF-OCT. In this paper, we will discuss which contrasts can be measured with such multimodal systems in the context of ex vivo biological tissue examination. We will particularly emphasize three multimodal combinations to measure the tissue mechanics, dynamics, and molecular content respectively.

MMX-I: A data-processing software for multi-modal X-ray imaging and tomography

International Nuclear Information System (INIS)

Bergamaschi, A; Medjoubi, K; Somogyi, A; Messaoudi, C; Marco, S

2017-01-01

Scanning hard X-ray imaging allows simultaneous acquisition of multimodal information, including X-ray fluorescence, absorption, phase and dark-field contrasts, providing structural and chemical details of the samples. Combining these scanning techniques with the infrastructure developed for fast data acquisition at Synchrotron Soleil permits to perform multimodal imaging and tomography during routine user experiments at the Nanoscopium beamline. A main challenge of such imaging techniques is the online processing and analysis of the generated very large volume (several hundreds of Giga Bytes) multimodal data-sets. This is especially important for the wide user community foreseen at the user oriented Nanoscopium beamline (e.g. from the fields of Biology, Life Sciences, Geology, Geobiology), having no experience in such data-handling. MMX-I is a new multi-platform open-source freeware for the processing and reconstruction of scanning multi-technique X-ray imaging and tomographic datasets. The MMX-I project aims to offer, both expert users and beginners, the possibility of processing and analysing raw data, either on-site or off-site. Therefore we have developed a multi-platform (Mac, Windows and Linux 64bit) data processing tool, which is easy to install, comprehensive, intuitive, extendable and user-friendly. MMX-I is now routinely used by the Nanoscopium user community and has demonstrated its performance in treating big data. (paper)

MMX-I: A data-processing software for multi-modal X-ray imaging and tomography

Science.gov (United States)

Bergamaschi, A.; Medjoubi, K.; Messaoudi, C.; Marco, S.; Somogyi, A.

2017-06-01

Scanning hard X-ray imaging allows simultaneous acquisition of multimodal information, including X-ray fluorescence, absorption, phase and dark-field contrasts, providing structural and chemical details of the samples. Combining these scanning techniques with the infrastructure developed for fast data acquisition at Synchrotron Soleil permits to perform multimodal imaging and tomography during routine user experiments at the Nanoscopium beamline. A main challenge of such imaging techniques is the online processing and analysis of the generated very large volume (several hundreds of Giga Bytes) multimodal data-sets. This is especially important for the wide user community foreseen at the user oriented Nanoscopium beamline (e.g. from the fields of Biology, Life Sciences, Geology, Geobiology), having no experience in such data-handling. MMX-I is a new multi-platform open-source freeware for the processing and reconstruction of scanning multi-technique X-ray imaging and tomographic datasets. The MMX-I project aims to offer, both expert users and beginners, the possibility of processing and analysing raw data, either on-site or off-site. Therefore we have developed a multi-platform (Mac, Windows and Linux 64bit) data processing tool, which is easy to install, comprehensive, intuitive, extendable and user-friendly. MMX-I is now routinely used by the Nanoscopium user community and has demonstrated its performance in treating big data.

Multimodality Imaging Probe for Positron Emission Tomography and Fluorescence Imaging Studies

Directory of Open Access Journals (Sweden)

Suresh K. Pandey

2014-05-01

Full Text Available Our goal is to develop multimodality imaging agents for use in cell tracking studies by positron emission tomography (PET and optical imaging (OI. For this purpose, bovine serum albumin (BSA was complexed with biotin (histologic studies, 5(6- carboxyfluorescein, succinimidyl ester (FAM SE (OI studies, and diethylenetriamine pentaacetic acid (DTPA for chelating gallium 68 (PET studies. For synthesis of BSA-biotin-FAM-DTPA, BSA was coupled to (+-biotin N-hydroxysuccinimide ester (biotin-NHSI. BSA- biotin was treated with DTPA-anhydride and biotin-BSA-DTPA was reacted with FAM. The biotin-BSA-DTPA-FAM was reacted with gallium chloride 3 to 5 mCi eluted from the generator using 0.1 N HCl and was passed through basic resin (AG 11 A8 and 150 mCi (100 μL, pH 7–8 was incubated with 0.1 mg of FAM conjugate (100 μL at room temperature for 15 minutes to give 66Ga-BSA-biotin-DTPA-FAM. A shaved C57 black mouse was injected with FAM conjugate (50 μL at one flank and FAM-68Ga (50 μL, 30 mCi at the other. Immediately after injection, the mouse was placed in a fluorescence imaging system (Kodak In-Vivo F, Bruker Biospin Co., Woodbridge, CT and imaged (Λex: 465 nm, Λem: 535 nm, time: 8 seconds, Xenon Light Source, Kodak. The same mouse was then placed under an Inveon microPET scanner (Siemens Medical Solutions, Knoxville, TN injected (intravenously with 25 μCi of 18F and after a half-hour (to allow sufficient bone uptake was imaged for 30 minutes. Molecular weight determined using matrix-associated laser desorption ionization (MALDI for the BSA sample was 66,485 Da and for biotin-BSA was 67,116 Da, indicating two biotin moieties per BSA molecule; for biotin-BSA-DTPA was 81,584 Da, indicating an average of 30 DTPA moieties per BSA molecule; and for FAM conjugate was 82,383 Da, indicating an average of 1.7 fluorescent moieties per BSA molecule. Fluorescence imaging clearly showed localization of FAM conjugate and FAM-68Ga at respective flanks of the mouse

Mannan-based conjugates as a multimodal imaging platform for lymph nodes

Czech Academy of Sciences Publication Activity Database

Rabyk, Mariia; Galisová, A.; Jirátová, M.; Patsula, Vitalii; Srbová, Linda; Loukotová, Lenka; Parnica, Jozef; Jirák, D.; Štěpánek, Petr; Hrubý, Martin

2018-01-01

Roč. 6, č. 17 (2018), s. 2584-2596 ISSN 2050-750X R&D Projects: GA MZd(CZ) NV15-25781A Institutional support: RVO:61389013 Keywords : polysaccharide modification * mannan * multimodal imaging Subject RIV: FR - Pharmacology ; Medidal Chemistry OBOR OECD: Pharmacology and pharmacy Impact factor: 4.543, year: 2016

Neuronal pathology in deep grey matter structures: a multimodal imaging analysis combining PET and MRI

Energy Technology Data Exchange (ETDEWEB)

Bosque-Freeman, L.; Leroy, C.; Galanaud, D.; Sureau, F.; Assouad, R.; Tourbah, A.; Papeix, C.; Comtat, C.; Trebossen, R.; Lubetzki, C.; Delforge, J.; Bottlaender, M.; Stankoff, B. [Serv. Hosp. Frederic Joliot, Orsay (France)

2009-07-01

Objective: To assess neuronal damage in deep gray matter structures by positron emission tomography (PET) using [{sup 11}C]-flumazenil (FMZ), a specific central benzodiazepine receptor antagonist, and [{sup 18}F]-fluorodeoxyglucose (FDG), which reflects neuronal metabolism. To compare results obtained by PET and those with multimodal magnetic resonance imaging (MRI). Background: It is now accepted that neuronal injury plays a crucial role in the occurrence and progression of neurological disability in multiple sclerosis (MS). To date, available MRI techniques do not specifically assess neuronal damage, but early abnormalities, such as iron deposition or atrophy, have been described in deep gray matter structures. Whether those MRI modifications correspond to neuronal damage remains to be further investigated. Materials and methods: Nine healthy volunteers were compared to 10 progressive and 9 relapsing remitting (RR) MS patients. Each subject performed two PET examinations with [{sup 11}C]-FMZ and [{sup 18}F]-FDG, on a high resolution research tomograph dedicated to brain imaging (Siemens Medical Solution, spatial resolution of 2.5 mm). Deep gray matter regions were manually segmented on T1-weighted MR images with the mutual information algorithm (www.brainvisa.info), and co-registered with PET images. A multimodal MRI including T1 pre and post gadolinium, T2-proton density sequences, magnetization transfer, diffusion tensor, and protonic spectroscopy was also performed for each subject. Results: On PET with [{sup 11}C]-FMZ, there was a pronounced decrease in receptor density for RR patients in all deep gray matter structures investigated, whereas the density was unchanged or even increased in the same regions for progressive patients. Whether the different patterns between RR and progressive patients reflect distinct pathogenic mechanisms is currently investigated by comparing PET and multimodal MRI results. Conclusion: Combination of PET and multimodal MR imaging

Preclinical Multimodal Molecular Imaging Using 18F-FDG PET/CT and MRI in a Phase I Study of a Knee Osteoarthritis in In Vivo Canine Model

Directory of Open Access Journals (Sweden)

Maria I. Menendez DVM, PhD

2017-03-01

Full Text Available The aim of this study was to use a multimodal molecular imaging approach to serially assess regional metabolic changes in the knee in an in vivo anterior cruciate ligament transection (ACLT canine model of osteoarthritis (OA. Five canine underwent ACLT in one knee and the contralateral knee served as uninjured control. Prior, 3, 6, and 12 weeks post-ACLT, the dogs underwent 18F-fluoro-d-glucose (18F-FDG positron emission tomography (PET/computed tomography (CT and magnetic resonance imaging (MRI. The MRI was coregistered with the PET/CT, and 3-dimensional regions of interest (ROIs were traced manually and maximum standardized uptake values (SUVmax were evaluated. 18F-fluoro-d-glucose SUVmax in the ACLT knee ROIs was significantly higher compared to the uninjured contralateral knees at 3, 6, and 12 weeks. Higher 18F-FDG uptake observed in ACLT knees compared to the uninjured knees reflects greater metabolic changes in the injured knees over time. Knee 18F-FDG uptake in an in vivo ACLT canine model using combined PET/CT and MRI demonstrated to be highly sensitive in the detection of metabolic alterations in osseous and nonosteochondral structures comprising the knee joint. 18F-fluoro-d-glucose appeared to be a capable potential imaging biomarker for early human knee OA diagnosis, prognosis, and management.

Water-stable NaLuF4-based upconversion nanophosphors with long-term validity for multimodal lymphatic imaging.

Science.gov (United States)

Zhou, Jing; Zhu, Xingjun; Chen, Min; Sun, Yun; Li, Fuyou

2012-09-01

Multimodal imaging is rapidly becoming an important tool for biomedical applications because it can compensate for the deficiencies of individual imaging modalities. Herein, multifunctional NaLuF(4)-based upconversion nanoparticles (Lu-UCNPs) were synthesized though a facile one-step microemulsion method under ambient condition. The doping of lanthanide ions (Gd(3+), Yb(3+) and Er(3+)/Tm(3+)) endows the Lu-UCNPs with high T(1)-enhancement, bright upconversion luminescence (UCL) emissions, and excellent X-ray absorption coefficient. Moreover, the as-prepared Lu-UCNPs are stable in water for more than six months, due to the protection of sodium glutamate and diethylene triamine pentacetate acid (DTPA) coordinating ligands on the surface. Lu-UCNPs have been successfully applied to the trimodal CT/MR/UCL lymphatic imaging on the modal of small animals. It is worth noting that Lu-UCNPs could be used for imaging even after preserving for over six months. In vitro transmission electron microscope (TEM), methyl thiazolyl tetrazolium (MTT) assay and histological analysis demonstrated that Lu-UCNPs exhibited low toxicity on living systems. Therefore, Lu-UCNPs could be multimodal agents for CT/MR/UCL imaging, and the concept can be served as a platform technology for the next-generation of probes for multimodal imaging. Copyright © 2012 Elsevier Ltd. All rights reserved.

Multimodality imaging in macular telangiectasia 2: A clue to its pathogenesis

Directory of Open Access Journals (Sweden)

Lihteh Wu

2015-01-01

Full Text Available Macular telangiectasia type 2 also known as idiopathic perifoveal telangiectasia and juxtafoveolar retinal telangiectasis type 2A is an acquired bilateral neurodegenerative macular disease that manifests itself during the fifth or sixth decades of life. It is characterized by minimal dilatation of the parafoveal capillaries with graying of the retinal area involved, a lack of lipid exudation, right-angled retinal venules, refractile deposits in the superficial retina, hyperplasia of the retinal pigment epithelium, foveal atrophy, and subretinal neovascularization (SRNV. Our understanding of the disease has paralleled advances in multimodality imaging of the fundus. Optical coherence tomography (OCT images typically demonstrate the presence of intraretinal hyporeflective spaces that are usually not related to retinal thickening or fluorescein leakage. The typical fluorescein angiographic (FA finding is a deep intraretinal hyperfluorescent staining in the temporal parafoveal area. With time, the staining may involve the whole parafoveal area but does not extend to the center of the fovea. Long-term prognosis for central vision is poor, because of the development of SRNV or macular atrophy. Its pathogenesis remains unclear but multimodality imaging with FA, spectral domain OCT, adaptive optics, confocal blue reflectance and short wave fundus autofluorescence implicate Müller cells and macular pigment. Currently, there is no known treatment for this condition.

Evaluation of registration strategies for multi-modality images of rat brain slices

International Nuclear Information System (INIS)

Palm, Christoph; Vieten, Andrea; Salber, Dagmar; Pietrzyk, Uwe

2009-01-01

In neuroscience, small-animal studies frequently involve dealing with series of images from multiple modalities such as histology and autoradiography. The consistent and bias-free restacking of multi-modality image series is obligatory as a starting point for subsequent non-rigid registration procedures and for quantitative comparisons with positron emission tomography (PET) and other in vivo data. Up to now, consistency between 2D slices without cross validation using an inherent 3D modality is frequently presumed to be close to the true morphology due to the smooth appearance of the contours of anatomical structures. However, in multi-modality stacks consistency is difficult to assess. In this work, consistency is defined in terms of smoothness of neighboring slices within a single modality and between different modalities. Registration bias denotes the distortion of the registered stack in comparison to the true 3D morphology and shape. Based on these metrics, different restacking strategies of multi-modality rat brain slices are experimentally evaluated. Experiments based on MRI-simulated and real dual-tracer autoradiograms reveal a clear bias of the restacked volume despite quantitatively high consistency and qualitatively smooth brain structures. However, different registration strategies yield different inter-consistency metrics. If no genuine 3D modality is available, the use of the so-called SOP (slice-order preferred) or MOSOP (modality-and-slice-order preferred) strategy is recommended.

Interactive Multimodal Molecular Set – Designing Ludic Engaging Science Learning Content

DEFF Research Database (Denmark)

Thorsen, Tine Pinholt; Christiansen, Kasper Holm Bonde; Jakobsen Sillesen, Kristian

2014-01-01

This paper reports on an exploratory study investigating 10 primary school students’ interaction with an interactive multimodal molecular set fostering ludic engaging science learning content in primary schools (8th and 9th grade). The concept of the prototype design was to bridge the physical...... and virtual worlds with electronic tags and, through this, blend the familiarity of the computer and toys, to create a tool that provided a ludic approach to learning about atoms and molecules. The study was inspired by the participatory design and informant design methodologies and included design...

The Use of Radiation Detectors in Medicine: The Future of Molecular Imaging and Multimodality Imaging: Advantages and Technological Challenges (3/3)

CERN Multimedia

CERN. Geneva

2009-01-01

The development of radiation detectors in the field of nuclear and particle physics has had a terrific impact in medical imaging since this latter discipline took off in late ’70 with the invention of the CT scanners. The massive use in High Energy Physics of position sensitive gas detectors, of high Z and high density scintillators coupled to Photomultiplier (PMT) and Position Sensitive Photomultipliers (PSPMT), and of solid state detectors has triggered during the last 30 years a series of novel applications in Medical Imaging with ionizing radiation. The accelerated scientific progression in genetics and molecular biology has finally generated what it is now called Molecular Imaging. This field of research presents additional challenges not only in the technology of radiation detector, but more and more in the ASIC electronics, fast digital readout and parallel software. In this series of three lectures I will try to present how high energy physics and medical imaging development have both benefited by t...

The developments and applications of molecular nuclear medicine

International Nuclear Information System (INIS)

Fang Shengwei; Xi Wang; Zhang Hong

2009-01-01

Molecular nuclear medicine including PET and SPECT is one of the most important parts of the molecular imaging. The combinations of molecular unclear medicine with CT, MRI, ultrasound or optical imaging and synthesis of multimodality radiopharmaceuticals are the major trends of the development of nuclear medicine. Molecular nuclear medicine has more and more and more important value on the monitoring of response to biology involved gene therapy or stem cell therapy and the developments of new drug. (authors)

Multimodality imaging in Europe: a survey by the European Association of Nuclear Medicine (EANM) and the European Society of Radiology (ESR)

International Nuclear Information System (INIS)

Cuocolo, Alberto; Breatnach, Eamann

2010-01-01

Multimodality imaging represents an area of rapid growth with important professional implication for both nuclear medicine physicians and radiologists throughout Europe. As a preliminary step for future action aimed at improving the quality and accessibility of PET/SPECT/CT multimodality imaging practice in Europe, the European Association of Nuclear Medicine (EANM) and the European Society of Radiology (ESR) performed a survey among the individual membership of both societies to obtain information on the status of multimodality imaging in their facilities and their future visions on training for combined modalities. A questionnaire was forwarded to all individual members of the EANM and ESR. The main subject matter of the questionnaire related to: (1) study performance, current procedures, current equipment including its supervisory personnel at respondents' individual facilities and (2) vision of future practice, performance and the potential for combined interdisciplinary viewing and training for future professionals. The reporting and the billing procedures of multimodality imaging studies are very heterogeneous in European countries. The majority of the members of both societies believe that the proportion of PET/CT conducted as a full diagnostic CT with contrast enhancement will increase over time. As expected, 18 F-FDG is the most commonly used PET tracer for clinical applications. The large majority of respondents were in favour of an interdisciplinary training programme being developed on a European level together by the EANM and the ESR and the respective sections of the European Union of Medical Specialists. The results of this survey show that there is wide heterogeneity in the current practice of multimodality imaging in Europe. This situation may limit the full potential and integration of multimodality imaging within the clinical arena. There is a strong desire within both specialties for the development of interdisciplinary training to address some

Multimodal Imaging of Brain Connectivity Using the MIBCA Toolbox: Preliminary Application to Alzheimer's Disease

Science.gov (United States)

Ribeiro, André Santos; Lacerda, Luís Miguel; Silva, Nuno André da; Ferreira, Hugo Alexandre

2015-06-01

The Multimodal Imaging Brain Connectivity Analysis (MIBCA) toolbox is a fully automated all-in-one connectivity analysis toolbox that offers both pre-processing, connectivity, and graph theory analysis of multimodal images such as anatomical, diffusion, and functional MRI, and PET. In this work, the MIBCA functionalities were used to study Alzheimer's Disease (AD) in a multimodal MR/PET approach. Materials and Methods: Data from 12 healthy controls, and 36 patients with EMCI, LMCI and AD (12 patients for each group) were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu), including T1-weighted (T1-w), Diffusion Tensor Imaging (DTI) data, and 18F-AV-45 (florbetapir) dynamic PET data from 40-60 min post injection (4x5 min). Both MR and PET data were automatically pre-processed for all subjects using MIBCA. T1-w data was parcellated into cortical and subcortical regions-of-interest (ROIs), and the corresponding thicknesses and volumes were calculated. DTI data was used to compute structural connectivity matrices based on fibers connecting pairs of ROIs. Lastly, dynamic PET images were summed, and the relative Standard Uptake Values calculated for each ROI. Results: An overall higher uptake of 18F-AV-45, consistent with an increased deposition of beta-amyloid, was observed for the AD group. Additionally, patients showed significant cortical atrophy (thickness and volume) especially in the entorhinal cortex and temporal areas, and a significant increase in Mean Diffusivity (MD) in the hippocampus, amygdala and temporal areas. Furthermore, patients showed a reduction of fiber connectivity with the progression of the disease, especially for intra-hemispherical connections. Conclusion: This work shows the potential of the MIBCA toolbox for the study of AD, as findings were shown to be in agreement with the literature. Here, only structural changes and beta-amyloid accumulation were considered. Yet, MIBCA is further able to

Multimodal scanning laser ophthalmoscopy for image guided treatment of age-related macular degeneration

Science.gov (United States)

Hammer, Daniel X.; Ferguson, R. D.; Patel, Ankit H.; Iftimia, Nicusor V.; Mujat, Mircea; Husain, Deeba

2009-02-01

Subretinal neovascular membranes (SRNM) are a deleterious complication of laser eye injury and retinal diseases such as age-related macular degeneration (AMD), choroiditis, and myopic retinopathy. Photodynamic therapy (PDT) and anti-vascular endothelial growth factor (VEGF) drugs are approved treatment methods. PDT acts by selective dye accumulation, activation by laser light, and disruption and clotting of the new leaky vessels. However, PDT surgery is currently not image-guided, nor does it proceed in an efficient or automated manner. This may contribute to the high rate of re-treatment. We have developed a multimodal scanning laser ophthalmoscope (SLO) for automated diagnosis and image-guided treatment of SRNMs associated with AMD. The system combines line scanning laser ophthalmoscopy (LSLO), fluorescein angiography (FA), indocyanine green angiography (ICGA), PDT laser delivery, and retinal tracking in a compact, efficient platform. This paper describes the system hardware and software design, performance characterization, and automated patient imaging and treatment session procedures and algorithms. Also, we present initial imaging and tracking measurements on normal subjects and automated lesion demarcation and sizing analysis of previously acquired angiograms. Future pre-clinical testing includes line scanning angiography and PDT treatment of AMD subjects. The automated acquisition procedure, enhanced and expedited data post-processing, and innovative image visualization and interpretation tools provided by the multimodal retinal imager may eventually aid in the diagnosis, treatment, and prognosis of AMD and other retinal diseases.

Multimodality Imaging Approach towards Primary Aortic Sarcomas Arising after Endovascular Abdominal Aortic Aneurysm Repair: Case Series Report

Energy Technology Data Exchange (ETDEWEB)

Kamran, Mudassar, E-mail: kamranm@mir.wustl.edu; Fowler, Kathryn J., E-mail: fowlerk@mir.wustl.edu; Mellnick, Vincent M., E-mail: mellnickv@mir.wustl.edu [Washington University School of Medicine, Mallinckrodt Institute of Radiology (United States); Sicard, Gregorio A., E-mail: sicard@wudosis.wustl.edu [Washington University School of Medicine, Department of Surgery (United States); Narra, Vamsi R., E-mail: narrav@mir.wustl.edu [Washington University School of Medicine, Mallinckrodt Institute of Radiology (United States)

2016-06-15

Primary aortic neoplasms are rare. Aortic sarcoma arising after endovascular aneurysm repair (EVAR) is a scarce subset of primary aortic malignancies, reports of which are infrequent in the published literature. The diagnosis of aortic sarcoma is challenging due to its non-specific clinical presentation, and the prognosis is poor due to delayed diagnosis, rapid proliferation, and propensity for metastasis. Post-EVAR, aortic sarcomas may mimic other more common aortic processes on surveillance imaging. Radiologists are rarely knowledgeable about this rare entity for which multimodality imaging and awareness are invaluable in early diagnosis. A series of three pathologically confirmed cases are presented to display the multimodality imaging features and clinical presentations of aortic sarcoma arising after EVAR.

Cardiovascular Molecular Imaging

International Nuclear Information System (INIS)

Lee, Kyung Han

2009-01-01

Molecular imaging strives to visualize processes in living subjects at the molecular level. Monitoring biochemical processes at this level will allow us to directly track biological processes and signaling events that lead to pathophysiological abnormalities, and help make personalized medicine a reality by allowing evaluation of therapeutic efficacies on an individual basis. Although most molecular imaging techniques emerged from the field of oncology, they have now gradually gained acceptance by the cardiovascular community. Hence, the availability of dedicated high-resolution small animal imaging systems and specific targeting imaging probes is now enhancing our understanding of cardiovascular diseases and expediting the development of newer therapies. Examples include imaging approaches to evaluate and track the progress of recent genetic and cellular therapies for treatment of myocardial ischemia. Other areas include in vivo monitoring of such key molecular processes as angiogenesis and apoptosis. Cardiovascular molecular imaging is already an important research tool in preclinical experiments. The challenge that lies ahead is to implement these techniques into the clinics so that they may help fulfill the promise of molecular therapies and personalized medicine, as well as to resolve disappointments and controversies surrounding the field

STRUCTURAL AND FUNCTIONAL CHARACTERIZATION OF BENIGN FLECK RETINA USING MULTIMODAL IMAGING.

Science.gov (United States)

Neriyanuri, Srividya; Rao, Chetan; Raman, Rajiv

2017-01-01

To report structural and functional features in a case series of benign fleck retina using multimodal imaging. Four cases with benign fleck retina underwent complete ophthalmic examination that included detailed history, visual acuity, and refractive error testing, FM-100 hue test, dilated fundus evaluation, full field electroretinogram, fundus photography with autofluorescence, fundus fluorescein angiography, and swept-source optical coherence tomography. Age group of the cases ranged from 19 years to 35 years (3 males and 1 female). Parental consanguinity was reported in two cases. All of them were visually asymptomatic with best-corrected visual acuity of 20/20 (moderate astigmatism) in both the eyes. Low color discrimination was seen in two cases. Fundus photography showed pisciform flecks which were compactly placed on posterior pole and were discrete, diverging towards periphery. Lesions were seen as smaller dots within 1500 microns from fovea and were hyperfluorescent on autofluorescence. Palisading retinal pigment epithelium defects were seen in posterior pole on fundus fluorescein angiography imaging; irregular hyper fluorescence was also noted. One case had reduced cone responses on full field electroretinogram; the other three cases had normal electroretinogram. On optical coherence tomography, level of lesions varied from retinal pigment epithelium, inner segment to outer segment extending till external limiting membrane. Functional and structural deficits in benign fleck retina were picked up using multimodal imaging.

Spatiotemporal Analysis of RGB-D-T Facial Images for Multimodal Pain Level Recognition

DEFF Research Database (Denmark)

Irani, Ramin; Nasrollahi, Kamal; Oliu Simon, Marc

2015-01-01

facial images for pain detection and pain intensity level recognition. For this purpose, we extract energies released by facial pixels using a spatiotemporal filter. Experiments on a group of 12 elderly people applying the multimodal approach show that the proposed method successfully detects pain...

Pseudo-HE images derived from CARS/TPEF/SHG multimodal imaging in combination with Raman-spectroscopy as a pathological screening tool

International Nuclear Information System (INIS)

Bocklitz, Thomas W.; Salah, Firas Subhi; Vogler, Nadine; Heuke, Sandro; Chernavskaia, Olga; Schmidt, Carsten; Waldner, Maximilian J.; Greten, Florian R.; Bräuer, Rolf; Schmitt, Michael; Stallmach, Andreas; Petersen, Iver; Popp, Jürgen

2016-01-01

Due to the steadily increasing number of cancer patients worldwide the early diagnosis and treatment of cancer is a major field of research. The diagnosis of cancer is mostly performed by an experienced pathologist via the visual inspection of histo-pathological stained tissue sections. To save valuable time, low quality cryosections are frequently analyzed with diagnostic accuracies that are below those of high quality embedded tissue sections. Thus, alternative means have to be found that enable for fast and accurate diagnosis as the basis of following clinical decision making. In this contribution we will show that the combination of the three label-free non-linear imaging modalities CARS (coherent anti-Stokes Raman-scattering), TPEF (two-photon excited autofluorescence) and SHG (second harmonic generation) yields information that can be translated into computational hematoxylin and eosin (HE) images by multivariate statistics. Thereby, a computational HE stain is generated resulting in pseudo-HE overview images that allow for identification of suspicious regions. The latter are analyzed further by Raman-spectroscopy retrieving the tissue’s molecular fingerprint. The results suggest that the combination of non-linear multimodal imaging and Raman-spectroscopy possesses the potential as a precise and fast tool in routine histopathology. As the key advantage, both optical methods are non-invasive enabling for further pathological investigations of the same tissue section, e.g. a direct comparison with the current pathological gold-standard

Use of multimodality imaging and artificial intelligence for diagnosis and prognosis of early stages of Alzheimer's disease.

Science.gov (United States)

Liu, Xiaonan; Chen, Kewei; Wu, Teresa; Weidman, David; Lure, Fleming; Li, Jing

2018-04-01

Alzheimer's disease (AD) is a major neurodegenerative disease and the most common cause of dementia. Currently, no treatment exists to slow down or stop the progression of AD. There is converging belief that disease-modifying treatments should focus on early stages of the disease, that is, the mild cognitive impairment (MCI) and preclinical stages. Making a diagnosis of AD and offering a prognosis (likelihood of converting to AD) at these early stages are challenging tasks but possible with the help of multimodality imaging, such as magnetic resonance imaging (MRI), fluorodeoxyglucose (FDG)-positron emission topography (PET), amyloid-PET, and recently introduced tau-PET, which provides different but complementary information. This article is a focused review of existing research in the recent decade that used statistical machine learning and artificial intelligence methods to perform quantitative analysis of multimodality image data for diagnosis and prognosis of AD at the MCI or preclinical stages. We review the existing work in 3 subareas: diagnosis, prognosis, and methods for handling modality-wise missing data-a commonly encountered problem when using multimodality imaging for prediction or classification. Factors contributing to missing data include lack of imaging equipment, cost, difficulty of obtaining patient consent, and patient drop-off (in longitudinal studies). Finally, we summarize our major findings and provide some recommendations for potential future research directions. Copyright © 2018 Elsevier Inc. All rights reserved.

Cuticular Drusen: Clinical Phenotypes and Natural History Defined Using Multimodal Imaging.

Science.gov (United States)

Balaratnasingam, Chandrakumar; Cherepanoff, Svetlana; Dolz-Marco, Rosa; Killingsworth, Murray; Chen, Fred K; Mendis, Randev; Mrejen, Sarah; Too, Lay Khoon; Gal-Or, Orly; Curcio, Christine A; Freund, K Bailey; Yannuzzi, Lawrence A

2018-01-01

To define the range and life cycles of cuticular drusen phenotypes using multimodal imaging and to review the histologic characteristics of cuticular drusen. Retrospective, observational cohort study and experimental laboratory study. Two hundred forty eyes of 120 clinic patients with a cuticular drusen phenotype and 4 human donor eyes with cuticular drusen (n = 2), soft drusen (n = 1), and hard drusen (n = 1). We performed a retrospective review of clinical and multimodal imaging data of patients with a cuticular drusen phenotype. Patients had undergone imaging with various combinations of color photography, fluorescein angiography, indocyanine green angiography, near-infrared reflectance, fundus autofluorescence, high-resolution OCT, and ultrawide-field imaging. Human donor eyes underwent processing for high-resolution light and electron microscopy. Appearance of cuticular drusen in multimodal imaging and the topography of a cuticular drusen distribution; age-dependent variations in cuticular drusen phenotypes, including the occurrence of retinal pigment epithelium (RPE) abnormalities, choroidal neovascularization, acquired vitelliform lesions (AVLs), and geographic atrophy (GA); and ultrastructural and staining characteristics of druse subtypes. The mean age of patients at the first visit was 57.9±13.4 years. Drusen and RPE changes were seen in the peripheral retina, anterior to the vortex veins, in 21.8% of eyes. Of eyes with more than 5 years of follow-up, cuticular drusen disappeared from view in 58.3% of eyes, drusen coalescence was seen in 70.8% of eyes, and new RPE pigmentary changes developed in 56.2% of eyes. Retinal pigment epithelium abnormalities, AVLs, neovascularization, and GA occurred at a frequency of 47.5%, 24.2%, 12.5%, and 25%, respectively, and were significantly more common in patients older than 60 years of age (all P < 0.015). Occurrence of GA and neovascularization were important determinants of final visual acuity in eyes with the

Multi-modality imaging of tumor phenotype and response to therapy

Science.gov (United States)

Nyflot, Matthew J.

2011-12-01

Imaging and radiation oncology have historically been closely linked. However, the vast majority of techniques used in the clinic involve anatomical imaging. Biological imaging offers the potential for innovation in the areas of cancer diagnosis and staging, radiotherapy target definition, and treatment response assessment. Some relevant imaging techniques are FDG PET (for imaging cellular metabolism), FLT PET (proliferation), CuATSM PET (hypoxia), and contrast-enhanced CT (vasculature and perfusion). Here, a technique for quantitative spatial correlation of tumor phenotype is presented for FDG PET, FLT PET, and CuATSM PET images. Additionally, multimodality imaging of treatment response with FLT PET, CuATSM, and dynamic contrast-enhanced CT is presented, in a trial of patients receiving an antiangiogenic agent (Avastin) combined with cisplatin and radiotherapy. Results are also presented for translational applications in animal models, including quantitative assessment of proliferative response to cetuximab with FLT PET and quantification of vascular volume with a blood-pool contrast agent (Fenestra). These techniques have clear applications to radiobiological research and optimized treatment strategies, and may eventually be used for personalized therapy for patients.

Diffusion Maps for Multimodal Registration

Directory of Open Access Journals (Sweden)

Gemma Piella

2014-06-01

Full Text Available Multimodal image registration is a difficult task, due to the significant intensity variations between the images. A common approach is to use sophisticated similarity measures, such as mutual information, that are robust to those intensity variations. However, these similarity measures are computationally expensive and, moreover, often fail to capture the geometry and the associated dynamics linked with the images. Another approach is the transformation of the images into a common space where modalities can be directly compared. Within this approach, we propose to register multimodal images by using diffusion maps to describe the geometric and spectral properties of the data. Through diffusion maps, the multimodal data is transformed into a new set of canonical coordinates that reflect its geometry uniformly across modalities, so that meaningful correspondences can be established between them. Images in this new representation can then be registered using a simple Euclidean distance as a similarity measure. Registration accuracy was evaluated on both real and simulated brain images with known ground-truth for both rigid and non-rigid registration. Results showed that the proposed approach achieved higher accuracy than the conventional approach using mutual information.

General perspectives for molecular nuclear imaging

International Nuclear Information System (INIS)

Chung, June Key

2004-01-01

Molecular imaging provides a visualization of normal as well as abnormal cellular processes at a molecular or genetic level rather than at an anatomical level. Conventional medical imaging methods utilize the imaging signals produced by nonspecific physico-chemical interaction. However, molecular imaging methods utilize the imaging signals derived from specific cellular or molecular events. Because molecular and genetic changes precede anatomical change in the course of disease development, molecular imaging can detect early events in disease progression. In the near future, through molecular imaging we can understand basic mechanisms of disease, and diagnose earlier and, subsequently, treat earlier intractable disease such as cancer, neuro-degenerative diseases, and immunologic disorders. In beginning period, nuclear medicine started as a molecular imaging, and has had a leading role in the field of molecular imaging. But recently molecular imaging has been rapidly developed. Besides nuclear imaging, molecular imaging methods such as optical imaging, magnetic resonance imaging are emerging. Each imaging modalities have their advantages and weaknesses. The opportunities from molecular imaging look bright. We should try nuclear medicine continues to have a leading role in molecular imaging

The value of multimodality imaging in the investigation of a PSA recurrence after radical prostatectomy in the Irish hospital setting.

Science.gov (United States)

McLoughlin, L C; Inder, S; Moran, D; O'Rourke, C; Manecksha, R P; Lynch, T H

2018-02-01

The diagnostic evaluation of a PSA recurrence after RP in the Irish hospital setting involves multimodality imaging with MRI, CT, and bone scanning, despite the low diagnostic yield from imaging at low PSA levels. We aim to investigate the value of multimodality imaging in PC patients after RP with a PSA recurrence. Forty-eight patients with a PSA recurrence after RP who underwent multimodality imaging were evaluated. Demographic data, postoperative PSA levels, and imaging studies performed at those levels were evaluated. Eight (21%) MRIs, 6 (33%) CTs, and 4 (9%) bone scans had PCa-specific findings. Three (12%) patients had a positive MRI with a PSA PSA ≥1.1 ng/ml (p = 0.05). Zero patient had a positive CT TAP at a PSA level PSA levels PSA levels PSA levels ≥1.1 ng/ml. MRI alone is of investigative value at PSA <1.0 ng/ml. The indication for CT, MRI, or isotope bone scanning should be carefully correlated with the clinical question and how it will affect further management.

Multimodality molecular imaging of disease progression in living ...

Indian Academy of Sciences (India)

immune cell trafficking, stem cell therapy, transgenic animals and even molecular interactions in living subjects. .... measurement of the effect of absorbed electromagnetic ..... Changes in intracellular pH, electrical impulses by nerve cells and ...

Multimodal segmentation of optic disc and cup from stereo fundus and SD-OCT images

Science.gov (United States)

Miri, Mohammad Saleh; Lee, Kyungmoo; Niemeijer, Meindert; Abràmoff, Michael D.; Kwon, Young H.; Garvin, Mona K.

2013-03-01

Glaucoma is one of the major causes of blindness worldwide. One important structural parameter for the diagnosis and management of glaucoma is the cup-to-disc ratio (CDR), which tends to become larger as glaucoma progresses. While approaches exist for segmenting the optic disc and cup within fundus photographs, and more recently, within spectral-domain optical coherence tomography (SD-OCT) volumes, no approaches have been reported for the simultaneous segmentation of these structures within both modalities combined. In this work, a multimodal pixel-classification approach for the segmentation of the optic disc and cup within fundus photographs and SD-OCT volumes is presented. In particular, after segmentation of other important structures (such as the retinal layers and retinal blood vessels) and fundus-to-SD-OCT image registration, features are extracted from both modalities and a k-nearest-neighbor classification approach is used to classify each pixel as cup, rim, or background. The approach is evaluated on 70 multimodal image pairs from 35 subjects in a leave-10%-out fashion (by subject). A significant improvement in classification accuracy is obtained using the multimodal approach over that obtained from the corresponding unimodal approach (97.8% versus 95.2%; p < 0:05; paired t-test).

Versatile quantitative phase imaging system applied to high-speed, low noise and multimodal imaging (Conference Presentation)

Science.gov (United States)

Federici, Antoine; Aknoun, Sherazade; Savatier, Julien; Wattellier, Benoit F.

2017-02-01

Quadriwave lateral shearing interferometry (QWLSI) is a well-established quantitative phase imaging (QPI) technique based on the analysis of interference patterns of four diffraction orders by an optical grating set in front of an array detector [1]. As a QPI modality, this is a non-invasive imaging technique which allow to measure the optical path difference (OPD) of semi-transparent samples. We present a system enabling QWLSI with high-performance sCMOS cameras [2] and apply it to perform high-speed imaging, low noise as well as multimodal imaging. This modified QWLSI system contains a versatile optomechanical device which images the optical grating near the detector plane. Such a device is coupled with any kind of camera by varying its magnification. In this paper, we study the use of a sCMOS Zyla5.5 camera from Andor along with our modified QWLSI system. We will present high-speed live cell imaging, up to 200Hz frame rate, in order to follow intracellular fast motions while measuring the quantitative phase information. The structural and density information extracted from the OPD signal is complementary to the specific and localized fluorescence signal [2]. In addition, QPI detects cells even when the fluorophore is not expressed. This is very useful to follow a protein expression with time. The 10 µm spatial pixel resolution of our modified QWLSI associated to the high sensitivity of the Zyla5.5 enabling to perform high quality fluorescence imaging, we have carried out multimodal imaging revealing fine structures cells, like actin filaments, merged with the morphological information of the phase. References [1]. P. Bon, G. Maucort, B. Wattellier, and S. Monneret, "Quadriwave lateral shearing interferometry for quantitative phase microscopy of living cells," Opt. Express, vol. 17, pp. 13080-13094, 2009. [2] P. Bon, S. Lécart, E. Fort and S. Lévêque-Fort, "Fast label-free cytoskeletal network imaging in living mammalian cells," Biophysical journal, 106

Applications of the Preclinical Molecular Image in Biomedicine; Aplicaciones de la imagen Molecular Preclínica en Biomedicina

Energy Technology Data Exchange (ETDEWEB)

Delgado, M.; Bascuñana, P.; Fernández de la Rosa, R.; De Cristobal, J.; García-García, L.; Pozo, M. A.

2014-07-01

Molecular imaging is a broad platform, which provides valuable information about physiological and pathophysiological changes in living organisms by non-invasive methods. Depending on the used technique: anatomical, functional metabolic or molecular data could be assessed. Positron Emission Tomography (PET) provides with functional and molecular data, and combined with Computerized Tomography (CT) and Magnetic Resonance (MRI) with the multimodality equipment, it can be exponentially improved. Metabolic pathways and changes on the molecular and cellular level are target in molecular imaging cancer research. Tumour microenvironment, stroma and new vessels can be assessed by PET imaging. Additionally the visualization of functions and monitoring data of provided therapies could be obtained. The aim of the current review is to summarize principles and novel findings in molecular imaging specifically in PET and its application in preclinical cancer research. The theoretical background of techniques and main applications will be highlighted [Spanish] La imagen molecular aporta información muy valiosa, mediante métodos no invasivos, acerca de la fisiología de organismos vivos y sus cambios debidos a patologías. Dependiendo de la técnica utilizada se pueden obtener datos anatómicos, funcionales, metabólicos o moleculares. La Tomografía por Emisión de Positrones (PET) aporta datos metabólicos y moleculares con una alta sensibilidad, y en asociación con la Tomografía Computarizada (TC) o con Resonancia Magnética (RM), con la aparición de los nuevos equipos multimodalidad, las posibilidades de diagnóstico se incrementan exponencialmente. La imagen molecular en investigación oncológica presenta como objetivos principales identificar las diferentes vías metabólicas tumorales y sus cambios a nivel molecular y celular, el comportamiento del microentorno tumoral, aparición de nuevos vasos, estroma, etc. Además, es posible el análisis y cuantificación del

The clinical utility of multimodal MR image-guided needle biopsy in cerebral gliomas.

Science.gov (United States)

Yao, Chengjun; Lv, Shunzeng; Chen, Hong; Tang, Weijun; Guo, Jun; Zhuang, Dongxiao; Chrisochoides, Nikos; Wu, Jinsong; Mao, Ying; Zhou, Liangfu

2016-01-01

Our aim was to evaluate the diagnostic value of multimodal Magnetic Resonance (MR) Image in the stereotactic biopsy of cerebral gliomas, and investigate its implications. Twenty-four patients with cerebral gliomas underwent (1)H Magnetic Resonance Spectroscopy ((1)H-MRS)- and intraoperative Magnetic Resonance Imaging (iMRI)-supported stereotactic biopsy, and 23 patients underwent only the preoperative MRI-guided biopsy. The diagnostic yield, morbidity and mortality rates were analyzed. In addition, 20 patients underwent subsequent tumor resection, thus the diagnostic accuracy of the biopsy was further evaluated. The diagnostic accuracies of biopsies evaluated by tumor resection in the trial groups were better than control groups (92.3% and 42.9%, respectively, p = 0.031). The diagnostic yield in the trial groups was better than the control groups, but the difference was not statistically significant (100% and 82.6%, respectively, p = 0.05). The morbidity and mortality rates were similar in both groups. Multimodal MR image-guided glioma biopsy is practical and valuable. This technique can increase the diagnostic accuracy in the stereotactic biopsy of cerebral gliomas. Besides, it is likely to increase the diagnostic yield but requires further validation.

Detail-enhanced multimodality medical image fusion based on gradient minimization smoothing filter and shearing filter.

Science.gov (United States)

Liu, Xingbin; Mei, Wenbo; Du, Huiqian

2018-02-13

In this paper, a detail-enhanced multimodality medical image fusion algorithm is proposed by using proposed multi-scale joint decomposition framework (MJDF) and shearing filter (SF). The MJDF constructed with gradient minimization smoothing filter (GMSF) and Gaussian low-pass filter (GLF) is used to decompose source images into low-pass layers, edge layers, and detail layers at multiple scales. In order to highlight the detail information in the fused image, the edge layer and the detail layer in each scale are weighted combined into a detail-enhanced layer. As directional filter is effective in capturing salient information, so SF is applied to the detail-enhanced layer to extract geometrical features and obtain directional coefficients. Visual saliency map-based fusion rule is designed for fusing low-pass layers, and the sum of standard deviation is used as activity level measurement for directional coefficients fusion. The final fusion result is obtained by synthesizing the fused low-pass layers and directional coefficients. Experimental results show that the proposed method with shift-invariance, directional selectivity, and detail-enhanced property is efficient in preserving and enhancing detail information of multimodality medical images. Graphical abstract The detailed implementation of the proposed medical image fusion algorithm.

Polymer encapsulated upconversion nanoparticle/iron oxide nanocomposites for multimodal imaging and magnetic targeted drug delivery.

Science.gov (United States)

Xu, Huan; Cheng, Liang; Wang, Chao; Ma, Xinxing; Li, Yonggang; Liu, Zhuang

2011-12-01

Multimodal imaging and imaging-guided therapies have become a new trend in the current development of cancer theranostics. In this work, we encapsulate hydrophobic upconversion nanoparticles (UCNPs) together with iron oxide nanoparticles (IONPs) by using an amphiphilic block copolymer, poly (styrene-block-allyl alcohol) (PS(16)-b-PAA(10)), via a microemulsion method, obtaining an UC-IO@Polymer multi-functional nanocomposite system. Fluorescent dye and anti-cancer drug molecules can be further loaded inside the UC-IO@Polymer nanocomposite for additional functionalities. Utilizing the Squaraine (SQ) dye loaded nanocomposite (UC-IO@Polymer-SQ), triple-modal upconversion luminescence (UCL)/down-conversion fluorescence (FL)/magnetic resonance (MR) imaging is demonstrated in vitro and in vivo, and also applied for in vivo cancer cell tracking in mice. On the other hand, a chemotherapy drug, doxorubicin, is also loaded into the nanocomposite, forming an UC-IO@Polymer-DOX complex, which enables novel imaging-guided and magnetic targeted drug delivery. Our work provides a method to fabricate a nanocomposite system with highly integrated functionalities for multimodal biomedical imaging and cancer therapy. Copyright © 2011 Elsevier Ltd. All rights reserved.

Development of a multi-scale and multi-modality imaging system to characterize tumours and their microenvironment in vivo

Science.gov (United States)

Rouffiac, Valérie; Ser-Leroux, Karine; Dugon, Emilie; Leguerney, Ingrid; Polrot, Mélanie; Robin, Sandra; Salomé-Desnoulez, Sophie; Ginefri, Jean-Christophe; Sebrié, Catherine; Laplace-Builhé, Corinne

2015-03-01

In vivo high-resolution imaging of tumor development is possible through dorsal skinfold chamber implantable on mice model. However, current intravital imaging systems are weakly tolerated along time by mice and do not allow multimodality imaging. Our project aims to develop a new chamber for: 1- long-term micro/macroscopic visualization of tumor (vascular and cellular compartments) and tissue microenvironment; and 2- multimodality imaging (photonic, MRI and sonography). Our new experimental device was patented in March 2014 and was primarily assessed on 75 mouse engrafted with 4T1-Luc tumor cell line, and validated in confocal and multiphoton imaging after staining the mice vasculature using Dextran 155KDa-TRITC or Dextran 2000kDa-FITC. Simultaneously, a universal stage was designed for optimal removal of respiratory and cardiac artifacts during microscopy assays. Experimental results from optical, ultrasound (Bmode and pulse subtraction mode) and MRI imaging (anatomic sequences) showed that our patented design, unlike commercial devices, improves longitudinal monitoring over several weeks (35 days on average against 12 for the commercial chamber) and allows for a better characterization of the early and late tissue alterations due to tumour development. We also demonstrated the compatibility for multimodality imaging and the increase of mice survival was by a factor of 2.9, with our new skinfold chamber. Current developments include: 1- defining new procedures for multi-labelling of cells and tissue (screening of fluorescent molecules and imaging protocols); 2- developing ultrasound and MRI imaging procedures with specific probes; 3- correlating optical/ultrasound/MRI data for a complete mapping of tumour development and microenvironment.

Molecular Imaging in Synthetic Biology, and Synthetic Biology in Molecular Imaging.

Science.gov (United States)

Gilad, Assaf A; Shapiro, Mikhail G

2017-06-01

Biomedical synthetic biology is an emerging field in which cells are engineered at the genetic level to carry out novel functions with relevance to biomedical and industrial applications. This approach promises new treatments, imaging tools, and diagnostics for diseases ranging from gastrointestinal inflammatory syndromes to cancer, diabetes, and neurodegeneration. As these cellular technologies undergo pre-clinical and clinical development, it is becoming essential to monitor their location and function in vivo, necessitating appropriate molecular imaging strategies, and therefore, we have created an interest group within the World Molecular Imaging Society focusing on synthetic biology and reporter gene technologies. Here, we highlight recent advances in biomedical synthetic biology, including bacterial therapy, immunotherapy, and regenerative medicine. We then discuss emerging molecular imaging approaches to facilitate in vivo applications, focusing on reporter genes for noninvasive modalities such as magnetic resonance, ultrasound, photoacoustic imaging, bioluminescence, and radionuclear imaging. Because reporter genes can be incorporated directly into engineered genetic circuits, they are particularly well suited to imaging synthetic biological constructs, and developing them provides opportunities for creative molecular and genetic engineering.

Operative and economic evaluation of a 'Laser Printer Multimodality' System

International Nuclear Information System (INIS)

Battaglia, G.; Moscatelli, G.; Maroldi, R.; Chiesa, A.

1991-01-01

The increasing application of digital techniques to diagnostic imaging is causing significant changes in several related activities, such as a reproduction of digital images on film. In the Department of Diagnostic Imaging of the University of Brescia, about 70% of the whole of images are produced by digital techniques; at present, most of these images are reproduced on film with a Multimodality System interfacing CT, MR, DSA, and DR units with a single laser printer. Our analysis evaluates the operative and economics aspects of image reproduction, by comparing the 'single cassette' multiformat Camera and the Laser Printer Multimodality SAystem. Our results point out the advantages obtained by reproducing images with a Laser Printer Multimodality System: outstanding quality, reproduction of multiple originals, and marked reduction in the time needed for both image archiving and film handling. The Laser Printer Multimodality System allows over 5 hours/day to be saved -that is to say the working day of an operator, who can be thus shifted to other functions. The important economic aspect of the reproduction of digital images on film proves the Laser Printer Multimodality System to have some advantage over Cameras

Modern spinal instrumentation. Part 2: Multimodality imaging approach for assessment of complications

International Nuclear Information System (INIS)

Allouni, A.K.; Davis, W.; Mankad, K.; Rankine, J.; Davagnanam, I.

2013-01-01

Radiologists frequently encounter studies demonstrating spinal instrumentation, either as part of the patient's postoperative evaluation, or as incidental to a study performed for another purpose. It is important for the reporting radiologist to identify potential complications of commonly used spinal implants. Part 1 of this review examined both the surgical approaches used and the normal appearances of these spinal implants and bone grafting techniques. This second part of the review will focus on the multimodal imaging strategy adopted in the assessment of the instrumented spine and the demonstration of imaging findings of common postoperative complications.

Multimodal optical coherence tomography and fluorescence lifetime imaging with interleaved excitation sources for simultaneous endogenous and exogenous fluorescence.

Science.gov (United States)

Shrestha, Sebina; Serafino, Michael J; Rico-Jimenez, Jesus; Park, Jesung; Chen, Xi; Zhaorigetu, Siqin; Walton, Brian L; Jo, Javier A; Applegate, Brian E

2016-09-01

Multimodal imaging probes a variety of tissue properties in a single image acquisition by merging complimentary imaging technologies. Exploiting synergies amongst the data, algorithms can be developed that lead to better tissue characterization than could be accomplished by the constituent imaging modalities taken alone. The combination of optical coherence tomography (OCT) with fluorescence lifetime imaging microscopy (FLIM) provides access to detailed tissue morphology and local biochemistry. The optical system described here merges 1310 nm swept-source OCT with time-domain FLIM having excitation at 355 and 532 nm. The pulses from 355 and 532 nm lasers have been interleaved to enable simultaneous acquisition of endogenous and exogenous fluorescence signals, respectively. The multimodal imaging system was validated using tissue phantoms. Nonspecific tagging with Alexa Flour 532 in a Watanbe rabbit aorta and active tagging of the LOX-1 receptor in human coronary artery, demonstrate the capacity of the system for simultaneous acquisition of OCT, endogenous FLIM, and exogenous FLIM in tissues.

Photoacoustic-Based Multimodal Nanoprobes: from Constructing to Biological Applications.

Science.gov (United States)

Gao, Duyang; Yuan, Zhen

2017-01-01

Multimodal nanoprobes have attracted intensive attentions since they can integrate various imaging modalities to obtain complementary merits of single modality. Meanwhile, recent interest in laser-induced photoacoustic imaging is rapidly growing due to its unique advantages in visualizing tissue structure and function with high spatial resolution and satisfactory imaging depth. In this review, we summarize multimodal nanoprobes involving photoacoustic imaging. In particular, we focus on the method to construct multimodal nanoprobes. We have divided the synthetic methods into two types. First, we call it "one for all" concept, which involves intrinsic properties of the element in a single particle. Second, "all in one" concept, which means integrating different functional blocks in one particle. Then, we simply introduce the applications of the multifunctional nanoprobes for in vivo imaging and imaging-guided tumor therapy. At last, we discuss the advantages and disadvantages of the present methods to construct the multimodal nanoprobes and share our viewpoints in this area.

Novelty detection of foreign objects in food using multi-modal X-ray imaging

DEFF Research Database (Denmark)

Einarsdottir, Hildur; Emerson, Monica Jane; Clemmensen, Line Katrine Harder

2016-01-01

In this paper we demonstrate a method for novelty detection of foreign objects in food products using grating-based multimodal X-ray imaging. With this imaging technique three modalities are available with pixel correspondence, enhancing organic materials such as wood chips, insects and soft...... plastics not detectable by conventional X-ray absorption radiography. We conduct experiments, where several food products are imaged with common foreign objects typically found in the food processing industry. To evaluate the benefit from using this multi-contrast X-ray technique over conventional X......-ray absorption imaging, a novelty detection scheme based on well known image- and statistical analysis techniques is proposed. The results show that the presented method gives superior recognition results and highlights the advantage of grating-based imaging....

AMIDE: A Free Software Tool for Multimodality Medical Image Analysis

Directory of Open Access Journals (Sweden)

Andreas Markus Loening

2003-07-01

Full Text Available Amide's a Medical Image Data Examiner (AMIDE has been developed as a user-friendly, open-source software tool for displaying and analyzing multimodality volumetric medical images. Central to the package's abilities to simultaneously display multiple data sets (e.g., PET, CT, MRI and regions of interest is the on-demand data reslicing implemented within the program. Data sets can be freely shifted, rotated, viewed, and analyzed with the program automatically handling interpolation as needed from the original data. Validation has been performed by comparing the output of AMIDE with that of several existing software packages. AMIDE runs on UNIX, Macintosh OS X, and Microsoft Windows platforms, and it is freely available with source code under the terms of the GNU General Public License.

Multimodal Nonlinear Optical Imaging for Sensitive Detection of Multiple Pharmaceutical Solid-State Forms and Surface Transformations.

Science.gov (United States)

Novakovic, Dunja; Saarinen, Jukka; Rojalin, Tatu; Antikainen, Osmo; Fraser-Miller, Sara J; Laaksonen, Timo; Peltonen, Leena; Isomäki, Antti; Strachan, Clare J

2017-11-07

Two nonlinear imaging modalities, coherent anti-Stokes Raman scattering (CARS) and sum-frequency generation (SFG), were successfully combined for sensitive multimodal imaging of multiple solid-state forms and their changes on drug tablet surfaces. Two imaging approaches were used and compared: (i) hyperspectral CARS combined with principal component analysis (PCA) and SFG imaging and (ii) simultaneous narrowband CARS and SFG imaging. Three different solid-state forms of indomethacin-the crystalline gamma and alpha forms, as well as the amorphous form-were clearly distinguished using both approaches. Simultaneous narrowband CARS and SFG imaging was faster, but hyperspectral CARS and SFG imaging has the potential to be applied to a wider variety of more complex samples. These methodologies were further used to follow crystallization of indomethacin on tablet surfaces under two storage conditions: 30 °C/23% RH and 30 °C/75% RH. Imaging with (sub)micron resolution showed that the approach allowed detection of very early stage surface crystallization. The surfaces progressively crystallized to predominantly (but not exclusively) the gamma form at lower humidity and the alpha form at higher humidity. Overall, this study suggests that multimodal nonlinear imaging is a highly sensitive, solid-state (and chemically) specific, rapid, and versatile imaging technique for understanding and hence controlling (surface) solid-state forms and their complex changes in pharmaceuticals.

An integrated multimodality image-guided robot system for small-animal imaging research

International Nuclear Information System (INIS)

Hsu, Wen-Lin; Hsin Wu, Tung; Hsu, Shih-Ming; Chen, Chia-Lin; Lee, Jason J.S.; Huang, Yung-Hui

2011-01-01

We design and construct an image-guided robot system for use in small-animal imaging research. This device allows the use of co-registered small-animal PET-MRI images to guide the movements of robotic controllers, which will accurately place a needle probe at any predetermined location inside, for example, a mouse tumor, for biological readouts without sacrificing the animal. This system is composed of three major components: an automated robot device, a CCD monitoring mechanism, and a multimodality registration implementation. Specifically, the CCD monitoring mechanism was used for correction and validation of the robot device. To demonstrate the value of the proposed system, we performed a tumor hypoxia study that involved FMISO small-animal PET imaging and the delivering of a pO 2 probe into the mouse tumor using the image-guided robot system. During our evaluation, the needle positioning error was found to be within 0.153±0.042 mm of desired placement; the phantom simulation errors were within 0.693±0.128 mm. In small-animal studies, the pO 2 probe measurements in the corresponding hypoxia areas showed good correlation with significant, low tissue oxygen tensions (less than 6 mmHg). We have confirmed the feasibility of the system and successfully applied it to small-animal investigations. The system could be easily adapted to extend to other biomedical investigations in the future.

Multimodal imaging analysis of single-photon emission computed tomography and magnetic resonance tomography for improving diagnosis of Parkinson's disease

International Nuclear Information System (INIS)

Barthel, H.; Georgi, P.; Slomka, P.; Dannenberg, C.; Kahn, T.

2000-01-01

Parkinson's disease (PD) is characterized by a degeneration of nigrostriated dopaminergic neurons, which can be imaged with 123 I-labeled 2β-carbomethoxy-3β-(4-iodophenyl) tropane ([ 123 I]β-CIT) and single-photon emission computed tomography (SPECT). However, the quality of the region of interest (ROI) technique used for quantitative analysis of SPECT data is compromised by limited anatomical information in the images. We investigated whether the diagnosis of PD can be improved by combining the use of SPECT images with morphological image data from magnetic resonance imaging (MRI)/computed tomography (CT). We examined 27 patients (8 men, 19 women; aged 55±13 years) with PD (Hoehn and Yahr stage 2.1±0.8) by high-resolution [ 123 I]β-CIT SPECT (185-200 MBq, Ceraspect camera). SPECT images were analyzed both by a unimodal technique (ROIs defined directly within the SPECT studies) and a multimodal technique (ROIs defined within individual MRI/CT studies and transferred to the corresponding interactively coregistered SPECT studies). [ 123 I]β-CIT binding ratios (cerebellum as reference), which were obtained for heads of caudate nuclei (CA), putamina (PU), and global striatal structures were compared with clinical parameters. Differences between contra- and ipsilateral (related to symptom dominance) striatal [ 123 I]β-CIT binding ratios proved to be larger in the multimodal ROI technique than in the unimodal approach (e.g., for PU: 1.2*** vs. 0.7**). Binding ratios obtained by the unimodal ROI technique were significantly correlated with those of the multimodal technique (e.g., for CA: y=0.97x+2.8; r=0.70; P com subscore (r=-0.49* vs. -0.32). These results show that the impact of [ 123 I]β-CIT SPECT for diagnosing PD is affected by the method used to analyze the SPECT images. The described multimodal approach, which is based on coregistration of SPECT and morphological imaging data, leads to improved determination of the degree of this dopaminergic disorder

Multimodal fluorescence molecular imaging for in vivo characterization of skin cancer using endogenous and exogenous fluorophores

Science.gov (United States)

Miller, Jessica P.; Habimana-Griffin, LeMoyne; Edwards, Tracy S.; Achilefu, Samuel

2017-06-01

Similarity of skin cancer with many benign skin pathologies requires reliable methods to detect and differentiate the different types of these lesions. Previous studies have explored the use of disparate optical techniques to identify and estimate the invasive nature of melanoma and basal cell carcinoma with varying outcomes. Here, we used a concerted approach that provides complementary information for rapid screening and characterization of tumors, focusing on squamous cell carcinoma (SCC) of the skin. Assessment of in vivo autofluorescence lifetime (FLT) imaging of endogenous fluorophores that are excitable at longer wavelengths (480 nm) than conventional NADH and FAD revealed a decrease in the short FLT component for SCC compared to normal skin, with mean values of 0.57±0.026 ns and 0.61±0.021 ns, respectively (p=0.004). Subsequent systemic administration of a near-infrared fluorescent molecular probe in SCC bearing mice, followed by the implementation of image processing methods on data acquired from two-dimensional and three-dimensional fluorescence molecular imaging, allowed us to estimate the tumor volume and depth, as well as quantify the fluorescent probe in the tumor. The result suggests the involvement of lipofuscin-like lipopigments and riboflavin in SCC metabolism and serves as a model for staging SCC.

Inflammation Modulates Murine Venous Thrombosis Resolution In Vivo: Assessment by Multimodal Fluorescence Molecular Imaging

Science.gov (United States)

Ripplinger, Crystal M.; Kessinger, Chase W.; Li, Chunqiang; Kim, Jin Won; McCarthy, Jason R.; Weissleder, Ralph; Henke, Peter K.; Lin, Charles P.; Jaffer, Farouc A.

2012-01-01

Objective Assessment of thrombus inflammation in vivo could provide new insights into deep vein thrombosis (DVT) resolution. Here we develop and evaluate two integrated fluorescence molecular-structural imaging strategies to quantify DVT-related inflammation and architecture, and to assess the effect of thrombus inflammation on subsequent DVT resolution in vivo. Methods and Results Murine DVT were created with topical 5% FeCl3 application to thigh or jugular veins (n=35). On day 3, mice received macrophage and matrix metalloproteinase (MMP) activity fluorescence imaging agents. On day 4, integrated assessment of DVT inflammation and architecture was performed using confocal fluorescence intravital microscopy (IVM). Day 4 analyses showed robust relationships among in vivo thrombus macrophages, MMP activity, and FITC-dextran deposition (r>0.70, pthrombus inflammation at day 4 predicted the magnitude of DVT resolution at day 6 (pthrombus resolution. PMID:22995524

A Multimodal Imaging Approach for Longitudinal Evaluation of Bladder Tumor Development in an Orthotopic Murine Model.

Directory of Open Access Journals (Sweden)

Chantal Scheepbouwer

Full Text Available Bladder cancer is the fourth most common malignancy amongst men in Western industrialized countries with an initial response rate of 70% for the non-muscle invasive type, and improving therapy efficacy is highly needed. For this, an appropriate, reliable animal model is essential to gain insight into mechanisms of tumor growth for use in response monitoring of (new agents. Several animal models have been described in previous studies, but so far success has been hampered due to the absence of imaging methods to follow tumor growth non-invasively over time. Recent developments of multimodal imaging methods for use in animal research have substantially strengthened these options of in vivo visualization of tumor growth. In the present study, a multimodal imaging approach was addressed to investigate bladder tumor proliferation longitudinally. The complementary abilities of Bioluminescence, High Resolution Ultrasound and Photo-acoustic Imaging permit a better understanding of bladder tumor development. Hybrid imaging modalities allow the integration of individual strengths to enable sensitive and improved quantification and understanding of tumor biology, and ultimately, can aid in the discovery and development of new therapeutics.

MINERVA - a multi-modal radiation treatment planning system

Energy Technology Data Exchange (ETDEWEB)

Wemple, C.A. E-mail: cew@enel.gov; Wessol, D.E.; Nigg, D.W.; Cogliati, J.J.; Milvich, M.L.; Frederickson, C.; Perkins, M.; Harkin, G.J

2004-11-01

Researchers at the Idaho National Engineering and Environmental Laboratory and Montana State University have undertaken development of MINERVA, a patient-centric, multi-modal, radiation treatment planning system. This system can be used for planning and analyzing several radiotherapy modalities, either singly or combined, using common modality independent image and geometry construction and dose reporting and guiding. It employs an integrated, lightweight plugin architecture to accommodate multi-modal treatment planning using standard interface components. The MINERVA design also facilitates the future integration of improved planning technologies. The code is being developed with the Java Virtual Machine for interoperability. A full computation path has been established for molecular targeted radiotherapy treatment planning, with the associated transport plugin developed by researchers at the Lawrence Livermore National Laboratory. Development of the neutron transport plugin module is proceeding rapidly, with completion expected later this year. Future development efforts will include development of deformable registration methods, improved segmentation methods for patient model definition, and three-dimensional visualization of the patient images, geometry, and dose data. Transport and source plugins will be created for additional treatment modalities, including brachytherapy, external beam proton radiotherapy, and the EGSnrc/BEAMnrc codes for external beam photon and electron radiotherapy.

Targeted molecular imaging

International Nuclear Information System (INIS)

Kim, E. Edmund

2003-01-01

Molecular imaging aims to visualize the cellular and molecular processes occurring in living tissues, and for the imaging of specific molecules in vivo, the development of reporter probes and dedicated imaging equipment is most important. Reporter genes can be used to monitor the delivery and magnitude of therapeutic gene transfer, and the time variation involved. Imaging technologies such as micro-PET, SPECT, MRI and CT, as well as optical imaging systems, are able to non-invasively detect, measure, and report the simultaneous expression of multiple meaningful genes. It is believed that recent advances in reporter probes, imaging technologies and gene transfer strategies will enhance the effectiveness of gene therapy trials

Classification of ADHD children through multimodal Magnetic Resonance Imaging

Directory of Open Access Journals (Sweden)

Dai eDai

2012-09-01

Full Text Available Attention deficit/hyperactivity disorder (ADHD is one of the most common diseases in school-age children. To date, the diagnosis of ADHD is mainly subjective and studies of objective diagnostic method are of great importance. Although many efforts have been made recently to investigate the use of structural and functional brain images for the diagnosis purpose, few of them are related to ADHD. In this paper, we introduce an automatic classification framework based on brain imaging features of ADHD patients, and present in detail the feature extraction, feature selection and classifier training methods. The effects of using different features are compared against each other. In addition, we integrate multimodal image features using multi-kernel learning (MKL. The performance of our framework has been validated in the ADHD-200 Global Competition, which is a world-wide classification contest on the ADHD-200 datasets. In this competition, our classification framework using features of resting-state functional connectivity was ranked the 6th out of 21 participants under the competition scoring policy, and performed the best in terms of sensitivity and J-statistic.

WE-H-206-00: Advances in Preclinical Imaging

International Nuclear Information System (INIS)

2016-01-01

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

WE-H-206-00: Advances in Preclinical Imaging

Energy Technology Data Exchange (ETDEWEB)

NONE

2016-06-15

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

Nanoplatform-based molecular imaging

National Research Council Canada - National Science Library

Chen, Xiaoyuan

2011-01-01

"Nanoplathform-Based Molecular Imaging provides rationale for using nanoparticle-based probes for molecular imaging, then discusses general strategies for this underutilized, yet promising, technology...

Molecular MR imaging

International Nuclear Information System (INIS)

Fleige, G.; Hamm, B.

2000-01-01

Basic medicobiological research in recent years has made rapid advances in the functional understanding of normal and pathological processes down to the molecular level. At the same time, various imaging modalities have developed from the depiction of organs to approaching the depiction of the cellular level and are about to make the visualization of molecular processes an established procedure. Besides other modalities like PET and near-infrared fluorescence, MR imaging offers some promising options for molecular imaging as well as some applications that have already been tested such as the visualization of enzyme activity, the depiction of the expression of certain genes, the visualization of surface receptors, or the specific demonstration of cells involved in the body's immune response. A major advantage of molecular magnetic resonance imaging (mMRI) over other more sensitive modalities is its high spatial resolution. However, the establishment of mMRI crucially relies on further improvements in resolution and the development of molecular markers for improving its sensitivity and specificity. The state of the art of mMRI is presented by giving a survey of the literature on experimental studies and reporting the results our study group obtained during investigation on gliomas. (orig.) [de

Primary evaluation of a nickel-chlorophyll derivative as a multimodality agent for tumor imaging and photodynamic therapy

International Nuclear Information System (INIS)

Ozge Er; Fatma Yurt Lambrecht; Kasim Ocakoglu; Cagla Kayabasi; Cumhur Gunduz

2015-01-01

In this study, the biological potential of a nickel chlorophyll derivative (Ni-PH-A) as a multimodal agent for tumor imaging and photodynamic therapy (PDT) was investigated. Optimum conditions of labeling with 131 I were investigated and determined as pH 10 and 1 mg amount of iodogen. Biodistribution results of 131 I labeled Ni-PH-A in female rats indicated that radiolabeled Ni-PH-A maximum uptake in the liver, spleen and ovary was observed at 30 min. Intercellular uptake and PDT efficacy of Ni-PH-A were better in MDAH-2774 (human ovarian endometrioid adenocarcinoma) than in MCF-7 (human breast adenocarcinoma) cells. Ni-PH-A might be a promising multimodal agent for lung, ovary and liver tumor imaging and PDT. (author)

VoxelStats: A MATLAB Package for Multi-Modal Voxel-Wise Brain Image Analysis.

Science.gov (United States)

Mathotaarachchi, Sulantha; Wang, Seqian; Shin, Monica; Pascoal, Tharick A; Benedet, Andrea L; Kang, Min Su; Beaudry, Thomas; Fonov, Vladimir S; Gauthier, Serge; Labbe, Aurélie; Rosa-Neto, Pedro

2016-01-01

In healthy individuals, behavioral outcomes are highly associated with the variability on brain regional structure or neurochemical phenotypes. Similarly, in the context of neurodegenerative conditions, neuroimaging reveals that cognitive decline is linked to the magnitude of atrophy, neurochemical declines, or concentrations of abnormal protein aggregates across brain regions. However, modeling the effects of multiple regional abnormalities as determinants of cognitive decline at the voxel level remains largely unexplored by multimodal imaging research, given the high computational cost of estimating regression models for every single voxel from various imaging modalities. VoxelStats is a voxel-wise computational framework to overcome these computational limitations and to perform statistical operations on multiple scalar variables and imaging modalities at the voxel level. VoxelStats package has been developed in Matlab(®) and supports imaging formats such as Nifti-1, ANALYZE, and MINC v2. Prebuilt functions in VoxelStats enable the user to perform voxel-wise general and generalized linear models and mixed effect models with multiple volumetric covariates. Importantly, VoxelStats can recognize scalar values or image volumes as response variables and can accommodate volumetric statistical covariates as well as their interaction effects with other variables. Furthermore, this package includes built-in functionality to perform voxel-wise receiver operating characteristic analysis and paired and unpaired group contrast analysis. Validation of VoxelStats was conducted by comparing the linear regression functionality with existing toolboxes such as glim_image and RMINC. The validation results were identical to existing methods and the additional functionality was demonstrated by generating feature case assessments (t-statistics, odds ratio, and true positive rate maps). In summary, VoxelStats expands the current methods for multimodal imaging analysis by allowing the

Introduction to basic molecular biologic techniques for molecular imaging researches

International Nuclear Information System (INIS)

Kang, Joo Hyun

2004-01-01

Molecular imaging is a rapidly growing field due to the advances in molecular biology and imaging technologies. With the introduction of imaging reporter genes into the cell, diverse cellular processes can be monitored, quantified and imaged non-invasively in vivo. These processes include the gene expression, protein-protein interactions, signal transduction pathways, and monitoring of cells such as cancer cells, immune cells, and stem cells. In the near future, molecular imaging analysis will allow us to observe the incipience and progression of the disease. These will make us easier to give a diagnosis in the early stage of intractable diseases such as cancer, neuro-degenerative disease, and immunological disorders. Additionally, molecular imaging method will be a valuable tool for the real-time evaluation of cells in molecular biology and the basic biological studies. As newer and more powerful molecular imaging tools become available, it will be necessary to corporate clinicians, molecular biologists and biochemists for the planning, interpretation, and application of these techniques to their fullest potential. In order for such a multidisciplinary team to be effective, it is essential that a common understanding of basic biochemical and molecular biologic techniques is achieved. Basic molecular techniques for molecular imaging methods are presented in this paper

An embedded system for image segmentation and multimodal registration in noninvasive skin cancer screening.

Science.gov (United States)

Diaz, Silvana; Soto, Javier E; Inostroza, Fabian; Godoy, Sebastian E; Figueroa, Miguel

2017-07-01

We present a heterogeneous architecture for image registration and multimodal segmentation on an embedded system for noninvasive skin cancer screening. The architecture combines Otsu thresholding and the random walker algorithm to perform image segmentation, and features a hardware implementation of the Harris corner detection algorithm to perform region-of-interest detection and image registration. Running on a Xilinx XC7Z020 reconfigurable system-on-a-chip, our prototype computes the initial segmentation of a 400×400-pixel region of interest in the visible spectrum in 12.1 seconds, and registers infrared images against this region at 540 frames per second, while consuming 1.9W.

Multi-modality image reconstruction for dual-head small-animal PET

International Nuclear Information System (INIS)

Huang, Chang-Han; Chou, Cheng-Ying

2015-01-01

The hybrid positron emission tomography/computed tomography (PET/CT) or positron emission tomography/magnetic resonance imaging (PET/MRI) has become routine practice in clinics. The applications of multi-modality imaging can also benefit research advances. Consequently, dedicated small-imaging system like dual-head small-animal PET (DHAPET) that possesses the advantages of high detection sensitivity and high resolution can exploit the structural information from CT or MRI. It should be noted that the special detector arrangement in DHAPET leads to severe data truncation, thereby degrading the image quality. We proposed to take advantage of anatomical priors and total variation (TV) minimization methods to reconstruct PET activity distribution form incomplete measurement data. The objective is to solve the penalized least-squares function consisted of data fidelity term, TV norm and medium root priors. In this work, we employed the splitting-based fast iterative shrinkage/thresholding algorithm to split smooth and non-smooth functions in the convex optimization problems. Our simulations studies validated that the images reconstructed by use of the proposed method can outperform those obtained by use of conventional expectation maximization algorithms or that without considering the anatomical prior information. Additionally, the convergence rate is also accelerated.

Cardiovascular molecular imaging of apoptosis

International Nuclear Information System (INIS)

Wolters, S.L.; Reutelingsperger, C.P.M.; Corsten, M.F.; Hofstra, L.; Narula, J.

2007-01-01

Molecular imaging strives to visualise processes at the molecular and cellular level in vivo. Understanding these processes supports diagnosis and evaluation of therapeutic efficacy on an individual basis and thereby makes personalised medicine possible. Apoptosis is a well-organised mode of cell suicide that plays a role in cardiovascular diseases (CVD). Apoptosis is associated with loss of cardiomyocytes following myocardial infarction, atherosclerotic plaque instability, congestive heart failure and allograft rejection of the transplanted heart. Thus, apoptosis constitutes an attractive target for molecular imaging of CVD. Our current knowledge about the molecular players and mechanisms underlying apoptosis offers a rich palette of potential molecular targets for molecular imaging. However, only a few have been successfully developed so far. This review highlights aspects of the molecular machinery and biochemistry of apoptosis relevant to the development of molecular imaging probes. It surveys the role of apoptosis in four major areas of CVD and portrays the importance and future perspectives of apoptosis imaging. The annexin A5 imaging protocol is emphasised since it is the most advanced protocol to measure apoptosis in both preclinical and clinical studies. (orig.)

Cardiovascular molecular imaging of apoptosis

Energy Technology Data Exchange (ETDEWEB)

Wolters, S.L.; Reutelingsperger, C.P.M. [Maastricht University, Department of Biochemistry, Cardiovascular Research Institute Maastricht, Maastricht (Netherlands); Corsten, M.F.; Hofstra, L. [Maastricht University, Department of Cardiology, Cardiovascular Research Institute Maastricht, P.O. Box 616, Maastricht (Netherlands); Narula, J. [University of California Irvine, Department of Cardiology, Irvine (United States)

2007-06-15

Molecular imaging strives to visualise processes at the molecular and cellular level in vivo. Understanding these processes supports diagnosis and evaluation of therapeutic efficacy on an individual basis and thereby makes personalised medicine possible. Apoptosis is a well-organised mode of cell suicide that plays a role in cardiovascular diseases (CVD). Apoptosis is associated with loss of cardiomyocytes following myocardial infarction, atherosclerotic plaque instability, congestive heart failure and allograft rejection of the transplanted heart. Thus, apoptosis constitutes an attractive target for molecular imaging of CVD. Our current knowledge about the molecular players and mechanisms underlying apoptosis offers a rich palette of potential molecular targets for molecular imaging. However, only a few have been successfully developed so far. This review highlights aspects of the molecular machinery and biochemistry of apoptosis relevant to the development of molecular imaging probes. It surveys the role of apoptosis in four major areas of CVD and portrays the importance and future perspectives of apoptosis imaging. The annexin A5 imaging protocol is emphasised since it is the most advanced protocol to measure apoptosis in both preclinical and clinical studies. (orig.)

Near-infrared light-triggered theranostics for tumor-specific enhanced multimodal imaging and photothermal therapy

Directory of Open Access Journals (Sweden)

Wu B

2017-06-01

Full Text Available Bo Wu,1,* Bing Wan,2,* Shu-Ting Lu,1 Kai Deng,3 Xiao-Qi Li,1 Bao-Lin Wu,1 Yu-Shuang Li,1 Ru-Fang Liao,1 Shi-Wen Huang,3 Hai-Bo Xu1,2 1Department of Radiology, Zhongnan Hospital of Wuhan University, 2Department of Radiology, Union Hospital of Tongji Medical College, Huazhong University of Science and Technology, 3Department of Chemistry, Key Laboratory of Biomedical Polymers, Ministry of Education, Wuhan University, Wuhan, People’s Republic of China *These authors contributed equally to this work Abstract: The major challenge in current clinic contrast agents (CAs and chemotherapy is the poor tumor selectivity and response. Based on the self-quench property of IR820 at high concentrations, and different contrast effect ability of Gd-DOTA between inner and outer of liposome, we developed “bomb-like” light-triggered CAs (LTCAs for enhanced CT/MRI/FI multimodal imaging, which can improve the signal-to-noise ratio of tumor tissue specifically. IR820, Iohexol and Gd-chelates were firstly encapsulated into the thermal-sensitive nanocarrier with a high concentration. This will result in protection and fluorescence quenching. Then, the release of CAs was triggered by near-infrared (NIR light laser irradiation, which will lead to fluorescence and MRI activation and enable imaging of inflammation. In vitro and in vivo experiments demonstrated that LTCAs with 808 nm laser irradiation have shorter T1 relaxation time in MRI and stronger intensity in FI compared to those without irradiation. Additionally, due to the high photothermal conversion efficiency of IR820, the injection of LTCAs was demonstrated to completely inhibit C6 tumor growth in nude mice up to 17 days after NIR laser irradiation. The results indicate that the LTCAs can serve as a promising platform for NIR-activated multimodal imaging and photothermal therapy. Keywords: light triggered, near-infrared light, tumor-specific, multimodal imaging, photothermal therapy, contrast agents

Nanodiamond Landmarks for Subcellular Multimodal Optical and Electron Imaging

Science.gov (United States)

Zurbuchen, Mark A.; Lake, Michael P.; Kohan, Sirus A.; Leung, Belinda; Bouchard, Louis-S.

2013-01-01

There is a growing need for biolabels that can be used in both optical and electron microscopies, are non-cytotoxic, and do not photobleach. Such biolabels could enable targeted nanoscale imaging of sub-cellular structures, and help to establish correlations between conjugation-delivered biomolecules and function. Here we demonstrate a sub-cellular multi-modal imaging methodology that enables localization of inert particulate probes, consisting of nanodiamonds having fluorescent nitrogen-vacancy centers. These are functionalized to target specific structures, and are observable by both optical and electron microscopies. Nanodiamonds targeted to the nuclear pore complex are rapidly localized in electron-microscopy diffraction mode to enable “zooming-in” to regions of interest for detailed structural investigations. Optical microscopies reveal nanodiamonds for in-vitro tracking or uptake-confirmation. The approach is general, works down to the single nanodiamond level, and can leverage the unique capabilities of nanodiamonds, such as biocompatibility, sensitive magnetometry, and gene and drug delivery. PMID:24036840

Multimodal Translation System Using Texture-Mapped Lip-Sync Images for Video Mail and Automatic Dubbing Applications

Science.gov (United States)

Morishima, Shigeo; Nakamura, Satoshi

2004-12-01

We introduce a multimodal English-to-Japanese and Japanese-to-English translation system that also translates the speaker's speech motion by synchronizing it to the translated speech. This system also introduces both a face synthesis technique that can generate any viseme lip shape and a face tracking technique that can estimate the original position and rotation of a speaker's face in an image sequence. To retain the speaker's facial expression, we substitute only the speech organ's image with the synthesized one, which is made by a 3D wire-frame model that is adaptable to any speaker. Our approach provides translated image synthesis with an extremely small database. The tracking motion of the face from a video image is performed by template matching. In this system, the translation and rotation of the face are detected by using a 3D personal face model whose texture is captured from a video frame. We also propose a method to customize the personal face model by using our GUI tool. By combining these techniques and the translated voice synthesis technique, an automatic multimodal translation can be achieved that is suitable for video mail or automatic dubbing systems into other languages.

Focusing and imaging with increased numerical apertures through multimode fibers with micro-fabricated optics.

Science.gov (United States)

Bianchi, S; Rajamanickam, V P; Ferrara, L; Di Fabrizio, E; Liberale, C; Di Leonardo, R

2013-12-01

The use of individual multimode optical fibers in endoscopy applications has the potential to provide highly miniaturized and noninvasive probes for microscopy and optical micromanipulation. A few different strategies have been proposed recently, but they all suffer from intrinsically low resolution related to the low numerical aperture of multimode fibers. Here, we show that two-photon polymerization allows for direct fabrication of micro-optics components on the fiber end, resulting in an increase of the numerical aperture to a value that is close to 1. Coupling light into the fiber through a spatial light modulator, we were able to optically scan a submicrometer spot (300 nm FWHM) over an extended region, facing the opposite fiber end. Fluorescence imaging with improved resolution is also demonstrated.

EDITORIAL: Molecular Imaging Technology

Science.gov (United States)

Asai, Keisuke; Okamoto, Koji

2006-06-01

'Molecular Imaging Technology' focuses on image-based techniques using nanoscale molecules as sensor probes to measure spatial variations of various species (molecular oxygen, singlet oxygen, carbon dioxide, nitric monoxide, etc) and physical properties (pressure, temperature, skin friction, velocity, mechanical stress, etc). This special feature, starting on page 1237, contains selected papers from The International Workshop on Molecular Imaging for Interdisciplinary Research, sponsored by the Ministry of Education, Culture, Sports, Science and Technology (MEXT) in Japan, which was held at the Sendai Mediatheque, Sendai, Japan, on 8 9 November 2004. The workshop was held as a sequel to the MOSAIC International Workshop that was held in Tokyo in 2003, to summarize the outcome of the 'MOSAIC Project', a five-year interdisciplinary project supported by Techno-Infrastructure Program, the Special Coordination Fund for Promotion of Science Technology to develop molecular sensor technology for aero-thermodynamic research. The workshop focused on molecular imaging technology and its applications to interdisciplinary research areas. More than 110 people attended this workshop from various research fields such as aerospace engineering, automotive engineering, radiotechnology, fluid dynamics, bio-science/engineering and medical engineering. The purpose of this workshop is to stimulate intermixing of these interdisciplinary fields for further development of molecular sensor and imaging technology. It is our pleasure to publish the seven papers selected from our workshop as a special feature in Measurement and Science Technology. We will be happy if this issue inspires people to explore the future direction of molecular imaging technology for interdisciplinary research.

Ultrasmall lanthanide oxide nanoparticles for biomedical imaging and therapy

CERN Document Server

Lee, Gang Ho

2014-01-01

Most books discuss general and broad topics regarding molecular imagings. However, Ultrasmall Lanthanide Oxide Nanoparticles for Biomedical Imaging and Therapy, will mainly focus on lanthanide oxide nanoparticles for molecular imaging and therapeutics. Multi-modal imaging capabilities will discussed, along with up-converting FI by using lanthanide oxide nanoparticles. The synthesis will cover polyol synthesis of lanthanide oxide nanoparticles, Surface coatings with biocompatible and hydrophilic ligands will be discussed and TEM images and dynamic light scattering (DLS) patterns will be

Molecular imaging in neurology and neuroscience

International Nuclear Information System (INIS)

Schreckenberger, M.

2007-01-01

Molecular imaging in neurology and neuroscience is a suspenseful and fast developing tool in order to quantitatively image genomics and proteomics by means of direct and indirect markers. Because of its high-sensitive tracer principle, nuclear medicine imaging has the pioneering task for the methodical progression of molecular imaging. The current development of molecular imaging in neurology changes from the use of indirect markers of gene and protein expression to the direct imaging of the molecular mechanisms. It is the aim of this article to give a short review on the status quo of molecular imaging in neurology with emphasis on clinically relevant aspects. (orig.)

Molecular imaging in oncology

International Nuclear Information System (INIS)

Weber, W.A.

2007-01-01

Molecular imaging is generally defined as noninvasive and quantitative imaging of targeted macromolecules and biological processes in living organisms. A characteristic of molecular imaging is the ability to perform repeated studies and assess changes in biological processes over time. Thus molecular imaging lends itself well for monitoring the effectiveness of tumor therapy. In animal models a variety of techniques can be used for molecular imaging. These include optical imaging (bioluminescence and fluorescence imaging), magnetic resonance imaging (MRI) and nuclear medicine techniques. In the clinical setting, however, nuclear medicine techniques predominate, because so far only radioactive tracers provide the necessary sensitivity to study expression and function of macromolecules non-invasively in patients. Nuclear medicine techniques allows to study a variety of biological processes in patients. These include the expression of various receptors (estrogen, androgen, somatostatin receptors and integrins). In addition, tracers are available to study tumor cell proliferation and hypoxia. The by far most commonly used molecular imaging technique in oncology is, however, positron emission tomography (PET) with the glucose analog [ 18 F]fluorodeoxyglucose (FDG-PET). FDG-PET permits non-invasive quantitative assessment of the accelerated exogenous glucose use of malignant tumors. Numerous studies have now shown that reduction of tumor FDG-uptake during therapy allows early prediction of tumor response and patient survival. Clinical studies are currently underway to determine whether FDG-PET can be used to individualize tumor therapy by signaling early in the course of therapy the need for therapeutic adjustments in patients with likely non-responding tumors. (orig.)

MRI Reporter Genes for Noninvasive Molecular Imaging

Directory of Open Access Journals (Sweden)

Caixia Yang

2016-05-01

Full Text Available Magnetic resonance imaging (MRI is one of the most important imaging technologies used in clinical diagnosis. Reporter genes for MRI can be applied to accurately track the delivery of cell in cell therapy, evaluate the therapy effect of gene delivery, and monitor tissue/cell-specific microenvironments. Commonly used reporter genes for MRI usually include genes encoding the enzyme (e.g., tyrosinase and β-galactosidase, the receptor on the cells (e.g., transferrin receptor, and endogenous reporter genes (e.g., ferritin reporter gene. However, low sensitivity limits the application of MRI and reporter gene-based multimodal imaging strategies are common including optical imaging and radionuclide imaging. These can significantly improve diagnostic efficiency and accelerate the development of new therapies.

Molecular cardiovascular imaging

International Nuclear Information System (INIS)

Schaefers, M.

2007-01-01

Although huge and long-lasting research efforts have been spent on the development of new diagnostic techniques investigating cardiovascular diseases, still fundamental challenges exist; the main challenge being the diagnosis of a suspected or known coronary artery disease or its consequences (myocardial infarction, heart failure etc.). Beside morphological techniques, functional imaging modalities are available in clinical diagnostic algorithms, whereas molecular cardiovascular imaging techniques are still under development. This review summarizes clinical-diagnostical challenges of modern cardiovascular medicine as well as the potential of new molecular imaging techniques to face these. (orig.)

Tissue imaging using full field optical coherence microscopy with short multimode fiber probe

Science.gov (United States)

Sato, Manabu; Eto, Kai; Goto, Tetsuhiro; Kurotani, Reiko; Abe, Hiroyuki; Nishidate, Izumi

2018-03-01

In achieving minimally invasive accessibility to deeply located regions the size of the imaging probes is important. We demonstrated full-field optical coherence tomography (FF-OCM) using an ultrathin forward-imaging short multimode fiber (SMMF) probe of 50 μm core diameter, 125 μm diameter, and 7.4 mm length for optical communications. The axial resolution was measured to be 2.14 μm and the lateral resolution was also evaluated to be below 4.38 μm using a test pattern (TP). The spatial mode and polarization characteristics of SMMF were evaluated. Inserting SMMF to in vivo rat brain, 3D images were measured and 2D information of nerve fibers was obtained. The feasibility of an SMMF as an ultrathin forward-imaging probe in FF-OCM has been demonstrated.

Depth-resolved imaging of colon tumor using optical coherence tomography and fluorescence laminar optical tomography (Conference Presentation)

Science.gov (United States)

Tang, Qinggong; Frank, Aaron; Wang, Jianting; Chen, Chao-wei; Jin, Lily; Lin, Jon; Chan, Joanne M.; Chen, Yu

2016-03-01

Early detection of neoplastic changes remains a critical challenge in clinical cancer diagnosis and treatment. Many cancers arise from epithelial layers such as those of the gastrointestinal (GI) tract. Current standard endoscopic technology is unable to detect those subsurface lesions. Since cancer development is associated with both morphological and molecular alterations, imaging technologies that can quantitative image tissue's morphological and molecular biomarkers and assess the depth extent of a lesion in real time, without the need for tissue excision, would be a major advance in GI cancer diagnostics and therapy. In this research, we investigated the feasibility of multi-modal optical imaging including high-resolution optical coherence tomography (OCT) and depth-resolved high-sensitivity fluorescence laminar optical tomography (FLOT) for structural and molecular imaging. APC (adenomatous polyposis coli) mice model were imaged using OCT and FLOT and the correlated histopathological diagnosis was obtained. Quantitative structural (the scattering coefficient) and molecular imaging parameters (fluorescence intensity) from OCT and FLOT images were developed for multi-parametric analysis. This multi-modal imaging method has demonstrated the feasibility for more accurate diagnosis with 87.4% (87.3%) for sensitivity (specificity) which gives the most optimal diagnosis (the largest area under receiver operating characteristic (ROC) curve). This project results in a new non-invasive multi-modal imaging platform for improved GI cancer detection, which is expected to have a major impact on detection, diagnosis, and characterization of GI cancers, as well as a wide range of epithelial cancers.

SU-E-I-83: Error Analysis of Multi-Modality Image-Based Volumes of Rodent Solid Tumors Using a Preclinical Multi-Modality QA Phantom

Energy Technology Data Exchange (ETDEWEB)

Lee, Y [University of Kansas Hospital, Kansas City, KS (United States); Fullerton, G; Goins, B [University of Texas Health Science Center at San Antonio, San Antonio, TX (United States)

2015-06-15

Purpose: In our previous study a preclinical multi-modality quality assurance (QA) phantom that contains five tumor-simulating test objects with 2, 4, 7, 10 and 14 mm diameters was developed for accurate tumor size measurement by researchers during cancer drug development and testing. This study analyzed the errors during tumor volume measurement from preclinical magnetic resonance (MR), micro-computed tomography (micro- CT) and ultrasound (US) images acquired in a rodent tumor model using the preclinical multi-modality QA phantom. Methods: Using preclinical 7-Tesla MR, US and micro-CT scanners, images were acquired of subcutaneous SCC4 tumor xenografts in nude rats (3–4 rats per group; 5 groups) along with the QA phantom using the same imaging protocols. After tumors were excised, in-air micro-CT imaging was performed to determine reference tumor volume. Volumes measured for the rat tumors and phantom test objects were calculated using formula V = (π/6)*a*b*c where a, b and c are the maximum diameters in three perpendicular dimensions determined by the three imaging modalities. Then linear regression analysis was performed to compare image-based tumor volumes with the reference tumor volume and known test object volume for the rats and the phantom respectively. Results: The slopes of regression lines for in-vivo tumor volumes measured by three imaging modalities were 1.021, 1.101 and 0.862 for MRI, micro-CT and US respectively. For phantom, the slopes were 0.9485, 0.9971 and 0.9734 for MRI, micro-CT and US respectively. Conclusion: For both animal and phantom studies, random and systematic errors were observed. Random errors were observer-dependent and systematic errors were mainly due to selected imaging protocols and/or measurement method. In the animal study, there were additional systematic errors attributed to ellipsoidal assumption for tumor shape. The systematic errors measured using the QA phantom need to be taken into account to reduce measurement

Development of magneto-plasmonic nanoparticles for multimodal image-guided therapy to the brain

OpenAIRE

Tomitaka, Asahi; Arami, Hamed; Raymond, Andrea; Yndart, Adriana; Kaushik, Ajeet; Jayant, Rahul Dev; Takemura, Yasushi; Cai, Yong; Toborek, Michal; Nair, Madhavan

2017-01-01

Magneto-plasmonic nanoparticles are one of the emerging multi-functional materials in the field of nanomedicine. Their potential for targeting and multi-modal imaging is highly attractive. In this study, magnetic core / gold shell (MNP@Au) magneto-plasmonic nanoparticles were synthesized by citrate reduction of Au ion on magnetic nanoparticle seeds. Hydrodynamic size and optical property of magneto-plasmonic nanoparticles synthesized with the variation of Au ion and reducing agent concentrati...

Focusing and imaging with increased numerical apertures through multimode fibers with micro-fabricated optics

KAUST Repository

Bianchi, Silvio; Rajamanickam, V.; Ferrara, Lorenzo; Di Fabrizio, Enzo M.; Liberale, Carlo; Di Leonardo, Roberto

2013-01-01

The use of individual multimode optical fibers in endoscopy applications has the potential to provide highly miniaturized and noninvasive probes for microscopy and optical micromanipulation. A few different strategies have been proposed recently, but they all suffer from intrinsically low resolution related to the low numerical aperture of multimode fibers. Here, we show that two-photon polymerization allows for direct fabrication of micro-optics components on the fiber end, resulting in an increase of the numerical aperture to a value that is close to 1. Coupling light into the fiber through a spatial light modulator, we were able to optically scan a submicrometer spot (300 nm FWHM) over an extended region, facing the opposite fiber end. Fluorescence imaging with improved resolution is also demonstrated. © 2013 Optical Society of America.

ADMultiImg: a novel missing modality transfer learning based CAD system for diagnosis of MCI due to AD using incomplete multi-modality imaging data

Science.gov (United States)

Liu, Xiaonan; Chen, Kewei; Wu, Teresa; Weidman, David; Lure, Fleming; Li, Jing

2018-02-01

Alzheimer's Disease (AD) is the most common cause of dementia and currently has no cure. Treatments targeting early stages of AD such as Mild Cognitive Impairment (MCI) may be most effective to deaccelerate AD, thus attracting increasing attention. However, MCI has substantial heterogeneity in that it can be caused by various underlying conditions, not only AD. To detect MCI due to AD, NIA-AA published updated consensus criteria in 2011, in which the use of multi-modality images was highlighted as one of the most promising methods. It is of great interest to develop a CAD system based on automatic, quantitative analysis of multi-modality images and machine learning algorithms to help physicians more adequately diagnose MCI due to AD. The challenge, however, is that multi-modality images are not universally available for many patients due to cost, access, safety, and lack of consent. We developed a novel Missing Modality Transfer Learning (MMTL) algorithm capable of utilizing whatever imaging modalities are available for an MCI patient to diagnose the patient's likelihood of MCI due to AD. Furthermore, we integrated MMTL with radiomics steps including image processing, feature extraction, and feature screening, and a post-processing for uncertainty quantification (UQ), and developed a CAD system called "ADMultiImg" to assist clinical diagnosis of MCI due to AD using multi-modality images together with patient demographic and genetic information. Tested on ADNI date, our system can generate a diagnosis with high accuracy even for patients with only partially available image modalities (AUC=0.94), and therefore may have broad clinical utility.

Intratumoral Administration of Holmium-166 Acetylacetonate Microspheres : Antitumor Efficacy and Feasibility of Multimodality Imaging in Renal Cancer

NARCIS (Netherlands)

Bult, Wouter; Kroeze, Stephanie G. C.; Elschot, Mattijs; Seevinck, Peter R.; Beekman, Freek J.; de Jong, Hugo W. A. M.; Uges, Donald R. A.; Kosterink, Jos G. W.; Luijten, Peter R.; Hennink, Wim E.; Schip, Alfred D. van Het; Bosch, J. L. H. Ruud; Nijsen, J. Frank W.; Jans, Judith J. M.

2013-01-01

Purpose: The increasing incidence of small renal tumors in an aging population with comorbidities has stimulated the development of minimally invasive treatments. This study aimed to assess the efficacy and demonstrate feasibility of multimodality imaging of intratumoral administration of

Multimodal Translation System Using Texture-Mapped Lip-Sync Images for Video Mail and Automatic Dubbing Applications

Directory of Open Access Journals (Sweden)

Nakamura Satoshi

2004-01-01

Full Text Available We introduce a multimodal English-to-Japanese and Japanese-to-English translation system that also translates the speaker's speech motion by synchronizing it to the translated speech. This system also introduces both a face synthesis technique that can generate any viseme lip shape and a face tracking technique that can estimate the original position and rotation of a speaker's face in an image sequence. To retain the speaker's facial expression, we substitute only the speech organ's image with the synthesized one, which is made by a 3D wire-frame model that is adaptable to any speaker. Our approach provides translated image synthesis with an extremely small database. The tracking motion of the face from a video image is performed by template matching. In this system, the translation and rotation of the face are detected by using a 3D personal face model whose texture is captured from a video frame. We also propose a method to customize the personal face model by using our GUI tool. By combining these techniques and the translated voice synthesis technique, an automatic multimodal translation can be achieved that is suitable for video mail or automatic dubbing systems into other languages.

Current state of molecular imaging research

International Nuclear Information System (INIS)

Grimm, J.; Wunder, A.

2005-01-01

The recent years have seen significant advances in both molecular biology, allowing the identification of genes and pathways related to disease, and imaging technologies that allow for improved spatial and temporal resolution, enhanced sensitivity, better depth penetration, improved image processing, and beneficial combinations of different imaging modalities. These advances have led to a paradigm shift in the scope of diagnostic imaging. The traditional role of radiological diagnostic imaging is to define gross anatomy and structure in order to detect pathological abnormalities. Available contrast agents are mostly non-specific and can be used to image physiological processes such as changes in blood volume, flow, and perfusion but not to demonstrate pathological alterations at molecular levels. However, alterations at the anatomical-morphological level are relatively late manifestations of underlying molecular changes. Using molecular probes or markers that bind specifically to molecular targets allows for the non-invasive visualization and quantitation of biological processes such as gene expression, apoptosis, or angiogenesis at the molecular level within intact living organisms. This rapidly evolving, multidisciplinary approach, referred to as molecular imaging, promises to enable early diagnosis, can provide improved classification of stage and severity of disease, an objective assessment of treatment efficacy, and a reliable prognosis. Furthermore, molecular imaging is an important tool for the evaluation of physiological and pathophysiological processes, and for the development of new therapies. This article comprises a review of current technologies of molecular imaging, describes the development of contrast agents and various imaging modalities, new applications in specific disease models, and potential future developments. (orig.)

Comparison of two imaging protocols for acute stroke: unenhanced cranial CT versus a multimodality cranial CT protocol with perfusion imaging

International Nuclear Information System (INIS)

Langer, R. D.; Gorkom, K. Neidl van.; Kaabi, Ho Al.; Torab, F.; Czechowski, J.; Nagi, M.; Ashish, G. M.

2007-01-01

Full text: The aim of the study was to validate a multimodality cranial computed tomography (CCT) protocol for patients with acute stroke in the United Arab Emirates as a basic imaging procedure for a stroke unit. Therefore, a comparative study was conducted between two groups: retrospective, historical group 1 with early unenhanced CCT and prospective group 2 undergoing a multimodality CCT protocol. Follow-up unenhanced CCT >48 h served as gold standard in both groups. Group 1: Early unenhanced CCT of 50 patients were evaluated retrospectively, using Alberta Stroke Program Early CT Score, and compared with the definite infarction on follow-up CCT. Group 2: 50 patients underwent multimodality CCT (unenhanced CCT, perfusion studies: cerebral blood flow, cerebral blood volume, mean transit time and CT angiography) <8 h after clinical onset and follow-up studies. Modified National Institute of Health Stroke Scale was used clinically in both groups. Group 1 showed 38 men, 12 women, clinical onset 2-8 h before CCT and modified National Institute of Health Stroke Scale 0-28. Group 2 included 38 men, 12 women, onset 3-8 h before CCT, modified National Institute of Health Stroke Scale 0-28. Sensitivity was 58.3% in group 1 and 84.2% in group 2. Computed tomography angiography detected nine intracranial occlusions/stenoses. The higher sensitivity of the multimodality CCT protocol justifies its use as a basic diagnostic tool for the set-up of a first-stroke unit in the United Arab Emirates

Multimodality medical image database for temporal lobe epilepsy

Science.gov (United States)

Siadat, Mohammad-Reza; Soltanian-Zadeh, Hamid; Fotouhi, Farshad A.; Elisevich, Kost

2003-05-01

This paper presents the development of a human brain multi-modality database for surgical candidacy determination in temporal lobe epilepsy. The focus of the paper is on content-based image management, navigation and retrieval. Several medical image-processing methods including our newly developed segmentation method are utilized for information extraction/correlation and indexing. The input data includes T1-, T2-Weighted and FLAIR MRI and ictal/interictal SPECT modalities with associated clinical data and EEG data analysis. The database can answer queries regarding issues such as the correlation between the attribute X of the entity Y and the outcome of a temporal lobe epilepsy surgery. The entity Y can be a brain anatomical structure such as the hippocampus. The attribute X can be either a functionality feature of the anatomical structure Y, calculated with SPECT modalities, such as signal average, or a volumetric/morphological feature of the entity Y such as volume or average curvature. The outcome of the surgery can be any surgery assessment such as non-verbal Wechsler memory quotient. A determination is made regarding surgical candidacy by analysis of both textual and image data. The current database system suggests a surgical determination for the cases with relatively small hippocampus and high signal intensity average on FLAIR images within the hippocampus. This indication matches the neurosurgeons expectations/observations. Moreover, as the database gets more populated with patient profiles and individual surgical outcomes, using data mining methods one may discover partially invisible correlations between the contents of different modalities of data and the outcome of the surgery.

Multimodal imaging evaluation in staging of rectal cancer

Science.gov (United States)

Heo, Suk Hee; Kim, Jin Woong; Shin, Sang Soo; Jeong, Yong Yeon; Kang, Heoung-Keun

2014-01-01

Rectal cancer is a common cancer and a major cause of mortality in Western countries. Accurate staging is essential for determining the optimal treatment strategies and planning appropriate surgical procedures to control rectal cancer. Endorectal ultrasonography (EUS) is suitable for assessing the extent of tumor invasion, particularly in early-stage or superficial rectal cancer cases. In advanced cases with distant metastases, computed tomography (CT) is the primary approach used to evaluate the disease. Magnetic resonance imaging (MRI) is often used to assess preoperative staging and the circumferential resection margin involvement, which assists in evaluating a patient’s risk of recurrence and their optimal therapeutic strategy. Positron emission tomography (PET)-CT may be useful in detecting occult synchronous tumors or metastases at the time of initial presentation. Restaging after neoadjuvant chemoradiotherapy (CRT) remains a challenge with all modalities because it is difficult to reliably differentiate between the tumor mass and other radiation-induced changes in the images. EUS does not appear to have a useful role in post-therapeutic response assessments. Although CT is most commonly used to evaluate treatment responses, its utility for identifying and following-up metastatic lesions is limited. Preoperative high-resolution MRI in combination with diffusion-weighted imaging, and/or PET-CT could provide valuable prognostic information for rectal cancer patients with locally advanced disease receiving preoperative CRT. Based on these results, we conclude that a combination of multimodal imaging methods should be used to precisely assess the restaging of rectal cancer following CRT. PMID:24764662

Multimodal imaging of language reorganization in patients with left temporal lobe epilepsy.

Science.gov (United States)

Chang, Yu-Hsuan A; Kemmotsu, Nobuko; Leyden, Kelly M; Kucukboyaci, N Erkut; Iragui, Vicente J; Tecoma, Evelyn S; Kansal, Leena; Norman, Marc A; Compton, Rachelle; Ehrlich, Tobin J; Uttarwar, Vedang S; Reyes, Anny; Paul, Brianna M; McDonald, Carrie R

2017-07-01

This study explored the relationships among multimodal imaging, clinical features, and language impairment in patients with left temporal lobe epilepsy (LTLE). Fourteen patients with LTLE and 26 controls underwent structural MRI, functional MRI, diffusion tensor imaging, and neuropsychological language tasks. Laterality indices were calculated for each imaging modality and a principal component (PC) was derived from language measures. Correlations were performed among imaging measures, as well as to the language PC. In controls, better language performance was associated with stronger left-lateralized temporo-parietal and temporo-occipital activations. In LTLE, better language performance was associated with stronger right-lateralized inferior frontal, temporo-parietal, and temporo-occipital activations. These right-lateralized activations in LTLE were associated with right-lateralized arcuate fasciculus fractional anisotropy. These data suggest that interhemispheric language reorganization in LTLE is associated with alterations to perisylvian white matter. These concurrent structural and functional shifts from left to right may help to mitigate language impairment in LTLE. Copyright © 2017 Elsevier Inc. All rights reserved.

Intraoperative high-field magnetic resonance imaging, multimodal neuronavigation, and intraoperative electrophysiological monitoring-guided surgery for treating supratentorial cavernomas.

Science.gov (United States)

Li, Fang-Ye; Chen, Xiao-Lei; Xu, Bai-Nan

2016-09-01

To determine the beneficial effects of intraoperative high-field magnetic resonance imaging (MRI), multimodal neuronavigation, and intraoperative electrophysiological monitoring-guided surgery for treating supratentorial cavernomas. Twelve patients with 13 supratentorial cavernomas were prospectively enrolled and operated while using a 1.5 T intraoperative MRI, multimodal neuronavigation, and intraoperative electrophysiological monitoring. All cavernomas were deeply located in subcortical areas or involved critical areas. Intraoperative high-field MRIs were obtained for the intraoperative "visualization" of surrounding eloquent structures, "brain shift" corrections, and navigational plan updates. All cavernomas were successfully resected with guidance from intraoperative MRI, multimodal neuronavigation, and intraoperative electrophysiological monitoring. In 5 cases with supratentorial cavernomas, intraoperative "brain shift" severely deterred locating of the lesions; however, intraoperative MRI facilitated precise locating of these lesions. During long-term (>3 months) follow-up, some or all presenting signs and symptoms improved or resolved in 4 cases, but were unchanged in 7 patients. Intraoperative high-field MRI, multimodal neuronavigation, and intraoperative electrophysiological monitoring are helpful in surgeries for the treatment of small deeply seated subcortical cavernomas.

Two Phase Non-Rigid Multi-Modal Image Registration Using Weber Local Descriptor-Based Similarity Metrics and Normalized Mutual Information

Directory of Open Access Journals (Sweden)

Feng Yang

2013-06-01

Full Text Available Non-rigid multi-modal image registration plays an important role in medical image processing and analysis. Existing image registration methods based on similarity metrics such as mutual information (MI and sum of squared differences (SSD cannot achieve either high registration accuracy or high registration efficiency. To address this problem, we propose a novel two phase non-rigid multi-modal image registration method by combining Weber local descriptor (WLD based similarity metrics with the normalized mutual information (NMI using the diffeomorphic free-form deformation (FFD model. The first phase aims at recovering the large deformation component using the WLD based non-local SSD (wldNSSD or weighted structural similarity (wldWSSIM. Based on the output of the former phase, the second phase is focused on getting accurate transformation parameters related to the small deformation using the NMI. Extensive experiments on T1, T2 and PD weighted MR images demonstrate that the proposed wldNSSD-NMI or wldWSSIM-NMI method outperforms the registration methods based on the NMI, the conditional mutual information (CMI, the SSD on entropy images (ESSD and the ESSD-NMI in terms of registration accuracy and computation efficiency.

Molecular imaging of oncolytic viral therapy

Directory of Open Access Journals (Sweden)

Dana Haddad

2014-01-01

Full Text Available Oncolytic viruses have made their mark on the cancer world as a potential therapeutic option, with the possible advantages of reduced side effects and strengthened treatment efficacy due to higher tumor selectivity. Results have been so promising, that oncolytic viral treatments have now been approved for clinical trials in several countries. However, clinical studies may benefit from the ability to noninvasively and serially identify sites of viral targeting via molecular imaging in order to provide safety, efficacy, and toxicity information. Furthermore, molecular imaging of oncolytic viral therapy may provide a more sensitive and specific diagnostic technique to detect tumor origin and, more importantly, presence of metastases. Several strategies have been investigated for molecular imaging of viral replication broadly categorized into optical and deep tissue imaging, utilizing several reporter genes encoding for fluorescence proteins, conditional enzymes, and membrane protein and transporters. Various imaging methods facilitate molecular imaging, including computer tomography, magnetic resonance imaging, positron emission tomography, single photon emission CT, gamma-scintigraphy, and photoacoustic imaging. In addition, several molecular probes are used for medical imaging, which act as targeting moieties or signaling agents. This review will explore the preclinical and clinical use of in vivo molecular imaging of replication-competent oncolytic viral therapy.

Connotation and category of functional-molecular imaging

International Nuclear Information System (INIS)

Li Tianran; Tian Jiahe

2007-01-01

Function and molecular lmaging represent medical imaging' s direction. The review article introduce function and molecular's concept and category and its characteristic. Comparing with traditionary classics radiology, function and molecular imaging have many features, such as micro-mount and specificity and quantitative. There are many technology about function and molecular imaging. Function and molecular imaging is important ingredient of modern medical and play a considerable role. (authors)

Multimodal Imaging in Klippel-Trénaunay-Weber Syndrome: Clinical Photography, Computed Tomoangiography, Infrared Thermography, and 99mTc-Phytate Lymphoscintigraphy.

Science.gov (United States)

Kim, Su Wan; Song, Heesung

2017-12-01

We report the case of a 19-year-old man who presented with a 12-year history of progressive fatigue, feeling hot, excessive sweating, and numbness in the left arm. He had undergone multimodal imaging and was diagnosed as having Klippel-Trénaunay-Weber syndrome (KTWS). This is a rare congenital disease, defined by combinations of nevus flammeus, venous and lymphatic malformation, and hypertrophy of the affected limbs. Lower extremities are affected mostly. Conventional modalities for evaluating KTWS are ultrasonography, CT, MRI, lymphoscintigraphy, and angiography. There are few reports on multimodal imaging of upper extremities of KTWS patients, and this is the first report of an infrared thermography in KTWS.

Image evaluation of HIV encephalopathy: a multimodal approach using quantitative MR techniques

Energy Technology Data Exchange (ETDEWEB)

Prado, Paulo T.C.; Escorsi-Rosset, Sara [University of Sao Paulo, Radiology Section, Internal Medicine Department, Ribeirao Preto School of Medicine, Sao Paulo (Brazil); Cervi, Maria C. [University of Sao Paulo, Department of Pediatrics, Ribeirao Preto School of Medicine, Sao Paulo (Brazil); Santos, Antonio Carlos [University of Sao Paulo, Radiology Section, Internal Medicine Department, Ribeirao Preto School of Medicine, Sao Paulo (Brazil); Hospital das Clinicas da FMRP-USP, Ribeirao Preto, SP (Brazil)

2011-11-15

A multimodal approach of the human immunodeficiency virus (HIV) encephalopathy using quantitative magnetic resonance (MR) techniques can demonstrate brain changes not detectable only with conventional magnetic resonance imaging (MRI). The aim of this study was to compare conventional MRI and MR quantitative techniques, such as magnetic resonance spectroscopy (MRS) and relaxometry and to determine whether quantitative techniques are more sensitive than conventional imaging for brain changes caused by HIV infection. We studied prospectively nine HIV positive children (mean age 6 years, from 5 to 8 years old) and nine controls (mean age 7.3 years; from 3 to 10 years), using MRS and relaxometry. Examinations were carried on 1.5-T equipment. HIV-positive patients presented with only minor findings and all control patients had normal conventional MR findings. MRS findings showed an increase in choline to creatine (CHO/CRE) ratios bilaterally in both frontal gray and white matter, in the left parietal white matter, and in total CHO/CRE ratio. In contrast, N-acetylaspartate to creatine (NAA/CRE) ratios did not present with any significant difference between both groups. Relaxometry showed significant bilateral abnormalities, with lengthening of the relaxation time in HIV positive in many regions. Conventional MRI is not sensitive for early brain changes caused by HIV infection. Quantitative techniques such as MRS and relaxometry appear as valuable tools in the diagnosis of these early changes. Therefore, a multimodal quantitative study can be useful in demonstrating and understanding the physiopathology of the disease. (orig.)

Capturing molecular multimode relaxation processes in excitable gases based on decomposition of acoustic relaxation spectra

Science.gov (United States)

Zhu, Ming; Liu, Tingting; Wang, Shu; Zhang, Kesheng

2017-08-01

Existing two-frequency reconstructive methods can only capture primary (single) molecular relaxation processes in excitable gases. In this paper, we present a reconstructive method based on the novel decomposition of frequency-dependent acoustic relaxation spectra to capture the entire molecular multimode relaxation process. This decomposition of acoustic relaxation spectra is developed from the frequency-dependent effective specific heat, indicating that a multi-relaxation process is the sum of the interior single-relaxation processes. Based on this decomposition, we can reconstruct the entire multi-relaxation process by capturing the relaxation times and relaxation strengths of N interior single-relaxation processes, using the measurements of acoustic absorption and sound speed at 2N frequencies. Experimental data for the gas mixtures CO2-N2 and CO2-O2 validate our decomposition and reconstruction approach.

MULTIMODAL IMAGING OF ANGIOID STREAKS ASSOCIATED WITH TURNER SYNDROME.

Science.gov (United States)

Chiu, Bing Q; Tsui, Edmund; Hussnain, Syed Amal; Barbazetto, Irene A; Smith, R Theodore

2018-02-13

To report multimodal imaging in a novel case of angioid streaks in a patient with Turner syndrome with 10-year follow-up. Case report of a patient with Turner syndrome and angioid streaks followed at Bellevue Hospital Eye Clinic from 2007 to 2017. Fundus photography, fluorescein angiography, and optical coherence tomography angiography were obtained. Angioid streaks with choroidal neovascularization were noted in this patient with Turner syndrome without other systemic conditions previously correlated with angioid streaks. We report a case of angioid streaks with choroidal neovascularization in a patient with Turner syndrome. We demonstrate that angioid streaks, previously associated with pseudoxanthoma elasticum, Ehlers-Danlos syndrome, Paget disease of bone, and hemoglobinopathies, may also be associated with Turner syndrome, and may continue to develop choroidal neovascularization, suggesting the need for careful ophthalmic examination in these patients.

Avaliação ocular multimodal em doenças heredodistróficas e degenerativas da retina Multimodal fundus imaging in heredodystrophic and degenerative diseases of the retina

Directory of Open Access Journals (Sweden)

Daniela Cavalcanti Ferrara

2009-10-01

Full Text Available A tomografia de coerência óptica incorporou-se gradativamente ao contemporâneo arsenal diagnóstico em Oftalmologia, passando a exercer papel fundamental na investigação e condução de doenças oculares, particularmente na especialidade de Retina e Vítreo. A disponibilização comercial da nova geração de aparelhos, chamada de tomografia de coerência óptica "espectral", baseada em conceito físico distinto que permite a aquisição de imagens em alta velocidade, marcou o início de uma nova era desta tecnologia de investigação auxiliar. Adicionalmente, sua recente combinação com o oftalmoscópio de varredura a laser confocal (confocal scanning laser ophthalmoscope vem propiciando a aquisição de imagens tomográficas guiadas em tempo real pelos diferentes modos de imagem (autofluorescência de fundo, reflectância com luz "infravermelha" e angiografia com fluoresceína ou indocianina verde. A avaliação ocular multimodal (multimodal fundus imaging permite a correlação real e minuciosa de achados da morfologia retiniana e do epitélio pigmentar com dados de estudos angiográficos e de autofluorescência ou reflectância, propiciando assim inferências valiosas sobre a fisiologia do tecido. Neste artigo, discutimos brevemente as possíveis implicações da avaliação ocular multimodal na prática da especialidade de Retina e Vítreo.Optical coherence tomography was progressively incorporated to the contemporary diagnostic arsenal in Ophthalmology, playing a crucial role in the diagnosis and management of eye diseases, particularly in the specialty of retina and vitreous. The commercial availability of the new generation of devices, coined "spectral" optical coherence tomography, which is based in a distinct physical concept that permits high-speed image acquisition, launched a new era for this investigative ancillary tool. In addition, the recent combination of this new technology with a confocal scanning laser ophthalmoscope

Mitral Valve Prolapse: Multimodality Imaging and Genetic Insights.

Science.gov (United States)

Parwani, Purvi; Avierinos, Jean-Francois; Levine, Robert A; Delling, Francesca N

Mitral valve prolapse (MVP) is a common heritable valvulopathy affecting approximately 2.4% of the population. It is the most important cause of primary mitral regurgitation (MR) requiring surgery. MVP is characterized by fibromyxomatous changes and displacement of one or both mitral leaflets into the left atrium. Echocardiography represents the primary diagnostic modality for assessment of MVP. Accurate quantitation of ventricular volumes and function for surgical planning in asymptomatic severe MR can be provided with both echocardiography and cardiac magnetic resonance. In addition, assessment of myocardial fibrosis using late gadolinium enhancement and T1 mapping allows better understanding of the impact of MVP on the myocardium. Imaging in MVP is important not only for diagnostic and prognostic purposes, but is also essential for detailed phenotyping in genetic studies. Genotype-phenotype studies in MVP pedigrees have allowed the identification of milder, non-diagnostic MVP morphologies by echocardiography. Such morphologies represent early expression of MVP in gene carriers. This review focuses on multimodality imaging and the phenotypic spectrum of MVP. Moreover, the review details the recent genetic discoveries that have increased our understanding of the pathophysiology of MVP, with clues to mechanisms and therapy. Copyright © 2017 Elsevier Inc. All rights reserved.

Modality prediction of biomedical literature images using multimodal feature representation

Directory of Open Access Journals (Sweden)

Pelka, Obioma

2016-08-01

Full Text Available This paper presents the modelling approaches performed to automatically predict the modality of images found in biomedical literature. Various state-of-the-art visual features such as Bag-of-Keypoints computed with dense SIFT descriptors, texture features and Joint Composite Descriptors were used for visual image representation. Text representation was obtained by vector quantisation on a Bag-of-Words dictionary generated using attribute importance derived from a χ-test. Computing the principal components separately on each feature, dimension reduction as well as computational load reduction was achieved. Various multiple feature fusions were adopted to supplement visual image information with corresponding text information. The improvement obtained when using multimodal features vs. visual or text features was detected, analysed and evaluated. Random Forest models with 100 to 500 deep trees grown by resampling, a multi class linear kernel SVM with C=0.05 and a late fusion of the two classifiers were used for modality prediction. A Random Forest classifier achieved a higher accuracy and computed Bag-of-Keypoints with dense SIFT descriptors proved to be a better approach than with Lowe SIFT.

MMX-I: data-processing software for multimodal X-ray imaging and tomography

Energy Technology Data Exchange (ETDEWEB)

Bergamaschi, Antoine, E-mail: antoine.bergamaschi@synchrotron-soleil.fr; Medjoubi, Kadda [Synchrotron SOLEIL, BP 48, Saint-Aubin, 91192 Gif sur Yvette (France); Messaoudi, Cédric; Marco, Sergio [Université Paris-Saclay, CNRS, Université Paris-Saclay, F-91405 Orsay (France); Institut Curie, INSERM, PSL Reseach University, F-91405 Orsay (France); Somogyi, Andrea [Synchrotron SOLEIL, BP 48, Saint-Aubin, 91192 Gif sur Yvette (France)

2016-04-12

The MMX-I open-source software has been developed for processing and reconstruction of large multimodal X-ray imaging and tomography datasets. The recent version of MMX-I is optimized for scanning X-ray fluorescence, phase-, absorption- and dark-field contrast techniques. This, together with its implementation in Java, makes MMX-I a versatile and friendly user tool for X-ray imaging. A new multi-platform freeware has been developed for the processing and reconstruction of scanning multi-technique X-ray imaging and tomography datasets. The software platform aims to treat different scanning imaging techniques: X-ray fluorescence, phase, absorption and dark field and any of their combinations, thus providing an easy-to-use data processing tool for the X-ray imaging user community. A dedicated data input stream copes with the input and management of large datasets (several hundred GB) collected during a typical multi-technique fast scan at the Nanoscopium beamline and even on a standard PC. To the authors’ knowledge, this is the first software tool that aims at treating all of the modalities of scanning multi-technique imaging and tomography experiments.

Investigating the Abscopal Effects of Radioablation on Shielded Bone Marrow in Rodent Models Using Multimodality Imaging.

Science.gov (United States)

Afshar, Solmaz F; Zawaski, Janice A; Inoue, Taeko; Rendon, David A; Zieske, Arthur W; Punia, Jyotinder N; Sabek, Omaima M; Gaber, M Waleed

2017-07-01

The abscopal effect is the response to radiation at sites that are distant from the irradiated site of an organism, and it is thought to play a role in bone marrow (BM) recovery by initiating responses in the unirradiated bone marrow. Understanding the mechanism of this effect has applications in treating BM failure (BMF) and BM transplantation (BMT), and improving survival of nuclear disaster victims. Here, we investigated the use of multimodality imaging as a translational tool to longitudinally assess bone marrow recovery. We used positron emission tomography/computed tomography (PET/CT), magnetic resonance imaging (MRI) and optical imaging to quantify bone marrow activity, vascular response and marrow repopulation in fully and partially irradiated rodent models. We further measured the effects of radiation on serum cytokine levels, hematopoietic cell counts and histology. PET/CT imaging revealed a radiation-induced increase in proliferation in the shielded bone marrow (SBM) compared to exposed bone marrow (EBM) and sham controls. T 2 -weighted MRI showed radiation-induced hemorrhaging in the EBM and unirradiated SBM. In the EBM and SBM groups, we found alterations in serum cytokine and hormone levels and in hematopoietic cell population proportions, and histological evidence of osteoblast activation at the bone marrow interface. Importantly, we generated a BMT mouse model using fluorescent-labeled bone marrow donor cells and performed fluorescent imaging to reveal the migration of bone marrow cells from shielded to radioablated sites. Our study validates the use of multimodality imaging to monitor bone marrow recovery and provides evidence for the abscopal response in promoting bone marrow recovery after irradiation.

Simultaneous in vivo imaging of melanin and lipofuscin in the retina with photoacoustic ophthalmoscopy and autofluorescence imaging

Science.gov (United States)

Zhang, Xiangyang; Zhang, Hao F.; Puliafito, Carmen A.; Jiao, Shuliang

2011-08-01

We combined photoacoustic ophthalmoscopy (PAOM) with autofluorescence imaging for simultaneous in vivo imaging of dual molecular contrasts in the retina using a single light source. The dual molecular contrasts come from melanin and lipofuscin in the retinal pigment epithelium (RPE). Melanin and lipofuscin are two types of pigments and are believed to play opposite roles (protective versus exacerbate) in the RPE in the aging process. We have successfully imaged the retina of pigmented and albino rats at different ages. The experimental results showed that multimodal PAOM system can be a potentially powerful tool in the study of age-related degenerative retinal diseases.

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer's Disease Diagnosis.

Science.gov (United States)

Liu, Manhua; Cheng, Danni; Wang, Kundong; Wang, Yaping

2018-03-23

Accurate and early diagnosis of Alzheimer's disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer's Disease Neuroimaging

Laser injury and in vivo multimodal imaging using a mouse model

Science.gov (United States)

Pocock, Ginger M.; Boretsky, Adam; Gupta, Praveena; Oliver, Jeff W.; Motamedi, Massoud

2011-03-01

Balb/c wild type mice were used to perform in vivo experiments of laser-induced thermal damage to the retina. A Heidelberg Spectralis HRA confocal scanning laser ophthalmoscope with a spectral domain optical coherence tomographer was used to obtain fundus and cross-sectional images of laser induced injury in the retina. Sub-threshold, threshold, and supra-threshold lesions were observed using optical coherence tomography (OCT), infrared reflectance, red-free reflectance, fluorescence angiography, and autofluorescence imaging modalities at different time points post-exposure. Lesions observed using all imaging modalities, except autofluorescence, were not visible immediately after exposure but did resolve within an hour and grew in size over a 24 hour period. There was a decrease in fundus autofluorescence at exposure sites immediately following exposure that developed into hyper-fluorescence 24-48 hours later. OCT images revealed threshold damage that was localized to the RPE but extended into the neural retina over a 24 hour period. Volumetric representations of the mouse retina were created to visualize the extent of damage within the retina over a 24 hour period. Multimodal imaging provides complementary information regarding damage mechanisms that may be used to quantify the extent of the damage as well as the effectiveness of treatments without need for histology.

Multi-Modality Imaging in the Evaluation and Treatment of Mitral Regurgitation.

Science.gov (United States)

Bouchard, Marc-André; Côté-Laroche, Claudia; Beaudoin, Jonathan

2017-10-13

Mitral regurgitation (MR) is frequent and associated with increased mortality and morbidity when severe. It may be caused by intrinsic valvular disease (primary MR) or ventricular deformation (secondary MR). Imaging has a critical role to document the severity, mechanism, and impact of MR on heart function as selected patients with MR may benefit from surgery whereas other will not. In patients planned for a surgical intervention, imaging is also important to select candidates for mitral valve (MV) repair over replacement and to predict surgical success. Although standard transthoracic echocardiography is the first-line modality to evaluate MR, newer imaging modalities like three-dimensional (3D) transesophageal echocardiography, stress echocardiography, cardiac magnetic resonance (CMR), and computed tomography (CT) are emerging and complementary tools for MR assessment. While some of these modalities can provide insight into MR severity, others will help to determine its mechanism. Understanding the advantages and limitations of each imaging modality is important to appreciate their respective role for MR assessment and help to resolve eventual discrepancies between different diagnostic methods. With the increasing use of transcatheter mitral procedures (repair or replacement) for high-surgical-risk patients, multimodality imaging has now become even more important to determine eligibility, preinterventional planning, and periprocedural guidance.

Workflow optimisation for multimodal imaging procedures: a case of combined X-ray and MRI-guided TACE.

Science.gov (United States)

Fernández-Gutiérrez, Fabiola; Wolska-Krawczyk, Malgorzata; Buecker, Arno; Houston, J Graeme; Melzer, Andreas

2017-02-01

This study presents a framework for workflow optimisation of multimodal image-guided procedures (MIGP) based on discrete event simulation (DES). A case of a combined X-Ray and magnetic resonance image-guided transarterial chemoembolisation (TACE) is presented to illustrate the application of this method. We used a ranking and selection optimisation algorithm to measure the performance of a number of proposed alternatives to improve a current scenario. A DES model was implemented with detail data collected from 59 TACE procedures and durations of magnetic resonance imaging (MRI) diagnostic procedures usually performed in a common MRI suite. Fourteen alternatives were proposed and assessed to minimise the waiting times and improve workflow. Data analysis observed an average of 20.68 (7.68) min of waiting between angiography and MRI for TACE patients in 71.19% of the cases. Following the optimisation analysis, an alternative was identified to reduce waiting times in angiography suite up to 48.74%. The model helped to understand and detect 'bottlenecks' during multimodal TACE procedures, identifying a better alternative to the current workflow and reducing waiting times. Simulation-based workflow analysis provides a cost-effective way to face some of the challenges of introducing MIGP in clinical radiology, highligthed in this study.

Fluorescence based molecular in vivo imaging

International Nuclear Information System (INIS)

Ebert, Bernd

2008-01-01

Molecular imaging represents a modern research area that allows the in vivo study of molecular biological process kinetics using appropriate probes and visualization methods. This methodology may be defined- apart from the contrast media injection - as non-abrasive. In order to reach an in vivo molecular process imaging as accurate as possible the effects of the used probes on the biological should not be too large. The contrast media as important part of the molecular imaging can significantly contribute to the understanding of molecular processes and to the development of tailored diagnostics and therapy. Since more than 15 years PTB is developing optic imaging systems that may be used for fluorescence based visualization of tissue phantoms, small animal models and the localization of tumors and their predecessors, and for the early recognition of inflammatory processes in clinical trials. Cellular changes occur during many diseases, thus the molecular imaging might be of importance for the early diagnosis of chronic inflammatory diseases. Fluorescent dyes can be used as unspecific or also as specific contrast media, which allow enhanced detection sensitivity

Molecular ultrasound imaging: current status and future directions

International Nuclear Information System (INIS)

Deshpande, N.; Needles, A.; Willmann, J.K.

2010-01-01

Targeted contrast-enhanced ultrasound (molecular ultrasound) is an emerging imaging strategy that combines ultrasound technology with novel molecularly-targeted ultrasound contrast agents for assessing biological processes at the molecular level. Molecular ultrasound contrast agents are nano- or micro-sized particles that are targeted to specific molecular markers by adding high-affinity binding ligands onto the surface of the particles. Following intravenous administration, these targeted ultrasound contrast agents accumulate at tissue sites overexpressing specific molecular markers, thereby enhancing the ultrasound imaging signal. High spatial and temporal resolution, real-time imaging, non-invasiveness, relatively low costs, lack of ionising irradiation and wide availability of ultrasound systems are advantages compared to other molecular imaging modalities. In this article we review current concepts and future directions of molecular ultrasound imaging, including different classes of molecular ultrasound contrast agents, ongoing technical developments of pre-clinical and clinical ultrasound systems, the potential of molecular ultrasound for imaging different diseases at the molecular level, and the translation of molecular ultrasound into the clinic.

Can multimodality imaging using {sup 18}F-FDG/{sup 18}F-FLT PET/CT benefit the diagnosis and management of patients with pulmonary lesions?

Energy Technology Data Exchange (ETDEWEB)

Xu, Baixuan; Guan, Zhiwei; Liu, Changbin; Wang, Ruimin; Yin, Dayi; Zhang, Jinming; Chen, Yingmao; Yao, Shulin; Shao, Mingzhe; Wang, Hui; Tian, Jiahe [Chinese PLA General Hospital, Department of Nuclear Medicine, Beijing (China)

2011-02-15

Dual-tracer, {sup 18}F-fluorodeoxyglucose and {sup 18}F-fluorodeoxythymidine ({sup 18}F-FDG/{sup 18}F-FLT), dual-modality (positron emission tomography and computed tomography, PET/CT) imaging was used in a clinical trial on differentiation of pulmonary nodules. The aims of this trial were to investigate if multimodality imaging is of advantage and to what extent it could benefit the patients in real clinical settings. Seventy-three subjects in whom it was difficult to establish the diagnosis and determine management of their pulmonary lesions were prospectively enrolled in this clinical trial. All subjects underwent {sup 18}F-FDG and {sup 18}F-FLT PET/CT imaging sequentially. The images were interpreted with different strategies as either individual or combined modalities. The pathological or clinical evidence during a follow-up period of more than 22 months served as the standard of truth. The diagnostic performance of each interpretation and their impact on clinical decision making was investigated. {sup 18}F-FLT/{sup 18}F-FDG PET/CT was proven to be of clinical value in improving the diagnostic confidence in 28 lung tumours, 18 tuberculoses and 27 other benign lesions. The ratio between maximum standardized uptake values of {sup 18}F-FLT and {sup 18}F-FDG was found to be of great potential in separating the three subgroups of patients. The advantage could only be obtained with the full use of the multimodality interpretation. Multimodality imaging induced substantial change in clinical management in 31.5% of the study subjects and partial change in another 12.3%. Multimodality imaging using {sup 18}F-FDG/{sup 18}F-FLT PET/CT provided the best diagnostic efficacy and the opportunity for better management in this group of clinically challenging patients with pulmonary lesions. (orig.)

Multimodal backside imaging of a microcontroller using confocal laser scanning and optical-beam-induced current imaging

Science.gov (United States)

Finkeldey, Markus; Göring, Lena; Schellenberg, Falk; Brenner, Carsten; Gerhardt, Nils C.; Hofmann, Martin

2017-02-01

Microscopy imaging with a single technology is usually restricted to a single contrast mechanism. Multimodal imaging is a promising technique to improve the structural information that could be obtained about a device under test (DUT). Due to the different contrast mechanisms of laser scanning microscopy (LSM), confocal laser scanning microscopy (CLSM) and optical beam induced current microscopy (OBICM), a combination could improve the detection of structures in integrated circuits (ICs) and helps to reveal their layout. While OBIC imaging is sensitive to the changes between differently doped areas and to semiconductor-metal transitions, CLSM imaging is mostly sensitive to changes in absorption and reflection. In this work we present the implementation of OBIC imaging into a CLSM. We show first results using industry standard Atmel microcontrollers (MCUs) with a feature size of about 250nm as DUTs. Analyzing these types of microcontrollers helps to improve in the field of side-channel attacks to find hardware Trojans, possible spots for laser fault attacks and for reverse engineering. For the experimental results the DUT is placed on a custom circuit board that allows us to measure the current while imaging it in our in-house built stage scanning microscope using a near infrared (NIR) laser diode as light source. The DUT is thinned and polished, allowing backside imaging through the Si-substrate. We demonstrate the possibilities using this optical setup by evaluating OBIC, LSM and CLSM images above and below the threshold of the laser source.

Multimodal Magnetic-Plasmonic Nanoparticles for Biomedical Applications

Directory of Open Access Journals (Sweden)

Shelley Stafford

2018-01-01

Full Text Available Magnetic plasmonic nanomaterials are of great interest in the field of biomedicine due to their vast number of potential applications, for example, in molecular imaging, photothermal therapy, magnetic hyperthermia and as drug delivery vehicles. The multimodal nature of these nanoparticles means that they are potentially ideal theranostic agents—i.e., they can be used both as therapeutic and diagnostic tools. This review details progress in the field of magnetic-plasmonic nanomaterials over the past ten years, focusing on significant developments that have been made and outlining the future work that still needs to be done in this fast emerging area. The review describes the main synthetic approaches to each type of magnetic plasmonic nanomaterial and the potential biomedical applications of these hybrid nanomaterials.

Firefly Luciferin-Inspired Biocompatible Chemistry for Protein Labeling and In Vivo Imaging.

Science.gov (United States)

Wang, Yuqi; An, Ruibing; Luo, Zhiliang; Ye, Deju

2018-04-17

Biocompatible reactions have emerged as versatile tools to build various molecular imaging probes that hold great promise for the detection of biological processes in vitro and/or in vivo. In this Minireview, we describe the recent advances in the development of a firefly luciferin-inspired biocompatible reaction between cyanobenzothiazole (CBT) and cysteine (Cys), and highlight its versatility to label proteins and build multimodality molecular imaging probes. The review starts from the general introduction of biocompatible reactions, which is followed by briefly describing the development of the firefly luciferin-inspired biocompatible chemistry. We then discuss its applications for the specific protein labeling and for the development of multimodality imaging probes (fluorescence, bioluminescence, MRI, PET, photoacoustic, etc.) that enable high sensitivity and spatial resolution imaging of redox environment, furin and caspase-3/7 activity in living cells and mice. Finally, we offer the conclusions and our perspective on the various and potential applications of this reaction. We hope that this review will contribute to the research of biocompatible reactions for their versatile applications in protein labeling and molecular imaging. © 2018 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim.

Multimodality Cardiac Imaging in a Patient with Kawasaki Disease and Giant Aneurysms

Directory of Open Access Journals (Sweden)

Ranjini Srinivasan

2016-01-01

Full Text Available Kawasaki disease is a well-known cause of acquired cardiac disease in the pediatric and adult population, most prevalent in Japan but also seen commonly in the United States. In the era of intravenous immunoglobulin (IVIG treatment, the morbidity associated with this disease has decreased, but it remains a serious illness. Here we present the case of an adolescent, initially diagnosed with Kawasaki disease as an infant, that progressed to giant aneurysm formation and calcification of the coronary arteries. We review his case and the literature, focusing on the integral role of multimodality imaging in managing Kawasaki disease.

Benign familial fleck retina: multimodal imaging including optical coherence tomography angiography.

Science.gov (United States)

Garcia, Jose Mauricio Botto de Barros; Isaac, David Leonardo Cruvinel; Sardeiro, Tainara; Aquino, Érika; Avila, Marcos

2017-01-01

This report presents multimodal imaging of a 27-year-old woman diagnosed with benign familial fleck retina (OMIM 228980), an uncommon disorder. Fundus photographs revealed retinal flecks that affected her post-equatorial retina but spared the macular area. Fundus autofluorescence and infrared imaging demonstrated a symmetrical pattern of yellow-white fleck lesions that affected both eyes. Her full-field electroretinogram and electrooculogram were normal. An optical coherence tomography B-scan was performed for both eyes, revealing increased thickness of the retinal pigmented epithelium leading to multiple small pigmented epithelium detachments. The outer retina remained intact in both eyes. Spectral-domain optical coherence tomography angiography with split-spectrum amplitude decorrelation algorithm and 3 × 3 mm structural en face optical coherence tomography did not show macular lesions. Benign familial fleck retina belongs to a heterogenous group of so-called flecked retina syndromes, and should be considered in patients with yellowish-white retinal lesions without involvement of the macula.

Benign familial fleck retina: multimodal imaging including optical coherence tomography angiography

Directory of Open Access Journals (Sweden)

Jose Mauricio Botto de Barros Garcia

Full Text Available ABSTRACT This report presents multimodal imaging of a 27-year-old woman diagnosed with benign familial fleck retina (OMIM 228980, an uncommon disorder. Fundus photographs revealed retinal flecks that affected her post-equatorial retina but spared the macular area. Fundus autofluorescence and infrared imaging demonstrated a symmetrical pattern of yellow-white fleck lesions that affected both eyes. Her full-field electroretinogram and electrooculogram were normal. An optical coherence tomography B-scan was performed for both eyes, revealing increased thickness of the retinal pigmented epithelium leading to multiple small pigmented epithelium detachments. The outer retina remained intact in both eyes. Spectral-domain optical coherence tomography angiography with split-spectrum amplitude decorrelation algorithm and 3 × 3 mm structural en face optical coherence tomography did not show macular lesions. Benign familial fleck retina belongs to a heterogenous group of so-called flecked retina syndromes, and should be considered in patients with yellowish-white retinal lesions without involvement of the macula.

4D XCAT phantom for multimodality imaging research

Energy Technology Data Exchange (ETDEWEB)

Segars, W. P.; Sturgeon, G.; Mendonca, S.; Grimes, Jason; Tsui, B. M. W. [Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, Duke University Medical Center, 2424 Erwin Road, Hock Plaza, Suite 302, Durham, North Carolina 27705 (United States); Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, Duke University Medical Center, 2424 Erwin Road, Hock Plaza, Suite 302, Durham, North Carolina 27705 and Department of Biomedical Engineering, University of North Carolina, Chapel Hill, North Carolina 27599 (United States); Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, Duke University Medical Center, 2424 Erwin Road, Hock Plaza, Suite 302, Durham, North Carolina 27705 (United States); The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Medical Institutions, Baltimore, Maryland 21287 (United States)

2010-09-15

Purpose: The authors develop the 4D extended cardiac-torso (XCAT) phantom for multimodality imaging research. Methods: Highly detailed whole-body anatomies for the adult male and female were defined in the XCAT using nonuniform rational B-spline (NURBS) and subdivision surfaces based on segmentation of the Visible Male and Female anatomical datasets from the National Library of Medicine as well as patient datasets. Using the flexibility of these surfaces, the Visible Human anatomies were transformed to match body measurements and organ volumes for a 50th percentile (height and weight) male and female. The desired body measurements for the models were obtained using the PEOPLESIZE program that contains anthropometric dimensions categorized from 1st to the 99th percentile for US adults. The desired organ volumes were determined from ICRP Publication 89 [ICRP, ''Basic anatomical and physiological data for use in radiological protection: reference values,'' ICRP Publication 89 (International Commission on Radiological Protection, New York, NY, 2002)]. The male and female anatomies serve as standard templates upon which anatomical variations may be modeled in the XCAT through user-defined parameters. Parametrized models for the cardiac and respiratory motions were also incorporated into the XCAT based on high-resolution cardiac- and respiratory-gated multislice CT data. To demonstrate the usefulness of the phantom, the authors show example simulation studies in PET, SPECT, and CT using publicly available simulation packages. Results: As demonstrated in the pilot studies, the 4D XCAT (which includes thousands of anatomical structures) can produce realistic imaging data when combined with accurate models of the imaging process. With the flexibility of the NURBS surface primitives, any number of different anatomies, cardiac or respiratory motions or patterns, and spatial resolutions can be simulated to perform imaging research. Conclusions: With the

4D XCAT phantom for multimodality imaging research

International Nuclear Information System (INIS)

Segars, W. P.; Sturgeon, G.; Mendonca, S.; Grimes, Jason; Tsui, B. M. W.

2010-01-01

Purpose: The authors develop the 4D extended cardiac-torso (XCAT) phantom for multimodality imaging research. Methods: Highly detailed whole-body anatomies for the adult male and female were defined in the XCAT using nonuniform rational B-spline (NURBS) and subdivision surfaces based on segmentation of the Visible Male and Female anatomical datasets from the National Library of Medicine as well as patient datasets. Using the flexibility of these surfaces, the Visible Human anatomies were transformed to match body measurements and organ volumes for a 50th percentile (height and weight) male and female. The desired body measurements for the models were obtained using the PEOPLESIZE program that contains anthropometric dimensions categorized from 1st to the 99th percentile for US adults. The desired organ volumes were determined from ICRP Publication 89 [ICRP, ''Basic anatomical and physiological data for use in radiological protection: reference values,'' ICRP Publication 89 (International Commission on Radiological Protection, New York, NY, 2002)]. The male and female anatomies serve as standard templates upon which anatomical variations may be modeled in the XCAT through user-defined parameters. Parametrized models for the cardiac and respiratory motions were also incorporated into the XCAT based on high-resolution cardiac- and respiratory-gated multislice CT data. To demonstrate the usefulness of the phantom, the authors show example simulation studies in PET, SPECT, and CT using publicly available simulation packages. Results: As demonstrated in the pilot studies, the 4D XCAT (which includes thousands of anatomical structures) can produce realistic imaging data when combined with accurate models of the imaging process. With the flexibility of the NURBS surface primitives, any number of different anatomies, cardiac or respiratory motions or patterns, and spatial resolutions can be simulated to perform imaging research. Conclusions: With the ability to produce

Molecular radio-oncology

International Nuclear Information System (INIS)

Baumann, Michael; Krause, Mechthild; Cordes, Nils

2016-01-01

This book concisely reviews our current understanding of hypoxia, molecular targeting, DNA repair, cancer stem cells, and tumor pathophysiology, while also discussing novel strategies for putting these findings into practice in daily clinical routine. Radiotherapy is an important part of modern multimodal cancer treatment, and the past several years have witnessed not only substantial improvements in radiation techniques and the use of new beam qualities, but also major strides in our understanding of molecular tumor biology and tumor radiation response. Against this backdrop, the book highlights recent efforts to identify reasonable and clinically applicable biomarkers using broad-spectrum tissue microarrays and high-throughput systems biology approaches like genomics and epigenomics. In particular, it describes in detail how such molecular information is now being exploited for diagnostic imaging and imaging throughout treatment using the example of positron emission tomography. By discussing all these issues in the context of modern radiation oncology, the book provides a broad, up-to-date overview of the molecular aspects of radiation oncology that will hopefully foster its further optimization.

Molecular radio-oncology

Energy Technology Data Exchange (ETDEWEB)

Baumann, Michael; Krause, Mechthild; Cordes, Nils (eds.) [Technische Univ. Dresden (Germany). Faculty of Medicine and University Hospital

2016-07-01

This book concisely reviews our current understanding of hypoxia, molecular targeting, DNA repair, cancer stem cells, and tumor pathophysiology, while also discussing novel strategies for putting these findings into practice in daily clinical routine. Radiotherapy is an important part of modern multimodal cancer treatment, and the past several years have witnessed not only substantial improvements in radiation techniques and the use of new beam qualities, but also major strides in our understanding of molecular tumor biology and tumor radiation response. Against this backdrop, the book highlights recent efforts to identify reasonable and clinically applicable biomarkers using broad-spectrum tissue microarrays and high-throughput systems biology approaches like genomics and epigenomics. In particular, it describes in detail how such molecular information is now being exploited for diagnostic imaging and imaging throughout treatment using the example of positron emission tomography. By discussing all these issues in the context of modern radiation oncology, the book provides a broad, up-to-date overview of the molecular aspects of radiation oncology that will hopefully foster its further optimization.

MIDA: A Multimodal Imaging-Based Detailed Anatomical Model of the Human Head and Neck.

Directory of Open Access Journals (Sweden)

Maria Ida Iacono

Full Text Available Computational modeling and simulations are increasingly being used to complement experimental testing for analysis of safety and efficacy of medical devices. Multiple voxel- and surface-based whole- and partial-body models have been proposed in the literature, typically with spatial resolution in the range of 1-2 mm and with 10-50 different tissue types resolved. We have developed a multimodal imaging-based detailed anatomical model of the human head and neck, named "MIDA". The model was obtained by integrating three different magnetic resonance imaging (MRI modalities, the parameters of which were tailored to enhance the signals of specific tissues: i structural T1- and T2-weighted MRIs; a specific heavily T2-weighted MRI slab with high nerve contrast optimized to enhance the structures of the ear and eye; ii magnetic resonance angiography (MRA data to image the vasculature, and iii diffusion tensor imaging (DTI to obtain information on anisotropy and fiber orientation. The unique multimodal high-resolution approach allowed resolving 153 structures, including several distinct muscles, bones and skull layers, arteries and veins, nerves, as well as salivary glands. The model offers also a detailed characterization of eyes, ears, and deep brain structures. A special automatic atlas-based segmentation procedure was adopted to include a detailed map of the nuclei of the thalamus and midbrain into the head model. The suitability of the model to simulations involving different numerical methods, discretization approaches, as well as DTI-based tensorial electrical conductivity, was examined in a case-study, in which the electric field was generated by transcranial alternating current stimulation. The voxel- and the surface-based versions of the models are freely available to the scientific community.

Molecular imaging of atherosclerosis in mice with MRI and near-infrared fluorescence imaging

International Nuclear Information System (INIS)

Lu Tong; Wen Song; Zhou Guanhui; Ju Shenghong; Teng Gaojun

2012-01-01

<0.05, n=8). The positive areas in imaging were (41.69 ± 5.29)% and (39.45 ± 5.35 )%, respectively. Immunofluorescence staining demonstrated that the expression of oxLDL was closely associated to macrophage infiltrates. Conclusion: This study demonstrates that atherosclerotic plaque MRI and NIRF imaging are feasible by using novel molecular imaging probes and may help to identify high-risk plaques, providing a foundation for multimodality imaging of atherosclerosis. (authors)

Multimodal news framing effects

NARCIS (Netherlands)

Powell, T.E.

2017-01-01

Visuals in news media play a vital role in framing citizens’ political preferences. Yet, compared to the written word, visual images are undervalued in political communication research. Using framing theory, this thesis redresses the balance by studying the combined, or multimodal, effects of visual

Multimodal imaging of the human knee down to the cellular level

Science.gov (United States)

Schulz, G.; Götz, C.; Müller-Gerbl, M.; Zanette, I.; Zdora, M.-C.; Khimchenko, A.; Deyhle, H.; Thalmann, P.; Müller, B.

2017-06-01

Computed tomography reaches the best spatial resolution for the three-dimensional visualization of human tissues among the available nondestructive clinical imaging techniques. Nowadays, sub-millimeter voxel sizes are regularly obtained. Regarding investigations on true micrometer level, lab-based micro-CT (μCT) has become gold standard. The aim of the present study is firstly the hierarchical investigation of a human knee post mortem using hard X-ray μCT and secondly a multimodal imaging using absorption and phase contrast modes in order to investigate hard (bone) and soft (cartilage) tissues on the cellular level. After the visualization of the entire knee using a clinical CT, a hierarchical imaging study was performed using the lab-system nanotom® m. First, the entire knee was measured with a pixel length of 65 μm. The highest resolution with a pixel length of 3 μm could be achieved after extracting cylindrically shaped plugs from the femoral bones. For the visualization of the cartilage, grating-based phase contrast μCT (I13-2, Diamond Light Source) was performed. With an effective voxel size of 2.3 μm it was possible to visualize individual chondrocytes within the cartilage.

Technological advances in Preclinical Molecular Imaging; Avances tecnológicos en Imagen Molecular Preclínica

Energy Technology Data Exchange (ETDEWEB)

Peña-Zalbidea, S.; Vaquero, J.

2014-07-01

Molecular imaging is undergoing an intense activity, mainly due to the availability of new detection and image reconstruction technologies, which in recent years have improved significantly both the resolution and sensitivity of these methods. The greatest potential for innovation comes from multimodality imaging, which combines information from more than one imaging technique and exploits the synergies between them. The main arguments in favour of these devices are the possibility of performing intrinsically registered scans in a minimum time and without moving the animal. Currently, the combination of PET and MRI as a hybrid imaging modality is receiving great attention and although its potential is clear, as it was with the PET/CT, this technology will have to overcome certain limitations and demonstrate its value for different applications. [Spanish] La imagen molecular es un área de investigación muy activa acelerada en los últimos años por la disponibilidad de nuevas tecnologías de detección y reconstrucción de imágenes. Estas innovaciones han permitido mejorar considerablemente tanto la resolución como la sensibilidad de las imágenes obtenidas sobre modelos preclínicos desarrollados en pequeños animales (ratón y rata principalmente). El mayor potencial de esta tecnología proviene de la imagen multimodalidad, que combina información de más de una técnica de imagen y explota las posibles sinergias entre ellas al integrar en una sola imagen “forma y función”. Los principales argumentos a favor de estos dispositivos multimodales son la posibilidad de hacer las exploraciones intrínsecamente registradas en un tiempo reducido, y sin necesidad de mover el animal entre diferentes equipos. De todas las posibles combinaciones la que está reclamando más la atención últimamente es la PET/IRM (tomografía por emisión de positrones e imagen de resonancia magnética), aunque de momento la PET/CT (tomografía por emisión de positrones y tomograf

Molecular Biomedical Imaging Laboratory (MBIL)

Data.gov (United States)

Federal Laboratory Consortium — The Molecular Biomedical Imaging Laboratory (MBIL) is adjacent-a nd has access-to the Department of Radiology and Imaging Sciences clinical imaging facilities. MBIL...

Detection of relationships among multi-modal brain imaging meta-features via information flow.

Science.gov (United States)

Miller, Robyn L; Vergara, Victor M; Calhoun, Vince D

2018-01-15

Neuroscientists and clinical researchers are awash in data from an ever-growing number of imaging and other bio-behavioral modalities. This flow of brain imaging data, taken under resting and various task conditions, combines with available cognitive measures, behavioral information, genetic data plus other potentially salient biomedical and environmental information to create a rich but diffuse data landscape. The conditions being studied with brain imaging data are often extremely complex and it is common for researchers to employ more than one imaging, behavioral or biological data modality (e.g., genetics) in their investigations. While the field has advanced significantly in its approach to multimodal data, the vast majority of studies still ignore joint information among two or more features or modalities. We propose an intuitive framework based on conditional probabilities for understanding information exchange between features in what we are calling a feature meta-space; that is, a space consisting of many individual featurae spaces. Features can have any dimension and can be drawn from any data source or modality. No a priori assumptions are made about the functional form (e.g., linear, polynomial, exponential) of captured inter-feature relationships. We demonstrate the framework's ability to identify relationships between disparate features of varying dimensionality by applying it to a large multi-site, multi-modal clinical dataset, balance between schizophrenia patients and controls. In our application it exposes both expected (previously observed) relationships, and novel relationships rarely considered investigated by clinical researchers. To the best of our knowledge there is not presently a comparably efficient way to capture relationships of indeterminate functional form between features of arbitrary dimension and type. We are introducing this method as an initial foray into a space that remains relatively underpopulated. The framework we propose is

Molecular imaging of transcriptional regulation during inflammation

Directory of Open Access Journals (Sweden)

Carlsen Harald

2010-04-01

Full Text Available Abstract Molecular imaging enables non-invasive visualization of the dynamics of molecular processes within living organisms in vivo. Different imaging modalities as MRI, SPECT, PET and optic imaging are used together with molecular probes specific for the biological process of interest. Molecular imaging of transcription factor activity is done in animal models and mostly in transgenic reporter mice, where the transgene essentially consists of a promoter that regulates a reporter gene. During inflammation, the transcription factor NF-κB is widely involved in orchestration and regulation of the immune system and almost all imaging studies in this field has revolved around the role and regulation of NF-κB. We here present a brief introduction to experimental use and design of transgenic reporter mice and a more extensive review of the various studies where molecular imaging of transcriptional regulation has been applied during inflammation.

Molecular imaging promotes progress in orthopedic research.

Science.gov (United States)

Mayer-Kuckuk, Philipp; Boskey, Adele L

2006-11-01

Modern orthopedic research is directed towards the understanding of molecular mechanisms that determine development, maintenance and health of musculoskeletal tissues. In recent years, many genetic and proteomic discoveries have been made which necessitate investigation under physiological conditions in intact, living tissues. Molecular imaging can meet this demand and is, in fact, the only strategy currently available for noninvasive, quantitative, real-time biology studies in living subjects. In this review, techniques of molecular imaging are summarized, and applications to bone and joint biology are presented. The imaging modality most frequently used in the past was optical imaging, particularly bioluminescence and near-infrared fluorescence imaging. Alternate technologies including nuclear and magnetic resonance imaging were also employed. Orthopedic researchers have applied molecular imaging to murine models including transgenic mice to monitor gene expression, protein degradation, cell migration and cell death. Within the bone compartment, osteoblasts and their stem cells have been investigated, and the organic and mineral bone phases have been assessed. These studies addressed malignancy and injury as well as repair, including fracture healing and cell/gene therapy for skeletal defects. In the joints, molecular imaging has focused on the inflammatory and tissue destructive processes that cause arthritis. As described in this review, the feasibility of applying molecular imaging to numerous areas of orthopedic research has been demonstrated and will likely result in an increase in research dedicated to this powerful strategy. Molecular imaging holds great promise in the future for preclinical orthopedic research as well as next-generation clinical musculoskeletal diagnostics.

Aspergillus infection monitored by multimodal imaging in a rat model.

Science.gov (United States)

Pluhacek, Tomas; Petrik, Milos; Luptakova, Dominika; Benada, Oldrich; Palyzova, Andrea; Lemr, Karel; Havlicek, Vladimir

2016-06-01

Although myriads of experimental approaches have been published in the field of fungal infection diagnostics, interestingly, in 21st century there is no satisfactory early noninvasive tool for Aspergillus diagnostics with good sensitivity and specificity. In this work, we for the first time described the fungal burden in rat lungs by multimodal imaging approach. The Aspergillus infection was monitored by positron emission tomography and light microscopy employing modified Grocott's methenamine silver staining and eosin counterstaining. Laser ablation inductively coupled plasma mass spectrometry imaging has revealed a dramatic iron increase in fungi-affected areas, which can be presumably attributed to microbial siderophores. Quantitative elemental data were inferred from matrix-matched standards prepared from rat lungs. The iron, silver, and gold MS images collected with variable laser foci revealed that particularly silver or gold can be used as excellent elements useful for sensitively tracking the Aspergillus infection. The limit of detection was determined for both (107) Ag and (197) Au as 0.03 μg/g (5 μm laser focus). The selective incorporation of (107) Ag and (197) Au into fungal cell bodies and low background noise from both elements were confirmed by energy dispersive X-ray scattering utilizing the submicron lateral resolving power of scanning electron microscopy. The low limits of detection and quantitation of both gold and silver make ICP-MS imaging monitoring a viable alternative to standard optical evaluation used in current clinical settings. © 2016 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Molecular imaging in the era of personalized medicine.

Science.gov (United States)

Jung, Kyung-Ho; Lee, Kyung-Han

2015-01-01

Clinical imaging creates visual representations of the body interior for disease assessment. The role of clinical imaging significantly overlaps with that of pathology, and diagnostic workflows largely depend on both fields. The field of clinical imaging is presently undergoing a radical change through the emergence of a new field called molecular imaging. This new technology, which lies at the intersection between imaging and molecular biology, enables noninvasive visualization of biochemical processes at the molecular level within living bodies. Molecular imaging differs from traditional anatomical imaging in that biomarkers known as imaging probes are used to visualize target molecules-of-interest. This ability opens up exciting new possibilities for applications in oncologic, neurological and cardiovascular diseases. Molecular imaging is expected to make major contributions to personalized medicine by allowing earlier diagnosis and predicting treatment response. The technique is also making a huge impact on pharmaceutical development by optimizing preclinical and clinical tests for new drug candidates. This review will describe the basic principles of molecular imaging and will briefly touch on three examples (from an immense list of new techniques) that may contribute to personalized medicine: receptor imaging, angiogenesis imaging, and apoptosis imaging.

Dual CARS and SHG image acquisition scheme that combines single central fiber and multimode fiber bundle to collect and differentiate backward and forward generated photons

Science.gov (United States)

Weng, Sheng; Chen, Xu; Xu, Xiaoyun; Wong, Kelvin K.; Wong, Stephen T. C.

2016-01-01

In coherent anti-Stokes Raman scattering (CARS) and second harmonic generation (SHG) imaging, backward and forward generated photons exhibit different image patterns and thus capture salient intrinsic information of tissues from different perspectives. However, they are often mixed in collection using traditional image acquisition methods and thus are hard to interpret. We developed a multimodal scheme using a single central fiber and multimode fiber bundle to simultaneously collect and differentiate images formed by these two types of photons and evaluated the scheme in an endomicroscopy prototype. The ratio of these photons collected was calculated for the characterization of tissue regions with strong or weak epi-photon generation while different image patterns of these photons at different tissue depths were revealed. This scheme provides a new approach to extract and integrate information captured by backward and forward generated photons in dual CARS/SHG imaging synergistically for biomedical applications. PMID:27375938

Spinal focal lesion detection in multiple myeloma using multimodal image features

Science.gov (United States)

Fränzle, Andrea; Hillengass, Jens; Bendl, Rolf

2015-03-01

Multiple myeloma is a tumor disease in the bone marrow that affects the skeleton systemically, i.e. multiple lesions can occur in different sites in the skeleton. To quantify overall tumor mass for determining degree of disease and for analysis of therapy response, volumetry of all lesions is needed. Since the large amount of lesions in one patient impedes manual segmentation of all lesions, quantification of overall tumor volume is not possible until now. Therefore development of automatic lesion detection and segmentation methods is necessary. Since focal tumors in multiple myeloma show different characteristics in different modalities (changes in bone structure in CT images, hypointensity in T1 weighted MR images and hyperintensity in T2 weighted MR images), multimodal image analysis is necessary for the detection of focal tumors. In this paper a pattern recognition approach is presented that identifies focal lesions in lumbar vertebrae based on features from T1 and T2 weighted MR images. Image voxels within bone are classified using random forests based on plain intensities and intensity value derived features (maximum, minimum, mean, median) in a 5 x 5 neighborhood around a voxel from both T1 and T2 weighted MR images. A test data sample of lesions in 8 lumbar vertebrae from 4 multiple myeloma patients can be classified at an accuracy of 95% (using a leave-one-patient-out test). The approach provides a reasonable delineation of the example lesions. This is an important step towards automatic tumor volume quantification in multiple myeloma.

Nanobody: the "magic bullet" for molecular imaging?

Science.gov (United States)

Chakravarty, Rubel; Goel, Shreya; Cai, Weibo

2014-01-01

Molecular imaging involves the non-invasive investigation of biological processes in vivo at the cellular and molecular level, which can play diverse roles in better understanding and treatment of various diseases. Recently, single domain antigen-binding fragments known as 'nanobodies' were bioengineered and tested for molecular imaging applications. Small molecular size (~15 kDa) and suitable configuration of the complementarity determining regions (CDRs) of nanobodies offer many desirable features suitable for imaging applications, such as rapid targeting and fast blood clearance, high solubility, high stability, easy cloning, modular nature, and the capability of binding to cavities and difficult-to-access antigens. Using nanobody-based probes, several imaging techniques such as radionuclide-based, optical and ultrasound have been employed for visualization of target expression in various disease models. This review summarizes the recent developments in the use of nanobody-based probes for molecular imaging applications. The preclinical data reported to date are quite promising, and it is expected that nanobody-based molecular imaging agents will play an important role in the diagnosis and management of various diseases.

Multimodal adaptive optics for depth-enhanced high-resolution ophthalmic imaging

Science.gov (United States)

Hammer, Daniel X.; Mujat, Mircea; Iftimia, Nicusor V.; Lue, Niyom; Ferguson, R. Daniel

2010-02-01

We developed a multimodal adaptive optics (AO) retinal imager for diagnosis of retinal diseases, including glaucoma, diabetic retinopathy (DR), age-related macular degeneration (AMD), and retinitis pigmentosa (RP). The development represents the first ever high performance AO system constructed that combines AO-corrected scanning laser ophthalmoscopy (SLO) and swept source Fourier domain optical coherence tomography (SSOCT) imaging modes in a single compact clinical prototype platform. The SSOCT channel operates at a wavelength of 1 μm for increased penetration and visualization of the choriocapillaris and choroid, sites of major disease activity for DR and wet AMD. The system is designed to operate on a broad clinical population with a dual deformable mirror (DM) configuration that allows simultaneous low- and high-order aberration correction. The system also includes a wide field line scanning ophthalmoscope (LSO) for initial screening, target identification, and global orientation; an integrated retinal tracker (RT) to stabilize the SLO, OCT, and LSO imaging fields in the presence of rotational eye motion; and a high-resolution LCD-based fixation target for presentation to the subject of stimuli and other visual cues. The system was tested in a limited number of human subjects without retinal disease for performance optimization and validation. The system was able to resolve and quantify cone photoreceptors across the macula to within ~0.5 deg (~100-150 μm) of the fovea, image and delineate ten retinal layers, and penetrate to resolve targets deep into the choroid. In addition to instrument hardware development, analysis algorithms were developed for efficient information extraction from clinical imaging sessions, with functionality including automated image registration, photoreceptor counting, strip and montage stitching, and segmentation. The system provides clinicians and researchers with high-resolution, high performance adaptive optics imaging to help

High-resolution multimodal clinical multiphoton tomography of skin

Science.gov (United States)

König, Karsten

2011-03-01

This review focuses on multimodal multiphoton tomography based on near infrared femtosecond lasers. Clinical multiphoton tomographs for 3D high-resolution in vivo imaging have been placed into the market several years ago. The second generation of this Prism-Award winning High-Tech skin imaging tool (MPTflex) was introduced in 2010. The same year, the world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph. In particular, non-fluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen has been imaged with submicron resolution in patients suffering from psoriasis. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution wide-field systems such as ultrasound, optoacoustical, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer, optimization of treatment strategies, and cosmetic research including long-term testing of sunscreen nanoparticles as well as anti-aging products.

Development of magneto-plasmonic nanoparticles for multimodal image-guided therapy to the brain.

Science.gov (United States)

Tomitaka, Asahi; Arami, Hamed; Raymond, Andrea; Yndart, Adriana; Kaushik, Ajeet; Jayant, Rahul Dev; Takemura, Yasushi; Cai, Yong; Toborek, Michal; Nair, Madhavan

2017-01-05

Magneto-plasmonic nanoparticles are one of the emerging multi-functional materials in the field of nanomedicine. Their potential for targeting and multi-modal imaging is highly attractive. In this study, magnetic core/gold shell (MNP@Au) magneto-plasmonic nanoparticles were synthesized by citrate reduction of Au ions on magnetic nanoparticle seeds. Hydrodynamic size and optical properties of magneto-plasmonic nanoparticles synthesized with the variation of Au ions and reducing agent concentrations were evaluated. The synthesized magneto-plasmonic nanoparticles exhibited superparamagnetic properties, and their magnetic properties contributed to the concentration-dependent contrast in magnetic resonance imaging (MRI). The imaging contrast from the gold shell part of the magneto-plasmonic nanoparticles was also confirmed by X-ray computed tomography (CT). The transmigration study of the magneto-plasmonic nanoparticles using an in vitro blood-brain barrier (BBB) model proved enhanced transmigration efficiency without disrupting the integrity of the BBB, and showed potential to be used for brain diseases and neurological disorders.

Molecular Imaging of Inflammation in Atherosclerosis

Science.gov (United States)

Wildgruber, Moritz; Swirski, Filip K.; Zernecke, Alma

2013-01-01

Acute rupture of vulnerable plaques frequently leads to myocardial infarction and stroke. Within the last decades, several cellular and molecular players have been identified that promote atherosclerotic lesion formation, maturation and plaque rupture. It is now widely recognized that inflammation of the vessel wall and distinct leukocyte subsets are involved throughout all phases of atherosclerotic lesion development. The mechanisms that render a stable plaque unstable and prone to rupture, however, remain unknown and the identification of the vulnerable plaque remains a major challenge in cardiovascular medicine. Imaging technologies used in the clinic offer minimal information about the underlying biology and potential risk for rupture. New imaging technologies are therefore being developed, and in the preclinical setting have enabled new and dynamic insights into the vessel wall for a better understanding of this complex disease. Molecular imaging has the potential to track biological processes, such as the activity of cellular and molecular biomarkers in vivo and over time. Similarly, novel imaging technologies specifically detect effects of therapies that aim to stabilize vulnerable plaques and silence vascular inflammation. Here we will review the potential of established and new molecular imaging technologies in the setting of atherosclerosis, and discuss the cumbersome steps required for translating molecular imaging approaches into the clinic. PMID:24312156

Evaluation of multimodality imaging using image fusion with ultrasound tissue elasticity imaging in an experimental animal model.

Science.gov (United States)

Paprottka, P M; Zengel, P; Cyran, C C; Ingrisch, M; Nikolaou, K; Reiser, M F; Clevert, D A

2014-01-01

To evaluate the ultrasound tissue elasticity imaging by comparison to multimodality imaging using image fusion with Magnetic Resonance Imaging (MRI) and conventional grey scale imaging with additional elasticity-ultrasound in an experimental small-animal-squamous-cell carcinoma-model for the assessment of tissue morphology. Human hypopharynx carcinoma cells were subcutaneously injected into the left flank of 12 female athymic nude rats. After 10 days (SD ± 2) of subcutaneous tumor growth, sonographic grey scale including elasticity imaging and MRI measurements were performed using a high-end ultrasound system and a 3T MR. For image fusion the contrast-enhanced MRI DICOM data set was uploaded in the ultrasonic device which has a magnetic field generator, a linear array transducer (6-15 MHz) and a dedicated software package (GE Logic E9), that can detect transducers by means of a positioning system. Conventional grey scale and elasticity imaging were integrated in the image fusion examination. After successful registration and image fusion the registered MR-images were simultaneously shown with the respective ultrasound sectional plane. Data evaluation was performed using the digitally stored video sequence data sets by two experienced radiologist using a modified Tsukuba Elasticity score. The colors "red and green" are assigned for an area of soft tissue, "blue" indicates hard tissue. In all cases a successful image fusion and plan registration with MRI and ultrasound imaging including grey scale and elasticity imaging was possible. The mean tumor volume based on caliper measurements in 3 dimensions was ~323 mm3. 4/12 rats were evaluated with Score I, 5/12 rates were evaluated with Score II, 3/12 rates were evaluated with Score III. There was a close correlation in the fused MRI with existing small necrosis in the tumor. None of the scored II or III lesions was visible by conventional grey scale. The comparison of ultrasound tissue elasticity imaging enables a

Multimodal ultrasound tomography for breast imaging: a prospective study of clinical feasibility.

Science.gov (United States)

Forte, S; Dellas, S; Stieltjes, B; Bongartz, B

2017-01-01

To describe the clinical set-up and evaluate the feasibility of multimodal ultrasound tomography (MUT) for breast imaging. Thirty-two consecutive patients referred for breast imaging and 24 healthy volunteers underwent MUT. In the 32 patients, the examination discomfort was compared to that of mammography (n = 31), handheld ultrasound (HUS) (n = 27) and magnetic resonance imaging (MRI) (n = 4) on a scale from 1 (lowest discomfort) to 10 (highest discomfort). MUT investigation time was recorded. Findings automatically detected by MUT were correlated with conventional imaging and biopsy results. Breast MUT was well tolerated by all 56 participants; 55 bilateral exams were uneventful. During one exam, the digitalisation card failed and the exam was successfully repeated within three days. Mean examination discomfort was 1.6 (range = 1-5) for MUT, 1.5 (range = 1-5) for HUS, 5.3 (range = 3-7) for MRI, and 6.3 (range = 1-10) for mammography. MUT examination time was 38 ± 6 min (mean ± standard deviation). In the patients referred for breast imaging, MUT detected four lesions and indicated malignancy in three of these cases. These findings were confirmed by additional imaging and biopsy. MUT is feasible in a clinical context considering examination time and patient acceptance. These interesting initial diagnostic findings warrant further studies.

Development of a simplified simulation model for performance characterization of a pixellated CdZnTe multimodality imaging system

Energy Technology Data Exchange (ETDEWEB)

Guerra, P; Santos, A [Departamento de IngenierIa Electronica, Universidad Politecnica de Madrid, Ciudad Universitaria s/n, 28040 Madrid (Spain); Darambara, D G [Joint Department of Physics, Royal Marsden NHS Foundation Trust and The Institute of Cancer Research, Fulham Road, London SW3 6JJ (United Kingdom)], E-mail: pguerra@die.um.es

2008-02-21

Current requirements of molecular imaging lead to the complete integration of complementary modalities in a single hybrid imaging system to correlate function and structure. Among the various existing detector technologies, which can be implemented to integrate nuclear modalities (PET and/or single-photon emission computed tomography with x-rays (CT) and most probably with MR, pixellated wide bandgap room temperature semiconductor detectors, such as CdZnTe and/or CdTe, are promising candidates. This paper deals with the development of a simplified simulation model for pixellated semiconductor radiation detectors, as a first step towards the performance characterization of a multimodality imaging system based on CdZnTe. In particular, this work presents a simple computational model, based on a 1D approximate solution of the Schockley-Ramo theorem, and its integration into the Geant4 application for tomographic emission (GATE) platform in order to perform accurately and, therefore, improve the simulations of pixellated detectors in different configurations with a simultaneous cathode and anode pixel readout. The model presented here is successfully validated against an existing detailed finite element simulator, the multi-geometry simulation code, with respect to the charge induced at the anode, taking into consideration interpixel charge sharing and crosstalk, and to the detector charge induction efficiency. As a final point, the model provides estimated energy spectra and time resolution for {sup 57}Co and {sup 18}F sources obtained with the GATE code after the incorporation of the proposed model.

PET-based molecular imaging in neuroscience

International Nuclear Information System (INIS)

Jacobs, A.H.; Heiss, W.D.; Li, H.; Knoess, C.; Schaller, B.; Kracht, L.; Monfared, P.; Vollmar, S.; Bauer, B.; Wagner, R.; Graf, R.; Wienhard, K.; Winkeler, A.; Rueger, A.; Klein, M.; Hilker, R.; Galldiks, N.; Herholz, K.; Sobesky, J.

2003-01-01

Positron emission tomography (PET) allows non-invasive assessment of physiological, metabolic and molecular processes in humans and animals in vivo. Advances in detector technology have led to a considerable improvement in the spatial resolution of PET (1-2 mm), enabling for the first time investigations in small experimental animals such as mice. With the developments in radiochemistry and tracer technology, a variety of endogenously expressed and exogenously introduced genes can be analysed by PET. This opens up the exciting and rapidly evolving field of molecular imaging, aiming at the non-invasive localisation of a biological process of interest in normal and diseased cells in animal models and humans in vivo. The main and most intriguing advantage of molecular imaging is the kinetic analysis of a given molecular event in the same experimental subject over time. This will allow non-invasive characterisation and ''phenotyping'' of animal models of human disease at various disease stages, under certain pathophysiological stimuli and after therapeutic intervention. The potential broad applications of imaging molecular events in vivo lie in the study of cell biology, biochemistry, gene/protein function and regulation, signal transduction, transcriptional regulation and characterisation of transgenic animals. Most importantly, molecular imaging will have great implications for the identification of potential molecular therapeutic targets, in the development of new treatment strategies, and in their successful implementation into clinical application. Here, the potential impact of molecular imaging by PET in applications in neuroscience research with a special focus on neurodegeneration and neuro-oncology is reviewed. (orig.)

Biodistribution of arctigenin-loaded nanoparticles designed for multimodal imaging.

Science.gov (United States)

Cui, Qingxin; Hou, Yuanyuan; Wang, Yanan; Li, Xu; Liu, Yang; Ma, Xiaoyao; Wang, Zengyong; Wang, Weiya; Tao, Jin; Wang, Qian; Jiang, Min; Chen, Dongyan; Feng, Xizeng; Bai, Gang

2017-04-07

Tracking targets of natural products is one of the most challenging issues in fields ranging from pharmacognosy to biomedicine. It is widely recognized that the biocompatible nanoparticle (NP) could function as a "key" that opens the target "lock". We report a functionalized poly-lysine NP technique that can monitor the target protein of arctigenin (ATG) in vivo non-invasively. The NPs were synthesized, and their morphologies and surface chemical properties were characterized by transmission electron microscopy (TEM), laser particle size analysis and atomic force microscopy (AFM). In addition, we studied the localization of ATG at the level of the cell and the whole animal (zebrafish and mice). We demonstrated that fluorescent NPs could be ideal carriers in the development of a feasible method for target identification. The distributions of the target proteins were found to be consistent with the pharmacological action of ATG at the cellular and whole-organism levels. The results indicated that functionalized poly-lysine NPs could be valuable in the multimodal imaging of arctigenin.

Comparative imaging study in ultrasound, MRI, CT, and DSA using a multimodality renal artery phantom

Energy Technology Data Exchange (ETDEWEB)

King, Deirdre M.; Fagan, Andrew J.; Moran, Carmel M.; Browne, Jacinta E. [Medical Ultrasound Physics and Technology Group, School of Physics, Dublin Institute of Technology, Dublin 8 (Ireland); Centre for Advanced Medical Imaging (CAMI), St James' s Hospital, Dublin 8 (Ireland); Department of Medical Physics, University of Edinburgh, Edinburgh EH16 4TJ (United Kingdom); Medical Ultrasound Physics and Technology Group, School of Physics, Dublin Institute of Technology, Dublin 8 (Ireland)

2011-02-15

Purpose: A range of anatomically realistic multimodality renal artery phantoms consisting of vessels with varying degrees of stenosis was developed and evaluated using four imaging techniques currently used to detect renal artery stenosis (RAS). The spatial resolution required to visualize vascular geometry and the velocity detection performance required to adequately characterize blood flow in patients suffering from RAS are currently ill-defined, with the result that no one imaging modality has emerged as a gold standard technique for screening for this disease. Methods: The phantoms, which contained a range of stenosis values (0%, 30%, 50%, 70%, and 85%), were designed for use with ultrasound, magnetic resonance imaging, x-ray computed tomography, and x-ray digital subtraction angiography. The construction materials used were optimized with respect to their ultrasonic speed of sound and attenuation coefficient, MR relaxometry (T{sub 1},T{sub 2}) properties, and Hounsfield number/x-ray attenuation coefficient, with a design capable of tolerating high-pressure pulsatile flow. Fiducial targets, incorporated into the phantoms to allow for registration of images among modalities, were chosen to minimize geometric distortions. Results: High quality distortion-free images of the phantoms with good contrast between vessel lumen, fiducial markers, and background tissue to visualize all stenoses were obtained with each modality. Quantitative assessments of the grade of stenosis revealed significant discrepancies between modalities, with each underestimating the stenosis severity for the higher-stenosed phantoms (70% and 85%) by up to 14%, with the greatest discrepancy attributable to DSA. Conclusions: The design and construction of a range of anatomically realistic renal artery phantoms containing varying degrees of stenosis is described. Images obtained using the main four diagnostic techniques used to detect RAS were free from artifacts and exhibited adequate contrast

Comparative imaging study in ultrasound, MRI, CT, and DSA using a multimodality renal artery phantom

International Nuclear Information System (INIS)

King, Deirdre M.; Fagan, Andrew J.; Moran, Carmel M.; Browne, Jacinta E.

2011-01-01

Purpose: A range of anatomically realistic multimodality renal artery phantoms consisting of vessels with varying degrees of stenosis was developed and evaluated using four imaging techniques currently used to detect renal artery stenosis (RAS). The spatial resolution required to visualize vascular geometry and the velocity detection performance required to adequately characterize blood flow in patients suffering from RAS are currently ill-defined, with the result that no one imaging modality has emerged as a gold standard technique for screening for this disease. Methods: The phantoms, which contained a range of stenosis values (0%, 30%, 50%, 70%, and 85%), were designed for use with ultrasound, magnetic resonance imaging, x-ray computed tomography, and x-ray digital subtraction angiography. The construction materials used were optimized with respect to their ultrasonic speed of sound and attenuation coefficient, MR relaxometry (T 1 ,T 2 ) properties, and Hounsfield number/x-ray attenuation coefficient, with a design capable of tolerating high-pressure pulsatile flow. Fiducial targets, incorporated into the phantoms to allow for registration of images among modalities, were chosen to minimize geometric distortions. Results: High quality distortion-free images of the phantoms with good contrast between vessel lumen, fiducial markers, and background tissue to visualize all stenoses were obtained with each modality. Quantitative assessments of the grade of stenosis revealed significant discrepancies between modalities, with each underestimating the stenosis severity for the higher-stenosed phantoms (70% and 85%) by up to 14%, with the greatest discrepancy attributable to DSA. Conclusions: The design and construction of a range of anatomically realistic renal artery phantoms containing varying degrees of stenosis is described. Images obtained using the main four diagnostic techniques used to detect RAS were free from artifacts and exhibited adequate contrast to allow

PET/SPECT/CT multimodal imaging in a transgenic mouse model of breast cancer

Energy Technology Data Exchange (ETDEWEB)

Boisgard, R.; Alberini, J.L.; Jego, B.; Siquier, K.; Theze, B.; Guillermet, S.; Tavitian, B. [Service Hospitalier Frederic Joliot, Institut d' Imagerie BioMedicale, CEA, 91 - Orsay (France); Inserm, U803, 91 - Orsay (France)

2008-02-15

Background. - In the therapy monitoring of breast cancer, conventional imaging methods include ultrasound, mammography, CT and MRI, which are essentially based on tumor size modifications. However these modifications represent a late consequence of the biological response and fail to differentiate scar or necrotic tissue from residual viable tumoral tissue. Therefore, a current objective is to develop tools able to predict early response to treatment. Positron Emission Tomography (PET) and Single Photon Emission Computerized Tomography (SPECT) are imaging modalities able to provide extremely sensitive quantitative molecular data and are widely used in humans and animals. Results. - Mammary epithelial cells of female transgenic mice expressing the polyoma middle T onco-protein (Py M.T.), undergo four distinct stages of tumour progression, from pre malignant to malignant stages. Stages are identifiable in the mammary tissue and can lead to the development of distant metastases Longitudinal studies by dynamic whole body acquisitions by multimodal imaging including PET, SPECT and Computed Tomography (CT) allow following the tumoral evolution in Py M.T. mice in comparison with the histopathological analysis. At four weeks of age, mammary hyperplasia was identified by histopathology, but no abnormalities were found by palpation or detected by PET with 2-deoxy-2-[{sup 18}F]fluoro-D-glucose. Such as in some human mammary cancers, the sodium iodide sym-porter (N.I.S.) in tumoral mammary epithelial cells is expressed in this mouse model. In order to investigate the expression of N.I.S. in the Py M.T. mice mammary tumours, [{sup 99m}Tc]TcO{sub 4} imaging was performed with a dedicated SPECT/CT system camera (B.I.O.S.P.A.C.E. Gamma Imager/CT). Local uptake of [{sup 99m}Tc]TcO{sub 4} was detected as early as four weeks of age. The efficacy of chemotherapy was evaluated in this mouse model using a conventional regimen (Doxorubicine, 100 mg/ kg) administered weekly from nine to

Dermatological Feasibility of Multimodal Facial Color Imaging Modality for Cross-Evaluation of Facial Actinic Keratosis

Science.gov (United States)

Bae, Youngwoo; Son, Taeyoon; Nelson, J. Stuart; Kim, Jae-Hong; Choi, Eung Ho; Jung, Byungjo

2010-01-01

Background/Purpose Digital color image analysis is currently considered as a routine procedure in dermatology. In our previous study, a multimodal facial color imaging modality (MFCIM), which provides a conventional, parallel- and cross-polarization, and fluorescent color image, was introduced for objective evaluation of various facial skin lesions. This study introduces a commercial version of MFCIM, DermaVision-PRO, for routine clinical use in dermatology and demonstrates its dermatological feasibility for cross-evaluation of skin lesions. Methods/Results Sample images of subjects with actinic keratosis or non-melanoma skin cancers were obtained at four different imaging modes. Various image analysis methods were applied to cross-evaluate the skin lesion and, finally, extract valuable diagnostic information. DermaVision-PRO is potentially a useful tool as an objective macroscopic imaging modality for quick prescreening and cross-evaluation of facial skin lesions. Conclusion DermaVision-PRO may be utilized as a useful tool for cross-evaluation of widely distributed facial skin lesions and an efficient database management of patient information. PMID:20923462

Automated Registration of Multimodal Optic Disc Images: Clinical Assessment of Alignment Accuracy.

Science.gov (United States)

Ng, Wai Siene; Legg, Phil; Avadhanam, Venkat; Aye, Kyaw; Evans, Steffan H P; North, Rachel V; Marshall, Andrew D; Rosin, Paul; Morgan, James E

2016-04-01

To determine the accuracy of automated alignment algorithms for the registration of optic disc images obtained by 2 different modalities: fundus photography and scanning laser tomography. Images obtained with the Heidelberg Retina Tomograph II and paired photographic optic disc images of 135 eyes were analyzed. Three state-of-the-art automated registration techniques Regional Mutual Information, rigid Feature Neighbourhood Mutual Information (FNMI), and nonrigid FNMI (NRFNMI) were used to align these image pairs. Alignment of each composite picture was assessed on a 5-point grading scale: "Fail" (no alignment of vessels with no vessel contact), "Weak" (vessels have slight contact), "Good" (vessels with 50% contact), and "Excellent" (complete alignment). Custom software generated an image mosaic in which the modalities were interleaved as a series of alternate 5×5-pixel blocks. These were graded independently by 3 clinically experienced observers. A total of 810 image pairs were assessed. All 3 registration techniques achieved a score of "Good" or better in >95% of the image sets. NRFNMI had the highest percentage of "Excellent" (mean: 99.6%; range, 95.2% to 99.6%), followed by Regional Mutual Information (mean: 81.6%; range, 86.3% to 78.5%) and FNMI (mean: 73.1%; range, 85.2% to 54.4%). Automated registration of optic disc images by different modalities is a feasible option for clinical application. All 3 methods provided useful levels of alignment, but the NRFNMI technique consistently outperformed the others and is recommended as a practical approach to the automated registration of multimodal disc images.

Self-imaging effect of TM modes in photonic crystal multimode waveguides only exhibiting band gaps for TE modes

International Nuclear Information System (INIS)

Yu Tianbao; Jiang Xiaoqing; Yang Jianyi; Zhou Haifeng; Liao Qinghua; Wang Minghua

2007-01-01

This Letter presents the properties of transverse-magnetic (TM) modes in multimode photonic crystal waveguides (PCWs), which only exhibit photonic band gaps for transverse-electric (TE) modes. A good equivalent model is applied to analysis the designed structures on the basis of multimode interference effect and self-imaging principle. The performance shows that the TM modes can also be propagated with high efficiency, and resemble index-guided modes owing to the combination of total internal reflection (TIR) and distribution Bragg reflection. It provides a novel way to realize the components for both TM and TE polarizations by combining PBG and TIR effect in PCWs. As one of potential applications, polarization-insensitive power splitter based on the proposed structures can be designed

A spinal cord window chamber model for in vivo longitudinal multimodal optical and acoustic imaging in a murine model.

Directory of Open Access Journals (Sweden)

Sarah A Figley

Full Text Available In vivo and direct imaging of the murine spinal cord and its vasculature using multimodal (optical and acoustic imaging techniques could significantly advance preclinical studies of the spinal cord. Such intrinsically high resolution and complementary imaging technologies could provide a powerful means of quantitatively monitoring changes in anatomy, structure, physiology and function of the living cord over time after traumatic injury, onset of disease, or therapeutic intervention. However, longitudinal in vivo imaging of the intact spinal cord in rodent models has been challenging, requiring repeated surgeries to expose the cord for imaging or sacrifice of animals at various time points for ex vivo tissue analysis. To address these limitations, we have developed an implantable spinal cord window chamber (SCWC device and procedures in mice for repeated multimodal intravital microscopic imaging of the cord and its vasculature in situ. We present methodology for using our SCWC to achieve spatially co-registered optical-acoustic imaging performed serially for up to four weeks, without damaging the cord or induction of locomotor deficits in implanted animals. To demonstrate the feasibility, we used the SCWC model to study the response of the normal spinal cord vasculature to ionizing radiation over time using white light and fluorescence microscopy combined with optical coherence tomography (OCT in vivo. In vivo power Doppler ultrasound and photoacoustics were used to directly visualize the cord and vascular structures and to measure hemoglobin oxygen saturation through the complete spinal cord, respectively. The model was also used for intravital imaging of spinal micrometastases resulting from primary brain tumor using fluorescence and bioluminescence imaging. Our SCWC model overcomes previous in vivo imaging challenges, and our data provide evidence of the broader utility of hybridized optical-acoustic imaging methods for obtaining

A fully automatic approach for multimodal PET and MR image segmentation in gamma knife treatment planning.

Science.gov (United States)

Rundo, Leonardo; Stefano, Alessandro; Militello, Carmelo; Russo, Giorgio; Sabini, Maria Gabriella; D'Arrigo, Corrado; Marletta, Francesco; Ippolito, Massimo; Mauri, Giancarlo; Vitabile, Salvatore; Gilardi, Maria Carla

2017-06-01

Nowadays, clinical practice in Gamma Knife treatments is generally based on MRI anatomical information alone. However, the joint use of MRI and PET images can be useful for considering both anatomical and metabolic information about the lesion to be treated. In this paper we present a co-segmentation method to integrate the segmented Biological Target Volume (BTV), using [ 11 C]-Methionine-PET (MET-PET) images, and the segmented Gross Target Volume (GTV), on the respective co-registered MR images. The resulting volume gives enhanced brain tumor information to be used in stereotactic neuro-radiosurgery treatment planning. GTV often does not match entirely with BTV, which provides metabolic information about brain lesions. For this reason, PET imaging is valuable and it could be used to provide complementary information useful for treatment planning. In this way, BTV can be used to modify GTV, enhancing Clinical Target Volume (CTV) delineation. A novel fully automatic multimodal PET/MRI segmentation method for Leksell Gamma Knife ® treatments is proposed. This approach improves and combines two computer-assisted and operator-independent single modality methods, previously developed and validated, to segment BTV and GTV from PET and MR images, respectively. In addition, the GTV is utilized to combine the superior contrast of PET images with the higher spatial resolution of MRI, obtaining a new BTV, called BTV MRI . A total of 19 brain metastatic tumors, undergone stereotactic neuro-radiosurgery, were retrospectively analyzed. A framework for the evaluation of multimodal PET/MRI segmentation is also presented. Overlap-based and spatial distance-based metrics were considered to quantify similarity concerning PET and MRI segmentation approaches. Statistics was also included to measure correlation among the different segmentation processes. Since it is not possible to define a gold-standard CTV according to both MRI and PET images without treatment response assessment

Multimodal imaging Gd-nanoparticles functionalized with Pittsburgh compound B or a nanobody for amyloid plaques targeting.

Science.gov (United States)

Pansieri, Jonathan; Plissonneau, Marie; Stransky-Heilkron, Nathalie; Dumoulin, Mireille; Heinrich-Balard, Laurence; Rivory, Pascaline; Morfin, Jean-François; Toth, Eva; Saraiva, Maria Joao; Allémann, Eric; Tillement, Olivier; Forge, Vincent; Lux, François; Marquette, Christel

2017-07-01

Gadolinium-based nanoparticles were functionalized with either the Pittsburgh compound B or a nanobody (B10AP) in order to create multimodal tools for an early diagnosis of amyloidoses. The ability of the functionalized nanoparticles to target amyloid fibrils made of β-amyloid peptide, amylin or Val30Met-mutated transthyretin formed in vitro or from pathological tissues was investigated by a range of spectroscopic and biophysics techniques including fluorescence microscopy. Nanoparticles functionalized by both probes efficiently interacted with the three types of amyloid fibrils, with K D values in 10 micromolar and 10 nanomolar range for, respectively, Pittsburgh compound B and B10AP nanoparticles. Moreover, they allowed the detection of amyloid deposits on pathological tissues. Such functionalized nanoparticles could represent promising flexible and multimodal imaging tools for the early diagnostic of amyloid diseases, in other words, Alzheimer's disease, Type 2 diabetes mellitus and the familial amyloidotic polyneuropathy.

Size selectivity of magnetite core- (Ag/Au) shell nanoparticles for multimodal imaging applications

Science.gov (United States)

Singh, Pinki; Upadhyay, Chandan

2017-10-01

The magnetic and optical properties of nanomaterials play a significant role in the selection of the materials to be used for contrast enhancement in different biological and cell imaging techniques. These nanoparticles can also be used as drug delivery agents. The calculation of absorption efficiency and surface plasmon resonance wavelength has been performed using Mie theory and MATLAB programs. The study of spectrum calculated indicates the dependence of several optical properties such as resonance and absorption efficiency peak on ratio of core radius to the thickness of shell. A systematic study on the effect of nanoparticle dimension has been presented which clearly indicates that the optical properties can be modulated across the visible and near infrared range by changing these parameters. These properties of nanomaterials make them suitable for their application as multimodal imaging agents as they are also magnetically active and biocompatible.

WE-H-206-01: Photoacoustic Tomography: Multiscale Imaging From Organelles to Patients by Ultrasonically Beating the Optical Diffusion Limit

International Nuclear Information System (INIS)

Wang, L.

2016-01-01

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

WE-H-206-03: Promises and Challenges of Benchtop X-Ray Fluorescence CT (XFCT) for Quantitative in Vivo Imaging

International Nuclear Information System (INIS)

Cho, S.

2016-01-01

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

WE-H-206-01: Photoacoustic Tomography: Multiscale Imaging From Organelles to Patients by Ultrasonically Beating the Optical Diffusion Limit

Energy Technology Data Exchange (ETDEWEB)

Wang, L. [Washington University (United States)

2016-06-15

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

WE-H-206-03: Promises and Challenges of Benchtop X-Ray Fluorescence CT (XFCT) for Quantitative in Vivo Imaging

Energy Technology Data Exchange (ETDEWEB)

Cho, S. [UT MD Anderson Cancer Center (United States)

2016-06-15

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffers from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly

A Novel Multimodal Biometrics Recognition Model Based on Stacked ELM and CCA Methods

Directory of Open Access Journals (Sweden)

Jucheng Yang

2018-04-01

Full Text Available Multimodal biometrics combine a variety of biological features to have a significant impact on identification performance, which is a newly developed trend in biometrics identification technology. This study proposes a novel multimodal biometrics recognition model based on the stacked extreme learning machines (ELMs and canonical correlation analysis (CCA methods. The model, which has a symmetric structure, is found to have high potential for multimodal biometrics. The model works as follows. First, it learns the hidden-layer representation of biological images using extreme learning machines layer by layer. Second, the canonical correlation analysis method is applied to map the representation to a feature space, which is used to reconstruct the multimodal image feature representation. Third, the reconstructed features are used as the input of a classifier for supervised training and output. To verify the validity and efficiency of the method, we adopt it for new hybrid datasets obtained from typical face image datasets and finger-vein image datasets. Our experimental results demonstrate that our model performs better than traditional methods.

New Technologies, New Possibilities for the Arts and Multimodality in English Language Arts

Science.gov (United States)

Williams, Wendy R.

2014-01-01

This article discusses the arts, multimodality, and new technologies in English language arts. It then turns to the example of the illuminated text--a multimodal book report consisting of animated text, music, and images--to consider how art, multimodality, and technology can work together to support students' reading of literature and inspire…

Characterizing the inflammatory tissue response to acute myocardial infarction by clinical multimodality noninvasive imaging.

Science.gov (United States)

Wollenweber, Tim; Roentgen, Philipp; Schäfer, Andreas; Schatka, Imke; Zwadlo, Caroline; Brunkhorst, Thomas; Berding, Georg; Bauersachs, Johann; Bengel, Frank M

2014-09-01

Myocardial infarction (MI) triggers a systemic inflammatory response which determines subsequent healing. Experimentally, cardiac positron emission tomography and magnetic resonance imaging have been used successfully to obtain mechanistic insights. We explored the translational potential in patients early after MI. Positron emission tomography/computed tomography and cardiac magnetic resonance were performed in 15 patients sources of inflammatory cells. Positron emission tomography and cardiac magnetic resonance multimodality characterization of the acutely infarcted, inflamed myocardium may provide multiparametric end points for clinical studies aiming at support of infarct healing. © 2014 American Heart Association, Inc.

Vision 20/20: Simultaneous CT-MRI — Next chapter of multimodality imaging

International Nuclear Information System (INIS)

Wang, Ge; Xi, Yan; Gjesteby, Lars; Getzin, Matthew; Yang, Qingsong; Cong, Wenxiang; Kalra, Mannudeep; Murugan, Venkatesh; Vannier, Michael

2015-01-01

Multimodality imaging systems such as positron emission tomography-computed tomography (PET-CT) and MRI-PET are widely available, but a simultaneous CT-MRI instrument has not been developed. Synergies between independent modalities, e.g., CT, MRI, and PET/SPECT can be realized with image registration, but such postprocessing suffers from registration errors that can be avoided with synchronized data acquisition. The clinical potential of simultaneous CT-MRI is significant, especially in cardiovascular and oncologic applications where studies of the vulnerable plaque, response to cancer therapy, and kinetic and dynamic mechanisms of targeted agents are limited by current imaging technologies. The rationale, feasibility, and realization of simultaneous CT-MRI are described in this perspective paper. The enabling technologies include interior tomography, unique gantry designs, open magnet and RF sequences, and source and detector adaptation. Based on the experience with PET-CT, PET-MRI, and MRI-LINAC instrumentation where hardware innovation and performance optimization were instrumental to construct commercial systems, the authors provide top-level concepts for simultaneous CT-MRI to meet clinical requirements and new challenges. Simultaneous CT-MRI fills a major gap of modality coupling and represents a key step toward the so-called “omnitomography” defined as the integration of all relevant imaging modalities for systems biology and precision medicine

Vision 20/20: Simultaneous CT-MRI — Next chapter of multimodality imaging

Energy Technology Data Exchange (ETDEWEB)

Wang, Ge, E-mail: wangg6@rpi.edu; Xi, Yan; Gjesteby, Lars; Getzin, Matthew; Yang, Qingsong; Cong, Wenxiang [Biomedical Imaging Center/Cluster, Rensselaer Polytechnic Institute, Troy, New York 12180 (United States); Kalra, Mannudeep; Murugan, Venkatesh [Department of Imaging, Massachusetts General Hospital, 55 Fruit Street, Boston, Massachusetts 02114 (United States); Vannier, Michael [Department of Radiology, University of Chicago, Chicago, Illinois 60637 (United States)

2015-10-15

Multimodality imaging systems such as positron emission tomography-computed tomography (PET-CT) and MRI-PET are widely available, but a simultaneous CT-MRI instrument has not been developed. Synergies between independent modalities, e.g., CT, MRI, and PET/SPECT can be realized with image registration, but such postprocessing suffers from registration errors that can be avoided with synchronized data acquisition. The clinical potential of simultaneous CT-MRI is significant, especially in cardiovascular and oncologic applications where studies of the vulnerable plaque, response to cancer therapy, and kinetic and dynamic mechanisms of targeted agents are limited by current imaging technologies. The rationale, feasibility, and realization of simultaneous CT-MRI are described in this perspective paper. The enabling technologies include interior tomography, unique gantry designs, open magnet and RF sequences, and source and detector adaptation. Based on the experience with PET-CT, PET-MRI, and MRI-LINAC instrumentation where hardware innovation and performance optimization were instrumental to construct commercial systems, the authors provide top-level concepts for simultaneous CT-MRI to meet clinical requirements and new challenges. Simultaneous CT-MRI fills a major gap of modality coupling and represents a key step toward the so-called “omnitomography” defined as the integration of all relevant imaging modalities for systems biology and precision medicine.

Mesh-to-raster region-of-interest-based nonrigid registration of multimodal images.

Science.gov (United States)

Tatano, Rosalia; Berkels, Benjamin; Deserno, Thomas M

2017-10-01

Region of interest (RoI) alignment in medical images plays a crucial role in diagnostics, procedure planning, treatment, and follow-up. Frequently, a model is represented as triangulated mesh while the patient data is provided from computed axial tomography scanners as pixel or voxel data. Previously, we presented a 2-D method for curve-to-pixel registration. This paper contributes (i) a general mesh-to-raster framework to register RoIs in multimodal images; (ii) a 3-D surface-to-voxel application, and (iii) a comprehensive quantitative evaluation in 2-D using ground truth (GT) provided by the simultaneous truth and performance level estimation (STAPLE) method. The registration is formulated as a minimization problem, where the objective consists of a data term, which involves the signed distance function of the RoI from the reference image and a higher order elastic regularizer for the deformation. The evaluation is based on quantitative light-induced fluoroscopy (QLF) and digital photography (DP) of decalcified teeth. STAPLE is computed on 150 image pairs from 32 subjects, each showing one corresponding tooth in both modalities. The RoI in each image is manually marked by three experts (900 curves in total). In the QLF-DP setting, our approach significantly outperforms the mutual information-based registration algorithm implemented with the Insight Segmentation and Registration Toolkit and Elastix.

Molecular imaging. Fundamentals and applications

International Nuclear Information System (INIS)

Tian, Jie

2013-01-01

Covers a wide range of new theory, new techniques and new applications. Contributed by many experts in China. The editor has obtained the National Science and Technology Progress Award twice. ''Molecular Imaging: Fundamentals and Applications'' is a comprehensive monograph which describes not only the theory of the underlying algorithms and key technologies but also introduces a prototype system and its applications, bringing together theory, technology and applications. By explaining the basic concepts and principles of molecular imaging, imaging techniques, as well as research and applications in detail, the book provides both detailed theoretical background information and technical methods for researchers working in medical imaging and the life sciences. Clinical doctors and graduate students will also benefit from this book.

High sensitivity optical molecular imaging system

Science.gov (United States)

An, Yu; Yuan, Gao; Huang, Chao; Jiang, Shixin; Zhang, Peng; Wang, Kun; Tian, Jie

2018-02-01

Optical Molecular Imaging (OMI) has the advantages of high sensitivity, low cost and ease of use. By labeling the regions of interest with fluorescent or bioluminescence probes, OMI can noninvasively obtain the distribution of the probes in vivo, which play the key role in cancer research, pharmacokinetics and other biological studies. In preclinical and clinical application, the image depth, resolution and sensitivity are the key factors for researchers to use OMI. In this paper, we report a high sensitivity optical molecular imaging system developed by our group, which can improve the imaging depth in phantom to nearly 5cm, high resolution at 2cm depth, and high image sensitivity. To validate the performance of the system, special designed phantom experiments and weak light detection experiment were implemented. The results shows that cooperated with high performance electron-multiplying charge coupled device (EMCCD) camera, precision design of light path system and high efficient image techniques, our OMI system can simultaneously collect the light-emitted signals generated by fluorescence molecular imaging, bioluminescence imaging, Cherenkov luminance and other optical imaging modality, and observe the internal distribution of light-emitting agents fast and accurately.

Experimental Study on Bioluminescence Tomography with Multimodality Fusion

Directory of Open Access Journals (Sweden)

Yujie Lv

2007-01-01

Full Text Available To verify the influence of a priori information on the nonuniqueness problem of bioluminescence tomography (BLT, the multimodality imaging fusion based BLT experiment is performed by multiview noncontact detection mode, which incorporates the anatomical information obtained by the microCT scanner and the background optical properties based on diffuse reflectance measurements. In the reconstruction procedure, the utilization of adaptive finite element methods (FEMs and a priori permissible source region refines the reconstructed results and improves numerical robustness and efficiency. The comparison between the absence and employment of a priori information shows that multimodality imaging fusion is essential to quantitative BLT reconstruction.

Markerless registration for image guided surgery. Preoperative image, intraoperative video image, and patient

International Nuclear Information System (INIS)

Kihara, Tomohiko; Tanaka, Yuko

1998-01-01

Real-time and volumetric acquisition of X-ray CT, MR, and SPECT is the latest trend of the medical imaging devices. A clinical challenge is to use these multi-modality volumetric information complementary on patient in the entire diagnostic and surgical processes. The intraoperative image and patient integration intents to establish a common reference frame by image in diagnostic and surgical processes. This provides a quantitative measure during surgery, for which we have been relied mostly on doctors' skills and experiences. The intraoperative image and patient integration involves various technologies, however, we think one of the most important elements is the development of markerless registration, which should be efficient and applicable to the preoperative multi-modality data sets, intraoperative image, and patient. We developed a registration system which integrates preoperative multi-modality images, intraoperative video image, and patient. It consists of a real-time registration of video camera for intraoperative use, a markerless surface sampling matching of patient and image, our previous works of markerless multi-modality image registration of X-ray CT, MR, and SPECT, and an image synthesis on video image. We think these techniques can be used in many applications which involve video camera like devices such as video camera, microscope, and image Intensifier. (author)

A small animal holding fixture system with positional reproducibility for longitudinal multimodal imaging

Energy Technology Data Exchange (ETDEWEB)

Kokuryo, Daisuke; Kimura, Yuichi; Obata, Takayuki; Yamaya, Taiga; Kawamura, Kazunori; Zhang, Ming-Rong; Kanno, Iwao; Aoki, Ichio, E-mail: ukimura@ieee.or [Molecular Imaging Center, National Institute of Radiological Sciences, 4-9-1 Anagawa, Inage, Chiba 263-8555 (Japan)

2010-07-21

This study presents a combined small animal holding fixture system, termed a 'bridge capsule', which provides for small animal re-fixation with positional reproducibility. This system comprises separate holding fixtures for the head and lower body and a connecting part to a gas anesthesia system. A mouse is fixed in place by the combination of a head fixture with a movable part made from polyacetal resin, a lower body fixture made from vinyl-silicone and a holder for the legs and tail. For re-fixation, a similar posture could be maintained by the same holding fixtures and a constant distance between the head and lower body fixtures is maintained. Artifacts caused by the bridge capsule system were not observed on magnetic resonance (MRI) and positron emission tomography (PET) images. The average position differences of the spinal column and the iliac body before and after re-fixation for the same modality were approximately 1.1 mm. The difference between the MRI and PET images was approximately 1.8 mm for the lower body fixture after image registration using fiducial markers. This system would be useful for longitudinal, repeated and multimodal imaging experiments requiring similar animal postures.

Multi-modal imaging, model-based tracking, and mixed reality visualisation for orthopaedic surgery

Science.gov (United States)

Fuerst, Bernhard; Tateno, Keisuke; Johnson, Alex; Fotouhi, Javad; Osgood, Greg; Tombari, Federico; Navab, Nassir

2017-01-01

Orthopaedic surgeons are still following the decades old workflow of using dozens of two-dimensional fluoroscopic images to drill through complex 3D structures, e.g. pelvis. This Letter presents a mixed reality support system, which incorporates multi-modal data fusion and model-based surgical tool tracking for creating a mixed reality environment supporting screw placement in orthopaedic surgery. A red–green–blue–depth camera is rigidly attached to a mobile C-arm and is calibrated to the cone-beam computed tomography (CBCT) imaging space via iterative closest point algorithm. This allows real-time automatic fusion of reconstructed surface and/or 3D point clouds and synthetic fluoroscopic images obtained through CBCT imaging. An adapted 3D model-based tracking algorithm with automatic tool segmentation allows for tracking of the surgical tools occluded by hand. This proposed interactive 3D mixed reality environment provides an intuitive understanding of the surgical site and supports surgeons in quickly localising the entry point and orienting the surgical tool during screw placement. The authors validate the augmentation by measuring target registration error and also evaluate the tracking accuracy in the presence of partial occlusion. PMID:29184659

Gestational Trophoblastic Disease: A Multimodality Imaging Approach with Impact on Diagnosis and Management

Directory of Open Access Journals (Sweden)

Sunita Dhanda

2014-01-01

Full Text Available Gestational trophoblastic disease is a condition of uncertain etiology, comprised of hydatiform mole (complete and partial, invasive mole, choriocarcinoma, and placental site trophoblastic tumor. It arises from abnormal proliferation of trophoblastic tissue. Early diagnosis of gestational trophoblastic disease and its potential complications is important for timely and successful management of the condition with preservation of fertility. Initial diagnosis is based on a multimodality approach: encompassing clinical features, serial quantitative β-hCG titers, and pelvic ultrasonography. Pelvic magnetic resonance imaging (MRI is sometimes used as a problem-solving tool to assess the depth of myometrial invasion and extrauterine disease spread in equivocal and complicated cases. Chest radiography, body computed tomography (CT, and brain MRI have been recommended as investigative tools for overall disease staging. Angiography has a role in management of disease complications and metastases. Efficacy of PET (positron emission tomography and PET/CT in the evaluation of recurrent or metastatic disease has not been adequately investigated yet. This paper discusses the imaging features of gestational trophoblastic disease on various imaging modalities and the role of different imaging techniques in the diagnosis and management of this entity.

Molecular imaging II

International Nuclear Information System (INIS)

Semmler, Wolfhard; Schwaiger, Markus

2008-01-01

The aim of this textbook of molecular imaging is to provide an up to date review of this rapidly growing field and to discuss basic methodological aspects necessary for the interpretation of experimental and clinical results. Emphasis is placed on the interplay of imaging technology and probe development, since the physical properties of the imaging approach need to be closely linked with the biologic application of the probe (i.e. nanoparticles and microbubbles). Various chemical strategies are discussed and related to the biologic applications. Reporter-gene imaging is being addressed not only in experimental protocols, but also first clinical applications are discussed. Finally, strategies of imaging to characterize apoptosis and angiogenesis are described and discussed in the context of possible clinical translation. (orig.)

Molecular imaging in cardiovascular diseases

International Nuclear Information System (INIS)

Botnar, R.M.; Ebersberger, H.; Noerenberg, D.

2015-01-01

Cardiovascular diseases remain the leading cause of morbidity and mortality in industrialized and developing countries. In clinical practice, the in-vivo identification of atherosclerotic lesions, which can lead to complications such as heart attack or stroke, remains difficult. Imaging techniques provide the reference standard for the detection of clinically significant atherosclerotic changes in the coronary and carotid arteries. The assessment of the luminal narrowing is feasible, while the differentiation of stable and potentially unstable or vulnerable atherosclerotic plaques is currently not possible using non-invasive imaging. With high spatial resolution and high soft tissue contrast, magnetic resonance imaging (MRI) is a suitable method for the evaluation of the thin arterial wall. In clinical practice, native MRI of the vessel wall already allows the differentiation and characterization of components of atherosclerotic plaques in the carotid arteries and the aorta. Additional diagnostic information can be gained by the use of non-specific MRI contrast agents. With the development of targeted molecular probes, that highlight specific molecules or cells, pathological processes can be visualized at a molecular level with high spatial resolution. In this review article, the development of pathophysiological changes leading to the development of the arterial wall are introduced and discussed. Additionally, principles of contrast enhanced imaging with non-specific contrast agents and molecular probes will be discussed and latest developments in the field of molecular imaging of the vascular wall will be introduced.

New developments in multimodal clinical multiphoton tomography

Science.gov (United States)

König, Karsten

2011-03-01

80 years ago, the PhD student Maria Goeppert predicted in her thesis in Goettingen, Germany, two-photon effects. It took 30 years to prove her theory, and another three decades to realize the first two-photon microscope. With the beginning of this millennium, first clinical multiphoton tomographs started operation in research institutions, hospitals, and in the cosmetic industry. The multiphoton tomograph MPTflexTM with its miniaturized flexible scan head became the Prism-Award 2010 winner in the category Life Sciences. Multiphoton tomographs with its superior submicron spatial resolution can be upgraded to 5D imaging tools by adding spectral time-correlated single photon counting units. Furthermore, multimodal hybrid tomographs provide chemical fingerprinting and fast wide-field imaging. The world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph in spring 2010. In particular, nonfluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen have been imaged in patients with dermatological disorders. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution imaging tools such as ultrasound, optoacoustic, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer (malignant melanoma), optimization of treatment strategies (wound healing, dermatitis), and cosmetic research including long-term biosafety tests of ZnO sunscreen nanoparticles and the measurement of the stimulated biosynthesis of collagen by anti-ageing products.

Has molecular imaging delivered to drug development?

Science.gov (United States)

Murphy, Philip S.; Patel, Neel; McCarthy, Timothy J.

2017-10-01

Pharmaceutical research and development requires a systematic interrogation of a candidate molecule through clinical studies. To ensure resources are spent on only the most promising molecules, early clinical studies must understand fundamental attributes of the drug candidate, including exposure at the target site, target binding and pharmacological response in disease. Molecular imaging has the potential to quantitatively characterize these properties in small, efficient clinical studies. Specific benefits of molecular imaging in this setting (compared to blood and tissue sampling) include non-invasiveness and the ability to survey the whole body temporally. These methods have been adopted primarily for neuroscience drug development, catalysed by the inability to access the brain compartment by other means. If we believe molecular imaging is a technology platform able to underpin clinical drug development, why is it not adopted further to enable earlier decisions? This article considers current drug development needs, progress towards integration of molecular imaging into studies, current impediments and proposed models to broaden use and increase impact. This article is part of the themed issue 'Challenges for chemistry in molecular imaging'.

Multimodal MSI in Conjunction with Broad Coverage Spatially Resolved MS² Increases Confidence in Both Molecular Identification and Localization

Energy Technology Data Exchange (ETDEWEB)

Veličković, Dušan; Chu, Rosalie K.; Carrell, Alyssa A. [Biosciences; Thomas, Mathew; Paša-Tolić, Ljiljana; Weston, David J. [Biosciences; Anderton, Christopher R.

2017-12-18

One critical aspect of mass spectrometry imaging (MSI) is the need to confidently identify detected analytes. While orthogonal tandem MS (e.g., LC-MS²) experiments from sample extracts can assist in annotating ions, the spatial information about these molecules is lost. Accordingly, this could cause mislead conclusions, especially in cases where isobaric species exhibit different distributions within a sample. In this Technical Note, we employed a multimodal imaging approach, using matrix assisted laser desorption/ionization (MALDI)-MSI and liquid extraction surface analysis (LESA)-MS²I, to confidently annotate and One critical aspect of mass spectrometry imaging (MSI) is the need to confidently identify detected analytes. While orthogonal tandem MS (e.g., LC-MS2) experiments from sample extracts can assist in annotating ions, the spatial information about these molecules is lost. Accordingly, this could cause mislead conclusions, especially in cases where isobaric species exhibit different distributions within a sample. In this Technical Note, we employed a multimodal imaging approach, using matrix assisted laser desorption/ionization (MALDI)-MSI and liquid extraction surface analysis (LESA)-MS²I, to confidently annotate and localize a broad range of metabolites involved in a tripartite symbiosis system of moss, cyanobacteria, and fungus. We found that the combination of these two imaging modalities generated very congruent ion images, providing the link between highly accurate structural information onfered by LESA and high spatial resolution attainable by MALDI. These results demonstrate how this combined methodology could be very useful in differentiating metabolite routes in complex systems.

In-situ Multimodal Imaging and Spectroscopy of Mg Electrodeposition at Electrode-Electrolyte Interfaces

Science.gov (United States)

Wu, Yimin A.; Yin, Zuwei; Farmand, Maryam; Yu, Young-Sang; Shapiro, David A.; Liao, Hong-Gang; Liang, Wen-I.; Chu, Ying-Hao; Zheng, Haimei

2017-02-01

We report the study of Mg cathodic electrochemical deposition on Ti and Au electrode using a multimodal approach by examining the sample area in-situ using liquid cell transmission electron microscopy (TEM), scanning transmission X-ray microscopy (STXM) and X-ray absorption spectroscopy (XAS). Magnesium Aluminum Chloride Complex was synthesized and utilized as electrolyte, where non-reversible features during in situ charging-discharging cycles were observed. During charging, a uniform Mg film was deposited on the electrode, which is consistent with the intrinsic non-dendritic nature of Mg deposition in Mg ion batteries. The Mg thin film was not dissolvable during the following discharge process. We found that such Mg thin film is hexacoordinated Mg compounds by in-situ STXM and XAS. This study provides insights on the non-reversibility issue and failure mechanism of Mg ion batteries. Also, our method provides a novel generic method to understand the in situ battery chemistry without any further sample processing, which can preserve the original nature of battery materials or electrodeposited materials. This multimodal in situ imaging and spectroscopy provides many opportunities to attack complex problems that span orders of magnitude in length and time scale, which can be applied to a broad range of the energy storage systems.

Nanobody: The “Magic Bullet” for Molecular Imaging?

Science.gov (United States)

Chakravarty, Rubel; Goel, Shreya; Cai, Weibo

2014-01-01

Molecular imaging involves the non-invasive investigation of biological processes in vivo at the cellular and molecular level, which can play diverse roles in better understanding and treatment of various diseases. Recently, single domain antigen-binding fragments known as 'nanobodies' were bioengineered and tested for molecular imaging applications. Small molecular size (~15 kDa) and suitable configuration of the complementarity determining regions (CDRs) of nanobodies offer many desirable features suitable for imaging applications, such as rapid targeting and fast blood clearance, high solubility, high stability, easy cloning, modular nature, and the capability of binding to cavities and difficult-to-access antigens. Using nanobody-based probes, several imaging techniques such as radionuclide-based, optical and ultrasound have been employed for visualization of target expression in various disease models. This review summarizes the recent developments in the use of nanobody-based probes for molecular imaging applications. The preclinical data reported to date are quite promising, and it is expected that nanobody-based molecular imaging agents will play an important role in the diagnosis and management of various diseases. PMID:24578722

Multimodal breast cancer imaging using coregistered dynamic diffuse optical tomography and digital breast tomosynthesis

Science.gov (United States)

Zimmermann, Bernhard B.; Deng, Bin; Singh, Bhawana; Martino, Mark; Selb, Juliette; Fang, Qianqian; Sajjadi, Amir Y.; Cormier, Jayne; Moore, Richard H.; Kopans, Daniel B.; Boas, David A.; Saksena, Mansi A.; Carp, Stefan A.

2017-04-01

Diffuse optical tomography (DOT) is emerging as a noninvasive functional imaging method for breast cancer diagnosis and neoadjuvant chemotherapy monitoring. In particular, the multimodal approach of combining DOT with x-ray digital breast tomosynthesis (DBT) is especially synergistic as DBT prior information can be used to enhance the DOT reconstruction. DOT, in turn, provides a functional information overlay onto the mammographic images, increasing sensitivity and specificity to cancer pathology. We describe a dynamic DOT apparatus designed for tight integration with commercial DBT scanners and providing a fast (up to 1 Hz) image acquisition rate to enable tracking hemodynamic changes induced by the mammographic breast compression. The system integrates 96 continuous-wave and 24 frequency-domain source locations as well as 32 continuous wave and 20 frequency-domain detection locations into low-profile plastic plates that can easily mate to the DBT compression paddle and x-ray detector cover, respectively. We demonstrate system performance using static and dynamic tissue-like phantoms as well as in vivo images acquired from the pool of patients recalled for breast biopsies at the Massachusetts General Hospital Breast Imaging Division.

Cell-permeable Ln(III) chelate-functionalized InP quantum dots as multimodal imaging agents.

Science.gov (United States)

Stasiuk, Graeme J; Tamang, Sudarsan; Imbert, Daniel; Poillot, Cathy; Giardiello, Marco; Tisseyre, Céline; Barbier, Emmanuel L; Fries, Pascal Henry; de Waard, Michel; Reiss, Peter; Mazzanti, Marinella

2011-10-25

Quantum dots (QDs) are ideal scaffolds for the development of multimodal imaging agents, but their application in clinical diagnostics is limited by the toxicity of classical CdSe QDs. A new bimodal MRI/optical nanosized contrast agent with high gadolinium payload has been prepared through direct covalent attachment of up to 80 Gd(III) chelates on fluorescent nontoxic InP/ZnS QDs. It shows a high relaxivity of 900 mM(-1) s(-1) (13 mM(-1 )s(-1) per Gd ion) at 35 MHz (0.81 T) and 298 K, while the bright luminescence of the QDs is preserved. Eu(III) and Tb(III) chelates were also successfully grafted to the InP/ZnS QDs. The absence of energy transfer between the QD and lanthanide emitting centers results in a multicolor system. Using this convenient direct grafting strategy additional targeting ligands can be included on the QD. Here a cell-penetrating peptide has been co-grafted in a one-pot reaction to afford a cell-permeable multimodal multimeric MRI contrast agent that reports cellular localization by fluorescence and provides high relaxivity and increased tissue retention with respect to commercial contrast agents.

Meet interesting abbreviations in clinical mass spectrometry: from compound classification by REIMS to multimodal and mass spectrometry imaging (MSI)

Czech Academy of Sciences Publication Activity Database

Luptáková, Dominika; Pluháček, Tomáš; Palyzová, Andrea; Přichystal, Jakub; Balogh, J.; Lemr, Karel; Juránek, I.; Havlíček, Vladimír

2017-01-01

Roč. 61, č. 3 (2017), s. 353-360 ISSN 0001-723X R&D Projects: GA MŠk(CZ) LO1509; GA ČR(CZ) GA16-20229S Institutional support: RVO:61388971 Keywords : REIMS * multimodal * mass spectrometry imaging Subject RIV: EE - Microbiology, Virology OBOR OECD: Microbiology Impact factor: 0.673, year: 2016

Brain Abnormalities in Congenital Fibrosis of the Extraocular Muscles Type 1: A Multimodal MRI Imaging Study.

Science.gov (United States)

Miao, Wen; Man, Fengyuan; Wu, Shaoqin; Lv, Bin; Wang, Zhenchang; Xian, Junfang; Sabel, Bernhard A; He, Huiguang; Jiao, Yonghong

2015-01-01

To explore the possible brain structural and functional alterations in congenital fibrosis of extraocular muscles type 1 (CFEOM1) patients using multimodal MRI imaging. T1-weighted, diffusion tensor images and functional MRI data were obtained from 9 KIF21A positive patients and 19 age- and gender-matched healthy controls. Voxel based morphometry and tract based spatial statistics were applied to the T1-weighted and diffusion tensor images, respectively. Amplitude of low frequency fluctuations and regional homogeneity were used to process the functional MRI data. We then compared these multimodal characteristics between CFEOM1 patients and healthy controls. Compared with healthy controls, CFEOM1 patients demonstrated increased grey matter volume in bilateral frontal orbital cortex and in the right temporal pole. No diffusion indices changes were detected, indicating unaffected white matter microstructure. In addition, from resting state functional MRI data, trend of amplitude of low-frequency fluctuations increases were noted in the right inferior parietal lobe and in the right frontal cortex, and a trend of ReHo increase (pleft precentral gyrus, left orbital frontal cortex, temporal pole and cingulate gyrus. CFEOM1 patients had structural and functional changes in grey matter, but the white matter was unaffected. These alterations in the brain may be due to the abnormality of extraocular muscles and their innervating nerves. Future studies should consider the possible correlations between brain morphological/functional findings and clinical data, especially pertaining to eye movements, to obtain more precise answers about the role of brain area changes and their functional consequence in CFEOM1.

Brain Abnormalities in Congenital Fibrosis of the Extraocular Muscles Type 1: A Multimodal MRI Imaging Study

Science.gov (United States)

Wu, Shaoqin; Lv, Bin; Wang, Zhenchang; Xian, Junfang; Sabel, Bernhard A.; He, Huiguang; Jiao, Yonghong

2015-01-01

Purpose To explore the possible brain structural and functional alterations in congenital fibrosis of extraocular muscles type 1 (CFEOM1) patients using multimodal MRI imaging. Methods T1-weighted, diffusion tensor images and functional MRI data were obtained from 9 KIF21A positive patients and 19 age- and gender- matched healthy controls. Voxel based morphometry and tract based spatial statistics were applied to the T1-weighted and diffusion tensor images, respectively. Amplitude of low frequency fluctuations and regional homogeneity were used to process the functional MRI data. We then compared these multimodal characteristics between CFEOM1 patients and healthy controls. Results Compared with healthy controls, CFEOM1 patients demonstrated increased grey matter volume in bilateral frontal orbital cortex and in the right temporal pole. No diffusion indices changes were detected, indicating unaffected white matter microstructure. In addition, from resting state functional MRI data, trend of amplitude of low-frequency fluctuations increases were noted in the right inferior parietal lobe and in the right frontal cortex, and a trend of ReHo increase (pleft precentral gyrus, left orbital frontal cortex, temporal pole and cingulate gyrus. Conclusions CFEOM1 patients had structural and functional changes in grey matter, but the white matter was unaffected. These alterations in the brain may be due to the abnormality of extraocular muscles and their innervating nerves. Future studies should consider the possible correlations between brain morphological/functional findings and clinical data, especially pertaining to eye movements, to obtain more precise answers about the role of brain area changes and their functional consequence in CFEOM1. PMID:26186732

2017 multimodality appropriate use criteria for noninvasive cardiac imaging: Export consensus of the Asian society of cardiovascular imaging

Energy Technology Data Exchange (ETDEWEB)

Beck, Kyong Min Sarah [Dept. of Radiology, Seoul St. Mary' s Hospital, College of Medicine, The Catholic University of Korea, Seoul (Korea, Republic of); Kim, Jeong A [Dept. of Radiology, Ilsan Paik Hospital, Inje University College of Medicine, Goyang (Korea, Republic of); Choe, Yeon Hyeon [Dept. of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul (Korea, Republic of); and others

2017-11-15

In 2010, the Asian Society of Cardiovascular Imaging (ASCI) provided recommendations for cardiac CT and MRI, and this document reflects an update of the 2010 ASCI appropriate use criteria (AUC). In 2016, the ASCI formed a new working group for revision of AUC for noninvasive cardiac imaging. A major change that we made in this document is the rating of various noninvasive tests (exercise electrocardiogram, echocardiography, positron emission tomography, single-photon emission computed tomography, radionuclide imaging, cardiac magnetic resonance, and cardiac computed tomography/angiography), compared side by side for their applications in various clinical scenarios. Ninety-five clinical scenarios were developed from eight selected pre-existing guidelines and classified into four sections as follows: 1) detection of coronary artery disease, symptomatic or asymptomatic; 2) cardiac evaluation in various clinical scenarios; 3) use of imaging modality according to prior testing; and 4) evaluation of cardiac structure and function. The clinical scenarios were scored by a separate rating committee on a scale of 1–9 to designate appropriate use, uncertain use, or inappropriate use according to a modified Delphi method. Overall, the AUC ratings for CT were higher than those of previous guidelines. These new AUC provide guidance for clinicians choosing among available testing modalities for various cardiac diseases and are also unique, given that most previous AUC for noninvasive imaging include only one imaging technique. As cardiac imaging is multimodal in nature, we believe that these AUC will be more useful for clinical decision making.

Spectral embedding-based registration (SERg) for multimodal fusion of prostate histology and MRI

Science.gov (United States)

Hwuang, Eileen; Rusu, Mirabela; Karthigeyan, Sudha; Agner, Shannon C.; Sparks, Rachel; Shih, Natalie; Tomaszewski, John E.; Rosen, Mark; Feldman, Michael; Madabhushi, Anant

2014-03-01

Multi-modal image registration is needed to align medical images collected from different protocols or imaging sources, thereby allowing the mapping of complementary information between images. One challenge of multimodal image registration is that typical similarity measures rely on statistical correlations between image intensities to determine anatomical alignment. The use of alternate image representations could allow for mapping of intensities into a space or representation such that the multimodal images appear more similar, thus facilitating their co-registration. In this work, we present a spectral embedding based registration (SERg) method that uses non-linearly embedded representations obtained from independent components of statistical texture maps of the original images to facilitate multimodal image registration. Our methodology comprises the following main steps: 1) image-derived textural representation of the original images, 2) dimensionality reduction using independent component analysis (ICA), 3) spectral embedding to generate the alternate representations, and 4) image registration. The rationale behind our approach is that SERg yields embedded representations that can allow for very different looking images to appear more similar, thereby facilitating improved co-registration. Statistical texture features are derived from the image intensities and then reduced to a smaller set by using independent component analysis to remove redundant information. Spectral embedding generates a new representation by eigendecomposition from which only the most important eigenvectors are selected. This helps to accentuate areas of salience based on modality-invariant structural information and therefore better identifies corresponding regions in both the template and target images. The spirit behind SERg is that image registration driven by these areas of salience and correspondence should improve alignment accuracy. In this work, SERg is implemented using Demons

[Future perspectives for diagnostic imaging in urology: from anatomic and functional to molecular imaging].

Science.gov (United States)

Macis, Giuseppe; Di Giovanni, Silvia; Di Franco, Davide; Bonomo, Lorenzo

2013-01-01

The future approach of diagnostic imaging in urology follows the technological progress, which made the visualization of in vivo molecular processes possible. From anatomo-morphological diagnostic imaging and through functional imaging molecular radiology is reached. Based on molecular probes, imaging is aimed at assessing the in vivo molecular processes, their physiology and function at cellular level. The future imaging will investigate the complex tumor functioning as metabolism, aerobic glycolysis in particular, angiogenesis, cell proliferation, metastatic potential, hypoxia, apoptosis and receptors expressed by neoplastic cells. Methods for performing molecular radiology are CT, MRI, PET-CT, PET-MRI, SPECT and optical imaging. Molecular ultrasound combines technological advancement with targeted contrast media based on microbubbles, this allowing the selective registration of microbubble signal while that of stationary tissues is suppressed. An experimental study was carried out where the ultrasound molecular probe BR55 strictly bound to prostate tumor results in strong enhancement in the early phase after contrast, this contrast being maintained in the late phase. This late enhancement is markedly significant for the detection of prostatic cancer foci and to guide the biopsy sampling. The 124I-cG250 molecular antibody which is strictly linked to cellular carbonic anhydrase IX of clear cell renal carcinoma, allows the acquisition of diagnostic PET images of clear cell renal carcinoma without biopsy. This WG-250 (RENCAREX) antibody was used as a therapy in metastatic clear cell renal carcinoma. Future advancements and applications will result in early cancer diagnosis, personalized therapy that will be specific according to the molecular features of cancer and leading to the development of catheter-based multichannel molecular imaging devices for cystoscopy-based molecular imaging diagnosis and intervention.

Development of comprehensive image processing technique for differential diagnosis of liver disease by using multi-modality images. Pixel-based cross-correlation method using a profile

International Nuclear Information System (INIS)

Inoue, Akira; Okura, Yasuhiko; Akiyama, Mitoshi; Ishida, Takayuki; Kawashita, Ikuo; Ito, Katsuyoshi; Matsunaga, Naofumi; Sanada, Taizo

2009-01-01

Imaging techniques such as high magnetic field imaging and multidetector-row CT have been markedly improved recently. The final image-reading systems easily produce more than a thousand diagnostic images per patient. Therefore, we developed a comprehensive cross-correlation processing technique using multi-modality images, in order to decrease the considerable time and effort involved in the interpretation of a radiogram (multi-formatted display and/or stack display method, etc). In this scheme, the criteria of an attending radiologist for the differential diagnosis of liver cyst, hemangioma of liver, hepatocellular carcinoma, and metastatic liver cancer on magnetic resonance images with various sequences and CT images with and without contrast enhancement employ a cross-correlation coefficient. Using a one-dimensional cross-correlation method, comprehensive image processing could be also adapted for various artifacts (some depending on modality imaging, and some on patients), which may be encountered at the clinical scene. This comprehensive image-processing technique could assist radiologists in the differential diagnosis of liver diseases. (author)

Imaging unstable plaque

International Nuclear Information System (INIS)

SRIRANJAN, Rouchelle S.; TARKIN, Jason M.; RUDD, James H.; EVANS, Nicholas R.; CHOWDHURY, Mohammed M.

2016-01-01

Recent advances in imaging technology have enabled us to utilise a range of diagnostic approaches to better characterise high-risk atherosclerotic plaque. The aim of this article is to review current and emerging techniques used to detect and quantify unstable plaque in the context of large and small arterial systems and will focus on both invasive and non-invasive imaging techniques. While the diagnosis of clinically relevant atherosclerosis still relies heavily on anatomical assessment of arterial luminal stenosis, evolving multimodal cross-sectional imaging techniques that encompass novel molecular probes can provide added information with regard to plaque composition and overall disease burden. Novel molecular probes currently being developed to track precursors of plaque rupture such as inflammation, micro-calcification, hypoxia and neoangiogenesis are likely to have translational applications beyond diagnostics and have the potential to play a part in quantifying early responses to therapeutic interventions and more accurate cardiovascular risk stratification.

Gastric Adenocarcinoma: A Multimodal Approach

Directory of Open Access Journals (Sweden)

Humair S. Quadri

2017-08-01

Full Text Available Despite its declining incidence, gastric cancer (GC remains a leading cause of cancer-related deaths worldwide. A multimodal approach to GC is critical to ensure optimal patient outcomes. Pretherapy fine resolution contrast-enhanced cross-sectional imaging, endoscopic ultrasound and staging laparoscopy play an important role in patients with newly diagnosed ostensibly operable GC to avoid unnecessary non-therapeutic laparotomies. Currently, margin negative gastrectomy and adequate lymphadenectomy performed at high volume hospitals remain the backbone of GC treatment. Importantly, adequate GC surgery should be integrated in the setting of a multimodal treatment approach. Treatment for advanced GC continues to expand with the emergence of additional lines of systemic and targeted therapies.

A review of molecular imaging studies reaching the clinical stage

International Nuclear Information System (INIS)

Wong, Franklin C.; Kim, E. Edmund

2009-01-01

The practice of molecular imaging in the clinics is examined across various imaging modalities to assess the current status of clinical molecular imaging. The various physiologic and scientific bases of clinical molecular imaging are surveyed to assess the possibilities and opportunities for the deployment of the different imaging modalities in the near future. The requisites for successful candidate(s) of clinical molecular imaging are reviewed for future development.

Multimodal Hyper-connectivity Networks for MCI Classification.

Science.gov (United States)

Li, Yang; Gao, Xinqiang; Jie, Biao; Yap, Pew-Thian; Kim, Min-Jeong; Wee, Chong-Yaw; Shen, Dinggang

2017-09-01

Hyper-connectivity network is a network where every edge is connected to more than two nodes, and can be naturally denoted using a hyper-graph. Hyper-connectivity brain network, either based on structural or functional interactions among the brain regions, has been used for brain disease diagnosis. However, the conventional hyper-connectivity network is constructed solely based on single modality data, ignoring potential complementary information conveyed by other modalities. The integration of complementary information from multiple modalities has been shown to provide a more comprehensive representation about the brain disruptions. In this paper, a novel multimodal hyper-network modelling method was proposed for improving the diagnostic accuracy of mild cognitive impairment (MCI). Specifically, we first constructed a multimodal hyper-connectivity network by simultaneously considering information from diffusion tensor imaging and resting-state functional magnetic resonance imaging data. We then extracted different types of network features from the hyper-connectivity network, and further exploited a manifold regularized multi-task feature selection method to jointly select the most discriminative features. Our proposed multimodal hyper-connectivity network demonstrated a better MCI classification performance than the conventional single modality based hyper-connectivity networks.

Molecular Imaging Probe Development using Microfluidics

Science.gov (United States)

Liu, Kan; Wang, Ming-Wei; Lin, Wei-Yu; Phung, Duy Linh; Girgis, Mark D.; Wu, Anna M.; Tomlinson, James S.; Shen, Clifton K.-F.

2012-01-01

In this manuscript, we review the latest advancement of microfluidics in molecular imaging probe development. Due to increasing needs for medical imaging, high demand for many types of molecular imaging probes will have to be met by exploiting novel chemistry/radiochemistry and engineering technologies to improve the production and development of suitable probes. The microfluidic-based probe synthesis is currently attracting a great deal of interest because of their potential to deliver many advantages over conventional systems. Numerous chemical reactions have been successfully performed in micro-reactors and the results convincingly demonstrate with great benefits to aid synthetic procedures, such as purer products, higher yields, shorter reaction times compared to the corresponding batch/macroscale reactions, and more benign reaction conditions. Several ‘proof-of-principle’ examples of molecular imaging probe syntheses using microfluidics, along with basics of device architecture and operation, and their potential limitations are discussed here. PMID:22977436

Translational research of optical molecular imaging for personalized medicine.

Science.gov (United States)

Qin, C; Ma, X; Tian, J

2013-12-01

In the medical imaging field, molecular imaging is a rapidly developing discipline and forms many imaging modalities, providing us effective tools to visualize, characterize, and measure molecular and cellular mechanisms in complex biological processes of living organisms, which can deepen our understanding of biology and accelerate preclinical research including cancer study and medicine discovery. Among many molecular imaging modalities, although the penetration depth of optical imaging and the approved optical probes used for clinics are limited, it has evolved considerably and has seen spectacular advances in basic biomedical research and new drug development. With the completion of human genome sequencing and the emergence of personalized medicine, the specific drug should be matched to not only the right disease but also to the right person, and optical molecular imaging should serve as a strong adjunct to develop personalized medicine by finding the optimal drug based on an individual's proteome and genome. In this process, the computational methodology and imaging system as well as the biomedical application regarding optical molecular imaging will play a crucial role. This review will focus on recent typical translational studies of optical molecular imaging for personalized medicine followed by a concise introduction. Finally, the current challenges and the future development of optical molecular imaging are given according to the understanding of the authors, and the review is then concluded.

Multimodality Cardiac Imaging for the Assessment of Left Atrial Function and the Association With Atrial Arrhythmias

DEFF Research Database (Denmark)

Olsen, Flemming Javier; Bertelsen, Litten; de Knegt, Martina Chantal

2016-01-01

Several cardiac imaging modalities are able to visualize the left atrium (LA) and, therefore, allow for quantification of both structural and functional properties of this cardiac chamber. In echocardiography, only the maximal LA volume is included in the assessment of diastolic function at the c......Several cardiac imaging modalities are able to visualize the left atrium (LA) and, therefore, allow for quantification of both structural and functional properties of this cardiac chamber. In echocardiography, only the maximal LA volume is included in the assessment of diastolic function...... atrial fibrillation, which will be a point of focus in this review. Pivotal cardiac magnetic resonance imaging studies have revealed high correlation between LA fibrosis and risk of atrial fibrillation recurrence after catheter ablation, and subsequent multimodality imaging studies have uncovered...... an inverse relationship between LA reservoir function and degree of LA fibrosis. This has sparked an increased interest into the application of advanced imaging modalities, including both speckle tracking echocardiography and tissue tracking by cardiac magnetic resonance imaging. Even though increasing...

Computer-based image analysis in radiological diagnostics and image-guided therapy: 3D-Reconstruction, contrast medium dynamics, surface analysis, radiation therapy and multi-modal image fusion

International Nuclear Information System (INIS)

Beier, J.

2001-01-01

This book deals with substantial subjects of postprocessing and analysis of radiological image data, a particular emphasis was put on pulmonary themes. For a multitude of purposes the developed methods and procedures can directly be transferred to other non-pulmonary applications. The work presented here is structured in 14 chapters, each describing a selected complex of research. The chapter order reflects the sequence of the processing steps starting from artefact reduction, segmentation, visualization, analysis, therapy planning and image fusion up to multimedia archiving. In particular, this includes virtual endoscopy with three different scene viewers (Chap. 6), visualizations of the lung disease bronchiectasis (Chap. 7), surface structure analysis of pulmonary tumors (Chap. 8), quantification of contrast medium dynamics from temporal 2D and 3D image sequences (Chap. 9) as well as multimodality image fusion of arbitrary tomographical data using several visualization techniques (Chap. 12). Thus, the software systems presented cover the majority of image processing applications necessary in radiology and were entirely developed, implemented and validated in the clinical routine of a university medical school. (orig.) [de

Nanomaterials and MRI molecular probe

International Nuclear Information System (INIS)

Inubushi, Toshiro

2008-01-01

This paper presents the current state and future prospect of enhancing probes in MRI which enable to image specific cells and molecules mainly from the aspect of cell trafficking. Although MRI requires such probes for specific imaging, it has an advantage that anatomical images are simultaneously available even during surgical operation without radiation exposure, differing from X-CT, -transillumination and positron emission tomography (PET). In the development of novel MRI molecular probes, the recent topic concerns the cell trafficking biology where cells related with transplantation and immunological therapy can be traced. Although superparamagnetic iron oxide (SPIO) has been used as a commercially available enhancer, this nanoparticle has problems like a difficulty to penetrate cell, cytotoxicity and others. For these, authors have developed the nanoparticle SPIO covered with silica shell, which can be chemically modified, e.g., by binding fluorescent pigments to possibly allow MR bimodal molecular imaging. For penetration of particles in cells, envelop of Sendai virus is used. PET-CT has been more popular these days; however, MRI is superior to CT for imaging soft tissues, and development of PET-MRI is actively under progress aiming the multi-modal imaging. At present, molecular probes for MRI are certainly not so many as those for PET and cooperative efforts to develop the probes are required in medical, technological and pharmaceutical fields. (R.T.)

IMAGING WITH MULTIMODAL ADAPTIVE-OPTICS OPTICAL COHERENCE TOMOGRAPHY IN MULTIPLE EVANESCENT WHITE DOT SYNDROME: THE STRUCTURE AND FUNCTIONAL RELATIONSHIP.

Science.gov (United States)

Labriola, Leanne T; Legarreta, Andrew D; Legarreta, John E; Nadler, Zach; Gallagher, Denise; Hammer, Daniel X; Ferguson, R Daniel; Iftimia, Nicusor; Wollstein, Gadi; Schuman, Joel S

2016-01-01

To elucidate the location of pathological changes in multiple evanescent white dot syndrome (MEWDS) with the use of multimodal adaptive optics (AO) imaging. A 5-year observational case study of a 24-year-old female with recurrent MEWDS. Full examination included history, Snellen chart visual acuity, pupil assessment, intraocular pressures, slit lamp evaluation, dilated fundoscopic exam, imaging with Fourier-domain optical coherence tomography (FD-OCT), blue-light fundus autofluorescence (FAF), fundus photography, fluorescein angiography, and adaptive-optics optical coherence tomography. Three distinct acute episodes of MEWDS occurred during the period of follow-up. Fourier-domain optical coherence tomography and adaptive-optics imaging showed disturbance in the photoreceptor outer segments (PR OS) in the posterior pole with each flare. The degree of disturbance at the photoreceptor level corresponded to size and extent of the visual field changes. All findings were transient with delineation of the photoreceptor recovery from the outer edges of the lesion inward. Hyperautofluorescence was seen during acute flares. Increase in choroidal thickness did occur with each active flare but resolved. Although changes in the choroid and RPE can be observed in MEWDS, Fourier-domain optical coherence tomography, and multimodal adaptive optics imaging localized the visually significant changes seen in this disease at the level of the photoreceptors. These transient retinal changes specifically occur at the level of the inner segment ellipsoid and OS/RPE line. En face optical coherence tomography imaging provides a detailed, yet noninvasive method for following the convalescence of MEWDS and provides insight into the structural and functional relationship of this transient inflammatory retinal disease.

Multimodal nonlinear imaging of atherosclerotic plaques differentiation of triglyceride and cholesterol deposits

Directory of Open Access Journals (Sweden)

Christian Matthäus

2014-09-01

Full Text Available Cardiovascular diseases in general and atherothrombosis as the most common of its individual disease entities is the leading cause of death in the developed countries. Therefore, visualization and characterization of inner arterial plaque composition is of vital diagnostic interest, especially for the early recognition of vulnerable plaques. Established clinical techniques provide valuable morphological information but cannot deliver information about the chemical composition of individual plaques. Therefore, spectroscopic imaging techniques have recently drawn considerable attention. Based on the spectroscopic properties of the individual plaque components, as for instance different types of lipids, the composition of atherosclerotic plaques can be analyzed qualitatively as well as quantitatively. Here, we compare the feasibility of multimodal nonlinear imaging combining two-photon fluorescence (TPF, coherent anti-Stokes Raman scattering (CARS and second-harmonic generation (SHG microscopy to contrast composition and morphology of lipid deposits against the surrounding matrix of connective tissue with diffraction limited spatial resolution. In this contribution, the spatial distribution of major constituents of the arterial wall and atherosclerotic plaques like elastin, collagen, triglycerides and cholesterol can be simultaneously visualized by a combination of nonlinear imaging methods, providing a powerful label-free complement to standard histopathological methods with great potential for in vivo application.

[Molecular imaging; current status and future prospects in USA].

Science.gov (United States)

Kobayashi, Hisataka

2007-02-01

The goal of this review is to introduce the definition, current status, and future prospects of the molecular imaging, which has recently been a hot topic in medicine and the biological science in USA. In vivo imaging methods to visualize the molecular events and functions in organs or animals/humans are overviewed and discussed especially in combinations of imaging modalities (machines) and contrast agents(chemicals) used in the molecular imaging. Next, the close relationship between the molecular imaging and the nanotechnology, an important part of nanomedicine, is stressed from the aspect of united multidisciplinary sciences such as physics, chemistry, biology, and medicine.

Multimodal microscopy and the stepwise multi-photon activation fluorescence of melanin

Science.gov (United States)

Lai, Zhenhua

The author's work is divided into three aspects: multimodal microscopy, stepwise multi-photon activation fluorescence (SMPAF) of melanin, and customized-profile lenses (CPL) for on-axis laser scanners, which will be introduced respectively. A multimodal microscope provides the ability to image samples with multiple modalities on the same stage, which incorporates the benefits of all modalities. The multimodal microscopes developed in this dissertation are the Keck 3D fusion multimodal microscope 2.0 (3DFM 2.0), upgraded from the old 3DFM with improved performance and flexibility, and the multimodal microscope for targeting small particles (the "Target" system). The control systems developed for both microscopes are low-cost and easy-to-build, with all components off-the-shelf. The control system have not only significantly decreased the complexity and size of the microscope, but also increased the pixel resolution and flexibility. The SMPAF of melanin, activated by a continuous-wave (CW) mode near-infrared (NIR) laser, has potential applications for a low-cost and reliable method of detecting melanin. The photophysics of melanin SMPAF has been studied by theoretical analysis of the excitation process and investigation of the spectra, activation threshold, and photon number absorption of melanin SMPAF. SMPAF images of melanin in mouse hair and skin, mouse melanoma, and human black and white hairs are compared with images taken by conventional multi-photon fluorescence microscopy (MPFM) and confocal reflectance microscopy (CRM). SMPAF images significantly increase specificity and demonstrate the potential to increase sensitivity for melanin detection compared to MPFM images and CRM images. Employing melanin SMPAF imaging to detect melanin inside human skin in vivo has been demonstrated, which proves the effectiveness of melanin detection using SMPAF for medical purposes. Selective melanin ablation with micrometer resolution has been presented using the Target system

In vivo molecular and genomic imaging: new challenges for imaging physics.

Science.gov (United States)

Cherry, Simon R

2004-02-07

The emerging and rapidly growing field of molecular and genomic imaging is providing new opportunities to directly visualize the biology of living organisms. By combining our growing knowledge regarding the role of specific genes and proteins in human health and disease, with novel ways to target these entities in a manner that produces an externally detectable signal, it is becoming increasingly possible to visualize and quantify specific biological processes in a non-invasive manner. All the major imaging modalities are contributing to this new field, each with its unique mechanisms for generating contrast and trade-offs in spatial resolution, temporal resolution and sensitivity with respect to the biological process of interest. Much of the development in molecular imaging is currently being carried out in animal models of disease, but as the field matures and with the development of more individualized medicine and the molecular targeting of new therapeutics, clinical translation is inevitable and will likely forever change our approach to diagnostic imaging. This review provides an introduction to the field of molecular imaging for readers who are not experts in the biological sciences and discusses the opportunities to apply a broad range of imaging technologies to better understand the biology of human health and disease. It also provides a brief review of the imaging technology (particularly for x-ray, nuclear and optical imaging) that is being developed to support this new field.

In vivo molecular and genomic imaging: new challenges for imaging physics

Energy Technology Data Exchange (ETDEWEB)

Cherry, Simon R [Department of Biomedical Engineering, University of California, Davis, CA (United States)

2004-02-07

The emerging and rapidly growing field of molecular and genomic imaging is providing new opportunities to directly visualize the biology of living organisms. By combining our growing knowledge regarding the role of specific genes and proteins in human health and disease, with novel ways to target these entities in a manner that produces an externally detectable signal, it is becoming increasingly possible to visualize and quantify specific biological processes in a non-invasive manner. All the major imaging modalities are contributing to this new field, each with its unique mechanisms for generating contrast and trade-offs in spatial resolution, temporal resolution and sensitivity with respect to the biological process of interest. Much of the development in molecular imaging is currently being carried out in animal models of disease, but as the field matures and with the development of more individualized medicine and the molecular targeting of new therapeutics, clinical translation is inevitable and will likely forever change our approach to diagnostic imaging. This review provides an introduction to the field of molecular imaging for readers who are not experts in the biological sciences and discusses the opportunities to apply a broad range of imaging technologies to better understand the biology of human health and disease. It also provides a brief review of the imaging technology (particularly for x-ray, nuclear and optical imaging) that is being developed to support this new field. (topical review)

In vivo molecular and genomic imaging: new challenges for imaging physics

International Nuclear Information System (INIS)

Cherry, Simon R

2004-01-01

The emerging and rapidly growing field of molecular and genomic imaging is providing new opportunities to directly visualize the biology of living organisms. By combining our growing knowledge regarding the role of specific genes and proteins in human health and disease, with novel ways to target these entities in a manner that produces an externally detectable signal, it is becoming increasingly possible to visualize and quantify specific biological processes in a non-invasive manner. All the major imaging modalities are contributing to this new field, each with its unique mechanisms for generating contrast and trade-offs in spatial resolution, temporal resolution and sensitivity with respect to the biological process of interest. Much of the development in molecular imaging is currently being carried out in animal models of disease, but as the field matures and with the development of more individualized medicine and the molecular targeting of new therapeutics, clinical translation is inevitable and will likely forever change our approach to diagnostic imaging. This review provides an introduction to the field of molecular imaging for readers who are not experts in the biological sciences and discusses the opportunities to apply a broad range of imaging technologies to better understand the biology of human health and disease. It also provides a brief review of the imaging technology (particularly for x-ray, nuclear and optical imaging) that is being developed to support this new field. (topical review)

A magnetic nanoparticle stabilized gas containing emulsion for multimodal imaging and triggered drug release.

Science.gov (United States)

Guo, Wei; Li, Diancheng; Zhu, Jia-an; Wei, Xiaohui; Men, Weiwei; Yin, Dazhi; Fan, Mingxia; Xu, Yuhong

2014-06-01

To develop a multimodal imaging guided and triggered drug delivery system based on a novel emulsion formulation composed of iron oxide nanoparticles, nanoscopic bubbles, and oil containing drugs. Iron oxide paramagnetic nanoparticles were synthesized and modified with surface conjugation of polyethylenimide (PEI) or Bovine Serum Albumin (BSA). Both particles were used to disperse and stabilize oil in water emulsions containing coumarin-6 as the model drug. Sulfur hexafluoride was introduced into the oil phase to form nanoscopic bubbles inside the emulsions. The resulted gas containing emulsions were evaluated for their magnetic resonance (MR) and ultrasound (US) imaging properties. The drug release profile triggered by ultrasound was also examined. We have successfully prepared the highly integrated multi-component emulsion system using the surface modified iron oxide nanoparticles to stabilize the interfaces. The resulted structure had distinctive MR and US imaging properties. Upon application of ultrasound waves, the gas containing emulsion would burst and encapsulated drug could be released. The integrated emulsion formulation was multifunctional with paramagnetic, sono-responsive and drug-carrying characteristics, which may have potential applications for disease diagnosis and imaging guided drug release.

Cancer Stratification by Molecular Imaging

Directory of Open Access Journals (Sweden)

Justus Weber

2015-03-01

Full Text Available The lack of specificity of traditional cytotoxic drugs has triggered the development of anticancer agents that selectively address specific molecular targets. An intrinsic property of these specialized drugs is their limited applicability for specific patient subgroups. Consequently, the generation of information about tumor characteristics is the key to exploit the potential of these drugs. Currently, cancer stratification relies on three approaches: Gene expression analysis and cancer proteomics, immunohistochemistry and molecular imaging. In order to enable the precise localization of functionally expressed targets, molecular imaging combines highly selective biomarkers and intense signal sources. Thus, cancer stratification and localization are performed simultaneously. Many cancer types are characterized by altered receptor expression, such as somatostatin receptors, folate receptors or Her2 (human epidermal growth factor receptor 2. Similar correlations are also known for a multitude of transporters, such as glucose transporters, amino acid transporters or hNIS (human sodium iodide symporter, as well as cell specific proteins, such as the prostate specific membrane antigen, integrins, and CD20. This review provides a comprehensive description of the methods, targets and agents used in molecular imaging, to outline their application for cancer stratification. Emphasis is placed on radiotracers which are used to identify altered expression patterns of cancer associated markers.

Interactivity in Educational Apps for Young children: A Multimodal Analysis

Directory of Open Access Journals (Sweden)

Alexandra H. Blitz-Raith

2017-11-01

Full Text Available Interactivity is an important indicator of an educational app's reception. Since most educational apps are multimodal, it justifies a methodological initiative to understand meaningful involvement of multimodality in enacting and even amplifying interactivity in an educational app. Yet research so far has largely concentrated on algorithm construct and user feedback rather than on multimodal interactions, especially from a social semiotics perspective. Drawing from social semiotics approaches, this article proposes a multimodal analytic framework to examine three layers of mode in engendering interaction; namely, multiplicity, function, and relationship. Using the analytic framework in an analysis of The Farm Adventure for Kids, a popular educational app for pre-school children, we found that still images are dominant proportionally and are central in the interactive process. We also found that tapping still images of animals on screen is the main action, with other screen actions deliberately excluded. Such findings suggest that aligning children’s cognitive and physical capabilities to the use of mode become the primary consideration in educational app design and that consistent attendance to this alignment in mobilizing modes significantly affect an educational app’s interactivity, and consequently its reception by young children

Molecular imaging by cardiovascular MR.

Science.gov (United States)

Cyrus, Tillmann; Lanza, Gregory M; Wickline, Samuel A

2007-01-01

Do molecularly-targeted contrast agents have what it takes to usher in a paradigm shift as to how we will image cardiovascular disease in the near future? Moreover, are non-invasive vulnerable plaque detection and preemptive treatments with these novel nanoparticulate agents within reach for clinical applications? In this article, we attempt to make a compelling case for how the advent of molecularly-targeted nanoparticle technology may change the way we detect atherosclerotic lesions, determine their clinical significance and even provide non-invasive treatments. Focusing on imaging with cardiovascular MR, an overview of the latest developments in this rapidly evolving field of so-called "intelligent" contrast agents that are able to interrogate the vascular wall and various complementary advanced imaging technologies are presented.

Brain Abnormalities in Congenital Fibrosis of the Extraocular Muscles Type 1: A Multimodal MRI Imaging Study.

Directory of Open Access Journals (Sweden)

Wen Miao

Full Text Available To explore the possible brain structural and functional alterations in congenital fibrosis of extraocular muscles type 1 (CFEOM1 patients using multimodal MRI imaging.T1-weighted, diffusion tensor images and functional MRI data were obtained from 9 KIF21A positive patients and 19 age- and gender-matched healthy controls. Voxel based morphometry and tract based spatial statistics were applied to the T1-weighted and diffusion tensor images, respectively. Amplitude of low frequency fluctuations and regional homogeneity were used to process the functional MRI data. We then compared these multimodal characteristics between CFEOM1 patients and healthy controls.Compared with healthy controls, CFEOM1 patients demonstrated increased grey matter volume in bilateral frontal orbital cortex and in the right temporal pole. No diffusion indices changes were detected, indicating unaffected white matter microstructure. In addition, from resting state functional MRI data, trend of amplitude of low-frequency fluctuations increases were noted in the right inferior parietal lobe and in the right frontal cortex, and a trend of ReHo increase (p<0.001 uncorrected in the left precentral gyrus, left orbital frontal cortex, temporal pole and cingulate gyrus.CFEOM1 patients had structural and functional changes in grey matter, but the white matter was unaffected. These alterations in the brain may be due to the abnormality of extraocular muscles and their innervating nerves. Future studies should consider the possible correlations between brain morphological/functional findings and clinical data, especially pertaining to eye movements, to obtain more precise answers about the role of brain area changes and their functional consequence in CFEOM1.

Molecular Imaging and Precision Medicine in Prostate Cancer.

Science.gov (United States)

Ceci, Francesco; Fiorentino, Michelangelo; Castellucci, Paolo; Fanti, Stefano

2017-01-01

The aim of the present review is to discuss about the role of new probes for molecular imaging in the evaluation of prostate cancer (PCa). This review focuses particularly on the role of new promising radiotracers for the molecular imaging with PET/computed tomography in the detection of PCa recurrence. The role of these new imaging techniques to guide lesion-target therapies and the potential application of these molecular probes as theranostics agents is discussed. Finally, the molecular mechanisms underlying resistance to castration in PCa and the maintenance of active androgen receptor are discussed. Copyright © 2016 Elsevier Inc. All rights reserved.

Linking variability in brain chemistry and circuit function through multimodal human neuroimaging

DEFF Research Database (Denmark)

Fisher, Patrick M; Hariri, A R

2012-01-01

and dopamine system and its effects on threat- and reward-related brain function, we review evidence for how such a multimodal neuroimaging strategy can be successfully implemented. Furthermore, we discuss how multimodal PET-fMRI can be integrated with techniques such as imaging genetics, pharmacological......Identifying neurobiological mechanisms mediating the emergence of individual differences in behavior is critical for advancing our understanding of relative risk for psychopathology. Neuroreceptor positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) can be used...

Mn-doped near-infrared quantum dots as multimodal targeted probes for pancreatic cancer imaging

Science.gov (United States)

Yong, Ken-Tye

2009-01-01

This work presents a novel approach to producing manganese (Mn)-doped quantum dots (Mnd-QDs) emitting in the near-infrared (NIR). Surface functionalization of Mnd-QDs with lysine makes them stably disperse in aqueous media and able to conjugate with targeting molecules. The nanoparticles were structurally and compositionally characterized and maintained a high photoluminescence quantum yield and displayed paramagnetism in water. The receptor-mediated delivery of bioconjugated Mnd-QDs into pancreatic cancer cells was demonstrated using the confocal microscopy technique. Cytotoxicity of Mnd-QDs on live cells has been evaluated. The NIR-emitting characteristic of the QDs has been exploited to acquire whole animal body imaging with high contrast signals. In addition, histological and blood analysis of mice have revealed that no long-term toxic effects arise from MnD-QDs. These studies suggest multimodal Mnd-QDs have the potentials as probes for early pancreatic cancer imaging and detection.

Multi-target molecular imaging and its progress in research and application

International Nuclear Information System (INIS)

Tang Ganghua

2011-01-01

Multi-target molecular imaging (MMI) is an important field of research in molecular imaging. It includes multi-tracer multi-target molecular imaging(MTMI), fusion-molecule multi-target imaging (FMMI), coupling-molecule multi-target imaging (CMMI), and multi-target multifunctional molecular imaging(MMMI). In this paper,imaging modes of MMI are reviewed, and potential applications of positron emission tomography MMI in near future are discussed. (author)

Tractography-Based Score for Learning Effective Connectivity From Multimodal Imaging Data Using Dynamic Bayesian Networks.

Science.gov (United States)

Dang, Shilpa; Chaudhury, Santanu; Lall, Brejesh; Roy, Prasun K

2018-05-01

Effective connectivity (EC) is the methodology for determining functional-integration among the functionally active segregated regions of the brain. By definition EC is "the causal influence exerted by one neuronal group on another" which is constrained by anatomical connectivity (AC) (axonal connections). AC is necessary for EC but does not fully determine it, because synaptic communication occurs dynamically in a context-dependent fashion. Although there is a vast emerging evidence of structure-function relationship using multimodal imaging studies, till date only a few studies have done joint modeling of the two modalities: functional MRI (fMRI) and diffusion tensor imaging (DTI). We aim to propose a unified probabilistic framework that combines information from both sources to learn EC using dynamic Bayesian networks (DBNs). DBNs are probabilistic graphical temporal models that learn EC in an exploratory fashion. Specifically, we propose a novel anatomically informed (AI) score that evaluates fitness of a given connectivity structure to both DTI and fMRI data simultaneously. The AI score is employed in structure learning of DBN given the data. Experiments with synthetic-data demonstrate the face validity of structure learning with our AI score over anatomically uninformed counterpart. Moreover, real-data results are cross-validated by performing classification-experiments. EC inferred on real fMRI-DTI datasets is found to be consistent with previous literature and show promising results in light of the AC present as compared to other classically used techniques such as Granger-causality. Multimodal analyses provide a more reliable basis for differentiating brain under abnormal/diseased conditions than the single modality analysis.

Performance study of a fan beam collimator designed for a multi-modality small animal imaging device

International Nuclear Information System (INIS)

Sabbir Ahmed, ASM; Kramer, Gary H.; Semmler, Wolfrad; Peter, Jorg

2011-01-01

This paper describes the methodology to design and conduct the performances of a fan beam collimator. This fan beam collimator was designed to use with a multi-modality small animal imaging device and the performance of the collimator was studied for a 3D geometry. Analytical expressions were formulated to calculate the parameters for the collimator. A Monte Carlo model was developed to analyze the scattering and image noises for a 3D object. The results showed that the performance of the fan beam collimator was strongly dependent on the source distribution and position. The fan beam collimator showed increased counting efficiency in comparison to a parallel hole collimator. Inside attenuating medium, the increased attenuating effect outweighed the fan beam increased counting efficiency.

Multimodal ophthalmic imaging using handheld spectrally encoded coherence tomography and reflectometry (SECTR)

Science.gov (United States)

Leeburg, Kelsey C.; El-Haddad, Mohamed T.; Malone, Joseph D.; Terrones, Benjamin D.; Tao, Yuankai K.

2018-02-01

Scanning laser ophthalmoscopy (SLO) provides high-speed, noninvasive en face imaging of the retinal fundus. Optical coherence tomography (OCT) is the current "gold-standard" for ophthalmic diagnostic imaging and enables depth-resolved visualization of ophthalmic structures and image-based surrogate biomarkers of disease. We present a compact optical and mechanical design for handheld spectrally encoded coherence tomography and reflectometry (SECTR) for multimodality en face spectrally encoded reflectometry (SER) and cross-sectional OCT imaging. We custom-designed a double-pass telecentric scan lens, which halves the size of 4-f optical relays and allowed us to reduce the footprint of our SECTR scan-head by a factor of >2.7x (volume) over our previous design. The double-pass scan lens was optimized for diffraction-limited performance over a +/-10° scan field. SECTR optics and optomechanics were combined in a compact rapid-prototyped enclosure with dimensions 87 x 141.8 x 137 mm (w x h x d). SECTR was implemented using a custom-built 400 kHz 1050 nm swept-source. OCT and SER were simultaneously digitized on dual input channels of a 4 GS/s digitizer at 1.4 GS/s per channel. In vivo human en face SER and cross-sectional OCT images were acquired at 350 fps. OCT volumes of 1000 B-scans were acquired in 2.86 s. We believe clinical translation of our compact handheld design will benefit point-of-care ophthalmic diagnostics in patients who are unable to be imaged on conventional slit-lamp based systems, such as infants and the bedridden. When combined with multi-volumetric registration methods, handheld SECTR will have advantages in motion-artifact free imaging over existing handheld technologies.

Prostate multimodality image registration based on B-splines and quadrature local energy.

Science.gov (United States)

Mitra, Jhimli; Martí, Robert; Oliver, Arnau; Lladó, Xavier; Ghose, Soumya; Vilanova, Joan C; Meriaudeau, Fabrice

2012-05-01

Needle biopsy of the prostate is guided by Transrectal Ultrasound (TRUS) imaging. The TRUS images do not provide proper spatial localization of malignant tissues due to the poor sensitivity of TRUS to visualize early malignancy. Magnetic Resonance Imaging (MRI) has been shown to be sensitive for the detection of early stage malignancy, and therefore, a novel 2D deformable registration method that overlays pre-biopsy MRI onto TRUS images has been proposed. The registration method involves B-spline deformations with Normalized Mutual Information (NMI) as the similarity measure computed from the texture images obtained from the amplitude responses of the directional quadrature filter pairs. Registration accuracy of the proposed method is evaluated by computing the Dice Similarity coefficient (DSC) and 95% Hausdorff Distance (HD) values for 20 patients prostate mid-gland slices and Target Registration Error (TRE) for 18 patients only where homologous structures are visible in both the TRUS and transformed MR images. The proposed method and B-splines using NMI computed from intensities provide average TRE values of 2.64 ± 1.37 and 4.43 ± 2.77 mm respectively. Our method shows statistically significant improvement in TRE when compared with B-spline using NMI computed from intensities with Student's t test p = 0.02. The proposed method shows 1.18 times improvement over thin-plate splines registration with average TRE of 3.11 ± 2.18 mm. The mean DSC and the mean 95% HD values obtained with the proposed method of B-spline with NMI computed from texture are 0.943 ± 0.039 and 4.75 ± 2.40 mm respectively. The texture energy computed from the quadrature filter pairs provides better registration accuracy for multimodal images than raw intensities. Low TRE values of the proposed registration method add to the feasibility of it being used during TRUS-guided biopsy.

Late effects of high-dose adjuvant chemotherapy on white and gray matter in breast cancer survivors: Converging results from multimodal magnetic resonance imaging

NARCIS (Netherlands)

de Ruiter, Michiel B.; Reneman, Liesbeth; Boogerd, Willem; Veltman, Dick J.; Caan, Matthan; Douaud, Gwenaëlle; Lavini, Cristina; Linn, Sabine C.; Boven, Epie; van Dam, Frits S. A. M.; Schagen, Sanne B.

2012-01-01

The neural substrate underlying cognitive impairments after chemotherapy is largely unknown. Here, we investigated very late (>9 years) effects of adjuvant high-dose chemotherapy on brain white and gray matter in primary breast cancer survivors (n = 17) with multimodal magnetic resonance imaging

Novel multimodality segmentation using level sets and Jensen-Renyi divergence

NARCIS (Netherlands)

Markel, Daniel; Zaidi, Habib; El Naqa, Issam

2013-01-01

Purpose: Positron emission tomography (PET) is playing an increasing role in radiotherapy treatment planning. However, despite progress, robust algorithms for PET and multimodal image segmentation are still lacking, especially if the algorithm were extended to image-guided and adaptive radiotherapy

Multi-modal magnetic resonance imaging and histology of vascular function in xenografts using macromolecular contrast agent hyperbranched polyglycerol (HPG-GdF).

Science.gov (United States)

Baker, Jennifer H E; McPhee, Kelly C; Moosvi, Firas; Saatchi, Katayoun; Häfeli, Urs O; Minchinton, Andrew I; Reinsberg, Stefan A

2016-01-01

Macromolecular gadolinium (Gd)-based contrast agents are in development as blood pool markers for MRI. HPG-GdF is a 583 kDa hyperbranched polyglycerol doubly tagged with Gd and Alexa 647 nm dye, making it both MR and histologically visible. In this study we examined the location of HPG-GdF in whole-tumor xenograft sections matched to in vivo DCE-MR images of both HPG-GdF and Gadovist. Despite its large size, we have shown that HPG-GdF extravasates from some tumor vessels and accumulates over time, but does not distribute beyond a few cell diameters from vessels. Fractional plasma volume (fPV) and apparent permeability-surface area product (aPS) parameters were derived from the MR concentration-time curves of HPG-GdF. Non-viable necrotic tumor tissue was excluded from the analysis by applying a novel bolus arrival time (BAT) algorithm to all voxels. aPS derived from HPG-GdF was the only MR parameter to identify a difference in vascular function between HCT116 and HT29 colorectal tumors. This study is the first to relate low and high molecular weight contrast agents with matched whole-tumor histological sections. These detailed comparisons identified tumor regions that appear distinct from each other using the HPG-GdF biomarkers related to perfusion and vessel leakiness, while Gadovist-imaged parameter measures in the same regions were unable to detect variation in vascular function. We have established HPG-GdF as a biocompatible multi-modal high molecular weight contrast agent with application for examining vascular function in both MR and histological modalities. Copyright © 2015 John Wiley & Sons, Ltd.

Learning of Multimodal Representations With Random Walks on the Click Graph.

Science.gov (United States)

Wu, Fei; Lu, Xinyan; Song, Jun; Yan, Shuicheng; Zhang, Zhongfei Mark; Rui, Yong; Zhuang, Yueting

2016-02-01

In multimedia information retrieval, most classic approaches tend to represent different modalities of media in the same feature space. With the click data collected from the users' searching behavior, existing approaches take either one-to-one paired data (text-image pairs) or ranking examples (text-query-image and/or image-query-text ranking lists) as training examples, which do not make full use of the click data, particularly the implicit connections among the data objects. In this paper, we treat the click data as a large click graph, in which vertices are images/text queries and edges indicate the clicks between an image and a query. We consider learning a multimodal representation from the perspective of encoding the explicit/implicit relevance relationship between the vertices in the click graph. By minimizing both the truncated random walk loss as well as the distance between the learned representation of vertices and their corresponding deep neural network output, the proposed model which is named multimodal random walk neural network (MRW-NN) can be applied to not only learn robust representation of the existing multimodal data in the click graph, but also deal with the unseen queries and images to support cross-modal retrieval. We evaluate the latent representation learned by MRW-NN on a public large-scale click log data set Clickture and further show that MRW-NN achieves much better cross-modal retrieval performance on the unseen queries/images than the other state-of-the-art methods.

Approaching Athenian Graffiti as a Multimodal Genre with GIS Application

OpenAIRE

Stampoulidis, Georgios

2017-01-01

Graffiti as an ever-changing form of urban art and visual communication is naturally multimodal, focusing on text–image relations (Bateman 2014; Forceville 2008; Kress 2006), which owe their existence mainly to the sociocultural and historical knowledge of the represented world of our experience – Husserlian Lebenswelt [Lifeworld] (Sonesson 2008; 2015). These relations constitute an interesting challenge to multimodal interpretations, because both verbal and/or pictorial representations can i...

Coronary plaque morphology on multi-modality imagining and periprocedural myocardial infarction after percutaneous coronary intervention

Directory of Open Access Journals (Sweden)

Akira Sato

2016-06-01

Full Text Available Percutaneous coronary intervention (PCI may be complicated by periprocedural myocardial infarction (PMI as manifested by elevated cardiac biomarkers such as creatine kinase (CK-MB or troponin T. The occurrence of PMI has been shown to be associated with worse short- and long-term clinical outcome. However, recent studies suggest that PMI defined by biomarker levels alone is a marker of atherosclerosis burden and procedural complexity but in most cases does not have independent prognostic significance. Diagnostic multi-modality imaging such as intravascular ultrasound, optical coherence tomography, coronary angioscopy, near-infrared spectroscopy, multidetector computed tomography, and magnetic resonance imaging can be used to closely investigate the atherosclerotic lesion in order to detect morphological markers of unstable and vulnerable plaques in the patients undergoing PCI. With the improvement of technical aspects of multimodality coronary imaging, clinical practice and research are increasingly shifting toward defining the clinical implication of plaque morphology and patients outcomes. There were numerous published data regarding the relationship between pre-PCI lesion subsets on multi-modality imaging and post-PCI biomarker levels. In this review, we discuss the relationship between coronary plaque morphology estimated by invasive or noninvasive coronary imaging and the occurrence of PMI. Furthermore, this review underlies that the value of the multimodality coronary imaging approach will become the gold standard for invasive or noninvasive prediction of PMI in clinical practice.

Fluorescent imaging of cancerous tissues for targeted surgery

Science.gov (United States)

Bu, Lihong; Shen, Baozhong; Cheng, Zhen

2014-01-01

To maximize tumor excision and minimize collateral damage is the primary goal of cancer surgery. Emerging molecular imaging techniques have to “image-guided surgery” developing into “molecular imaging-guided surgery”, which is termed “targeted surgery” in this review. Consequently, the precision of surgery can be advanced from tissue-scale to molecule-scale, enabling “targeted surgery” to be a component of “targeted therapy”. Evidence from numerous experimental and clinical studies has demonstrated significant benefits of fluorescent imaging in targeted surgery with preoperative molecular diagnostic screening. Fluorescent imaging can help to improve intraoperative staging and enable more radical cytoreduction, detect obscure tumor lesions in special organs, highlight tumor margins, better map lymph node metastases, and identify important normal structures intraoperatively. Though limited tissue penetration of fluorescent imaging and tumor heterogeneity are two major hurdles for current targeted surgery, multimodality imaging and multiplex imaging may provide potential solutions to overcome these issues, respectively. Moreover, though many fluorescent imaging techniques and probes have been investigated, targeted surgery remains at a proof-of-principle stage. The impact of fluorescent imaging on cancer surgery will likely be realized through persistent interdisciplinary amalgamation of research in diverse fields. PMID:25064553

Gestational Trophoblastic Disease: A Multimodality Imaging Approach with Impact on Diagnosis and Management

International Nuclear Information System (INIS)

Dhanda, S.; Ramani, S.; Dhanda, S.; Ramani, S.; Thakur, M.

2014-01-01

Gestational trophoblastic disease is a condition of uncertain etiology, comprised of hydatiform mole (complete and partial), invasive mole, choriocarcinoma, and placental site trophoblastic tumor. It arises from abnormal proliferation of trophoblastic tissue. Early diagnosis of gestational trophoblastic disease and its potential complications is important for timely and successful management of the condition with preservation of fertility. Initial diagnosis is based on a multimodality approach: encompassing clinical features, serial quantitative β-hCG titers, and pelvic ultrasonography. Pelvic magnetic resonance imaging (MRI) is sometimes used as a problem-solving tool to assess the depth of myometrial invasion and extra uterine disease spread in equivocal and complicated cases. Chest radiography, body computed tomography (CT), and brain MRI have been recommended as investigative tools for overall disease staging. Angiography has a role in management of disease complications and metastases. Efficacy of PET (positron emission tomography) and PET/CT in the evaluation of recurrent or metastatic disease has not been adequately investigated yet. This paper discusses the imaging features of gestational trophoblastic disease on various imaging modalities and the role of different imaging techniques in the diagnosis and management of this entity. 1. Introduction Gestational trophoblastic disease (GTD) refers to an abnormal trophoblastic proliferation composed of a broad spectrum of lesions ranging from benign, albeit pre malignant hydatiform mole (complete and partial), through to the aggressive invasive mole, choriocarcinoma

A multifunctional probe for ICP-MS determination and multimodal imaging of cancer cells.

Science.gov (United States)

Yang, Bin; Zhang, Yuan; Chen, Beibei; He, Man; Yin, Xiao; Wang, Han; Li, Xiaoting; Hu, Bin

2017-10-15

Inductively coupled plasma-mass spectrometry (ICP-MS) based bioassay and multimodal imaging have attracted increasing attention in the current development of cancer research and theranostics. Herein, a sensitive, simple, timesaving, and reliable immunoassay for cancer cells counting and dual-modal imaging was proposed by using ICP-MS detection and down-conversion fluorescence (FL)/upconversion luminescence (UCL) with the aid of a multifunctional probe for the first time. The probe consisted of a recognition unit of goat anti-mouse IgG to label the anti-EpCAM antibody attached cells, a fluorescent dye (Cy3) moiety for FL imaging as well as upconversion nanoparticles (UCNPs) tag for both ICP-MS quantification and UCL imaging of cancer cells. Under the optimized conditions, an excellent linearity and sensitivity were achieved owing to the signal amplification effect of nanoparticles and low spectral interference. Accordingly, a limit of detection (3σ) of 1×10 2 HepG2 cells and a relative standard deviation of 7.1% for seven replicate determinations of 1×10 3 HepG2 cells were obtained. This work proposed a method to employ UCNPs with highly integrated functionalities enabling us not only to count but also to see the cancer cells, opening a promising avenue for biological research and clinical theranostics. Copyright © 2017 Elsevier B.V. All rights reserved.

Feature-Fusion Guidelines for Image-Based Multi-Modal Biometric Fusion

Directory of Open Access Journals (Sweden)

Dane Brown

2017-07-01

Full Text Available The feature level, unlike the match score level, lacks multi-modal fusion guidelines. This work demonstrates a new approach for improved image-based biometric feature-fusion. The approach extracts and combines the face, fingerprint and palmprint at the feature level for improved human identification accuracy. Feature-fusion guidelines, proposed in our recent work, are extended by adding a new face segmentation method and the support vector machine classifier. The new face segmentation method improves the face identification equal error rate (EER by 10%. The support vector machine classifier combined with the new feature selection approach, proposed in our recent work, outperforms other classifiers when using a single training sample. Feature-fusion guidelines take the form of strengths and weaknesses as observed in the applied feature processing modules during preliminary experiments. The guidelines are used to implement an effective biometric fusion system at the feature level, using a novel feature-fusion methodology, reducing the EER of two groups of three datasets namely: SDUMLA face, SDUMLA fingerprint and IITD palmprint; MUCT Face, MCYT Fingerprint and CASIA Palmprint.

Molecular nuclear imaging for targeting and trafficking

International Nuclear Information System (INIS)

Bom, Hee Seung; Min, Jung Jun; Jeong, Hwan-Jeong

2006-01-01

Noninvasive molecular targeting in living subjects is highly demanded for better understanding of such diverse topics as the efficient delivery of drugs, genes, or radionuclides for the diagnosis or treatment of diseases. Progress in molecular biology, genetic engineering and polymer chemistry provides various tools to target molecules and cells in vivo. We used chitosan as a polymer, and 99m Tc as a radionuclide. We developed 99m Tc-galactosylated chitosan to target asialoglycoprotein receptors for nuclear imaging. We also developed 99m Tc-HYNIC-chitosan-transferrin to target inflammatory cells, which was more effective than 67 Ga-citrate for imaging inflammatory lesions. For an effective delivery of molecules, a longer circulation time is needed. We found that around 10% PEGylation was most effective to prolong the circulation time of liposomes for nuclear imaging of 99m Tc-HMPAO-labeled liposomes in rats. Using various characteristics of molecules, we can deliver drugs into targets more effectively. We found that 99m Tc-labeled biodegradable pullulan-derivatives are retained in tumor tissue in response to extracellular ion-strength. For the trafficking of various cells or bacteria in an intact animal, we used optical imaging techniques or radiolabeled cells. We monitored tumor-targeting bacteria by bioluminescent imaging techniques, dentritic cells by radiolabeling and neuronal stem cells by sodium-iodide symporter reporter gene imaging. In summary, we introduced recent achievements of molecular nuclear imaging technologies in targeting receptors for hepatocyte or inflammatory cells and in trafficking bacterial, immune and stem cells using molecular nuclear imaging techniques

Molecular imaging in the framework of personalized cancer medicine.

Science.gov (United States)

Belkić, Dzevad; Belkić, Karen

2013-11-01

With our increased understanding of cancer cell biology, molecular imaging offers a strategic bridge to oncology. This complements anatomic imaging, particularly magnetic resonance (MR) imaging, which is sensitive but not specific. Among the potential harms of false positive findings is lowered adherence to recommended surveillance post-therapy and by persons at increased cancer risk. Positron emission tomography (PET) plus computerized tomography (CT) is the molecular imaging modality most widely used in oncology. In up to 40% of cases, PET-CT leads to changes in therapeutic management. Newer PET tracers can detect tumor hypoxia, bone metastases in androgen-sensitive prostate cancer, and human epidermal growth factor receptor type 2 (HER2)-expressive tumors. Magnetic resonance spectroscopy provides insight into several metabolites at the same time. Combined with MRI, this yields magnetic resonance spectroscopic imaging (MRSI), which does not entail ionizing radiation and is thus suitable for repeated monitoring. Using advanced signal processing, quantitative information can be gleaned about molecular markers of brain, breast, prostate and other cancers. Radiation oncology has benefited from molecular imaging via PET-CT and MRSI. Advanced mathematical approaches can improve dose planning in stereotactic radiosurgery, stereotactic body radiotherapy and high dose-rate brachytherapy. Molecular imaging will likely impact profoundly on clinical decision making in oncology. Molecular imaging via MR could facilitate early detection especially in persons at high risk for specific cancers.

Nanomedicine: Perspective and promises with ligand-directed molecular imaging

Energy Technology Data Exchange (ETDEWEB)

Pan Dipanjan [Department of Medicine, Washington University Medical School, St. Louis, MO (United States)], E-mail: dipanjan@wustl.edu; Lanza, Gregory M.; Wickline, Samuel A. [Department of Medicine, Washington University Medical School, St. Louis, MO (United States); Caruthers, Shelton D. [Department of Medicine, Washington University Medical School, St. Louis, MO (United States); Philips Healthcare, Andover, MA (United States)], E-mail: scaruthers@cmrl.wustl.edu

2009-05-15

Molecular imaging and targeted drug delivery play an important role toward personalized medicine, which is the future of patient management. Of late, nanoparticle-based molecular imaging has emerged as an interdisciplinary area, which shows promises to understand the components, processes, dynamics and therapies of a disease at a molecular level. The unprecedented potential of nanoplatforms for early detection, diagnosis and personalized treatment of diseases, have found application in every biomedical imaging modality. Biological and biophysical barriers are overcome by the integration of targeting ligands, imaging agents and therapeutics into the nanoplatform which allow for theranostic applications. In this article, we have discussed the opportunities and potential of targeted molecular imaging with various modalities putting a particular emphasis on perfluorocarbon nanoemulsion-based platform technology.

Nanomedicine: Perspective and promises with ligand-directed molecular imaging

International Nuclear Information System (INIS)

Pan Dipanjan; Lanza, Gregory M.; Wickline, Samuel A.; Caruthers, Shelton D.

2009-01-01

Molecular imaging and targeted drug delivery play an important role toward personalized medicine, which is the future of patient management. Of late, nanoparticle-based molecular imaging has emerged as an interdisciplinary area, which shows promises to understand the components, processes, dynamics and therapies of a disease at a molecular level. The unprecedented potential of nanoplatforms for early detection, diagnosis and personalized treatment of diseases, have found application in every biomedical imaging modality. Biological and biophysical barriers are overcome by the integration of targeting ligands, imaging agents and therapeutics into the nanoplatform which allow for theranostic applications. In this article, we have discussed the opportunities and potential of targeted molecular imaging with various modalities putting a particular emphasis on perfluorocarbon nanoemulsion-based platform technology.

Online molecular image repository and analysis system: A multicenter collaborative open-source infrastructure for molecular imaging research and application.

Science.gov (United States)

Rahman, Mahabubur; Watabe, Hiroshi

2018-05-01

Molecular imaging serves as an important tool for researchers and clinicians to visualize and investigate complex biochemical phenomena using specialized instruments; these instruments are either used individually or in combination with targeted imaging agents to obtain images related to specific diseases with high sensitivity, specificity, and signal-to-noise ratios. However, molecular imaging, which is a multidisciplinary research field, faces several challenges, including the integration of imaging informatics with bioinformatics and medical informatics, requirement of reliable and robust image analysis algorithms, effective quality control of imaging facilities, and those related to individualized disease mapping, data sharing, software architecture, and knowledge management. As a cost-effective and open-source approach to address these challenges related to molecular imaging, we develop a flexible, transparent, and secure infrastructure, named MIRA, which stands for Molecular Imaging Repository and Analysis, primarily using the Python programming language, and a MySQL relational database system deployed on a Linux server. MIRA is designed with a centralized image archiving infrastructure and information database so that a multicenter collaborative informatics platform can be built. The capability of dealing with metadata, image file format normalization, and storing and viewing different types of documents and multimedia files make MIRA considerably flexible. With features like logging, auditing, commenting, sharing, and searching, MIRA is useful as an Electronic Laboratory Notebook for effective knowledge management. In addition, the centralized approach for MIRA facilitates on-the-fly access to all its features remotely through any web browser. Furthermore, the open-source approach provides the opportunity for sustainable continued development. MIRA offers an infrastructure that can be used as cross-boundary collaborative MI research platform for the rapid

Molecular Imaging in Nanotechnology and Theranostics.

Science.gov (United States)

Andreou, Chrysafis; Pal, Suchetan; Rotter, Lara; Yang, Jiang; Kircher, Moritz F

2017-06-01

The fields of biomedical nanotechnology and theranostics have enjoyed exponential growth in recent years. The "Molecular Imaging in Nanotechnology and Theranostics" (MINT) Interest Group of the World Molecular Imaging Society (WMIS) was created in order to provide a more organized and focused forum on these topics within the WMIS and at the World Molecular Imaging Conference (WMIC). The interest group was founded in 2015 and was officially inaugurated during the 2016 WMIC. The overarching goal of MINT is to bring together the many scientists who work on molecular imaging approaches using nanotechnology and those that work on theranostic agents. MINT therefore represents scientists, labs, and institutes that are very diverse in their scientific backgrounds and areas of expertise, reflecting the wide array of materials and approaches that drive these fields. In this short review, we attempt to provide a condensed overview over some of the key areas covered by MINT. Given the breadth of the fields and the given space constraints, we have limited the coverage to the realm of nanoconstructs, although theranostics is certainly not limited to this domain. We will also focus only on the most recent developments of the last 3-5 years, in order to provide the reader with an intuition of what is "in the pipeline" and has potential for clinical translation in the near future.

Molecular imaging in cervical cancer

International Nuclear Information System (INIS)

KHAN, Sairah R.; ROCKALL, Andrea G.; BARWICK, Tara D.

2016-01-01

Despite the development of screening and of a vaccine, cervix cancer is a major cause of cancer death in young women worldwide. A third of women treated for the disease will recur, almost inevitably leading to death. Functional imaging has the potential to stratify patients at higher risk of poor response or relapse by improved delineation of disease extent and tumor characteristics. A number of molecular imaging biomarkers have been shown to predict outcome at baseline and/or early during therapy in cervical cancer. In future this could help tailor the treatment plan which could include selection of patients for close follow up, adjuvant therapy or trial entry for novel agents or adaptive clinical trials. The use of molecular imaging techniques, FDG PET/CT and functional MRI, in staging and response assessment of cervical cancer is reviewed.

Bioresponsive probes for molecular imaging:Concepts and in vivo applications