WorldWideScience

Sample records for based multimodal registration

  1. Development of IDL-based software for multimodal image registration

    International Nuclear Information System (INIS)

    Image registration with anatomical modalities such as CT and MRI, facilitates the anatomical localization in the interpretation of nuclear medicine images, which are relatively lacking in anatomical information. User-friendly program for image registration and fusion of registered images was developed. In consideration of easy transplantation to various operating systems (OS), the program was developed using IDL language. For the registration without operator's interaction, several automatic algorithms were implemented, which include principal axes matching and maximization of mutual information methods. User interface was designed to support the manual registration using point landmarks and the correction for unwanted mis-registration. Fused images were composed by overlaying one image with the other one transparently, in which the opacity of overlaid image was interactively controlled. OS and platform independent program for image registration was developed based on IDL language. It will be useful for the clinical application of image registration techniques

  2. Spectral embedding-based registration (SERg) for multimodal fusion of prostate histology and MRI

    Science.gov (United States)

    Hwuang, Eileen; Rusu, Mirabela; Karthigeyan, Sudha; Agner, Shannon C.; Sparks, Rachel; Shih, Natalie; Tomaszewski, John E.; Rosen, Mark; Feldman, Michael; Madabhushi, Anant

    2014-03-01

    Multi-modal image registration is needed to align medical images collected from different protocols or imaging sources, thereby allowing the mapping of complementary information between images. One challenge of multimodal image registration is that typical similarity measures rely on statistical correlations between image intensities to determine anatomical alignment. The use of alternate image representations could allow for mapping of intensities into a space or representation such that the multimodal images appear more similar, thus facilitating their co-registration. In this work, we present a spectral embedding based registration (SERg) method that uses non-linearly embedded representations obtained from independent components of statistical texture maps of the original images to facilitate multimodal image registration. Our methodology comprises the following main steps: 1) image-derived textural representation of the original images, 2) dimensionality reduction using independent component analysis (ICA), 3) spectral embedding to generate the alternate representations, and 4) image registration. The rationale behind our approach is that SERg yields embedded representations that can allow for very different looking images to appear more similar, thereby facilitating improved co-registration. Statistical texture features are derived from the image intensities and then reduced to a smaller set by using independent component analysis to remove redundant information. Spectral embedding generates a new representation by eigendecomposition from which only the most important eigenvectors are selected. This helps to accentuate areas of salience based on modality-invariant structural information and therefore better identifies corresponding regions in both the template and target images. The spirit behind SERg is that image registration driven by these areas of salience and correspondence should improve alignment accuracy. In this work, SERg is implemented using Demons

  3. Development of a hardware-based registration system for the multimodal medical images by USB cameras

    International Nuclear Information System (INIS)

    There are several medical imaging scanners and each modality has different aspect for visualizing inside of human body. By combining these images, diagnostic accuracy could be improved, and therefore, several attempts for multimodal image registration have been implemented. One popular approach is to use hybrid image scanners such as positron emission tomography (PET)/CT and single photon emission computed tomography (SPECT)/CT. However, these hybrid scanners are expensive and not fully available. We developed multimodal image registration system with universal serial bus (USB) cameras, which is inexpensive and applicable to any combinations of existed conventional imaging scanners. The multiple USB cameras will determine the three dimensional positions of a patient while scanning. Using information of these positions and rigid body transformation, the acquired image is registered to the common coordinate which is shared with another scanner. For each scanner, reference marker is attached on gantry of the scanner. For observing the reference marker's position by the USB cameras, the location of the USB cameras can be arbitrary. In order to validate the system, we scanned a cardiac phantom with different positions by PET and MRI scanners. Using this system, images from PET and MRI were visually aligned, and good correlations between PET and MRI images were obtained after the registration. The results suggest this system can be inexpensively used for multimodal image registrations. (author)

  4. Improving efficiency of multi-modality registration of brain scans based on mutual information

    International Nuclear Information System (INIS)

    Full text: One approach for multi-modality registration uses a similarity measure based on mutual information (MI) of voxel intensities. MI measures the statistical dependence between two images by comparing the joint probability distribution (approximated by the 2D joint histogram), with the distribution in the case of complete independence (approximated from the I D histograms). The MI measure reaches a maximum when the images are aligned. The purpose of the current work was to investigate if the registration process could be accelerated through subsampling, i.e. by using only a subset of all voxels for the calculations. The behaviour of the MI measure at different subsampling factors was studied. It was observed that subsampling caused MI to exhibit multiple local maxima unless it was accompanied by a reduction in the number of bins used for the histograms. However, too few bins in the histograms made the peak of the MI measure broader. It was therefore concluded that a coarse-to-fine subsampling procedure, followed by a corresponding increase in the number of bins in the histogram, would be the best choice. The method was validated on SPET-MRI data from seven healthy volunteers. Using a 64:1, 32:1 and 16:1 subsampling scheme with a corresponding bin size of 24, 32 and 48, the new method converged in an average time of 2.5 min as compared to 46 min for the original method (PC Pentium 200). The average absolute differences were 0.24, 0.34, 0.30 mm translation and 0.58, 0.41, 0.66 degrees rotation. We conclude that the suggested scheme renders the registration method sufficiently rapid for routine use in the clinical setting

  5. Fast multi-core based multimodal registration of 2D cross-sections and 3D datasets

    Directory of Open Access Journals (Sweden)

    Pielot Rainer

    2010-01-01

    Full Text Available Abstract Background Solving bioinformatics tasks often requires extensive computational power. Recent trends in processor architecture combine multiple cores into a single chip to improve overall performance. The Cell Broadband Engine (CBE, a heterogeneous multi-core processor, provides power-efficient and cost-effective high-performance computing. One application area is image analysis and visualisation, in particular registration of 2D cross-sections into 3D image datasets. Such techniques can be used to put different image modalities into spatial correspondence, for example, 2D images of histological cuts into morphological 3D frameworks. Results We evaluate the CBE-driven PlayStation 3 as a high performance, cost-effective computing platform by adapting a multimodal alignment procedure to several characteristic hardware properties. The optimisations are based on partitioning, vectorisation, branch reducing and loop unrolling techniques with special attention to 32-bit multiplies and limited local storage on the computing units. We show how a typical image analysis and visualisation problem, the multimodal registration of 2D cross-sections and 3D datasets, benefits from the multi-core based implementation of the alignment algorithm. We discuss several CBE-based optimisation methods and compare our results to standard solutions. More information and the source code are available from http://cbe.ipk-gatersleben.de. Conclusions The results demonstrate that the CBE processor in a PlayStation 3 accelerates computational intensive multimodal registration, which is of great importance in biological/medical image processing. The PlayStation 3 as a low cost CBE-based platform offers an efficient option to conventional hardware to solve computational problems in image processing and bioinformatics.

  6. Multi-modal Image Registration for Correlative Microscopy

    OpenAIRE

    Cao, Tian; Zach, Christopher; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

    2014-01-01

    Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies. Image registration for correlative microscopy is quite challenging because it is a multi-modal, multi-scale and multi-dimensional registration problem. In this report, I introduce two methods of image registration for correlative microscopy. The first method is based on fiducials (beads). I generate landmarks from the fiduci...

  7. WE-D-9A-04: Improving Multi-Modality Image Registration Using Edge-Based Transformations

    International Nuclear Information System (INIS)

    Purpose: Multi-modality deformable image registration (DIR) for head and neck (HN) radiotherapy is difficult, particularly when matching computed tomography (CT) scans with magnetic resonance imaging (MRI) scans. We hypothesized that the ‘shared information’ between images of different modalities was to be found in some form of edge-based transformation, and that novel edge-based DIR methods might outperform standard DIR methods. Methods: We propose a novel method that combines gray-scale edge-based morphology and mutual information (MI) in two stages. In the first step, we applied a modification of a previously published mathematical morphology method as an efficient gray scale edge estimator, with denoising function. The results were fed into a MI-based solver (plastimatch). The method was tested on 5 HN patients with pretreatment CT and MR datasets and associated follow-up weekly MR scans. The followup MRs showed significant regression in tumor and normal structure volumes as compared to the pretreatment MRs. The MR images used in this study were obtained using fast spin echo based T2w images with a 1 mm isotropic resolution and FOV matching the CT scan. Results: In all cases, the novel edge-based registration method provided better registration quality than MI-based DIR using the original CT and MRI images. For example, the mismatch in carotid arteries was reduced from 3–5 mm to within 2 mm. The novel edge-based method with different registration regulation parameters did not show any distorted deformations as compared to the non-realistic deformations resulting from MI on the original images. Processing time was 1.3 to 2 times shorter (edge vs. non-edge). In general, we observed quality improvement and significant calculation time reduction with the new method. Conclusion: Transforming images to an ‘edge-space,’ if designed appropriately, greatly increases the speed and accuracy of DIR

  8. Intensity-based registration and combined visualization of multimodal brain images for noninvasive epilepsy surgery planning

    Science.gov (United States)

    Hong, Helen; Shin, Yeong G.

    2003-05-01

    To visualize the brain anatomy, seizure focus location and grid and strip electrode in 3-dimensional space provides improved planning information for focus localization and margin determination pre- and intra-operatively. However given the relatively poor spatial resolution and structural detail of the PET images, it can be difficult to recognize precise anatomic localization of the site of increased activation during seizure. In this paper, we present an intensity-based registration and combined visualization of CT, MR and PET brain images to provide both critical functional information and the structural details.

  9. Distance-Dependent Multimodal Image Registration for Agriculture Tasks

    OpenAIRE

    Ron Berenstein; Marko Hočevar; Tone Godeša; Yael Edan; Ohad Ben-Shahar

    2015-01-01

    Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal sensory systems and operate in natural environments. While not limited to any particular modalities; here we focus on systems with visual and thermal sensory inputs. Our approach is based on pre-cali...

  10. Multimodality image registration with software: state-of-the-art

    International Nuclear Information System (INIS)

    Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

  11. Registration of Multimodal Medical Images

    OpenAIRE

    H. Costin; Cr. Rotariu

    2010-01-01

    Medical images are increasingly being used within healthcare for diagnosis, planning treatment, guiding treatment and monitoring disease progression. Within medical research (e.g. neuroscience research) they are used to investigate disease processes and understand normal development and ageing. Technically, medical imaging mainly processes missing, ambiguous, complementary, redundant and distorted data. In this paper, we propose a set of MR-CT image registration methods by using spatial model...

  12. Image fusion between whole body FDG PET images and whole body MRI images using a full-automatic mutual information-based multimodality image registration software

    International Nuclear Information System (INIS)

    We attempted image fusion between whole body PET and whole body MRI of thirty patients using a full-automatic mutual information (MI) -based multimodality image registration software and evaluated accuracy of this method and impact of the coregistrated imaging on diagnostic accuracy. For 25 of 30 fused images in body area, translating gaps were within 6 mm in all axes and rotating gaps were within 2 degrees around all axes. In head and neck area, considerably much gaps caused by difference of head inclination at imaging occurred in 16 patients, however these gaps were able to decrease by fused separately. In 6 patients, diagnostic accuracy using PET/MRI fused images was superior compared by PET image alone. This work shows that whole body FDG PET images and whole body MRI images can be automatically fused using MI-based multimodality image registration software accurately and this technique can add useful information when evaluating FDG PET images. (author)

  13. Multimodal Registration of Fundus Camera and OCT Retinal Images

    OpenAIRE

    Běťák, Ondřej

    2012-01-01

    This thesis is dealing with multimodal registration of retina from different scanning devices. With this multimodal registration is possible to enhance some details on the images which are crucial to detect different types of eye diseases (such as glaucoma, nerve fibre layer degradation, vessel degradation, etc.). The theoretical background of this thesis is followed by practical application which describes different types of registration of fundus, SLO and OCT images. Registration of fundus ...

  14. Robust Nonrigid Multimodal Image Registration using Local Frequency Maps*

    Science.gov (United States)

    Jian, Bing; Vemuri, Baba C.; Marroquin, José L.

    2008-01-01

    Automatic multi-modal image registration is central to numerous tasks in medical imaging today and has a vast range of applications e.g., image guidance, atlas construction, etc. In this paper, we present a novel multi-modal 3D non-rigid registration algorithm where in 3D images to be registered are represented by their corresponding local frequency maps efficiently computed using the Riesz transform as opposed to the popularly used Gabor filters. The non-rigid registration between these local frequency maps is formulated in a statistically robust framework involving the minimization of the integral squared error a.k.a. L2E (L2 error). This error is expressed as the squared difference between the true density of the residual (which is the squared difference between the non-rigidly transformed reference and the target local frequency representations) and a Gaussian or mixture of Gaussians density approximation of the same. The non-rigid transformation is expressed in a B-spline basis to achieve the desired smoothness in the transformation as well as computational efficiency. The key contributions of this work are (i) the use of Riesz transform to achieve better efficiency in computing the local frequency representation in comparison to Gabor filter-based approaches, (ii) new mathematical model for local-frequency based non-rigid registration, (iii) analytic computation of the gradient of the robust non-rigid registration cost function to achieve efficient and accurate registration. The proposed non-rigid L2E-based registration is a significant extension of research reported in literature to date. We present experimental results for registering several real data sets with synthetic and real non-rigid misalignments. PMID:17354721

  15. Multi-modal robust inverse-consistent linear registration.

    Science.gov (United States)

    Wachinger, Christian; Golland, Polina; Magnain, Caroline; Fischl, Bruce; Reuter, Martin

    2015-04-01

    Registration performance can significantly deteriorate when image regions do not comply with model assumptions. Robust estimation improves registration accuracy by reducing or ignoring the contribution of voxels with large intensity differences, but existing approaches are limited to monomodal registration. In this work, we propose a robust and inverse-consistent technique for cross-modal, affine image registration. The algorithm is derived from a contextual framework of image registration. The key idea is to use a modality invariant representation of images based on local entropy estimation, and to incorporate a heteroskedastic noise model. This noise model allows us to draw the analogy to iteratively reweighted least squares estimation and to leverage existing weighting functions to account for differences in local information content in multimodal registration. Furthermore, we use the nonparametric windows density estimator to reliably calculate entropy of small image patches. Finally, we derive the Gauss-Newton update and show that it is equivalent to the efficient second-order minimization for the fully symmetric registration approach. We illustrate excellent performance of the proposed methods on datasets containing outliers for alignment of brain tumor, full head, and histology images. PMID:25470798

  16. Assessment of rigid multi-modality image registration consistency using the multiple sub-volume registration (MSR) method

    International Nuclear Information System (INIS)

    Registration of different imaging modalities such as CT, MRI, functional MRI (fMRI), positron (PET) and single photon (SPECT) emission tomography is used in many clinical applications. Determining the quality of any automatic registration procedure has been a challenging part because no gold standard is available to evaluate the registration. In this note we present a method, called the 'multiple sub-volume registration' (MSR) method, for assessing the consistency of a rigid registration. This is done by registering sub-images of one data set on the other data set, performing a crude non-rigid registration. By analysing the deviations (local deformations) of the sub-volume registrations from the full registration we get a measure of the consistency of the rigid registration. Registration of 15 data sets which include CT, MR and PET images for brain, head and neck, cervix, prostate and lung was performed utilizing a rigid body registration with normalized mutual information as the similarity measure. The resulting registrations were classified as good or bad by visual inspection. The resulting registrations were also classified using our MSR method. The results of our MSR method agree with the classification obtained from visual inspection for all cases (p < 0.02 based on ANOVA of the good and bad groups). The proposed method is independent of the registration algorithm and similarity measure. It can be used for multi-modality image data sets and different anatomic sites of the patient. (note)

  17. Multimodal Registration of gated cardiac PET, CT and MR sequences

    International Nuclear Information System (INIS)

    The research described in this manuscript deals with the multimodal registration of cardiac images from Magnetic Resonance Imaging (MRI), Position Emission Tomography (PET) and Computerized Tomography (CT). All these modalities are gated to the Electrocardiogram (ECG) and provide information to evaluate cardiac function, and to diagnose and to follow-up cardiovascular pathologies. PET imaging allows the evaluation of ventricular function and MRI is a gold standard for the study of the left ventricular function. The goal of our registration process is to merge functional (from PET) and anatomical images (from CT and MRI). Our process is adapted to the modalities used and is divided in two steps: (i) a global rigid 3-dimensional model-based ICP (Iterative Closest Point) registration between CT and MR data and (ii) an iconic 2-dimensional registration based on Free Form Deformations and Mutual Information. This last step presents an original contribution by using a composite image of CT (which presents epicardic contours) and PET (where endocardic contours are partially visible) data to make mutual information more accurate in representing the similarity with the MR data. To speed up the whole process, we also present a transformation initialization scheme using displacement field obtained form MR data only. The obtained results have been evaluated by experts. (author)

  18. Multimodality image registration and fusion using neural network

    Institute of Scientific and Technical Information of China (English)

    Mostafa G Mostafa; Aly A Farag; Edward Essock

    2003-01-01

    Multimodality image registration and fusion are essential steps in building 3-D models from remotesensing data. We present in this paper a neural network technique for the registration and fusion of multimodali-ty remote sensing data for the reconstruction of 3-D models of terrain regions. A FeedForward neural network isused to fuse the intensity data sets with the spatial data set after learning its geometry. Results on real data arepresented. Human performance evaluation is assessed on several perceptual tests in order to evaluate the fusionresults.

  19. A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration

    OpenAIRE

    Chen, Jian; Tian, Jie; Lee, Noah; Zheng, Jian; Smith, R. Theodore; Laine, Andrew F

    2010-01-01

    Detection of vascular bifurcations is a challenging task in multimodal retinal image registration. Existing algorithms based on bifurcations usually fail in correctly aligning poor quality retinal image pairs. To solve this problem, we propose a novel highly distinctive local feature descriptor named partial intensity invariant feature descriptor (PIIFD) and describe a robust automatic retinal image registration framework named Harris-PIIFD. PIIFD is invariant to image rotation, partially inv...

  20. Distance-Dependent Multimodal Image Registration for Agriculture Tasks

    Directory of Open Access Journals (Sweden)

    Ron Berenstein

    2015-08-01

    Full Text Available Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal sensory systems and operate in natural environments. While not limited to any particular modalities; here we focus on systems with visual and thermal sensory inputs. Our approach is based on pre-calibrating a distance-dependent transformation matrix (DDTM between the sensors; and representing it in a compact way by regressing the distance-dependent coefficients as distance-dependent functions. The DDTM is measured by calculating a projective transformation matrix for varying distances between the sensors and possible targets. To do so we designed a unique experimental setup including unique Artificial Control Points (ACPs and their detection algorithms for the two sensors. We demonstrate the utility of our approach using different experiments and evaluation criteria.

  1. Non-rigid multi-modal registration on the GPU

    Science.gov (United States)

    Vetter, Christoph; Guetter, Christoph; Xu, Chenyang; Westermann, Rüdiger

    2007-03-01

    Non-rigid multi-modal registration of images/volumes is becoming increasingly necessary in many medical settings. While efficient registration algorithms have been published, the speed of the solutions is a problem in clinical applications. Harnessing the computational power of graphics processing unit (GPU) for general purpose computations has become increasingly popular in order to speed up algorithms further, but the algorithms have to be adapted to the data-parallel, streaming model of the GPU. This paper describes the implementation of a non-rigid, multi-modal registration using mutual information and the Kullback-Leibler divergence between observed and learned joint intensity distributions. The entire registration process is implemented on the GPU, including a GPU-friendly computation of two-dimensional histograms using vertex texture fetches as well as an implementation of recursive Gaussian filtering on the GPU. Since the computation is performed on the GPU, interactive visualization of the registration process can be done without bus transfer between main memory and video memory. This allows the user to observe the registration process and to evaluate the result more easily. Two hybrid approaches distributing the computation between the GPU and CPU are discussed. The first approach uses the CPU for lower resolutions and the GPU for higher resolutions, the second approach uses the GPU to compute a first approximation to the registration that is used as starting point for registration on the CPU using double-precision. The results of the CPU implementation are compared to the different approaches using the GPU regarding speed as well as image quality. The GPU performs up to 5 times faster per iteration than the CPU implementation.

  2. Coercive Region-level Registration for Multi-modal Images

    CERN Document Server

    Chen, Yu-Hui; Newstadt, Gregory; Simmons, Jeffrey; hero, Alfred

    2015-01-01

    We propose a coercive approach to simultaneously register and segment multi-modal images which share similar spatial structure. Registration is done at the region level to facilitate data fusion while avoiding the need for interpolation. The algorithm performs alternating minimization of an objective function informed by statistical models for pixel values in different modalities. Hypothesis tests are developed to determine whether to refine segmentations by splitting regions. We demonstrate that our approach has significantly better performance than the state-of-the-art registration and segmentation methods on microscopy images.

  3. Learning Nonrigid Deformations for Constrained Multi-modal Image Registration

    OpenAIRE

    Onofrey, John A.; Staib, Lawrence H.; Papademetris, Xenophon

    2013-01-01

    We present a new strategy to constrain nonrigid registrations of multi-modal images using a low-dimensional statistical deformation model and test this in registering pre-operative and post-operative images from epilepsy patients. For those patients who may undergo surgical resection for treatment, the current gold-standard to identify regions of seizure involves craniotomy and implantation of intracranial electrodes. To guide surgical resection, surgeons utilize pre-op anat...

  4. Multi-Modality Registration And Fusion Of Medical Image Data

    International Nuclear Information System (INIS)

    Digitalisation of health care providing facilities allows US to maximize the usage of digital data from one patient obtained by various modalities. Complex view on to the problem can be achieved from the site of morphology as well as functionality. Multi-modal registration and fusion of medical image data is one of the examples that provides improved insight and allows more precise approach and treatment. (author)

  5. Automatic quantification of multi-modal rigid registration accuracy using feature detectors

    Science.gov (United States)

    Hauler, F.; Furtado, H.; Jurisic, M.; Polanec, S. H.; Spick, C.; Laprie, A.; Nestle, U.; Sabatini, U.; Birkfellner, W.

    2016-07-01

    In radiotherapy, the use of multi-modal images can improve tumor and target volume delineation. Images acquired at different times by different modalities need to be aligned into a single coordinate system by 3D/3D registration. State of the art methods for validation of registration are visual inspection by experts and fiducial-based evaluation. Visual inspection is a qualitative, subjective measure, while fiducial markers sometimes suffer from limited clinical acceptance. In this paper we present an automatic, non-invasive method for assessing the quality of intensity-based multi-modal rigid registration using feature detectors. After registration, interest points are identified on both image data sets using either speeded-up robust features or Harris feature detectors. The quality of the registration is defined by the mean Euclidean distance between matching interest point pairs. The method was evaluated on three multi-modal datasets: an ex vivo porcine skull (CT, CBCT, MR), seven in vivo brain cases (CT, MR) and 25 in vivo lung cases (CT, CBCT). Both a qualitative (visual inspection by radiation oncologist) and a quantitative (mean target registration error—mTRE—based on selected markers) method were employed. In the porcine skull dataset, the manual and Harris detectors give comparable results but both overestimated the gold standard mTRE based on fiducial markers. For instance, for CT-MR-T1 registration, the mTREman (based on manually annotated landmarks) was 2.2 mm whereas mTREHarris (based on landmarks found by the Harris detector) was 4.1 mm, and mTRESURF (based on landmarks found by the SURF detector) was 8 mm. In lung cases, the difference between mTREman and mTREHarris was less than 1 mm, while the difference between mTREman and mTRESURF was up to 3 mm. The Harris detector performed better than the SURF detector with a resulting estimated registration error close to the gold standard. Therefore the Harris detector was shown to be the more suitable

  6. Deformable registration of multi-modal data including rigid structures

    International Nuclear Information System (INIS)

    Multi-modality imaging studies are becoming more widely utilized in the analysis of medical data. Anatomical data from CT and MRI are useful for analyzing or further processing functional data from techniques such as PET and SPECT. When data are not acquired simultaneously, even when these data are acquired on a dual-imaging device using the same bed, motion can occur that requires registration between the reconstructed image volumes. As the human torso can allow non-rigid motion, this type of motion should be estimated and corrected. We report a deformation registration technique that utilizes rigid registration for bony structures, while allowing elastic transformation of soft tissue to more accurately register the entire image volume. The technique is applied to the registration of CT and MR images of the lumbar spine. First a global rigid registration is performed to approximately align features. Bony structures are then segmented from the CT data using semi-automated process, and bounding boxes for each vertebra are established. Each CT subvolume is then individually registered to the MRI data using a piece-wise rigid registration algorithm and a mutual information image similarity measure. The resulting set of rigid transformations allows for accurate registration of the parts of the CT and MRI data representing the vertebrae, but not the adjacent soft tissue. To align the soft tissue, a smoothly-varying deformation is computed using a thin platespline(TPS) algorithm. The TPS technique requires a sparse set of landmarks that are to be brought into correspondence. These landmarks are automatically obtained from the segmented data using simple edge-detection techniques and random sampling from the edge candidates. A smoothness parameter is also included in the TPS formulation for characterization of the stiffness of the soft tissue. Estimation of an appropriate stiffness factor is obtained iteratively by using the mutual information cost function on the result

  7. Deformable registration of multi-modal data including rigid structures

    Energy Technology Data Exchange (ETDEWEB)

    Huesman, Ronald H.; Klein, Gregory J.; Kimdon, Joey A.; Kuo, Chaincy; Majumdar, Sharmila

    2003-05-02

    Multi-modality imaging studies are becoming more widely utilized in the analysis of medical data. Anatomical data from CT and MRI are useful for analyzing or further processing functional data from techniques such as PET and SPECT. When data are not acquired simultaneously, even when these data are acquired on a dual-imaging device using the same bed, motion can occur that requires registration between the reconstructed image volumes. As the human torso can allow non-rigid motion, this type of motion should be estimated and corrected. We report a deformation registration technique that utilizes rigid registration for bony structures, while allowing elastic transformation of soft tissue to more accurately register the entire image volume. The technique is applied to the registration of CT and MR images of the lumbar spine. First a global rigid registration is performed to approximately align features. Bony structures are then segmented from the CT data using semi-automated process, and bounding boxes for each vertebra are established. Each CT subvolume is then individually registered to the MRI data using a piece-wise rigid registration algorithm and a mutual information image similarity measure. The resulting set of rigid transformations allows for accurate registration of the parts of the CT and MRI data representing the vertebrae, but not the adjacent soft tissue. To align the soft tissue, a smoothly-varying deformation is computed using a thin platespline(TPS) algorithm. The TPS technique requires a sparse set of landmarks that are to be brought into correspondence. These landmarks are automatically obtained from the segmented data using simple edge-detection techniques and random sampling from the edge candidates. A smoothness parameter is also included in the TPS formulation for characterization of the stiffness of the soft tissue. Estimation of an appropriate stiffness factor is obtained iteratively by using the mutual information cost function on the result

  8. Deformable image registration for multimodal lung-cancer staging

    Science.gov (United States)

    Cheirsilp, Ronnarit; Zang, Xiaonan; Bascom, Rebecca; Allen, Thomas W.; Mahraj, Rickhesvar P. M.; Higgins, William E.

    2016-03-01

    Positron emission tomography (PET) and X-ray computed tomography (CT) serve as major diagnostic imaging modalities in the lung-cancer staging process. Modern scanners provide co-registered whole-body PET/CT studies, collected while the patient breathes freely, and high-resolution chest CT scans, collected under a brief patient breath hold. Unfortunately, no method exists for registering a PET/CT study into the space of a high-resolution chest CT scan. If this could be done, vital diagnostic information offered by the PET/CT study could be brought seamlessly into the procedure plan used during live cancer-staging bronchoscopy. We propose a method for the deformable registration of whole-body PET/CT data into the space of a high-resolution chest CT study. We then demonstrate its potential for procedure planning and subsequent use in multimodal image-guided bronchoscopy.

  9. Multimodal acquisition of articulatory data: Geometrical and temporal registration.

    Science.gov (United States)

    Aron, Michaël; Berger, Marie-Odile; Kerrien, Erwan; Wrobel-Dautcourt, Brigitte; Potard, Blaise; Laprie, Yves

    2016-02-01

    Acquisition of dynamic articulatory data is of major importance for studying speech production. It turns out that one technique alone often is not enough to get a correct coverage of the whole vocal tract at a sufficient sampling rate. Ultrasound (US) imaging has been proposed as a good acquisition technique for the tongue surface because it offers a good temporal sampling, does not alter speech production, is cheap, and is widely available. However, it cannot be used alone and this paper describes a multimodal acquisition system which uses electromagnetography sensors to locate the US probe. The paper particularly focuses on the calibration of the US modality which is the key point of the system. This approach enables US data to be merged with other data. The use of the system is illustrated via an experiment consisting of measuring the minimal tongue to palate distance in order to evaluate and design Magnetic Resonance Imaging protocols well suited for the acquisition of three-dimensional images of the vocal tract. Compared to manual registration of acquisition modalities which is often used in acquisition of articulatory data, the approach presented relies on automatic techniques well founded from geometrical and mathematical points of view. PMID:26936548

  10. Multimodal image fusion with SIMS: Preprocessing with image registration.

    Science.gov (United States)

    Tarolli, Jay Gage; Bloom, Anna; Winograd, Nicholas

    2016-06-01

    In order to utilize complementary imaging techniques to supply higher resolution data for fusion with secondary ion mass spectrometry (SIMS) chemical images, there are a number of aspects that, if not given proper consideration, could produce results which are easy to misinterpret. One of the most critical aspects is that the two input images must be of the same exact analysis area. With the desire to explore new higher resolution data sources that exists outside of the mass spectrometer, this requirement becomes even more important. To ensure that two input images are of the same region, an implementation of the insight segmentation and registration toolkit (ITK) was developed to act as a preprocessing step before performing image fusion. This implementation of ITK allows for several degrees of movement between two input images to be accounted for, including translation, rotation, and scale transforms. First, the implementation was confirmed to accurately register two multimodal images by supplying a known transform. Once validated, two model systems, a copper mesh grid and a group of RAW 264.7 cells, were used to demonstrate the use of the ITK implementation to register a SIMS image with a microscopy image for the purpose of performing image fusion. PMID:26772745

  11. Multi-modality liver image registration based on multilevel B-splines free-form deformation and L-BFGS optimal algorithm

    Institute of Scientific and Technical Information of China (English)

    宋红; 李佳佳; 王树良; 马婧婷

    2014-01-01

    A new coarse-to-fine strategy was proposed for nonrigid registration of computed tomography (CT) and magnetic resonance (MR) images of a liver. This hierarchical framework consisted of an affine transformation and a B-splines free-form deformation (FFD). The affine transformation performed a rough registration targeting the mismatch between the CT and MR images. The B-splines FFD transformation performed a finer registration by correcting local motion deformation. In the registration algorithm, the normalized mutual information (NMI) was used as similarity measure, and the limited memory Broyden-Fletcher-Goldfarb-Shannon (L-BFGS) optimization method was applied for optimization process. The algorithm was applied to the fully automated registration of liver CT and MR images in three subjects. The results demonstrate that the proposed method not only significantly improves the registration accuracy but also reduces the running time, which is effective and efficient for nonrigid registration.

  12. Multi-modal Registration for Correlative Microscopy using Image Analogies

    OpenAIRE

    Cao, Tian; Zach, Christopher; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

    2013-01-01

    Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies for the same biological specimen. In this paper, we propose an image registration method for correlative microscopy, which is challenging due to the distinct appearance of biological structures when imaged with different modalities. Our method is based on image analogies and allows to transform images of a given modality into...

  13. Multi-Modal Robust Inverse-Consistent Linear Registration

    OpenAIRE

    Wachinger, Christian; Golland, Polina; Magnain, Caroline; Fischl, Bruce; Reuter, Martin

    2014-01-01

    Registration performance can significantly deteriorate when image regions do not comply with model assumptions. Robust estimation improves registration accuracy by reducing or ignoring the contribution of voxels with large intensity differences, but existing approaches are limited to monomodal registration. In this work, we propose a robust and inverse-consistent technique for crossmodal, affine image registration. The algorithm is derived from a contextual framework of image registration. Th...

  14. MIND: modality independent neighbourhood descriptor for multi-modal deformable registration.

    Science.gov (United States)

    Heinrich, Mattias P; Jenkinson, Mark; Bhushan, Manav; Matin, Tahreema; Gleeson, Fergus V; Brady, Sir Michael; Schnabel, Julia A

    2012-10-01

    Deformable registration of images obtained from different modalities remains a challenging task in medical image analysis. This paper addresses this important problem and proposes a modality independent neighbourhood descriptor (MIND) for both linear and deformable multi-modal registration. Based on the similarity of small image patches within one image, it aims to extract the distinctive structure in a local neighbourhood, which is preserved across modalities. The descriptor is based on the concept of image self-similarity, which has been introduced for non-local means filtering for image denoising. It is able to distinguish between different types of features such as corners, edges and homogeneously textured regions. MIND is robust to the most considerable differences between modalities: non-functional intensity relations, image noise and non-uniform bias fields. The multi-dimensional descriptor can be efficiently computed in a dense fashion across the whole image and provides point-wise local similarity across modalities based on the absolute or squared difference between descriptors, making it applicable for a wide range of transformation models and optimisation algorithms. We use the sum of squared differences of the MIND representations of the images as a similarity metric within a symmetric non-parametric Gauss-Newton registration framework. In principle, MIND would be applicable to the registration of arbitrary modalities. In this work, we apply and validate it for the registration of clinical 3D thoracic CT scans between inhale and exhale as well as the alignment of 3D CT and MRI scans. Experimental results show the advantages of MIND over state-of-the-art techniques such as conditional mutual information and entropy images, with respect to clinically annotated landmark locations. PMID:22722056

  15. A method of image registration for small animal, multi-modality imaging

    OpenAIRE

    Chow, Patrick L; Stout, David B.; Komisopoulou, Evangelia; Chatziioannou, Arion F

    2006-01-01

    Many research institutions have a full suite of preclinical tomographic scanners to answer biomedical questions in vivo. Routine multi-modality imaging requires robust registration of images generated by various tomographs. We have implemented a hardware registration method for preclinical imaging that is similar to that used in the combined positron emission tomography (PET)/computed tomography (CT) scanners in the clinic. We designed an imaging chamber which can be rigidly and reproducibly ...

  16. Multi-modal Sensor Registration for Vehicle Perception via Deep Neural Networks

    OpenAIRE

    Giering, Michael; Venugopalan, Vivek; Reddy, Kishore

    2014-01-01

    The ability to simultaneously leverage multiple modes of sensor information is critical for perception of an automated vehicle's physical surroundings. Spatio-temporal alignment of registration of the incoming information is often a prerequisite to analyzing the fused data. The persistence and reliability of multi-modal registration is therefore the key to the stability of decision support systems ingesting the fused information. LiDAR-video systems like on those many driverless cars are a co...

  17. Medical Image Registration Based Retrieval

    Directory of Open Access Journals (Sweden)

    Swarnambiga AYYACHAMY

    2013-02-01

    Full Text Available This paper presents a quantitative evaluation of state-of-the art intensity based image registration with retrieval methods applied to medical images. The purpose of this study is to access the stability of these methods for medical image analysis. The accuracy of this medical image retrieval with affine based registration and without registration is evaluated using observer study. For retrieval without registration and with registration, we examine the performance of various transform methods for the retrieval of medical images by extracting the features. This helps for the early diagnosis. The technique used for retrieval of medical images were a set of 2-D discrete Fourier transform (DFT, discrete cosine transform (DCT, discrete wavelet transform (DWT, Complex wavelet transform (CWT, and rotated complex wavelet filters (RCWF were implemented and examined for MRI imaging modalities. Especially RCWF gives texture information strongly oriented in six different directions (45° apart from the complex wavelet transform. Experimental results indicate that the DWT method perform well in retrieval of medical images. The method also retains the comparable levels of computational complexity. Then the experimental evaluation is carried by calculating the precision and recall values. It is found that DWT performs well for retrieval without registration and CWT with affine performs well in registration based retrieval with efficiency of 92% from retrieval efficiency 83% of DWT without registration. This helps in classification as before registration and after registration especially for clinical treatment and diagnosis.

  18. Multimodal registration of the face for computer-aided maxillofacial surgery

    OpenAIRE

    Leloup, Thierry; Chabanas, Matthieu; Payan, Yohan

    2006-01-01

    This paper introduces a multimodal elastic registration algorithm applied to match a generic Finite Element model of the face to several patients morphologies. The method is automatic and appears to be accurate and robust. The computing time is compatible with clinical practice constraints.

  19. Single- and multimodal subvoxel registration of dissimilar medical images using robust similarity measures

    Science.gov (United States)

    Nikou, Christophoros; Heitz, Fabrice; Armspach, Jean-Paul; Namer, Izzie-Jacques

    1998-06-01

    Although a large variety of image registration methods have been described in the literature, only a few approaches have attempted to address the rigid registration of medical images showing gross dissimilarities (due for instance to lesion evolution). In the present paper, we develop driven registration algorithms, relying on robust pixel similarity metrics, that enable an accurate (subvoxel) rigid registration of dissimilar single or multimodal 2D/3D images. In the proposed approach, gross dissimilarities are handled by considering similarity measures related to robust M-estimators. A `soft redescending' estimator (the Geman- McClure p-function) has been adopted to reject gross image dissimilarities during the registration. The registration parameters are estimated using a top down stochastic multigrid relaxation algorithm. Thanks to the stochastic multigrid strategy, the registration is not affected by local minima in the objective function and a manual initialization near the optimal solution is not necessary. The proposed robust similarity metrics compare favorably to the most popular standard similarity metrics, on patient image pairs showing gross dissimilarities. Two case studies are considered: the registration of MR/MR and MR/SPECT image volumes of patients suffering from multiple sclerosis and epilepsy.

  20. Multimode waveguide based directional coupler

    Science.gov (United States)

    Ahmed, Rajib; Rifat, Ahmmed A.; Sabouri, Aydin; Al-Qattan, Bader; Essa, Khamis; Butt, Haider

    2016-07-01

    The Silicon-on-Insulator (SOI) based platform overcomes limitations of the previous copper and fiber based technologies. Due to its high index difference, SOI waveguide (WG) and directional couplers (DC) are widely used for high speed optical networks and hybrid Electro-Optical inter-connections; TE00-TE01, TE00-TE00 and TM00-TM00 SOI direction couplers are designed with symmetrical and asymmetrical configurations to couple with TE00, TE01 and TM00 in a multi-mode semi-triangular ring-resonator configuration which will be applicable for multi-analyte sensing. Couplers are designed with effective index method and their structural parameters are optimized with consideration to coupler length, wavelength and polarization dependence. Lastly, performance of the couplers are analyzed in terms of cross-talk, mode overlap factor, coupling length and coupling efficiency.

  1. Spatial Information Based Medical Image Registration using Mutual Information

    Directory of Open Access Journals (Sweden)

    Benzheng Wei

    2011-06-01

    Full Text Available Image registration is a valuable technique for medical diagnosis and treatment. Due to the inferiority of image registration using maximum mutual information, a new hybrid method of multimodality medical image registration based on mutual information of spatial information is proposed. The new measure that combines mutual information, spatial information and feature characteristics, is proposed. Edge points are used as features, obtained from a morphology gradient detector. Feature characteristics like location, edge strength and orientation are taken into account to compute a joint probability distribution of corresponding edge points in two images. Mutual information based on this function is minimized to find the best alignment parameters. Finally, the translation parameters are calculated by using a modified Particle Swarm Optimization (MPSO algorithm. The experimental results demonstrate the effectiveness of the proposed registration scheme.

  2. Feasibility of Multimodal Deformable Registration for Head and Neck Tumor Treatment Planning

    Energy Technology Data Exchange (ETDEWEB)

    Fortunati, Valerio, E-mail: v.fortunati@erasmusmc.nl [Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands); Verhaart, René F. [Hyperthermia Unit, Department of Radiation Oncology, Erasmus MC University Medical Center Cancer Institute, Rotterdam (Netherlands); Angeloni, Francesco [Istituto di Ricovero e Cura a Carattere Scientifico Foundation SDN for Research and High Education in Nuclear Diagnostics, Naples (Italy); Lugt, Aad van der [Department of Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands); Niessen, Wiro J. [Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands); Faculty of Applied Sciences, Delft University of Technology, Delft (Netherlands); Veenland, Jifke F. [Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands); Paulides, Margarethus M. [Hyperthermia Unit, Department of Radiation Oncology, Erasmus MC University Medical Center Cancer Institute, Rotterdam (Netherlands); Walsum, Theo van [Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands)

    2014-09-01

    Purpose: To investigate the feasibility of using deformable registration in clinical practice to fuse MR and CT images of the head and neck for treatment planning. Method and Materials: A state-of-the-art deformable registration algorithm was optimized, evaluated, and compared with rigid registration. The evaluation was based on manually annotated anatomic landmarks and regions of interest in both modalities. We also developed a multiparametric registration approach, which simultaneously aligns T1- and T2-weighted MR sequences to CT. This was evaluated and compared with single-parametric approaches. Results: Our results show that deformable registration yielded a better accuracy than rigid registration, without introducing unrealistic deformations. For deformable registration, an average landmark alignment of approximatively 1.7 mm was obtained. For all the regions of interest excluding the cerebellum and the parotids, deformable registration provided a median modified Hausdorff distance of approximatively 1 mm. Similar accuracies were obtained for the single-parameter and multiparameter approaches. Conclusions: This study demonstrates that deformable registration of head-and-neck CT and MR images is feasible, with overall a significanlty higher accuracy than for rigid registration.

  3. Feasibility of Multimodal Deformable Registration for Head and Neck Tumor Treatment Planning

    International Nuclear Information System (INIS)

    Purpose: To investigate the feasibility of using deformable registration in clinical practice to fuse MR and CT images of the head and neck for treatment planning. Method and Materials: A state-of-the-art deformable registration algorithm was optimized, evaluated, and compared with rigid registration. The evaluation was based on manually annotated anatomic landmarks and regions of interest in both modalities. We also developed a multiparametric registration approach, which simultaneously aligns T1- and T2-weighted MR sequences to CT. This was evaluated and compared with single-parametric approaches. Results: Our results show that deformable registration yielded a better accuracy than rigid registration, without introducing unrealistic deformations. For deformable registration, an average landmark alignment of approximatively 1.7 mm was obtained. For all the regions of interest excluding the cerebellum and the parotids, deformable registration provided a median modified Hausdorff distance of approximatively 1 mm. Similar accuracies were obtained for the single-parameter and multiparameter approaches. Conclusions: This study demonstrates that deformable registration of head-and-neck CT and MR images is feasible, with overall a significanlty higher accuracy than for rigid registration

  4. Comparative study of multimodal intra-subject image registration methods on a publicly available database

    Science.gov (United States)

    Miri, Mohammad Saleh; Ghayoor, Ali; Johnson, Hans J.; Sonka, Milan

    2016-03-01

    This work reports on a comparative study between five manual and automated methods for intra-subject pair-wise registration of images from different modalities. The study includes a variety of inter-modal image registrations (MR-CT, PET-CT, PET-MR) utilizing different methods including two manual point-based techniques using rigid and similarity transformations, one automated point-based approach based on Iterative Closest Point (ICP) algorithm, and two automated intensity-based methods using mutual information (MI) and normalized mutual information (NMI). These techniques were employed for inter-modal registration of brain images of 9 subjects from a publicly available dataset, and the results were evaluated qualitatively via checkerboard images and quantitatively using root mean square error and MI criteria. In addition, for each inter-modal registration, a paired t-test was performed on the quantitative results in order to find any significant difference between the results of the studied registration techniques.

  5. Multimode optical fiber based spectrometers

    CERN Document Server

    Redding, Brandon; Cao, Hui

    2013-01-01

    A standard multimode optical fiber can be used as a general purpose spectrometer after calibrating the wavelength dependent speckle patterns produced by interference between the guided modes of the fiber. A transmission matrix was used to store the calibration data and a robust algorithm was developed to reconstruct an arbitrary input spectrum in the presence of experimental noise. We demonstrate that a 20 meter long fiber can resolve two laser lines separated by only 8 pm. At the other extreme, we show that a 2 centimeter long fiber can measure a broadband continuous spectrum generated from a supercontinuum source. We investigate the effect of the fiber geometry on the spectral resolution and bandwidth, and also discuss the additional limitation on the bandwidth imposed by speckle contrast reduction when measuring dense spectra. Finally, we demonstrate a method to reduce the spectrum reconstruction error and increase the bandwidth by separately imaging the speckle patterns of orthogonal polarizations. The mu...

  6. Decision of Multimodal Transportation Scheme Based on Swarm Intelligence

    OpenAIRE

    Kai Lei; Xiaoning Zhu; Jianfei Hou; Wencheng Huang

    2014-01-01

    In this paper, some basic concepts of multimodal transportation and swarm intelligence were described and reviewed and analyzed related literatures of multimodal transportation scheme decision and swarm intelligence methods application areas. Then, this paper established a multimodal transportation scheme decision optimization mathematical model based on transportation costs, transportation time, and transportation risks, explained relevant parameters and the constraints of the model in detai...

  7. Region-based multimodal image fusion using ICA bases

    OpenAIRE

    Cvejic, N; Lewis, J.; Bull, DR; Canagarajah, CN

    2006-01-01

    In this paper, we present a novel region-based multimodal image fusion algorithm in the ICA domain. It uses segmentation to determine the most important regions in the input images and consequently fuses the ICA coefficients from the given regions. The proposed method exhibits considerably higher performance than the basic ICA algorithm and shows improvement over other state-of-the-art algorithms In this paper, we present a novel region-based multimodal image fusion algorithm in the ICA do...

  8. MUTUAL INFORMATION BASED 3D NON-RIGID REGISTRATION OF CT/MR ABDOMEN IMAGES

    Institute of Scientific and Technical Information of China (English)

    HU; Hai-bo(

    2001-01-01

    [1]Maintz J B, Viergever M A. A survey of medical image registration[J]. Medical Image Analysis, 1998, 3(1):1~37.[2]Collignon A. Automated multi-modality image registration based on information theory[J]. Computational Imaging and vision, 1995, 3:263~274.[3]Eberl S, Braun M. Intra-and inter-modality registration of functional and anatomical clinical images[A]. Pham B, et al. eds. New Approaches in Medical Image Analysis, SPIE 3747[C].[s.l.]:[s.n.], 1999. 102~114.[4]Lau Y H, Braun M, Hutton B F. Non-rigid 3D image registration using regionally constrained matching and the correlation ratio[A]. Pernus F, et al.eds. Biomedical Image Registration, Proc Int Workshop[C]. Bled, Slovenia, 1999. 137~148.[5]Wells Ⅲ W M, Viola P, Atsumi H, et al. Multi-modal volume registration by maximization of mutual information[J]. Medical Image Analysis, 1996, 1(1):35~51.[6]Feldmar J, Ayache N. Rigid, affine and locally affine registration of free-form surfaces[J]. Int J of Computer Vision, 1996, 23(3):97~104.

  9. Multimodal Registration of gated cardiac PET, CT and MR sequences; Recalage de sequences cardiaques spation-temporelles IRM et TEP/SCAN

    Energy Technology Data Exchange (ETDEWEB)

    Baty, X

    2007-07-15

    The research described in this manuscript deals with the multimodal registration of cardiac images from Magnetic Resonance Imaging (MRI), Position Emission Tomography (PET) and Computerized Tomography (CT). All these modalities are gated to the Electrocardiogram (ECG) and provide information to evaluate cardiac function, and to diagnose and to follow-up cardiovascular pathologies. PET imaging allows the evaluation of ventricular function and MRI is a gold standard for the study of the left ventricular function. The goal of our registration process is to merge functional (from PET) and anatomical images (from CT and MRI). Our process is adapted to the modalities used and is divided in two steps: (i) a global rigid 3-dimensional model-based ICP (Iterative Closest Point) registration between CT and MR data and (ii) an iconic 2-dimensional registration based on Free Form Deformations and Mutual Information. This last step presents an original contribution by using a composite image of CT (which presents epicardic contours) and PET (where endocardic contours are partially visible) data to make mutual information more accurate in representing the similarity with the MR data. To speed up the whole process, we also present a transformation initialization scheme using displacement field obtained form MR data only. The obtained results have been evaluated by experts. (author)

  10. Fast musculoskeletal registration based on shape matching.

    Science.gov (United States)

    Gilles, Benjamin; Pai, Dinesh K

    2008-01-01

    This paper presents a new method for computing elastic and plastic deformations in the context of discrete deformable model-based registration. Internal forces are estimated by averaging local transforms between reference and current particle positions. Our technique can accommodate large non-linear deformations, and is unconditionally stable. Moreover, it is simple to implement and versatile. We show how to tune model stiffness and computational cost, which is important for efficient registration, and demonstrate our technique in the complex problem of inter-patient musculoskeletal registration. PMID:18982681

  11. Multimodality

    DEFF Research Database (Denmark)

    Buhl, Mie

    In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal’ communication, which should not be confused with the term ‘multimedia’. While multimedia...... learning situations. The choices they make involve E-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very useful for...... represent the use of various media for communication, multimodality refers to the different symbol systems we employ in communication practices. As new educational practices emerge from the application of ICT, all teachers address multimodality when they plan, practice and reflect on their teaching and...

  12. A Robust and Accurate Two-Step Auto-Labeling Conditional Iterative Closest Points (TACICP) Algorithm for Three-Dimensional Multi-Modal Carotid Image Registration

    Science.gov (United States)

    Guo, Hengkai; Wang, Guijin; Huang, Lingyun; Hu, Yuxin; Yuan, Chun; Li, Rui; Zhao, Xihai

    2016-01-01

    Atherosclerosis is among the leading causes of death and disability. Combining information from multi-modal vascular images is an effective and efficient way to diagnose and monitor atherosclerosis, in which image registration is a key technique. In this paper a feature-based registration algorithm, Two-step Auto-labeling Conditional Iterative Closed Points (TACICP) algorithm, is proposed to align three-dimensional carotid image datasets from ultrasound (US) and magnetic resonance (MR). Based on 2D segmented contours, a coarse-to-fine strategy is employed with two steps: rigid initialization step and non-rigid refinement step. Conditional Iterative Closest Points (CICP) algorithm is given in rigid initialization step to obtain the robust rigid transformation and label configurations. Then the labels and CICP algorithm with non-rigid thin-plate-spline (TPS) transformation model is introduced to solve non-rigid carotid deformation between different body positions. The results demonstrate that proposed TACICP algorithm has achieved an average registration error of less than 0.2mm with no failure case, which is superior to the state-of-the-art feature-based methods. PMID:26881433

  13. Registration of the Cone Beam CT and Blue-Ray Scanned Dental Model Based on the Improved ICP Algorithm

    Directory of Open Access Journals (Sweden)

    Xue Mei

    2014-01-01

    Full Text Available Multimodality image registration and fusion has complementary significance for guiding dental implant surgery. As the needs of the different resolution image registration, we develop an improved Iterative Closest Point (ICP algorithm that focuses on the registration of Cone Beam Computed Tomography (CT image and high-resolution Blue-light scanner image. The proposed algorithm includes two major phases, coarse and precise registration. Firstly, for reducing the matching interference of human subjective factors, we extract feature points based on curvature characteristics and use the improved three point’s translational transformation method to realize coarse registration. Then, the feature point set and reference point set, obtained by the initial registered transformation, are processed in the precise registration step. Even with the unsatisfactory initial values, this two steps registration method can guarantee the global convergence and the convergence precision. Experimental results demonstrate that the method has successfully realized the registration of the Cone Beam CT dental model and the blue-ray scanner model with higher accuracy. So the method could provide researching foundation for the relevant software development in terms of the registration of multi-modality medical data.

  14. MUTUAL INFORMATION BASED 3D NON-RIGID REGISTRATION OF CT/MR ABDOMEN IMAGES

    Institute of Scientific and Technical Information of China (English)

    2001-01-01

    A mutual information based 3D non-rigid registration approach was proposed for the registration of deformable CT/MR body abdomen images. The Parzen Windows Density Estimation (PWDE) method is adopted to calculate the mutual information between the two modals of CT and MRI abdomen images. By maximizing MI between the CT and MR volume images, the overlapping part of them reaches the biggest, which means that the two body images of CT and MR matches best to each other. Visible Human Project (VHP) Male abdomen CT and MRI Data are used as experimental data sets. The experimental results indicate that this approach of non-rigid 3D registration of CT/MR body abdominal images can be achieved effectively and automatically, without any prior processing procedures such as segmentation and feature extraction, but has a main drawback of very long computation time. Key words: medical image registration; multi-modality; mutual information; non-rigid; Parzen window density estimation

  15. Multimodality

    DEFF Research Database (Denmark)

    Buhl, Mie

    2010-01-01

    In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal' communication, which should not be confused with the term ‘multimedia'. While multimedia r...

  16. A Joint Land Cover Mapping and Image Registration Algorithm Based on a Markov Random Field Model

    Directory of Open Access Journals (Sweden)

    Apisit Eiumnoh

    2013-10-01

    Full Text Available Traditionally, image registration of multi-modal and multi-temporal images is performed satisfactorily before land cover mapping. However, since multi-modal and multi-temporal images are likely to be obtained from different satellite platforms and/or acquired at different times, perfect alignment is very difficult to achieve. As a result, a proper land cover mapping algorithm must be able to correct registration errors as well as perform an accurate classification. In this paper, we propose a joint classification and registration technique based on a Markov random field (MRF model to simultaneously align two or more images and obtain a land cover map (LCM of the scene. The expectation maximization (EM algorithm is employed to solve the joint image classification and registration problem by iteratively estimating the map parameters and approximate posterior probabilities. Then, the maximum a posteriori (MAP criterion is used to produce an optimum land cover map. We conducted experiments on a set of four simulated images and one pair of remotely sensed images to investigate the effectiveness and robustness of the proposed algorithm. Our results show that, with proper selection of a critical MRF parameter, the resulting LCMs derived from an unregistered image pair can achieve an accuracy that is as high as when images are perfectly aligned. Furthermore, the registration error can be greatly reduced.

  17. Phase Correlation Based Iris Image Registration Model

    Institute of Scientific and Technical Information of China (English)

    Jun-Zhou Huang; Tie-Niu Tan; Li Ma; Yun-Hong Wang

    2005-01-01

    Iris recognition is one of the most reliable personal identification methods. In iris recognition systems, image registration is an important component. Accurately registering iris images leads to higher recognition rate for an iris recognition system. This paper proposes a phase correlation based method for iris image registration with sub-pixel accuracy.Compared with existing methods, it is insensitive to image intensity and can compensate to a certain extent the non-linear iris deformation caused by pupil movement. Experimental results show that the proposed algorithm has an encouraging performance.

  18. Registration accuracy for MR images of the prostate using a subvolume based registration protocol

    Directory of Open Access Journals (Sweden)

    Söderström Karin

    2011-06-01

    Full Text Available Abstract Background In recent years, there has been a considerable research effort concerning the integration of magnetic resonance imaging (MRI into the external radiotherapy workflow motivated by the superior soft tissue contrast as compared to computed tomography. Image registration is a necessary step in many applications, e.g. in patient positioning and therapy response assessment with repeated imaging. In this study, we investigate the dependence between the registration accuracy and the size of the registration volume for a subvolume based rigid registration protocol for MR images of the prostate. Methods Ten patients were imaged four times each over the course of radiotherapy treatment using a T2 weighted sequence. The images were registered to each other using a mean square distance metric and a step gradient optimizer for registration volumes of different sizes. The precision of the registrations was evaluated using the center of mass distance between the manually defined prostates in the registered images. The optimal size of the registration volume was determined by minimizing the standard deviation of these distances. Results We found that prostate position was most uncertain in the anterior-posterior (AP direction using traditional full volume registration. The improvement in standard deviation of the mean center of mass distance between the prostate volumes using a registration volume optimized to the prostate was 3.9 mm (p Conclusions Repeated MR imaging of the prostate for therapy set-up or therapy assessment will both require high precision tissue registration. With a subvolume based registration the prostate registration uncertainty can be reduced down to the order of 1 mm (1 SD compared to several millimeters for registration based on the whole pelvis.

  19. Multimodal Hierarchical Dirichlet Process-based Active Perception

    OpenAIRE

    Taniguchi, Tadahiro; Takano, Toshiaki; Yoshino, Ryo

    2015-01-01

    In this paper, we propose an active perception method for recognizing object categories based on the multimodal hierarchical Dirichlet process (MHDP). The MHDP enables a robot to form object categories using multimodal information, e.g., visual, auditory, and haptic information, which can be observed by performing actions on an object. However, performing many actions on a target object requires a long time. In a real-time scenario, i.e., when the time is limited, the robot has to determine t...

  20. Fiber-Optic Vibration Sensor Based on Multimode Fiber

    Directory of Open Access Journals (Sweden)

    I. Lujo

    2008-06-01

    Full Text Available The purpose of this paper is to present a fiberoptic vibration sensor based on the monitoring of the mode distribution in a multimode optical fiber. Detection of vibrations and their parameters is possible through observation of the output speckle pattern from the multimode optical fiber. A working experimental model has been built in which all used components are widely available and cheap: a CCD camera (a simple web-cam, a multimode laser in visible range as a light source, a length of multimode optical fiber, and a computer for signal processing. Measurements have shown good agreement with the actual frequency of vibrations, and promising results were achieved with the amplitude measurements although they require some adaptation of the experimental model. Proposed sensor is cheap and lightweight and therefore presents an interesting alternative for monitoring large smart structures.

  1. 医学图像配准算法研究%Multimodality Image Registration

    Institute of Scientific and Technical Information of China (English)

    秦洪英

    2011-01-01

    The problem of image registration accuracy. Image registration techniques has been widely used in medical imaging and remote sensing images, and other fields, for the traditional image registration algorithm and low efficiency and lack of precision, a genetic algorithm to improve adaptive and applied to image registration the optimization process, the algorithm first pre-and post were adjusted using evolutionary crossover probability and mutation probability, the second cross, and immigration strategies to overcome the traditional genetic algorithm is easy to fall into local optimum shortcomings. Simulation results show that the algorithm effectively improves the accuracy of image registration, and with the common image registration algorithm compared to verify the feasibility of the method is an efficient image registration algorithm.%研究图像配准精度优化问题,医学图像由多种图像结合,利用图像各自的特点进行融合.图像配准技术一直被广泛应用在医学图像和遥感图像领域中,针对传统的图像配准算法效率和精度较低等不足,为了提高医学图像配准的准确度,提出了一种将改进的最大熵算法并应用到图像配准的优化过程中,算法首先将输入的待配准图像进行灰度处理,对灰度值进行初始化,然后采用遗传算法的选择、交叉和变异操作对图像进行平滑,并选择最优值,最后采用最大熵算法对图像进行配准选择,算法有效克服了传统遗传算法容易陷入局部最优的缺点.仿真结果表明了改进的算法有效的提高J图像配准的精确度,验证了改进算法是有效的图像配准方法.

  2. A New Extended Projection-Based Image Registration Algorithm

    Institute of Scientific and Technical Information of China (English)

    CHENHuafu; YAODezhong

    2005-01-01

    In the presence of fixed -pattern noise, the projection-based image registration technique is effective but its implementation is only confined to translation registration. Presented in this paper is an extended projectionbased image registration technique in which, by rearranging the projections of images, the image registration is implemented in two steps: rotation and translation, to accomplish two-dimensional (2-D) image registration. Thisapproach transforms the general 2-D optimization procedure into an 1-D projection optimization, thus considerably reducing the amount of computation. The validity ofthe new method is testified by simulation experiment.

  3. Multiscale registration of medical images based on edge preserving scale space with application in image-guided radiation therapy

    International Nuclear Information System (INIS)

    Mutual information (MI) is a well-accepted similarity measure for image registration in medical systems. However, MI-based registration faces the challenges of high computational complexity and a high likelihood of being trapped into local optima due to an absence of spatial information. In order to solve these problems, multi-scale frameworks can be used to accelerate registration and improve robustness. Traditional Gaussian pyramid representation is one such technique but it suffers from contour diffusion at coarse levels which may lead to unsatisfactory registration results. In this work, a new multi-scale registration framework called edge preserving multiscale registration (EPMR) was proposed based upon an edge preserving total variation L1 norm (TV-L1) scale space representation. TV-L1 scale space is constructed by selecting edges and contours of images according to their size rather than the intensity values of the image features. This ensures more meaningful spatial information with an EPMR framework for MI-based registration. Furthermore, we design an optimal estimation of the TV-L1 parameter in the EPMR framework by training and minimizing the transformation offset between the registered pairs for automated registration in medical systems. We validated our EPMR method on both simulated mono- and multi-modal medical datasets with ground truth and clinical studies from a combined positron emission tomography/computed tomography (PET/CT) scanner. We compared our registration framework with other traditional registration approaches. Our experimental results demonstrated that our method outperformed other methods in terms of the accuracy and robustness for medical images. EPMR can always achieve a small offset value, which is closer to the ground truth both for mono-modality and multi-modality, and the speed can be increased 5–8% for mono-modality and 10–14% for multi-modality registration under the same condition. Furthermore, clinical application by

  4. Audiovisual Quality Fusion based on Relative Multimodal Complexity

    DEFF Research Database (Denmark)

    You, Junyong; Korhonen, Jari; Reiter, Ulrich

    2011-01-01

    for relative multimodal complexity analysis to derive the fusion parameter in objective audiovisual quality metrics. Audio and video qualities are first estimated separately using advanced quality models, and then they are combined into the overall audiovisual quality using a linear fusion. Based on......In multimodal presentations the perceived audiovisual quality assessment is significantly influenced by the content of both the audio and visual tracks. Based on our earlier subjective quality test for finding the optimal trade-off between audio and video quality, this paper proposes a novel method...... quality metrics, compared to the fusion parameters obtained from the subjective quality tests using other known optimization methods....

  5. Atlas-Based Prostate Segmentation Using an Hybrid Registration

    OpenAIRE

    Martin, Sébastien; Daanen, Vincent; Troccaz, Jocelyne

    2008-01-01

    Purpose: This paper presents the preliminary results of a semi-automatic method for prostate segmentation of Magnetic Resonance Images (MRI) which aims to be incorporated in a navigation system for prostate brachytherapy. Methods: The method is based on the registration of an anatomical atlas computed from a population of 18 MRI exams onto a patient image. An hybrid registration framework which couples an intensity-based registration with a robust point-matching algorithm is used for both atl...

  6. A Framework for a WAP-Based Course Registration System

    Science.gov (United States)

    AL-Bastaki, Yousif; Al-Ajeeli, Abid

    2005-01-01

    This paper describes a WAP-based course registration system designed and implemented to facilitating the process of students' registration at Bahrain University. The framework will support many opportunities for applying WAP based technology to many services such as wireless commerce, cashless payment... and location-based services. The paper…

  7. Three-dimensional registration methods for multi-modal magnetic resonance neuroimages

    CERN Document Server

    Triantafyllou, C

    2001-01-01

    automatically such measures in a reliable way. possible in principle, although the true accuracy of the method depends on the type of geometrical distortions present. These results also reveal that this class of algorithm is unable to solve more localised variations and higher order magnetic field distortions between the images. These facts motivate the development of a high-dimensional 3-D registration method capable of effecting a one-to-one correspondence by capturing the localised differences. This method was seen to account not only for topological differences but also for non-linear deformations in size and shape. Validation of the algorithm is carried out on geometrical objects, simulated data and real images to ensure that the important requirements for a topologically useful mapping; invertibility, smoothness of the deformation field and an almost perfect correspondence can be maintained between two image sequences. Finally, the performance of both approaches is compared by their application to clini...

  8. Three-dimensional registration methods for multi-modal magnetic resonance neuroimages

    International Nuclear Information System (INIS)

    In this thesis, image alignment techniques are developed and evaluated for applications in neuroimaging. In particular, the problem of combining cross-sequence MRI (Magnetic Resonance Imaging) intra-subject scans is considered. The challenge in this case is to find topographically uniform mappings in order to register (find a mapping between) low resolution echo-planar images and their high resolution structural counterparts. Such an approach enables us to effectually fuse, in a clinically useful way, information across scans. This dissertation devises a new framework by which this may be achieved, involving appropriate optimisation of the required mapping functions, which turn out to be non-linear and high-dimensional in nature. Novel ways to constrain and regularise these functions to enhance the computational speed of the process and the accuracy of the solution are also studied. The algorithms, whose characteristics are demonstrated for this specific application should be fully generalisable to other medical imaging modalities and potentially, other areas of image processing. To begin with, some existing registration methods are reviewed, followed by the introduction of an automated global 3-D registration method. Its performance is investigated on extracted cortical and ventricular surfaces by utilising the principles of the chamfer matching approach. Evaluations on synthetic and real data-sets, are performed to show that removal of global image differences is possible in principle, although the true accuracy of the method depends on the type of geometrical distortions present. These results also reveal that this class of algorithm is unable to solve more localised variations and higher order magnetic field distortions between the images. These facts motivate the development of a high-dimensional 3-D registration method capable of effecting a one-to-one correspondence by capturing the localised differences. This method was seen to account not only for

  9. 47 CFR 64.611 - Internet-based TRS registration.

    Science.gov (United States)

    2010-10-01

    ... valid number portability request as set forth in 47 CFR 52.34; or, if the user does not wish to port a... 47 Telecommunication 3 2010-10-01 2010-10-01 false Internet-based TRS registration. 64.611 Section... Customer Premises Equipment for Persons With Disabilities § 64.611 Internet-based TRS registration....

  10. Automatic registration of multi-modal microscopy images for integrative analysis of prostate tissue sections

    International Nuclear Information System (INIS)

    Prostate cancer is one of the leading causes of cancer related deaths. For diagnosis, predicting the outcome of the disease, and for assessing potential new biomarkers, pathologists and researchers routinely analyze histological samples. Morphological and molecular information may be integrated by aligning microscopic histological images in a multiplex fashion. This process is usually time-consuming and results in intra- and inter-user variability. The aim of this study is to investigate the feasibility of using modern image analysis methods for automated alignment of microscopic images from differently stained adjacent paraffin sections from prostatic tissue specimens. Tissue samples, obtained from biopsy or radical prostatectomy, were sectioned and stained with either hematoxylin & eosin (H&E), immunohistochemistry for p63 and AMACR or Time Resolved Fluorescence (TRF) for androgen receptor (AR). Image pairs were aligned allowing for translation, rotation and scaling. The registration was performed automatically by first detecting landmarks in both images, using the scale invariant image transform (SIFT), followed by the well-known RANSAC protocol for finding point correspondences and finally aligned by Procrustes fit. The Registration results were evaluated using both visual and quantitative criteria as defined in the text. Three experiments were carried out. First, images of consecutive tissue sections stained with H&E and p63/AMACR were successfully aligned in 85 of 88 cases (96.6%). The failures occurred in 3 out of 13 cores with highly aggressive cancer (Gleason score ≥ 8). Second, TRF and H&E image pairs were aligned correctly in 103 out of 106 cases (97%). The third experiment considered the alignment of image pairs with the same staining (H&E) coming from a stack of 4 sections. The success rate for alignment dropped from 93.8% in adjacent sections to 22% for sections furthest away. The proposed method is both reliable and fast and therefore well suited

  11. Intensity-Based Registration for Lung Motion Estimation

    Science.gov (United States)

    Cao, Kunlin; Ding, Kai; Amelon, Ryan E.; Du, Kaifang; Reinhardt, Joseph M.; Raghavan, Madhavan L.; Christensen, Gary E.

    Image registration plays an important role within pulmonary image analysis. The task of registration is to find the spatial mapping that brings two images into alignment. Registration algorithms designed for matching 4D lung scans or two 3D scans acquired at different inflation levels can catch the temporal changes in position and shape of the region of interest. Accurate registration is critical to post-analysis of lung mechanics and motion estimation. In this chapter, we discuss lung-specific adaptations of intensity-based registration methods for 3D/4D lung images and review approaches for assessing registration accuracy. Then we introduce methods for estimating tissue motion and studying lung mechanics. Finally, we discuss methods for assessing and quantifying specific volume change, specific ventilation, strain/ stretch information and lobar sliding.

  12. Event based self-supervised temporal integration for multimodal sensor data.

    Science.gov (United States)

    Barakova, Emilia I; Lourens, Tino

    2005-06-01

    A method for synergistic integration of multimodal sensor data is proposed in this paper. This method is based on two aspects of the integration process: (1) achieving synergistic integration of two or more sensory modalities, and (2) fusing the various information streams at particular moments during processing. Inspired by psychophysical experiments, we propose a self-supervised learning method for achieving synergy with combined representations. Evidence from temporal registration and binding experiments indicates that different cues are processed individually at specific time intervals. Therefore, an event-based temporal co-occurrence principle is proposed for the integration process. This integration method was applied to a mobile robot exploring unfamiliar environments. Simulations showed that integration enhanced route recognition with many perceptual similarities; moreover, they indicate that a perceptual hierarchy of knowledge about instant movement contributes significantly to short-term navigation, but that visual perceptions have bigger impact over longer intervals. PMID:15988800

  13. Accuracy assessment of an automatic image-based PET/CT registration for ultrasound-guided biopsies and ablations

    Science.gov (United States)

    Kadoury, Samuel; Wood, Bradford J.; Venkatesan, Aradhana M.; Dalal, Sandeep; Xu, Sheng; Kruecker, Jochen

    2011-03-01

    The multimodal fusion of spatially tracked real-time ultrasound (US) with a prior CT scan has demonstrated clinical utility, accuracy, and positive impact upon clinical outcomes when used for guidance during biopsy and radiofrequency ablation in the treatment of cancer. Additionally, the combination of CT-guided procedures with positron emission tomography (PET) may not only enhance navigation, but add valuable information regarding the specific location and volume of the targeted masses which may be invisible on CT and US. The accuracy of this fusion depends on reliable, reproducible registration methods between PET and CT. This can avoid extensive manual efforts to correct registration which can be long and tedious in an interventional setting. In this paper, we present a registration workflow for PET/CT/US fusion by analyzing various image metrics based on normalized mutual information and cross-correlation, using both rigid and affine transformations to automatically align PET and CT. Registration is performed between the CT component of the prior PET-CT and the intra-procedural CT scan used for navigation to maximize image congruence. We evaluate the accuracy of the PET/CT registration by computing fiducial and target registration errors using anatomical landmarks and lesion locations respectively. We also report differences to gold-standard manual alignment as well as the root mean square errors for CT/US fusion. Ten patients with prior PET/CT who underwent ablation or biopsy procedures were selected for this study. Studies show that optimal results were obtained using a crosscorrelation based rigid registration with a landmark localization error of 1.1 +/- 0.7 mm using a discrete graphminimizing scheme. We demonstrate the feasibility of automated fusion of PET/CT and its suitability for multi-modality ultrasound guided navigation procedures.

  14. Edge-based correlation image registration for multispectral imaging

    Science.gov (United States)

    Nandy, Prabal

    2009-11-17

    Registration information for images of a common target obtained from a plurality of different spectral bands can be obtained by combining edge detection and phase correlation. The images are edge-filtered, and pairs of the edge-filtered images are then phase correlated to produce phase correlation images. The registration information can be determined based on these phase correlation images.

  15. Modification of species-based differential evolution for multimodal optimization

    Science.gov (United States)

    Idrus, Said Iskandar Al; Syahputra, Hermawan; Firdaus, Muliawan

    2015-12-01

    At this time optimization has an important role in various fields as well as between other operational research, industry, finance and management. Optimization problem is the problem of maximizing or minimizing a function of one variable or many variables, which include unimodal and multimodal functions. Differential Evolution (DE), is a random search technique using vectors as an alternative solution in the search for the optimum. To localize all local maximum and minimum on multimodal function, this function can be divided into several domain of fitness using niching method. Species-based niching method is one of method that build sub-populations or species in the domain functions. This paper describes the modification of species-based previously to reduce the computational complexity and run more efficiently. The results of the test functions show species-based modifications able to locate all the local optima in once run the program.

  16. Deformable image registration for cone-beam CT guided transoral robotic base-of-tongue surgery

    International Nuclear Information System (INIS)

    Transoral robotic surgery (TORS) offers a minimally invasive approach to resection of base-of-tongue tumors. However, precise localization of the surgical target and adjacent critical structures can be challenged by the highly deformed intraoperative setup. We propose a deformable registration method using intraoperative cone-beam computed tomography (CBCT) to accurately align preoperative CT or MR images with the intraoperative scene. The registration method combines a Gaussian mixture (GM) model followed by a variation of the Demons algorithm. First, following segmentation of the volume of interest (i.e. volume of the tongue extending to the hyoid), a GM model is applied to surface point clouds for rigid initialization (GM rigid) followed by nonrigid deformation (GM nonrigid). Second, the registration is refined using the Demons algorithm applied to distance map transforms of the (GM-registered) preoperative image and intraoperative CBCT. Performance was evaluated in repeat cadaver studies (25 image pairs) in terms of target registration error (TRE), entropy correlation coefficient (ECC) and normalized pointwise mutual information (NPMI). Retraction of the tongue in the TORS operative setup induced gross deformation >30 mm. The mean TRE following the GM rigid, GM nonrigid and Demons steps was 4.6, 2.1 and 1.7 mm, respectively. The respective ECC was 0.57, 0.70 and 0.73, and NPMI was 0.46, 0.57 and 0.60. Registration accuracy was best across the superior aspect of the tongue and in proximity to the hyoid (by virtue of GM registration of surface points on these structures). The Demons step refined registration primarily in deeper portions of the tongue further from the surface and hyoid bone. Since the method does not use image intensities directly, it is suitable to multi-modality registration of preoperative CT or MR with intraoperative CBCT. Extending the 3D image registration to the fusion of image and planning data in stereo-endoscopic video is anticipated to

  17. Precise numerical modeling of next generation multimode fiber based links

    Science.gov (United States)

    Maksymiuk, L.; Stepniak, G.

    2015-12-01

    In order to numerically model modern multimode fiber based links we are required to take into account modal and chromatic dispersion, profile dispersion and spectral dependent coupling. In this paper we propose a complete numerical model which not only is precise but also versatile. Additionally to the detailed mathematical description of the model we provide also a bunch of numerical calculations performed with the use of the model.

  18. Synergy Effects in Natural Language-Based Multimodal Interaction

    OpenAIRE

    Bretan, Ivan; Karlgren, Jussi

    1993-01-01

    We discuss the synergetic effects that can be obtained in an integrated multimodal interface framework comprising on one hand a visual language-based modality and on the other natural language analysis and generation components. Besides a visual language with high expressive power, the framework includes a cross-modal translation mechanism which enables mutual illumination of interface language syntax and semantics. Special attention has been payed to how to address pro...

  19. Total variation minimization-based multimodality medical image reconstruction

    Science.gov (United States)

    Cui, Xuelin; Yu, Hengyong; Wang, Ge; Mili, Lamine

    2014-09-01

    Since its recent inception, simultaneous image reconstruction for multimodality fusion has received a great deal of attention due to its superior imaging performance. On the other hand, the compressed sensing (CS)-based image reconstruction methods have undergone a rapid development because of their ability to significantly reduce the amount of raw data. In this work, we combine computed tomography (CT) and magnetic resonance imaging (MRI) into a single CS-based reconstruction framework. From a theoretical viewpoint, the CS-based reconstruction methods require prior sparsity knowledge to perform reconstruction. In addition to the conventional data fidelity term, the multimodality imaging information is utilized to improve the reconstruction quality. Prior information in this context is that most of the medical images can be approximated as piecewise constant model, and the discrete gradient transform (DGT), whose norm is the total variation (TV), can serve as a sparse representation. More importantly, the multimodality images from the same object must share structural similarity, which can be captured by DGT. The prior information on similar distributions from the sparse DGTs is employed to improve the CT and MRI image quality synergistically for a CT-MRI scanner platform. Numerical simulation with undersampled CT and MRI datasets is conducted to demonstrate the merits of the proposed hybrid image reconstruction approach. Our preliminary results confirm that the proposed method outperforms the conventional CT and MRI reconstructions when they are applied separately.

  20. Adaptive region-based multimodal image fusion using ICA bases

    OpenAIRE

    Cvejic, N; Canagarajah, CN; Bull, DR

    2006-01-01

    In this paper, we present a novel multimodal image fusion algorithm in ICA domain. It uses segmentation to determine the most important regions in the input images and consequently fuses the ICA coefficients from given regions using the Piella fusion metric to maximise the quality of the fused image. The proposed method exhibits significantly higher performance than the basic ICA algorithm and improvement over other state-of-the-art algorithms In this paper, we present a novel multimodal i...

  1. Evaluation of Four Volume-Based Image Registration Algorithms

    International Nuclear Information System (INIS)

    We evaluated 4 volume-based automatic image registration algorithms from 2 commercially available treatment planning systems (Philips Syntegra and BrainScan). The algorithms based on cross correlation (CC), local correlation (LC), normalized mutual information (NMI), and BrainScan mutual information (BSMI) were evaluated with: (1) the synthetic computed tomography (CT) images, (2) the CT and magnetic resonance (MR) phantom images, and (3) the CT and MR head image pairs from 12 patients with brain tumors. For the synthetic images, the registration results were compared with known transformation parameters, and all algorithms achieved accuracy of submillimeter in translation and subdegree in rotation. For the phantom images, the registration results were compared with those provided by frame and marker-based manual registration. For the patient images, the results were compared with anatomical landmark-based manual registration to qualitatively determine how the results were close to a clinically acceptable registration. NMI and LC outperformed CC and BSMI, with the sense of being closer to a clinically acceptable result. As for the robustness, NMI and BSMI outperformed CC and LC. A guideline of image registration in our institution was given, and final visual assessment is necessary to guarantee reasonable results.

  2. Rule Based System for Recognizing Emotions Using Multimodal Approach

    Directory of Open Access Journals (Sweden)

    Preeti Khanna

    2013-08-01

    Full Text Available Emotion is assuming increasing importance in human computer interaction (HCI, in general, with the growing feeling that emotion is central to human communication and intelligence. Users expect not just functionality as a factor of usability, but experiences, matched to their expectations, emotional states, and interaction goals. Endowing computers with this kind of intelligence for HCI is a complex task. It becomes more complex with the fact that the interaction of humans with their environment (including other humans is naturally multimodal. In reality, one uses a combination of modalities and they are not treated independently. In an attempt to render HCI more similar to human-human communication and enhance its naturalness, research on multiple modalities of human expressions has seen ongoing progress in the past few years. As compared to unimodal approaches, various problems arise in case of multimodal emotion recognition especially concerning fusion architecture of multimodal information. In this paper we will be proposing a rule based hybrid approach to combine the information from various sources for recognizing the target emotions. The results presented in this paper shows that it is feasible to recognize human affective states with a reasonable accuracy by combining the modalities together using rule based system.

  3. A comparative study of surface- and volume-based techniques for the automatic registration between CT and SPECT brain images

    International Nuclear Information System (INIS)

    Image registration of multimodality images is an essential task in numerous applications in three-dimensional medical image processing. Medical diagnosis can benefit from the complementary information in different modality images. Surface-based registration techniques, while still widely used, were succeeded by volume-based registration algorithms that appear to be theoretically advantageous in terms of reliability and accuracy. Several applications of such algorithms for the registration of CT-MRI, CT-PET, MRI-PET, and SPECT-MRI images have emerged in the literature, using local optimization techniques for the matching of images. Our purpose in this work is the development of automatic techniques for the registration of real CT and SPECT images, based on either surface- or volume-based algorithms. Optimization is achieved using genetic algorithms that are known for their robustness. The two techniques are compared against a well-established method, the Iterative Closest Point--ICP. The correlation coefficient was employed as an independent measure of spatial match, to produce unbiased results. The repeated measures ANOVA indicates the significant impact of the choice of registration method on the magnitude of the correlation (F=4.968, p=0.0396). The volume-based method achieves an average correlation coefficient value of 0.454 with a standard deviation of 0.0395, as opposed to an average of 0.380 with a standard deviation of 0.0603 achieved by the surface-based method and an average of 0.396 with a standard deviation equal to 0.0353 achieved by ICP. The volume-based technique performs significantly better compared to both ICP (p<0.05, Neuman Keuls test) and the surface-based technique (p<0.05, Neuman-Keuls test). Surface-based registration and ICP do not differ significantly in performance

  4. Multi-band Image Registration Method Based on Fourier Transform

    Institute of Scientific and Technical Information of China (English)

    庹红娅; 刘允才

    2004-01-01

    This paper presented a registration method based on Fourier transform for multi-band images which is involved in translation and small rotation. Although different band images differ a lot in the intensity and features,they contain certain common information which we can exploit. A model was given that the multi-band images have linear correlations under the least-square sense. It is proved that the coefficients have no effect on the registration progress if two images have linear correlations. Finally, the steps of the registration method were proposed. The experiments show that the model is reasonable and the results are satisfying.

  5. Atlas-Based Prostate Segmentation Using an Hybrid Registration

    CERN Document Server

    Martin, Sébastien; Troccaz, Jocelyne

    2008-01-01

    Purpose: This paper presents the preliminary results of a semi-automatic method for prostate segmentation of Magnetic Resonance Images (MRI) which aims to be incorporated in a navigation system for prostate brachytherapy. Methods: The method is based on the registration of an anatomical atlas computed from a population of 18 MRI exams onto a patient image. An hybrid registration framework which couples an intensity-based registration with a robust point-matching algorithm is used for both atlas building and atlas registration. Results: The method has been validated on the same dataset that the one used to construct the atlas using the "leave-one-out method". Results gives a mean error of 3.39 mm and a standard deviation of 1.95 mm with respect to expert segmentations. Conclusions: We think that this segmentation tool may be a very valuable help to the clinician for routine quantitative image exploitation.

  6. Ricci Flow-based Spherical Parameterization and Surface Registration

    OpenAIRE

    Chen, X.; He, H.; G. Zou; Zhang, X; Gu, X.; Hua, J

    2013-01-01

    This paper presents an improved Euclidean Ricci flow method for spherical parameterization. We subsequently invent a scale space processing built upon Ricci energy to extract robust surface features for accurate surface registration. Since our method is based on the proposed Euclidean Ricci flow, it inherits the properties of Ricci flow such as conformality, robustness and intrinsicalness, facilitating efficient and effective surface mapping. Compared with other surface registration methods u...

  7. An efficient strategy based on an individualized selection of registration methods. Application to the coregistration of MR and SPECT images in neuro-oncology

    International Nuclear Information System (INIS)

    An efficient registration strategy is described that aims to help solve delicate medical imaging registration problems. It consists of running several registration methods for each dataset and selecting the best one for each specific dataset, according to an evaluation criterion. Finally, the quality of the registration results, obtained with the best method, is visually scored by an expert as excellent, correct or poor. The strategy was applied to coregister Technetium-99m Sestamibi SPECT and MRI data in the framework of a follow-up protocol in patients with high grade gliomas receiving antiangiogenic therapy. To adapt the strategy to this clinical context, a robust semi-automatic evaluation criterion based on the physiological uptake of the Sestamibi tracer was defined. A panel of eighteen multimodal registration algorithms issued from BrainVisa, SPM or AIR software environments was systematically applied to the clinical database composed of sixty-two datasets. According to the expert visual validation, this new strategy provides 85% excellent registrations, 12% correct ones and only 3% poor ones. These results compare favorably to the ones obtained by the globally most efficient registration method over the whole database, for which only 61% of excellent registration results have been reported. Thus the registration strategy in its current implementation proves to be suitable for clinical application. (paper)

  8. An efficient strategy based on an individualized selection of registration methods. Application to the coregistration of MR and SPECT images in neuro-oncology

    Science.gov (United States)

    Tacchella, Jean-Marc; Roullot, Elodie; Lefort, Muriel; Cohen, Mike-Ely; Guillevin, Rémy; Petrirena, Grégorio; Delattre, Jean-Yves; Habert, Marie-Odile; Yeni, Nathanaëlle; Kas, Aurélie; Frouin, Frédérique

    2014-11-01

    An efficient registration strategy is described that aims to help solve delicate medical imaging registration problems. It consists of running several registration methods for each dataset and selecting the best one for each specific dataset, according to an evaluation criterion. Finally, the quality of the registration results, obtained with the best method, is visually scored by an expert as excellent, correct or poor. The strategy was applied to coregister Technetium-99m Sestamibi SPECT and MRI data in the framework of a follow-up protocol in patients with high grade gliomas receiving antiangiogenic therapy. To adapt the strategy to this clinical context, a robust semi-automatic evaluation criterion based on the physiological uptake of the Sestamibi tracer was defined. A panel of eighteen multimodal registration algorithms issued from BrainVisa, SPM or AIR software environments was systematically applied to the clinical database composed of sixty-two datasets. According to the expert visual validation, this new strategy provides 85% excellent registrations, 12% correct ones and only 3% poor ones. These results compare favorably to the ones obtained by the globally most efficient registration method over the whole database, for which only 61% of excellent registration results have been reported. Thus the registration strategy in its current implementation proves to be suitable for clinical application.

  9. Visible and infrared image registration based on visual salient features

    Science.gov (United States)

    Wu, Feihong; Wang, Bingjian; Yi, Xiang; Li, Min; Hao, Jingya; Qin, Hanlin; Zhou, Huixin

    2015-09-01

    In order to improve the precision of visible and infrared (VIS/IR) image registration, an image registration method based on visual salient (VS) features is presented. First, a VS feature detector based on the modified visual attention model is presented to extract VS points. Because the iterative, within-feature competition method used in visual attention models is time consuming, an alternative fast visual salient (FVS) feature detector is proposed to make VS features more efficient. Then, a descriptor-rearranging (DR) strategy is adopted to describe feature points. This strategy combines information of both IR image and its negative image to overcome the contrast reverse problem between VIS and IR images, making it easier to find the corresponding points on VIS/IR images. Experiments show that both VS and FVS detectors have higher repeatability scores than scale invariant feature transform in the cases of blurring, brightness change, JPEG compression, noise, and viewpoint, except big scale change. The combination of VS detector and DR registration strategy can achieve precise image registration, but it is time-consuming. The combination of FVS detector and DR registration strategy can also reach a good registration of VIS/IR images but in a shorter time.

  10. Multimodal MRI Neuroimaging with Motion Compensation Based on Particle Filtering

    CERN Document Server

    Chen, Yu-Hui; Kim, Boklye; Meyer, Charles; Hero, Alfred

    2015-01-01

    Head movement during scanning impedes activation detection in fMRI studies. Head motion in fMRI acquired using slice-based Echo Planar Imaging (EPI) can be estimated and compensated by aligning the images onto a reference volume through image registration. However, registering EPI images volume to volume fails to consider head motion between slices, which may lead to severely biased head motion estimates. Slice-to-volume registration can be used to estimate motion parameters for each slice by more accurately representing the image acquisition sequence. However, accurate slice to volume mapping is dependent on the information content of the slices: middle slices are information rich, while edge slides are information poor and more prone to distortion. In this work, we propose a Gaussian particle filter based head motion tracking algorithm to reduce the image misregistration errors. The algorithm uses a dynamic state space model of head motion with an observation equation that models continuous slice acquisitio...

  11. Automatic Image Registration Algorithm Based on Wavelet Transform

    Institute of Scientific and Technical Information of China (English)

    LIU Qiong; NI Guo-qiang

    2006-01-01

    An automatic image registration approach based on wavelet transform is proposed. This proposed method utilizes multiscale wavelet transform to extract feature points. A coarse-to-fine feature matching method is utilized in the feature matching phase. A two-way matching method based on cross-correlation to get candidate point pairs and a fine matching based on support strength combine to form the matching algorithm. At last, based on an affine transformation model, the parameters are iteratively refined by using the least-squares estimation approach. Experimental results have verified that the proposed algorithm can realize automatic registration of various kinds of images rapidly and effectively.

  12. Multimodal biometrics system based on face profile and ear

    Science.gov (United States)

    Youssef, Iman S.; Abaza, Ayman A.; Rasmy, Mohamed E.; Badawi, Ahmed M.

    2014-05-01

    Face recognition from a side profile view, has recently received significant attention in the literature. Even though current face recognition systems have reached a certain level of maturity at angles up to 30 degrees, their success is still limited with side profile angles. This paper presents an efficient technique for the fusion of face profile and ear biometrics. We propose to use a Block-based Local Binary Pattern (LBP) to generate the features for recognition from face profile images and ear images. These feature distributions are then fused at the score level using simple mean rule. Experimental results show that the proposed multimodal system can achieve 97:98% recognition performance, compared to unimodal biometrics of face profile 96.76%, and unimodal biometrics of ear 96.95%, details in the Experimental Results Section. Comparisons with other multimodal systems used in the literature, like Principal Component Analysis (PCA), Full-space Linear Discriminant Analysis (FSLDA) and Kernel Fisher discriminant analysis (KFDA), are presented in the Experimental Results Section.

  13. Multi-mode reliability-based design of horizontal curves.

    Science.gov (United States)

    Essa, Mohamed; Sayed, Tarek; Hussein, Mohamed

    2016-08-01

    Recently, reliability analysis has been advocated as an effective approach to account for uncertainty in the geometric design process and to evaluate the risk associated with a particular design. In this approach, a risk measure (e.g. probability of noncompliance) is calculated to represent the probability that a specific design would not meet standard requirements. The majority of previous applications of reliability analysis in geometric design focused on evaluating the probability of noncompliance for only one mode of noncompliance such as insufficient sight distance. However, in many design situations, more than one mode of noncompliance may be present (e.g. insufficient sight distance and vehicle skidding at horizontal curves). In these situations, utilizing a multi-mode reliability approach that considers more than one failure (noncompliance) mode is required. The main objective of this paper is to demonstrate the application of multi-mode (system) reliability analysis to the design of horizontal curves. The process is demonstrated by a case study of Sea-to-Sky Highway located between Vancouver and Whistler, in southern British Columbia, Canada. Two noncompliance modes were considered: insufficient sight distance and vehicle skidding. The results show the importance of accounting for several noncompliance modes in the reliability model. The system reliability concept could be used in future studies to calibrate the design of various design elements in order to achieve consistent safety levels based on all possible modes of noncompliance. PMID:27180287

  14. Fingerprints, Iris and DNA Features based Multimodal Systems: A Review

    Directory of Open Access Journals (Sweden)

    Prakash Chandra Srivastava

    2013-01-01

    Full Text Available Biometric systems are alternates to the traditional identification systems. This paper provides an overview of single feature and multiple features based biometric systems, including the performance of physiological characteristics (such as fingerprint, hand geometry, head recognition, iris, retina, face recognition, DNA recognition, palm prints, heartbeat, finger veins, palates etc and behavioral characteristics (such as body language, facial expression, signature verification, speech recognition, Gait Signature etc.. The fingerprints, iris image, and DNA features based multimodal systems and their performances are analyzed in terms of security, reliability, accuracy, and long-term stability. The strengths and weaknesses of various multiple features based biometric approaches published so far are analyzed. The directions of future research work for robust personal identification is outlined.

  15. Image registration based on matrix perturbation analysis using spectral graph

    Institute of Scientific and Technical Information of China (English)

    Chengcai Leng; Zheng Tian; Jing Li; Mingtao Ding

    2009-01-01

    @@ We present a novel perspective on characterizing the spectral correspondence between nodes of the weighted graph with application to image registration.It is based on matrix perturbation analysis on the spectral graph.The contribution may be divided into three parts.Firstly, the perturbation matrix is obtained by perturbing the matrix of graph model.Secondly, an orthogonal matrix is obtained based on an optimal parameter, which can better capture correspondence features.Thirdly, the optimal matching matrix is proposed by adjusting signs of orthogonal matrix for image registration.Experiments on both synthetic images and real-world images demonstrate the effectiveness and accuracy of the proposed method.

  16. PCA-based groupwise image registration for quantitative MRI.

    Science.gov (United States)

    Huizinga, W; Poot, D H J; Guyader, J-M; Klaassen, R; Coolen, B F; van Kranenburg, M; van Geuns, R J M; Uitterdijk, A; Polfliet, M; Vandemeulebroucke, J; Leemans, A; Niessen, W J; Klein, S

    2016-04-01

    Quantitative magnetic resonance imaging (qMRI) is a technique for estimating quantitative tissue properties, such as the T1 and T2 relaxation times, apparent diffusion coefficient (ADC), and various perfusion measures. This estimation is achieved by acquiring multiple images with different acquisition parameters (or at multiple time points after injection of a contrast agent) and by fitting a qMRI signal model to the image intensities. Image registration is often necessary to compensate for misalignments due to subject motion and/or geometric distortions caused by the acquisition. However, large differences in image appearance make accurate image registration challenging. In this work, we propose a groupwise image registration method for compensating misalignment in qMRI. The groupwise formulation of the method eliminates the requirement of choosing a reference image, thus avoiding a registration bias. The method minimizes a cost function that is based on principal component analysis (PCA), exploiting the fact that intensity changes in qMRI can be described by a low-dimensional signal model, but not requiring knowledge on the specific acquisition model. The method was evaluated on 4D CT data of the lungs, and both real and synthetic images of five different qMRI applications: T1 mapping in a porcine heart, combined T1 and T2 mapping in carotid arteries, ADC mapping in the abdomen, diffusion tensor mapping in the brain, and dynamic contrast-enhanced mapping in the abdomen. Each application is based on a different acquisition model. The method is compared to a mutual information-based pairwise registration method and four other state-of-the-art groupwise registration methods. Registration accuracy is evaluated in terms of the precision of the estimated qMRI parameters, overlap of segmented structures, distance between corresponding landmarks, and smoothness of the deformation. In all qMRI applications the proposed method performed better than or equally well as

  17. Feature quality-based multimodal unconstrained eye recognition

    Science.gov (United States)

    Zhou, Zhi; Du, Eliza Y.; Lin, Yong; Thomas, N. Luke; Belcher, Craig; Delp, Edward J.

    2013-05-01

    Iris recognition has been tested to the most accurate biometrics using high resolution near infrared images. However, it does not work well under visible wavelength illumination. Sclera recognition, however, has been shown to achieve reasonable recognition accuracy under visible wavelengths. Combining iris and sclera recognition together can achieve better recognition accuracy. However, image quality can significantly affect the recognition accuracy. Moreover, in unconstrained situations, the acquired eye images may not be frontally facing. In this research, we proposed a feature quality-based multimodal unconstrained eye recognition method that combine the respective strengths of iris recognition and sclera recognition for human identification and can work with frontal and off-angle eye images. The research results show that the proposed method is very promising.

  18. FULLY AUTOMATIC IMAGE-BASED REGISTRATION OF UNORGANIZED TLS DATA

    Directory of Open Access Journals (Sweden)

    M. Weinmann

    2012-09-01

    Full Text Available The estimation of the transformation parameters between different point clouds is still a crucial task as it is usually followed by scene reconstruction, object detection or object recognition. Therefore, the estimates should be as accurate as possible. Recent developments show that it is feasible to utilize both the measured range information and the reflectance information sampled as image, as 2D imagery provides additional information. In this paper, an image-based registration approach for TLS data is presented which consists of two major steps. In the first step, the order of the scans is calculated by checking the similarity of the respective reflectance images via the total number of SIFT correspondences between them. Subsequently, in the second step, for each SIFT correspondence the respective SIFT features are filtered with respect to their reliability concerning the range information and projected to 3D space. Combining the 3D points with 2D observations on a virtual plane yields 3D-to-2D correspondences from which the coarse transformation parameters can be estimated via a RANSAC-based registration scheme including the EPnP algorithm. After this coarse registration, the 3D points are again checked for consistency by using constraints based on the 3D distance, and, finally, the remaining 3D points are used for an ICP-based fine registration. Thus, the proposed methodology provides a fast, reliable, accurate and fully automatic image-based approach for the registration of unorganized point clouds without the need of a priori information about the order of the scans, the presence of regular surfaces or human interaction.

  19. Implicit function-based phantoms for evaluation of registration algorithms

    Science.gov (United States)

    Gopalakrishnan, Girish; Poston, Timothy; Nagaraj, Nithin; Mullick, Rakesh; Knoplioch, Jerome

    2005-04-01

    Medical image fusion is increasingly enhancing diagnostic accuracy by synergizing information from multiple images, obtained by the same modality at different times or from complementary modalities such as structural information from CT and functional from PET. An active, crucial research topic in fusion is validation of the registration (point-to-point correspondence) used. Phantoms and other simulated studies are useful in the absence of, or as a preliminary to, definitive clinical tests. Software phantoms in specific have the added advantage of robustness, repeatability and reproducibility. Our virtual-lung-phantom-based scheme can test the accuracy of any registration algorithm and is flexible enough for added levels of complexity (addition of blur/anti-alias, rotate/warp, and modality-associated noise) to help evaluate the robustness of an image registration/fusion methodology. Such a framework extends easily to different anatomies. The feature of adding software-based fiducials both within and outside simulated anatomies prove more beneficial when compared to experiments using data from external fiducials on a patient. It would help the diagnosing clinician make a prudent choice of registration algorithm.

  20. An accurate 3D shape context based non-rigid registration method for mouse whole-body skeleton registration

    Science.gov (United States)

    Xiao, Di; Zahra, David; Bourgeat, Pierrick; Berghofer, Paula; Acosta Tamayo, Oscar; Wimberley, Catriona; Gregoire, Marie C.; Salvado, Olivier

    2011-03-01

    Small animal image registration is challenging because of its joint structure, and posture and position difference in each acquisition without a standard scan protocol. In this paper, we face the issue of mouse whole-body skeleton registration from CT images. A novel method is developed for analyzing mouse hind-limb and fore-limb postures based on geodesic path descriptor and then registering the major skeletons and fore limb skeletons initially by thin-plate spline (TPS) transform based on the obtained geodesic paths and their enhanced correspondence fields. A target landmark correction method is proposed for improving the registration accuracy of the improved 3D shape context non-rigid registration method we previously proposed. A novel non-rigid registration framework, combining the skeleton posture analysis, geodesic path based initial alignment and 3D shape context model, is proposed for mouse whole-body skeleton registration. The performance of the proposed methods and framework was tested on 12 pairs of mouse whole-body skeletons. The experimental results demonstrated the flexibility, stability and accuracy of the proposed framework for automatic mouse whole body skeleton registration.

  1. An integrated GIS-based data model for multimodal urban public transportation analysis and management

    Science.gov (United States)

    Chen, Shaopei; Tan, Jianjun; Ray, C.; Claramunt, C.; Sun, Qinqin

    2008-10-01

    Diversity is one of the main characteristics of transportation data collected from multiple sources or formats, which can be extremely complex and disparate. Moreover, these multimodal transportation data are usually characterised by spatial and temporal properties. Multimodal transportation network data modelling involves both an engineering and research domain that has attracted the design of a number of spatio-temporal data models in the geographic information system (GIS). However, the application of these specific models to multimodal transportation network is still a challenging task. This research addresses this challenge from both integrated multimodal data organization and object-oriented modelling perspectives, that is, how a complex urban transportation network should be organized, represented and modeled appropriately when considering a multimodal point of view, and using object-oriented modelling method. We proposed an integrated GIS-based data model for multimodal urban transportation network that lays a foundation to enhance the multimodal transportation network analysis and management. This modelling method organizes and integrates multimodal transit network data, and supports multiple representations for spatio-temporal objects and relationship as both visual and graphic views. The data model is expressed by using a spatio-temporal object-oriented modelling method, i.e., the unified modelling language (UML) extended to spatial and temporal plug-in for visual languages (PVLs), which provides an essential support to the spatio-temporal data modelling for transportation GIS.

  2. Investigation on Multimode SAR Imaging Based on Digital Array Radar

    OpenAIRE

    Li Xue-shi; Sun Guang-cai; Shao Peng; Wu Yu-feng; Xing Meng-dao

    2014-01-01

    Digital Array Radar (DAR) has the ability of simultaneous multimode imaging and has many potential applications. This paper firstly introduces the basic hardware structure and the operation principle of DAR. Combined with the Digital BeamForming (DBF) technique, six operational modes that can be used in multimode Synthetic Aperture Radar (SAR) imaging are proposed, and the corresponding novel imaging modes are produced. Moreover, the design of the novel imaging modes is introduced in detail. ...

  3. Validation of a deformable image registration technique for cone beam CT-based dose verification

    Energy Technology Data Exchange (ETDEWEB)

    Moteabbed, M., E-mail: mmoteabbed@partners.org; Sharp, G. C.; Wang, Y.; Trofimov, A.; Efstathiou, J. A.; Lu, H.-M. [Massachusetts General Hospital, Boston, Massachusetts 02114 and Harvard Medical School, Boston, Massachusetts 02115 (United States)

    2015-01-15

    Purpose: As radiation therapy evolves toward more adaptive techniques, image guidance plays an increasingly important role, not only in patient setup but also in monitoring the delivered dose and adapting the treatment to patient changes. This study aimed to validate a method for evaluation of delivered intensity modulated radiotherapy (IMRT) dose based on multimodal deformable image registration (DIR) for prostate treatments. Methods: A pelvic phantom was scanned with CT and cone-beam computed tomography (CBCT). Both images were digitally deformed using two realistic patient-based deformation fields. The original CT was then registered to the deformed CBCT resulting in a secondary deformed CT. The registration quality was assessed as the ability of the DIR method to recover the artificially induced deformations. The primary and secondary deformed CT images as well as vector fields were compared to evaluate the efficacy of the registration method and it’s suitability to be used for dose calculation. PLASTIMATCH, a free and open source software was used for deformable image registration. A B-spline algorithm with optimized parameters was used to achieve the best registration quality. Geometric image evaluation was performed through voxel-based Hounsfield unit (HU) and vector field comparison. For dosimetric evaluation, IMRT treatment plans were created and optimized on the original CT image and recomputed on the two warped images to be compared. The dose volume histograms were compared for the warped structures that were identical in both warped images. This procedure was repeated for the phantom with full, half full, and empty bladder. Results: The results indicated mean HU differences of up to 120 between registered and ground-truth deformed CT images. However, when the CBCT intensities were calibrated using a region of interest (ROI)-based calibration curve, these differences were reduced by up to 60%. Similarly, the mean differences in average vector field

  4. Validation of a deformable image registration technique for cone beam CT-based dose verification

    International Nuclear Information System (INIS)

    Purpose: As radiation therapy evolves toward more adaptive techniques, image guidance plays an increasingly important role, not only in patient setup but also in monitoring the delivered dose and adapting the treatment to patient changes. This study aimed to validate a method for evaluation of delivered intensity modulated radiotherapy (IMRT) dose based on multimodal deformable image registration (DIR) for prostate treatments. Methods: A pelvic phantom was scanned with CT and cone-beam computed tomography (CBCT). Both images were digitally deformed using two realistic patient-based deformation fields. The original CT was then registered to the deformed CBCT resulting in a secondary deformed CT. The registration quality was assessed as the ability of the DIR method to recover the artificially induced deformations. The primary and secondary deformed CT images as well as vector fields were compared to evaluate the efficacy of the registration method and it’s suitability to be used for dose calculation. PLASTIMATCH, a free and open source software was used for deformable image registration. A B-spline algorithm with optimized parameters was used to achieve the best registration quality. Geometric image evaluation was performed through voxel-based Hounsfield unit (HU) and vector field comparison. For dosimetric evaluation, IMRT treatment plans were created and optimized on the original CT image and recomputed on the two warped images to be compared. The dose volume histograms were compared for the warped structures that were identical in both warped images. This procedure was repeated for the phantom with full, half full, and empty bladder. Results: The results indicated mean HU differences of up to 120 between registered and ground-truth deformed CT images. However, when the CBCT intensities were calibrated using a region of interest (ROI)-based calibration curve, these differences were reduced by up to 60%. Similarly, the mean differences in average vector field

  5. Language-Based Multimodal Displays for the Handover of Control in Autonomous Cars

    OpenAIRE

    Politis, Ioannis; Brewster, Stephen; Pollick, Frank

    2015-01-01

    This paper presents a first evaluation of multimodal language-based warnings for handovers of control in autonomous cars. A set of possible handover situations varying in urgency is described. A set of multimodal, language-based warnings for these situations is then introduced. All combinations of audio, tactile and visual warnings for handovers were evaluated in terms of perceived urgency, annoyance and alerting effectiveness. Results showed clear recognition of the warning urgency in this n...

  6. Multimodal Training of Maintenance and Assembly Skills Based on Augmented Reality

    OpenAIRE

    Webel, Sabine

    2012-01-01

    The main goal of this work is to provide an efficient multimodal training platform for improving technicians’ maintenance and assembly skills in order to accelerate their acquisition process of new maintenance and assembly tasks. A concept for multimodal Augmented Reality based training of maintenance skills has been developed which fulfils the requirements of efficient training. The work presents results of interdisciplinary research based on the fusion of cognitive science and computer scie...

  7. Entropy-Based Block Processing for Satellite Image Registration

    Directory of Open Access Journals (Sweden)

    Ikhyun Lee

    2012-11-01

    Full Text Available Image registration is an important task in many computer vision applications such as fusion systems, 3D shape recovery and earth observation. Particularly, registering satellite images is challenging and time-consuming due to limited resources and large image size. In such scenario, state-of-the-art image registration methods such as scale-invariant feature transform (SIFT may not be suitable due to high processing time. In this paper, we propose an algorithm based on block processing via entropy to register satellite images. The performance of the proposed method is evaluated using different real images. The comparative analysis shows that it not only reduces the processing time but also enhances the accuracy.

  8. Registration-based initialization during radiation therapy planning

    Science.gov (United States)

    Gopalakrishnan, Girish; Mullick, Rakesh

    2007-03-01

    An established challenge in the field of image analysis has been the registration of images having a large initial misalignment. For example in chemo and Radiation Therapy Planning (RTP), there is often a need to register an image delineating a specific anatomy (usually in the surgery position) with that of a whole body image (obtained preoperatively). In such a scenario, there is room for a large misalignment between the two images that are required to be aligned. Large misalignments are traditionally handled in two ways: 1) Semi-automatically with a user initialization or 2) With the help of the origin fields in the image header. The first approach is user dependant and the second method can be used only if the two images are obtained from the same scanner with consistent origins. Our methodology extends a typical registration framework by selecting components that are capable of searching a large parameter space without settling on local optima. We have used an optimizer that is based on an Evolutionary Scheme along with an information theory based similarity metric that can address these needs. The attempt in this study is to convert a large misalignment problem to a small misalignment problem that can then be handled using application specific registration algorithms. Further improvements along local areas can be obtained by subjecting the image to a non-rigid transformation. We have successfully registered the following pairs of images without any user initialization: CTAC - simCT (neuro, lungs); MRPET/ CT (neuro, liver); T2-SPGR (neuro).

  9. Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain

    OpenAIRE

    Yong Yang; Song Tong; Shuying Huang; Pan Lin

    2014-01-01

    Multimodal medical image fusion is a powerful tool in clinical applications such as noninvasive diagnosis, image-guided radiotherapy, and treatment planning. In this paper, a novel nonsubsampled Contourlet transform (NSCT) based method for multimodal medical image fusion is presented, which is approximately shift invariant and can effectively suppress the pseudo-Gibbs phenomena. The source medical images are initially transformed by NSCT followed by fusing low- and high-frequency components. ...

  10. Investigation on Multimode SAR Imaging Based on Digital Array Radar

    Directory of Open Access Journals (Sweden)

    Li Xue-shi

    2014-08-01

    Full Text Available Digital Array Radar (DAR has the ability of simultaneous multimode imaging and has many potential applications. This paper firstly introduces the basic hardware structure and the operation principle of DAR. Combined with the Digital BeamForming (DBF technique, six operational modes that can be used in multimode Synthetic Aperture Radar (SAR imaging are proposed, and the corresponding novel imaging modes are produced. Moreover, the design of the novel imaging modes is introduced in detail. The simulation results confirm the efficiency and precision of the imaging modes.

  11. Bi-objective optimization for multi-modal transportation routing planning problem based on Pareto optimality

    Directory of Open Access Journals (Sweden)

    Yan Sun

    2015-09-01

    Full Text Available Purpose: The purpose of study is to solve the multi-modal transportation routing planning problem that aims to select an optimal route to move a consignment of goods from its origin to its destination through the multi-modal transportation network. And the optimization is from two viewpoints including cost and time. Design/methodology/approach: In this study, a bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. Minimizing the total transportation cost and the total transportation time are set as the optimization objectives of the model. In order to balance the benefit between the two objectives, Pareto optimality is utilized to solve the model by gaining its Pareto frontier. The Pareto frontier of the model can provide the multi-modal transportation operator (MTO and customers with better decision support and it is gained by the normalized normal constraint method. Then, an experimental case study is designed to verify the feasibility of the model and Pareto optimality by using the mathematical programming software Lingo. Finally, the sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case. Findings: The calculation results indicate that the proposed model and Pareto optimality have good performance in dealing with the bi-objective optimization. The sensitivity analysis also shows the influence of the variation of the demand and supply on the multi-modal transportation organization clearly. Therefore, this method can be further promoted to the practice. Originality/value: A bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. The Pareto frontier based sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case.

  12. Polyaffine parametrization of image registration based on geodesic flows

    DEFF Research Database (Denmark)

    Hansen, Michael Sass; Thorup, Signe Strann; Warfield, Simon K.

    2012-01-01

    Image registration based on geodesic flows has gained much popularity in recent years. We describe a novel parametrization of the velocity field in a stationary flow equation. We show that the method offers both precision, flexibility, and simplicity of evaluation. With our representation, which ...... of geodesic shooting for computational anatomy. We avoid to do warp field convolution by interpolation in a dense field, we can easily calculate warp derivatives in a reference frame of choice, and we can consequently avoid interpolation in the image space altogether....

  13. A three-dimensional head-and-neck phantom for validation of multimodality deformable image registration for adaptive radiotherapy

    International Nuclear Information System (INIS)

    Purpose: To develop a three-dimensional (3D) deformable head-and-neck (H and N) phantom with realistic tissue contrast for both kilovoltage (kV) and megavoltage (MV) imaging modalities and use it to objectively evaluate deformable image registration (DIR) algorithms. Methods: The phantom represents H and N patient anatomy. It is constructed from thermoplastic, which becomes pliable in boiling water, and hardened epoxy resin. Using a system of additives, the Hounsfield unit (HU) values of these materials were tuned to mimic anatomy for both kV and MV imaging. The phantom opens along a sagittal midsection to reveal radiotransparent markers, which were used to characterize the phantom deformation. The deformed and undeformed phantoms were scanned with kV and MV imaging modalities. Additionally, a calibration curve was created to change the HUs of the MV scans to be similar to kV HUs, (MC). The extracted ground-truth deformation was then compared to the results of two commercially available DIR algorithms, from Velocity Medical Solutions and MIM software. Results: The phantom produced a 3D deformation, representing neck flexion, with a magnitude of up to 8 mm and was able to represent tissue HUs for both kV and MV imaging modalities. The two tested deformation algorithms yielded vastly different results. For kV–kV registration, MIM produced mean and maximum errors of 1.8 and 11.5 mm, respectively. These same numbers for Velocity were 2.4 and 7.1 mm, respectively. For MV–MV, kV–MV, and kV–MC Velocity produced similar mean and maximum error values. MIM, however, produced gross errors for all three of these scenarios, with maximum errors ranging from 33.4 to 41.6 mm. Conclusions: The application of DIR across different imaging modalities is particularly difficult, due to differences in tissue HUs and the presence of imaging artifacts. For this reason, DIR algorithms must be validated specifically for this purpose. The developed H and N phantom is an effective tool

  14. Two new approaches for image registration based on spatial-temporal relationship

    Institute of Scientific and Technical Information of China (English)

    Deng Zhipeng; Yang Jie; Liu Xiaojun

    2005-01-01

    How to improve the probability of registration and precision of localization is a hard problem, which is desiderated to solve. The two basic approaches (normalized cross-correlation and phase correlation) for image registration are analysed, two improved approaches based on spatial-temporal relationship are presented. This method adds the correlation matrix according to the displacements in x- cirection and y- directions, and the registration pose is searched in the added matrix. The method overcomes the shortcoming that the probability of registration decreasing with area increasing owing to geometric distortion, improves the probability and the robustness of registration.

  15. Facial Emotion Recognition Using Context Based Multimodal Approach

    Directory of Open Access Journals (Sweden)

    Priya Metri

    2011-12-01

    Full Text Available Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user’s emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion . Multimodal system gives more accurate result than a signal or bimodal system

  16. Social Network Extraction and Analysis Based on Multimodal Dyadic Interaction

    OpenAIRE

    Bogdan Raducanu; Sergio Escalera; Xavier Baró; Petia Radeva; Jordi Vitrià

    2012-01-01

    Social interactions are a very important component in people’s lives. Social network analysis has become a common technique used to model and quantify the properties of social interactions. In this paper, we propose an integrated framework to explore the characteristics of a social network extracted from multimodal dyadic interactions. For our study, we used a set of videos belonging to New York Times’ Blogging Heads opinion blog. The Social Network is represented as an oriented graph, whose ...

  17. Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

    Directory of Open Access Journals (Sweden)

    Jing-Yu Yang

    2012-04-01

    Full Text Available When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person’s overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA. Specifically, one person’s different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

  18. Warped document image correction method based on heterogeneous registration strategies

    Science.gov (United States)

    Tong, Lijing; Zhan, Guoliang; Peng, Quanyao; Li, Yang; Li, Yifan

    2013-03-01

    With the popularity of digital camera and the application requirement of digitalized document images, using digital cameras to digitalize document images has become an irresistible trend. However, the warping of the document surface impacts on the quality of the Optical Character Recognition (OCR) system seriously. To improve the warped document image's vision quality and the OCR rate, this paper proposed a warped document image correction method based on heterogeneous registration strategies. This method mosaics two warped images of the same document from different viewpoints. Firstly, two feature points are selected from one image. Then the two feature points are registered in the other image base on heterogeneous registration strategies. At last, image mosaics are done for the two images, and the best mosaiced image is selected by OCR recognition results. As a result, for the best mosaiced image, the distortions are mostly removed and the OCR results are improved markedly. Experimental results show that the proposed method can resolve the issue of warped document image correction more effectively.

  19. Multimodal imaging and in vivo/post mortem co-registration in rodents and non human primates

    International Nuclear Information System (INIS)

    provided information (typically 15-70 μm versus several hundreds μm to several mm for in vivo anatomy and function devices), make post mortem imaging a real advantage over in vivo and a gold standard for macroscopic in vivo studies. However, post mortem imaging does not allow longitudinal follow-up studies, requires brain cutting into serial sections producing up to several hundreds/thousands of histological and autoradiographic data, individual brain sections are spatially separated and 3-D spatial geometry (available with in vivo imaging systems) is lost. These later years, many methods have been proposed in the literature to align 2-D histological or autoradiographic . However, a few works have specifically addressed the registration of post mortem images from two modalities, such as histology and autoradiography or the in vivo/post mortem co-registration. Moreover, despite the diffusion of 3-D reconstruction automated tools, generic and robust algorithms, allowing massive digitization as well as automated data analysis taking advantage of the 3-D anatomo-functional reconstruction, are still missing. Hence, post mortem imaging encompasses low cost, easily available, very accurate methods which main limitations are the very large amounts of data, the duration time for the whole data processing and the loss of volumetric consistency. Thus, without dedicated computer tools able to easily and quickly process them, the analysis of such biological post mortem data is traditionally realized with a limited number of 2-D sections and remains time-consuming and labor-intensive . Our research projects aim at proposing automated image processing protocols of post mortem biological data obtained in rodent and non-human primates in order to reconstruct in 3-D post mortem data and to integrate both in vivo/post mortem and anatomical/functional information. The first project deals with animals presenting small brains such as rodents. It includes the optimized acquisition and the

  20. 2D Satellite Image Registration Using Transform Based and Correlation Based Methods

    OpenAIRE

    Dr. H.B. Kekre, Dr. Tanuja K. Sarode, Ms. Ruhina B. Karani

    2012-01-01

    Image registration is the process of geometrically aligning one image to another image of the same scene taken from different viewpoints or by different sensors. It is a fundamental image processing technique and is very useful in integrating information from different sensors, finding changes in images taken at different times and inferring three-dimensional information from stereo images. Image registration can be done by using two matching method: transform based methods and correlation ba...

  1. 2D Satellite Image Registration Using Transform Based and Correlation Based Methods

    Directory of Open Access Journals (Sweden)

    Dr. H.B. Kekre, Dr. Tanuja K. Sarode, Ms. Ruhina B. Karani

    2012-05-01

    Full Text Available Image registration is the process of geometrically aligning one image to another image of the same scene taken from different viewpoints or by different sensors. It is a fundamental image processing technique and is very useful in integrating information from different sensors, finding changes in images taken at different times and inferring three-dimensional information from stereo images. Image registration can be done by using two matching method: transform based methods and correlation based methods. When image registration is done using correlation based methods like normalized cross correlation, the results are slow. They are also computationally complex and sensitive to the image intensity changes which are caused by noise and varying illumination. In this paper, an unusual form of image registration is proposed which focuses upon using various transforms for fast and accurate image registration. The data set can be a set of photographs, data from various sensors, from different times, or from different viewpoints. The applications of image registration are in the field of computer vision, medical imaging, military automatic target recognition, and in analyzing images and data from satellites. The proposed technique works on satellite images. It tries to find out area of interest by comparing the unregistered image with source image and finding the part that has highest similarity matching. The paper mainly works on the concept of seeking water or land in the stored image. The proposed technique uses different transforms like Discrete Cosine Transform, Discrete Wavelet Transform, HAAR Transform and Walsh transform to achieve accurate image registration. The paper also focuses upon using normalized cross correlation as an area based technique of image registration for the purpose of comparison. The root mean square error is used as similarity measure. Experimental results show that the proposed algorithm can successfully register the

  2. Advanced Impulse Detection & Reduction Based on Multimodal Filter

    Directory of Open Access Journals (Sweden)

    P. Thirumurugan

    2014-07-01

    Full Text Available Impulse noises are occurred in the images during image signal acquisition and processing from one location to another location. In this paper, the optimal detector noise filtering algorithm and its efficient hardware architecture is presented. The proposed architecture comprises of orthogonal direction pattern generation, sorter, thresholder, local binary converter, multimodal filter and pixel converter units respectively. The local binary converter unit detects and corrects the noise pixel efficiently using a simple logic circuit. The design possesses only two line memory buffers with very low computational complexity, thereby reducing the hardware cost and appropriate for several real-time applications.

  3. Learning-Based Approaches to Deformable Image Registration

    OpenAIRE

    Münzing, S.E.A.

    2014-01-01

    Accurate registration of images is an important and often crucial step in many areas of image processing and analysis, yet it is only used in a small percentage of possible applications. Automated registration methods are not considered to be sufficiently robust to handle complex deformations and locally deviating intensities. The motive of this research has therefore been the development of methodology that learns to cope with such situations, from example registrations defined by experts. I...

  4. A Novel Histogram Based Robust Image Registration Technique

    OpenAIRE

    Karthikeyan, V.

    2014-01-01

    In this paper, a method for Automatic Image Registration (AIR) through histogram is proposed. Automatic image registration is one of the crucial steps in the analysis of remotely sensed data. A new acquired image must be transformed, using image registration techniques, to match the orientation and scale of previous related images. This new approach combines several segmentations of the pair of images to be registered. A relaxation parameter on the histogram modes delineation is introduced. I...

  5. 3D Elastic Registration of Ultrasound Images Based on Skeleton Feature

    Institute of Scientific and Technical Information of China (English)

    LI Dan-dan; LIU Zhi-Yan; SHEN Yi

    2005-01-01

    In order to eliminate displacement and elastic deformation between images of adjacent frames in course of 3D ultrasonic image reconstruction, elastic registration based on skeleton feature was adopt in this paper. A new automatically skeleton tracking extract algorithm is presented, which can extract connected skeleton to express figure feature. Feature points of connected skeleton are extracted automatically by accounting topical curvature extreme points several times. Initial registration is processed according to barycenter of skeleton. Whereafter, elastic registration based on radial basis function are processed according to feature points of skeleton. Result of example demonstrate that according to traditional rigid registration, elastic registration based on skeleton feature retain natural difference in shape for organ's different part, and eliminate slight elastic deformation between frames caused by image obtained process simultaneously. This algorithm has a high practical value for image registration in course of 3D ultrasound image reconstruction.

  6. Multispectral Interest Points for RGB-NIR Image Registration

    OpenAIRE

    Firmenich, Damien; Brown, Matthew; Süsstrunk, Sabine

    2011-01-01

    This paper explores the use of joint colour and near-infrared (NIR) information for feature based matching and image registration. In particular, we investigate multispectral generalisations of two popular interest point detectors (Harris and difference of Gaussians), and show that these give a marked improvement in performance when the extra NIR channel is available. We also look at the problem of multimodal RGB to NIR registration, and propose a variant of the SIFT descriptor that gives imp...

  7. Ridge-based retinal image registration algorithm involving OCT fundus images

    Science.gov (United States)

    Li, Ying; Gregori, Giovanni; Knighton, Robert W.; Lujan, Brandon J.; Rosenfeld, Philip J.; Lam, Byron L.

    2011-03-01

    This paper proposes an algorithm for retinal image registration involving OCT fundus images (OFIs). The first application of the algorithm is to register OFIs with color fundus photographs; such registration between multimodal retinal images can help correlate features across imaging modalities, which is important for both clinical and research purposes. The second application is to perform the montage of several OFIs, which allows us to construct 3D OCT images over a large field of view out of separate OCT datasets. We use blood vessel ridges as registration features. The brute force search and an Iterative Closest Point (ICP) algorithm are employed for image pair registration. Global alignment to minimize the distance between matching pixel pairs is used to obtain the montage of OFIs. Quality of OFIs is the big limitation factor of the registration algorithm. In the first experiment, the effect of manual OFI enhancement on registration was evaluated for the affine model on 11 image pairs from diseased eyes. The average root mean square error (RMSE) decreases from 58 μm to 40 μm. This indicates that the registration algorithm is robust to manual enhancement. In the second experiment for the montage of OFIs, the algorithm was tested on 6 sets from healthy eyes and 6 sets from diseased eyes, each set having 8 partially overlapping SD-OCT images. Visual evaluation showed that the montage performance was acceptable for normal cases, and not good for abnormal cases due to low visibility of blood vessels. The average RMSE for a typical montage case from a healthy eye is 2.3 pixels (69 μm).

  8. Relationship between pre-reconstruction filter and accuracy of registration software based on mutual-information maximization. A study of SPECT-MR brain phantom images

    International Nuclear Information System (INIS)

    Image registration technique is becoming an increasingly important tool in SPECT. Recently, software based on mutual-information maximization has been developed for automatic multimodality image registration. The accuracy of the software is important for its application to image registration. During SPECT reconstruction, the projection data are pre-filtered in order to reduce Poisson noise, commonly using a Butterworth filter. We have investigated the dependence of the absolute accuracy of MRI-SPECT registration on the cut-off frequencies of a range of Butterworth filters. This study used a 3D Hoffman phantom (Model No. 9000, Data-spectrum Co.). For the reference volume, an magnetization prepared rapid gradient echo (MPRage) sequence was performed on a Vision MRI (Siemence, 1.5 T). For the floating volumes, SPECT data of a phantom including 99mTc 85 kBq/mL were acquired by a GCA-9300 (Toshiba Medical Systems Co.). During SPECT, the orbito-meatal (OM) line of the phantom was tilted by 5 deg and 15 deg to mimic the incline of a patient's head. The projection data were pre-filtered with Butterworth filters (cut-off frequency varying between 0.24 to 0.94 cycles/cm in 0.02 steps, order 8). The automated registrations were performed using iNRT β version software (Nihon Medi. Co.) and the rotation angles of SPECT for registration were noted. In this study, the registrations of all SPECT data were successful. Graphs of registration rotation angles against cut-off frequencies were scattered and showed no correlation between the two. The registration rotation angles ranged with changing cut-off frequency from -0.4 deg to +3.8 deg at a 5 deg tilt and from +12.7 deg to +19.6 deg at a 15 deg tilt. The registration rotation angles showed variation even for slight differences in cut-off frequencies. The absolute errors were a few degrees for any cut-off frequency. Regardless of the cut-off frequency, automatic registration using this software provides similar results. (author)

  9. Comprehensive Context Recognizer Based on Multimodal Sensors in a Smartphone

    Directory of Open Access Journals (Sweden)

    Sungyoung Lee

    2012-09-01

    Full Text Available Recent developments in smartphones have increased the processing capabilities and equipped these devices with a number of built-in multimodal sensors, including accelerometers, gyroscopes, GPS interfaces, Wi-Fi access, and proximity sensors. Despite the fact that numerous studies have investigated the development of user-context aware applications using smartphones, these applications are currently only able to recognize simple contexts using a single type of sensor. Therefore, in this work, we introduce a comprehensive approach for context aware applications that utilizes the multimodal sensors in smartphones. The proposed system is not only able to recognize different kinds of contexts with high accuracy, but it is also able to optimize the power consumption since power-hungry sensors can be activated or deactivated at appropriate times. Additionally, the system is able to recognize activities wherever the smartphone is on a human’s body, even when the user is using the phone to make a phone call, manipulate applications, play games, or listen to music. Furthermore, we also present a novel feature selection algorithm for the accelerometer classification module. The proposed feature selection algorithm helps select good features and eliminates bad features, thereby improving the overall accuracy of the accelerometer classifier. Experimental results show that the proposed system can classify eight activities with an accuracy of 92.43%.

  10. Registration of point cloud data for HDD stamped base inspection

    Science.gov (United States)

    Suh, Sungho; Cho, Hansang

    2015-09-01

    As a part of the HDD manufacturing process, HDD stamped base, an exterior container, is one of the most essential components in which various parts become assembled to compose a hard disk drive (HDD). Height errors that are caused by pressing, breaking or cracking can occur on the base, because it is designed by a stamping method. In order to detect the height errors, the inspection process is essential in the production fields. In the current industry, CMM (Coordinate Measurement Machine) is one of the representative machines that inspect certain regions on the product. The machine probes a designated point by an operator and judges the defect by comparing the height of the point to the originally designed height. However, the method takes much time to inspect each designated point resulting in a total of 17 minutes. In order to reduce the total inspection time, we propose an inspection method using 3D point cloud data acquired from a holographic sensor. To compare the height from acquired 3D point cloud data with the one from the originally designed CAD data, the exact point cloud registration is important. There are differences between 2D image registration and 3D point cloud registration, such as translation on each plane, rotation, tilt, and nonlinear transformations. The relationship between the acquired 3D point cloud data and the originally designed CAD data can be obtained by projective transformation. If the projective transformation matrix between the two is obtained, 3D point cloud data registration can be performed. In order to calculate 3D projective transformation matrix, corresponding points between 3D point cloud data and CAD data are required. To find the corresponding points, we use the height map which is projected from 3D point cloud data onto XY plane. The height map has pixel intensity from the height value of each point. If the height maps from 3D point cloud data and CAD data are matched, corresponding points can be estimated. As one of the

  11. Multiscale Combination of Physically-Based Registration and Deformation Modeling

    Energy Technology Data Exchange (ETDEWEB)

    Tsap, L.; Goldgof, D.B.; Sarkar, S.

    1999-11-08

    In this paper the authors present a novel multiscale approach to recovery of nonrigid motion from sequences of registered intensity and range images. The main idea of the approach is that a finite element (FEM) model can naturally handle both registration and deformation modeling using a single model-driving strategy. The method includes a multiscale iterative algorithm based on analysis of the undirected Hausdorff distance to recover correspondences. The method is evaluated with respect to speed, accuracy, and noise sensitivity. Advantages of the proposed approach are demonstrated using man-made elastic materials and human skin motion. Experiments with regular grid features are used for performance comparison with a conventional approach (separate snakes and FEM models). It is shown that the new method does not require a grid and can adapt the model to available object features.

  12. A Novel Technique Based on Node Registration in MANETs

    Directory of Open Access Journals (Sweden)

    Rashid Jalal Qureshi

    2012-09-01

    Full Text Available In ad hoc network communication links between the nodes are wireless and each node acts as a router for the other node and packet is forward from one node to other. This type of networks helps in solving challenges and problems that may arise in every day communication. Mobile Ad Hoc Networks is a new field of research and it is particularly useful in situations where network infrastructure is costly. Protecting MANETs from security threats is a challenging task because of the MANETs dynamic topology. Every node in a MANETs is independent and is free to move in any direction, therefore change its connections to other nodes frequently. Due to its decentralized nature different types of attacks can be occur. The aim of this research paper is to investigate different MANETs security attacks and proposed nodes registration based technique by using cryptography functions.

  13. Feature fusion in multimodal recognition based on ear and profile face

    Science.gov (United States)

    Pan, Xiuqin; Xu, Xiaona; Lu, Yong; Cao, Yongcun

    2008-10-01

    Because of ear's special physiological structure and location, it is reasonable to combine ear with profile face for recognition in such scenarios as frontal face images are not available. In this paper, a novel method of multimodal recognition fusing ear and profile face based on kernel principal component analysis is proposed. With the algorithm, the fusion feature vectors of ear and profile face are established and nonlinear feature fusion projection could be implemented. The experimental results show that multimodal recognition fusing both ear and profile face results in improvement over either ear or profile face unimodal recognition.

  14. Photonic Crystal Waveguide Intersection Based on Self-Imaging of Multi-Mode Interference

    Institute of Scientific and Technical Information of China (English)

    DING Wei-Qiang; TANG Dong-Hua; CHEN Li-Xue; ZHAO Yuan; Liu Yan

    2007-01-01

    @@ A new mechanism of intersection formed by two line defect photonic crystal (PC) waveguides are numerically investigated using the finite-difference time-domain method. The results show that the normalized crosstalk is smaller than 10-4; the reflection is smaller than 10-3, and the transmission is larger than 0.999. The authors analyse the physical origins and find that a modified self-imaging process in the intersected multi-mode region is the main reason of the excellent performance. This kind of multi-mode interference based intersection may find potential applications in PC optical circuits.

  15. Learning-Based Approaches to Deformable Image Registration

    NARCIS (Netherlands)

    Munzing, S.E.A.

    2014-01-01

    Accurate registration of images is an important and often crucial step in many areas of image processing and analysis, yet it is only used in a small percentage of possible applications. Automated registration methods are not considered to be sufficiently robust to handle complex deformations and lo

  16. Automatic PET-CT Image Registration Method Based on Mutual Information and Genetic Algorithms

    OpenAIRE

    Martina Marinelli; Vincenzo Positano; Francesco Tucci; Danilo Neglia; Luigi Landini

    2012-01-01

    Hybrid PET/CT scanners can simultaneously visualize coronary artery disease as revealed by computed tomography (CT) and myocardial perfusion as measured by positron emission tomography (PET). Manual registration is usually required in clinical practice to compensate spatial mismatch between datasets. In this paper, we present a registration algorithm that is able to automatically align PET/CT cardiac images. The algorithm bases on mutual information (MI) as registration metric and on genetic ...

  17. Registration of structurally dissimilar images in MRI-based brachytherapy

    International Nuclear Information System (INIS)

    A serious challenge in image registration is the accurate alignment of two images in which a certain structure is present in only one of the two. Such topological changes are problematic for conventional non-rigid registration algorithms. We propose to incorporate in a conventional free-form registration framework a geometrical penalty term that minimizes the volume of the missing structure in one image. We demonstrate our method on cervical MR images for brachytherapy. The intrapatient registration problem involves one image in which a therapy applicator is present and one in which it is not. By including the penalty term, a substantial improvement in the surface distance to the gold standard anatomical position and the residual volume of the applicator void are obtained. Registration of neighboring structures, i.e. the rectum and the bladder is generally improved as well, albeit to a lesser degree. (paper)

  18. Social Network Extraction and Analysis Based on Multimodal Dyadic Interaction

    Directory of Open Access Journals (Sweden)

    Bogdan Raducanu

    2012-02-01

    Full Text Available Social interactions are a very important component in people’s lives. Social network analysis has become a common technique used to model and quantify the properties of social interactions. In this paper, we propose an integrated framework to explore the characteristics of a social network extracted from multimodal dyadic interactions. For our study, we used a set of videos belonging to New York Times’ Blogging Heads opinion blog. The Social Network is represented as an oriented graph, whose directed links are determined by the Influence Model. The links’ weights are a measure of the “influence” a person has over the other. The states of the Influence Model encode automatically extracted audio/visual features from our videos using state-of-the art algorithms. Our results are reported in terms of accuracy of audio/visual data fusion for speaker segmentation and centrality measures used to characterize the extracted social network.

  19. A Randomized Trial of a Multimodal Community-Based Prisoner Reentry Program Emphasizing Substance Abuse Treatment

    Science.gov (United States)

    Grommon, Eric; Davidson, William S., II; Bynum, Timothy S.

    2013-01-01

    Prisoner reentry programs continue to be developed and implemented to ease the process of transition into the community and to curtail fiscal pressures. This study describes and provides relapse and recidivism outcome findings related to a randomized trial evaluating a multimodal, community-based reentry program that prioritized substance abuse…

  20. Student's Uncertainty Modeling through a Multimodal Sensor-Based Approach

    Science.gov (United States)

    Jraidi, Imene; Frasson, Claude

    2013-01-01

    Detecting the student internal state during learning is a key construct in educational environment and particularly in Intelligent Tutoring Systems (ITS). Students' uncertainty is of primary interest as it is deeply rooted in the process of knowledge construction. In this paper we propose a new sensor-based multimodal approach to model…

  1. Predicting the Attitude Flow in Dialogue Based on Multi-Modal Speech Cues

    DEFF Research Database (Denmark)

    Juel Henrichsen, Peter; Allwood, Jens

    We present our experiments on attitude detection based on annotated multi-modal dialogue data1. Our long-term goal is to establish a computational model able to predict the attitudinal patterns in humanhuman dialogue. We believe, such prediction algorithms are useful tools in the pursuit of reali...

  2. Using Interdisciplinary, Project-Based, Multimodal Activities to Facilitate Literacy across the Content Areas

    Science.gov (United States)

    Hill, Archie E.

    2014-01-01

    Tour Across America is an interdisciplinary, project-based, multimodal (IPM) activity where students get the opportunity to apply what they learn to a real-life situation while illustrating the interdisciplinary nature of literacy. It provides students with a high-interest, creative platform to review, reinforce, and integrate learned literacy…

  3. Modeling the Multicommodity Multimodal Routing Problem with Schedule-Based Services and Carbon Dioxide Emission Costs

    Directory of Open Access Journals (Sweden)

    Yan Sun

    2015-01-01

    Full Text Available We explore a freight routing problem wherein the aim is to assign optimal routes to move commodities through a multimodal transportation network. This problem belongs to the operational level of service network planning. The following formulation characteristics will be comprehensively considered: (1 multicommodity flow routing; (2 a capacitated multimodal transportation network with schedule-based rail services and time-flexible road services; (3 carbon dioxide emissions consideration; and (4 a generalized costs optimum oriented to customer demands. The specific planning of freight routing is thus defined as a capacitated time-sensitive multicommodity multimodal generalized shortest path problem. To solve this problem systematically, we first establish a node-arc-based mixed integer nonlinear programming model that combines the above formulation characteristics in a comprehensive manner. Then, we develop a linearization method to transform the proposed model into a linear one. Finally, a computational experiment from the Chinese inland container export business is presented to demonstrate the feasibility of the model and linearization method. The computational results indicate that implementing the proposed model and linearization method in the mathematical programming software Lingo can effectively solve the large-scale practical multicommodity multimodal transportation routing problem.

  4. Quick Web Services Lookup Model Based on Hierarchical Registration

    Institute of Scientific and Technical Information of China (English)

    谢山; 朱国进; 陈家训

    2003-01-01

    Quick Web Services Lookup (Q-WSL) is a new model to registration and lookup of complex services in the Internet. The model is designed to quickly find complex Web services by using hierarchical registration method. The basic concepts of Web services system are introduced and presented, and then the method of hierarchical registration of services is described. In particular, service query document description and service lookup procedure are concentrated, and it addresses how to lookup these services which are registered in the Web services system. Furthermore, an example design and an evaluation of its performance are presented.Specifically, it shows that the using of attributionbased service query document design and contentbased hierarchical registration in Q-WSL allows service requesters to discover needed services more flexibly and rapidly. It is confirmed that Q-WSL is very suitable for Web services system.

  5. Population based ranking of frameless CT-MRI registration methods

    Energy Technology Data Exchange (ETDEWEB)

    Opposits, Gabor; Kis, Sandor A.; Tron, Lajos; Emri, Miklos [Debrecen Univ. (Hungary). Dept. of Nuclear Medicine; Berenyi, Ervin [Debrecen Univ. (Hungary). Dept. of Biomedical Laboratory and Imaging Science; Takacs, Endre [Rotating Gamma Ltd., Debrecen (Hungary); Dobai, Jozsef G.; Bognar, Laszlo [Debrecen Univ., Medical Center (Hungary). Dept. of Neurosurgery; Szuecs, Bernadett [ScanoMed Ltd., Debrecen (Hungary)

    2015-07-01

    Clinical practice often requires simultaneous information obtained by two different imaging modalities. Registration algorithms are commonly used for this purpose. Automated procedures are very helpful in cases when the same kind of registration has to be performed on images of a high number of subjects. Radiotherapists would prefer to use the best automated method to assist therapy planning, however there are not accepted procedures for ranking the different registration algorithms. We were interested in developing a method to measure the population level performance of CT-MRI registration algorithms by a parameter of values in the [0,1] interval. Pairs of CT and MRI images were collected from 1051 subjects. Results of an automated registration were corrected manually until a radiologist and a neurosurgeon expert both accepted the result as good. This way 1051 registered MRI images were produced by the same pair of experts to be used as gold standards for the evaluation of the performance of other registration algorithms. Pearson correlation coefficient, mutual information, normalized mutual information, Kullback-Leibler divergence, L{sub 1} norm and square L{sub 2} norm (dis)similarity measures were tested for sensitivity to indicate the extent of (dis)similarity of a pair of individual mismatched images. The square Hellinger distance proved suitable to grade the performance of registration algorithms at population level providing the developers with a valuable tool to rank algorithms. The developed procedure provides an objective method to find the registration algorithm performing the best on the population level out of newly constructed or available preselected ones.

  6. Population based ranking of frameless CT-MRI registration methods

    International Nuclear Information System (INIS)

    Clinical practice often requires simultaneous information obtained by two different imaging modalities. Registration algorithms are commonly used for this purpose. Automated procedures are very helpful in cases when the same kind of registration has to be performed on images of a high number of subjects. Radiotherapists would prefer to use the best automated method to assist therapy planning, however there are not accepted procedures for ranking the different registration algorithms. We were interested in developing a method to measure the population level performance of CT-MRI registration algorithms by a parameter of values in the [0,1] interval. Pairs of CT and MRI images were collected from 1051 subjects. Results of an automated registration were corrected manually until a radiologist and a neurosurgeon expert both accepted the result as good. This way 1051 registered MRI images were produced by the same pair of experts to be used as gold standards for the evaluation of the performance of other registration algorithms. Pearson correlation coefficient, mutual information, normalized mutual information, Kullback-Leibler divergence, L1 norm and square L2 norm (dis)similarity measures were tested for sensitivity to indicate the extent of (dis)similarity of a pair of individual mismatched images. The square Hellinger distance proved suitable to grade the performance of registration algorithms at population level providing the developers with a valuable tool to rank algorithms. The developed procedure provides an objective method to find the registration algorithm performing the best on the population level out of newly constructed or available preselected ones.

  7. Multimodal System Based on Electrooculography and Voice Recognition to Control a Robot Arm

    Directory of Open Access Journals (Sweden)

    José A. Martínez

    2013-07-01

    Full Text Available People with severe motor disorders cannot use their arms and/or hands to interact with the environment. In such cases, a human‐machine interface can be used to allow these people to perform activities of daily life. Voice recognition would be the best method to control a device devoted to help with these tasks, but this method is very dependent on the background noise and, under certain circumstances, it cannot be used successfully. In this sense, other methods must be included in the system to assist the voice recognition module. In this project, electrooculography (EOG has been selected due to its stability and robustness. This way, a multimodal system based on EOG and voice recognition has been developed to control a robotic arm. This paper presents the procedures designed to combine both methods to create a multimodal interface useful for disabled people. Tests presented in this document compare the skills of five different users while controlling the robotic arm to perform pick‐and‐place tasks. Task duration and accuracy have been measured to obtain specific scores that are used to evaluate both interaction methods independently and the multimodal combination of them. The system works successfully using both methods (EOG and voice recognition. In addition, the multimodal interface improves robustness and reduces the uncertainty generated by the environment when there is background noise.

  8. A CNN based Hybrid approach towards automatic image registration

    Science.gov (United States)

    Arun, Pattathal V.; Katiyar, Sunil K.

    2013-06-01

    Image registration is a key component of various image processing operations which involve the analysis of different image data sets. Automatic image registration domains have witnessed the application of many intelligent methodologies over the past decade; however inability to properly model object shape as well as contextual information had limited the attainable accuracy. In this paper, we propose a framework for accurate feature shape modeling and adaptive resampling using advanced techniques such as Vector Machines, Cellular Neural Network (CNN), SIFT, coreset, and Cellular Automata. CNN has found to be effective in improving feature matching as well as resampling stages of registration and complexity of the approach has been considerably reduced using corset optimization The salient features of this work are cellular neural network approach based SIFT feature point optimisation, adaptive resampling and intelligent object modelling. Developed methodology has been compared with contemporary methods using different statistical measures. Investigations over various satellite images revealed that considerable success was achieved with the approach. System has dynamically used spectral and spatial information for representing contextual knowledge using CNN-prolog approach. Methodology also illustrated to be effective in providing intelligent interpretation and adaptive resampling. Rejestracja obrazu jest kluczowym składnikiem różnych operacji jego przetwarzania. W ostatnich latach do automatycznej rejestracji obrazu wykorzystuje się metody sztucznej inteligencji, których największą wadą, obniżającą dokładność uzyskanych wyników jest brak możliwości dobrego wymodelowania kształtu i informacji kontekstowych. W niniejszej pracy zaproponowano zasady dokładnego modelowania kształtu oraz adaptacyjnego resamplingu z wykorzystaniem zaawansowanych technik, takich jak Vector Machines (VM), komórkowa sieć neuronowa (CNN), przesiewanie (SIFT), Coreset i

  9. Fast time-of-flight camera based surface registration for radiotherapy patient positioning

    International Nuclear Information System (INIS)

    Purpose: This work introduces a rigid registration framework for patient positioning in radiotherapy, based on real-time surface acquisition by a time-of-flight (ToF) camera. Dynamic properties of the system are also investigated for future gating/tracking strategies. Methods: A novel preregistration algorithm, based on translation and rotation-invariant features representing surface structures, was developed. Using these features, corresponding three-dimensional points were computed in order to determine initial registration parameters. These parameters became a robust input to an accelerated version of the iterative closest point (ICP) algorithm for the fine-tuning of the registration result. Distance calibration and Kalman filtering were used to compensate for ToF-camera dependent noise. Additionally, the advantage of using the feature based preregistration over an ''ICP only'' strategy was evaluated, as well as the robustness of the rigid-transformation-based method to deformation. Results: The proposed surface registration method was validated using phantom data. A mean target registration error (TRE) for translations and rotations of 1.62 ± 1.08 mm and 0.07 deg. ± 0.05 deg., respectively, was achieved. There was a temporal delay of about 65 ms in the registration output, which can be seen as negligible considering the dynamics of biological systems. Feature based preregistration allowed for accurate and robust registrations even at very large initial displacements. Deformations affected the accuracy of the results, necessitating particular care in cases of deformed surfaces. Conclusions: The proposed solution is able to solve surface registration problems with an accuracy suitable for radiotherapy cases where external surfaces offer primary or complementary information to patient positioning. The system shows promising dynamic properties for its use in gating/tracking applications. The overall system is competitive with commonly-used surface registration

  10. Free-form deformation based non-rigid registration on breast cancer MR imaging

    Science.gov (United States)

    Zhang, Liangbin; Suo, Shiteng; Lu, Xuesong; Li, Yuehua; Chen, Li; Zhang, Su

    2013-07-01

    High-Intensity Focused Ultrasound treatment combined with magnetic resonance technology (MRI-guided HIFU, MRgHIFU) can protect the thermal ablation without harming the surrounding tissue by using MRI for target positioning, where image registration plays an important role in the implementation of precise treatment. In this paper, we apply three-dimension free-form deformation non-rigid registration on treatment plan amendments and tracking of breast cancer. Free-form deformation based and demons based non-rigid registration are respectively employed on breast cancer MR imaging required at different times before and after for comparison. The results of the experiments show that the registration performed on the breast tumor image data with slight and larger deformation is effective, and the mutual information of the ROI increased from 1.49 before registration to 1.53.

  11. Co-Registration Airborne LIDAR Point Cloud Data and Synchronous Digital Image Registration Based on Combined Adjustment

    Science.gov (United States)

    Yang, Z. H.; Zhang, Y. S.; Zheng, T.; Lai, W. B.; Zou, Z. R.; Zou, B.

    2016-06-01

    Aim at the problem of co-registration airborne laser point cloud data with the synchronous digital image, this paper proposed a registration method based on combined adjustment. By integrating tie point, point cloud data with elevation constraint pseudo observations, using the principle of least-squares adjustment to solve the corrections of exterior orientation elements of each image, high-precision registration results can be obtained. In order to ensure the reliability of the tie point, and the effectiveness of pseudo observations, this paper proposed a point cloud data constrain SIFT matching and optimizing method, can ensure that the tie points are located on flat terrain area. Experiments with the airborne laser point cloud data and its synchronous digital image, there are about 43 pixels error in image space using the original POS data. If only considering the bore-sight of POS system, there are still 1.3 pixels error in image space. The proposed method regards the corrections of the exterior orientation elements of each image as unknowns and the errors are reduced to 0.15 pixels.

  12. Design and fabrication of multimode interference couplers based on digital micro-mirror system

    Science.gov (United States)

    Wu, Sumei; He, Xingdao; Shen, Chenbo

    2008-03-01

    Multimode interference (MMI) couplers, based on the self-imaging effect (SIE), are accepted popularly in integrated optics. According to the importance of MMI devices, in this paper, we present a novel method to design and fabricate MMI couplers. A technology of maskless lithography to make MMI couplers based on a smart digital micro-mirror device (DMD) system is proposed. A 1×4 MMI device is designed as an example, which shows the present method is efficient and cost-effective.

  13. Computer-aided psychotherapy based on multimodal elicitation, estimation and regulation of emotion.

    Science.gov (United States)

    Cosić, Krešimir; Popović, Siniša; Horvat, Marko; Kukolja, Davor; Dropuljić, Branimir; Kovač, Bernard; Jakovljević, Miro

    2013-09-01

    Contemporary psychiatry is looking at affective sciences to understand human behavior, cognition and the mind in health and disease. Since it has been recognized that emotions have a pivotal role for the human mind, an ever increasing number of laboratories and research centers are interested in affective sciences, affective neuroscience, affective psychology and affective psychopathology. Therefore, this paper presents multidisciplinary research results of Laboratory for Interactive Simulation System at Faculty of Electrical Engineering and Computing, University of Zagreb in the stress resilience. Patient's distortion in emotional processing of multimodal input stimuli is predominantly consequence of his/her cognitive deficit which is result of their individual mental health disorders. These emotional distortions in patient's multimodal physiological, facial, acoustic, and linguistic features related to presented stimulation can be used as indicator of patient's mental illness. Real-time processing and analysis of patient's multimodal response related to annotated input stimuli is based on appropriate machine learning methods from computer science. Comprehensive longitudinal multimodal analysis of patient's emotion, mood, feelings, attention, motivation, decision-making, and working memory in synchronization with multimodal stimuli provides extremely valuable big database for data mining, machine learning and machine reasoning. Presented multimedia stimuli sequence includes personalized images, movies and sounds, as well as semantically congruent narratives. Simultaneously, with stimuli presentation patient provides subjective emotional ratings of presented stimuli in terms of subjective units of discomfort/distress, discrete emotions, or valence and arousal. These subjective emotional ratings of input stimuli and corresponding physiological, speech, and facial output features provides enough information for evaluation of patient's cognitive appraisal deficit

  14. Hybrid registration of PET/CT in thoracic region with pre-filtering PET sinogram

    Science.gov (United States)

    Mokri, S. S.; Saripan, M. I.; Marhaban, M. H.; Nordin, A. J.; Hashim, S.

    2015-11-01

    The integration of physiological (PET) and anatomical (CT) images in cancer delineation requires an accurate spatial registration technique. Although hybrid PET/CT scanner is used to co-register these images, significant misregistrations exist due to patient and respiratory/cardiac motions. This paper proposes a hybrid feature-intensity based registration technique for hybrid PET/CT scanner. First, simulated PET sinogram was filtered with a 3D hybrid mean-median before reconstructing the image. The features were then derived from the segmented structures (lung, heart and tumor) from both images. The registration was performed based on modified multi-modality demon registration with multiresolution scheme. Apart from visual observations improvements, the proposed registration technique increased the normalized mutual information index (NMI) between the PET/CT images after registration. All nine tested datasets show marked improvements in mutual information (MI) index than free form deformation (FFD) registration technique with the highest MI increase is 25%.

  15. Improvement of registration accuracy in accelerated partial breast irradiation using the point-based rigid-body registration algorithm for patients with implanted fiducial markers

    Energy Technology Data Exchange (ETDEWEB)

    Inoue, Minoru; Yoshimura, Michio, E-mail: myossy@kuhp.kyoto-u.ac.jp; Sato, Sayaka; Nakamura, Mitsuhiro; Yamada, Masahiro; Hirata, Kimiko; Ogura, Masakazu; Hiraoka, Masahiro [Department of Radiation Oncology and Image-Applied Therapy, Kyoto University Graduate School of Medicine, Kyoto 606-8507 (Japan); Sasaki, Makoto; Fujimoto, Takahiro [Division of Clinical Radiology Service, Kyoto University Hospital, Kyoto 606-8507 (Japan)

    2015-04-15

    Purpose: To investigate image-registration errors when using fiducial markers with a manual method and the point-based rigid-body registration (PRBR) algorithm in accelerated partial breast irradiation (APBI) patients, with accompanying fiducial deviations. Methods: Twenty-two consecutive patients were enrolled in a prospective trial examining 10-fraction APBI. Titanium clips were implanted intraoperatively around the seroma in all patients. For image-registration, the positions of the clips in daily kV x-ray images were matched to those in the planning digitally reconstructed radiographs. Fiducial and gravity registration errors (FREs and GREs, respectively), representing resulting misalignments of the edge and center of the target, respectively, were compared between the manual and algorithm-based methods. Results: In total, 218 fractions were evaluated. Although the mean FRE/GRE values for the manual and algorithm-based methods were within 3 mm (2.3/1.7 and 1.3/0.4 mm, respectively), the percentages of fractions where FRE/GRE exceeded 3 mm using the manual and algorithm-based methods were 18.8%/7.3% and 0%/0%, respectively. Manual registration resulted in 18.6% of patients with fractions of FRE/GRE exceeding 5 mm. The patients with larger clip deviation had significantly more fractions showing large FRE/GRE using manual registration. Conclusions: For image-registration using fiducial markers in APBI, the manual registration results in more fractions with considerable registration error due to loss of fiducial objectivity resulting from their deviation. The authors recommend the PRBR algorithm as a safe and effective strategy for accurate, image-guided registration and PTV margin reduction.

  16. Automatic Mrf-Based Registration of High Resolution Satellite Video Data

    Science.gov (United States)

    Platias, C.; Vakalopoulou, M.; Karantzalos, K.

    2016-06-01

    In this paper we propose a deformable registration framework for high resolution satellite video data able to automatically and accurately co-register satellite video frames and/or register them to a reference map/image. The proposed approach performs non-rigid registration, formulates a Markov Random Fields (MRF) model, while efficient linear programming is employed for reaching the lowest potential of the cost function. The developed approach has been applied and validated on satellite video sequences from Skybox Imaging and compared with a rigid, descriptor-based registration method. Regarding the computational performance, both the MRF-based and the descriptor-based methods were quite efficient, with the first one converging in some minutes and the second in some seconds. Regarding the registration accuracy the proposed MRF-based method significantly outperformed the descriptor-based one in all the performing experiments.

  17. Researchers and teachers learning together and from each other using video-based multimodal analysis

    DEFF Research Database (Denmark)

    Davidsen, Jacob; Vanderlinde, Ruben

    2014-01-01

    integrated touch-screens into their teaching and learning. This paper examines the methodological usefulness of video-based multimodal analysis. Through reflection on the research project, we discuss how, by using video-based multimodal analysis, researchers and teachers can study children’s touch-screen......This paper discusses a year-long technology integration project, during which teachers and researchers joined forces to explore children’s collaborative activities through the use of touch-screens. In the research project, discussed in this paper, 16 touch-screens were integrated into teaching and...... learning activities in two separate classrooms; the learning and collaborative processes were captured by using video, collecting over 150 hours of footage. By using digital research technologies and a longitudinal design, the authors of the research project studied how teachers and children gradually...

  18. A Multistage Approach for Image Registration.

    Science.gov (United States)

    Bowen, Francis; Hu, Jianghai; Du, Eliza Yingzi

    2016-09-01

    Successful image registration is an important step for object recognition, target detection, remote sensing, multimodal content fusion, scene blending, and disaster assessment and management. The geometric and photometric variations between images adversely affect the ability for an algorithm to estimate the transformation parameters that relate the two images. Local deformations, lighting conditions, object obstructions, and perspective differences all contribute to the challenges faced by traditional registration techniques. In this paper, a novel multistage registration approach is proposed that is resilient to view point differences, image content variations, and lighting conditions. Robust registration is realized through the utilization of a novel region descriptor which couples with the spatial and texture characteristics of invariant feature points. The proposed region descriptor is exploited in a multistage approach. A multistage process allows the utilization of the graph-based descriptor in many scenarios thus allowing the algorithm to be applied to a broader set of images. Each successive stage of the registration technique is evaluated through an effective similarity metric which determines subsequent action. The registration of aerial and street view images from pre- and post-disaster provide strong evidence that the proposed method estimates more accurate global transformation parameters than traditional feature-based methods. Experimental results show the robustness and accuracy of the proposed multistage image registration methodology. PMID:26292357

  19. Multi-modal label-free imaging based on a femtosecond fiber laser

    OpenAIRE

    Xie, Ruxin; Su, Jue; Rentchler, Eric C.; Zhang, Ziyan; Johnson, Carey K.; Shi, Honglian; Hui, Rongqing

    2014-01-01

    We demonstrate multi-mode microscopy based on a single femtosecond fiber laser. Coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS) and photothermal images can be obtained simultaneously with this simplified setup. Distributions of lipid and hemoglobin in sliced mouse brain samples and blood cells are imaged. The dependency of signal amplitude on the pump power and pump modulation frequency is characterized, which allows to isolate the impact from different contrib...

  20. Multi-Modality Medical Image Fusion Based on Wavelet Analysis and Quality Evaluation

    Institute of Scientific and Technical Information of China (English)

    2001-01-01

    Multi-modality medical image fusion has more and more important applications in medical image analysisand understanding. In this paper, we develop and apply a multi-resolution method based on wavelet pyramid to fusemedical images from different modalities such as PET-MRI and CT-MRI. In particular, we evaluate the different fusionresults when applying different selection rules and obtain optimum combination of fusion parameters.

  1. Gel-based Multimodality (CT/MR) Phantoms for Ion Radiotherapy

    OpenAIRE

    Niebuhr, Nina Isabelle

    2012-01-01

    The importance of magnetic resonance imaging (MRI) in radiation therapy (RT) has been increasing over the past years. In ion RT, due to its high accuracy and sensitivity to small uncertainties, the treatment planning process based on computed tomography (CT) is currently extended towards MRI. For exploring the potential of new imaging techniques (such as MRI) multimodality phantoms are mandatory. Hereby, interaction properties with photon and ion radiation have to be adjusted i...

  2. DPSK signals demodulation based on a multimode fiber with a central dip

    OpenAIRE

    CHEN Xiaoyong; Rodriguez Horche, Paloma; Martín Minguez, Alfredo

    2014-01-01

    Differential Phase Shift Keying (DPSK) modulation format has been shown as a robust solution for next-generation optical transmission systems. One key device enabling such systems is a delay interferometer, converting the phase modulation signal into the intensity modulation signal to be detected by the photodiodes. Usually, a standard Mach-Zehnder interferometer (MZI) is used for demodulating a DPSK signal. In this paper, we develop an MZI which is based on all-fiber Multimode Interference (...

  3. A tunable comb filter using single-mode/multimode/polarization-maintaining-fiber-based Sagnac fiber loop

    Institute of Scientific and Technical Information of China (English)

    Ruan Juan; Zhang Wei-Gang; Zhang Hao; Geng Peng-Cheng; Bai Zhi-Yong

    2013-01-01

    A novel tunable comb filter composed of a single-mode/multimode/polarization-maintaining-fiber-based Sagnac fiber loop is proposed and experimentally demonstrated.The filter tunability is achieved by rotating the polarization controller.The spectral shift is dependent on rotation direction and the position of the polarization controller.In addition,the adjustable range achieved by rotating the half-wave-plate polarization controller is twice higher than that of the quarter-wave-plate one.

  4. A new web-based educational tool for training in multimodal cardiac imaging

    OpenAIRE

    Todiere, Giancarlo; L Abbate, Giuseppe Andrea; Positano, Vincenzo; Zingoni, Gloria; Esposito, Natalia; Puzzuoli, Stefano; Neglia, Danilo; Marcheschi, Paolo; Marinelli, Martina

    2012-01-01

    Purpose: The dynamic evolution of cardiac multimodal imaging is based on the increasing clinical interest on the use of different and complementary data to evaluate cardiac diseases. This is supported by the development of technologies related to single or hybrid imaging devices. The increasing use of combined imaging for diagnosis and clinical decision requires to choose an appropriate diagnostic path combining, step by step, invasive and/or noninvasive tests. The cost- risk- benefits balanc...

  5. Content-Based Medical Image Retrieval: A Survey of Applications to Multidimensional and Multimodality Data

    OpenAIRE

    Kumar, Ashnil; Kim, Jinman; Cai, Weidong; Fulham, Michael; Feng, Dagan

    2013-01-01

    Medical imaging is fundamental to modern healthcare, and its widespread use has resulted in the creation of image databases, as well as picture archiving and communication systems. These repositories now contain images from a diverse range of modalities, multidimensional (three-dimensional or time-varying) images, as well as co-aligned multimodality images. These image collections offer the opportunity for evidence-based diagnosis, teaching, and research; for these applications, there is a re...

  6. A nonlinear biomechanical model based registration method for aligning prone and supine MR breast images.

    Science.gov (United States)

    Han, Lianghao; Hipwell, John H; Eiben, Björn; Barratt, Dean; Modat, Marc; Ourselin, Sebastien; Hawkes, David J

    2014-03-01

    Preoperative diagnostic magnetic resonance (MR) breast images can provide good contrast between different tissues and 3-D information about suspicious tissues. Aligning preoperative diagnostic MR images with a patient in the theatre during breast conserving surgery could assist surgeons in achieving the complete excision of cancer with sufficient margins. Typically, preoperative diagnostic MR breast images of a patient are obtained in the prone position, while surgery is performed in the supine position. The significant shape change of breasts between these two positions due to gravity loading, external forces and related constraints makes the alignment task extremely difficult. Our previous studies have shown that either nonrigid intensity-based image registration or biomechanical modelling alone are limited in their ability to capture such a large deformation. To tackle this problem, we proposed in this paper a nonlinear biomechanical model-based image registration method with a simultaneous optimization procedure for both the material parameters of breast tissues and the direction of the gravitational force. First, finite element (FE) based biomechanical modelling is used to estimate a physically plausible deformation of the pectoral muscle and the major deformation of breast tissues due to gravity loading. Then, nonrigid intensity-based image registration is employed to recover the remaining deformation that FE analyses do not capture due to the simplifications and approximations of biomechanical models and the uncertainties of external forces and constraints. We assess the registration performance of the proposed method using the target registration error of skin fiducial markers and the Dice similarity coefficient (DSC) of fibroglandular tissues. The registration results on prone and supine MR image pairs are compared with those from two alternative nonrigid registration methods for five breasts. Overall, the proposed algorithm achieved the best registration

  7. Comparison of landmark-based and automatic methods for cortical surface registration

    OpenAIRE

    Pantazis, Dimitrios; Joshi, Anand; Jiang, Jintao; Shattuck, David; Bernstein, Lynne E.; Damasio, Hanna; Leahy, Richard M.

    2009-01-01

    Group analysis of structure or function in cerebral cortex typically involves as a first step the alignment of the cortices. A surface based approach to this problem treats the cortex as a convoluted surface and coregisters across subjects so that cortical landmarks or features are aligned. This registration can be performed using curves representing sulcal fundi and gyral crowns to constrain the mapping. Alternatively, registration can be based on the alignment of curvature metrics computed ...

  8. A novel registration method for retinal images based on local features

    OpenAIRE

    Chen, Jian; R Theodore Smith; Tian, Jie; Laine, Andrew F

    2008-01-01

    Sometimes it is very hard to automatically detect the bifurcations of vascular network in retinal images so that the general feature based registration methods will fail to register two images. In order to solve this problem, we developed a novel local feature based retinal image registration method. We first detect the corner points instead of bifurcations since corner points are sufficient and uniformly distributed in the overlaps. Second, a novel highly distinctive local feature is extract...

  9. Automatic registration of large-scale urban scene point clouds based on semantic feature points

    Science.gov (United States)

    Yang, Bisheng; Dong, Zhen; Liang, Fuxun; Liu, Yuan

    2016-03-01

    Point clouds collected by terrestrial laser scanning (TLS) from large-scale urban scenes contain a wide variety of objects (buildings, cars, pole-like objects, and others) with symmetric and incomplete structures, and relatively low-textured surfaces, all of which pose great challenges for automatic registration between scans. To address the challenges, this paper proposes a registration method to provide marker-free and multi-view registration based on the semantic feature points extracted. First, the method detects the semantic feature points within a detection scheme, which includes point cloud segmentation, vertical feature lines extraction and semantic information calculation and finally takes the intersections of these lines with the ground as the semantic feature points. Second, the proposed method matches the semantic feature points using geometrical constraints (3-point scheme) as well as semantic information (category and direction), resulting in exhaustive pairwise registration between scans. Finally, the proposed method implements multi-view registration by constructing a minimum spanning tree of the fully connected graph derived from exhaustive pairwise registration. Experiments have demonstrated that the proposed method performs well in various urban environments and indoor scenes with the accuracy at the centimeter level and improves the efficiency, robustness, and accuracy of registration in comparison with the feature plane-based methods.

  10. Direct estimation of nonrigid registrations with image-based self-occlusion reasoning.

    Science.gov (United States)

    Gay-Bellile, Vincent; Bartoli, Adrien; Sayd, Patrick

    2010-01-01

    The registration problem for images of a deforming surface has been well studied. External occlusions are usually well handled. In 2D image-based registration, self-occlusions are more challenging. Consequently, the surface is usually assumed to be only slightly self-occluding. This paper is about image-based nonrigid registration with self-occlusion reasoning. A specific framework explicitly modeling self-occlusions is proposed. It is combined with an intensity-based, "direct" data term for registration. Self-occlusions are detected as shrinkage areas in the 2D warp. Experimental results on several challenging data sets show that our approach successfully registers images with self-occlusions while effectively detecting the self-occluded regions. PMID:19926901

  11. A New Multimodal Biometric System Based on Finger Vein and Hand Vein Recognition

    Directory of Open Access Journals (Sweden)

    Randa Boukhris Trabelsi

    2013-08-01

    Full Text Available As a reliable and robust biological characteristic, the vein pattern increases more and more the progress in biometric researches. Generally, it was shown that single biometric modality recognition is not able to meet high performances. In this paper, we propose a new multimodal biometric system based on fusion of both hand vein and finger vein modalities. For finger vein recognition, we employ the Monogenic Local Binary Pattern (MLBP, and for hand vein recognitionan Improved Gaussian Matched Filter (IGMF. Experimental results confirm that the proposed multimodal biometric process achieves excellent recognition performance compared to unimodal biometric system. The Area Under Curve (AUC of the proposed approach is very close to unity (0.98.

  12. Computer Network-based Multimodal Teaching of British and American Literature

    Directory of Open Access Journals (Sweden)

    Liu Xucai

    2013-01-01

    Full Text Available Guided under the multimodal teaching theory, the researchers mainly discuss the practice of the computer network-based multimodal teaching of British and American literature. This article emphasizes that the teachers take advantage of pictures, network screenshots, movies, video, sound, and other resources in the classroom lectures to mobilize the coordination operation of the auditory, visual and tactile senses, to enhance the students impression of the writer and his works. By doing so, the students have a good understanding of the original work, instead of having the boring sense of the single text-mode teaching and the distress of comprehension of literary works, and have no difficulties in comprehending the text and then the classroom teaching is improved.

  13. Multi-feature-based plaque characterization in ex vivo MRI trained by registration to 3D histology

    DEFF Research Database (Denmark)

    Engelen, Arna van; Niessen, Wiro J.; Klein, Stefan; Groen, Harald C.; Verhagen, Hence J.M.; Wentzel, Jolanda J.; Lugt, Aad van der; de Bruijne, Marleen

    2012-01-01

    voxelwise classification on different combinations of features, we evaluated their relative importance. To establish whether training by 3D registration yields different results than training by 2D registration, we determined plaque composition using (1) a 2D slice-based registration approach for three...

  14. The skill of surface registration in CT-based navigation system for total hip arthroplasty

    International Nuclear Information System (INIS)

    Surface registration of the CT-based navigation system, which is a matching between computational and real spatial spaces, is a key step to guarantee the accuracy of navigation. However, it has not been well described how the accuracy is affected by the registration skill of surgeon. Here, we reported the difference of the registration error between eight surgeons with the experience of navigation and six apprentice surgeons. A cadaveric pelvic model with an acetabular cup was made to measure the skill and learning curve of registration. After surface registration, two cup angles (inclination and anteversion) were recorded in the navigation system and the variance of these cup angles in ten trials were compared between the experienced surgeons and apprentices. In addition, we investigated whether the accuracy of registration by the apprentices was improved by visual information on how to take the surface points. The results showed that there was statistically significant difference in the accuracy of registration between the two groups. The accuracy of the second ten trials after getting the visual information showed great improvements. (orig.)

  15. A Practical Approach Based on Analytic Deformable Algorithm for Scenic Image Registration.

    Directory of Open Access Journals (Sweden)

    Wei-Yen Hsu

    Full Text Available Image registration is to produce an entire scene by aligning all the acquired image sequences. A registration algorithm is necessary to tolerance as much as possible for intensity and geometric variation among images. However, captured image views of real scene usually produce unexpected distortions. They are generally derived from the optic characteristics of image sensors or caused by the specific scenes and objects.An analytic registration algorithm considering the deformation is proposed for scenic image applications in this study. After extracting important features by the wavelet-based edge correlation method, an analytic registration approach is then proposed to achieve deformable and accurate matching of point sets. Finally, the registration accuracy is further refined to obtain subpixel precision by a feature-based Levenberg-Marquardt (FLM method. It converges evidently faster than most other methods because of its feature-based characteristic.We validate the performance of proposed method by testing with synthetic and real image sequences acquired by a hand-held digital still camera (DSC and in comparison with an optical flow-based motion technique in terms of the squared sum of intensity differences (SSD and correlation coefficient (CC. The results indicate that the proposed method is satisfactory in the registration accuracy and quality of DSC images.

  16. Travel Demand-Based Assignment Model for Multimodal and Multiuser Transportation System

    Directory of Open Access Journals (Sweden)

    Bingfeng Si

    2012-01-01

    Full Text Available In this paper, the structural characteristic of urban multimodal transport system is fully analyzed and then a two-tier network structure is proposed to describe such a system, in which the first-tier network is used to depict the traveller’s mode choice behaviour and the second-tier network is used to depict the vehicle routing when a certain mode has been selected. Subsequently, the generalized travel cost is formulated considering the properties of both traveller and transport mode. A new link impedance function is proposed, in which the interferences between different vehicle flows are taken into account. Simultaneously, the bi-equilibrium patterns for multimodal transport network are proposed by extending Wardrop principle. Correspondingly, a bi-level programming model is then presented to describe the bi-equilibrium based assignment for multi-class multimodal transport network. The solution algorithm is also given. Finally, a numerical example is provided to illustrate the model and algorithm.

  17. Tracking and registration method based on vector operation for augmented reality system

    Science.gov (United States)

    Gao, Yanfei; Wang, Hengyou; Bian, Xiaoning

    2015-08-01

    Tracking and registration is one key issue for an augmented reality (AR) system. For the marker-based AR system, the research focuses on detecting the real-time position and orientation of camera. In this paper, we describe a method of tracking and registration using the vector operations. Our method is proved to be stable and accurate, and have a good real-time performance.

  18. Accuracy Evaluation for Region Centroid-Based Registration of Fluorescent CLSM Imagery

    Directory of Open Access Journals (Sweden)

    Lin Amy

    2006-01-01

    Full Text Available We present an accuracy evaluation of a semiautomatic registration technique for 3D volume reconstruction from fluorescent confocal laser scanning microscope (CLSM imagery. The presented semiautomatic method is designed based on our observations that (a an accurate point selection is much harder than an accurate region (segment selection for a human, (b a centroid selection of any region is less accurate by a human than by a computer, and (c registration based on structural shape of a region rather than based on intensity-defined point is more robust to noise and to morphological deformation of features across stacks. We applied the method to image mosaicking and image alignment registration steps and evaluated its performance with 20 human subjects on CLSM images with stained blood vessels. Our experimental evaluation showed significant benefits of automation for 3D volume reconstruction in terms of achieved accuracy, consistency of results, and performance time. In addition, the results indicate that the differences between registration accuracy obtained by experts and by novices disappear with the proposed semiautomatic registration technique while the absolute registration accuracy increases.

  19. Shape-constrained multi-atlas based segmentation with multichannel registration

    Science.gov (United States)

    Hao, Yongfu; Jiang, Tianzi; Fan, Yong

    2012-02-01

    Multi-atlas based segmentation methods have recently attracted much attention in medical image segmentation. The multi-atlas based segmentation methods typically consist of three steps, including image registration, label propagation, and label fusion. Most of the recent studies devote to improving the label fusion step and adopt a typical image registration method for registering atlases to the target image. However, the existing registration methods may become unstable when poor image quality or high anatomical variance between registered image pairs involved. In this paper, we propose an iterative image segmentation and registration procedure to simultaneously improve the registration and segmentation performance in the multi-atlas based segmentation framework. Particularly, a two-channel registration method is adopted with one channel driven by appearance similarity between the atlas image and the target image and the other channel optimized by similarity between atlas label and the segmentation of the target image. The image segmentation is performed by fusing labels of multiple atlases. The validation of our method on hippocampus segmentation of 30 subjects containing MR images with both 1.5T and 3.0T field strength has demonstrated that our method can significantly improve the segmentation performance with different fusion strategies and obtain segmentation results with Dice overlap of 0.892+/-0.024 for 1.5T images and 0.902+/-0.022 for 3.0T images to manual segmentations.

  20. Landmark Optimization Using Local Curvature for Point-Based Nonlinear Rodent Brain Image Registration

    Directory of Open Access Journals (Sweden)

    Yutong Liu

    2012-01-01

    Full Text Available Purpose. To develop a technique to automate landmark selection for point-based interpolating transformations for nonlinear medical image registration. Materials and Methods. Interpolating transformations were calculated from homologous point landmarks on the source (image to be transformed and target (reference image. Point landmarks are placed at regular intervals on contours of anatomical features, and their positions are optimized along the contour surface by a function composed of curvature similarity and displacements of the homologous landmarks. The method was evaluated in two cases (=5 each. In one, MRI was registered to histological sections; in the second, geometric distortions in EPI MRI were corrected. Normalized mutual information and target registration error were calculated to compare the registration accuracy of the automatically and manually generated landmarks. Results. Statistical analyses demonstrated significant improvement (<0.05 in registration accuracy by landmark optimization in most data sets and trends towards improvement (<0.1 in others as compared to manual landmark selection.

  1. A novel 3D volumetric voxel registration technique for volume-view-guided image registration of multiple imaging modalities

    International Nuclear Information System (INIS)

    Purpose: To provide more clinically useful image registration with improved accuracy and reduced time, a novel technique of three-dimensional (3D) volumetric voxel registration of multimodality images is developed. Methods and Materials: This technique can register up to four concurrent images from multimodalities with volume view guidance. Various visualization effects can be applied, facilitating global and internal voxel registration. Fourteen computed tomography/magnetic resonance (CT/MR) image sets and two computed tomography/positron emission tomography (CT/PET) image sets are used. For comparison, an automatic registration technique using maximization of mutual information (MMI) and a three-orthogonal-planar (3P) registration technique are used. Results: Visually sensitive registration criteria for CT/MR and CT/PET have been established, including the homogeneity of color distribution. Based on the registration results of 14 CT/MR images, the 3D voxel technique is in excellent agreement with the automatic MMI technique and is indicatory of a global positioning error (defined as the means and standard deviations of the error distribution) using the 3P pixel technique: 1.8 deg ± 1.2 deg in rotation and 2.0 ± 1.3 (voxel unit) in translation. To the best of our knowledge, this is the first time that such positioning error has been addressed. Conclusion: This novel 3D voxel technique establishes volume-view-guided image registration of up to four modalities. It improves registration accuracy with reduced time, compared with the 3P pixel technique. This article suggests that any interactive and automatic registration should be safeguarded using the 3D voxel technique

  2. A cloud-based multimodality case file for mobile devices.

    Science.gov (United States)

    Balkman, Jason D; Loehfelm, Thomas W

    2014-01-01

    Recent improvements in Web and mobile technology, along with the widespread use of handheld devices in radiology education, provide unique opportunities for creating scalable, universally accessible, portable image-rich radiology case files. A cloud database and a Web-based application for radiologic images were developed to create a mobile case file with reasonable usability, download performance, and image quality for teaching purposes. A total of 75 radiology cases related to breast, thoracic, gastrointestinal, musculoskeletal, and neuroimaging subspecialties were included in the database. Breast imaging cases are the focus of this article, as they best demonstrate handheld display capabilities across a wide variety of modalities. This case subset also illustrates methods for adapting radiologic content to cloud platforms and mobile devices. Readers will gain practical knowledge about storage and retrieval of cloud-based imaging data, an awareness of techniques used to adapt scrollable and high-resolution imaging content for the Web, and an appreciation for optimizing images for handheld devices. The evaluation of this software demonstrates the feasibility of adapting images from most imaging modalities to mobile devices, even in cases of full-field digital mammograms, where high resolution is required to represent subtle pathologic features. The cloud platform allows cases to be added and modified in real time by using only a standard Web browser with no application-specific software. Challenges remain in developing efficient ways to generate, modify, and upload radiologic and supplementary teaching content to this cloud-based platform. Online supplemental material is available for this article. PMID:24819664

  3. Multimodality Imaging with Silica-Based Targeted Nanoparticle Platforms

    Energy Technology Data Exchange (ETDEWEB)

    Jason S. Lewis

    2012-04-09

    Objectives: To synthesize and characterize a C-Dot silica-based nanoparticle containing 'clickable' groups for the subsequent attachment of targeting moieties (e.g., peptides) and multiple contrast agents (e.g., radionuclides with high specific activity) [1,2]. These new constructs will be tested in suitable tumor models in vitro and in vivo to ensure maintenance of target-specificity and high specific activity. Methods: Cy5 dye molecules are cross-linked to a silica precursor which is reacted to form a dye-rich core particle. This core is then encapsulated in a layer of pure silica to create the core-shell C-Dot (Figure 1) [2]. A 'click' chemistry approach has been used to functionalize the silica shell with radionuclides conferring high contrast and specific activity (e.g. 64Cu and 89Zr) and peptides for tumor targeting (e.g. cRGD and octreotate) [3]. Based on the selective Diels-Alder reaction between tetrazine and norbornene, the reaction is bioorthogonal, highyielding, rapid, and water-compatible. This radiolabeling approach has already been employed successfully with both short peptides (e.g. octreotate) and antibodies (e.g. trastuzumab) as model systems for the ultimate labeling of the nanoparticles [1]. Results: PEGylated C-Dots with a Cy5 core and labeled with tetrazine have been synthesized (d = 55 nm, zeta potential = -3 mV) reliably and reproducibly and have been shown to be stable under physiological conditions for up to 1 month. Characterization of the nanoparticles revealed that the immobilized Cy5 dye within the C-Dots exhibited fluorescence intensities over twice that of the fluorophore alone. The nanoparticles were successfully radiolabeled with Cu-64. Efforts toward the conjugation of targeting peptides (e.g. cRGD) are underway. In vitro stability, specificity, and uptake studies as well as in vivo imaging and biodistribution investigations will be presented. Conclusions: C-Dot silica-based nanoparticles offer a robust

  4. Multimodality Imaging with Silica-Based Targeted Nanoparticle Platforms

    International Nuclear Information System (INIS)

    Objectives: To synthesize and characterize a C-Dot silica-based nanoparticle containing 'clickable' groups for the subsequent attachment of targeting moieties (e.g., peptides) and multiple contrast agents (e.g., radionuclides with high specific activity) (1,2). These new constructs will be tested in suitable tumor models in vitro and in vivo to ensure maintenance of target-specificity and high specific activity. Methods: Cy5 dye molecules are cross-linked to a silica precursor which is reacted to form a dye-rich core particle. This core is then encapsulated in a layer of pure silica to create the core-shell C-Dot (Figure 1) (2). A 'click' chemistry approach has been used to functionalize the silica shell with radionuclides conferring high contrast and specific activity (e.g. 64Cu and 89Zr) and peptides for tumor targeting (e.g. cRGD and octreotate) (3). Based on the selective Diels-Alder reaction between tetrazine and norbornene, the reaction is bioorthogonal, highyielding, rapid, and water-compatible. This radiolabeling approach has already been employed successfully with both short peptides (e.g. octreotate) and antibodies (e.g. trastuzumab) as model systems for the ultimate labeling of the nanoparticles (1). Results: PEGylated C-Dots with a Cy5 core and labeled with tetrazine have been synthesized (d = 55 nm, zeta potential = -3 mV) reliably and reproducibly and have been shown to be stable under physiological conditions for up to 1 month. Characterization of the nanoparticles revealed that the immobilized Cy5 dye within the C-Dots exhibited fluorescence intensities over twice that of the fluorophore alone. The nanoparticles were successfully radiolabeled with Cu-64. Efforts toward the conjugation of targeting peptides (e.g. cRGD) are underway. In vitro stability, specificity, and uptake studies as well as in vivo imaging and biodistribution investigations will be presented. Conclusions: C-Dot silica-based nanoparticles offer a robust, versatile, and multi

  5. Design and implementation of software defined radio based multi-mode transceiver

    Science.gov (United States)

    Fang, Yixiang; Zhou, Jinhe

    2013-03-01

    In this paper, we aim at the study on multi-mode transceiver based on software defined radio(SDR). Multi-rate signal processing and polyphase filtering technique are both applied in the design and implementation of the transceiver. Simplified FFT butterfly algorithm has been employed in the polyphase filter design as well. Simulation results illustrate that BER performance can be improved by adopting the SDR proposed in this paper. Especially, it has obvious advantages at low SNR. Meanwhile, improved filter design scheme has much more predominant in-band and out-ofband performance.

  6. Deep assessment: an exploratory study of game-based, multimodal learning in Epidemic

    Directory of Open Access Journals (Sweden)

    Jennifer Jenson

    2016-03-01

    Full Text Available n this study, we examine what and how intermediate age students learned from playing in a health-focused game-based digital learning environment, Epidemic. Epidemic is a playful interactive environment designed to deliver factual knowledge, invite critical understanding, and encourage effective self-care practices in dealing with viral contagious diseases, using a social networking interface to integrate both serious games and game-like multimodal design projects. Epidemic invites a playful approach to its deadly serious core concern – communicable disease – in order to see what happens when students are encouraged to critically approach information from multiple or contradictory perspectives. To identify what participants learned while interacting within Epidemic, we deployed two instructional and assessment models, noting the differences each instructional approach could potentially make, and what approach to assessment might help us evaluate game-based learning. We found that each approach provided importantly different perspectives on what and how students learned, and on the very meaning of student success. Recognizing that traditional assessment tools based in print-cultural literacy may prove increasingly ill-suited for assessing emergent multimodal literacies in game-based learning environments, this study seeks to contribute to a growing body of work on the development of novel assessments for learning.

  7. Arbitrary-ratio power splitter based on nonlinear multimode interference coupler

    Energy Technology Data Exchange (ETDEWEB)

    Tajaldini, Mehdi [School of Physics, Universiti Sains Malaysia, 11800 Pulau Pinang (Malaysia); Young Researchers and Elite Club, Baft Branch, Islamic Azad University, Baft (Iran, Islamic Republic of); Jafri, Mohd Zubir Mat [School of Physics, Universiti Sains Malaysia, 11800 Pulau Pinang (Malaysia)

    2015-04-24

    We propose an ultra-compact multimode interference (MMI) power splitter based on nonlinear effects from simulations using nonlinear modal propagation analysis (NMPA) cooperation with finite difference Method (FDM) to access free choice of splitting ratio. Conventional multimode interference power splitter could only obtain a few discrete ratios. The power splitting ratio may be adjusted continuously while the input set power is varying by a tunable laser. In fact, using an ultra- compact MMI with a simple structure that is launched by a tunable nonlinear input fulfills the problem of arbitrary-ratio in integrated photonics circuits. Silicon on insulator (SOI) is used as the offered material due to the high contrast refractive index and Centro symmetric properties. The high-resolution images at the end of the multimode waveguide in the simulated power splitter have a high power balance, whereas access to a free choice of splitting ratio is not possible under the linear regime in the proposed length range except changes in the dimension for any ratio. The compact dimensions and ideal performance of the device are established according to optimized parameters. The proposed regime can be extended to the design of M×N arbitrary power splitters ratio for programmable logic devices in all optical digital signal processing. The results of this study indicate that nonlinear modal propagation analysis solves the miniaturization problem for all-optical devices based on MMI couplers to achieve multiple functions in a compact planar integrated circuit and also overcomes the limitations of previously proposed methods for nonlinear MMI.

  8. Automatic registration of laser-scanned point clouds based on planar features

    Science.gov (United States)

    Li, Minglei; Gao, Xinyuan; Wang, Li; Li, Guangyun

    2016-03-01

    Automatic multistation registration of laser-scanned point clouds is a research hotspot in laser-scanned point clouds registration. Some targets such as common buildings have plenty of planar features, and using these features as constraints properly can bring about high accuracy registration results. Starting from this, a new automatic multistation registration method using homologous planar features of two scan stations was proposed. In order to recognize planes from different scan stations and get plane equations in corresponding scan station coordinate systems, k-means dynamic clustering method was improved to be adaptive and robust. And to match the homologous planes of the two scan stations, two different procedures were proposed, respectively, one of which was based on the "common" relationship between planes and the other referenced RANSAC algorithm. And the transformation parameters of the two scan station coordinate systems were calculated after homologous plane matching. Finally, the transformation parameters based on the optimal match of planes was adopted as the final registration result. Comparing with ICP algorithm in experiment, the method is proved to be effective.

  9. A dynamic tree-based registration could handle possible large deformations among MR brain images.

    Science.gov (United States)

    Zhang, Pei; Wu, Guorong; Gao, Yaozong; Yap, Pew-Thian; Shen, Dinggang

    2016-09-01

    Multi-atlas segmentation is a powerful approach to automated anatomy delineation via fusing label information from a set of spatially normalized atlases. For simplicity, many existing methods perform pairwise image registration, leading to inaccurate segmentation especially when shape variation is large. In this paper, we propose a dynamic tree-based strategy for effective large-deformation registration and multi-atlas segmentation. To deal with local minima caused by large shape variation, coarse estimates of deformations are first obtained via alignment of automatically localized landmark points. The dynamic tree capturing the structural relationships between images is then employed to further reduce misalignment errors. Evaluation based on two real human brain datasets, ADNI and LPBA40, shows that our method significantly improves registration and segmentation accuracy. PMID:27235894

  10. Multi-modal face parts fusion based on Gabor feature for face recognition

    Institute of Scientific and Technical Information of China (English)

    Xiang Yan; Su Guangda; Shang Yan; Li Congcong

    2009-01-01

    A novel face recognition method, which is a fusion of multi-modal face parts based on Gabor feature (MMP-GF), is proposed in this paper. Firstly, the bare face image detached from the normalized image was convolved with a family of Gabor kernels, and then according to the face structure and the key-points locations, the calculated Gabor images were divided into five parts: Gabor face, Gabor eyebrow, Gabor eye, Gabor nose and Gabor mouth. After that multi-modal Gabor features were spatially partitioned into non-overlapping regions and the averages of regions were concatenated to be a low dimension feature vector, whose dimension was further reduced by principal component analysis (PCA). In the decision level fusion, match results respectively calculated based on the five parts were combined according to linear discriminant analysis (LDA) and a normalized matching algorithm was used to improve the performance. Experiments on FERET database show that the proposed MMP-GF method achieves good robustness to the expression and age variations.

  11. EEG Classification for Hybrid Brain-Computer Interface Using a Tensor Based Multiclass Multimodal Analysis Scheme.

    Science.gov (United States)

    Ji, Hongfei; Li, Jie; Lu, Rongrong; Gu, Rong; Cao, Lei; Gong, Xiaoliang

    2016-01-01

    Electroencephalogram- (EEG-) based brain-computer interface (BCI) systems usually utilize one type of changes in the dynamics of brain oscillations for control, such as event-related desynchronization/synchronization (ERD/ERS), steady state visual evoked potential (SSVEP), and P300 evoked potentials. There is a recent trend to detect more than one of these signals in one system to create a hybrid BCI. However, in this case, EEG data were always divided into groups and analyzed by the separate processing procedures. As a result, the interactive effects were ignored when different types of BCI tasks were executed simultaneously. In this work, we propose an improved tensor based multiclass multimodal scheme especially for hybrid BCI, in which EEG signals are denoted as multiway tensors, a nonredundant rank-one tensor decomposition model is proposed to obtain nonredundant tensor components, a weighted fisher criterion is designed to select multimodal discriminative patterns without ignoring the interactive effects, and support vector machine (SVM) is extended to multiclass classification. Experiment results suggest that the proposed scheme can not only identify the different changes in the dynamics of brain oscillations induced by different types of tasks but also capture the interactive effects of simultaneous tasks properly. Therefore, it has great potential use for hybrid BCI. PMID:26880873

  12. Comparative Study of Image Registration Methods

    Directory of Open Access Journals (Sweden)

    Supriya S. Kothalkar

    2014-06-01

    Full Text Available The main objective of image registration is to match two or more images captured at different times by different sensors or by different angles or from different viewpoints. Image registration has become a crucial step in most of the image processing tasks used in various areas. It is a key technology which is applied for computer vision, remote sensing, image processing, medical image analysis and other fields. Medical image registration is used to find a spatial transformation to match all the anatomical points and diagnostic points on the image. In general, the majority of registration methods consist of the following four steps: feature extraction, feature matching, transform modeling, and finally image resampling. The accuracy of a registration process is highly dependent to the feature extraction and matching methods. Cross Correlation is the basic statistical approach to image registration. It is used for template matching or pattern recognition. Template is considered as a sub-image from the reference image, and the image is considered as a sensed image. The objective is to establish the correspondence between the reference image and sensed image. It gives the measure of the degree of similarity between an image and template, which can be used for image registration. Normalized Cross Correlation (NCC method is improved by using Feature Based Method. Image are effectively represented by any of its feature such as edges, points, curves etc. and these features are effectively used for image registration. Images are applied with the filters to extract edges. Post that NCC is done to find the sharp point on NCC plot. This method restricts us with only monomodal images. For multimodal images we have used Mutual Information as a measure of similarity. A widely used measure is Mutual Information (MI. This method requires estimating joint histogram of the two images. Experiments are presented that demonstrate the approach. The technique is

  13. Computer-vision-based registration techniques for augmented reality

    Science.gov (United States)

    Hoff, William A.; Nguyen, Khoi; Lyon, Torsten

    1996-10-01

    Augmented reality is a term used to describe systems in which computer-generated information is superimposed on top of the real world; for example, through the use of a see- through head-mounted display. A human user of such a system could still see and interact with the real world, but have valuable additional information, such as descriptions of important features or instructions for performing physical tasks, superimposed on the world. For example, the computer could identify and overlay them with graphic outlines, labels, and schematics. The graphics are registered to the real-world objects and appear to be 'painted' onto those objects. Augmented reality systems can be used to make productivity aids for tasks such as inspection, manufacturing, and navigation. One of the most critical requirements for augmented reality is to recognize and locate real-world objects with respect to the person's head. Accurate registration is necessary in order to overlay graphics accurately on top of the real-world objects. At the Colorado School of Mines, we have developed a prototype augmented reality system that uses head-mounted cameras and computer vision techniques to accurately register the head to the scene. The current system locates and tracks a set of pre-placed passive fiducial targets placed on the real-world objects. The system computes the pose of the objects and displays graphics overlays using a see-through head-mounted display. This paper describes the architecture of the system and outlines the computer vision techniques used.

  14. A Rigid Image Registration Based on the Nonsubsampled Contourlet Transform and Genetic Algorithms

    Science.gov (United States)

    Meskine, Fatiha; Chikr El Mezouar, Miloud; Taleb, Nasreddine

    2010-01-01

    Image registration is a fundamental task used in image processing to match two or more images taken at different times, from different sensors or from different viewpoints. The objective is to find in a huge search space of geometric transformations, an acceptable accurate solution in a reasonable time to provide better registered images. Exhaustive search is computationally expensive and the computational cost increases exponentially with the number of transformation parameters and the size of the data set. In this work, we present an efficient image registration algorithm that uses genetic algorithms within a multi-resolution framework based on the Non-Subsampled Contourlet Transform (NSCT). An adaptable genetic algorithm for registration is adopted in order to minimize the search space. This approach is used within a hybrid scheme applying the two techniques fitness sharing and elitism. Two NSCT based methods are proposed for registration. A comparative study is established between these methods and a wavelet based one. Because the NSCT is a shift-invariant multidirectional transform, the second method is adopted for its search speeding up property. Simulation results clearly show that both proposed techniques are really promising methods for image registration compared to the wavelet approach, while the second technique has led to the best performance results of all. Moreover, to demonstrate the effectiveness of these methods, these registration techniques have been successfully applied to register SPOT, IKONOS and Synthetic Aperture Radar (SAR) images. The algorithm has been shown to work perfectly well for multi-temporal satellite images as well, even in the presence of noise. PMID:22163672

  15. A Rigid Image Registration Based on the Nonsubsampled Contourlet Transform and Genetic Algorithms

    Directory of Open Access Journals (Sweden)

    Nasreddine Taleb

    2010-09-01

    Full Text Available Image registration is a fundamental task used in image processing to match two or more images taken at different times, from different sensors or from different viewpoints. The objective is to find in a huge search space of geometric transformations, an acceptable accurate solution in a reasonable time to provide better registered images. Exhaustive search is computationally expensive and the computational cost increases exponentially with the number of transformation parameters and the size of the data set. In this work, we present an efficient image registration algorithm that uses genetic algorithms within a multi-resolution framework based on the Non-Subsampled Contourlet Transform (NSCT. An adaptable genetic algorithm for registration is adopted in order to minimize the search space. This approach is used within a hybrid scheme applying the two techniques fitness sharing and elitism. Two NSCT based methods are proposed for registration. A comparative study is established between these methods and a wavelet based one. Because the NSCT is a shift-invariant multidirectional transform, the second method is adopted for its search speeding up property. Simulation results clearly show that both proposed techniques are really promising methods for image registration compared to the wavelet approach, while the second technique has led to the best performance results of all. Moreover, to demonstrate the effectiveness of these methods, these registration techniques have been successfully applied to register SPOT, IKONOS and Synthetic Aperture Radar (SAR images. The algorithm has been shown to work perfectly well for multi-temporal satellite images as well, even in the presence of noise.

  16. An SOI-based 1550-nm 4×4 multimode interference coupler used for OADC

    Science.gov (United States)

    Tian, Ye; Wei, Shile; Qiu, Jifang; Wu, Jian; Zhang, Daolin; Wang, Yue

    2015-08-01

    A novel integrable optical analog-to-digital converter (OADC) scheme based on phase-shifted optical quantization has been proposed for years, the quantization module of which is mainly composed of a 1×2 multi-mode interference (MMI) coupler, a phase modulator and a 4×4MMI. Although the manufacture technology of 1×2 MMI and phase modulator has been very mature, the 4×4MMI on a silicon-on-insulator (SOI) substrate with superior performance has not been realized. Since the 4×4MMI is crucial for the realization of the OADC, we designed and fabricated a 4×4 MMI coupler on SOI substrate. The width and length of the multi-mode section are 10.2 um and 182.6 um respectively. Measurement results show that the imbalance of the four output ports at 1550-nm is around 1.9 dB, while the insertion losses are 5.6 dB.

  17. Curvelet and Ridgelet-based Multimodal Biometric Recognition System using Weighted Similarity Approach

    Directory of Open Access Journals (Sweden)

    S. Arivazhagan

    2014-03-01

    Full Text Available Biometric security artifacts for establishing the identity of a person with high confidence have evoked enormous interest in security and access control applications for the past few years. Biometric systems based solely on unimodal biometrics often suffer from problems such as noise, intra-class variations and spoof attacks. This paper presents a novel multimodal biometric recognition system by integrating three biometric traits namely iris, fingerprint and face using weighted similarity approach. In this work, the multi-resolution features are extracted independently from query images using curvelet and ridgelet transforms, and are then compared to the enrolled templates stored in the database containing features of each biometric trait. The final decision is made by normalizing the feature vectors, assigning different weights to the modalities and fusing the computed scores using score combination techniques. This system is tested with the public unimodal databases such as CASIA–Iris-V3-Interval, FVC2004, ORL and self-built multimodal databases. Experimental results obtained shows that the designed system achieves an excellent recognition rate of 98.75 per cent and 100 per cent for the public and self-built databases respectively and provides ultra high security than unimodal biometric systems.Defence Science Journal, 2014, 64(2, pp. 106-114. DOI: http://dx.doi.org/10.14429/dsj.64.3469

  18. Evanescent wave absorption sensor based on tapered multimode fiber coated with monolayer graphene film

    Science.gov (United States)

    Qiu, Hengwei; Gao, Saisai; Chen, Peixi; Li, Zhen; Liu, Xiaoyun; Zhang, Chao; Xu, Yuanyuan; Jiang, Shouzhen; Yang, Cheng; Huo, Yanyan; Yue, Weiwei

    2016-05-01

    An evanescent wave absorption (EWA) sensor based on tapered multimode fiber (TMMF) coated with monolayer graphene film for the detection of double-stranded DNA (DS-DNA) is investigated in this work. The TMMF is a silica multimode fiber (nominally at 62.5 μm), which was tapered to symmetric taper with waist diameters of ~30 μm and total length of ~3 mm. Monolayer graphene film was grown on a copper foil via chemical vapor deposition (CVD) technology and transferred onto skinless tapered fiber core via dry transfer technology. All the components of the sensor are coupled together by fusion splicer in order to eliminate the external disturbance. DS-DNA is created by the assembly of two relatively complemented oligonucleotides. The measurements are obtained by using a spectrometer in the optical wavelength range of 400-900 nm. With the increase of DS-DNA concentration, the output light intensity (OPLI) arisen an obvious attenuation. Importantly, the absorbance (A) and the DS-DNA concentrations shown a reasonable linear variation in a wide range of 5-400 μM. Through a series of comparison, the accuracy of TMMF sensor with graphene (G-TMMF) is much better than that without graphene (TMMF), which can be attributed to the molecular enrichment of graphene by π-π stacking.

  19. Urban expressway traffic state forecasting based on multimode maximum entropy model

    Institute of Scientific and Technical Information of China (English)

    2010-01-01

    The accurate and timely traffic state prediction has become increasingly important for the traffic participants,especially for the traffic managements. In this paper,the traffic state is described by Micro-LOS,and a direct prediction method is introduced. The development of the proposed method is based on Maximum Entropy (ME) models trained for multiple modes. In the Multimode Maximum Entropy (MME) framework,the different features like temporal and spatial features of traffic systems,regional traffic state are integrated simultaneously,and the different state behaviors based on 14 traffic modes defined by average speed according to the date-time division are also dealt with. The experiments based on the real data in Beijing expressway prove that the MME models outperforms the already existing model in both effectiveness and robustness.

  20. Automatic registration of geometric distortions in satellite images based on control points

    International Nuclear Information System (INIS)

    This paper presents an automatic registration scheme to register geometric distortion in satellite images; A novel feature based matching scheme is proposed which establishes correspondence between the corner points in the reference and target images either by correlating the intensity values around a circular neighborhood of these corner points or by exploiting the relative orientation of lines connecting these corner points. Affine transformation model is used to estimate transformation parameters. Re-sampling is carried out by nearest neighborhood interpolation. The registration process is automatic and can efficiently serve as preprocessing stage for multitemporal analysis, image fusion, image mosaicking and change detection. The effectiveness of the algorithm has been verified by an intensive experiment on a large number of real images. Experimental results reveal high supremacy of the proposed registration method. (author)

  1. An Efficient Multimodal 2D + 3D Feature-based Approach to Automatic Facial Expression Recognition

    KAUST Repository

    Li, Huibin

    2015-07-29

    We present a fully automatic multimodal 2D + 3D feature-based facial expression recognition approach and demonstrate its performance on the BU-3DFE database. Our approach combines multi-order gradient-based local texture and shape descriptors in order to achieve efficiency and robustness. First, a large set of fiducial facial landmarks of 2D face images along with their 3D face scans are localized using a novel algorithm namely incremental Parallel Cascade of Linear Regression (iPar-CLR). Then, a novel Histogram of Second Order Gradients (HSOG) based local image descriptor in conjunction with the widely used first-order gradient based SIFT descriptor are used to describe the local texture around each 2D landmark. Similarly, the local geometry around each 3D landmark is described by two novel local shape descriptors constructed using the first-order and the second-order surface differential geometry quantities, i.e., Histogram of mesh Gradients (meshHOG) and Histogram of mesh Shape index (curvature quantization, meshHOS). Finally, the Support Vector Machine (SVM) based recognition results of all 2D and 3D descriptors are fused at both feature-level and score-level to further improve the accuracy. Comprehensive experimental results demonstrate that there exist impressive complementary characteristics between the 2D and 3D descriptors. We use the BU-3DFE benchmark to compare our approach to the state-of-the-art ones. Our multimodal feature-based approach outperforms the others by achieving an average recognition accuracy of 86.32%. Moreover, a good generalization ability is shown on the Bosphorus database.

  2. Consistency of parametric registration in serial MRI studies of brain tumor progression

    International Nuclear Information System (INIS)

    The consistency of parametric registration in multi-temporal magnetic resonance (MR) imaging studies was evaluated. Serial MRI scans of adult patients with a brain tumor (glioma) were aligned by parametric registration. The performance of low-order spatial alignment (6/9/12 degrees of freedom) of different 3D serial MR-weighted images is evaluated. A registration protocol for the alignment of all images to one reference coordinate system at baseline is presented. Registration results were evaluated for both, multimodal intra-timepoint and mono-modal multi-temporal registration. The latter case might present a challenge to automatic intensity-based registration algorithms due to ill-defined correspondences. The performance of our algorithm was assessed by testing the inverse registration consistency. Four different similarity measures were evaluated to assess consistency. Careful visual inspection suggests that images are well aligned, but their consistency may be imperfect. Sub-voxel inconsistency within the brain was found for allsimilarity measures used for parametric multi-temporal registration. T1-weighted images were most reliable for establishing spatial correspondence between different timepoints. The parametric registration algorithm is feasible for use in this application. The sub-voxel resolution mean displacement error of registration transformations demonstrates that the algorithm converges to an almost identical solution for forward and reverse registration. (orig.)

  3. Combination of intensity-based image registration with 3D simulation in radiation therapy

    Science.gov (United States)

    Li, Pan; Malsch, Urban; Bendl, Rolf

    2008-09-01

    Modern techniques of radiotherapy like intensity modulated radiation therapy (IMRT) make it possible to deliver high dose to tumors of different irregular shapes at the same time sparing surrounding healthy tissue. However, internal tumor motion makes precise calculation of the delivered dose distribution challenging. This makes analysis of tumor motion necessary. One way to describe target motion is using image registration. Many registration methods have already been developed previously. However, most of them belong either to geometric approaches or to intensity approaches. Methods which take account of anatomical information and results of intensity matching can greatly improve the results of image registration. Based on this idea, a combined method of image registration followed by 3D modeling and simulation was introduced in this project. Experiments were carried out for five patients 4DCT lung datasets. In the 3D simulation, models obtained from images of end-exhalation were deformed to the state of end-inhalation. Diaphragm motions were around -25 mm in the cranial-caudal (CC) direction. To verify the quality of our new method, displacements of landmarks were calculated and compared with measurements in the CT images. Improvement of accuracy after simulations has been shown compared to the results obtained only by intensity-based image registration. The average improvement was 0.97 mm. The average Euclidean error of the combined method was around 3.77 mm. Unrealistic motions such as curl-shaped deformations in the results of image registration were corrected. The combined method required less than 30 min. Our method provides information about the deformation of the target volume, which we need for dose optimization and target definition in our planning system.

  4. Registration-based Reconstruction of Four-dimensional Cone Beam Computed Tomography

    DEFF Research Database (Denmark)

    Christoffersen, Christian; Hansen, David Christoffer; Poulsen, Per Rugaard; Sørensen, Thomas Sangild

    2013-01-01

    We present a new method for reconstruction of four-dimensional (4D) cone beam computed tomography from an undersampled set of X-ray projections. The novelty of the proposed method lies in utilizing optical flow based registration to facilitate that each temporal phase is reconstructed from the full...

  5. Surface membrane based bladder registration for evaluation of accumulated dose during brachytherapy in cervical cancer

    DEFF Research Database (Denmark)

    Noe, Karsten Østergaard; Tanderup, Kari; Sørensen, Thomas Sangild

    2011-01-01

    of the fixed surface. Optional landmark based matches can be included in the suggested iterative solver. The technique is demonstrated for bladder registration in brachytherapy treatment evaluation of cervical cancer. It holds promise to better estimate the accumulated but unintentional dose delivered...

  6. Bi-objective optimization for multi-modal transportation routing planning problem based on Pareto optimality

    OpenAIRE

    Yan Sun; Maoxiang Lang

    2015-01-01

    Purpose: The purpose of study is to solve the multi-modal transportation routing planning problem that aims to select an optimal route to move a consignment of goods from its origin to its destination through the multi-modal transportation network. And the optimization is from two viewpoints including cost and time. Design/methodology/approach: In this study, a bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. ...

  7. Applying Connectivist Principles and the Task-Based Approach to the Design of a Multimodal Didactic Unit

    Directory of Open Access Journals (Sweden)

    Yeraldine Aldana Gutiérrez

    2012-12-01

    Full Text Available This article describes the pedagogical intervention developed in a public school as part of the research “Exploring Communications Practices through Facebook as a Mediatic Device”, framed within the computer mediated communications field. Twelve ninth graders’ communications practices were explored and addressed by means of multimodal technological resources and tasks based on the connectivist learning view. As a result, a didactic unit was designed in the form of the digital book Diverface. This one in turn displayed information through different media channels and semiotic elements to support its multimodal features. Teachers and students might thus need to reconstruct an alternative multimodal literacy so that they can produce and interpret texts of the same nature in online environments.

  8. A 2×2 SOI mach-zehnder thermo-optical switch based on strongly guided paired multimode interference couplers

    Institute of Scientific and Technical Information of China (English)

    2007-01-01

    A silicon-on-insulator 2×2 Mach-Zehnder thermo-optical switch is developed based on strongly guided paired multimode interference couplers. The multimode-interference couplers were etched deeply for improving coupler characteristics such as self-imaging quality, uniformity and fabrication tolerance. The proposed switch achieves good performances, including a low insertion loss of -11 .OdB, a fiber-waveguide coupling loss of -4.3dB and a fast response speed measured to be 3.5 and 8.8 μs for raise and fall switching time, respectively.

  9. The evolution of gadolinium based contrast agents: from single-modality to multi-modality.

    Science.gov (United States)

    Zhang, Li; Liu, Ruiqing; Peng, Hui; Li, Penghui; Xu, Zushun; Whittaker, Andrew K

    2016-05-19

    Gadolinium-based contrast agents are extensively used as magnetic resonance imaging (MRI) contrast agents due to their outstanding signal enhancement and ease of chemical modification. However, it is increasingly recognized that information obtained from single modal molecular imaging cannot satisfy the higher requirements on the efficiency and accuracy for clinical diagnosis and medical research, due to its limitation and default rooted in single molecular imaging technique itself. To compensate for the deficiencies of single function magnetic resonance imaging contrast agents, the combination of multi-modality imaging has turned to be the research hotpot in recent years. This review presents an overview on the recent developments of the functionalization of gadolinium-based contrast agents, and their application in biomedicine applications. PMID:27159645

  10. Design of Radio Frequency Link in Automatic Test System for Multimode Mobile Communication Base Station

    Science.gov (United States)

    Zhang, Weipeng

    2015-12-01

    A modularized design for the radio frequency (RF) link in automatic test system of multimode mobile communication base station is presented, considering also the characteristics of wireless communication indices and composition of signals of base stations. The test link is divided into general module, time division duplex (TDD) module, module of spurious noise filter, module of downlink intermodulation, module of uplink intermodulation and uplink block module. The composition of modules and link functions are defined, and the interfaces of the general module and the module of spurious noise filter are described. Finally, the estimated gain budget of the test link is presented. It is verified by experiments that the system is reliable and the test efficiency is improved.

  11. All-optical flip-flop operation based on asymmetric active-multimode interferometer bi-stable laser diodes

    DEFF Research Database (Denmark)

    Jiang, H.; Chaen, Y.; Hagio, T.;

    2011-01-01

    We demonstrate fast and low energy all optical flip-flop devices based on asymmetric active-multimode interferometer using high-mesa waveguide structure. The implemented devices showed high speed alloptical flip-flop operation with 25ps long pulses. The rising and falling times of the output signal...

  12. Research on the Multi-view Point 3-D Clouds Splicing Algorithm based on Local Registration

    Directory of Open Access Journals (Sweden)

    Daoming Feng

    2013-01-01

    Full Text Available The paper proposed a new 3-D measurement point cloud splicing algorithm. The algorithm utilizes registration ideal in model identification technology to realize unbound and accurate splicing of 3-D data. First, sample the overlapping areas in the two 3-D point clouds which need to be spliced. Carry out pre-processing over the sampled point cloud with principal analysis method based on the statistic theory. Through extracting the feature vector that could best indicate the point cloud information, it realizes the dimension reduction for data. Then, apply improved iterate corresponding point algorithm to the sampled point cloud data which has realized pre-registration to achieve accurate registration. In the process, the set of progressive decrease of iterate condition by different levels reduced the iterate times. The utilization of new comprehensive distance measurement function effectively increases the accuracy and robustness of overall iterated convergence. Finally, apply the transformation parameter based on local sampled point cloud calculation to the entire point cloud splicing and achieve the accurate registration of multiple sampled point cloud. In the end, the actual test proved that the algorithm boasts high splicing accuracy with high overall convergence robustness, few convergence iterate times and strong anti-noise capacity.

  13. A local fast marching-based diffusion tensor image registration algorithm by simultaneously considering spatial deformation and tensor orientation.

    Science.gov (United States)

    Xue, Zhong; Li, Hai; Guo, Lei; Wong, Stephen T C

    2010-08-01

    It is a key step to spatially align diffusion tensor images (DTI) to quantitatively compare neural images obtained from different subjects or the same subject at different timepoints. Different from traditional scalar or multi-channel image registration methods, tensor orientation should be considered in DTI registration. Recently, several DTI registration methods have been proposed in the literature, but deformation fields are purely dependent on the tensor features not the whole tensor information. Other methods, such as the piece-wise affine transformation and the diffeomorphic non-linear registration algorithms, use analytical gradients of the registration objective functions by simultaneously considering the reorientation and deformation of tensors during the registration. However, only relatively local tensor information such as voxel-wise tensor-similarity is utilized. This paper proposes a new DTI image registration algorithm, called local fast marching (FM)-based simultaneous registration. The algorithm not only considers the orientation of tensors during registration but also utilizes the neighborhood tensor information of each voxel to drive the deformation, and such neighborhood tensor information is extracted from a local fast marching algorithm around the voxels of interest. These local fast marching-based tensor features efficiently reflect the diffusion patterns around each voxel within a spherical neighborhood and can capture relatively distinctive features of the anatomical structures. Using simulated and real DTI human brain data the experimental results show that the proposed algorithm is more accurate compared with the FA-based registration and is more efficient than its counterpart, the neighborhood tensor similarity-based registration. PMID:20382233

  14. Multi-mode sliding mode control for precision linear stage based on fixed or floating stator

    Science.gov (United States)

    Fang, Jiwen; Long, Zhili; Wang, Michael Yu; Zhang, Lufan; Dai, Xufei

    2016-02-01

    This paper presents the control performance of a linear motion stage driven by Voice Coil Motor (VCM). Unlike the conventional VCM, the stator of this VCM is regulated, which means it can be adjusted as a floating-stator or fixed-stator. A Multi-Mode Sliding Mode Control (MMSMC), including a conventional Sliding Mode Control (SMC) and an Integral Sliding Mode Control (ISMC), is designed to control the linear motion stage. The control is switched between SMC and IMSC based on the error threshold. To eliminate the chattering, a smooth function is adopted instead of a signum function. The experimental results with the floating stator show that the positioning accuracy and tracking performance of the linear motion stage are improved with the MMSMC approach.

  15. Fuzzy decoupling controller based on multimode control algorithm of PI-single neuron and its application

    Science.gov (United States)

    Zhang, Xianxia; Wang, Jian; Qin, Tinggao

    2003-09-01

    Intelligent control algorithms are introduced into the control system of temperature and humidity. A multi-mode control algorithm of PI-Single Neuron is proposed for single loop control of temperature and humidity. In order to remove the coupling between temperature and humidity, a new decoupling method is presented, which is called fuzzy decoupling. The decoupling is achieved by using a fuzzy controller that dynamically modifies the static decoupling coefficient. Taking the control algorithm of PI-Single Neuron as the single loop control of temperature and humidity, the paper provides the simulated output response curves with no decoupling control, static decoupling control and fuzzy decoupling control. Those control algorithms are easily implemented in singlechip-based hardware systems.

  16. User-based representation of time-resolved multimodal public transportation networks

    CERN Document Server

    Alessandretti, Laura; Gauvin, Laetitia

    2015-01-01

    Multimodal transportation systems can be represented as time-resolved multilayer networks where different transportation modes connecting the same set of nodes are associated to distinct network layers. Their quantitative description became possible recently due to openly accessible datasets describing the geolocalised transportation dynamics of large urban areas. Advancements call for novel analytics, which combines earlier established methods and exploits the inherent complexity of the data. Here, our aim is to provide a novel user-based methodological framework to represent public transportation systems considering the total travel time, its variability across the schedule, and taking into account the number of transfers necessary. Using this framework we analyse public transportation systems in several French municipal areas. We incorporate travel routes and times over multiple transportation modes to identify efficient transportation connections and non-trivial connectivity patterns. The proposed method ...

  17. Variable Optical Attenuator Based on Long-Range Surface Plasmon Polariton Multimode Interference Coupler

    Directory of Open Access Journals (Sweden)

    Xiaoqiang Sun

    2014-01-01

    Full Text Available The fabrication and characterization of a thermal variable optical attenuator based on long-range surface plasmon polariton (LRSPP waveguide with multimode interference architecture were investigated. The surface morphology and waveguide configuration of Au stripe were studied by atomic force microscopy. The fluctuation of refractive index of poly(methyl-methacrylate-glycidyl-methacrylate polymer cladding was confirmed to be less than 3×10-4 within 8 h curing at 120°C. The end-fire excitation of LRSPP mode guiding at 1550 nm along Au stripe indicated that the extinction ratio of attenuator was about 12 dB at a driving power of 69 mW. The measured optical rise time and fall time are 0.57 and 0.87 ms, respectively. These favorable properties promise potentials of this plasmonic device in the application of optical interconnection.

  18. Multi-modal vibration energy harvesting approach based on nonlinear oscillator arrays under magnetic levitation

    Science.gov (United States)

    Abed, I.; Kacem, N.; Bouhaddi, N.; Bouazizi, M. L.

    2016-02-01

    We propose a multi-modal vibration energy harvesting approach based on arrays of coupled levitated magnets. The equations of motion which include the magnetic nonlinearity and the electromagnetic damping are solved using the harmonic balance method coupled with the asymptotic numerical method. A multi-objective optimization procedure is introduced and performed using a non-dominated sorting genetic algorithm for the cases of small magnet arrays in order to select the optimal solutions in term of performances by bringing the eigenmodes close to each other in terms of frequencies and amplitudes. Thanks to the nonlinear coupling and the modal interactions even for only three coupled magnets, the proposed method enable harvesting the vibration energy in the operating frequency range of 4.6-14.5 Hz, with a bandwidth of 190% and a normalized power of 20.2 {mW} {{cm}}-3 {{{g}}}-2.

  19. Heat-induced multimode interference variable optical attenuator based on novel organic-inorganic hybrid materials

    International Nuclear Information System (INIS)

    A heat-induced multimode interference (MMI) variable optical attenuator at 1310 nm wavelength, based on novel organic–inorganic hybrid materials is successfully designed and fabricated. The thermal stability and optical properties of the sol–gel materials are analyzed. The thermo-optic (TO) coefficient of the organic–inorganic hybrid material is obtained as −1.85 × 10−4 °C−1. The characteristic parameters of the waveguides and heat-induced electrodes are carefully designed and simulated. The propagation loss of a 4 μm-wide straight waveguide is 0.56 dB cm−1. The attenuation of the device is about −25 dB, and the applied electric power is 36.2 mW. The new material system and low-cost fabrication technique could be suitable for realizing large-scale photonic integrated circuits. (paper)

  20. Tunable triple Fano resonances based on multimode interference in coupled plasmonic resonator system.

    Science.gov (United States)

    Li, Shilei; Zhang, Yunyun; Song, Xiaokang; Wang, Yilin; Yu, Li

    2016-07-11

    In this paper, an asymmetric plasmonic structure composed of two MIM (metal-insulator-metal) waveguides and two rectangular cavities is reported, which can support triple Fano resonances originating from three different mechanisms. And the multimode interference coupled mode theory (MICMT) including coupling phases is proposed based on single mode coupled mode theory (CMT), which is used for describing and explaining the multiple Fano resonance phenomenon in coupled plasmonic resonator systems. Just because the triple Fano resonances originate from three different mechanisms, each Fano resonance can be tuned independently or semi-independently by changing the parameters of the two rectangular cavities. Such, a narrow 'M' type of double Lorentzian-like line-shape transmission windows with the position and the full width at half maximum (FWHM) can be tuned freely is constructed by changing the parameters of the two cavities appropriately, which can find widely applications in sensors, nonlinear and slow-light devices. PMID:27410811

  1. Refractive index sensors based on the fused tapered special multi-mode fiber

    Science.gov (United States)

    Fu, Xing-hu; Xiu, Yan-li; Liu, Qin; Xie, Hai-yang; Yang, Chuan-qing; Zhang, Shun-yang; Fu, Guang-wei; Bi, Wei-hong

    2016-01-01

    In this paper, a novel refractive index (RI) sensor is proposed based on the fused tapered special multi-mode fiber (SMMF). Firstly, a section of SMMF is spliced between two single-mode fibers (SMFs). Then, the SMMF is processed by a fused tapering machine, and a tapered fiber structure is fabricated. Finally, a fused tapered SMMF sensor is obtained for measuring external RI. The RI sensing mechanism of tapered SMMF sensor is analyzed in detail. For different fused tapering lengths, the experimental results show that the RI sensitivity can be up to 444.517 81 nm/RIU in the RI range of 1.334 9—1.347 0. The RI sensitivity is increased with the increase of fused tapering length. Moreover, it has many advantages, including high sensitivity, compact structure, fast response and wide application range. So it can be used to measure the solution concentration in the fields of biochemistry, health care and food processing.

  2. A New Approach for Super resolution by Using Web Images and FFT Based Image Registration

    OpenAIRE

    2014-01-01

    Preserving accuracy is a challenging issue in super resolution images. In this paper, we propose a new FFT based image registration algorithm and a sparse based super resolution algorithm to improve the accuracy of super resolution image. Given a low resolution image, our approach initially extracts the local descriptors from the input and then the local descriptors from the whole correlated images using the SIFT algorithm. Once this is completed, it will compare the local descriptors on the ...

  3. Rigid Registration of Renal Perfusion Images Using a Neurobiology-Based Visual Saliency Model

    Directory of Open Access Journals (Sweden)

    Mahapatra Dwarikanath

    2010-01-01

    Full Text Available General mutual information- (MI- based registration methods treat all voxels equally. But each voxel has a different utility depending upon the task. Because of its robustness to noise, low computation time, and agreement with human fixations, the Itti-Koch visual saliency model is used to determine voxel utility of renal perfusion data. The model is able to match identical regions in spite of intensity change due to its close adherence to the center-surround property of the visual cortex. Saliency value is used as a pixel's utility measure in an MI framework for rigid registration of renal perfusion data exhibiting rapid intensity change and noise. We simulated varying degrees of rotation and translation motion under different noise levels, and a novel optimization technique was used for fast and accurate recovery of registration parameters. We also registered real patient data having rotation and translation motion. Our results show that saliency information improves registration accuracy for perfusion images and the Itti-Koch model is a better indicator of visual saliency than scale-space maps.

  4. Automated Feature Based Tls Data Registration for 3d Building Modeling

    Science.gov (United States)

    Kitamura, K.; Kochi, N.; Kaneko, S.

    2012-07-01

    In this paper we present a novel method for the registration of point cloud data obtained using terrestrial laser scanner (TLS). The final goal of our investigation is the automated reconstruction of CAD drawings and the 3D modeling of objects surveyed by TLS. Because objects are scanned from multiple positions, individual point cloud need to be registered to the same coordinate system. We propose in this paper an automated feature based registration procedure. Our proposed method does not require the definition of initial values or the placement of targets and is robust against noise and background elements. A feature extraction procedure is performed for each point cloud as pre-processing. The registration of the point clouds from different viewpoints is then performed by utilizing the extracted features. The feature extraction method which we had developed previously (Kitamura, 2010) is used: planes and edges are extracted from the point cloud. By utilizing these features, the amount of information to process is reduced and the efficiency of the whole registration procedure is increased. In this paper, we describe the proposed algorithm and, in order to demonstrate its effectiveness, we show the results obtained by using real data.

  5. Cooperative Moving Object Segmentation using Two Cameras based on Background Subtraction and Image Registration

    Directory of Open Access Journals (Sweden)

    Zhigao Cui

    2014-03-01

    Full Text Available Moving camera, such as PTZ (pan-tilt-zoom camera, has been widely applied in visual surveillance system. However, it’s difficult to extract moving objects because of the dynamic background caused by the camera motion. In this paper, a novel framework for moving object segmentation exploiting two cameras collaboration is presented by combining background subtraction and image registration method. The proposed method uses one static camera to capture large-view images at low resolution, and one moving camera (i.e. PTZ camera to capture local-view images at high resolution. Different with methods using a single moving camera, the moving objects can be effectively segmented in the static camera image by background subtraction method. Then image registration method can be applied to extract moving region in the moving camera image. To deal with the resolution and intensity discrepancy between two synchronized images, we design a practical three-step image registration method, which has higher registration accuracy than traditional feature based method. Experimental results on outdoor scene demonstrate the effectiveness and robustness of proposed approach.

  6. Validation of 3D multimodality roadmapping in interventional neuroradiology

    Science.gov (United States)

    Ruijters, Daniel; Homan, Robert; Mielekamp, Peter; van de Haar, Peter; Babic, Drazenko

    2011-08-01

    Three-dimensional multimodality roadmapping is entering clinical routine utilization for neuro-vascular treatment. Its purpose is to navigate intra-arterial and intra-venous endovascular devices through complex vascular anatomy by fusing pre-operative computed tomography (CT) or magnetic resonance (MR) with the live fluoroscopy image. The fused image presents the real-time position of the intra-vascular devices together with the patient's 3D vascular morphology and its soft-tissue context. This paper investigates the effectiveness, accuracy, robustness and computation times of the described methods in order to assess their suitability for the intended clinical purpose: accurate interventional navigation. The mutual information-based 3D-3D registration proved to be of sub-voxel accuracy and yielded an average registration error of 0.515 mm and the live machine-based 2D-3D registration delivered an average error of less than 0.2 mm. The capture range of the image-based 3D-3D registration was investigated to characterize its robustness, and yielded an extent of 35 mm and 25° for >80% of the datasets for registration of 3D rotational angiography (3DRA) with CT, and 15 mm and 20° for >80% of the datasets for registration of 3DRA with MR data. The image-based 3D-3D registration could be computed within 8 s, while applying the machine-based 2D-3D registration only took 1.5 µs, which makes them very suitable for interventional use.

  7. Robust Global Image Registration Based on a Hybrid Algorithm Combining Fourier- and Spatial-domain Techniques

    Science.gov (United States)

    Crabtree, P.; McNicholl, P.; Seanor, C.; Murray-Krezan, J.

    2012-09-01

    A variety of image registration techniques have been investigated for applications such as image analysis, fusion, compression, enhancement, and creating mosaics. In particular, robust registration is a key component for successful multi-frame processing aimed at super-resolution or high dynamic range imaging. Image registration techniques are broadly categorized as global (area) or feature-based, and can also be classified as being performed in either the Fourier- or spatial-domain. Spatial domain methods are typically used for applications requiring accurate estimation of sub-pixel motion, such as multi-frame super-resolution based on de-aliasing. However, these techniques often rely on the availability of a priori information (good initial guess), and are therefore limited in terms of the dynamic range of the global motion estimates. A Gaussian pyramid approach is one standard method for extending the region of convergence of spatial domain techniques. On the other hand, Fourier domain-based correlation techniques such as the log-polar FFT method provide fast and reasonably accurate estimates of global shifts, rotation, and uniform scale changes, and tend to perform well over a large range of frame-to-frame motion magnitudes. In this paper we explore several possible hybrid algorithms for robust global registration based on combining the log-polar FFT and spatial-domain techniques. This includes the straightforward use of the log-polar FFT algorithm to generate an initial guess for use by a spatial domain algorithm, as well as the intertwining of the two methods by applying both global correlation and spatial domain registration at each relevant step within the log-polar FFT algorithm. In addition, we explore the benefits of normalized gradient correlation in performing the coarse log-polar FFT registration. The use of normalized gradient correlation, as opposed to phase-only correlation, has recently been proposed for improving the log-polar FFT method in terms

  8. Seed-based transrectal ultrasound-fluoroscopy registration method for intraoperative dosimetry analysis of prostate brachytherapy

    International Nuclear Information System (INIS)

    Prostate brachytherapy is an effective treatment option for early-stage prostate cancer. During a prostate brachytherapy procedure, transrectal ultrasound (TRUS) and fluoroscopy imaging modalities complement each other by providing good visualization of soft tissue and implanted seeds, respectively. Therefore, the registration of these two imaging modalities, which are readily available in the operating room, could facilitate intraoperative dosimetry, thus enabling physicians to implant additional seeds into the underdosed portions of the prostate while the patient is still on the operating table. It is desirable to register TRUS and fluoroscopy images by using the seeds as fiducial markers. Although the locations of all the implanted seeds can be reconstructed from three fluoroscopy images, only a fraction of these seeds can be located in TRUS images. It is challenging to register the TRUS and fluoroscopy images by using the identified seeds, since the correspondence between them is unknown. Furthermore, misdetection of nonseed structures as seeds can lead to the inclusion of spurious points in the data set. We developed a new method called iterative optimal assignment (IOA) to overcome these challenges in TRUS-fluoroscopy registration. By using the Hungarian method in an optimization framework, IOA computes a set of transformation parameters that yield the one-to-one correspondence with minimum cost. We have evaluated our registration method at varying noise levels, seed detection rates, and number of spurious points using data collected from 25 patients. We have found that IOA can perform registration with an average root mean square error of about 0.2 cm even when the seed detection rate is only 10%. We believe that IOA can offer a robust solution to seed-based TRUS-fluoroscopy registration, thus making intraoperative dosimetry possible

  9. Rationale for a Multimodality Strategy to Enhance the Efficacy of Dendritic Cell-Based Cancer Immunotherapy.

    Science.gov (United States)

    Datta, Jashodeep; Berk, Erik; Cintolo, Jessica A; Xu, Shuwen; Roses, Robert E; Czerniecki, Brian J

    2015-01-01

    Dendritic cells (DC), master antigen-presenting cells that orchestrate interactions between the adaptive and innate immune arms, are increasingly utilized in cancer immunotherapy. Despite remarkable progress in our understanding of DC immunobiology, as well as several encouraging clinical applications - such as DC-based sipuleucel-T for metastatic castration-resistant prostate cancer - clinically effective DC-based immunotherapy as monotherapy for a majority of tumors remains a distant goal. The complex interplay between diverse molecular and immune processes that govern resistance to DC-based vaccination compels a multimodality approach, encompassing a growing arsenal of antitumor agents which target these distinct processes and synergistically enhance DC function. These include antibody-based targeted molecular therapies, immune checkpoint inhibitors, therapies that inhibit immunosuppressive cellular elements, conventional cytotoxic modalities, and immune potentiating adjuvants. It is likely that in the emerging era of "precision" cancer therapeutics, tangible clinical benefits will only be realized with a multifaceted - and personalized - approach combining DC-based vaccination with adjunctive strategies. PMID:26082780

  10. Rationale for a multimodality strategy to enhance the efficacy of dendritic cell-based cancer immunotherapy

    Directory of Open Access Journals (Sweden)

    Jashodeep eDatta

    2015-06-01

    Full Text Available Dendritic cells (DC, master antigen-presenting cells that orchestrate interactions between the adaptive and innate immune arms, are increasingly utilized in cancer immunotherapy. Despite remarkable progress in our understanding of DC immunobiology, as well as several encouraging clinical applications — such as DC-based sipuleucel-T for metastatic castration-resistant prostate cancer — clinically effective DC-based immunotherapy as monotherapy for a majority of tumors remains a distant goal. The complex interplay between diverse molecular and immune processes that govern resistance to DC-based vaccination compels a multimodality approach, encompassing a growing arsenal of antitumor agents which target these distinct processes and synergistically enhance DC function. These include antibody-based targeted molecular therapies, immune checkpoint inhibitors, therapies that inhibit immunosuppressive cellular elements, conventional cytotoxic modalities, and immune potentiating adjuvants. It is likely that in the emerging era of precision cancer therapeutics, tangible clinical benefits will only be realized with a multifaceted—and personalized—approach combining DC-based vaccination with adjunctive strategies.

  11. Multimodal Afslapning

    Directory of Open Access Journals (Sweden)

    Stephen Palmer

    2012-10-01

    Full Text Available Artiklen beskriver Multimodal Relaxation Method (MRM, fremover Multimodal Afslapningsmetode, somkan anvendes i livs-, ledelses-, virksomheds-, sports- eller sundhedscoaching til at forbedre ydeevnen hos denenkelte og reducere eller håndtere stress. Inden for sports- og sundhedscoaching kan metoden anvendes til atreducere fysiske spændinger og styrke fysiologisk kontrol, fx lavere hjertefrekvens og nedsætte blodtrykket.

  12. Communications using multi-mode laser system based on chaotic synchronization

    Institute of Scientific and Technical Information of China (English)

    吴亮; 朱士群

    2003-01-01

    The communication using chaotic synchronization between two multi-mode Nd:YAG lasers has been investigated numerically. The digital communication using multi-mode chaotic lasers is quite different from that using single mode lasers. By introducing a short break between two adjacent bits in the communication scheme, the digital signals can be successfully encoded into the spiky pulses and decoded through the subtraction of receiver output from the transmitted.Even when the two multi-mode lasers are not synchronized perfectly with certain deviations, the encoded digits can still be decoded correctly.

  13. RFID based patient registration in mass casualty incidents

    Directory of Open Access Journals (Sweden)

    Nestler, Simon

    2011-01-01

    Full Text Available In MCIs (mass casualty incidents the EMC (emergency medical chief has to gain an overview on all patients at the scene. When using paper based patient tags the patient-related information remains at the patients themselves and the information relay is complex. We propose a mobile, RFID based solution, which makes the local patient-related information available to all relief workers at the scene. As a consequence all processes in an MCI are more transparent and the resulting medication and transport of the injured is more efficient. The introduction of RFID enhanced patient tags leads to various usability challenges which are discussed in this paper. Furthermore, three different implementations show, how these challenges can be solved in the future. These solutions have been evaluated in a disaster control exercise in order to get an impression of the practical suitability of the proposed solutions. The future introduction of RFID tags in rescue and emergency services can be based on this work.

  14. Evaluation of an Automatic Registration-Based Algorithm for Direct Measurement of Volume Change in Tumors

    International Nuclear Information System (INIS)

    Purpose: Assuming that early tumor volume change is a biomarker for response to therapy, accurate quantification of early volume changes could aid in adapting an individual patient’s therapy and lead to shorter clinical trials. We investigated an image registration–based approach for tumor volume change quantification that may more reliably detect smaller changes that occur in shorter intervals than can be detected by existing algorithms. Methods and Materials: Variance and bias of the registration-based approach were evaluated using retrospective, in vivo, very-short-interval diffusion magnetic resonance imaging scans where true zero tumor volume change is unequivocally known and synthetic data, respectively. The interval scans were nonlinearly registered using two similarity measures: mutual information (MI) and normalized cross-correlation (NCC). Results: The 95% confidence interval of the percentage volume change error was (−8.93% to 10.49%) for MI-based and (−7.69%, 8.83%) for NCC-based registrations. Linear mixed-effects models demonstrated that error in measuring volume change increased with increase in tumor volume and decreased with the increase in the tumor’s normalized mutual information, even when NCC was the similarity measure being optimized during registration. The 95% confidence interval of the relative volume change error for the synthetic examinations with known changes over ±80% of reference tumor volume was (−3.02% to 3.86%). Statistically significant bias was not demonstrated. Conclusion: A low-noise, low-bias tumor volume change measurement algorithm using nonlinear registration is described. Errors in change measurement were a function of tumor volume and the normalized mutual information content of the tumor.

  15. Comparison of landmark-based and automatic methods for cortical surface registration.

    Science.gov (United States)

    Pantazis, Dimitrios; Joshi, Anand; Jiang, Jintao; Shattuck, David W; Bernstein, Lynne E; Damasio, Hanna; Leahy, Richard M

    2010-02-01

    Group analysis of structure or function in cerebral cortex typically involves, as a first step, the alignment of cortices. A surface-based approach to this problem treats the cortex as a convoluted surface and coregisters across subjects so that cortical landmarks or features are aligned. This registration can be performed using curves representing sulcal fundi and gyral crowns to constrain the mapping. Alternatively, registration can be based on the alignment of curvature metrics computed over the entire cortical surface. The former approach typically involves some degree of user interaction in defining the sulcal and gyral landmarks while the latter methods can be completely automated. Here we introduce a cortical delineation protocol consisting of 26 consistent landmarks spanning the entire cortical surface. We then compare the performance of a landmark-based registration method that uses this protocol with that of two automatic methods implemented in the software packages FreeSurfer and BrainVoyager. We compare performance in terms of discrepancy maps between the different methods, the accuracy with which regions of interest are aligned, and the ability of the automated methods to correctly align standard cortical landmarks. Our results show similar performance for ROIs in the perisylvian region for the landmark-based method and FreeSurfer. However, the discrepancy maps showed larger variability between methods in occipital and frontal cortex and automated methods often produce misalignment of standard cortical landmarks. Consequently, selection of the registration approach should consider the importance of accurate sulcal alignment for the specific task for which coregistration is being performed. When automatic methods are used, the users should ensure that sulci in regions of interest in their studies are adequately aligned before proceeding with subsequent analysis. PMID:19796696

  16. Modified maximum likelihood registration based on information fusion

    Institute of Scientific and Technical Information of China (English)

    Yongqing Qi; Zhongliang Jing; Shiqiang Hu

    2007-01-01

    The bias estimation of passive sensors is considered based on information fusion in multi-platform multisensor tracking system. The unobservable problem of bearing-only tracking in blind spot is analyzed. A modified maximum likelihood method, which uses the redundant information of multi-sensor system to calculate the target position, is investigated to estimate the biases. Monte Carlo simulation results show that the modified method eliminates the effect of unobservable problem in the blind spot and can estimate the biases more rapidly and accurately than maximum likelihood method. It is statistically efficient since the standard deviation of bias estimation errors meets the theoretical lower bounds.

  17. Comparison of Image Registration Based Measures of Regional Lung Ventilation from Dynamic Spiral CT with Xe-CT

    CERN Document Server

    Ding, Kai; Fuld, Matthew K; Du, Kaifang; Christensen, Gary E; Hoffman, Eric A; Reinhardt, Joseph M

    2012-01-01

    Purpose: Regional lung volume change as a function of lung inflation serves as an index of parenchymal and airway status as well as an index of regional ventilation and can be used to detect pathologic changes over time. In this article, we propose a new regional measure of lung mechanics --- the specific air volume change by corrected Jacobian. Methods: 4DCT and Xe-CT data sets from four adult sheep are used in this study. Nonlinear, 3D image registration is applied to register an image acquired near end inspiration to an image acquired near end expiration. Approximately 200 annotated anatomical points are used as landmarks to evaluate registration accuracy. Three different registration-based measures of regional lung mechanics are derived and compared: the specific air volume change calculated from the Jacobian (SAJ); the specific air volume change calculated by the corrected Jacobian (SACJ); and the specific air volume change by intensity change (SAI). Results: After registration, the mean registration err...

  18. Addressing missing values in kernel-based multimodal biometric fusion using neutral point substitution

    OpenAIRE

    Poh N.; Windridge D.; Mottl V.; Tatarchuk A.; Eliseyev A.

    2010-01-01

    In multimodal biometric information fusion, it is common to encounter missing modalities in which matching cannot be performed. As a result, at the match score level, this implies that scores will be missing. We address the multimodal fusion problem involving missing modalities (scores) using support vector machines (SVMs) with the neutral point substitution (NPS) method. The approach starts by processing each modality using a kernel. When a modality is missing, at the kernel level, the missi...

  19. Intensity-based registration and fusion of thermal and visual facial-images

    Science.gov (United States)

    Arslan, Musa Serdar; Elbakaray, Mohamed I.; Reza, Shamim; Iftekharuddin, Khan M.

    2012-10-01

    Fusion of images from different modalities provides information that cannot be obtained by viewing the images separately and consecutively. Automatic fusion of thermal and visual images is of great interest in defense and medical applications. In this study, we implemented automatic intensity-based illumination, translation and scale invariant registration of deformable objects in thermal and visual images by maximization of a similarity measure such as generalized correlation ratio. This method was originally used to register ultrasound (US) and magnetic resonance images (MRI) successfully. In our current work, we propose a major modification to the original algorithm by investigating appropriate information content in the input data. The registration of facial thermal and visual images in this algorithm is achieved by maximization of the similarity measure between the input images in the appropriate image channel. The algorithm is tested using real facial images with illumination, scale, and translation variations and the results show acceptable accuracy.

  20. Bias reduction in sub-pixel image registration based on the anti-symmetric feature

    Science.gov (United States)

    Wang, Dezhi; Jiang, Yu; Wang, Weizhuo; Wang, Yueqi

    2016-03-01

    A simple but effective bias reduction technique is developed based on the anti-symmetric feature of the sub-pixel image registration bias. Depending on the error propagation theory, the anti-symmetric feature is mathematically derived through a classical subset-based digital image correlation algorithm considering the most common error sources i.e. the grey-intensity interpolation scheme and random noise. This leads to the sub-pixel registration bias formulated in the form of an analytic expression that consists of the interpolation-induced phase error and the random noise induced bias, which is also further illustrated by numerical simulations. Bias reduction is achieved by compensating the bias at a certain sub-pixel displacement with the bias at the corresponding anti-symmetric sub-pixel displacement where the Fourier shift theorem is employed to alter the displacement without introducing extra bias. The performance of proposed method is validated using numerical case studies with different interpolation schemes and noise levels, by which the sub-pixel registration bias is shown to be significantly reduced.

  1. Bias reduction in sub-pixel image registration based on the anti-symmetric feature

    International Nuclear Information System (INIS)

    A simple but effective bias reduction technique is developed based on the anti-symmetric feature of the sub-pixel image registration bias. Depending on the error propagation theory, the anti-symmetric feature is mathematically derived through a classical subset-based digital image correlation algorithm considering the most common error sources i.e. the grey-intensity interpolation scheme and random noise. This leads to the sub-pixel registration bias formulated in the form of an analytic expression that consists of the interpolation-induced phase error and the random noise induced bias, which is also further illustrated by numerical simulations. Bias reduction is achieved by compensating the bias at a certain sub-pixel displacement with the bias at the corresponding anti-symmetric sub-pixel displacement where the Fourier shift theorem is employed to alter the displacement without introducing extra bias. The performance of proposed method is validated using numerical case studies with different interpolation schemes and noise levels, by which the sub-pixel registration bias is shown to be significantly reduced. (paper)

  2. Fast Rotation-Free Feature-Based Image Registration Using Improved N-SIFT and GMM-Based Parallel Optimization.

    Science.gov (United States)

    Yu, Dongdong; Yang, Feng; Yang, Caiyun; Leng, Chengcai; Cao, Jian; Wang, Yining; Tian, Jie

    2016-08-01

    Image registration is a key problem in a variety of applications, such as computer vision, medical image processing, pattern recognition, etc., while the application of registration is limited by time consumption and the accuracy in the case of large pose differences. Aimed at these two kinds of problems, we propose a fast rotation-free feature-based rigid registration method based on our proposed accelerated-NSIFT and GMM registration-based parallel optimization (PO-GMMREG). Our method is accelerated by using the GPU/CUDA programming and preserving only the location information without constructing the descriptor of each interest point, while its robustness to missing correspondences and outliers is improved by converting the interest point matching to Gaussian mixture model alignment. The accuracy in the case of large pose differences is settled by our proposed PO-GMMREG algorithm by constructing a set of initial transformations. Experimental results demonstrate that our proposed algorithm can fast rigidly register 3-D medical images and is reliable for aligning 3-D scans even when they exhibit a poor initialization. PMID:26259212

  3. Core-based portal image registration for automatic radiotherapy treatment verification

    International Nuclear Information System (INIS)

    Purpose: Portal imaging is the most important quality assurance procedure for monitoring the reproducibility of setup geometry in radiation therapy. The role of portal imaging has become even more critical in recent years due to the migration of three-dimensional (3D) treatment planning technology, including high-precision conformal therapy, from the research setting to routine clinical practice. Unfortunately, traditional methods for acquiring and interpreting portal images suffer from a number of deficiencies that contribute to the well-documented observation that many setup errors go undetected, and some persist for a clinically significant portion of the prescribed dose. Significant improvements in both accuracy and efficiency of detecting setup errors can, in principle, be achieved by using automatic image registration for on-line screening of images obtained from electronic portal imaging devices (EPIDs). Methods and Materials: This article presents recent developments in a method called core-based image analysis that shows great promise for achieving the desired improvements in error detection. Core-based image analysis is a fundamental computer vision method that is capable of exploiting the full power of EPIDs by providing for on-line detection of setup errors via automatic registration of user-selected anatomical structures. We describe a robust method for automatic portal image registration based on core analysis and demonstrate an approach for assessing both accuracy and precision of registration methods using realistic, digitally reconstructed portal radiographs (DRPRs) where truth is know. Results: Automatic core-based analysis of a set of 20 DRPRs containing known, random field positioning errors was performed for a patient undergoing treatment for prostate cancer. In all cases, the reported translation was within 1 mm of the actual translation with mean absolute errors of 0.3 mm and standard deviations of 0.3 mm. In all cases, the reported rotation

  4. Appearance-based human gesture recognition using multimodal features for human computer interaction

    Science.gov (United States)

    Luo, Dan; Gao, Hua; Ekenel, Hazim Kemal; Ohya, Jun

    2011-03-01

    The use of gesture as a natural interface plays an utmost important role for achieving intelligent Human Computer Interaction (HCI). Human gestures include different components of visual actions such as motion of hands, facial expression, and torso, to convey meaning. So far, in the field of gesture recognition, most previous works have focused on the manual component of gestures. In this paper, we present an appearance-based multimodal gesture recognition framework, which combines the different groups of features such as facial expression features and hand motion features which are extracted from image frames captured by a single web camera. We refer 12 classes of human gestures with facial expression including neutral, negative and positive meanings from American Sign Languages (ASL). We combine the features in two levels by employing two fusion strategies. At the feature level, an early feature combination can be performed by concatenating and weighting different feature groups, and LDA is used to choose the most discriminative elements by projecting the feature on a discriminative expression space. The second strategy is applied on decision level. Weighted decisions from single modalities are fused in a later stage. A condensation-based algorithm is adopted for classification. We collected a data set with three to seven recording sessions and conducted experiments with the combination techniques. Experimental results showed that facial analysis improve hand gesture recognition, decision level fusion performs better than feature level fusion.

  5. Plasmonic-multimode-interference-based logic circuit with simple phase adjustment

    Science.gov (United States)

    Ota, Masashi; Sumimura, Asahi; Fukuhara, Masashi; Ishii, Yuya; Fukuda, Mitsuo

    2016-04-01

    All-optical logic circuits using surface plasmon polaritons have a potential for high-speed information processing with high-density integration beyond the diffraction limit of propagating light. However, a number of logic gates that can be cascaded is limited by complicated signal phase adjustment. In this study, we demonstrate a half-adder operation with simple phase adjustment using plasmonic multimode interference (MMI) devices, composed of dielectric stripes on a metal film, which can be fabricated by a complementary metal-oxide semiconductor (MOS)-compatible process. Also, simultaneous operations of XOR and AND gates are substantiated experimentally by combining 1 × 1 MMI based phase adjusters and 2 × 2 MMI based intensity modulators. An experimental on-off ratio of at least 4.3 dB is confirmed using scanning near-field optical microscopy. The proposed structure will contribute to high-density plasmonic circuits, fabricated by complementary MOS-compatible process or printing techniques.

  6. CPG-based Sensory Feedback Control for Bio-inspired Multimodal Swimming

    Directory of Open Access Journals (Sweden)

    Ming Wang

    2014-10-01

    Full Text Available Sensory feedback plays a very significant role in the generation of diverse and stable movements for animals. In this paper we describe our effort to develop a Central Pattern Generator (CPG-based sensory feedback control for the creation of multimodal swimming for a multi-articulated robotic fish in the context of neurocomputing. The proposed control strategy is composed of two phases: the upper decision-making and the automatic adjustment. According to the upper control commands and the sensory inputs, different swimming gaits are determined by a finite state machine algorithm. At the same time, the sensory feedback is exploited to shape the CPG coupling forms and control parameters. In the automatic adjustment phase, the CPG model with sensory feedback will adapt the environment autonomously. Simulation and underwater tests are further conducted to verify the presented control scheme. It is found that the CPG-based sensory feedback control method can effectively improve the manoeuvrability and adaptability of the robotic fish in water.

  7. Experimental research on an integrated thermooptic switch based on multimode interference couplers

    Institute of Scientific and Technical Information of China (English)

    WAN Zhujun; WU Yaming; LI Sihua

    2007-01-01

    The experimental results of a 2×2 integrated thermooptic Mach-Zehnder interferometer (MZI)switch based on multimode interference(MMI)couplers are reported.The insertion loss (IL) is 3.40 dB,the polarization dependent loss is 0.47 dB,the extinction ratio (ER)at bar state and cross state is 32.01 dB and 16.42 dB respectively,the response time is less than 3 ms,and the power consumption is 65 8 mW Regarding the asymmetry of extinction ratio at bar state and cross state,theoretical analysis is first presented.The coupling ratio of the two MMI couplers deviates from 50:50 but the deviation is nearly the same.which is decided by good uniformity of semiconductor planar lightwave circuit (PLC)process.This property affects the extinction ratio at bar state and cross state in different mechanisms.Adding a metal electrode on the waveguide affects its effective index and analysis based on experimental results is given.The jncrement of waveguide effective index is in the order of 2×10-4.

  8. Two-port multimode interference reflectors based on aluminium mirrors in a thick SOI platform

    CERN Document Server

    Fandiño, Javier S; Muñoz, Pascual

    2015-01-01

    Multimode interference reflectors (MIRs) were recently introduced as a new type of photonic integrated devices for on-chip, broadband light reflection. In the original proposal, different MIRs were demonstrated based on total internal reflection mirrors made of two deep-etched facets. Although simpler to fabricate, this approach imposes certain limits on the shape of the field pattern at the reflecting facets, which in turn restricts the types of MIRs that can be implemented. In this work, we propose and experimentally demonstrate the use of aluminium-based mirrors for the design of 2-port MIRs with variable reflectivity. These mirrors do not impose any restrictions on the incident field, and thus give more flexibility at the design stage. Different devices with reflectivities between~0~and~0.5 were fabricated in a 3~um thick SOI platform, and characterization of multiple dies was performed to extract statistical data about their performance. Our measurements show that, on average, losses both in the aluminiu...

  9. Face-iris multimodal biometric scheme based on feature level fusion

    Science.gov (United States)

    Huo, Guang; Liu, Yuanning; Zhu, Xiaodong; Dong, Hongxing; He, Fei

    2015-11-01

    Unlike score level fusion, feature level fusion demands all the features extracted from unimodal traits with high distinguishability, as well as homogeneity and compatibility, which is difficult to achieve. Therefore, most multimodal biometric research focuses on score level fusion, whereas few investigate feature level fusion. We propose a face-iris recognition method based on feature level fusion. We build a special two-dimensional-Gabor filter bank to extract local texture features from face and iris images, and then transform them by histogram statistics into an energy-orientation variance histogram feature with lower dimensions and higher distinguishability. Finally, through a fusion-recognition strategy based on principal components analysis and support vector machine (FRSPS), feature level fusion and one-to-n identification are accomplished. The experimental results demonstrate that this method can not only effectively extract face and iris features but also provide higher recognition accuracy. Compared with some state-of-the-art fusion methods, the proposed method has a significant performance advantage.

  10. Personalized, relevance-based Multimodal Robotic Imaging and augmented reality for Computer Assisted Interventions.

    Science.gov (United States)

    Navab, Nassir; Fellow, Miccai; Hennersperger, Christoph; Frisch, Benjamin; Fürst, Bernhard

    2016-10-01

    In the last decade, many researchers in medical image computing and computer assisted interventions across the world focused on the development of the Virtual Physiological Human (VPH), aiming at changing the practice of medicine from classification and treatment of diseases to that of modeling and treating patients. These projects resulted in major advancements in segmentation, registration, morphological, physiological and biomechanical modeling based on state of art medical imaging as well as other sensory data. However, a major issue which has not yet come into the focus is personalizing intra-operative imaging, allowing for optimal treatment. In this paper, we discuss the personalization of imaging and visualization process with particular focus on satisfying the challenging requirements of computer assisted interventions. We discuss such requirements and review a series of scientific contributions made by our research team to tackle some of these major challenges. PMID:27475417

  11. Registration of Aerial Image with Airborne LiDAR Data Based on Plücker Line

    OpenAIRE

    SHENG Qinghong; Chen, Shuwen; FEI Lijia; Liu, Jianfeng; Wang, Huinan

    2015-01-01

    Registration of aerial image with airborne LiDAR data is a key to feature extraction. A registration model based on Plücker line is proposed. The relative position and attitude relationship between the conjugate lines in LiDAR and image is determined based on Plücker linear equation, which describes line transformation in space, then coplanarity condition equation is established. Finally, coordinate transformation between image point and corresponding LiDAR point is achieved by the ...

  12. Sensitivity study of voxel-based PET image comparison to image registration algorithms

    Energy Technology Data Exchange (ETDEWEB)

    Yip, Stephen, E-mail: syip@lroc.harvard.edu; Chen, Aileen B.; Berbeco, Ross [Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute and Harvard Medical School, Boston, Massachusetts 02115 (United States); Aerts, Hugo J. W. L. [Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute and Harvard Medical School, Boston, Massachusetts 02115 and Department of Radiology, Brigham and Women’s Hospital and Harvard Medical School, Boston, Massachusetts 02115 (United States)

    2014-11-01

    Purpose: Accurate deformable registration is essential for voxel-based comparison of sequential positron emission tomography (PET) images for proper adaptation of treatment plan and treatment response assessment. The comparison may be sensitive to the method of deformable registration as the optimal algorithm is unknown. This study investigated the impact of registration algorithm choice on therapy response evaluation. Methods: Sixteen patients with 20 lung tumors underwent a pre- and post-treatment computed tomography (CT) and 4D FDG-PET scans before and after chemoradiotherapy. All CT images were coregistered using a rigid and ten deformable registration algorithms. The resulting transformations were then applied to the respective PET images. Moreover, the tumor region defined by a physician on the registered PET images was classified into progressor, stable-disease, and responder subvolumes. Particularly, voxels with standardized uptake value (SUV) decreases >30% were classified as responder, while voxels with SUV increases >30% were progressor. All other voxels were considered stable-disease. The agreement of the subvolumes resulting from difference registration algorithms was assessed by Dice similarity index (DSI). Coefficient of variation (CV) was computed to assess variability of DSI between individual tumors. Root mean square difference (RMS{sub rigid}) of the rigidly registered CT images was used to measure the degree of tumor deformation. RMS{sub rigid} and DSI were correlated by Spearman correlation coefficient (R) to investigate the effect of tumor deformation on DSI. Results: Median DSI{sub rigid} was found to be 72%, 66%, and 80%, for progressor, stable-disease, and responder, respectively. Median DSI{sub deformable} was 63%–84%, 65%–81%, and 82%–89%. Variability of DSI was substantial and similar for both rigid and deformable algorithms with CV > 10% for all subvolumes. Tumor deformation had moderate to significant impact on DSI for progressor

  13. All-fiber supercontinuum source in the range of 1550 – 2400 nm based on telecommunication multimode fiber

    International Nuclear Information System (INIS)

    For the first time to our best knowledge we have realized all-fiber supercontinuum source based on standard telecommunication multimode fiber. To pump the source Q-switched Er-doped fiber laser was used. The observed spectrum covers the spectral range from 1550 to 2400 nm with the power variation less than two decades. Average power of 0.85 W and pulse energy of 0.19 mJ was measured

  14. G-Heart: A GPU-based System for Electrophysiological Simulation and Multi-modality Cardiac Visualization

    OpenAIRE

    Lei Zhang; Kuanquan Wang; Wangmeng Zuo; Changqing Gai

    2014-01-01

    Cardiac electrophysiological simulation and multi-modality visualization are computationally intensive and valuable in studying the structure, mechanism, and dynamics of heart. The existing multi-CPU based approaches can reduce the calculation time, but suffer from the hardware and communication cost problems and are inefficient for 3D data visualization. Compared with multi-CPU, the highly parallel and multi-core properties of GPU make it a suitable alternative for accelerating cardiac simul...

  15. Cellular neural network-based hybrid approach toward automatic image registration

    Science.gov (United States)

    Arun, Pattathal VijayaKumar; Katiyar, Sunil Kumar

    2013-01-01

    Image registration is a key component of various image processing operations that involve the analysis of different image data sets. Automatic image registration domains have witnessed the application of many intelligent methodologies over the past decade; however, inability to properly model object shape as well as contextual information has limited the attainable accuracy. A framework for accurate feature shape modeling and adaptive resampling using advanced techniques such as vector machines, cellular neural network (CNN), scale invariant feature transform (SIFT), coreset, and cellular automata is proposed. CNN has been found to be effective in improving feature matching as well as resampling stages of registration and complexity of the approach has been considerably reduced using coreset optimization. The salient features of this work are cellular neural network approach-based SIFT feature point optimization, adaptive resampling, and intelligent object modelling. Developed methodology has been compared with contemporary methods using different statistical measures. Investigations over various satellite images revealed that considerable success was achieved with the approach. This system has dynamically used spectral and spatial information for representing contextual knowledge using CNN-prolog approach. This methodology is also illustrated to be effective in providing intelligent interpretation and adaptive resampling.

  16. Model-based registration for assessment of spinal deformities in idiopathic scoliosis

    International Nuclear Information System (INIS)

    Detailed analysis of spinal deformity is important within orthopaedic healthcare, in particular for assessment of idiopathic scoliosis. This paper addresses this challenge by proposing an image analysis method, capable of providing a full three-dimensional spine characterization. The proposed method is based on the registration of a highly detailed spine model to image data from computed tomography. The registration process provides an accurate segmentation of each individual vertebra and the ability to derive various measures describing the spinal deformity. The derived measures are estimated from landmarks attached to the spine model and transferred to the patient data according to the registration result. Evaluation of the method provides an average point-to-surface error of 0.9 mm ± 0.9 (comparing segmentations), and an average target registration error of 2.3 mm ± 1.7 (comparing landmarks). Comparing automatic and manual measurements of axial vertebral rotation provides a mean absolute difference of 2.5° ± 1.8, which is on a par with other computerized methods for assessing axial vertebral rotation. A significant advantage of our method, compared to other computerized methods for rotational measurements, is that it does not rely on vertebral symmetry for computing the rotational measures. The proposed method is fully automatic and computationally efficient, only requiring three to four minutes to process an entire image volume covering vertebrae L5 to T1. Given the use of landmarks, the method can be readily adapted to estimate other measures describing a spinal deformity by changing the set of employed landmarks. In addition, the method has the potential to be utilized for accurate segmentations of the vertebrae in routine computed tomography examinations, given the relatively low point-to-surface error. (paper)

  17. Evaluation of feature-based 3-d registration of probabilistic volumetric scenes

    Science.gov (United States)

    Restrepo, Maria I.; Ulusoy, Ali O.; Mundy, Joseph L.

    2014-12-01

    Automatic estimation of the world surfaces from aerial images has seen much attention and progress in recent years. Among current modeling technologies, probabilistic volumetric models (PVMs) have evolved as an alternative representation that can learn geometry and appearance in a dense and probabilistic manner. Recent progress, in terms of storage and speed, achieved in the area of volumetric modeling, opens the opportunity to develop new frameworks that make use of the PVM to pursue the ultimate goal of creating an entire map of the earth, where one can reason about the semantics and dynamics of the 3-d world. Aligning 3-d models collected at different time-instances constitutes an important step for successful fusion of large spatio-temporal information. This paper evaluates how effectively probabilistic volumetric models can be aligned using robust feature-matching techniques, while considering different scenarios that reflect the kind of variability observed across aerial video collections from different time instances. More precisely, this work investigates variability in terms of discretization, resolution and sampling density, errors in the camera orientation, and changes in illumination and geographic characteristics. All results are given for large-scale, outdoor sites. In order to facilitate the comparison of the registration performance of PVMs to that of other 3-d reconstruction techniques, the registration pipeline is also carried out using Patch-based Multi-View Stereo (PMVS) algorithm. Registration performance is similar for scenes that have favorable geometry and the appearance characteristics necessary for high quality reconstruction. In scenes containing trees, such as a park, or many buildings, such as a city center, registration performance is significantly more accurate when using the PVM.

  18. User-based representation of time-resolved multimodal public transportation networks.

    Science.gov (United States)

    Alessandretti, Laura; Karsai, Márton; Gauvin, Laetitia

    2016-07-01

    Multimodal transportation systems, with several coexisting services like bus, tram and metro, can be represented as time-resolved multilayer networks where the different transportation modes connecting the same set of nodes are associated with distinct network layers. Their quantitative description became possible recently due to openly accessible datasets describing the geo-localized transportation dynamics of large urban areas. Advancements call for novel analytics, which combines earlier established methods and exploits the inherent complexity of the data. Here, we provide a novel user-based representation of public transportation systems, which combines representations, accounting for the presence of multiple lines and reducing the effect of spatial embeddedness, while considering the total travel time, its variability across the schedule, and taking into account the number of transfers necessary. After the adjustment of earlier techniques to the novel representation framework, we analyse the public transportation systems of several French municipal areas and identify hidden patterns of privileged connections. Furthermore, we study their efficiency as compared to the commuting flow. The proposed representation could help to enhance resilience of local transportation systems to provide better design policies for future developments. PMID:27493773

  19. Organic white-light-emitting devices based on a multimode resonant microcavity

    Science.gov (United States)

    Zhang, Hongmei; You, Han; Wang, Wei; Shi, Jiawei; Guo, Shuxu; Liu, Mingda; Ma, Dongge

    2006-08-01

    Organic white-light-emitting devices (OLEDs) based on a multimode resonant microcavity defined by a pair of dielectric mirrors and metal mirrors were presented. By selective effects of the quarter-wave dielectric stack mirror on mode, white light emission containing three individual narrow peaks of red, green and blue was achieved, and showed weak dependence on the viewing angle. The Commission Internationale De L'Eclairage (CIE) chromaticity coordinates changed from (0.29, 0.37) at 0° to (0.31, 0.33) at 40°. Furthermore, the brightness and electroluminescence efficiency of the microcavity OLEDs were enhanced compared with noncavity OLEDs. The maximum brightness reached 1940 cd m-2 at a current density of 200 mA cm-2, and the maximum current efficiency and power efficiency are 1.6 cd A-1 at a current density of 12 mA cm-2 and 0.41 lm W-1 at a current density of 1.6 mA cm-2, which are over 1.6 times higher than that of a noncavity OLED.

  20. Reflectance and fluorescence hyperspectral elastic image registration

    Science.gov (United States)

    Lange, Holger; Baker, Ross; Hakansson, Johan; Gustafsson, Ulf P.

    2004-05-01

    Science and Technology International (STI) presents a novel multi-modal elastic image registration approach for a new hyperspectral medical imaging modality. STI's HyperSpectral Diagnostic Imaging (HSDI) cervical instrument is used for the early detection of uterine cervical cancer. A Computer-Aided-Diagnostic (CAD) system is being developed to aid the physician with the diagnosis of pre-cancerous and cancerous tissue regions. The CAD system uses the fusion of multiple data sources to optimize its performance. The key enabling technology for the data fusion is image registration. The difficulty lies in the image registration of fluorescence and reflectance hyperspectral data due to the occurrence of soft tissue movement and the limited resemblance of these types of imagery. The presented approach is based on embedding a reflectance image in the fluorescence hyperspectral imagery. Having a reflectance image in both data sets resolves the resemblance problem and thereby enables the use of elastic image registration algorithms required to compensate for soft tissue movements. Several methods of embedding the reflectance image in the fluorescence hyperspectral imagery are described. Initial experiments with human subject data are presented where a reflectance image is embedded in the fluorescence hyperspectral imagery.

  1. Evaluation of Demons- and FEM-Based Registration Algorithms for Lung Cancer.

    Science.gov (United States)

    Yang, Juan; Li, Dengwang; Yin, Yong; Zhao, Fen; Wang, Hongjun

    2016-04-01

    We evaluated and compared the accuracy of 2 deformable image registration algorithms in 4-dimensional computed tomography images for patients with lung cancer. Ten patients with non-small cell lung cancer or small cell lung cancer were enrolled in this institutional review board-approved study. The displacement vector fields relative to a specific reference image were calculated by using the diffeomorphic demons (DD) algorithm and the finite element method (FEM)-based algorithm. The registration accuracy was evaluated by using normalized mutual information (NMI), the sum of squared intensity difference (SSD), modified Hausdorff distance (dH_M), and ratio of gross tumor volume (rGTV) difference between reference image and deformed phase image. We also compared the registration speed of the 2 algorithms. Of all patients, the FEM-based algorithm showed stronger ability in aligning 2 images than the DD algorithm. The means (±standard deviation) of NMI were 0.86 (±0.05) and 0.90 (±0.05) using the DD algorithm and the FEM-based algorithm, respectively. The means of SSD were 0.006 (±0.003) and 0.003 (±0.002) using the DD algorithm and the FEM-based algorithm, respectively. The means of dH_M were 0.04 (±0.02) and 0.03 (±0.03) using the DD algorithm and the FEM-based algorithm, respectively. The means of rGTV were 3.9% (±1.01%) and 2.9% (±1.1%) using the DD algorithm and the FEM-based algorithm, respectively. However, the FEM-based algorithm costs a longer time than the DD algorithm, with the average running time of 31.4 minutes compared to 21.9 minutes for all patients. The preliminary results showed that the FEM-based algorithm was more accurate than the DD algorithm while compromised with the registration speed. PMID:25817713

  2. SU-E-I-83: Error Analysis of Multi-Modality Image-Based Volumes of Rodent Solid Tumors Using a Preclinical Multi-Modality QA Phantom

    Energy Technology Data Exchange (ETDEWEB)

    Lee, Y [University of Kansas Hospital, Kansas City, KS (United States); Fullerton, G; Goins, B [University of Texas Health Science Center at San Antonio, San Antonio, TX (United States)

    2015-06-15

    Purpose: In our previous study a preclinical multi-modality quality assurance (QA) phantom that contains five tumor-simulating test objects with 2, 4, 7, 10 and 14 mm diameters was developed for accurate tumor size measurement by researchers during cancer drug development and testing. This study analyzed the errors during tumor volume measurement from preclinical magnetic resonance (MR), micro-computed tomography (micro- CT) and ultrasound (US) images acquired in a rodent tumor model using the preclinical multi-modality QA phantom. Methods: Using preclinical 7-Tesla MR, US and micro-CT scanners, images were acquired of subcutaneous SCC4 tumor xenografts in nude rats (3–4 rats per group; 5 groups) along with the QA phantom using the same imaging protocols. After tumors were excised, in-air micro-CT imaging was performed to determine reference tumor volume. Volumes measured for the rat tumors and phantom test objects were calculated using formula V = (π/6)*a*b*c where a, b and c are the maximum diameters in three perpendicular dimensions determined by the three imaging modalities. Then linear regression analysis was performed to compare image-based tumor volumes with the reference tumor volume and known test object volume for the rats and the phantom respectively. Results: The slopes of regression lines for in-vivo tumor volumes measured by three imaging modalities were 1.021, 1.101 and 0.862 for MRI, micro-CT and US respectively. For phantom, the slopes were 0.9485, 0.9971 and 0.9734 for MRI, micro-CT and US respectively. Conclusion: For both animal and phantom studies, random and systematic errors were observed. Random errors were observer-dependent and systematic errors were mainly due to selected imaging protocols and/or measurement method. In the animal study, there were additional systematic errors attributed to ellipsoidal assumption for tumor shape. The systematic errors measured using the QA phantom need to be taken into account to reduce measurement

  3. SU-E-I-83: Error Analysis of Multi-Modality Image-Based Volumes of Rodent Solid Tumors Using a Preclinical Multi-Modality QA Phantom

    International Nuclear Information System (INIS)

    Purpose: In our previous study a preclinical multi-modality quality assurance (QA) phantom that contains five tumor-simulating test objects with 2, 4, 7, 10 and 14 mm diameters was developed for accurate tumor size measurement by researchers during cancer drug development and testing. This study analyzed the errors during tumor volume measurement from preclinical magnetic resonance (MR), micro-computed tomography (micro- CT) and ultrasound (US) images acquired in a rodent tumor model using the preclinical multi-modality QA phantom. Methods: Using preclinical 7-Tesla MR, US and micro-CT scanners, images were acquired of subcutaneous SCC4 tumor xenografts in nude rats (3–4 rats per group; 5 groups) along with the QA phantom using the same imaging protocols. After tumors were excised, in-air micro-CT imaging was performed to determine reference tumor volume. Volumes measured for the rat tumors and phantom test objects were calculated using formula V = (π/6)*a*b*c where a, b and c are the maximum diameters in three perpendicular dimensions determined by the three imaging modalities. Then linear regression analysis was performed to compare image-based tumor volumes with the reference tumor volume and known test object volume for the rats and the phantom respectively. Results: The slopes of regression lines for in-vivo tumor volumes measured by three imaging modalities were 1.021, 1.101 and 0.862 for MRI, micro-CT and US respectively. For phantom, the slopes were 0.9485, 0.9971 and 0.9734 for MRI, micro-CT and US respectively. Conclusion: For both animal and phantom studies, random and systematic errors were observed. Random errors were observer-dependent and systematic errors were mainly due to selected imaging protocols and/or measurement method. In the animal study, there were additional systematic errors attributed to ellipsoidal assumption for tumor shape. The systematic errors measured using the QA phantom need to be taken into account to reduce measurement

  4. Appearance-Based Multimodal Human Tracking and Identification for Healthcare in the Digital Home

    Directory of Open Access Journals (Sweden)

    Mau-Tsuen Yang

    2014-08-01

    Full Text Available There is an urgent need for intelligent home surveillance systems to provide home security, monitor health conditions, and detect emergencies of family members. One of the fundamental problems to realize the power of these intelligent services is how to detect, track, and identify people at home. Compared to RFID tags that need to be worn all the time, vision-based sensors provide a natural and nonintrusive solution. Observing that body appearance and body build, as well as face, provide valuable cues for human identification, we model and record multi-view faces, full-body colors and shapes of family members in an appearance database by using two Kinects located at a home’s entrance. Then the Kinects and another set of color cameras installed in other parts of the house are used to detect, track, and identify people by matching the captured color images with the registered templates in the appearance database. People are detected and tracked by multisensor fusion (Kinects and color cameras using a Kalman filter that can handle duplicate or partial measurements. People are identified by multimodal fusion (face, body appearance, and silhouette using a track-based majority voting. Moreover, the appearance-based human detection, tracking, and identification modules can cooperate seamlessly and benefit from each other. Experimental results show the effectiveness of the human tracking across multiple sensors and human identification considering the information of multi-view faces, full-body clothes, and silhouettes. The proposed home surveillance system can be applied to domestic applications in digital home security and intelligent healthcare.

  5. Multimodal Wireless Sensor Network-Based Ambient Assisted Living in Real Homes with Multiple Residents

    Directory of Open Access Journals (Sweden)

    Can Tunca

    2014-05-01

    Full Text Available Human activity recognition and behavior monitoring in a home setting using wireless sensor networks (WSNs provide a great potential for ambient assisted living (AAL applications, ranging from health and wellbeing monitoring to resource consumption monitoring. However, due to the limitations of the sensor devices, challenges in wireless communication and the challenges in processing large amounts of sensor data in order to recognize complex human activities, WSN-based AAL systems are not effectively integrated in the home environment. Additionally, given the variety of sensor types and activities, selecting the most suitable set of sensors in the deployment is an important task. In order to investigate and propose solutions to such challenges, we introduce a WSN-based multimodal AAL system compatible for homes with multiple residents. Particularly, we focus on the details of the system architecture, including the challenges of sensor selection, deployment, networking and data collection and provide guidelines for the design and deployment of an effective AAL system. We also present the details of the field study we conducted, using the systems deployed in two different real home environments with multiple residents. With these systems, we are able to collect ambient sensor data from multiple homes. This data can be used to assess the wellbeing of the residents and identify deviations from everyday routines, which may be indicators of health problems. Finally, in order to elaborate on the possible applications of the proposed AAL system and to exemplify directions for processing the collected data, we provide the results of several human activity inference experiments, along with examples on how such results could be interpreted. We believe that the experiences shared in this work will contribute towards accelerating the acceptance of WSN-based AAL systems in the home setting.

  6. Multimodal Discrimination of Alzheimer's Disease Based on Regional Cortical Atrophy and Hypometabolism.

    Directory of Open Access Journals (Sweden)

    Hyuk Jin Yun

    Full Text Available Structural MR image (MRI and 18F-Fluorodeoxyglucose-positron emission tomography (FDG-PET have been widely employed in diagnosis of both Alzheimer's disease (AD and mild cognitive impairment (MCI pathology, which has led to the development of methods to distinguish AD and MCI from normal controls (NC. Synaptic dysfunction leads to a reduction in the rate of metabolism of glucose in the brain and is thought to represent AD progression. FDG-PET has the unique ability to estimate glucose metabolism, providing information on the distribution of hypometabolism. In addition, patients with AD exhibit significant neuronal loss in cerebral regions, and previous AD research has shown that structural MRI can be used to sensitively measure cortical atrophy. In this paper, we introduced a new method to discriminate AD from NC based on complementary information obtained by FDG and MRI. For accurate classification, surface-based features were employed and 12 predefined regions were selected from previous studies based on both MRI and FDG-PET. Partial least square linear discriminant analysis was employed for making diagnoses. We obtained 93.6% classification accuracy, 90.1% sensitivity, and 96.5% specificity in discriminating AD from NC. The classification scheme had an accuracy of 76.5% and sensitivity and specificity of 46.5% and 89.6%, respectively, for discriminating MCI from AD. Our method exhibited a superior classification performance compared with single modal approaches and yielded parallel accuracy to previous multimodal classification studies using MRI and FDG-PET.

  7. Highly-Automatic MI Based Multiple 2D/3D Image Registration Using Self-initialized Geodesic Feature Correspondences

    OpenAIRE

    Zheng, Hongwei; Cleju, Ioan; Saupe, Dietmar

    2010-01-01

    Intensity based registration methods, such as the mutual information (MI), do not commonly consider the spatial geometric information and the initial correspondences are uncertainty. In this paper, we present a novel approach for achieving highly-automatic 2D/3D image registration integrating the advantages from both entropy MI and spatial geometric features correspondence methods. Inspired by the scale space theory, we project the surfaces on a 3D model to 2D normal image spaces provided tha...

  8. MOBILTEL - Mobile Multimodal Telecommunications dialogue system based on VoIP telephony

    Directory of Open Access Journals (Sweden)

    Anton Čižmár

    2009-10-01

    Full Text Available In this paper the project MobilTel ispresented. The communication itself is becoming amultimodal interactive process. The MobilTel projectprovides research and development activities inmultimodal interfaces area. The result is a functionalarchitecture for mobile multimodal telecommunicationsystem running on handheld device. The MobilTelcommunicator is a multimodal Slovak speech andgraphical interface with integrated VoIP client. Theother possible modalities are pen – touch screeninteraction, keyboard, and display on which theinformation is more user friendly presented (icons,emoticons, etc., and provides hyperlink and scrollingmenu availability.We describe the method of interaction between mobileterminal (PDA and MobilTel multimodal PCcommunicator over a VoIP WLAN connection basedon SIP protocol. We also present the graphicalexamples of services that enable users to obtaininformation about weather or information about trainconnection between two train stations.

  9. A simultaneous multimodal imaging system for tissue functional parameters

    Science.gov (United States)

    Ren, Wenqi; Zhang, Zhiwu; Wu, Qiang; Zhang, Shiwu; Xu, Ronald

    2014-02-01

    Simultaneous and quantitative assessment of skin functional characteristics in different modalities will facilitate diagnosis and therapy in many clinical applications such as wound healing. However, many existing clinical practices and multimodal imaging systems are subjective, qualitative, sequential for multimodal data collection, and need co-registration between different modalities. To overcome these limitations, we developed a multimodal imaging system for quantitative, non-invasive, and simultaneous imaging of cutaneous tissue oxygenation and blood perfusion parameters. The imaging system integrated multispectral and laser speckle imaging technologies into one experimental setup. A Labview interface was developed for equipment control, synchronization, and image acquisition. Advanced algorithms based on a wide gap second derivative reflectometry and laser speckle contrast analysis (LASCA) were developed for accurate reconstruction of tissue oxygenation and blood perfusion respectively. Quantitative calibration experiments and a new style of skinsimulating phantom were designed to verify the accuracy and reliability of the imaging system. The experimental results were compared with a Moor tissue oxygenation and perfusion monitor. For In vivo testing, a post-occlusion reactive hyperemia (PORH) procedure in human subject and an ongoing wound healing monitoring experiment using dorsal skinfold chamber models were conducted to validate the usability of our system for dynamic detection of oxygenation and perfusion parameters. In this study, we have not only setup an advanced multimodal imaging system for cutaneous tissue oxygenation and perfusion parameters but also elucidated its potential for wound healing assessment in clinical practice.

  10. Voxel-based statistical analysis of uncertainties associated with deformable image registration

    International Nuclear Information System (INIS)

    Deformable image registration (DIR) algorithms have inherent uncertainties in their displacement vector fields (DVFs).The purpose of this study is to develop an optimal metric to estimate DIR uncertainties. Six computational phantoms have been developed from the CT images of lung cancer patients using a finite element method (FEM). The FEM generated DVFs were used as a standard for registrations performed on each of these phantoms. A mechanics-based metric, unbalanced energy (UE), was developed to evaluate these registration DVFs. The potential correlation between UE and DIR errors was explored using multivariate analysis, and the results were validated by landmark approach and compared with two other error metrics: DVF inverse consistency (IC) and image intensity difference (ID). Landmark-based validation was performed using the POPI-model. The results show that the Pearson correlation coefficient between UE and DIR error is rUE-error = 0.50. This is higher than rIC-error = 0.29 for IC and DIR error and rID-error = 0.37 for ID and DIR error. The Pearson correlation coefficient between UE and the product of the DIR displacements and errors is rUE-error×DVF = 0.62 for the six patients and rUE-error×DVF = 0.73 for the POPI-model data. It has been demonstrated that UE has a strong correlation with DIR errors, and the UE metric outperforms the IC and ID metrics in estimating DIR uncertainties. The quantified UE metric can be a useful tool for adaptive treatment strategies, including probability-based adaptive treatment planning. (paper)

  11. Multimodal Classification of Mild Cognitive Impairment Based on Partial Least Squares.

    Science.gov (United States)

    Wang, Pingyue; Chen, Kewei; Yao, Li; Hu, Bin; Wu, Xia; Zhang, Jiacai; Ye, Qing; Guo, Xiaojuan

    2016-08-10

    In recent years, increasing attention has been given to the identification of the conversion of mild cognitive impairment (MCI) to Alzheimer's disease (AD). Brain neuroimaging techniques have been widely used to support the classification or prediction of MCI. The present study combined magnetic resonance imaging (MRI), 18F-fluorodeoxyglucose PET (FDG-PET), and 18F-florbetapir PET (florbetapir-PET) to discriminate MCI converters (MCI-c, individuals with MCI who convert to AD) from MCI non-converters (MCI-nc, individuals with MCI who have not converted to AD in the follow-up period) based on the partial least squares (PLS) method. Two types of PLS models (informed PLS and agnostic PLS) were built based on 64 MCI-c and 65 MCI-nc from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. The results showed that the three-modality informed PLS model achieved better classification accuracy of 81.40%, sensitivity of 79.69%, and specificity of 83.08% compared with the single-modality model, and the three-modality agnostic PLS model also achieved better classification compared with the two-modality model. Moreover, combining the three modalities with clinical test score (ADAS-cog), the agnostic PLS model (independent data: florbetapir-PET; dependent data: FDG-PET and MRI) achieved optimal accuracy of 86.05%, sensitivity of 81.25%, and specificity of 90.77%. In addition, the comparison of PLS, support vector machine (SVM), and random forest (RF) showed greater diagnostic power of PLS. These results suggested that our multimodal PLS model has the potential to discriminate MCI-c from the MCI-nc and may therefore be helpful in the early diagnosis of AD. PMID:27567818

  12. Multi-modal vibration based MEMS energy harvesters for ultra-low power wireless functional nodes

    Science.gov (United States)

    Iannacci, J.; Gottardi, M.; Serra, E.; Di Criscienzo, R.; Borrielli, A.; Bonaldi, M.

    2013-05-01

    The aim of this contribution is to report and discuss a preliminary study and rough optimization of a novel concept of MEMS device for vibration energy harvesting, based on a multi-modal dynamic behavior. The circular-shaped device features Four-Leaf Clover-like (FLC) double spring-mass cascaded systems, kept constrained to the surrounding frame by means of four straight beams. The combination of flexural bending behavior of the slender beams plus deformable parts of the petals enable to populate the desired vibration frequency range with a number of resonant modes, and improve the energy conversion capability of the micro-transducer. The harvester device, conceived for piezoelectric mechanical into electric energy conversion, is intended to sense environmental vibrations and, thereby, its geometry is optimized to have a large concentration of resonant modes in a frequency range below 5-10 kHz. The results of FEM (Finite Element Method) based analysis performed in ANSYSTM Workbench are reported, both concerning modal and harmonic response, providing important indications related to the device geometry optimization. The analysis reported in this work is limited to the sole mechanical modeling of the proposed MEMS harvester device concept. Future developments of the study will encompass the inclusion of piezoelectric conversion in the FEM simulations, in order to have indications of the actual power levels achievable with the proposed harvester concept. Furthermore, the results of the FEM studies here discussed, will be validated against experimental data, as soon as the MEMS resonator specimens, currently under fabrication, are ready for testing.

  13. Assessment of Eye Fatigue Caused by 3D Displays Based on Multimodal Measurements

    Directory of Open Access Journals (Sweden)

    Jae Won Bang

    2014-09-01

    Full Text Available With the development of 3D displays, user’s eye fatigue has been an important issue when viewing these displays. There have been previous studies conducted on eye fatigue related to 3D display use, however, most of these have employed a limited number of modalities for measurements, such as electroencephalograms (EEGs, biomedical signals, and eye responses. In this paper, we propose a new assessment of eye fatigue related to 3D display use based on multimodal measurements. compared to previous works Our research is novel in the following four ways: first, to enhance the accuracy of assessment of eye fatigue, we measure EEG signals, eye blinking rate (BR, facial temperature (FT, and a subjective evaluation (SE score before and after a user watches a 3D display; second, in order to accurately measure BR in a manner that is convenient for the user, we implement a remote gaze-tracking system using a high speed (mega-pixel camera that measures eye blinks of both eyes; thirdly, changes in the FT are measured using a remote thermal camera, which can enhance the measurement of eye fatigue, and fourth, we perform various statistical analyses to evaluate the correlation between the EEG signal, eye BR, FT, and the SE score based on the T-test, correlation matrix, and effect size. Results show that the correlation of the SE with other data (FT, BR, and EEG is the highest, while those of the FT, BR, and EEG with other data are second, third, and fourth highest, respectively.

  14. Assessment of eye fatigue caused by 3D displays based on multimodal measurements.

    Science.gov (United States)

    Bang, Jae Won; Heo, Hwan; Choi, Jong-Suk; Park, Kang Ryoung

    2014-01-01

    With the development of 3D displays, user's eye fatigue has been an important issue when viewing these displays. There have been previous studies conducted on eye fatigue related to 3D display use, however, most of these have employed a limited number of modalities for measurements, such as electroencephalograms (EEGs), biomedical signals, and eye responses. In this paper, we propose a new assessment of eye fatigue related to 3D display use based on multimodal measurements. compared to previous works Our research is novel in the following four ways: first, to enhance the accuracy of assessment of eye fatigue, we measure EEG signals, eye blinking rate (BR), facial temperature (FT), and a subjective evaluation (SE) score before and after a user watches a 3D display; second, in order to accurately measure BR in a manner that is convenient for the user, we implement a remote gaze-tracking system using a high speed (mega-pixel) camera that measures eye blinks of both eyes; thirdly, changes in the FT are measured using a remote thermal camera, which can enhance the measurement of eye fatigue, and fourth, we perform various statistical analyses to evaluate the correlation between the EEG signal, eye BR, FT, and the SE score based on the T-test, correlation matrix, and effect size. Results show that the correlation of the SE with other data (FT, BR, and EEG) is the highest, while those of the FT, BR, and EEG with other data are second, third, and fourth highest, respectively. PMID:25192315

  15. Registration-Based Range-Dependence Compensation for Bistatic STAP Radars

    Directory of Open Access Journals (Sweden)

    Lapierre Fabian D

    2005-01-01

    Full Text Available We address the problem of detecting slow-moving targets using space-time adaptive processing (STAP radar. Determining the optimum weights at each range requires data snapshots at neighboring ranges. However, in virtually all configurations, snapshot statistics are range dependent, meaning that snapshots are nonstationary with respect to range. This results in poor performance. In this paper, we propose a new compensation method based on registration of clutter ridges and designed to work on a single realization of the stochastic snapshot at each range. The method has been successfully tested on simulated, stochastic snapshots. An evaluation of performance is presented.

  16. A computationally efficient approach for template matching-based image registration

    Indian Academy of Sciences (India)

    Vilas H Gaidhane; Yogesh V Hote; Vijander Singh

    2014-04-01

    Image registration using template matching is an important step in image processing. In this paper, a simple, robust and computationally efficient approach is presented. The proposed approach is based on the properties of a normalized covariance matrix. The main advantage of the proposed approach is that the image matching can be achieved without calculating eigenvalues and eigenvectors of a covariance matrix, hence reduces the computational complexity. The experimental results show that the proposed approach performs better in the presence of various noises and rigid geometric transformations.

  17. MatchGUI: A Graphical MATLAB-Based Tool for Automatic Image Co-Registration

    Science.gov (United States)

    Ansar, Adnan I.

    2011-01-01

    MatchGUI software, based on MATLAB, automatically matches two images and displays the match result by superimposing one image on the other. A slider bar allows focus to shift between the two images. There are tools for zoom, auto-crop to overlap region, and basic image markup. Given a pair of ortho-rectified images (focused primarily on Mars orbital imagery for now), this software automatically co-registers the imagery so that corresponding image pixels are aligned. MatchGUI requires minimal user input, and performs a registration over scale and inplane rotation fully automatically

  18. Multimodal analgesia versus traditional opiate based analgesia after cardiac surgery, a randomized controlled trial

    DEFF Research Database (Denmark)

    Rafiq, Sulman; Steinbrüchel, Daniel Andreas; Wanscher, Michael Jaeger;

    2014-01-01

    BACKGROUND: To evaluate if an opiate sparing multimodal regimen of dexamethasone, gabapentin, ibuprofen and paracetamol had better analgesic effect, less side effects and was safe compared to a traditional morphine and paracetamol regimen after cardiac surgery. METHODS: Open-label, prospective...

  19. Cross Space: The Exploration of SNS-Based Writing Activities in a Multimodal Learning Environment

    Science.gov (United States)

    Lee, Kwang-Soon; Kim, Bong-Gyu

    2016-01-01

    This study explores the positive learning effect of formulating English sentences via Social Network Service (SNS; "Kakao-Talk") on less proficient L2 university students' (LPSs') writing, when the application is utilized as a tool to link in and out-of class activities in a multimodal-learning environment. Its objective is also to…

  20. Multimodality imaging of 131I uptake in nude mice thyroid based on Cerenkov radiation

    International Nuclear Information System (INIS)

    Objective: To perform the multimodality 131I thyroid imaging using Cerenkov luminescence tomography (CLT) and gamma imaging, and to compare the results of CLT and gamma imaging. Methods The nude mice (n=4, mass: (21 ±3) g) were injected with 1.67 ×107 Bq 131I. CLT and gamma imaging were acquired at 0.5, 3, 12 and 24 h after the injection. Three-dimensional biodistribution of 131I uptake in thyroid was reconstructed using Cerenkov source reconstruction method based on the diffusion equation (DE), and the reconstructed power of 131I in different acquisition time points was obtained. Additionally, the ROIs were drawn over the gamma images of the mouse neck, and the counts were read. The correlation between the reconstructed power of CLT and gamma ray counts of gamma imaging was analyzed. Results: The power of 131I uptake in thyroid at 0.5, 3, 12 and 24 h were 7.80 ×10-13, 1.62×10-12, 2.20×10-12 and 2.68 × 10-12 W, respectively. CLT results showed that reconstructed power increased with the increasing of acquisition time. Gamma imaging results indicated that 131I uptake decreased in abdomen and increased in thyroid with the collection time. The results of CLT were consistent with that of gamma imaging (r2=0.7620, P<0.05). Conclusion: CLT has the potential to identify and monitor functioning thyroid tissue at before and (or) after 131I treatment. (authors)

  1. Co-registration of the BNCT treatment planning images for clinical practice

    International Nuclear Information System (INIS)

    We have co-registered MRI, CT and FBPA-PET images for BNCT in clinical practice. Co-registration improves the spatial accuracy of the treatment planning by enabling use of information from all the co-registered modalities. The multimodal co-registration has been implemented as a service product provided by the Imaging Center of Helsinki University Central Hospital to other departments. To increase the accuracy of co-registration and patient positioning in the head area BNCT, a patient-specific fixation mask suitable for PET, MRI and CT was developed. The goal of the fixation mask is to normalize the orientation of the patient's head and neck. Co-registration is performed at the image processing unit by using a rigid body model, mutual-information based algorithms and partly in-house developed software tools. The accuracy of co-registration is verified by comparing the locations of the external skin markers and anatomical landmarks in different modalities. After co-registration, the images are transformed and covered into a format required by the BNCT dose-planning software and set to the dose-planning unit of the hospital. So far co-registration has been done for 22 patients. The co-registration protocol has proved to be reliable and efficient. Some registration errors are seen on some patients in the neck area because the rigid-body model used in co-registration is not fully valid for the brain-neck entity. The registration accuracy in this area could likely be improved by implementing a co-registration procedure utilizing a partly non-rigid body model. (author)

  2. An automated image-registration technique based on multiple structure matching

    International Nuclear Information System (INIS)

    A new image-registration technique that matches multiple structures on complementary imaging data sets (e.g., CT and MRI) has been developed and tested with both phantom and patient data. The algorithm assumes a rigid-body transformation and is suitable for correlating structures within the cranium or at the skull base. The basic premise of the new technique is that an optimum transformation is achieved when the relative volume lying outside of the intersection between a structure and its transformed counterpart is a minimum. This relative volume is calculated numerically using a random sampling approach, and a binary searching algorithm was used to step through the nine-dimensional parameter space consisting of three rotation angles, three scaling factors and three components of a translation vector. For the nine tests using phantom data, the automated structure-matching technique was able to predict the correct rotation angles to within ±1 degree. The expected clinical performance of the new technique was assessed by comparing results obtained with the new method to those obtained using other techniques for 12 patients who were treated with charged particles at Lawrence Berkeley Laboratory (LBL) and who had image-registration studies performed as part of their treatment plan. For 9 of the 12 patients considered, the new structure-matching technique produced a significantly better registration than the older methods, as measured by the resultant average relative volume lying outside of the intersection between any structure and its transformed counterpart. For the other three patients, results were not significantly different for the new structure-matching method and the older techniques

  3. Three-dimensional elastic image registration based on strain energy minimization: application to prostate magnetic resonance imaging.

    Science.gov (United States)

    Zhang, Bao; Arola, Dwayne D; Roys, Steve; Gullapalli, Rao P

    2011-08-01

    The use of magnetic resonance (MR) imaging in conjunction with an endorectal coil is currently the clinical standard for the diagnosis of prostate cancer because of the increased sensitivity and specificity of this approach. However, imaging in this manner provides images and spectra of the prostate in the deformed state because of the insertion of the endorectal coil. Such deformation may lead to uncertainties in the localization of prostate cancer during therapy. We propose a novel 3-D elastic registration procedure that is based on the minimization of a physically motivated strain energy function that requires the identification of similar features (points, curves, or surfaces) in the source and target images. The Gauss-Seidel method was used in the numerical implementation of the registration algorithm. The registration procedure was validated on synthetic digital images, MR images from prostate phantom, and MR images obtained on patients. The registration error, assessed by averaging the displacement of a fiducial landmark in the target to its corresponding point in the registered image, was 0.2 ± 0.1 pixels on synthetic images. On the prostate phantom and patient data, the registration errors were 1.0 ± 0.6 pixels (0.6 ± 0.4 mm) and 1.8 ± 0.7 pixels (1.1 ± 0.4 mm), respectively. Registration also improved image similarity (normalized cross-correlation) from 0.72 ± 0.10 to 0.96 ± 0.03 on patient data. Registration results on digital images, phantom, and prostate data in vivo demonstrate that the registration procedure can be used to significantly improve both the accuracy of localized therapies such as brachytherapy or external beam therapy and can be valuable in the longitudinal follow-up of patients after therapy. PMID:20552248

  4. MARS: a mouse atlas registration system based on a planar x-ray projector and an optical camera

    International Nuclear Information System (INIS)

    This paper introduces a mouse atlas registration system (MARS), composed of a stationary top-view x-ray projector and a side-view optical camera, coupled to a mouse atlas registration algorithm. This system uses the x-ray and optical images to guide a fully automatic co-registration of a mouse atlas with each subject, in order to provide anatomical reference for small animal molecular imaging systems such as positron emission tomography (PET). To facilitate the registration, a statistical atlas that accounts for inter-subject anatomical variations was constructed based on 83 organ-labeled mouse micro-computed tomography (CT) images. The statistical shape model and conditional Gaussian model techniques were used to register the atlas with the x-ray image and optical photo. The accuracy of the atlas registration was evaluated by comparing the registered atlas with the organ-labeled micro-CT images of the test subjects. The results showed excellent registration accuracy of the whole-body region, and good accuracy for the brain, liver, heart, lungs and kidneys. In its implementation, the MARS was integrated with a preclinical PET scanner to deliver combined PET/MARS imaging, and to facilitate atlas-assisted analysis of the preclinical PET images. (paper)

  5. Multi-dimensional respiratory motion tracking from markerless optical surface imaging based on deformable mesh registration

    International Nuclear Information System (INIS)

    Real-time optical surface imaging systems offer a non-invasive way to monitor intra-fraction motion of a patient's thorax surface during radiotherapy treatments. Due to lack of point correspondence in dynamic surface acquisition, such systems cannot currently provide 3D motion tracking at specific surface landmarks, as available in optical technologies based on passive markers. We propose to apply deformable mesh registration to extract surface point trajectories from markerless optical imaging, thus yielding multi-dimensional breathing traces. The investigated approach is based on a non-rigid extension of the iterative closest point algorithm, using a locally affine regularization. The accuracy in tracking breathing motion was quantified in a group of healthy volunteers, by pair-wise registering the thoraco-abdominal surfaces acquired at three different respiratory phases using a clinically available optical system. The motion tracking accuracy proved to be maximal in the abdominal region, where breathing motion mostly occurs, with average errors of 1.09 mm. The results demonstrate the feasibility of recovering multi-dimensional breathing motion from markerless optical surface acquisitions by using the implemented deformable registration algorithm. The approach can potentially improve respiratory motion management in radiation therapy, including motion artefact reduction or tumour motion compensation by means of internal/external correlation models. (paper)

  6. Multi-camera calibration based on openCV and multi-view registration

    Science.gov (United States)

    Deng, Xiao-ming; Wan, Xiong; Zhang, Zhi-min; Leng, Bi-yan; Lou, Ning-ning; He, Shuai

    2010-10-01

    For multi-camera calibration systems, a method based on OpenCV and multi-view registration combining calibration algorithm is proposed. First of all, using a Zhang's calibration plate (8X8 chessboard diagram) and a number of cameras (with three industrial-grade CCD) to be 9 group images shooting from different angles, using OpenCV to calibrate the parameters fast in the camera. Secondly, based on the corresponding relationship between each camera view, the computation of the rotation matrix and translation matrix is formulated as a constrained optimization problem. According to the Kuhn-Tucker theorem and the properties on the derivative of the matrix-valued function, the formulae of rotation matrix and translation matrix are deduced by using singular value decomposition algorithm. Afterwards an iterative method is utilized to get the entire coordinate transformation of pair-wise views, thus the precise multi-view registration can be conveniently achieved and then can get the relative positions in them(the camera outside the parameters).Experimental results show that the method is practical in multi-camera calibration .

  7. Target location for IR image based on IR/visual image registration

    Science.gov (United States)

    Liu, Zhao-ying; Zhou, Fu-gen; Bai, Xiang-zhi

    2009-07-01

    We propose an effective algorithm of IR target location based on image registration. This approach includes four steps--pre-processing, typical region and feature points extraction, point pattern matching, target location. Firstly, by analying the characters of the visual and IR images, a pre-processing procedure is introduced to improve the IR image quality and to make the gray distribution in IR and visual images more consistent. Secondly, mathematical morphology is used to extract typical regions around the target, and we mark the feature points based on the extracted typical regions. Thirdly, point pattern matching algorithm is applied to realize the preliminary registration of IR/visual images, triangle geometry similarity is utilized as the similarity measure to establish two points set correspondance. Finally, we take twostage location strategy to accurately locate the IR targets, least square method and mutual information theory are applied in the location strategy. Experiment results demonstrate a high rate (above 93%) of success for predicting target location, the results showed that this method can effectively meet the requirement of target detection in low resolution and low contrast IR images.

  8. Impact of Computed Tomography Image Quality on Image-Guided Radiation Therapy Based on Soft Tissue Registration

    Energy Technology Data Exchange (ETDEWEB)

    Morrow, Natalya V.; Lawton, Colleen A. [Department of Radiation Oncology, Medical College of Wisconsin, Milwaukee, Wisconsin (United States); Qi, X. Sharon [Department of Radiation Oncology, University of Colorado Denver, Denver, Colorado (United States); Li, X. Allen, E-mail: ali@mcw.edu [Department of Radiation Oncology, Medical College of Wisconsin, Milwaukee, Wisconsin (United States)

    2012-04-01

    Purpose: In image-guided radiation therapy (IGRT), different computed tomography (CT) modalities with varying image quality are being used to correct for interfractional variations in patient set-up and anatomy changes, thereby reducing clinical target volume to the planning target volume (CTV-to-PTV) margins. We explore how CT image quality affects patient repositioning and CTV-to-PTV margins in soft tissue registration-based IGRT for prostate cancer patients. Methods and Materials: Four CT-based IGRT modalities used for prostate RT were considered in this study: MV fan beam CT (MVFBCT) (Tomotherapy), MV cone beam CT (MVCBCT) (MVision; Siemens), kV fan beam CT (kVFBCT) (CTVision, Siemens), and kV cone beam CT (kVCBCT) (Synergy; Elekta). Daily shifts were determined by manual registration to achieve the best soft tissue agreement. Effect of image quality on patient repositioning was determined by statistical analysis of daily shifts for 136 patients (34 per modality). Inter- and intraobserver variability of soft tissue registration was evaluated based on the registration of a representative scan for each CT modality with its corresponding planning scan. Results: Superior image quality with the kVFBCT resulted in reduced uncertainty in soft tissue registration during IGRT compared with other image modalities for IGRT. The largest interobserver variations of soft tissue registration were 1.1 mm, 2.5 mm, 2.6 mm, and 3.2 mm for kVFBCT, kVCBCT, MVFBCT, and MVCBCT, respectively. Conclusions: Image quality adversely affects the reproducibility of soft tissue-based registration for IGRT and necessitates a careful consideration of residual uncertainties in determining different CTV-to-PTV margins for IGRT using different image modalities.

  9. Impact of Computed Tomography Image Quality on Image-Guided Radiation Therapy Based on Soft Tissue Registration

    International Nuclear Information System (INIS)

    Purpose: In image-guided radiation therapy (IGRT), different computed tomography (CT) modalities with varying image quality are being used to correct for interfractional variations in patient set-up and anatomy changes, thereby reducing clinical target volume to the planning target volume (CTV-to-PTV) margins. We explore how CT image quality affects patient repositioning and CTV-to-PTV margins in soft tissue registration-based IGRT for prostate cancer patients. Methods and Materials: Four CT-based IGRT modalities used for prostate RT were considered in this study: MV fan beam CT (MVFBCT) (Tomotherapy), MV cone beam CT (MVCBCT) (MVision; Siemens), kV fan beam CT (kVFBCT) (CTVision, Siemens), and kV cone beam CT (kVCBCT) (Synergy; Elekta). Daily shifts were determined by manual registration to achieve the best soft tissue agreement. Effect of image quality on patient repositioning was determined by statistical analysis of daily shifts for 136 patients (34 per modality). Inter- and intraobserver variability of soft tissue registration was evaluated based on the registration of a representative scan for each CT modality with its corresponding planning scan. Results: Superior image quality with the kVFBCT resulted in reduced uncertainty in soft tissue registration during IGRT compared with other image modalities for IGRT. The largest interobserver variations of soft tissue registration were 1.1 mm, 2.5 mm, 2.6 mm, and 3.2 mm for kVFBCT, kVCBCT, MVFBCT, and MVCBCT, respectively. Conclusions: Image quality adversely affects the reproducibility of soft tissue-based registration for IGRT and necessitates a careful consideration of residual uncertainties in determining different CTV-to-PTV margins for IGRT using different image modalities.

  10. Registration-based Compensation using Sparse Representation in Conformal-array STAP

    CERN Document Server

    Sun, Ke; Wang, Xiqin

    2010-01-01

    Space-time adaptive processing (STAP) is a well-suited technique to detect slow-moving targets in the presence of a clutter-spreading environment. When considering the STAP system deployed with conformal radar array (CFA), the training data is range-dependent, which results in poor detection performance of statistical-based algorithms. In this paper, we propose registration-based compensation using sparse representation (SR-RBC) to generate stationary training data. This method first converts the estimation of both the unknown configuration parameters and clutter power distribution into an ill-posed problem with the constraint of sparsity, and then utilizes the technique of sparse representation like iterative reweighted least squares (IRLS) to solve it. Based on this, the transform matrix is designed so that the processed training data behaves nearly stationary with the test cell. Since the configuration parameters as well as the clutter spectral response is obtained with full-snapshot using sparse represent...

  11. 2D-3D registration for prostate radiation therapy based on a statistical model of transmission images

    International Nuclear Information System (INIS)

    Purpose: In external beam radiation therapy of pelvic sites, patient setup errors can be quantified by registering 2D projection radiographs acquired during treatment to a 3D planning computed tomograph (CT). We present a 2D-3D registration framework based on a statistical model of the intensity values in the two imaging modalities. Methods: The model assumes that intensity values in projection radiographs are independently but not identically distributed due to the nonstationary nature of photon counting noise. Two probability distributions are considered for the intensity values: Poisson and Gaussian. Using maximum likelihood estimation, two similarity measures, maximum likelihood with a Poisson (MLP) and maximum likelihood with Gaussian (MLG), distribution are derived. Further, we investigate the merit of the model-based registration approach for data obtained with current imaging equipment and doses by comparing the performance of the similarity measures derived to that of the Pearson correlation coefficient (ICC) on accurately collected data of an anthropomorphic phantom of the pelvis and on patient data. Results: Registration accuracy was similar for all three similarity measures and surpassed current clinical requirements of 3 mm for pelvic sites. For pose determination experiments with a kilovoltage (kV) cone-beam CT (CBCT) and kV projection radiographs of the phantom in the anterior-posterior (AP) view, registration accuracies were 0.42 mm (MLP), 0.29 mm (MLG), and 0.29 mm (ICC). For kV CBCT and megavoltage (MV) AP portal images of the same phantom, registration accuracies were 1.15 mm (MLP), 0.90 mm (MLG), and 0.69 mm (ICC). Registration of a kV CT and MV AP portal images of a patient was successful in all instances. Conclusions: The results indicate that high registration accuracy is achievable with multiple methods including methods that are based on a statistical model of a 3D CT and 2D projection images.

  12. Control over structure-specific flexibility improves anatomical accuracy for point-based deformable registration in bladder cancer radiotherapy

    International Nuclear Information System (INIS)

    Purpose: Future developments in image guided adaptive radiotherapy (IGART) for bladder cancer require accurate deformable image registration techniques for the precise assessment of tumor and bladder motion and deformation that occur as a result of large bladder volume changes during the course of radiotherapy treatment. The aim was to employ an extended version of a point-based deformable registration algorithm that allows control over tissue-specific flexibility in combination with the authors’ unique patient dataset, in order to overcome two major challenges of bladder cancer registration, i.e., the difficulty in accounting for the difference in flexibility between the bladder wall and tumor and the lack of visible anatomical landmarks for validation. Methods: The registration algorithm used in the current study is an extension of the symmetric-thin plate splines-robust point matching (S-TPS-RPM) algorithm, a symmetric feature-based registration method. The S-TPS-RPM algorithm has been previously extended to allow control over the degree of flexibility of different structures via a weight parameter. The extended weighted S-TPS-RPM algorithm was tested and validated on CT data (planning- and four to five repeat-CTs) of five urinary bladder cancer patients who received lipiodol injections before radiotherapy. The performance of the weighted S-TPS-RPM method, applied to bladder and tumor structures simultaneously, was compared with a previous version of the S-TPS-RPM algorithm applied to bladder wall structure alone and with a simultaneous nonweighted S-TPS-RPM registration of the bladder and tumor structures. Performance was assessed in terms of anatomical and geometric accuracy. The anatomical accuracy was calculated as the residual distance error (RDE) of the lipiodol markers and the geometric accuracy was determined by the surface distance, surface coverage, and inverse consistency errors. Optimal parameter values for the flexibility and bladder weight

  13. Spectral demixing avoids registration errors and reduces noise in multicolor localization-based super-resolution microscopy

    Science.gov (United States)

    Lampe, André; Tadeus, Georgi; Schmoranzer, Jan

    2015-09-01

    Multicolor single molecule localization-based super-resolution microscopy (SMLM) approaches are challenged by channel crosstalk and errors in multi-channel registration. We recently introduced a spectral demixing-based variant of direct stochastic optical reconstruction microscopy (SD-dSTORM) to perform multicolor SMLM with minimal color crosstalk. Here, we demonstrate that the spectral demixing procedure is inherently free of errors in multicolor registration and therefore does not require multicolor channel alignment. Furthermore, spectral demixing significantly reduces single molecule noise and is applicable to astigmatism-based 3D multicolor imaging achieving 25 nm lateral and 66 nm axial resolution on cellular nanostructures.

  14. Installed Base Registration of Decentralised Solar Panels with Applications in Crisis Management

    Science.gov (United States)

    Aarsen, R.; Janssen, M.; Ramkisoen, M.; Biljecki, F.; Quak, W.; Verbree, E.

    2015-08-01

    In case of a calamity in the Netherlands - e.g. a dike breach - parts of the nationwide electric network can fall out. In these occasions it would be useful if decentralised energy sources of the Smart Grid would contribute to balance out the fluctuations of the energy network. Decentralised energy sources include: solar energy, wind energy, combined heat and power, and biogas. In this manner, parts of the built environment - e.g. hospitals - that are in need of a continuous power flow, could be secured of this power. When a calamity happens, information about the Smart Grid is necessary to control the crisis and to ensure a shared view on the energy networks for both the crisis managers and network operators. The current situation of publishing, storing and sharing data of solar energy has been shown a lack of reliability about the current number, physical location, and capacity of installed decentralised photovoltaic (PV) panels in the Netherlands. This study focuses on decentralised solar energy in the form of electricity via PV panels in the Netherlands and addresses this challenge by proposing a new, reliable and up-to-date database. The study reveals the requirements for a registration of the installed base of PV panels in the Netherlands. This new database should serve as a replenishment for the current national voluntary registration, called Production Installation Register of Energy Data Services Netherland (EDSN-PIR), of installed decentralised PV panel installations in the Smart Grid, and provide important information in case of a calamity.

  15. Multimodal Medical Image Fusion Methods Based on Improved Discrete Wavelet Transform

    Institute of Scientific and Technical Information of China (English)

    XU Lei; TIAN Shu-chang; CUI Can; MENG Qing-le; YANG Rui; JIANG Hong-bing; WANG Feng

    2016-01-01

    Objective This paper proposed a novel algorithm of discrete wavelet transform (DWT) which is used for multimodal medical image fusion.Methods The source medical images are initially transformed by DWT followed by fusing low and high frequency sub-images. Then, the “coefficient absolute value” that can provide clear and detail parts is adapted to fuse high-frequency coefifcients, where as the “region energy ratio” which can efifciently preserve most information of source images is employed to fuse low-frequency coefifcients. Finally, the fused image is reconstructed by inverse wavelet transform.Results Visually and quantitatively experimental results indicate that the proposed fusion method is superior to traditional wavelet transform and the existing fusion methods.Conclusion The proposed method is a feasible approach for multimodal medical image fusion which can obtain more efifcient and accurate fusions results even in the noise environment.

  16. Multi-modal Intelligent Seizure Acquisition (MISA) system - A new approach towards seizure detection based on full body motion measures

    DEFF Research Database (Denmark)

    Conradsen, Isa; Beniczky, Sándor; Wolf, Peter; Terney, Daniella; Sams, Thomas; Sørensen, Helge Bjarup Dissing

    hazards. Today no reliable alarm systems are available. A Multi-modal Intelligent Seizure Acquisition (MISA) system based on full body motion data seems as a good approach towards detection of epileptic seizures. The system is the first to provide a full body description for epilepsy applications. Three......) and audio and video recording. The results showed that a non-subject specific MISA system developed on data from the modalities: accelerometer (ACM), gyroscope and EMG is able to detect 98% of the simulated seizures and at the same time mistakes only 4 of the normal movements for seizures. If the...

  17. Generating multi-modal robot behavior based on a virtual agent framework

    OpenAIRE

    Salem, Maha; Kopp, Stefan; Wachsmuth, Ipke; Joublin, Frank

    2010-01-01

    One of the crucial steps in the attempt to build sociable, communicative humanoid robots is to endow them with expressive non-verbal behaviors along with speech. One such behavior is gesture, frequently used by human speakers to emphasize, supplement, or even complement what they express in speech. The generation of speech-accompanying robot gesture together with an evaluation of the effects of this multi-modal behavior is still largely unexplored. We present an approach to systematically add...

  18. The Development of Cadastral Domain Model Oriented at Unified Real Estate Registration of China Based on Ontology

    Science.gov (United States)

    Li, M.; Zhu, X.; Shen, C.; Chen, D.; Guo, W.

    2012-07-01

    With the certain regulation of unified real estate registration taken by the Property Law and the step-by-step advance of simultaneous development in urban and rural in China, it is the premise and foundation to clearly specify property rights and their relations in promoting the integrated management of urban and rural land. This paper aims at developing a cadastral domain model oriented at unified real estate registration of China from the perspective of legal and spatial, which set up the foundation for unified real estate registration, and facilitates the effective interchange of cadastral information and the administration of land use. The legal cadastral model is provided based on the analysis of gap between current model and the demand of unified real estate registration, which implies the restrictions between different rights. Then the new cadastral domain model is constructed based on the legal cadastral domain model and CCDM (van Oosterom et al., 2006), which integrate real estate rights of urban land and rural land. Finally, the model is validated by a prototype system. The results show that the model is applicable for unified real estate registration in China.

  19. Surface-Based Registration of Airborne and Terrestrial Mobile LiDAR Point Clouds

    OpenAIRE

    Tee-Ann Teo; Shih-Han Huang

    2014-01-01

    Light Detection and Ranging (LiDAR) is an active sensor that can effectively acquire a large number of three-dimensional (3-D) points. LiDAR systems can be equipped on different platforms for different applications, but to integrate the data, point cloud registration is needed to improve geometric consistency. The registration of airborne and terrestrial mobile LiDAR is a challenging task because the point densities and scanning directions differ. We proposed a scheme for the registration of ...

  20. Featured-Based Algorithm for the Automated Registration of Multisensorial / Multitemporal Oceanographic Satellite Imagery

    OpenAIRE

    Javier Marcello; Francisco Eugenio

    2009-01-01

    Spatial registration of multidate or multisensorial images is required for many applications in remote sensing. Automatic image registration, which has been extensively studied in other areas of image processing, is still a complex problem in the framework of remote sensing. In this work we explore an alternative strategy for a fully automatic and operational registration system capable of registering multitemporal and multisensorial remote sensing satellite images with high accuracy and avoi...

  1. THE DIRECT REGISTRATION OF LIDAR POINT CLOUDS AND HIGH RESOLUTION IMAGE BASED ON LINEAR FEATURE BY INTRODUCING AN UNKNOWN PARAMETER

    Directory of Open Access Journals (Sweden)

    Y. Chunjing

    2012-07-01

    Full Text Available The registration between optical images and point clouds is the first task when the combination of these two datasets is concerned. Due to the discrete nature of the point clouds, and the 2D-3D transformation in particular, a tie points based registration strategy which is commonly adopted in image-to-image registration is hard to be used directly in this scenario. A derived collinear equation describing the map relationship between an image point and a ground point is used as the mathematical model for registration, with the point in the LiDAR space expressed by its parametric form. such a map relation can be viewed as the mathematical model which registers the image pixels to point clouds. This model is not only suitable for a single image registration but also applicable to multiple consecutive images. We also studied scale problem in image and point clouds registration, with scale problem is defined by the optimal corresponding between the image resolution and the density of point clouds. Test dataset includes the DMC images and point clouds acquired by the Leica ALS50 II over an area in Henan Prov., China. Main contributions of the paper includes: [1] an derived collinear equation is introduced by which a ground point is expressed by its parametric form, which makes it possible to replace point feature by linear feature, hence avoiding the problem that it is almost impossible to find a point in the point clouds which is accurately corresponds to a point in the image space; [2] least square method is used to calculate the registration transformation parameters and the unknown parameter λ in the same time;[3] scale problem is analyzed semi-quantitatively and to the authors’ best knowledge, it is the first time in literature that clearly defines the scale problem and carries out semi-quantitative analysis in the context of LiDAR data processing.

  2. G-Heart: A GPU-based System for Electrophysiological Simulation and Multi-modality Cardiac Visualization

    Directory of Open Access Journals (Sweden)

    Lei Zhang

    2014-02-01

    Full Text Available Cardiac electrophysiological simulation and multi-modality visualization are computationally intensive and valuable in studying the structure, mechanism, and dynamics of heart. The existing multi-CPU based approaches can reduce the calculation time, but suffer from the hardware and communication cost problems and are inefficient for 3D data visualization. Compared with multi-CPU, the highly parallel and multi-core properties of GPU make it a suitable alternative for accelerating cardiac simulation and visualization. In this paper, we develop a G-Heart system where GPU-based acceleration technologies are adopted for both the simulation of cardiac electrophysiological activities and the online illustration 3D multi-modality (anatomical and electrophysiological data. In the simulation stage, a phase-field method is employed to cope with the no-flux boundary condition. For heart geometrical structure illustration, a GPU-based ray-casting volume rendering algorithm is implemented and an improved context-preserving model with user interaction is integrated into the proposed framework. Finally, a fusion visualization method is proposed, which can provide 3D visualization results for both the simulation data and the anatomical data simultaneously.

  3. PSO-based methods for medical image registration and change assessment of pigmented skin

    Science.gov (United States)

    Kacenjar, Steve; Zook, Matthew; Balint, Michael

    2011-03-01

    There are various scientific and technological areas in which it is imperative to rapidly detect and quantify changes in imagery over time. In fields such as earth remote sensing, aerospace systems, and medical imaging, searching for timedependent, regional changes across deformable topographies is complicated by varying camera acquisition geometries, lighting environments, background clutter conditions, and occlusion. Under these constantly-fluctuating conditions, the use of standard, rigid-body registration approaches often fail to provide sufficient fidelity to overlay image scenes together. This is problematic because incorrect assessments of the underlying changes of high-level topography can result in systematic errors in the quantification and classification of interested areas. For example, in the current naked-eye detection strategies of melanoma, a dermatologist often uses static morphological attributes to identify suspicious skin lesions for biopsy. This approach does not incorporate temporal changes which suggest malignant degeneration. By performing the co-registration of time-separated skin imagery, a dermatologist may more effectively detect and identify early morphological changes in pigmented lesions; enabling the physician to detect cancers at an earlier stage resulting in decreased morbidity and mortality. This paper describes an image processing system which will be used to detect changes in the characteristics of skin lesions over time. The proposed system consists of three main functional elements: 1.) coarse alignment of timesequenced imagery, 2.) refined alignment of local skin topographies, and 3.) assessment of local changes in lesion size. During the coarse alignment process, various approaches can be used to obtain a rough alignment, including: 1.) a manual landmark/intensity-based registration method1, and 2.) several flavors of autonomous optical matched filter methods2. These procedures result in the rough alignment of a patient

  4. Registration Service

    CERN Multimedia

    GS Department

    2010-01-01

    Following a reorganization in Building 55, please note that the Registration Service is now organised as follows :  Ground floor: access cards (76903). 1st floor : registration of external firms’ personnel (76611 / 76622); car access stickers (76633); biometric registration (79710). Opening hours: 07-30 to 16-00 non-stop. GS-SEM Group General Infrastructure Services Department

  5. Multimodal evaluering af deltagerstyret problem- og undersøgelsesbaseret aktiviteter i børnehave og indskolingMultimodal assessment of inquiry based science education in kindergarten and primary school

    Directory of Open Access Journals (Sweden)

    Lars Domino Østergaard

    2013-11-01

    Full Text Available A multimodal assessment method is designed on the basis on Science Performance Assessment with three central representations in focus of assessment: Written, oral and practical representations. The multimodal assessment method is tried out in both kindergarten and in primary school, which have worked with inquiry based science education (IBSE related to the subject “Wind & Weather”. The study is situated in a sociocultural context and the data are analyzed according to Engeströms activity theory. The results clearly indicated that the method is suitable for assessment of IBSE activities. It gives the evaluator opportunities to test students’ knowledge, skills and competencies related to science as well as students’ social and personal competencies. Hence, the evaluator in a better way can guide the students in the right direction on their learning journey.

  6. Motion Segmentation for Time-Varying Mesh Sequences Based on Spherical Registration

    Directory of Open Access Journals (Sweden)

    Kiyoharu Aizawa

    2008-08-01

    Full Text Available A highly accurate motion segmentation technique for time-varying mesh (TVM is presented. In conventional approaches, motion of the objects was analyzed using shape feature vectors extracted from TVM frames. This was because it was very difficult to locate and track feature points in the objects in the 3D space due to the fact that the number of vertices and connection varies each frame. In this study, we developed an algorithm to analyze the objects' motion in the 3D space using the spherical registration based on the iterative closest-point algorithm. Rough motion tracking is conducted and the degree of motion is robustly calculated by this method. Although the approach is straightforward, much better motion segmentation results than the conventional approaches are obtained by yielding such high precision and recall rates as 95% and 92% on average.

  7. Deformable Registration of Feature-Endowed Point Sets Based on Tensor Fields

    Science.gov (United States)

    Wassermann, Demian; Ross, James; Washko, George; Wells, William M.; San Jose-Estepar, Raul

    2014-01-01

    The main contribution of this work is a framework to register anatomical structures characterized as a point set where each point has an associated symmetric matrix. These matrices can represent problem-dependent characteristics of the registered structure. For example, in airways, matrices can represent the orientation and thickness of the structure. Our framework relies on a dense tensor field representation which we implement sparsely as a kernel mixture of tensor fields. We equip the space of tensor fields with a norm that serves as a similarity measure. To calculate the optimal transformation between two structures we minimize this measure using an analytical gradient for the similarity measure and the deformation field, which we restrict to be a diffeomorphism. We illustrate the value of our tensor field model by comparing our results with scalar and vector field based models. Finally, we evaluate our registration algorithm on synthetic data sets and validate our approach on manually annotated airway trees. PMID:25473253

  8. Finding a Good Feature Detector-Descriptor Combination for the 2d Keypoint-Based Registration of Tls Point Clouds

    Science.gov (United States)

    Urban, S.; Weinmann, M.

    2015-08-01

    The automatic and accurate registration of terrestrial laser scanning (TLS) data is a topic of great interest in the domains of city modeling, construction surveying or cultural heritage. While numerous of the most recent approaches focus on keypoint-based point cloud registration relying on forward-projected 2D keypoints detected in panoramic intensity images, little attention has been paid to the selection of appropriate keypoint detector-descriptor combinations. Instead, keypoints are commonly detected and described by applying well-known methods such as the Scale Invariant Feature Transform (SIFT) or Speeded-Up Robust Features (SURF). In this paper, we present a framework for evaluating the influence of different keypoint detector-descriptor combinations on the results of point cloud registration. For this purpose, we involve five different approaches for extracting local features from the panoramic intensity images and exploit the range information of putative feature correspondences in order to define bearing vectors which, in turn, may be exploited to transfer the task of point cloud registration from the object space to the observation space. With an extensive evaluation of our framework on a standard benchmark TLS dataset, we clearly demonstrate that replacing SIFT and SURF detectors and descriptors by more recent approaches significantly alleviates point cloud registration in terms of accuracy, efficiency and robustness.

  9. Efficient feature-based 2D/3D registration of transesophageal echocardiography to x-ray fluoroscopy for cardiac interventions

    Science.gov (United States)

    Hatt, Charles R.; Speidel, Michael A.; Raval, Amish N.

    2014-03-01

    We present a novel 2D/ 3D registration algorithm for fusion between transesophageal echocardiography (TEE) and X-ray fluoroscopy (XRF). The TEE probe is modeled as a subset of 3D gradient and intensity point features, which facilitates efficient 3D-to-2D perspective projection. A novel cost-function, based on a combination of intensity and edge features, evaluates the registration cost value without the need for time-consuming generation of digitally reconstructed radiographs (DRRs). Validation experiments were performed with simulations and phantom data. For simulations, in silica XRF images of a TEE probe were generated in a number of different pose configurations using a previously acquired CT image. Random misregistrations were applied and our method was used to recover the TEE probe pose and compare the result to the ground truth. Phantom experiments were performed by attaching fiducial markers externally to a TEE probe, imaging the probe with an interventional cardiac angiographic x-ray system, and comparing the pose estimated from the external markers to that estimated from the TEE probe using our algorithm. Simulations found a 3D target registration error of 1.08(1.92) mm for biplane (monoplane) geometries, while the phantom experiment found a 2D target registration error of 0.69mm. For phantom experiments, we demonstrated a monoplane tracking frame-rate of 1.38 fps. The proposed feature-based registration method is computationally efficient, resulting in near real-time, accurate image based registration between TEE and XRF.

  10. Ultra-compact, broadband tunable optical bandstop filters based on a multimode one-dimensional photonic crystal waveguide.

    Science.gov (United States)

    Huang, Qingzhong; Jie, Kun; Liu, Qiang; Huang, Ying; Wang, Yi; Xia, Jinsong

    2016-09-01

    In this paper, ultra-compact, broadband tunable optical bandstop filters (OBSFs) based on a multimode one-dimensional photonic crystal waveguide (PhCW) are proposed and systematically investigated. For the wavelengths in the mini-stopband, the input mode is coupled to a contra-propagating higher order mode by the PhCW and then radiates in a taper, resulting in a stopband at the output with low backreflection at the input. Three-dimensional finite-difference time-domain method is employed to study the OBSFs. The influence of main structural parameters is analyzed, and the design is optimized to reduce the back-reflection and band sidelobes. Using localized heating, we can shift the stopband and tune the bandwidth continuously by cascading the proposed structures. Due to the strong grating strength, our device provides a more compact footprint (40 μm × 1 μm) and much broader stopband (bandwidth of up to 84 nm), compared to the counterparts based on microrings, long-period waveguide gratings, and multimode two-dimensional PhCWs. PMID:27607658

  11. Cycling in multimodal transport behaviours

    DEFF Research Database (Denmark)

    Olafsson, Anton Stahl; Nielsen, Thomas Sick; Carstensen, Trine Agervig

    2016-01-01

    explores how cycling forms part of multimodal transport behaviour based on survey data on transport modes and travel purposes and the weekly frequency of out-of-home activities and travel mode use in a representative sample of adult Danes (n = 1957). The following five distinct multimodal travel segments...... or 'modality styles' are identified: 'education transport'; 'public-based transport'; 'limited transport'; 'bicycle-based transport'; and 'car-based transport'. Travel behaviour is predominantly multimodal with few unimodal car-drivers being identified. Substantial cycling takes place in all modality...... urban settings and small towns. Thus, the way in which travel modes relate to the urban environment and variations in modality styles must serve as the starting point for policies aiming to fulfil the potential of multimodal transport behaviour and promote cycling....

  12. Development of real-time monitoring system for printing registration based on μC/OS-Ⅱ

    Institute of Scientific and Technical Information of China (English)

    马志艳

    2009-01-01

    After analyzing the basic composition and principles of multicolor printing system,we presented a design of real-time monitoring system for printing registration based on multitask real-time operating system μC/OS-Ⅱ.According to functional requirements of registration system and the target development platform,we described the detailed process of task division, priority assignment,and synchronization and communication,and optimized the real-time performance of system in the premise of stability assurance.Fi...

  13. A Comparison of FFD-based Nonrigid Registration and AAMs Applied to Myocardial Perfusion MRI

    DEFF Research Database (Denmark)

    Ólafsdóttir, Hildur; Stegmann, Mikkel Bille; Ersbøll, Bjarne Kjær;

    2006-01-01

    -slice myocardial perfusion images. The images are acquired by magnetic resonance imaging, from infarct patients. A registration of these sequences is crucial for clinical practice, which currently is subjected to manual labor. In the paper, the pros and cons of the two registration approaches are discussed and...

  14. Incidence of unintentional injuries in farming based on one year of weekly registration in Danish farms

    DEFF Research Database (Denmark)

    Rasmussen, K; Carstensen, O; Lauritsen, Jens

    2000-01-01

    In Denmark, farming ranks as the industry with the highest incidence rate of fatal injuries. For nonfatal injuries, insufficient registration practices prevent valid comparisons between occupations. This study examines the occurrence of farm accidents and injuries, as well as work-specific factors......, via weekly registration in a representative sample of 393 farms in one county during 1 year....

  15. Multimodal MRI-Based Classification of Trauma Survivors with and without Post-Traumatic Stress Disorder.

    Science.gov (United States)

    Zhang, Qiongmin; Wu, Qizhu; Zhu, Hongru; He, Ling; Huang, Hua; Zhang, Junran; Zhang, Wei

    2016-01-01

    Post-traumatic stress disorder (PTSD) is a debilitating psychiatric disorder. It can be difficult to discern the symptoms of PTSD and obtain an accurate diagnosis. Different magnetic resonance imaging (MRI) modalities focus on different aspects, which may provide complementary information for PTSD discrimination. However, none of the published studies assessed the diagnostic potential of multimodal MRI in identifying individuals with and without PTSD. In the current study, we investigated whether the complementary information conveyed by multimodal MRI scans could be combined to improve PTSD classification performance. Structural and resting-state functional MRI (rs-fMRI) scans were conducted on 17 PTSD patients, 20 trauma-exposed controls without PTSD (TEC) and 20 non-traumatized healthy controls (HC). Gray matter volume (GMV), amplitude of low-frequency fluctuations (ALFF), and regional homogeneity were extracted as classification features, and in order to integrate the information of structural and functional MRI data, the extracted features were combined by a multi-kernel combination strategy. Then a support vector machine (SVM) classifier was trained to distinguish the subjects at individual level. The performance of the classifier was evaluated using the leave-one-out cross-validation (LOOCV) method. In the pairwise comparison of PTSD, TEC, and HC groups, classification accuracies obtained by the proposed approach were 2.70, 2.50, and 2.71% higher than the best single feature way, with the accuracies of 89.19, 90.00, and 67.57% for PTSD vs. HC, TEC vs. HC, and PTSD vs. TEC respectively. The proposed approach could improve PTSD identification at individual level. Additionally, it provides preliminary support to develop the multimodal MRI method as a clinical diagnostic aid. PMID:27445664

  16. Towards multimodal detection of melanoma thickness based on optical coherence tomography and optoacoustics

    Science.gov (United States)

    Rahlves, M.; Varkentin, A.; Stritzel, J.; Blumenröther, E.; Mazurenka, M.; Wollweber, M.; Roth, B.

    2016-03-01

    Melanoma skin cancer has one of the highest mortality rates of all types of cancer if not detected at an early stage. The survival rate is highly dependent on its penetration depth, which is commonly determined by histopathology. In this work, we aim at combining optical coherence tomography and optoacoustic as a non-invasive all-optical method to measure the penetration depth of melanoma. We present our recent achievements to setup a handheld multimodal device and also results from first in vivo measurements on healthy and cancerous skin tissue, which are compared to measurements obtained by ultrasound and histopathology.

  17. Multi-Modality Phantom Development

    Energy Technology Data Exchange (ETDEWEB)

    Huber, Jennifer S.; Peng, Qiyu; Moses, William W.

    2009-03-20

    Multi-modality imaging has an increasing role in the diagnosis and treatment of a large number of diseases, particularly if both functional and anatomical information are acquired and accurately co-registered. Hence, there is a resulting need for multi modality phantoms in order to validate image co-registration and calibrate the imaging systems. We present our PET-ultrasound phantom development, including PET and ultrasound images of a simple prostate phantom. We use agar and gelatin mixed with a radioactive solution. We also present our development of custom multi-modality phantoms that are compatible with PET, transrectal ultrasound (TRUS), MRI and CT imaging. We describe both our selection of tissue mimicking materials and phantom construction procedures. These custom PET-TRUS-CT-MRI prostate phantoms use agargelatin radioactive mixtures with additional contrast agents and preservatives. We show multi-modality images of these custom prostate phantoms, as well as discuss phantom construction alternatives. Although we are currently focused on prostate imaging, this phantom development is applicable to many multi-modality imaging applications.

  18. Registration of partially overlapping surfaces for range image based augmented reality on mobile devices

    Science.gov (United States)

    Kilgus, T.; Franz, A. M.; Seitel, A.; Marz, K.; Bartha, L.; Fangerau, M.; Mersmann, S.; Groch, A.; Meinzer, H.-P.; Maier-Hein, L.

    2012-02-01

    Visualization of anatomical data for disease diagnosis, surgical planning, or orientation during interventional therapy is an integral part of modern health care. However, as anatomical information is typically shown on monitors provided by a radiological work station, the physician has to mentally transfer internal structures shown on the screen to the patient. To address this issue, we recently presented a new approach to on-patient visualization of 3D medical images, which combines the concept of augmented reality (AR) with an intuitive interaction scheme. Our method requires mounting a range imaging device, such as a Time-of-Flight (ToF) camera, to a portable display (e.g. a tablet PC). During the visualization process, the pose of the camera and thus the viewing direction of the user is continuously determined with a surface matching algorithm. By moving the device along the body of the patient, the physician is given the impression of looking directly into the human body. In this paper, we present and evaluate a new method for camera pose estimation based on an anisotropic trimmed variant of the well-known iterative closest point (ICP) algorithm. According to in-silico and in-vivo experiments performed with computed tomography (CT) and ToF data of human faces, knees and abdomens, our new method is better suited for surface registration with ToF data than the established trimmed variant of the ICP, reducing the target registration error (TRE) by more than 60%. The TRE obtained (approx. 4-5 mm) is promising for AR visualization, but clinical applications require maximization of robustness and run-time.

  19. INSTALLED BASE REGISTRATION OF DECENTRALISED SOLAR PANELS WITH APPLICATIONS IN CRISIS MANAGEMENT

    Directory of Open Access Journals (Sweden)

    R. Aarsen

    2015-08-01

    Full Text Available In case of a calamity in the Netherlands - e.g. a dike breach - parts of the nationwide electric network can fall out. In these occasions it would be useful if decentralised energy sources of the Smart Grid would contribute to balance out the fluctuations of the energy network. Decentralised energy sources include: solar energy, wind energy, combined heat and power, and biogas. In this manner, parts of the built environment - e.g. hospitals - that are in need of a continuous power flow, could be secured of this power. When a calamity happens, information about the Smart Grid is necessary to control the crisis and to ensure a shared view on the energy networks for both the crisis managers and network operators. The current situation of publishing, storing and sharing data of solar energy has been shown a lack of reliability about the current number, physical location, and capacity of installed decentralised photovoltaic (PV panels in the Netherlands. This study focuses on decentralised solar energy in the form of electricity via PV panels in the Netherlands and addresses this challenge by proposing a new, reliable and up-to-date database. The study reveals the requirements for a registration of the installed base of PV panels in the Netherlands. This new database should serve as a replenishment for the current national voluntary registration, called Production Installation Register of Energy Data Services Netherland (EDSN-PIR, of installed decentralised PV panel installations in the Smart Grid, and provide important information in case of a calamity.

  20. A mutual-information-based registration algorithm for ultrasound-guided computer-assisted orthopaedic surgery

    Science.gov (United States)

    Chen, Thomas K.; Abolmaesumi, Purang

    2005-04-01

    This paper presents a novel approach and its preliminary laboratory results for the employment of ultrasound (US) imaging in intraoperative guidance of computer-assisted orthopaedic surgeries (CAOS). The goal is to register live intraoperative US images with preoperative surgical planning data using minimal number of images. Preoperatively, a set of 2D US images are acquired with the corresponding positional information of the US probe provided by an optical tracking system. Using calibration parameters, the position of every pixel in the acquired images is transformed into the world coordinate frame to construct a 3D volumetric representation of the targeted anatomy for surgical planning. Intraoperatively, the surgeon takes live US images from the patient with the position of the US probe tracked in real time. A mutual-information-based registration algorithm is then used to find the closest match to the live image in the preoperative US image database. Because the position of the preoperative image inside the US volume is known, we are able to register the preoperative US volume to the live image, thus to the patient. Experiments have shown the registration algorithm has sub-millimeter accuracy in localizing the best match between the intraoperative and pre-operative images, demonstrating great potential for orthopaedic surgery applications. This method has some significant advantages over the previously reported US-guided CAOS techniques: it requires no segmentation, and employs only a few intraoperative images to accurately and robustly localize the patient. Preliminary laboratory results on both a Sawbones model of a radius bone and human subjects are presented.

  1. Template-based CTA X-ray angio rigid registration of coronary arteries in frequency domain

    Science.gov (United States)

    Aksoy, Timur; Demirci, Stefanie; Degertekin, Muzaffer; Navab, Nassir; Unal, Gozde

    2013-03-01

    This study performs 3D to 2D rigid registration of segmented pre-operative CTA coronary arteries with a single segmented intra-operative X-ray Angio frame in both frequency and spatial domains for real-time Angiography interventions by C-arm fluoroscopy. Most of the work on rigid registration in literature required a close initial- ization of poses and/or positions because of the abundance of local minima and high complexity that searching algorithms face. This study avoids such setbacks by transforming the projections into translation-invariant Fourier domain for estimating the 3D pose. First, template DRRs as candidate poses of 3D vessels of segmented CTA are produced by rotating the camera (image intensifier) around the DICOM angle values with a wide range as in C-arm setup. We have compared the 3D poses of template DRRs with the real X-ray after equalizing the scales (due to disparities in focal length distances) in 3 domains, namely Fourier magnitude, Fourier phase and Fourier polar. The best pose candidate was chosen by one of the highest similarity measures returned by the methods in these domains. It has been noted in literature that these methods are robust against noise and occlusion which was also validated by our results. Translation of the volume was then recovered by distance-map based BFGS optimization well suited to convex structure of our objective function without local minima due to distance maps. Final results were evaluated in 2D projection space rather than with actual values in 3D due to lack of ground truth, ill-posedness of the problem which we intend to address in future.

  2. 78 FR 31571 - Announcement of Requirements and Registration for the “Technology-based Products to Prevent High...

    Science.gov (United States)

    2013-05-24

    ... and Registration for the ``Technology-based Products to Prevent High-Risk Drinking Among College... organizations to help prevent high-risk drinking among college students. Excessive and underage drinking among... illness on America's communities. SAMHSA recognizes that preventing high-risk drinking among...

  3. Medical case-based retrieval: integrating query MeSH terms for query-adaptive multi-modal fusion

    Science.gov (United States)

    Seco de Herrera, Alba G.; Foncubierta-Rodríguez, Antonio; Müller, Henning

    2015-03-01

    Advances in medical knowledge give clinicians more objective information for a diagnosis. Therefore, there is an increasing need for bibliographic search engines that can provide services helping to facilitate faster information search. The ImageCLEFmed benchmark proposes a medical case-based retrieval task. This task aims at retrieving articles from the biomedical literature that are relevant for differential diagnosis of query cases including a textual description and several images. In the context of this campaign many approaches have been investigated showing that the fusion of visual and text information can improve the precision of the retrieval. However, fusion does not always lead to better results. In this paper, a new query-adaptive fusion criterion to decide when to use multi-modal (text and visual) or only text approaches is presented. The proposed method integrates text information contained in MeSH (Medical Subject Headings) terms extracted and visual features of the images to find synonym relations between them. Given a text query, the query-adaptive fusion criterion decides when it is suitable to also use visual information for the retrieval. Results show that this approach can decide if a text or multi{modal approach should be used with 77.15% of accuracy.

  4. Design of a 1 × 4 silicon-alumina wavelength demultiplexer based on multimode interference in slot waveguide structures

    Science.gov (United States)

    Malka, Dror; Sintov, Yoav; Zalevsky, Zeev

    2015-12-01

    In this paper we present 1 × 4 wavelength demultiplexer operating at 1.4 μm, 1.45 μm, 1.5 μm and 1.55 μm wavelengths, based on multimode interference (MMI) coupler in slot waveguide structure. Alumina was used as the slot material. The design is based on three cascaded 1 × 2 MMI demultiplexers. Tapered waveguide structures are being in the input/output of the MMI section, for reducing the excess loss. Since the slot waveguide encompasses true guided modes, confined by total internal reflections, there are no noticeable confinement losses. Full vectorial-beam propagation method (FV-BPM) and BPM simulations were used for optimizing the device parameters and assessing its performance. To the best of our knowledge it is the first time that a 1 × 4 demultiplexer is being implemented by a slot waveguide based MMI.

  5. Constructing and Using Multimodal Narratives to Research in Science Education: Contributions Based on Practical Classroom

    Science.gov (United States)

    Lopes, J. B.; Silva, A. A.; Cravino, J. P.; Santos, C. A.; Cunha, A.; Pinto, A.; Silva, A.; Viegas, C.; Saraiva, E.; Branco, M. J.

    2014-06-01

    This study deals with the problem of how to collect genuine and useful data about science classroom practices, and preserving the complex and holistic nature of teaching and learning. Additionally, we were looking for an instrument that would allow comparability and verifiability for teaching and research purposes. Given the multimodality of teaching and learning processes, we developed the multimodal narrative (MN), which describes what happens during a task and incorporates data such as examples of students' work, photos, diagrams, etc. Also, it describes teachers' intentions, preserving the nature of teaching practice in natural settings and it is verifiable and comparable. In this paper, we show how the MN was developed and present the protocol that was used for its construction. We identify the main characteristics of the MN and place it in the context of international research. We explore the potential of the MN for research purposes, illustrating its use in a research study that we carried out. We find that the MN provides a way to gather, organize and transform data, avoiding confusing and time-consuming manipulation of data, while minimizing the natural subjectivity of the narrator. The same MN can be used by the same or by different researchers for different purposes. Furthermore, the same MN can be used with different analysis techniques. It is also possible to study research practices on a large scale using MNs from different teachers and lessons. We propose that MNs can also be useful for teachers' professional development.

  6. Improving Intensity-Based Lung CT Registration Accuracy Utilizing Vascular Information

    Directory of Open Access Journals (Sweden)

    Kunlin Cao

    2012-01-01

    Full Text Available Accurate pulmonary image registration is a challenging problem when the lungs have a deformation with large distance. In this work, we present a nonrigid volumetric registration algorithm to track lung motion between a pair of intrasubject CT images acquired at different inflation levels and introduce a new vesselness similarity cost that improves intensity-only registration. Volumetric CT datasets from six human subjects were used in this study. The performance of four intensity-only registration algorithms was compared with and without adding the vesselness similarity cost function. Matching accuracy was evaluated using landmarks, vessel tree, and fissure planes. The Jacobian determinant of the transformation was used to reveal the deformation pattern of local parenchymal tissue. The average matching error for intensity-only registration methods was on the order of 1 mm at landmarks and 1.5 mm on fissure planes. After adding the vesselness preserving cost function, the landmark and fissure positioning errors decreased approximately by 25% and 30%, respectively. The vesselness cost function effectively helped improve the registration accuracy in regions near thoracic cage and near the diaphragm for all the intensity-only registration algorithms tested and also helped produce more consistent and more reliable patterns of regional tissue deformation.

  7. Significant acceleration of 2D-3D registration-based fusion of ultrasound and x-ray images by mesh-based DRR rendering

    Science.gov (United States)

    Kaiser, Markus; John, Matthias; Borsdorf, Anja; Mountney, Peter; Ionasec, Razvan; Nöttling, Alois; Kiefer, Philipp; Seeburger, Jörg; Neumuth, Thomas

    2013-03-01

    For transcatheter-based minimally invasive procedures in structural heart disease ultrasound and X-ray are the two enabling imaging modalities. A live fusion of both real-time modalities can potentially improve the workflow and the catheter navigation by combining the excellent instrument imaging of X-ray with the high-quality soft tissue imaging of ultrasound. A recently published approach to fuse X-ray fluoroscopy with trans-esophageal echo (TEE) registers the ultrasound probe to X-ray images by a 2D-3D registration method which inherently provides a registration of ultrasound images to X-ray images. In this paper, we significantly accelerate the 2D-3D registration method in this context. The main novelty is to generate the projection images (DRR) of the 3D object not via volume ray-casting but instead via a fast rendering of triangular meshes. This is possible, because in the setting for TEE/X-ray fusion the 3D geometry of the ultrasound probe is known in advance and their main components can be described by triangular meshes. We show that the new approach can achieve a speedup factor up to 65 and does not affect the registration accuracy when used in conjunction with the gradient correlation similarity measure. The improvement is independent of the underlying registration optimizer. Based on the results, a TEE/X-ray fusion could be performed with a higher frame rate and a shorter time lag towards real-time registration performance. The approach could potentially accelerate other applications of 2D-3D registrations, e.g. the registration of implant models with X-ray images.

  8. High sensitivity high temperature sensor based on SMS structure with large-core all-solid bandgap fiber as the multimode section

    Science.gov (United States)

    Franco, Marcos A. R.; Cruz, Alice L. S.; Serrão, Valdir A.; Barbosa, Carmem L.

    2014-05-01

    A fiber optic interferometric device based on a singlemode-multimode-singlemode (SMS) structure is proposed as a high sensitive high temperature sensor. The multimode section (MMF) consists of a large-core all-solid photonic bandgap fiber (AS-PBF) with silica as the background material and germanium-doped silica at the high index regions. The numerical analyses were carried out by beam propagation method. The numerical results indicate a constant high temperature sensitivity of ~-35 pm/°C over a large temperature range from 20oC to 930°C.

  9. Efficient generation of sum-of-products representations of high-dimensional potential energy surfaces based on multimode expansions

    Science.gov (United States)

    Ziegler, Benjamin; Rauhut, Guntram

    2016-03-01

    The transformation of multi-dimensional potential energy surfaces (PESs) from a grid-based multimode representation to an analytical one is a standard procedure in quantum chemical programs. Within the framework of linear least squares fitting, a simple and highly efficient algorithm is presented, which relies on a direct product representation of the PES and a repeated use of Kronecker products. It shows the same scalings in computational cost and memory requirements as the potfit approach. In comparison to customary linear least squares fitting algorithms, this corresponds to a speed-up and memory saving by several orders of magnitude. Different fitting bases are tested, namely, polynomials, B-splines, and distributed Gaussians. Benchmark calculations are provided for the PESs of a set of small molecules.

  10. Fast and accurate marker-based projective registration method for uncalibrated transmission electron microscope tilt series

    International Nuclear Information System (INIS)

    This paper presents a fast and accurate marker-based automatic registration technique for aligning uncalibrated projections taken from a transmission electron microscope (TEM) with different tilt angles and orientations. Most of the existing TEM image alignment methods estimate the similarity between images using the projection model with least-squares metric and guess alignment parameters by computationally expensive nonlinear optimization schemes. Approaches based on the least-squares metric which is sensitive to outliers may cause misalignment since automatic tracking methods, though reliable, can produce a few incorrect trajectories due to a large number of marker points. To decrease the influence of outliers, we propose a robust similarity measure using the projection model with a Gaussian weighting function. This function is very effective in suppressing outliers that are far from correct trajectories and thus provides a more robust metric. In addition, we suggest a fast search strategy based on the non-gradient Powell's multidimensional optimization scheme to speed up optimization as only meaningful parameters are considered during iterative projection model estimation. Experimental results show that our method brings more accurate alignment with less computational cost compared to conventional automatic alignment methods.

  11. Ant colony optimization image registration algorithm based on wavelet transform and mutual information

    Science.gov (United States)

    Zhang, Hong; Sun, Yanfeng; Zhai, Bing; Wang, Yiding

    2013-07-01

    This paper studies on the image registration of the medical images. Wavelet transform is adopted to decompose the medical images because the resolution of the medical image is high and the computational amount of the registration is large. Firstly, the low frequency sub-images are matched. Then source images are matched. The image registration was fulfilled by the ant colony optimization algorithm to search the extremum of the mutual information. The experiment result demonstrates the proposed approach can not only reduce calculation amount, but also skip from the local extremum during optimization process, and search the optimization value.

  12. MRI-based treatment planning with pseudo CT generated through atlas registration

    International Nuclear Information System (INIS)

    Purpose: To evaluate the feasibility and accuracy of magnetic resonance imaging (MRI)-based treatment planning using pseudo CTs generated through atlas registration. Methods: A pseudo CT, providing electron density information for dose calculation, was generated by deforming atlas CT images previously acquired on other patients. The authors tested 4 schemes of synthesizing a pseudo CT from single or multiple deformed atlas images: use of a single arbitrarily selected atlas, arithmetic mean process using 6 atlases, and pattern recognition with Gaussian process (PRGP) using 6 or 12 atlases. The required deformation for atlas CT images was derived from a nonlinear registration of conjugated atlas MR images to that of the patient of interest. The contrasts of atlas MR images were adjusted by histogram matching to reduce the effect of different sets of acquisition parameters. For comparison, the authors also tested a simple scheme assigning the Hounsfield unit of water to the entire patient volume. All pseudo CT generating schemes were applied to 14 patients with common pediatric brain tumors. The image similarity of real patient-specific CT and pseudo CTs constructed by different schemes was compared. Differences in computation times were also calculated. The real CT in the treatment planning system was replaced with the pseudo CT, and the dose distribution was recalculated to determine the difference. Results: The atlas approach generally performed better than assigning a bulk CT number to the entire patient volume. Comparing atlas-based schemes, those using multiple atlases outperformed the single atlas scheme. For multiple atlas schemes, the pseudo CTs were similar to the real CTs (correlation coefficient, 0.787–0.819). The calculated dose distribution was in close agreement with the original dose. Nearly the entire patient volume (98.3%–98.7%) satisfied the criteria of chi-evaluation (<2% maximum dose and 2 mm range). The dose to 95% of the volume and the

  13. Evaluation of accuracy of B-spline transformation-based deformable image registration with different parameter settings for thoracic images

    International Nuclear Information System (INIS)

    Deformable image registration (DIR) is fundamental technique for adaptive radiotherapy and image-guided radiotherapy. However, further improvement of DIR is still needed. We evaluated the accuracy of B-spline transformation-based DIR implemented in elastix. This registration package is largely based on the Insight Segmentation and Registration Toolkit (ITK), and several new functions were implemented to achieve high DIR accuracy. The purpose of this study was to clarify whether new functions implemented in elastix are useful for improving DIR accuracy. Thoracic 4D computed tomography images of ten patients with esophageal or lung cancer were studied. Datasets for these patients were provided by DIR-lab (dir-lab.com) and included a coordinate list of anatomical landmarks that had been manually identified. DIR between peak-inhale and peak-exhale images was performed with four types of parameter settings. The first one represents original ITK (Parameter 1). The second employs the new function of elastix (Parameter 2), and the third was created to verify whether new functions improve DIR accuracy while keeping computational time (Parameter 3). The last one partially employs a new function (Parameter 4). Registration errors for these parameter settings were calculated using the manually determined landmark pairs. 3D registration errors with standard deviation over all cases were 1.78 (1.57), 1.28 (1.10), 1.44 (1.09) and 1.36 (1.35) mm for Parameter 1, 2, 3 and 4, respectively, indicating that the new functions are useful for improving DIR accuracy, even while maintaining the computational time, and this B-spline-based DIR could be used clinically to achieve high-accuracy adaptive radiotherapy. (author)

  14. Temperature-Corrected Oxygen Detection Based on Multi-Mode Diode Laser Correlation Spectroscopy

    Directory of Open Access Journals (Sweden)

    Xiutao Lou

    2013-01-01

    Full Text Available Temperature-corrected oxygen measurements were performed by using multi-mode diode laser correlation spectroscopy at temperatures ranging between 300 and 473 K. The experiments simulate in situ monitoring of oxygen in coal-combustion exhaust gases at the tail of the flue. A linear relationship with a correlation coefficient of −0.999 was found between the evaluated concentration and the gas temperature. Temperature effects were either auto-corrected by keeping the reference gas at the same conditions as the sample gas, or rectified by using a predetermined effective temperature-correction coefficient calibrated for a range of absorption wavelengths. Relative standard deviations of the temperature-corrected oxygen concentrations obtained by different schemes and at various temperatures were estimated, yielding a measurement precision of 0.6%.

  15. An optical authentication system based on encryption technique and multimodal biometrics

    Science.gov (United States)

    Yuan, Sheng; Zhang, Tong; Zhou, Xin; Liu, Xuemei; Liu, Mingtang

    2013-12-01

    A major concern nowadays for a biometric credential management system is its potential vulnerability to protect its information sources. To prevent a genuine user's templates from both internal and external threats, a novel and simple method combined optical encryption with multimodal biometric authentication technique is proposed. In this method, the standard biometric templates are generated real-timely by the verification keys owned by legal user so that they are unnecessary to be stored in a database. Compared with the traditional recognition algorithms, storage space and matching time are greatly saved. In addition, the verification keys are difficult to be forged due to the utilization of optical encryption technique. Although the verification keys are lost or stolen, they are useless for others in absence of the legal owner's biometric. A series of numerical simulations are performed to demonstrate the feasibility and performance of this method.

  16. Achromatic approach to phase-based multi-modal imaging with conventional X-ray sources.

    Science.gov (United States)

    Endrizzi, Marco; Vittoria, Fabio A; Kallon, Gibril; Basta, Dario; Diemoz, Paul C; Vincenzi, Alessandro; Delogu, Pasquale; Bellazzini, Ronaldo; Olivo, Alessandro

    2015-06-15

    Compatibility with polychromatic radiation is an important requirement for an imaging system using conventional rotating anode X-ray sources. With a commercially available energy-resolving single-photon-counting detector we investigated how broadband radiation affects the performance of a multi-modal edge-illumination phase-contrast imaging system. The effect of X-ray energy on phase retrieval is presented, and the achromaticity of the method is experimentally demonstrated. Comparison with simulated measurements integrating over the energy spectrum shows that there is no significant loss of image quality due to the use of polychromatic radiation. This means that, to a good approximation, the imaging system exploits radiation in the same way at all energies typically used in hard-X-ray imaging. PMID:26193618

  17. Optical fibre sensors based on multi-mode fibres and MIMO signal processing: an experimental approach

    Science.gov (United States)

    Ahrens, Andreas; Sandmann, Andre; Bremer, Kort; Roth, Bernhard; Lochmann, Steffen

    2015-09-01

    In this paper multiple-input multiple-output (MIMO) signal processing is investigated for fibre optic sensor applications. A (2 × 2) MIMO implementation is realized by using lower-order and higher-order mode groups of a graded-index (GI) multi-mode fibre (MMF) as separate transmission channels. A micro-bending pressure sensor changes these separate transmission characteristics and introduces additional crosstalk. By observing the weight-factors of the MIMO system the amount of load applied was determined. Experiments verified a good correlation between the change of the MIMO weight coefficients and the load applied to the sensor and thus verified that MIMO signal processing can beneficially be used for fibre optic sensor applications.

  18. Patient-specific port placement for laparoscopic surgery using atlas-based registration

    Science.gov (United States)

    Enquobahrie, Andinet; Shivaprabhu, Vikas; Aylward, Stephen; Finet, Julien; Cleary, Kevin; Alterovitz, Ron

    2013-03-01

    Laparoscopic surgery is a minimally invasive surgical approach, in which abdominal surgical procedures are performed through trocars via small incisions. Patients benefit by reduced postoperative pain, shortened hospital stays, improved cosmetic results, and faster recovery times. Optimal port placement can improve surgeon dexterity and avoid the need to move the trocars, which would cause unnecessary trauma to the patient. We are building an intuitive open source visualization system to help surgeons identify ports. Our methodology is based on an intuitive port placement visualization module and atlas-based registration algorithm to transfer port locations to individual patients. The methodology follows three steps:1) Use a port placement visualization module to manually place ports in an abdominal organ atlas. This step generates port-augmented abdominal atlas. This is done only once for a given patient population. 2) Register the atlas data with the patient CT data, to transfer the prescribed ports to the individual patient 3) Review and adjust the transferred port locations using the port placement visualization module. Tool maneuverability and target reachability can be tested using the visualization system. Our methodology would decrease the amount of physician input necessary to optimize port placement for each patient case. In a follow up work, we plan to use the transferred ports as starting point for further optimization of the port locations by formulating a cost function that will take into account factors such as tool dexterity and likelihood of collision between instruments.

  19. Image Registration Using Log Polar Transform and Fft Based Scale Invariant

    Directory of Open Access Journals (Sweden)

    Mr. Divyang Patel,

    2014-05-01

    Full Text Available Image registration is the fundamental task used to match two or more partially overlapping images taken, for example, at different times, from different sensors, or from different viewpoints and stitch these images into one panoramic image comprising the whole scene. It is a fundamental image processing technique and is very useful in integrating information from different sensors, finding changes in images taken at different times, inferring three-dimensional information from stereo images, and recognizing model-based objects. Some techniques are proposed to find a geometrical transformation that relates the points of an image to their corresponding points of another image. To register two images, the coordinate transformation between a pair of images must be found. In this paper, we have proposed an algorithm that is based on Log-Polar Transform and first we roughly estimate the angle, scale and translation between two images. The proposed algorithm can recover scale value up to 5.85. The robustness of this algorithm is verified on different images with similarity transformation and in the presence of noise.

  20. Neurofunctional maps of the 'maternal brain' and the effects of oxytocin: a multimodal voxel-based meta-analysis.

    Science.gov (United States)

    Rocchetti, Matteo; Radua, Joaquim; Paloyelis, Yannis; Xenaki, Lida-Alkisti; Frascarelli, Marianna; Caverzasi, Edgardo; Politi, Pierluigi; Fusar-Poli, Paolo

    2014-10-01

    Several studies have tried to understand the possible neurobiological basis of mothering. The putative involvement of oxytocin, in this regard, has been deeply investigated. Performing a voxel-based meta-analysis, we aimed at testing the hypothesis of overlapping brain activation in functional magnetic resonance imaging (fMRI) studies investigating the mother-infant interaction and the oxytocin modulation of emotional stimuli in humans. We performed two systematic literature searches: fMRI studies investigating the neurofunctional correlates of the 'maternal brain' by employing mother-infant paradigms; and fMRI studies employing oxytocin during emotional tasks. A unimodal voxel-based meta-analysis was performed on each database, whereas a multimodal voxel-based meta-analytical tool was adopted to assess the hypothesis that the neurofunctional effects of oxytocin are detected in brain areas implicated in the 'maternal brain.' We found greater activation in the bilateral insula extending to the inferior frontal gyrus, basal ganglia and thalamus during mother-infant interaction and greater left insular activation associated with oxytocin administration versus placebo. Left insula extending to basal ganglia and frontotemporal gyri as well as bilateral thalamus and amygdala showed consistent activation across the two paradigms. Right insula also showed activation across the two paradigms, and dorsomedial frontal cortex activation in mothers but deactivation with oxytocin. Significant activation in areas involved in empathy, emotion regulation, motivation, social cognition and theory of mind emerged from our multimodal meta-analysis, supporting the need for further studies directly investigating the neurobiology of oxytocin in the mother-infant relationship. PMID:24734987

  1. Mutual information image registration based on improved bee evolutionary genetic algorithm

    Science.gov (United States)

    Xu, Gang; Tu, Jingzhi

    2009-07-01

    In recent years, the mutual information is regarded as a more efficient similarity metrics in the image registration. According to the features of mutual information image registration, the Bee Evolution Genetic Algorithm (BEGA) is chosen for optimizing parameters, which imitates swarm mating. Besides, we try our best adaptively set the initial parameters to improve the BEGA. The programming result shows the wonderful precision of the algorithm.

  2. Ultra-compact and broadband tunable mid-infrared multimode interference splitter based on graphene plasmonic waveguide

    CERN Document Server

    Zheng, Ruiqi; Dong, Jianji

    2015-01-01

    We propose and design an ultra-compact and broadband tunable multimode interference (MMI) splitter in mid-infrared based on graphene plasmonic waveguides. The size of the device is only 0.56{\\mu}m*1.2{\\mu}m, which corresponds to device area of only about 0.014{\\lambda}^2, where {\\lambda} is the vacuum wavelength. And the center wavelength of the device can be tuned in a broad band from 7{\\mu}m to 9{\\mu}m with the Fermi level of graphene varied from 0.5eV to 1eV. Furthermore, the device is easy to be fabricated on chip.

  3. Securing Revocable Iris and Retinal Templates using Combined User and Soft Biometric based Password Hardened Multimodal Fuzzy Vault

    Directory of Open Access Journals (Sweden)

    V. S. Meenakshi

    2010-09-01

    Full Text Available Biometric systems are subjected to a variety of attacks. Stored biometric template attack is very severe compared to all other attacks. Providing security to biometric templates is an important issue in building a reliable personal identification system. Multi biometric systems are more resistive towards spoof attacks compared to unibiometric counterpart. Soft biometric are ancillary information about a person. This work provides security and revocability to iris and retinal templates using combined user and soft biometric based password hardened multimodal biometric fuzzy vault. Password hardening provides security and revocability to biometric templates. Eye biometrics namely iris and retina have certain merits compared to fingerprint. Iris and retina capturing cameras can be mounted on a single device to improve user convenience. Security of the vault is measured in terms of min-entropy.

  4. Radiation dose response simulation for biomechanical-based deformable image registration of head and neck cancer treatment

    International Nuclear Information System (INIS)

    Biomechanical-based deformable image registration is conducted on the head and neck region. Patient specific 3D finite element models consisting of parotid glands (PG), submandibular glands (SG), tumor, vertebrae (VB), mandible, and external body are used to register pre-treatment MRI to post-treatment MR images to model the dose response using image data of five patients. The images are registered using combinations of vertebrae and mandible alignments, and surface projection of the external body as boundary conditions. In addition, the dose response is simulated by applying a new loading technique in the form of a dose-induced shrinkage using the dose-volume relationship. The dose-induced load is applied as dose-induced shrinkage of the tumor and four salivary glands. The Dice Similarity Coefficient (DSC) is calculated for the four salivary glands, and tumor to calculate the volume overlap of the structures after deformable registration. A substantial improvement in the registration is found by including the dose-induced shrinkage. The greatest registration improvement is found in the four glands where the average DSC increases from 0.53, 0.55, 0.32, and 0.37 to 0.68, 0.68, 0.51, and 0.49 in the left PG, right PG, left SG, and right SG, respectively by using bony alignment of vertebrae and mandible (M), body (B) surface projection and dose (D) (VB+M+B+D). (paper)

  5. Validation of experts versus atlas-based and automatic registration methods for subthalamic nucleus targeting on MRI

    International Nuclear Information System (INIS)

    Objects: In functional stereotactic neurosurgery, one of the cornerstones upon which the success and the operating time depends is an accurate targeting. The subthalamic nucleus (STN) is the usual target involved when applying deep brain stimulation for Parkinson's disease (PD). Unfortunately, STN is usually not clearly visible in common medical imaging modalities, which justifies the use of atlas-based segmentation techniques to infer the STN location. Materials and methods: Eight bilaterally implanted PD patients were included in this study. A three-dimensional T1-weighted sequence and inversion recovery T2-weighted coronal slices were acquired pre-operatively. We propose a methodology for the construction of a ground truth of the STN location and a scheme that allows both, to perform a comparison between different non-rigid registration algorithms and to evaluate their usability to locate the STN automatically. Results: The intra-expert variability in identifying the STN location is 1.06±0.61 mm while the best non-rigid registration method gives an error of 1.80±0.62 mm. On the other hand, statistical tests show that an affine registration with only 12 degrees of freedom is not enough for this application. Conclusions: Using our validation-evaluation scheme, we demonstrate that automatic STN localization is possible and accurate with non-rigid registration algorithms. (orig.)

  6. Use of registration-based contour propagation in texture analysis for esophageal cancer pathologic response prediction

    Science.gov (United States)

    Yip, Stephen S. F.; Coroller, Thibaud P.; Sanford, Nina N.; Huynh, Elizabeth; Mamon, Harvey; Aerts, Hugo J. W. L.; Berbeco, Ross I.

    2016-01-01

    Change in PET-based textural features has shown promise in predicting cancer response to treatment. However, contouring tumour volumes on longitudinal scans is time-consuming. This study investigated the usefulness of contour propagation in texture analysis for the purpose of pathologic response prediction in esophageal cancer. Forty-five esophageal cancer patients underwent PET/CT scans before and after chemo-radiotherapy. Patients were classified into responders and non-responders after the surgery. Physician-defined tumour ROIs on pre-treatment PET were propagated onto the post-treatment PET using rigid and ten deformable registration algorithms. PET images were converted into 256 discrete values. Co-occurrence, run-length, and size zone matrix textures were computed within all ROIs. The relative difference of each texture at different treatment time-points was used to predict the pathologic responders. Their predictive value was assessed using the area under the receiver-operating-characteristic curve (AUC). Propagated ROIs from different algorithms were compared using Dice similarity index (DSI). Contours propagated by the fast-demons, fast-free-form and rigid algorithms did not fully capture the high FDG uptake regions of tumours. Fast-demons propagated ROIs had the least agreement with other contours (DSI  =  58%). Moderate to substantial overlap were found in the ROIs propagated by all other algorithms (DSI  =  69%-79%). Rigidly propagated ROIs with co-occurrence texture failed to significantly differentiate between responders and non-responders (AUC  =  0.58, q-value  =  0.33), while the differentiation was significant with other textures (AUC  =  0.71‒0.73, p  <  0.009). Among the deformable algorithms, fast-demons (AUC  =  0.68‒0.70, q-value  <  0.03) and fast-free-form (AUC  =  0.69‒0.74, q-value  <  0.04) were the least predictive. ROIs propagated by all other

  7. Validation of Shape Context Based Image Registration Method Using Digital Image Correlation Measurement on a Rat Stomach

    DEFF Research Database (Denmark)

    Liao, Donghua; Wang, P; Zhao, Jingbo;

    2014-01-01

    needs to be further verified by using a feature tracking measurement. Hence, the aim of this study was to verify the SC method-based calculation by using digital image correlation (DIC) measurement on a rat stomach. The rat stomach exposed to distension pressures 0.0, 0.2, 0.4, and 0.6 kPa were studied...... using both 3D DIC system and SC-based image registration calculation. Three different surface sample counts between the reference and the target surfaces were usedto gauge the effect of the surface sample counts on the calculation. Each pair of the surface points between the DIC measured target surface...... quantitative agreement on the surfaces with small dissimilarity and small sample count difference between the reference surface and the target surface. In conclusion, this is the first study to validate the 3D SC-based image registration method by using unique tracking features measurement. The developed...

  8. Feature-based registration of historical aerial images by Area Minimization

    Science.gov (United States)

    Nagarajan, Sudhagar; Schenk, Toni

    2016-06-01

    The registration of historical images plays a significant role in assessing changes in land topography over time. By comparing historical aerial images with recent data, geometric changes that have taken place over the years can be quantified. However, the lack of ground control information and precise camera parameters has limited scientists' ability to reliably incorporate historical images into change detection studies. Other limitations include the methods of determining identical points between recent and historical images, which has proven to be a cumbersome task due to continuous land cover changes. Our research demonstrates a method of registering historical images using Time Invariant Line (TIL) features. TIL features are different representations of the same line features in multi-temporal data without explicit point-to-point or straight line-to-straight line correspondence. We successfully determined the exterior orientation of historical images by minimizing the area formed between corresponding TIL features in recent and historical images. We then tested the feasibility of the approach with synthetic and real data and analyzed the results. Based on our analysis, this method shows promise for long-term 3D change detection studies.

  9. Positioning accuracy in a registration-free CT-based navigation system

    International Nuclear Information System (INIS)

    In order to maintain overall navigation accuracy established by a calibration procedure in our CT-based registration-free navigation system, the CT scanner has to repeatedly generate identical volume images of a target at the same coordinates. We tested the positioning accuracy of the prototype of an advanced workplace for image-guided surgery (AWIGS) which features an operating table capable of direct patient transfer into a CT scanner. Volume images (N = 154) of a specialized phantom were analysed for translational shifting after various table translations. Variables included added weight and phantom position on the table. The navigation system's calibration accuracy was determined (bias 2.1 mm, precision ± 0.7 mm, N = 12). In repeated use, a bias of 3.0 mm and a precision of ± 0.9 mm (N = 10) were maintainable. Instances of translational image shifting were related to the table-to-CT scanner docking mechanism. A distance scaling error when altering the table's height was detected. Initial prototype problems visible in our study causing systematic errors were resolved by repeated system calibrations between interventions. We conclude that the accuracy achieved is sufficient for a wide range of clinical applications in surgery and interventional radiology

  10. Free Form Deformation–Based Image Registration Improves Accuracy of Traction Force Microscopy

    Science.gov (United States)

    Jorge-Peñas, Alvaro; Izquierdo-Alvarez, Alicia; Aguilar-Cuenca, Rocio; Vicente-Manzanares, Miguel; Garcia-Aznar, José Manuel; Van Oosterwyck, Hans; de-Juan-Pardo, Elena M.; Ortiz-de-Solorzano, Carlos; Muñoz-Barrutia, Arrate

    2015-01-01

    Traction Force Microscopy (TFM) is a widespread method used to recover cellular tractions from the deformation that they cause in their surrounding substrate. Particle Image Velocimetry (PIV) is commonly used to quantify the substrate’s deformations, due to its simplicity and efficiency. However, PIV relies on a block-matching scheme that easily underestimates the deformations. This is especially relevant in the case of large, locally non-uniform deformations as those usually found in the vicinity of a cell’s adhesions to the substrate. To overcome these limitations, we formulate the calculation of the deformation of the substrate in TFM as a non-rigid image registration process that warps the image of the unstressed material to match the image of the stressed one. In particular, we propose to use a B-spline -based Free Form Deformation (FFD) algorithm that uses a connected deformable mesh to model a wide range of flexible deformations caused by cellular tractions. Our FFD approach is validated in 3D fields using synthetic (simulated) data as well as with experimental data obtained using isolated endothelial cells lying on a deformable, polyacrylamide substrate. Our results show that FFD outperforms PIV providing a deformation field that allows a better recovery of the magnitude and orientation of tractions. Together, these results demonstrate the added value of the FFD algorithm for improving the accuracy of traction recovery. PMID:26641883

  11. Off-Line Persian Signature Identification and Verification Based on Image Registration and Fusion

    Directory of Open Access Journals (Sweden)

    Samaneh Ghandali

    2009-06-01

    Full Text Available Signature verification and Identification has great importance for authentication purpose. Persian signatures are different from other signature types because people usually do not use text in it and they draw a shape as their signature, therefore, a different approach should be considered to process such signatures. In this paper, a method for off-line Persian signature identification and verification is proposed that is based on Image Registration, DWT (Discrete Wavelet Transform and Image Fusion. Training signatures of each person are registered to overcome shift and scale problem. To extract features, at first, DWT is used to access details of signature; then several registered instances of each person signatures are fused together to generate reference pattern of person's signatures. In the classification phase, Euclidean distance between the test image and each pattern is used in different sub-bands. Experimental results confirmed the effectiveness of the proposed method. However, the proposed method has been tested on Persian signature database but we believe it can be extended for other languages.

  12. Clinical significance of creative 3D-image fusion across multimodalities [PET + CT + MR] based on characteristic coregistration

    International Nuclear Information System (INIS)

    Objective: To investigate a registration approach for 2-dimension (2D) based on characteristic localization to achieve 3-dimension (3D) fusion from images of PET, CT and MR one by one. Method: A cubic oriented scheme of“9-point and 3-plane” for co-registration design was verified to be geometrically practical. After acquisiting DICOM data of PET/CT/MR (directed by radiotracer 18F-FDG etc.), through 3D reconstruction and virtual dissection, human internal feature points were sorted to combine with preselected external feature points for matching process. By following the procedure of feature extraction and image mapping, “picking points to form planes” and “picking planes for segmentation” were executed. Eventually, image fusion was implemented at real-time workstation mimics based on auto-fuse techniques so called “information exchange” and “signal overlay”. Result: The 2D and 3D images fused across modalities of [CT + MR], [PET + MR], [PET + CT] and [PET + CT + MR] were tested on data of patients suffered from tumors. Complementary 2D/3D images simultaneously presenting metabolic activities and anatomic structures were created with detectable-rate of 70%, 56%, 54% (or 98%) and 44% with no significant difference for each in statistics. Conclusion: Currently, based on the condition that there is no complete hybrid detector integrated of triple-module [PET + CT + MR] internationally, this sort of multiple modality fusion is doubtlessly an essential complement for the existing function of single modality imaging.

  13. Radiolabeled Nanoparticles for Multimodality Tumor Imaging

    OpenAIRE

    Xing, Yan; Zhao, Jinhua; Conti, Peter S.; Chen, Kai

    2014-01-01

    Each imaging modality has its own unique strengths. Multimodality imaging, taking advantages of strengths from two or more imaging modalities, can provide overall structural, functional, and molecular information, offering the prospect of improved diagnostic and therapeutic monitoring abilities. The devices of molecular imaging with multimodality and multifunction are of great value for cancer diagnosis and treatment, and greatly accelerate the development of radionuclide-based multimodal mol...

  14. Decoherence of multimode thermal squeezed coherent states

    Energy Technology Data Exchange (ETDEWEB)

    Yeh, L.

    1992-08-14

    It is well known that any multimode positive definite quadratic Hamiltonian can be transformed into a hamiltonian of uncoupled harmonic oscillators. Based on this theorem, the multimode thermal squeezed coherent states are constructed in terms of density operators. Decoherence of multimode thermal squeezed coherent states in investigated via the characteristic function and it is shown that the decohered (reduced) states are still thermal squeezed coherent states in general.

  15. Improved efficiency for MRI-SPET registration based on mutual information

    International Nuclear Information System (INIS)

    Mutual information has been proposed as a criterion for image registration. The criterion is calculated from a two-dimensional grey-scale histogram of the image pair being registered. In this paper we study how sparse sampling can be used to increase speed performance using the registration algorithm of Maes et al. (IEEE Trans Med Imaging 1997; 16: 187-198) with a focus on registration of MRI-SPET brain images. In particular we investigate how sparse sampling and parameters such as the number of bins used for the grey-scale histograms and smoothing of the data prior to registration affect accuracy and robustness of the registration. The method was validated using both simulated and human data. Our results show that sparse sampling introduced local maxima into the mutual information similarity function when the number of bins used for the histograms was large. To speed up registration while retaining robustness, smoothing of the data prior to registration was used and a coarse to fine subsampling protocol, where the number of bins in the histograms were dependent on the subsampling factor, was employed. For the simulated data, the method was able to recover known transformations with an accuracy of about 1 mm. Using the human data, there were no significant differences in the recovered transformation parameters when the suggested subsampling scheme was used compared with when no subsampling was used, but there was a more than tenfold increase in speed. Our results show that, with the appropriate choice of parameters, the method can accurately register MRI-SPET brain images even when very efficient sampling protocols are used. (orig.)

  16. Image-based dose planning of intracavitary brachytherapy: registration of serial-imaging studies using deformable anatomic templates

    International Nuclear Information System (INIS)

    cancer. These changes cannot be modeled by the conventional rigid landmark transformation method. In the current study, we found that the deformable anatomic template registration method, based on continuum-mechanics models of deformation, successfully described these large anatomic shape changes before and after ICT. These promising modeling results indicate that realistic registration of the cumulative dose distribution to the organs (or targets) of interest for radiation therapy of cervical cancers is achievable

  17. Registration of SPECT, PET and/or X-ray CT images in patients with lung cancer

    International Nuclear Information System (INIS)

    Aim: In order to evaluate the therapeutic gain of heavy ion therapy performed on patients with lung cancer, the regional pulmonary functions and the amount of radio tracer accumulation to the tumor, we are investigated by using the region of interest based on anatomical information obtained from X-ray CT. There are many registration techniques for brain images, but not so much for the other organ images that we have studied registration of chest SPECT, PET and/or X-ray CT images. Materials and Methods: Perfusion, ventilation and blood pool images with Tc99m labeled radiopharmaceuticals and SPECT, tumor images with 11C-methionine and PET and X-ray CT scans were performed on several patients with lung cancer before and after heavy ion therapy. The registrations of SPECT-CT, PET-CT and CT-CT were performed by using AMIR (Automatic Multimodality Image Registration), which was developed by Babak et al. for registration of brain images. In a case of SPECT-CT registration, each of the three functional images was registered to the X-ray CT image, and the accuracy of each registration was compared. In the studies of PET-CT registration, the transmission images and X-ray CT images were registered at first, because the 11C-methionine PET images bear little resemblance to the underlying anatomical images. Next, the emission images were realigned by using the same registration parameters. The X-ray CT images obtained from a single subject at the different time were registered to the first X-ray CT images, respectively. Results: In the SPECT-CT registration, the blood pool-CT registration is the best among three SPECT images in visual inspection by radiologists. In the PET-CT registration, the Transmission-CT registrations got good results. Therefore, Emission-CT registrations also got good results. In the CT-CT registration, the X-ray CT images obtained from a single subject at the different time were superimposed well each other except for lower lobe. As the results, it was

  18. PET and MR three-dimensional image registration based on second-order mutual information

    International Nuclear Information System (INIS)

    Aim: Mutual information has currently been one of the most intensively researched measures. Despite the general promising results, it sometimes might lead to mis-registration because of neglecting spatial information and treating intensity variations with undue sensitivity. In order to avoid mis- registration and improve the robustness of algorithm, an extension of mutual information framework was proposed in which spatial information regarding higher-order image structures was incorporated into the registration processing of PET and MR. Fusion software of higher-order mutual information algorithm was developed and applied to PET and MR images of seven patients. Visual inspection and accuracy evaluation were also performed. Materials and Methods: The raw data of seven patients were provided by Vanderbilt University. Second-order entropy and normalized second-order mutual information were applied as similarity measures which integrate spatial information and avoid most local optima. PET image was treated as reference image while MR image as float image. Second-order entropy was calculated with 2D histogram measuring the frequency of co-occurrence of intensities between neighboring voxel pairs in a single image. The joint probability and second-order mutual information was estimated with the 4D histogram of the intensity of neighboring voxels between images. In order to avoid the occurrence of sparse histogram and simplify the computation, 16 bins per dimension were chosen in this project to calculate 4D joint histogram and the neighborhood was defined by the six nearest neighbors of each voxel. Optimization strategy was Powell's method, combined with Brent's algorithm. The interpolation method was PV method. Evaluation was carried out in a blinded fashion by Vanderbilt. Results: The mean of errors was 3.54mm and SE of which was 0.34. The registration accuracy was sub-voxel. Visual inspection showed that the image registrations of all the seven patients were good and

  19. Image registration with uncertainty analysis

    Science.gov (United States)

    Simonson, Katherine M.

    2011-03-22

    In an image registration method, edges are detected in a first image and a second image. A percentage of edge pixels in a subset of the second image that are also edges in the first image shifted by a translation is calculated. A best registration point is calculated based on a maximum percentage of edges matched. In a predefined search region, all registration points other than the best registration point are identified that are not significantly worse than the best registration point according to a predetermined statistical criterion.

  20. Time-Dependent Properties of Multimodal Polyoxymethylene Based Binder for Powder Injection Molding

    Science.gov (United States)

    Gonzalez-Gutierrez, Joamin; Stringari, Gustavo Beulke; Zupancic, Barbara; Kubyshkina, Galina; Bernstorff, Bernd Von; Emri, Igor

    Powder injection molding (PIM) is one of the most versatile methods for the manufacturing of small complex shaped components from metal, ceramic or cemented carbide powders for the use in many applications. PIM consists of mixing the powder and a polymeric binder, injecting this mixture in a mold, debinding and then sintering. Catalytic debinding of polyoxymethylene (POM) is attractive since it shows high debinding rates and low risk of cracking. This work examines the possibility of using POM with bimodal molecular mass distribution as the main component of the binding agent by studying its time-dependent properties and comparing them to monomodal POM. Furthermore, possible optimization of the binder formulation was investigated by the addition of shorter polymeric chains (wax) to bimodal POM, as to create a multimodal material. It was observed that the magnitude of the complex viscosity for the commercial bimodal material was more than 2 times lower than for the chemically identical monomodal POM within the investigated frequency range and temperature. Viscosity values were observed to drop as the content of wax was increased, without compromising the binders mechanical properties in solid state. A new formulation of bimodal POM plus 8 wt.% of added wax provided the most appropriate results from investigated combinations. This work has shown how the addition of short polymeric chains in POM influences its time-dependent properties in solid and molten state, which can be an important tool for the optimization of binders designed to be used in PIM technology.

  1. Analysis of Predictive Values Based on Individual Risk Factors in Multi-Modality Trials

    Directory of Open Access Journals (Sweden)

    Katharina Lange

    2013-03-01

    Full Text Available The accuracy of diagnostic tests with binary end-points is most frequently measured by sensitivity and specificity. However, from the clinical perspective, the main purpose of a diagnostic agent is to assess the probability of a patient actually being diseased and hence predictive values are more suitable here. As predictive values depend on the pre-test probability of disease, we provide a method to take risk factors influencing the patient’s prior probability of disease into account, when calculating predictive values. Furthermore, approaches to assess confidence intervals and a methodology to compare predictive values by statistical tests are presented. Hereby the methods can be used to analyze predictive values of factorial diagnostic trials, such as multi-modality, multi-reader-trials. We further performed a simulation study assessing length and coverage probability for different types of confidence intervals, and we present the R-Package facROC that can be used to analyze predictive values in factorial diagnostic trials in particular. The methods are applied to a study evaluating CT-angiography as a noninvasive alternative to coronary angiography for diagnosing coronary artery disease. Hereby the patients’ symptoms are considered as risk factors influencing the respective predictive values.

  2. Multimodality Neurological Data Visualization With Multi-VOI-Based DTI Fiber Dynamic Integration.

    Science.gov (United States)

    Zhang, Qi; Alexander, Murray; Ryner, Lawrence

    2016-01-01

    Brain lesions are usually located adjacent to critical spinal structures, so it is a challenging task for neurosurgeons to precisely plan a surgical procedure without damaging healthy tissues and nerves. The advancement of medical imaging technologies produces a large amount of neurological data, which are capable of showing a wide variety of brain properties. Advanced algorithms of medical data computing and visualization are critically helpful in efficiently utilizing the acquired data for disease diagnosis and brain function and structure exploration, which is helpful for treatment planning. In this paper, we describe new algorithms and a software framework for multiple volume of interest specified diffusion tensor imaging (DTI) fiber dynamic visualization. The displayed results have been integrated with a volume rendering pipeline for multimodality neurological data exploration. A depth texture indexing algorithm is used to detect DTI fiber tracts in graphics process units (GPUs), which makes fibers to be displayed and interactively manipulated with brain data acquired from functional magnetic resonance imaging, T1- and T2-weighted anatomic imaging, and angiographic imaging. The developed software platform is built on an object-oriented structure, which is transparent and extensible. It provides a comprehensive human-computer interface for data exploration and information extraction. The GPU-accelerated high-performance computing kernels have been implemented to enable our software to dynamically visualize neurological data. The developed techniques will be useful in computer-aided neurological disease diagnosis, brain structure exploration, and general cognitive neuroscience. PMID:25376048

  3. A Context-Aware-Based Audio Guidance System for Blind People Using a Multimodal Profile Model

    Directory of Open Access Journals (Sweden)

    Qing Lin

    2014-10-01

    Full Text Available A wearable guidance system is designed to provide context-dependent guidance messages to blind people while they traverse local pathways. The system is composed of three parts: moving scene analysis, walking context estimation and audio message delivery. The combination of a downward-pointing laser scanner and a camera is used to solve the challenging problem of moving scene analysis. By integrating laser data profiles and image edge profiles, a multimodal profile model is constructed to estimate jointly the ground plane, object locations and object types, by using a Bayesian network. The outputs of the moving scene analysis are further employed to estimate the walking context, which is defined as a fuzzy safety level that is inferred through a fuzzy logic model. Depending on the estimated walking context, the audio messages that best suit the current context are delivered to the user in a flexible manner. The proposed system is tested under various local pathway scenes, and the results confirm its efficiency in assisting blind people to attain autonomous mobility.

  4. Evaluation of Interpolation Effects on Upsampling and Accuracy of Cost Functions-Based Optimized Automatic Image Registration

    OpenAIRE

    Kashou, Nasser H.; Amir Pasha Mahmoudzadeh

    2013-01-01

    Interpolation has become a default operation in image processing and medical imaging and is one of the important factors in the success of an intensity-based registration method. Interpolation is needed if the fractional unit of motion is not matched and located on the high resolution (HR) grid. The purpose of this work is to present a systematic evaluation of eight standard interpolation techniques (trilinear, nearest neighbor, cubic Lagrangian, quintic Lagrangian, hepatic Lagrangian, window...

  5. Studying primate carpal kinematics in three dimensions using a computed-tomography-based markerless registration method.

    Science.gov (United States)

    Orr, Caley M; Leventhal, Evan L; Chivers, Spencer F; Marzke, Mary W; Wolfe, Scott W; Crisco, Joseph J

    2010-04-01

    The functional morphology of the wrist pertains to a number of important questions in primate evolutionary biology, including that of hominins. Reconstructing locomotor and manipulative capabilities of the wrist in extinct species requires a detailed understanding of wrist biomechanics in extant primates and the relationship between carpal form and function. The kinematics of carpal movement, and the role individual joints play in providing mobility and stability of the wrist, is central to such efforts. However, there have been few detailed biomechanical studies of the nonhuman primate wrist. This is largely because of the complexity of wrist morphology and the considerable technical challenges involved in tracking the movements of the many small bones that compose the carpus. The purpose of this article is to introduce and outline a method adapted from human clinical studies of three-dimensional (3D) carpal kinematics for use in a comparative context. The method employs computed tomography of primate cadaver forelimbs in increments throughout the wrist's range of motion, coupled with markerless registration of 3D polygon models based on inertial properties of each bone. The 3D kinematic principles involved in extracting motion axis parameters that describe bone movement are reviewed. In addition, a set of anatomically based coordinate systems embedded in the radius, capitate, hamate, lunate, and scaphoid is presented for the benefit of other primate functional morphologists interested in studying carpal kinematics. Finally, a brief demonstration of how the application of these methods can elucidate the mechanics of the wrist in primates illustrates the closer-packing of carpals in chimpanzees than in orangutans, which may help to stabilize the midcarpus and produce a more rigid wrist beneficial for efficient hand posturing during knuckle-walking locomotion. PMID:20235325

  6. Hybrid Feature Point Based Registration of 2D Abdominal CT Images

    Directory of Open Access Journals (Sweden)

    Asmita A. Moghe

    2010-07-01

    Full Text Available Liver lesions like abscess, cirrhosis, metastases etc usually appear globular with gray levels differing remarkably from that of the surrounding liver region but the boundaries of these lesions are poorly defined and give an approximate picture of the extent of invasion of the lesion into surrounding regions. Choice of feature points and their matching in the images under consideration is crucial and image dependent. This leads to variations in registration methods. The objective of the proposed technique is to enhance registration for such abdominal CT images with the use of invariant points lying on the boundaries of lesions and the lesion centroids as the feature points. This paper uses a combination of hull points and centroids as feature points to register the images and compares results with those obtained by registration using only centroids as feature points. The outer margins of lesions become more sharply defined which helps in improving diagnostic accuracy.

  7. 3D ultrasound-CT registration of the liver using combined landmark-intensity information

    International Nuclear Information System (INIS)

    An important issue in computer-assisted surgery of the liver is a fast and reliable transfer of preoperative resection plans to the intraoperative situation. One problem is to match the planning data, derived from preoperative CT or MR images, with 3D ultrasound images of the liver, acquired during surgery. As the liver deforms significantly in the intraoperative situation non-rigid registration is necessary. This is a particularly challenging task because pre- and intraoperative image data stem from different modalities and ultrasound images are generally very noisy. One way to overcome these problems is to incorporate prior knowledge into the registration process. We propose a method of combining anatomical landmark information with a fast non-parametric intensity registration approach. Mathematically, this leads to a constrained optimization problem. As distance measure we use the normalized gradient field which allows for multimodal image registration. A qualitative and quantitative validation on clinical liver data sets of three different patients has been performed. We used the distance of dense corresponding points on vessel center lines for quantitative validation. The combined landmark and intensity approach improves the mean and percentage of point distances above 3 mm compared to rigid and thin-plate spline registration based only on landmarks. The proposed algorithm offers the possibility to incorporate additional a priori knowledge - in terms of few landmarks - provided by a human expert into a non-rigid registration process. (orig.)

  8. Image registration for CT and intra-operative ultrasound data of the liver

    Science.gov (United States)

    Papenberg, Nils; Lange, Thomas; Modersitzki, Jan; Schlag, Peter M.; Fischer, Bernd

    2008-03-01

    The paper is concerned with image registration algorithms for the alignment of computer tomography (CT) and 3D-ultrasound (US) images of the liver. The necessity of registration arises from the surgeon's request to benefit from the planning data during surgery. The goal is to align the planning data, derived from pre-operative CT-images, with the current US-images of the liver acquired during the surgery. The registration task is complicated by the fact, that the images are of a different modality, that the US-images are severely corrupted by noise, and that the surgeon is looking for a fast and robust scheme. To guide and support the registration, additional pairs of corresponding landmarks are prepared. We will present two different approaches for registration. The first one is based on the pure alignment of the landmarks using thin plate splines. It has been successfully applied in various applications and is now transmitted to liver surgery. In the second approach, we mix a volumetric distance measure with the landmark interpolation constraints. In particular, we investigate the promising normalized gradient field distance measure. We use data from actual liver surgery to illustrate the applicability and the characteristics of both approaches. It turns out that both approaches are suitable for the registration of multi-modal images of the liver.

  9. Quality assurance of CT-PET alignment and image registration for radiation treatment planning

    International Nuclear Information System (INIS)

    A multi-layer point source phantom was first used to calibrate and verify the CT-PET system alignment. A partial whole-body Aldcrson RANDO Man Phantom (head through mid-femur) was externally and internally marked with small metal cannulas filled with 18F-FDG and then scanned with both modalities. Six series of phantom studies with different acquisition settings and scan positions were performed to reveal possible system bias and evaluate the accuracy and reliabilities of Philips Syntegra program in image alignment, coregistration and fusion. The registration error was assessed quantitatively by measuring the root-mean-square distance between the iso-centers of corresponding fiducial marker geometries in reference CT volumes and transformed CT or PET volumes. Results: Experimental data confirms the accuracy of manual, parameter, point and image-based registration using Syntegra is better than 2 mm. Comparisons between blind and cross definition of iso-centers of fiducial marks indicate that the fused CT and PET is superior to visual correlation of CT and PET side-by-side. Conclusion: In this work we demonstrate the QA procedures of Gemini image alignment and registration. Syntegra produces intrinsic and robust multi-modality image registration and fusion with careful user interaction. The registration accuracy is generally better than the spatial resolution of the PET scanner used and this appears to be sufficient for most RTP CT-PET registration procedures

  10. SU-E-J-111: Finite Element-Based Deformable Image Registration of Pleural Cavity for Photodynamic Therapy

    Energy Technology Data Exchange (ETDEWEB)

    Penjweini, R; Zhu, T [Univ Pennsylvania, Philadelphia, PA (United States)

    2015-06-15

    Purpose: The pleural volumes will deform during surgery portion of the pleural photodynamic therapy (PDT) of lung cancer when the pleural cavity is opened. This impact the delivered dose when using highly conformal treatment techniques. In this study, a finite element-based (FEM) deformable image registration is used to quantify the anatomical variation between the contours for the pleural cavities obtained in the operating room and those determined from pre-surgery computed tomography (CT) scans. Methods: An infrared camera-based navigation system (NDI) is used during PDT to track the anatomical changes and contour the lung and chest cavity. A series of CTs of the lungs, in the same patient, are also acquired before the surgery. The structure contour of lung and the CTs are processed and contoured in Matlab and MeshLab. Then, the contours are imported into COMSOL Multiphysics 5.0, where the FEM-based deformable image registration is obtained using the deformed mesh - moving mesh (ALE) model. The NDI acquired lung contour is considered as the reference contour, and the CT contour is used as the target one, which will be deformed. Results: The reconstructed three-dimensional contours from both NDI and CT can be converted to COMSOL so that a three-dimensional ALE model can be developed. The contours can be registered using COMSOL ALE moving mesh model, which takes into account the deformation along x, y and z-axes. The deformed contour has good matches to the reference contour after the dynamic matching process. The resulting 3D deformation map can be used to obtain the locations of other critical anatomic structures, e.g., heart, during surgery. Conclusion: Deformable image registration can fuse images acquired by different modalities. It provides insights into the development of phenomenon and variation in normal anatomical structures over time. The initial assessments of three-dimensional registration show good agreement.

  11. SU-E-J-111: Finite Element-Based Deformable Image Registration of Pleural Cavity for Photodynamic Therapy

    International Nuclear Information System (INIS)

    Purpose: The pleural volumes will deform during surgery portion of the pleural photodynamic therapy (PDT) of lung cancer when the pleural cavity is opened. This impact the delivered dose when using highly conformal treatment techniques. In this study, a finite element-based (FEM) deformable image registration is used to quantify the anatomical variation between the contours for the pleural cavities obtained in the operating room and those determined from pre-surgery computed tomography (CT) scans. Methods: An infrared camera-based navigation system (NDI) is used during PDT to track the anatomical changes and contour the lung and chest cavity. A series of CTs of the lungs, in the same patient, are also acquired before the surgery. The structure contour of lung and the CTs are processed and contoured in Matlab and MeshLab. Then, the contours are imported into COMSOL Multiphysics 5.0, where the FEM-based deformable image registration is obtained using the deformed mesh - moving mesh (ALE) model. The NDI acquired lung contour is considered as the reference contour, and the CT contour is used as the target one, which will be deformed. Results: The reconstructed three-dimensional contours from both NDI and CT can be converted to COMSOL so that a three-dimensional ALE model can be developed. The contours can be registered using COMSOL ALE moving mesh model, which takes into account the deformation along x, y and z-axes. The deformed contour has good matches to the reference contour after the dynamic matching process. The resulting 3D deformation map can be used to obtain the locations of other critical anatomic structures, e.g., heart, during surgery. Conclusion: Deformable image registration can fuse images acquired by different modalities. It provides insights into the development of phenomenon and variation in normal anatomical structures over time. The initial assessments of three-dimensional registration show good agreement

  12. Development of an eye model from multimodal data

    Science.gov (United States)

    Yu, Chun P.; Jagannathan, Lakshmipathy; Srinivasan, Rajagopalan; Nowinski, Wieslaw L.

    1998-06-01

    We are building a 3D eye model from multimodal data and this paper describes our progress in using images from the Visible Human project and Scheimpflug images. The former is being targeted at muscles and the eyeball and the latter is being used to model the cornea. In this regard, the orbital anatomy of the Visible Human is being segmented and the relevant segmented data are then used to create geometric models. The lessons and methods we have learnt here will then be applied to MRI data when these become available. For Scheimpflug data, we are mutually registering individual images to reconstruct the cornea first, after which volumetric models can then be obtained. Our registration method is based on the fact that each image has a common point which can be used as a landmark. Future work includes registration of cornea and eyeball models, the incorporation of CT and biometric norms, as well as the identification of anatomical landmarks for deformation and registration.

  13. Easily processable multimodal spectral converters based on metal oxide/organic—inorganic hybrid nanocomposites

    Science.gov (United States)

    Julián-López, Beatriz; Gonell, Francisco; Lima, Patricia P.; Freitas, Vânia T.; André, Paulo S.; Carlos, Luis D.; Ferreira, Rute A. S.

    2015-10-01

    This manuscript reports the synthesis and characterization of the first organic-inorganic hybrid material exhibiting efficient multimodal spectral converting properties. The nanocomposite, made of Er3+, Yb3+ codoped zirconia nanoparticles (NPs) entrapped in a di-ureasil d-U(600) hybrid matrix, is prepared by an easy two-step sol-gel synthesis leading to homogeneous and transparent materials that can be very easily processed as monolith or film. Extensive structural characterization reveals that zirconia nanocrystals of 10-20 nm in size are efficiently dispersed into the hybrid matrix and that the local structure of the di-ureasil is not affected by the presence of the NPs. A significant enhancement in the refractive index of the di-ureasil matrix with the incorporation of the ZrO2 nanocrystals is observed. The optical study demonstrates that luminescent properties of both constituents are perfectly preserved in the final hybrid. Thus, the material displays a white-light photoluminescence from the di-ureasil component upon excitation at UV/visible radiation and also intense green and red emissions from the Er3+- and Yb3+-doped NPs after NIR excitation. The dynamics of the optical processes were also studied as a function of the lanthanide content and the thickness of the films. Our results indicate that these luminescent hybrids represent a low-cost, environmentally friendly, size-controlled, easily processed and chemically stable alternative material to be used in light harvesting devices such as luminescent solar concentrators, optical fibres and sensors. Furthermore, this synthetic approach can be extended to a wide variety of luminescent NPs entrapped in hybrid matrices, thus leading to multifunctional and versatile materials for efficient tuneable nonlinear optical nanodevices.

  14. Inter-slice bidirectional registration-based segmentation of the prostate gland in MR and CT image sequences

    International Nuclear Information System (INIS)

    Purpose: Accurate segmentation and volume estimation of the prostate gland in magnetic resonance (MR) and computed tomography (CT) images are necessary steps in diagnosis, treatment, and monitoring of prostate cancer. This paper presents an algorithm for the prostate gland volume estimation based on the semiautomated segmentation of individual slices in T2-weighted MR and CT image sequences. Methods: The proposedInter-Slice Bidirectional Registration-based Segmentation (iBRS) algorithm relies on interslice image registration of volume data to segment the prostate gland without the use of an anatomical atlas. It requires the user to mark only three slices in a given volume dataset, i.e., the first, middle, and last slices. Next, the proposed algorithm uses a registration algorithm to autosegment the remaining slices. We conducted comprehensive experiments to measure the performance of the proposed algorithm using three registration methods (i.e., rigid, affine, and nonrigid techniques). Results: The results with the proposed technique were compared with manual marking using prostate MR and CT images from 117 patients. Manual marking was performed by an expert user for all 117 patients. The median accuracies for individual slices measured using the Dice similarity coefficient (DSC) were 92% and 91% for MR and CT images, respectively. The iBRS algorithm was also evaluated regarding user variability, which confirmed that the algorithm was robust to interuser variability when marking the prostate gland. Conclusions: The proposed algorithm exploits the interslice data redundancy of the images in a volume dataset of MR and CT images and eliminates the need for an atlas, minimizing the computational cost while producing highly accurate results which are robust to interuser variability

  15. Automatic co-registration of space-based sensors for precision change detection and analysis

    Science.gov (United States)

    Bryant, N.; Zobrist, A.; Logan, T.

    2003-01-01

    A variety of techniques were developed at JPL to assure sub-pixel co-registration of scenes and ortho-rectification of satellite imagery to other georeferenced information to permit precise change detection and analysis of low and moderate resolution space sensors.

  16. Automatic registration between 3D intra-operative ultrasound and pre-operative CT images of the liver based on robust edge matching

    International Nuclear Information System (INIS)

    The registration of a three-dimensional (3D) ultrasound (US) image with a computed tomography (CT) or magnetic resonance image is beneficial in various clinical applications such as diagnosis and image-guided intervention of the liver. However, conventional methods usually require a time-consuming and inconvenient manual process for pre-alignment, and the success of this process strongly depends on the proper selection of initial transformation parameters. In this paper, we present an automatic feature-based affine registration procedure of 3D intra-operative US and pre-operative CT images of the liver. In the registration procedure, we first segment vessel lumens and the liver surface from a 3D B-mode US image. We then automatically estimate an initial registration transformation by using the proposed edge matching algorithm. The algorithm finds the most likely correspondences between the vessel centerlines of both images in a non-iterative manner based on a modified Viterbi algorithm. Finally, the registration is iteratively refined on the basis of the global affine transformation by jointly using the vessel and liver surface information. The proposed registration algorithm is validated on synthesized datasets and 20 clinical datasets, through both qualitative and quantitative evaluations. Experimental results show that automatic registration can be successfully achieved between 3D B-mode US and CT images even with a large initial misalignment.

  17. Registration of knee joint surfaces for the in vivo study of joint injuries based on magnetic resonance imaging

    Science.gov (United States)

    Cheng, Rita W. T.; Habib, Ayman F.; Frayne, Richard; Ronsky, Janet L.

    2006-03-01

    In-vivo quantitative assessments of joint conditions and health status can help to increase understanding of the pathology of osteoarthritis, a degenerative joint disease that affects a large population each year. Magnetic resonance imaging (MRI) provides a non-invasive and accurate means to assess and monitor joint properties, and has become widely used for diagnosis and biomechanics studies. Quantitative analyses and comparisons of MR datasets require accurate alignment of anatomical structures, thus image registration becomes a necessary procedure for these applications. This research focuses on developing a registration technique for MR knee joint surfaces to allow quantitative study of joint injuries and health status. It introduces a novel idea of translating techniques originally developed for geographic data in the field of photogrammetry and remote sensing to register 3D MR data. The proposed algorithm works with surfaces that are represented by randomly distributed points with no requirement of known correspondences. The algorithm performs matching locally by identifying corresponding surface elements, and solves for the transformation parameters relating the surfaces by minimizing normal distances between them. This technique was used in three applications to: 1) register temporal MR data to verify the feasibility of the algorithm to help monitor diseases, 2) quantify patellar movement with respect to the femur based on the transformation parameters, and 3) quantify changes in contact area locations between the patellar and femoral cartilage at different knee flexion angles. The results indicate accurate registration and the proposed algorithm can be applied for in-vivo study of joint injuries with MRI.

  18. Shadow-Based Hierarchical Matching for the Automatic Registration of Airborne LiDAR Data and Space Imagery

    Directory of Open Access Journals (Sweden)

    Alireza Safdarinezhad

    2016-06-01

    Full Text Available The automatic registration of LiDAR data and optical images, which are heterogeneous data sources, has been a major research challenge in recent years. In this paper, a novel hierarchical method is proposed in which the least amount of interaction of a skilled operator is required. Thereby, two shadow extraction schemes, one from LiDAR and the other from high-resolution satellite images, were used, and the obtained 2D shadow maps were then considered as prospective matching entities. Taken as the base, the reconstructed LiDAR shadows were transformed to image shadows using a four-step hierarchical method starting from a coarse 2D registration model and leading to a fine 3D registration model. In the first step, a general matching was performed in the frequency domain that yielded a rough 2D similarity model that related the LiDAR and image shadow masks. This model was further improved by modeling and compensating for the local geometric distortions that existed between the two heterogeneous data sources. In the third step, shadow masks, which were organized as segmented matched patches, were the subjects of a coinciding procedure that resulted in a coarse 3D registration model. In the last hierarchical step, that model was ultimately reinforced via a precise matching between the LiDAR and image edges. The evaluation results, which were conducted on six datasets and from different relative and absolute aspects, demonstrated the efficiency of the proposed method, which had a very promising accuracy on the order of one pixel.

  19. An Entropy-Based Upper Bound Methodology for Robust Predictive Multi-Mode RCPSP Schedules

    Directory of Open Access Journals (Sweden)

    Angela Hsiang-Ling Chen

    2014-09-01

    Full Text Available Projects are an important part of our activities and regardless of their magnitude, scheduling is at the very core of every project. In an ideal world makespan minimization, which is the most commonly sought objective, would give us an advantage. However, every time we execute a project we have to deal with uncertainty; part of it coming from known sources and part remaining unknown until it affects us. For this reason, it is much more practical to focus on making our schedules robust, capable of handling uncertainty, and even to determine a range in which the project could be completed. In this paper we focus on an approach to determine such a range for the Multi-mode Resource Constrained Project Scheduling Problem (MRCPSP, a widely researched, NP-complete problem, but without adding any subjective considerations to its estimation. We do this by using a concept well known in the domain of thermodynamics, entropy and a three-stage approach. First we use Artificial Bee Colony (ABC—an effective and powerful meta-heuristic—to determine a schedule with minimized makespan which serves as a lower bound. The second stage defines buffer times and creates an upper bound makespan using an entropy function, with the advantage over other methods that it only considers elements which are inherent to the schedule itself and does not introduce any subjectivity to the buffer time generation. In the last stage, we use the ABC algorithm with an objective function that seeks to maximize robustness while staying within the makespan boundaries defined previously and in some cases even below the lower boundary. We evaluate our approach with two different benchmarks sets: when using the PSPLIB for the MRCPSP benchmark set, the computational results indicate that it is possible to generate robust schedules which generally result in an increase of less than 10% of the best known solutions while increasing the robustness in at least 20% for practically every

  20. Co-Registration of Terrestrial and Uav-Based Images - Experimental Results

    Science.gov (United States)

    Gerke, M.; Nex, F.; Jende, P.

    2016-03-01

    For many applications within urban environments the combined use of images taken from the ground and from unmanned aerial platforms seems interesting: while from the airborne perspective the upper parts of objects including roofs can be observed, the ground images can complement the data from lateral views to retrieve a complete visualisation or 3D reconstruction of interesting areas. The automatic co-registration of air- and ground-based images is still a challenge and cannot be considered solved. The main obstacle is originating from the fact that objects are photographed from quite different angles, and hence state-of-the-art tie point measurement approaches cannot cope with the induced perspective transformation. One first important step towards a solution is to use airborne images taken under slant directions. Those oblique views not only help to connect vertical images and horizontal views but also provide image information from 3D-structures not visible from the other two directions. According to our experience, however, still a good planning and many images taken under different viewing angles are needed to support an automatic matching across all images and complete bundle block adjustment. Nevertheless, the entire process is still quite sensible - the removal of a single image might lead to a completely different or wrong solution, or separation of image blocks. In this paper we analyse the impact different parameters and strategies have on the solution. Those are a) the used tie point matcher, b) the used software for bundle adjustment. Using the data provided in the context of the ISPRS benchmark on multi-platform photogrammetry, we systematically address the mentioned influences. Concerning the tie-point matching we test the standard SIFT point extractor and descriptor, but also the SURF and ASIFT-approaches, the ORB technique, as well as (A)KAZE, which are based on a nonlinear scale space. In terms of pre-processing we analyse the Wallis

  1. SU-E-J-237: Image Feature Based DRR and Portal Image Registration

    Energy Technology Data Exchange (ETDEWEB)

    Wang, X; Chang, J [NY Weill Cornell Medical Ctr, NY (United States)

    2014-06-01

    Purpose: Two-dimensional (2D) matching of the kV X-ray and digitally reconstructed radiography (DRR) images is an important setup technique for image-guided radiotherapy (IGRT). In our clinics, mutual information based methods are used for this purpose on commercial linear accelerators, but with often needs for manual corrections. This work proved the feasibility that feature based image transform can be used to register kV and DRR images. Methods: The scale invariant feature transform (SIFT) method was implemented to detect the matching image details (or key points) between the kV and DRR images. These key points represent high image intensity gradients, and thus the scale invariant features. Due to the poor image contrast from our kV image, direct application of the SIFT method yielded many detection errors. To assist the finding of key points, the center coordinates of the kV and DRR images were read from the DICOM header, and the two groups of key points with similar relative positions to their corresponding centers were paired up. Using these points, a rigid transform (with scaling, horizontal and vertical shifts) was estimated. We also artificially introduced vertical and horizontal shifts to test the accuracy of our registration method on anterior-posterior (AP) and lateral pelvic images. Results: The results provided a satisfactory overlay of the transformed kV onto the DRR image. The introduced vs. detected shifts were fit into a linear regression. In the AP image experiments, linear regression analysis showed a slope of 1.15 and 0.98 with an R2 of 0.89 and 0.99 for the horizontal and vertical shifts, respectively. The results are 1.2 and 1.3 with R2 of 0.72 and 0.82 for the lateral image shifts. Conclusion: This work provided an alternative technique for kV to DRR alignment. Further improvements in the estimation accuracy and image contrast tolerance are underway.

  2. SMS fiber structure with a multimode fiber graded index type for a temperature measurement using an intensity-based interrogation system

    Science.gov (United States)

    Mufarrikha, Ainun; Hatta, Agus M.; Koentjoro, Sekartedjo

    2015-01-01

    Temperature sensing based on a singlemode-multimode-singlemode (SMS) fiber structure with a graded index multimode fiber (GI-MMF) type using an intensity-based interrogation has been investigated numerically and experimentally. The effect of temperature on the SMS fiber structure with the MMF-GI type was modeled using a modal propagation analysis (MPA). The SMS fiber structures for temperature sensor was fabricated and tested with the MMF length of 57 mm. It is demonstrated experimentally, and supported with numerical results, that the sensor showed a sensitivity of 0.063 dB/°C with a temperature measurement range of 175-325°C. This sensor offers simple configuration and low cost of fabrication for the temperature measurement applications.

  3. Pulmonary nodule registration in serial CT scans based on rib anatomy and nodule template matching

    International Nuclear Information System (INIS)

    An automated method is being developed in order to identify corresponding nodules in serial thoracic CT scans for interval change analysis. The method uses the rib centerlines as the reference for initial nodule registration. A spatially adaptive rib segmentation method first locates the regions where the ribs join the spine, which define the starting locations for rib tracking. Each rib is tracked and locally segmented by expectation-maximization. The ribs are automatically labeled, and the centerlines are estimated using skeletonization. For a given nodule in the source scan, the closest three ribs are identified. A three-dimensional (3D) rigid affine transformation guided by simplex optimization aligns the centerlines of each of the three rib pairs in the source and target CT volumes. Automatically defined control points along the centerlines of the three ribs in the source scan and the registered ribs in the target scan are used to guide an initial registration using a second 3D rigid affine transformation. A search volume of interest (VOI) is then located in the target scan. Nodule candidate locations within the search VOI are identified as regions with high Hessian responses. The initial registration is refined by searching for the maximum cross-correlation between the nodule template from the source scan and the candidate locations. The method was evaluated on 48 CT scans from 20 patients. Experienced radiologists identified 101 pairs of corresponding nodules. Three metrics were used for performance evaluation. The first metric was the Euclidean distance between the nodule centers identified by the radiologist and the computer registration, the second metric was a volume overlap measure between the nodule VOIs identified by the radiologist and the computer registration, and the third metric was the hit rate, which measures the fraction of nodules whose centroid computed by the computer registration in the target scan falls within the VOI identified by the

  4. Demons deformable registration of CT and cone-beam CT using an iterative intensity matching approach

    International Nuclear Information System (INIS)

    with rigid registration. Conclusions: A method was developed to iteratively correct CT-CBCT intensity disparity during Demons registration, enabling fast, intensity-based registration in CBCT-guided procedures such as surgery and radiotherapy, in which CBCT voxel values may be inaccurate. Accurate CT-CBCT registration in turn facilitates registration of multimodality preoperative image and planning data to intraoperative CBCT by way of the preoperative CT, thereby linking the intraoperative frame of reference to a wealth of preoperative information that could improve interventional guidance.

  5. A neural network-based 2D/3D image registration quality evaluator for pediatric patient setup in external beam radiotherapy.

    Science.gov (United States)

    Wu, Jian; Su, Zhong; Li, Zuofeng

    2016-01-01

    Our purpose was to develop a neural network-based registration quality evaluator (RQE) that can improve the 2D/3D image registration robustness for pediatric patient setup in external beam radiotherapy. Orthogonal daily setup X-ray images of six pediatric patients with brain tumors receiving proton therapy treatments were retrospectively registered with their treatment planning computed tomography (CT) images. A neural network-based pattern classifier was used to determine whether a registration solution was successful based on geometric features of the similarity measure values near the point-of-solution. Supervised training and test datasets were generated by rigidly registering a pair of orthogonal daily setup X-ray images to the treatment planning CT. The best solution for each registration task was selected from 50 optimizing attempts that differed only by the randomly generated initial transformation parameters. The distance from each individual solution to the best solution in the normalized parametrical space was compared to a user-defined error tolerance to determine whether that solution was acceptable. A supervised training was then used to train the RQE. Performance of the RQE was evaluated using test dataset consisting of registration results that were not used in training. The RQE was integrated with our in-house 2D/3D registration system and its performance was evaluated using the same patient dataset. With an optimized sampling step size (i.e., 5 mm) in the feature space, the RQE has the sensitivity and the speci-ficity in the ranges of 0.865-0.964 and 0.797-0.990, respectively, when used to detect registration error with mean voxel displacement (MVD) greater than 1 mm. The trial-to-acceptance ratio of the integrated 2D/3D registration system, for all patients, is equal to 1.48. The final acceptance ratio is 92.4%. The proposed RQE can potentially be used in a 2D/3D rigid image registration system to improve the overall robustness by rejecting

  6. Curve-based 2D-3D registration of coronary vessels for image guided procedure

    Science.gov (United States)

    Duong, Luc; Liao, Rui; Sundar, Hari; Tailhades, Benoit; Meyer, Andreas; Xu, Chenyang

    2009-02-01

    3D roadmap provided by pre-operative volumetric data that is aligned with fluoroscopy helps visualization and navigation in Interventional Cardiology (IC), especially when contrast agent-injection used to highlight coronary vessels cannot be systematically used during the whole procedure, or when there is low visibility in fluoroscopy for partially or totally occluded vessels. The main contribution of this work is to register pre-operative volumetric data with intraoperative fluoroscopy for specific vessel(s) occurring during the procedure, even without contrast agent injection, to provide a useful 3D roadmap. In addition, this study incorporates automatic ECG gating for cardiac motion. Respiratory motion is identified by rigid body registration of the vessels. The coronary vessels are first segmented from a multislice computed tomography (MSCT) volume and correspondent vessel segments are identified on a single gated 2D fluoroscopic frame. Registration can be explicitly constrained using one or multiple branches of a contrast-enhanced vessel tree or the outline of guide wire used to navigate during the procedure. Finally, the alignment problem is solved by Iterative Closest Point (ICP) algorithm. To be computationally efficient, a distance transform is computed from the 2D identification of each vessel such that distance is zero on the centerline of the vessel and increases away from the centerline. Quantitative results were obtained by comparing the registration of random poses and a ground truth alignment for 5 datasets. We conclude that the proposed method is promising for accurate 2D-3D registration, even for difficult cases of occluded vessel without injection of contrast agent.

  7. SU-E-J-263: Dosimetric Analysis On Breast Brachytherapy Based On Deformable Image Registration

    International Nuclear Information System (INIS)

    Purpose: To quantitatively compare and evaluate the dosimetry difference between breast brachytherapy protocols with different fractionation using deformable image registration. Methods: The accumulative dose distribution for multiple breast brachytherapy patients using four different applicators: Contura, Mammosite, Savi, and interstitial catheters, under two treatment protocols: 340cGy by 10 fractions in 5 days and 825cGy by 3 fractions in 2days has been reconstructed using a two stage deformable image registration approach. For all patients, daily CT was acquired with the same slice thickness (2.5mm). In the first stage, the daily CT images were rigidly registered to the initial planning CT using the registration module in Eclipse (Varian) to align the applicators. In the second stage, the tissues surrounding the applicator in the rigidly registered daily CT image were non-rigidly registered to the initial CT using a combination of image force and the local constraint that enforce zero normal motion on the surface of the applicator, using a software developed in house. We calculated the dose distribution in the daily CTs and deformed them using the final registration to convert into the image domain of the initial planning CT. The accumulative dose distributions were evaluated by dosimetry parameters including D90, V150 and V200, as well as DVH. Results: Dose reconstruction results showed that the two day treatment has a significant dosimetry improvement over the five day protocols. An average daily drop of D90 at 1.3% of the prescription dose has been observed on multiple brachytherapy patients. There is no significant difference on V150 and V200 between those two protocols. Conclusion: Brachytherapy with higher fractional dose and less fractions has an improved performance on being conformal to the dose distribution in the initial plan. Elongated brachytherapy treatments need to consider the dose uncertainty caused by the temporal changes of the soft tissue

  8. Organ dose calculation in CT based on scout image data and automatic image registration

    Energy Technology Data Exchange (ETDEWEB)

    Kortesniemi, Mika; Salli, Eero; Seuri, Raija [HUS Helsinki Medical Imaging Center, Univ. of Helsinki, Helsinki (Finland)], E-mail: mika.kortesniemi@hus.fi

    2012-10-15

    Background Computed tomography (CT) has become the main contributor of the cumulative radiation exposure in radiology. Information on cumulative exposure history of the patient should be available for efficient management of radiation exposures and for radiological justification. Purpose To develop and evaluate automatic image registration for organ dose calculation in CT. Material and Methods Planning radiograph (scout) image data describing CT scan ranges from 15 thoracic CT examinations (9 men and 6 women) and 10 abdominal CT examinations (6 men and 4 women) were co-registered with the reference trunk CT scout image. 2-D affine transformation and normalized correlation metric was used for image registration. Longitudinal (z-axis) scan range coordinates on the reference scout image were converted into slice locations on the CT-Expo anthropomorphic male and female models, following organ and effective dose calculations. Results The average deviation of z-location of studied patient images from the corresponding location in the reference scout image was 6.2 mm. The ranges of organ and effective doses with constant exposure parameters were from 0 to 28.0 mGy and from 7.3 to 14.5 mSv, respectively. The mean deviation of the doses for fully irradiated organs (inside the scan range), partially irradiated organs and non-irradiated organs (outside the scan range) was 1%, 5%, and 22%, respectively, due to image registration. Conclusion The automated image processing method to registrate individual chest and abdominal CT scout radiograph with the reference scout radiograph is feasible. It can be used to determine the individual scan range coordinates in z-direction to calculate the organ dose values. The presented method could be utilized in automatic organ dose calculation in CT for radiation exposure tracking of the patients.

  9. Feature-based pairwise retinal image registration by radial distortion correction

    Science.gov (United States)

    Lee, Sangyeol; Abràmoff, Michael D.; Reinhardt, Joseph M.

    2007-03-01

    Fundus camera imaging is widely used to document disorders such as diabetic retinopathy and macular degeneration. Multiple retinal images can be combined together through a procedure known as mosaicing to form an image with a larger field of view. Mosaicing typically requires multiple pairwise registrations of partially overlapped images. We describe a new method for pairwise retinal image registration. The proposed method is unique in that the radial distortion due to image acquisition is corrected prior to the geometric transformation. Vessel lines are detected using the Hessian operator and are used as input features to the registration. Since the overlapping region is typically small in a retinal image pair, only a few correspondences are available, thus limiting the applicable model to an afine transform at best. To recover the distortion due to curved-surface of retina and lens optics, a combined approach of an afine model with a radial distortion correction is proposed. The parameters of the image acquisition and radial distortion models are estimated during an optimization step that uses Powell's method driven by the vessel line distance. Experimental results using 20 pairs of green channel images acquired from three subjects with a fundus camera confirmed that the afine model with distortion correction could register retinal image pairs to within 1.88+/-0.35 pixels accuracy (mean +/- standard deviation) assessed by vessel line error, which is 17% better than the afine-only approach. Because the proposed method needs only two correspondences, it can be applied to obtain good registration accuracy even in the case of small overlap between retinal image pairs.

  10. Organ dose calculation in CT based on scout image data and automatic image registration

    International Nuclear Information System (INIS)

    Background Computed tomography (CT) has become the main contributor of the cumulative radiation exposure in radiology. Information on cumulative exposure history of the patient should be available for efficient management of radiation exposures and for radiological justification. Purpose To develop and evaluate automatic image registration for organ dose calculation in CT. Material and Methods Planning radiograph (scout) image data describing CT scan ranges from 15 thoracic CT examinations (9 men and 6 women) and 10 abdominal CT examinations (6 men and 4 women) were co-registered with the reference trunk CT scout image. 2-D affine transformation and normalized correlation metric was used for image registration. Longitudinal (z-axis) scan range coordinates on the reference scout image were converted into slice locations on the CT-Expo anthropomorphic male and female models, following organ and effective dose calculations. Results The average deviation of z-location of studied patient images from the corresponding location in the reference scout image was 6.2 mm. The ranges of organ and effective doses with constant exposure parameters were from 0 to 28.0 mGy and from 7.3 to 14.5 mSv, respectively. The mean deviation of the doses for fully irradiated organs (inside the scan range), partially irradiated organs and non-irradiated organs (outside the scan range) was 1%, 5%, and 22%, respectively, due to image registration. Conclusion The automated image processing method to registrate individual chest and abdominal CT scout radiograph with the reference scout radiograph is feasible. It can be used to determine the individual scan range coordinates in z-direction to calculate the organ dose values. The presented method could be utilized in automatic organ dose calculation in CT for radiation exposure tracking of the patients

  11. Automatic Descriptor-Based Co-Registration of Frame Hyperspectral Data

    OpenAIRE

    Maria Vakalopoulou; Konstantinos Karantzalos

    2014-01-01

    Frame hyperspectral sensors, in contrast to push-broom or line-scanning ones, produce hyperspectral datasets with, in general, better geometry but with unregistered spectral bands. Being acquired at different instances and due to platform motion and movements (UAVs, aircrafts, etc.), every spectral band is displaced and acquired with a different geometry. The automatic and accurate registration of hyperspectral datasets from frame sensors remains a challenge. Powerful local feature descriptor...

  12. Automatic Descriptor-Based Co-Registration of Frame Hyperspectral Data

    Directory of Open Access Journals (Sweden)

    Maria Vakalopoulou

    2014-04-01

    Full Text Available Frame hyperspectral sensors, in contrast to push-broom or line-scanning ones, produce hyperspectral datasets with, in general, better geometry but with unregistered spectral bands. Being acquired at different instances and due to platform motion and movements (UAVs, aircrafts, etc., every spectral band is displaced and acquired with a different geometry. The automatic and accurate registration of hyperspectral datasets from frame sensors remains a challenge. Powerful local feature descriptors when computed over the spectrum fail to extract enough correspondences and successfully complete the registration procedure. To this end, we propose a generic and automated framework which decomposes the problem and enables the efficient computation of a sufficient amount of accurate correspondences over the given spectrum, without using any ancillary data (e.g., from GPS/IMU. First, the spectral bands are divided in spectral groups according to their wavelength. The spectral borders of each group are not strict and their formulation allows certain overlaps. The spectral variance and proximity determine the applicability of every spectral band to act as a reference during the registration procedure. The proposed decomposition allows the descriptor and the robust estimation process to deliver numerous inliers. The search space of possible solutions has been effectively narrowed by sorting and selecting the optimal spectral bands which under an unsupervised manner can quickly recover hypercube’s geometry. The developed approach has been qualitatively and quantitatively evaluated with six different datasets obtained by frame sensors onboard aerial platforms and UAVs. Experimental results appear promising.

  13. Contrast-Based 3D/2D Registration of the Left Atrium: Fast versus Consistent.

    Science.gov (United States)

    Hoffmann, Matthias; Kowalewski, Christopher; Maier, Andreas; Kurzidim, Klaus; Strobel, Norbert; Hornegger, Joachim

    2016-01-01

    For augmented fluoroscopy during cardiac ablation, a preoperatively acquired 3D model of a patient's left atrium (LA) can be registered to X-ray images recorded during a contrast agent (CA) injection. An automatic registration method that works also for small amounts of CA is desired. We propose two similarity measures: The first focuses on edges of the patient anatomy. The second computes a contrast agent distribution estimate (CADE) inside the 3D model and rates its consistency with the CA as seen in biplane fluoroscopic images. Moreover, temporal filtering on the obtained registration results of a sequence is applied using a Markov chain framework. Evaluation was performed on 11 well-contrasted clinical angiographic sequences and 10 additional sequences with less CA. For well-contrasted sequences, the error for all 73 frames was 7.9 ± 6.3 mm and it dropped to 4.6 ± 4.0 mm when registering to an automatically selected, well enhanced frame in each sequence. Temporal filtering reduced the error for all frames from 7.9 ± 6.3 mm to 5.7 ± 4.6 mm. The error was typically higher if less CA was used. A combination of both similarity measures outperforms a previously proposed similarity measure. The mean accuracy for well contrasted sequences is in the range of other proposed manual registration methods. PMID:27051412

  14. An efficient nano-based theranostic system for multi-modal imaging-guided photothermal sterilization in gastrointestinal tract.

    Science.gov (United States)

    Liu, Zhen; Liu, Jianhua; Wang, Rui; Du, Yingda; Ren, Jinsong; Qu, Xiaogang

    2015-07-01

    Since understanding the healthy status of gastrointestinal tract (GI tract) is of vital importance, clinical implementation for GI tract-related disease have attracted much more attention along with the rapid development of modern medicine. Here, a multifunctional theranostic system combining X-rays/CT/photothermal/photoacoustic mapping of GI tract and imaging-guided photothermal anti-bacterial treatment is designed and constructed. PEGylated W18O49 nanosheets (PEG-W18O49) are created via a facile solvothermal method and an in situ probe-sonication approach. In terms of excellent colloidal stability, low cytotoxicity, and neglectable hemolysis of PEG-W18O49, we demonstrate the first example of high-performance four-modal imaging of GI tract by using these nanosheets as contrast agents. More importantly, due to their intrinsic absorption of NIR light, glutaraldehyde-modified PEG-W18O49 are successfully applied as fault-free targeted photothermal agents for imaging-guided killing of bacteria on a mouse infection model. Critical to pre-clinical and clinical prospects, long-term toxicity is further investigated after oral administration of these theranostic agents. These kinds of tungsten-based nanomaterials exhibit great potential as multi-modal contrast agents for directed visualization of GI tract and anti-bacterial agents for phothothermal sterilization. PMID:25934293

  15. Label-free multimodal protease detection based on protein/perylene dye coassembly and enzyme-triggered disassembly.

    Science.gov (United States)

    Lin, Yiyang; Chapman, Robert; Stevens, Molly M

    2014-07-01

    The development of novel assays for protease sensing plays an important role in clinical diagnostics and therapeutics. Herein, we report a supramolecular platform for label-free protease detection, based on protein/dye self-assembly and enzyme-triggered disassembly. In a typical case, coassembly of protamine sulfate and perylene dye via electrostatic attractions and π-π interactions caused significant colorimetric and fluorescent responses. Subsequent addition of trypsin was found to cleave the amide bonds of protein, triggering the dissociation of protein/dye aggregates and the release of perylene dyes. The enzyme-triggered disassembly was transduced into multiple readouts including absorption, fluorescence, and polarization, which were exploited for trypsin detection and inhibitor testing. This assay was also used for turn-on fluorescence detection of cathepsin B, an enzyme known to be overexpressed in mammalian cancer cells. The integration of supramolecular self-assembly into enzyme detection in this work has provided a novel label-free biosensing platform which is highly sensitive with multimodal readouts. The relative simplicity of the approach avoids the need for time-consuming substrate synthesis, and is also amenable to naked eye detection. PMID:24914622

  16. Maternal mortality in rural south Ethiopia: outcomes of community-based birth registration by health extension workers.

    Directory of Open Access Journals (Sweden)

    Yaliso Yaya

    Full Text Available Rural communities in low-income countries lack vital registrations to track birth outcomes. We aimed to examine the feasibility of community-based birth registration and measure maternal mortality ratio (MMR in rural south Ethiopia.In 2010, health extension workers (HEWs registered births and maternal deaths among 421,639 people in three districts (Derashe, Bonke, and Arba Minch Zuria. One nurse-supervisor per district provided administrative and technical support to HEWs. The primary outcomes were the feasibility of registration of a high proportion of births and measuring MMR. The secondary outcome was the proportion of skilled birth attendance. We validated the completeness of the registry and the MMR by conducting a house-to-house survey in 15 randomly selected villages in Bonke.We registered 10,987 births (81·4% of expected 13,492 births with annual crude birth rate of 32 per 1,000 population. The validation study showed that, of 2,401 births occurred in the surveyed households within eight months of the initiation of the registry, 71·6% (1,718 were registered with similar MMRs (474 vs. 439 between the registered and unregistered births. Overall, we recorded 53 maternal deaths; MMR was 489 per 100,000 live births and 83% (44 of 53 maternal deaths occurred at home. Ninety percent (9,863 births were at home, 4% (430 at health posts, 2·5% (282 at health centres, and 3·5% (412 in hospitals. MMR increased if: the male partners were illiterate (609 vs. 346; p= 0·051 and the villages had no road access (946 vs. 410; p= 0·039. The validation helped to increase the registration coverage by 10% through feedback discussions.It is possible to obtain a high-coverage birth registration and measure MMR in rural communities where a functional system of community health workers exists. The MMR was high in rural south Ethiopia and most births and maternal deaths occurred at home.

  17. Simplified Multimodal Biometric Identification

    Directory of Open Access Journals (Sweden)

    Abhijit Shete

    2014-03-01

    Full Text Available Multibiometric systems are expected to be more reliable than unimodal biometric systems for personal identification due to the presence of multiple, fairly independent pieces of evidence e.g. Unique Identification Project "Aadhaar" of Government of India. In this paper, we present a novel wavelet based technique to perform fusion at the feature level and score level by considering two biometric modalities, face and fingerprint. The results indicate that the proposed technique can lead to substantial improvement in multimodal matching performance. The proposed technique is simple because of no preprocessing of raw biometric traits as well as no feature and score normalization.

  18. A frequency-based approach to locate common structure for 2D-3D intensity-based registration of setup images in prostate radiotherapy

    International Nuclear Information System (INIS)

    In many radiotherapy clinics, geometric uncertainties in the delivery of 3D conformal radiation therapy and intensity modulated radiation therapy of the prostate are reduced by aligning the patient's bony anatomy in the planning 3D CT to corresponding bony anatomy in 2D portal images acquired before every treatment fraction. In this paper, we seek to determine if there is a frequency band within the portal images and the digitally reconstructed radiographs (DRRs) of the planning CT in which bony anatomy predominates over non-bony anatomy such that portal images and DRRs can be suitably filtered to achieve high registration accuracy in an automated 2D-3D single portal intensity-based registration framework. Two similarity measures, mutual information and the Pearson correlation coefficient were tested on carefully collected gold-standard data consisting of a kilovoltage cone-beam CT (CBCT) and megavoltage portal images in the anterior-posterior (AP) view of an anthropomorphic phantom acquired under clinical conditions at known poses, and on patient data. It was found that filtering the portal images and DRRs during the registration considerably improved registration performance. Without filtering, the registration did not always converge while with filtering it always converged to an accurate solution. For the pose-determination experiments conducted on the anthropomorphic phantom with the correlation coefficient, the mean (and standard deviation) of the absolute errors in recovering each of the six transformation parameters were θx:0.18(0.19) deg., θy:0.04(0.04) deg., θz:0.04(0.02) deg., tx:0.14(0.15) mm, ty:0.09(0.05) mm, and tz:0.49(0.40) mm. The mutual information-based registration with filtered images also resulted in similarly small errors. For the patient data, visual inspection of the superimposed registered images showed that they were correctly aligned in all instances. The results presented in this paper suggest that robust and accurate registration

  19. Image registration

    CERN Document Server

    Goshtasby, A Ardeshir

    2012-01-01

    This book presents a thorough and detailed guide to image registration, outlining the principles and reviewing state-of-the-art tools and methods. The book begins by identifying the components of a general image registration system, and then describes the design of each component using various image analysis tools. The text reviews a vast array of tools and methods, not only describing the principles behind each tool and method, but also measuring and comparing their performances using synthetic and real data. Features: discusses similarity/dissimilarity measures, point detectors, feature extr

  20. A Multi-Modal Digital Game-Based Learning Environment for Hospitalized Children with Chronic Illnesses.

    Science.gov (United States)

    Chin, Jui-Chih; Tsuei, Mengping

    2014-01-01

    The aim of this study was to explore the digital game-based learning for children with chronic illnesses in the hospital settings. The design-based research and qualitative methods were applied. Three eight-year-old children with leukemia participated in this study. In the first phase, the multi-user game-based learning system was developed and…

  1. SU-E-J-132: Automated Segmentation with Post-Registration Atlas Selection Based On Mutual Information

    Energy Technology Data Exchange (ETDEWEB)

    Ren, X; Gao, H [Shanghai Jiao Tong University, Shanghai, Shanghai (China); Sharp, G [Massachusetts General Hospital, Boston, MA (United States)

    2015-06-15

    Purpose: The delineation of targets and organs-at-risk is a critical step during image-guided radiation therapy, for which manual contouring is the gold standard. However, it is often time-consuming and may suffer from intra- and inter-rater variability. The purpose of this work is to investigate the automated segmentation. Methods: The automatic segmentation here is based on mutual information (MI), with the atlas from Public Domain Database for Computational Anatomy (PDDCA) with manually drawn contours.Using dice coefficient (DC) as the quantitative measure of segmentation accuracy, we perform leave-one-out cross-validations for all PDDCA images sequentially, during which other images are registered to each chosen image and DC is computed between registered contour and ground truth. Meanwhile, six strategies, including MI, are selected to measure the image similarity, with MI to be the best. Then given a target image to be segmented and an atlas, automatic segmentation consists of: (a) the affine registration step for image positioning; (b) the active demons registration method to register the atlas to the target image; (c) the computation of MI values between the deformed atlas and the target image; (d) the weighted image fusion of three deformed atlas images with highest MI values to form the segmented contour. Results: MI was found to be the best among six studied strategies in the sense that it had the highest positive correlation between similarity measure (e.g., MI values) and DC. For automated segmentation, the weighted image fusion of three deformed atlas images with highest MI values provided the highest DC among four proposed strategies. Conclusion: MI has the highest correlation with DC, and therefore is an appropriate choice for post-registration atlas selection in atlas-based segmentation. Xuhua Ren and Hao Gao were partially supported by the NSFC (#11405105), the 973 Program (#2015CB856000) and the Shanghai Pujiang Talent Program (#14PJ1404500)

  2. SU-E-J-132: Automated Segmentation with Post-Registration Atlas Selection Based On Mutual Information

    International Nuclear Information System (INIS)

    Purpose: The delineation of targets and organs-at-risk is a critical step during image-guided radiation therapy, for which manual contouring is the gold standard. However, it is often time-consuming and may suffer from intra- and inter-rater variability. The purpose of this work is to investigate the automated segmentation. Methods: The automatic segmentation here is based on mutual information (MI), with the atlas from Public Domain Database for Computational Anatomy (PDDCA) with manually drawn contours.Using dice coefficient (DC) as the quantitative measure of segmentation accuracy, we perform leave-one-out cross-validations for all PDDCA images sequentially, during which other images are registered to each chosen image and DC is computed between registered contour and ground truth. Meanwhile, six strategies, including MI, are selected to measure the image similarity, with MI to be the best. Then given a target image to be segmented and an atlas, automatic segmentation consists of: (a) the affine registration step for image positioning; (b) the active demons registration method to register the atlas to the target image; (c) the computation of MI values between the deformed atlas and the target image; (d) the weighted image fusion of three deformed atlas images with highest MI values to form the segmented contour. Results: MI was found to be the best among six studied strategies in the sense that it had the highest positive correlation between similarity measure (e.g., MI values) and DC. For automated segmentation, the weighted image fusion of three deformed atlas images with highest MI values provided the highest DC among four proposed strategies. Conclusion: MI has the highest correlation with DC, and therefore is an appropriate choice for post-registration atlas selection in atlas-based segmentation. Xuhua Ren and Hao Gao were partially supported by the NSFC (#11405105), the 973 Program (#2015CB856000) and the Shanghai Pujiang Talent Program (#14PJ1404500)

  3. A semi-automated 2D/3D marker-based registration algorithm modelling prostate shrinkage during radiotherapy for prostate cancer

    International Nuclear Information System (INIS)

    Background and purpose: Currently, most available patient alignment tools based on implanted markers use manual marker matching and rigid registration transformations to measure the needed translational shifts. To quantify the particular effect of prostate gland shrinkage, implanted gold markers were tracked during a course of radiotherapy including an isotropic scaling factor to model prostate shrinkage. Materials and methods: Eight patients with prostate cancer had gold markers implanted transrectally and seven were treated with (neo) adjuvant androgen deprivation therapy. After patient alignment to skin tattoos, orthogonal electronic portal images (EPIs) were taken. A semi-automated 2D/3D marker-based registration was performed to calculate the necessary couch shifts. The registration consists of a rigid transformation combined with an isotropic scaling to model prostate shrinkage. Results: The inclusion of an isotropic shrinkage model in the registration algorithm cancelled the corresponding increase in registration error. The mean scaling factor was 0.89 ± 0.09. For all but two patients, a decrease of the isotropic scaling factor during treatment was observed. However, there was almost no difference in the translation offset between the manual matching of the EPIs to the digitally reconstructed radiographs and the semi-automated 2D/3D registration. A decrease in the intermarker distance was found correlating with prostate shrinkage rather than with random marker migration. Conclusions: Inclusion of shrinkage in the registration process reduces registration errors during a course of radiotherapy. Nevertheless, this did not lead to a clinically significant change in the proposed table translations when compared to translations obtained with manual marker matching without a scaling correction

  4. Estimation of lung motion fields in 4D CT data by variational non-linear intensity-based registration: A comparison and evaluation study

    International Nuclear Information System (INIS)

    Accurate and robust estimation of motion fields in respiration-correlated CT (4D CT) images, usually performed by non-linear registration of the temporal CT frames, is a precondition for the analysis of patient-specific breathing dynamics and subsequent image-supported diagnostics and treatment planning. In this work, we present a comprehensive comparison and evaluation study of non-linear registration variants applied to the task of lung motion estimation in thoracic 4D CT data. In contrast to existing multi-institutional comparison studies (e.g. MIDRAS and EMPIRE10), we focus on the specific but common class of variational intensity-based non-parametric registration and analyze the impact of the different main building blocks of the underlying optimization problem: the distance measure to be minimized, the regularization approach and the transformation space considered during optimization. In total, 90 different combinations of building block instances are compared. Evaluated on proprietary and publicly accessible 4D CT images, landmark-based registration errors (TRE) between 1.14 and 1.20 mm for the most accurate registration variants demonstrate competitive performance of the applied general registration framework compared to other state-of-the-art approaches for lung CT registration. Although some specific trends can be observed, effects of interchanging individual instances of the building blocks on the TRE are in general rather small (no single outstanding registration variant existing); the same level of accuracy is, however, associated with significantly different degrees of motion field smoothness and computational demands. Consequently, the building block combination of choice will depend on application-specific requirements on motion field characteristics. (paper)

  5. Bi-Objective Modelling for Hazardous Materials Road–Rail Multimodal Routing Problem with Railway Schedule-Based Space–Time Constraints

    Science.gov (United States)

    Sun, Yan; Lang, Maoxiang; Wang, Danzhu

    2016-01-01

    The transportation of hazardous materials is always accompanied by considerable risk that will impact public and environment security. As an efficient and reliable transportation organization, a multimodal service should participate in the transportation of hazardous materials. In this study, we focus on transporting hazardous materials through the multimodal service network and explore the hazardous materials multimodal routing problem from the operational level of network planning. To formulate this problem more practicably, minimizing the total generalized costs of transporting the hazardous materials and the social risk along the planned routes are set as the optimization objectives. Meanwhile, the following formulation characteristics will be comprehensively modelled: (1) specific customer demands; (2) multiple hazardous material flows; (3) capacitated schedule-based rail service and uncapacitated time-flexible road service; and (4) environmental risk constraint. A bi-objective mixed integer nonlinear programming model is first built to formulate the routing problem that combines the formulation characteristics above. Then linear reformations are developed to linearize and improve the initial model so that it can be effectively solved by exact solution algorithms on standard mathematical programming software. By utilizing the normalized weighted sum method, we can generate the Pareto solutions to the bi-objective optimization problem for a specific case. Finally, a large-scale empirical case study from the Beijing–Tianjin–Hebei Region in China is presented to demonstrate the feasibility of the proposed methods in dealing with the practical problem. Various scenarios are also discussed in the case study. PMID:27483294

  6. Bi-Objective Modelling for Hazardous Materials Road-Rail Multimodal Routing Problem with Railway Schedule-Based Space-Time Constraints.

    Science.gov (United States)

    Sun, Yan; Lang, Maoxiang; Wang, Danzhu

    2016-01-01

    The transportation of hazardous materials is always accompanied by considerable risk that will impact public and environment security. As an efficient and reliable transportation organization, a multimodal service should participate in the transportation of hazardous materials. In this study, we focus on transporting hazardous materials through the multimodal service network and explore the hazardous materials multimodal routing problem from the operational level of network planning. To formulate this problem more practicably, minimizing the total generalized costs of transporting the hazardous materials and the social risk along the planned routes are set as the optimization objectives. Meanwhile, the following formulation characteristics will be comprehensively modelled: (1) specific customer demands; (2) multiple hazardous material flows; (3) capacitated schedule-based rail service and uncapacitated time-flexible road service; and (4) environmental risk constraint. A bi-objective mixed integer nonlinear programming model is first built to formulate the routing problem that combines the formulation characteristics above. Then linear reformations are developed to linearize and improve the initial model so that it can be effectively solved by exact solution algorithms on standard mathematical programming software. By utilizing the normalized weighted sum method, we can generate the Pareto solutions to the bi-objective optimization problem for a specific case. Finally, a large-scale empirical case study from the Beijing-Tianjin-Hebei Region in China is presented to demonstrate the feasibility of the proposed methods in dealing with the practical problem. Various scenarios are also discussed in the case study. PMID:27483294

  7. Prostate CT segmentation method based on nonrigid registration in ultrasound-guided CT-based HDR prostate brachytherapy

    Energy Technology Data Exchange (ETDEWEB)

    Yang, Xiaofeng, E-mail: xyang43@emory.edu; Rossi, Peter; Ogunleye, Tomi; Marcus, David M.; Jani, Ashesh B.; Curran, Walter J.; Liu, Tian [Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, Georgia 30322 (United States); Mao, Hui [Department of Radiology and Imaging Sciences, Emory University, Atlanta, Georgia 30322 (United States)

    2014-11-01

    Purpose: The technological advances in real-time ultrasound image guidance for high-dose-rate (HDR) prostate brachytherapy have placed this treatment modality at the forefront of innovation in cancer radiotherapy. Prostate HDR treatment often involves placing the HDR catheters (needles) into the prostate gland under the transrectal ultrasound (TRUS) guidance, then generating a radiation treatment plan based on CT prostate images, and subsequently delivering high dose of radiation through these catheters. The main challenge for this HDR procedure is to accurately segment the prostate volume in the CT images for the radiation treatment planning. In this study, the authors propose a novel approach that integrates the prostate volume from 3D TRUS images into the treatment planning CT images to provide an accurate prostate delineation for prostate HDR treatment. Methods: The authors’ approach requires acquisition of 3D TRUS prostate images in the operating room right after the HDR catheters are inserted, which takes 1–3 min. These TRUS images are used to create prostate contours. The HDR catheters are reconstructed from the intraoperative TRUS and postoperative CT images, and subsequently used as landmarks for the TRUS–CT image fusion. After TRUS–CT fusion, the TRUS-based prostate volume is deformed to the CT images for treatment planning. This method was first validated with a prostate-phantom study. In addition, a pilot study of ten patients undergoing HDR prostate brachytherapy was conducted to test its clinical feasibility. The accuracy of their approach was assessed through the locations of three implanted fiducial (gold) markers, as well as T2-weighted MR prostate images of patients. Results: For the phantom study, the target registration error (TRE) of gold-markers was 0.41 ± 0.11 mm. For the ten patients, the TRE of gold markers was 1.18 ± 0.26 mm; the prostate volume difference between the authors’ approach and the MRI-based volume was 7.28% ± 0

  8. SU-C-18A-02: Image-Based Camera Tracking: Towards Registration of Endoscopic Video to CT

    International Nuclear Information System (INIS)

    Purpose: Endoscopic examinations are routinely performed on head and neck and esophageal cancer patients. However, these images are underutilized for radiation therapy because there is currently no way to register them to a CT of the patient. The purpose of this work is to develop a method to track the motion of an endoscope within a structure using images from standard clinical equipment. This method will be incorporated into a broader endoscopy/CT registration framework. Methods: We developed a software algorithm to track the motion of an endoscope within an arbitrary structure. We computed frame-to-frame rotation and translation of the camera by tracking surface points across the video sequence and utilizing two-camera epipolar geometry. The resulting 3D camera path was used to recover the surrounding structure via triangulation methods. We tested this algorithm on a rigid cylindrical phantom with a pattern spray-painted on the inside. We did not constrain the motion of the endoscope while recording, and we did not constrain our measurements using the known structure of the phantom. Results: Our software algorithm can successfully track the general motion of the endoscope as it moves through the phantom. However, our preliminary data do not show a high degree of accuracy in the triangulation of 3D point locations. More rigorous data will be presented at the annual meeting. Conclusion: Image-based camera tracking is a promising method for endoscopy/CT image registration, and it requires only standard clinical equipment. It is one of two major components needed to achieve endoscopy/CT registration, the second of which is tying the camera path to absolute patient geometry. In addition to this second component, future work will focus on validating our camera tracking algorithm in the presence of clinical imaging features such as patient motion, erratic camera motion, and dynamic scene illumination

  9. Integrating HMM-Based Speech Recognition With Direct Manipulation In A Multimodal Korean Natural Language Interface

    CERN Document Server

    Lee, G; Kim, S; Lee, Geunbae; Lee, Jong-Hyeok; Kim, Sangeok

    1996-01-01

    This paper presents a HMM-based speech recognition engine and its integration into direct manipulation interfaces for Korean document editor. Speech recognition can reduce typical tedious and repetitive actions which are inevitable in standard GUIs (graphic user interfaces). Our system consists of general speech recognition engine called ABrain {Auditory Brain} and speech commandable document editor called SHE {Simple Hearing Editor}. ABrain is a phoneme-based speech recognition engine which shows up to 97% of discrete command recognition rate. SHE is a EuroBridge widget-based document editor that supports speech commands as well as direct manipulation interfaces.

  10. 3D Assessment of Mandibular Growth Based on Image Registration: A Feasibility Study in a Rabbit Model

    Directory of Open Access Journals (Sweden)

    I. Kim

    2014-01-01

    Full Text Available Background. Our knowledge of mandibular growth mostly derives from cephalometric radiography, which has inherent limitations due to the two-dimensional (2D nature of measurement. Objective. To assess 3D morphological changes occurring during growth in a rabbit mandible. Methods. Serial cone-beam computerised tomographic (CBCT images were made of two New Zealand white rabbits, at baseline and eight weeks after surgical implantation of 1 mm diameter metallic spheres as fiducial markers. A third animal acted as an unoperated (no implant control. CBCT images were segmented and registered in 3D (Implant Superimposition and Procrustes Method, and the remodelling pattern described used color maps. Registration accuracy was quantified by the maximal of the mean minimum distances and by the Hausdorff distance. Results. The mean error for image registration was 0.37 mm and never exceeded 1 mm. The implant-based superimposition showed most remodelling occurred at the mandibular ramus, with bone apposition posteriorly and vertical growth at the condyle. Conclusion. We propose a method to quantitatively describe bone remodelling in three dimensions, based on the use of bone implants as fiducial markers and CBCT as imaging modality. The method is feasible and represents a promising approach for experimental studies by comparing baseline growth patterns and testing the effects of growth-modification treatments.

  11. Lesion registration for longitudinal disease tracking in an imaging informatics-based multiple sclerosis eFolder

    Science.gov (United States)

    Ma, Kevin; Liu, Joseph; Zhang, Xuejun; Lerner, Alex; Shiroishi, Mark; Amezcua, Lilyana; Liu, Brent

    2016-03-01

    We have designed and developed a multiple sclerosis eFolder system for patient data storage, image viewing, and automatic lesion quantification results stored in DICOM-SR format. The web-based system aims to be integrated in DICOM-compliant clinical and research environments to aid clinicians in patient treatments and data analysis. The system needs to quantify lesion volumes, identify and register lesion locations to track shifts in volume and quantity of lesions in a longitudinal study. In order to perform lesion registration, we have developed a brain warping and normalizing methodology using Statistical Parametric Mapping (SPM) MATLAB toolkit for brain MRI. Patients' brain MR images are processed via SPM's normalization processes, and the brain images are analyzed and warped according to the tissue probability map. Lesion identification and contouring are completed by neuroradiologists, and lesion volume quantification is completed by the eFolder's CAD program. Lesion comparison results in longitudinal studies show key growth and active regions. The results display successful lesion registration and tracking over a longitudinal study. Lesion change results are graphically represented in the web-based user interface, and users are able to correlate patient progress and changes in the MRI images. The completed lesion and disease tracking tool would enable the eFolder to provide complete patient profiles, improve the efficiency of patient care, and perform comprehensive data analysis through an integrated imaging informatics system.

  12. A multimodal (MRI/ultrasound) cardiac phantom for imaging experiments

    Science.gov (United States)

    Tavakoli, Vahid; Kendrick, Michael; Shakeri, Mostafa; Alshaher, Motaz; Stoddard, Marcus F.; Amini, Amir

    2013-03-01

    A dynamic cardiac phantom can play a significant role in the evaluation and development of ultrasound and cardiac magnetic resonance (MR) motion tracking and registration methods. A four chamber multimodal cardiac phantom has been designed and built to simulate normal and pathologic hearts with different degrees of "infarction" and "scar tissues". In this set up, cardiac valves have been designed and modeled as well. The four-chamber structure can simulate the asymmetric ventricular, atrial and valve motions. Poly Vinyl Alcohol (PVA) is used as the principal material since it can simulate the shape, elasticity, and MR and ultrasound properties of the heart. The cardiac shape is simulated using a four-chamber mold made of polymer clay. An additional pathologic heart phantom containing stiff inclusions has been manufactured in order to simulate an infracted heart. The stiff inclusions are of different shapes and different degrees of elasticity and are able to simulate abnormal cardiac segments. The cardiac elasticity is adjusted based on freeze-thaw cycles of the PVA cryogel for normal and scarred regions. Ultrasound and MRI markers were inserted in the cardiac phantom as landmarks for validations. To the best of our knowledge, this is the first multimodal phantom that models a dynamic four-chamber human heart including the cardiac valve.

  13. Image registration in intra-oral radiography

    OpenAIRE

    Leung, CC; Yiu, KL; Zee, KY; Tsui, WK

    2005-01-01

    Image registration is one of the image processing methods which is widely used in computer vision, pattern recognition, and medical imaging. In digital subtraction radiography, image registration is one of the important prerequisites to match the reference and subsequent images. In this paper, we propose an automatic non-rigid registration method namely curvature-based registration that relies on a curvature based penalizing term and its application on dental radiography. The regularizing ter...

  14. Tibial cortical lesions: A multimodality pictorial review

    Energy Technology Data Exchange (ETDEWEB)

    Tyler, P.A., E-mail: philippa.tyler@rnoh.nhs.uk [Department of Radiology, Royal National Orthopaedic Hospital, Brockley Hill, Stanmore HA7 4LP (United Kingdom); Mohaghegh, P., E-mail: pegah1000@gmail.com [Department of Radiology, Royal National Orthopaedic Hospital, Brockley Hill, Stanmore HA7 4LP (United Kingdom); Foley, J., E-mail: jfoley1@nhs.net [Department of Radiology, Glasgow Royal Infirmary, 16 Alexandra Parade, Glasgow G31 2ES (United Kingdom); Isaac, A., E-mail: amandaisaac@doctors.org.uk [Department of Radiology, King' s College Hospital, Denmark Hill, London SE5 9RS (United Kingdom); Zavareh, A., E-mail: ali.zavareh@gmail.com [Department of Radiology, North Bristol NHS Trust, Frenchay, Bristol BS16 1LE (United Kingdom); Thorning, C., E-mail: cthorning@doctors.org.uk [Department of Radiology, East Surrey Hospital, Canada Avenue, Redhill, Surrey RH1 5RH (United Kingdom); Kirwadi, A., E-mail: anandkirwadi@gmail.com [Department of Radiology, Manchester Royal Infirmary, Oxford Road, Manchester M13 9WL (United Kingdom); Pressney, I., E-mail: ipressney@hotmail.com [Department of Radiology, Royal National Orthopaedic Hospital, Brockley Hill, Stanmore HA7 4LP (United Kingdom); Amary, F., E-mail: fernanda.amary@rnoh.nhs.uk [Department of Histopathology, Royal National Orthopaedic Hospital, Brockley Hill, Stanmore HA7 4LP (United Kingdom); Rajeswaran, G., E-mail: grajeswaran@gmail.com [Department of Radiology, Chelsea and Westminster Hospital, 369 Fulham Road, London SW10 9NH (United Kingdom)

    2015-01-15

    Highlights: • Multimodality imaging plays an important role in the investigation and diagnosis of shin pain. • We review the multimodality imaging findings of common cortically based tibial lesions. • We also describe the rarer pathologies of tibial cortical lesions. - Abstract: Shin pain is a common complaint, particularly in young and active patients, with a wide range of potential diagnoses and resulting implications. We review the natural history and multimodality imaging findings of the more common causes of cortically-based tibial lesions, as well as the rarer pathologies less frequently encountered in a general radiology department.

  15. Tibial cortical lesions: A multimodality pictorial review

    International Nuclear Information System (INIS)

    Highlights: • Multimodality imaging plays an important role in the investigation and diagnosis of shin pain. • We review the multimodality imaging findings of common cortically based tibial lesions. • We also describe the rarer pathologies of tibial cortical lesions. - Abstract: Shin pain is a common complaint, particularly in young and active patients, with a wide range of potential diagnoses and resulting implications. We review the natural history and multimodality imaging findings of the more common causes of cortically-based tibial lesions, as well as the rarer pathologies less frequently encountered in a general radiology department

  16. OptoCeramic-Based High Speed Fiber Multiplexer for Multimode Fiber Project

    Data.gov (United States)

    National Aeronautics and Space Administration — A fiber-based fixed-array laser transmitter can be combined with a fiber-arrayed detector to create the next-generation NASA array LIDAR systems. High speed optical...

  17. Rationale for a multimodality strategy to enhance the efficacy of dendritic cell-based cancer immunotherapy

    OpenAIRE

    Jashodeep eDatta; Erik eBerk; Jessica A Cintolo; Shuwen eXu; Roses, Robert E; Czerniecki, Brian J.

    2015-01-01

    Dendritic cells (DC), master antigen-presenting cells that orchestrate interactions between the adaptive and innate immune arms, are increasingly utilized in cancer immunotherapy. Despite remarkable progress in our understanding of DC immunobiology, as well as several encouraging clinical applications — such as DC-based sipuleucel-T for metastatic castration-resistant prostate cancer — clinically effective DC-based immunotherapy as monotherapy for a majority of tumors remains a distant goal. ...

  18. Rationale for a Multimodality Strategy to Enhance the Efficacy of Dendritic Cell-Based Cancer Immunotherapy

    OpenAIRE

    Datta, Jashodeep; Berk, Erik; Jessica A Cintolo; Xu, Shuwen; Roses, Robert E; Czerniecki, Brian J.

    2015-01-01

    Dendritic cells (DC), master antigen-presenting cells that orchestrate interactions between the adaptive and innate immune arms, are increasingly utilized in cancer immunotherapy. Despite remarkable progress in our understanding of DC immunobiology, as well as several encouraging clinical applications – such as DC-based sipuleucel-T for metastatic castration-resistant prostate cancer – clinically effective DC-based immunotherapy as monotherapy for a majority of tumors remains a distant goal. ...

  19. Hopc: a Novel Similarity Metric Based on Geometric Structural Properties for Multi-Modal Remote Sensing Image Matching

    Science.gov (United States)

    Ye, Yuanxin; Shen, Li

    2016-06-01

    Automatic matching of multi-modal remote sensing images (e.g., optical, LiDAR, SAR and maps) remains a challenging task in remote sensing image analysis due to significant non-linear radiometric differences between these images. This paper addresses this problem and proposes a novel similarity metric for multi-modal matching using geometric structural properties of images. We first extend the phase congruency model with illumination and contrast invariance, and then use the extended model to build a dense descriptor called the Histogram of Orientated Phase Congruency (HOPC) that captures geometric structure or shape features of images. Finally, HOPC is integrated as the similarity metric to detect tie-points between images by designing a fast template matching scheme. This novel metric aims to represent geometric structural similarities between multi-modal remote sensing datasets and is robust against significant non-linear radiometric changes. HOPC has been evaluated with a variety of multi-modal images including optical, LiDAR, SAR and map data. Experimental results show its superiority to the recent state-of-the-art similarity metrics (e.g., NCC, MI, etc.), and demonstrate its improved matching performance.

  20. Score level fusion scheme based on adaptive local Gabor features for face-iris-fingerprint multimodal biometric

    Science.gov (United States)

    He, Fei; Liu, Yuanning; Zhu, Xiaodong; Huang, Chun; Han, Ye; Chen, Ying

    2014-05-01

    A multimodal biometric system has been considered a promising technique to overcome the defects of unimodal biometric systems. We have introduced a fusion scheme to gain a better understanding and fusion method for a face-iris-fingerprint multimodal biometric system. In our case, we use particle swarm optimization to train a set of adaptive Gabor filters in order to achieve the proper Gabor basic functions for each modality. For a closer analysis of texture information, two different local Gabor features for each modality are produced by the corresponding Gabor coefficients. Next, all matching scores of the two Gabor features for each modality are projected to a single-scalar score via a trained, supported, vector regression model for a final decision. A large-scale dataset is formed to validate the proposed scheme using the Facial Recognition Technology database-fafb and CASIA-V3-Interval together with FVC2004-DB2a datasets. The experimental results demonstrate that as well as achieving further powerful local Gabor features of multimodalities and obtaining better recognition performance by their fusion strategy, our architecture also outperforms some state-of-the-art individual methods and other fusion approaches for face-iris-fingerprint multimodal biometric systems.

  1. The UCLA Multimodal Connectivity Database: A web-based platform for brain connectivity matrix sharing and analysis

    Directory of Open Access Journals (Sweden)

    Jesse A. Brown

    2012-11-01

    Full Text Available Brain connectomics research has rapidly expanded using functional MRI (fMRI and diffusion-weighted MRI (dwMRI. A common product of these varied analyses is a connectivity matrix (CM. A CM stores the connection strength between any two regions (nodes in a brain network. This format is useful for several reasons: 1 it is highly distilled, with minimal data size and complexity, 2 graph theory can be applied to characterize the network’s topology, and 3 it retains sufficient information to capture individual differences such as age, gender, intelligence quotient, or disease state. Here we introduce the UCLA Multimodal Connectivity Database (http://umcd.humanconnectomeproject.org, an openly available website for brain network analysis and data sharing. The site is a repository for researchers to publicly share CMs derived from their data. The site also allows users to select any CM shared by another user, compute graph theoretical metrics on the site, visualize a report of results, or download the raw CM. To date, users have contributed over 2000 individual CMs, spanning different imaging modalities (fMRI, dwMRI and disorders (Alzheimer’s, autism, Attention Deficit Hyperactive Disorder. To demonstrate the site’s functionality, whole brain functional and structural connectivity matrices are derived from 60 subjects’ (ages 26-45 resting state fMRI (rs-fMRI and dwMRI data and uploaded to the site. The site is utilized to derive graph theory global and regional measures for the rs-fMRI and dwMRI networks. Global and nodal graph theoretical measures between functional and structural networks exhibit low correspondence. This example demonstrates how this tool can enhance the comparability of brain networks from different imaging modalities and studies. The existence of this connectivity-based repository should foster broader data sharing and enable larger-scale meta analyses comparing networks across imaging modality, age group, and disease state.

  2. The development of a performance assessment methodology for activity based intelligence: A study of spatial, temporal, and multimodal considerations

    Science.gov (United States)

    Lewis, Christian M.

    Activity Based Intelligence (ABI) is the derivation of information from a series of in- dividual actions, interactions, and transactions being recorded over a period of time. This usually occurs in Motion imagery and/or Full Motion Video. Due to the growth of unmanned aerial systems technology and the preponderance of mobile video devices, more interest has developed in analyzing people's actions and interactions in these video streams. Currently only visually subjective quality metrics exist for determining the utility of these data in detecting specific activities. One common misconception is that ABI boils down to a simple resolution problem; more pixels and higher frame rates are better. Increasing resolution simply provides more data, not necessary more informa- tion. As part of this research, an experiment was designed and performed to address this assumption. Nine sensors consisting of four modalities were place on top of the Chester F. Carlson Center for Imaging Science in order to record a group of participants executing a scripted set of activities. The multimodal characteristics include data from the visible, long-wave infrared, multispectral, and polarimetric regimes. The activities the participants were scripted to cover a wide range of spatial and temporal interactions (i.e. walking, jogging, and a group sporting event). As with any large data acquisition, only a subset of this data was analyzed for this research. Specifically, a walking object exchange scenario and simulated RPG. In order to analyze this data, several steps of preparation occurred. The data were spatially and temporally registered; the individual modalities were fused; a tracking algorithm was implemented, and an activity detection algorithm was applied. To develop a performance assessment for these activities a series of spatial and temporal degradations were performed. Upon completion of this work, the ground truth ABI dataset will be released to the community for further analysis.

  3. Motion tracking in the liver: Validation of a method based on 4D ultrasound using a nonrigid registration technique

    International Nuclear Information System (INIS)

    Purpose: Treatments like radiotherapy and focused ultrasound in the abdomen require accurate motion tracking, in order to optimize dosage delivery to the target and minimize damage to critical structures and healthy tissues around the target. 4D ultrasound is a promising modality for motion tracking during such treatments. In this study, the authors evaluate the accuracy of motion tracking in the liver based on deformable registration of 4D ultrasound images. Methods: The offline analysis was performed using a nonrigid registration algorithm that was specifically designed for motion estimation from dynamic imaging data. The method registers the entire 4D image data sequence in a groupwise optimization fashion, thus avoiding a bias toward a specifically chosen reference time point. Three healthy volunteers were scanned over several breathing cycles (12 s) from three different positions and angles on the abdomen; a total of nine 4D scans for the three volunteers. Well-defined anatomic landmarks were manually annotated in all 96 time frames for assessment of the automatic algorithm. The error of the automatic motion estimation method was compared with interobserver variability. The authors also performed experiments to investigate the influence of parameters defining the deformation field flexibility and evaluated how well the method performed with a lower temporal resolution in order to establish the minimum frame rate required for accurate motion estimation. Results: The registration method estimated liver motion with an error of 1 mm (75% percentile over all datasets), which was lower than the interobserver variability of 1.4 mm. The results were only slightly dependent on the degrees of freedom of the deformation model. The registration error increased to 2.8 mm with an eight times lower temporal resolution. Conclusions: The authors conclude that the methodology was able to accurately track the motion of the liver in the 4D ultrasound data. The authors believe

  4. Motion tracking in the liver: Validation of a method based on 4D ultrasound using a nonrigid registration technique

    Energy Technology Data Exchange (ETDEWEB)

    Vijayan, Sinara, E-mail: sinara.vijayan@ntnu.no [Norwegian University of Science and Technology, 7491 Trondheim (Norway); Klein, Stefan [Norwegian University of Science and Technology, 7491 Trondheim, Norway and Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC, 3000 CA Rotterdam (Netherlands); Hofstad, Erlend Fagertun; Langø, Thomas [SINTEF, Department Medical Technology, 7465 Trondheim (Norway); Lindseth, Frank [Norwegian University of Science and Technology, 7491 Trondheim, Norway and SINTEF, Department Medical Technology, 7465 Trondheim (Norway); Ystgaard, Brynjulf [Department of Surgery, St. Olavs Hospital, 7030 Trondheim (Norway)

    2014-08-15

    Purpose: Treatments like radiotherapy and focused ultrasound in the abdomen require accurate motion tracking, in order to optimize dosage delivery to the target and minimize damage to critical structures and healthy tissues around the target. 4D ultrasound is a promising modality for motion tracking during such treatments. In this study, the authors evaluate the accuracy of motion tracking in the liver based on deformable registration of 4D ultrasound images. Methods: The offline analysis was performed using a nonrigid registration algorithm that was specifically designed for motion estimation from dynamic imaging data. The method registers the entire 4D image data sequence in a groupwise optimization fashion, thus avoiding a bias toward a specifically chosen reference time point. Three healthy volunteers were scanned over several breathing cycles (12 s) from three different positions and angles on the abdomen; a total of nine 4D scans for the three volunteers. Well-defined anatomic landmarks were manually annotated in all 96 time frames for assessment of the automatic algorithm. The error of the automatic motion estimation method was compared with interobserver variability. The authors also performed experiments to investigate the influence of parameters defining the deformation field flexibility and evaluated how well the method performed with a lower temporal resolution in order to establish the minimum frame rate required for accurate motion estimation. Results: The registration method estimated liver motion with an error of 1 mm (75% percentile over all datasets), which was lower than the interobserver variability of 1.4 mm. The results were only slightly dependent on the degrees of freedom of the deformation model. The registration error increased to 2.8 mm with an eight times lower temporal resolution. Conclusions: The authors conclude that the methodology was able to accurately track the motion of the liver in the 4D ultrasound data. The authors believe

  5. Registration and Fusion of the Autofluorescent and Infrared Retinal Images

    Directory of Open Access Journals (Sweden)

    Jiri Jan

    2008-10-01

    Full Text Available This article deals with registration and fusion of multimodal opththalmologic images obtained by means of a laser scanning device (Heidelberg retina angiograph. The registration framework has been designed and tested for combination of autofluorescent and infrared images. This process is a necessary step for consecutive pixel level fusion and analysis utilizing information from both modalities. Two fusion methods are presented and compared.

  6. Multimodal Emotion Recognition Using Multimodal Deep Learning

    OpenAIRE

    Liu, Wei; Zheng, Wei-Long; Lu, Bao-Liang

    2016-01-01

    To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals. For unimodal enhancement task, we indicate that the best recognition accuracy of 82.11% on SEED dataset is achieved with shared representations generated by Deep AutoEncoder (DAE) model. For multimodal facilitation tasks, we demonstrate that the Bimodal De...

  7. Contextual Multivariate Segmentation of Pork Tissue from Grating-Based Multimodal X-Ray Tomography

    DEFF Research Database (Denmark)

    Einarsdottir, Hildur; Nielsen, Mikkel S.; Ersbøll, Bjarne Kjær;

    2013-01-01

    X-ray computed tomography is increasingly used as a nondestructive method for studying three dimensional food structures. For meat products, studies have focused mainly on fat and protein content due to limited contrast capabilities of absorption based techniques. Recent advances in X-ray imaging...... have made novel X-ray image modalities available, where the refraction and scattering of X-rays is obtained simultaneously with the absorption properties, providing enhanced contrast for soft biological tissues. This paper demonstrates how data obtained from grating-based imaging can be segmented by...... means of multivariate and contextual methods to improve the classification of soft tissues in meat products. The results show that the presented segmentation method provides improved classification over univariate segmentation....

  8. A case-based multi-modal clinical system for stress management

    OpenAIRE

    Ahmed, Mobyen Uddin

    2010-01-01

    A difficult issue in stress management is to use biomedical sensor signal in the diagnosis and treatment of stress. Clinicians often make their diagnosis and decision based on manual inspection of physiological signals such as, ECG, heart rate, finger temperature etc. However, the complexity associated with manual analysis and interpretation of the signals makes it difficult even for experienced clinicians. Today the diagnosis and decision is largely dependent on how experienced the clinician...

  9. Contextual Multivariate Segmentation of Pork Tissue from Grating-Based Multimodal X-Ray Tomography

    OpenAIRE

    Einarsdottir, Hildur; Nielsen, Mikkel S.; Ersbøll, Bjarne Kjær; Larsen, Rasmus; Bech, Martin; Pfeier, Franz; Christensen, Lars B.; Feidenhans'l, Robert

    2013-01-01

    X-ray computed tomography is increasingly used as a nondestructive method for studying three dimensional food structures. For meat products, studies have focused mainly on fat and protein content due to limited contrast capabilities of absorption based techniques. Recent advances in X-ray imaging have made novel X-ray image modalities available, where the refraction and scattering of X-rays is obtained simultaneously with the absorption properties, providing enhanced contrast for soft biologi...

  10. Math Search for the Masses: Multimodal Search Interfaces and Appearance-Based Retrieval

    OpenAIRE

    Zanibbi, Richard; Orakwue, Awelemdy

    2015-01-01

    We summarize math search engines and search interfaces produced by the Document and Pattern Recognition Lab in recent years, and in particular the min math search interface and the Tangent search engine. Source code for both systems are publicly available. "The Masses" refers to our emphasis on creating systems for mathematical non-experts, who may be looking to define unfamiliar notation, or browse documents based on the visual appearance of formulae rather than their mathematical semantics.

  11. FPGA-Based Multimodal Embedded Sensor System Integrating Low- and Mid-Level Vision

    OpenAIRE

    Uwe Meyer-Baese; Guillermo Botella; Matilde Santos; José Antonio Martín H.

    2011-01-01

    Motion estimation is a low-level vision task that is especially relevant due to its wide range of applications in the real world. Many of the best motion estimation algorithms include some of the features that are found in mammalians, which would demand huge computational resources and therefore are not usually available in real-time. In this paper we present a novel bioinspired sensor based on the synergy between optical flow and orthogonal variant moments. The bioinspired sensor has been de...

  12. Evaluation of Interpolation Effects on Upsampling and Accuracy of Cost Functions-Based Optimized Automatic Image Registration

    Directory of Open Access Journals (Sweden)

    Amir Pasha Mahmoudzadeh

    2013-01-01

    Full Text Available Interpolation has become a default operation in image processing and medical imaging and is one of the important factors in the success of an intensity-based registration method. Interpolation is needed if the fractional unit of motion is not matched and located on the high resolution (HR grid. The purpose of this work is to present a systematic evaluation of eight standard interpolation techniques (trilinear, nearest neighbor, cubic Lagrangian, quintic Lagrangian, hepatic Lagrangian, windowed Sinc, B-spline 3rd order, and B-spline 4th order and to compare the effect of cost functions (least squares (LS, normalized mutual information (NMI, normalized cross correlation (NCC, and correlation ratio (CR for optimized automatic image registration (OAIR on 3D spoiled gradient recalled (SPGR magnetic resonance images (MRI of the brain acquired using a 3T GE MR scanner. Subsampling was performed in the axial, sagittal, and coronal directions to emulate three low resolution datasets. Afterwards, the low resolution datasets were upsampled using different interpolation methods, and they were then compared to the high resolution data. The mean squared error, peak signal to noise, joint entropy, and cost functions were computed for quantitative assessment of the method. Magnetic resonance image scans and joint histogram were used for qualitative assessment of the method.

  13. Sound speed based patient-specific biomechanical modeling for registration of USCT volumes with X-ray mammograms

    Science.gov (United States)

    Hopp, T.; Stromboni, A.; Duric, N.; Zapf, M.; Gemmeke, H.; Ruiter, N. V.

    2013-03-01

    Ultrasound Computer Tomography is an upcoming imaging modality for early breast cancer detection. For evaluation of the method, comparison with the standard method X-ray mammography is of strongest interest. To overcome the significant differences in dimensionality and compression state of the breast, in earlier work a registration method based on biomechanical modeling of the breast was proposed. However only homogeneous models could be applied, i.e. inner structures of the breast were neglected. In this work we extend the biomechanical modeling of the breast by estimating patient-specific tissue parameters automatically from the speed of sound volume. Two heterogeneous models are proposed modeling a quadratic and an exponential relationship between speed of sound and tissue stiffness. The models were evaluated using phantom images and clinical data. The size of all lesions is better preserved using heterogeneous models, especially using an exponential relationship. The presented approach yields promising results and gives a physical justification to our registration method. It can be considered as a first step towards a realistic modeling of the breast.

  14. Comparison of before and after CBCT image registration based on the lung cancer intensity-modulated planning

    International Nuclear Information System (INIS)

    Objective: To study the CBCT image registration of PTV enlarging distance and IMRT planning (CT-1) for patients with lung cancer,and evaluate their characters. Methods: Ten patients with lung cancer were included in the study. Two sets image, before and after radiotherapy, were acquired every week. Then delineated the targeted volume and made the planning (CT-2) according the enlarging distance data. To compare the parameters of DVH for lung and spinal cord, volumes and dose of PTV and NTCP with CT-1 and CT-2. The difference of two plan was analyzed by covariance analysis or Wilcoxson's z-test. Results: The max, min and mean dose of PTV, the lung V5, V10, V20, V30, V50 were similar in both plans (P =0.242-0.663). There was superiority in CT-2 of PTV and lung's mean dose (P =0.049, 0.035). The NTCP had the decent tendency followed by the increasing of lung V5, V10, V20 (P =0.146, 0.053, 0.000). Conclusions: CBCT based image registration can reduce PTV, the mean dose of lung, NTCP, and increase PTV dose. This provides a tool for exploring accurate radiotherapy strategies. (authors)

  15. Note: A simple image processing based fiducial auto-alignment method for sample registration

    Science.gov (United States)

    Robertson, Wesley D.; Porto, Lucas R.; Ip, Candice J. X.; Nantel, Megan K. T.; Tellkamp, Friedjof; Lu, Yinfei; Dwayne Miller, R. J.

    2015-08-01

    A simple method for the location and auto-alignment of sample fiducials for sample registration using widely available MATLAB/LabVIEW software is demonstrated. The method is robust, easily implemented, and applicable to a wide variety of experiment types for improved reproducibility and increased setup speed. The software uses image processing to locate and measure the diameter and center point of circular fiducials for distance self-calibration and iterative alignment and can be used with most imaging systems. The method is demonstrated to be fast and reliable in locating and aligning sample fiducials, provided here by a nanofabricated array, with accuracy within the optical resolution of the imaging system. The software was further demonstrated to register, load, and sample the dynamically wetted array.

  16. Registration-based geometric calibration of industrial X-ray tomography system

    International Nuclear Information System (INIS)

    This paper presents a general and efficient method for geometrical calibration of industrial X-ray tomography systems without the use of any phantom. In the field of nondestructive testing (NDT), an accurate numerical model of the object is usually available. By extending the classical volume-to-image registration framework, the method estimates both the parameters related to the position of the object, and those related to the positions and the orientations of the X-ray source, the detector and the rotation axis. Only using the projections data and the numerical model of the object, the values of the geometrical parameters are estimated with a good accuracy. Numerical experiments show that the method provides good results, even if the initialization of the process is far from the real values. (authors)

  17. Towards Multimodal Content Representation

    CERN Document Server

    Bunt, Harry

    2009-01-01

    Multimodal interfaces, combining the use of speech, graphics, gestures, and facial expressions in input and output, promise to provide new possibilities to deal with information in more effective and efficient ways, supporting for instance: - the understanding of possibly imprecise, partial or ambiguous multimodal input; - the generation of coordinated, cohesive, and coherent multimodal presentations; - the management of multimodal interaction (e.g., task completion, adapting the interface, error prevention) by representing and exploiting models of the user, the domain, the task, the interactive context, and the media (e.g. text, audio, video). The present document is intended to support the discussion on multimodal content representation, its possible objectives and basic constraints, and how the definition of a generic representation framework for multimodal content representation may be approached. It takes into account the results of the Dagstuhl workshop, in particular those of the informal working group...

  18. Dispersion-based control of modal characteristics for parametric down-conversion in a multimode waveguide

    CERN Document Server

    Karpinski, Michal; Banaszek, Konrad

    2011-01-01

    We report generation of near-infrared photon pairs in fundamental spatial modes via type-II spontaneous parametric down-conversion in a periodically poled potassium titanyl phosphate nonlinear waveguide supporting multiple transverse modes. This demonstrates experimentally a versatile scheme for complete control over the spatial characteristics of the produced nonclassical light based on careful exploitation of intermodal dispersion. The down-converted photons are characterized by the measurement of the beam quality factors in the heralded regime. Their indistinguishability is verified by the preparation of a polarization-entangled two-photon state shown to violate Bell's inequality.

  19. Predicting standard-dose PET image from low-dose PET and multimodal MR images using mapping-based sparse representation

    Science.gov (United States)

    Wang, Yan; Zhang, Pei; An, Le; Ma, Guangkai; Kang, Jiayin; Shi, Feng; Wu, Xi; Zhou, Jiliu; Lalush, David S.; Lin, Weili; Shen, Dinggang

    2016-01-01

    Positron emission tomography (PET) has been widely used in clinical diagnosis for diseases and disorders. To obtain high-quality PET images requires a standard-dose radionuclide (tracer) injection into the human body, which inevitably increases risk of radiation exposure. One possible solution to this problem is to predict the standard-dose PET image from its low-dose counterpart and its corresponding multimodal magnetic resonance (MR) images. Inspired by the success of patch-based sparse representation (SR) in super-resolution image reconstruction, we propose a mapping-based SR (m-SR) framework for standard-dose PET image prediction. Compared with the conventional patch-based SR, our method uses a mapping strategy to ensure that the sparse coefficients, estimated from the multimodal MR images and low-dose PET image, can be applied directly to the prediction of standard-dose PET image. As the mapping between multimodal MR images (or low-dose PET image) and standard-dose PET images can be particularly complex, one step of mapping is often insufficient. To this end, an incremental refinement framework is therefore proposed. Specifically, the predicted standard-dose PET image is further mapped to the target standard-dose PET image, and then the SR is performed again to predict a new standard-dose PET image. This procedure can be repeated for prediction refinement of the iterations. Also, a patch selection based dictionary construction method is further used to speed up the prediction process. The proposed method is validated on a human brain dataset. The experimental results show that our method can outperform benchmark methods in both qualitative and quantitative measures.

  20. Feasibility and Initial Performance of Simultaneous SPECT-CT Imaging Using a Commercial Multi-Modality Preclinical Imaging System

    OpenAIRE

    Osborne, Dustin R.; Derek W. Austin

    2015-01-01

    Multi-modality imaging provides coregistered PET-CT and SPECT-CT images; however such multi-modality workflows usually consist of sequential scans from the individual imaging components for each modality. This typical workflow may result in long scan times limiting throughput of the imaging system. Conversely, acquiring multi-modality data simultaneously may improve correlation and registration of images, improve temporal alignment of the acquired data, increase imaging throughput, and benefi...

  1. The multimodal edge of human aerobotic interaction

    OpenAIRE

    Abioye, Ayodeji; Prior, Stephen; Thomas, Trevor; Saddington, Peter

    2016-01-01

    This paper presents the idea of a multimodal human aerobotic interaction. An overview of the aerobotic system and its application is given. The joystick-based controller interface and its limitations is discussed. Two techniques are suggested as emerging alternatives to the joystick-based controller interface used in human aerobotic interaction. The first technique is a multimodal combination of speech, gaze, gesture, and other non-verbal cues already used in regular human-human interactio...

  2. Nonparametric Feature Matching Based Conditional Random Fields for Gesture Recognition from Multi-Modal Video.

    Science.gov (United States)

    Chang, Ju Yong

    2016-08-01

    We present a new gesture recognition method that is based on the conditional random field (CRF) model using multiple feature matching. Our approach solves the labeling problem, determining gesture categories and their temporal ranges at the same time. A generative probabilistic model is formalized and probability densities are nonparametrically estimated by matching input features with a training dataset. In addition to the conventional skeletal joint-based features, the appearance information near the active hand in an RGB image is exploited to capture the detailed motion of fingers. The estimated likelihood function is then used as the unary term for our CRF model. The smoothness term is also incorporated to enforce the temporal coherence of our solution. Frame-wise recognition results can then be obtained by applying an efficient dynamic programming technique. To estimate the parameters of the proposed CRF model, we incorporate the structured support vector machine (SSVM) framework that can perform efficient structured learning by using large-scale datasets. Experimental results demonstrate that our method provides effective gesture recognition results for challenging real gesture datasets. By scoring 0.8563 in the mean Jaccard index, our method has obtained the state-of-the-art results for the gesture recognition track of the 2014 ChaLearn Looking at People (LAP) Challenge. PMID:26800528

  3. Multimodality and CALL

    OpenAIRE

    Guichon, Nicolas; Cohen, Cathy

    2016-01-01

    This chapter explores the issues pertaining to multimodality, which has always been considered as a defining characteristic of CALL (Chapelle 2009). The chapter begins by critically examining the various definitions of multimodality, especially in the field of second language acquisition and cognitive psychology and explores the distinction between mode, modality and channel. With reference to specific studies conducted in the field, we then investigate the potential of multimodality for seco...

  4. Challenges With Manual-Based Multimodal Psychotherapy for People With Alzheimer's Disease: A Case Study.

    Science.gov (United States)

    Tonga, Johanne Bjoernstad; Karlsoeen, Bente Brekne; Arnevik, Espen Ajo; Werheid, Katja; Korsnes, Maria S; Ulstein, Ingun Dina

    2016-06-01

    Earlier detection of dementia requires increased knowledge of how to help people in the early stages of dementia. However, few studies have focused on how psychotherapy should be adapted to improve the outcome of therapy for people with Alzheimer's disease. The aims of the present study were to identify and to explore possible obstacles encountered during the use of manual-based psychotherapy for people with early-stage Alzheimer's disease. The study found that individual adaptations to the treatment manual were necessary, particularly the modification of memory aids in order to adapt them to patients' functional level and previous experience with modern technology. In addition, caregivers were essential for both treatment and homework completion, while reduced awareness constituted an obstacle for adherence to the manual. PMID:26385947

  5. Multimodal Biometric System Based on the Recognition of Face and Both Irises

    Directory of Open Access Journals (Sweden)

    Yeong Gon Kim

    2012-09-01

    Our study has the following novel features. First, the device proposed acquires images of the face and both irises simultaneously. The proposed device consists of a face camera, two iris cameras, near‐infrared illuminators and cold mirrors. Second, fast and accurate iris detection is based on two circular edge detections, which are accomplished in the iris image on the basis of the size of the iris detected in the face image. Third, the combined accuracy is enhanced by combining each score for the face and both irises using a support vector machine. The experimental results show that the equal error rate for the proposed method is 0.131%, which is lower than that of face or iris recognition and other fusion methods.

  6. Molecular signatures based on 2-methoxy phenylpiperazine for neuroreceptor imaging using multimodality approach

    International Nuclear Information System (INIS)

    Full text: 5-HT1A, the best-characterized subtype of currently known 5-HT receptors, is tightly implicated in the pathogenesis of depression, anxiety, epilepsy and eating disorders. Specific radioligands and positron emission tomography (PET) allow for a quantitative imaging of brain 5-HT1A receptor distribution in living animals and humans. Potent and selective ligands for 5-HT1A receptors labeled with 18F and 11C with high specific activity aids the progress of understanding the pharmacological function of the patient's brain. It is not only desirable to find new compound based on 2-methoxyphenyl piperazine (MPP) selective to 5-HT1A receptors for possible pharmacological activity; such ligands are desired as they may be labeled with different PET/SPECT radioisotopes. We have envisaged to associate 2-methoxyphenyl piperazine with p-nitrophenyl derivative which was then subjected to 18F-fluorination reaction (An efficient one-step approach to label MPP with 18F for PET Imaging). We have developed short-lived 11C (t1/2=20 min) labeled methoxy phenylpiperazine based derivative, (N-methyl-11C)bis(2-(4-(2-methoxy-phenyl)-piperazin-1-yl)ethyl)-amine ((N-methyl-11C)bis-MPP) with high specific activity for PET. The synthesis, characterization and biological evaluation of conjugate the 1-(2-methoxyphenylpiperazine) moiety complexed with paramagnetic metal ion, a fragment of the true 5-HT1A antagonist was carried out and characterized by spectroscopic methods for MRI. Initial studies with primary cultures of rat hippocampal cell lines indicated that the novel derivatives of MPP are highly selective for the serotonin (5-HT1A) receptor. It has significantly higher uptake in the hippocampal region of the brain, where 5-HT1A receptor density is high

  7. Improving image registration by correspondence interpolation

    DEFF Research Database (Denmark)

    Ólafsdóttir, Hildur; Pedersen, Henrik; Hansen, Michael Sass; Larsson, Henrik; Larsen, Rasmus

    This paper presents how using a correspondence-based interpolation scheme for 3D image registration improves the registration accuracy. The interpolator takes into account correspondences across slices, which is an advantage, particularly when the volume has thick slices, and where anatomies lie...... downsampled data, increasing the registration accuracy of original data to 5.8% on average with respect to a standard interpolator....

  8. Nonrigid registration of myocardial perfusion MRI

    DEFF Research Database (Denmark)

    Ólafsdóttir, Hildur

    2005-01-01

    This paper describes a fully automatic registration of 10 multi-slice myocardial perfusion magnetic resonance image sequences. The registration of these sequences is crucial for the clinical interpretation, which currently is subjected to manual labour. The approach used in this study is a nonrigid...... registration algorithm based on free-form deformations due to Rueckert et al. Inspection of difference images from the wash-out part of the perfusion sequences indicates that a good registration accuracy is obtained....

  9. Nonrigid registration of myocardial perfusion MRI

    OpenAIRE

    Ólafsdóttir, Hildur

    2005-01-01

    This paper describes a fully automatic registration of 10 multi-slice myocardial perfusion magnetic resonance image sequences. The registration of these sequences is crucial for the clinical interpretation, which currently is subjected to manual labour. The approach used in this study is a nonrigid registration algorithm based on free-form deformations due to Rueckert et al. Inspection of difference images from the wash-out part of the perfusion sequences indicates that a good registration ac...

  10. Image Registration Concept and Techniques: A Review

    Directory of Open Access Journals (Sweden)

    Sombir Singh Bisht

    2014-04-01

    Full Text Available In the past few years the global need for low computation, less time consuming, and good quality image mapping methods has caused an image registration technique alive in multiple application areas. Image registration is the method of superimposition the pixels or control points from one image over another image namely the target image and reference image respectively. The concentration is on various methods of mapping parameters. Input images are reference image and the sensed image. Basically image registration is of two types Area based and Feature based. Area based works on the intensity of image and feature based is based on feature points or objects of image. Also the simple and efficient registration techniques are very essential in many application areas. This paper presents a review on image registration techniques as well as the hybrid registration approach. Many authors have also reported the modified registration techniques, each technique is reviewed according to its merits and drawbacks.

  11. Validation protocol applied to an automatic co-registration method based on multi-resolution analysis and local deformation models

    OpenAIRE

    Blanc, Philippe; Wald, Lucien

    1998-01-01

    The issue of co-registration distortions between images is one of major problems involved in data fusion processes. This conclusion can be extended to change detection generally also performing on a pixel basis. Accurate methods are therefore required for co-registration of images in these particular cases. It is the reason why we present a co-registration method using multi-resolution analysis and local deformation models. This work includes a validation protocol that enables the assessment ...

  12. A Local Fast Marching-Based Diffusion Tensor Image Registration Algorithm by Simultaneously Considering Spatial Deformation and Tensor Orientation

    OpenAIRE

    Xue, Zhong; Li, Hai; Guo, Lei; Wong, Stephen T.C.

    2010-01-01

    It is a key step to spatially align diffusion tensor images (DTI) to quantitatively compare neural images obtained from different subjects or the same subject at different timepoints. Different from traditional scalar or multi-channel image registration methods, tensor orientation should be considered in DTI registration. Recently, several DTI registration methods have been proposed in the literature, but deformation fields are purely dependent on the tensor features not the whole tensor info...

  13. Coating-free reflection technique for fiber-optic sensors based on multimode interference: A temperature sensing study

    Science.gov (United States)

    Taue, Shuji; Takahashi, Tsuyoshi; Fukano, Hideki

    2016-08-01

    A novel reflection technique for use in fiber-optic sensors is investigated and applied to a multimode interference structure. The reflectivity at a fiber end face is increased with two operations. Firstly, the light intensity is increased toward the periphery of the end-face by adjusting the fiber length, which is determined theoretically. Secondly, the fiber end-face is deformed into an ellipsoid by heating it with a gas torch. The deformed shape is characterized from microscopic images. The reflected light intensity is increased by more than 10 dB as a result of controlling the fiber length and deforming its end-face. Temperature sensing was performed using the reflection-type multimode interference structure immersed in temperature-controlled silicone oil. The resulting sensitivity was 0.028 °C for a 29.60 mm sensing region, achieved without using any reflection coating.

  14. The need for application-based adaptation of deformable image registration

    International Nuclear Information System (INIS)

    Purpose: To utilize a deformable phantom to objectively evaluate the accuracy of 11 different deformable image registration (DIR) algorithms. Methods: The phantom represents an axial plane of the pelvic anatomy. Urethane plastic serves as the bony anatomy and urethane rubber with three levels of Hounsfield units (HU) is used to represent fat and organs, including the prostate. A plastic insert is placed into the phantom to simulate bladder filling. Nonradiopaque markers reside on the phantom surface. Optical camera images of these markers are used to measure the positions and determine the deformation from the bladder insert. Eleven different DIR algorithms are applied to the full and empty-bladder computed tomography images of the phantom (fixed and moving volumes, respectively) to calculate the deformation. The algorithms include those from MIM Software (MIM) and Velocity Medical Solutions (VEL) and nine different implementations from the deformable image registration and adaptive radiotherapy toolbox for Matlab. These algorithms warp one image to make it similar to another, but must utilize a method for regularization to avoid physically unrealistic deformation scenarios. The mean absolute difference (MAD) between the HUs at the marker locations on one image and the calculated location on the other serves as a metric to evaluate the balance between image similarity and regularization. To demonstrate the effect of regularization on registration accuracy, an additional beta version of MIM was created with a variable smoothness factor that controls the emphasis of the algorithm on regularization. The distance to agreement between the measured and calculated marker deformations is used to compare the overall spatial accuracy of the DIR algorithms. This overall spatial accuracy is also utilized to evaluate the phantom geometry and the ability of the phantom soft-tissue heterogeneity to represent patient data. To evaluate the ability of the DIR algorithms to

  15. FUSION BASED MULTIMODAL AUTHENTICATION IN BIOMETRICS USING CONTEXT-SENSITIVE EXPONENT ASSOCIATIVE MEMORY MODEL : A NOVEL APPROACH

    OpenAIRE

    P. E. S. N. Krishna Prasad; Pavan Kumar K; M. V. Ramakrishna; B. D. C. N. Prasad

    2013-01-01

    Biometrics is one of the primary key concepts of real application domains such as aadhar card, passport, pan card, etc. In such applications user can provide two to three biometrics patterns like face, finger, palm, signature, iris data, and so on. We considered face and finger patterns for encoding and then also for verification. Using this data we proposed a novel model for authentication in multimodal biometrics often called Context-Sensitive Exponent Associative Memory Mode...

  16. Multimodal Brain-Tumor Segmentation Based on Dirichlet Process Mixture Model with Anisotropic Diffusion and Markov Random Field Prior

    Directory of Open Access Journals (Sweden)

    Yisu Lu

    2014-01-01

    Full Text Available Brain-tumor segmentation is an important clinical requirement for brain-tumor diagnosis and radiotherapy planning. It is well-known that the number of clusters is one of the most important parameters for automatic segmentation. However, it is difficult to define owing to the high diversity in appearance of tumor tissue among different patients and the ambiguous boundaries of lesions. In this study, a nonparametric mixture of Dirichlet process (MDP model is applied to segment the tumor images, and the MDP segmentation can be performed without the initialization of the number of clusters. Because the classical MDP segmentation cannot be applied for real-time diagnosis, a new nonparametric segmentation algorithm combined with anisotropic diffusion and a Markov random field (MRF smooth constraint is proposed in this study. Besides the segmentation of single modal brain-tumor images, we developed the algorithm to segment multimodal brain-tumor images by the magnetic resonance (MR multimodal features and obtain the active tumor and edema in the same time. The proposed algorithm is evaluated using 32 multimodal MR glioma image sequences, and the segmentation results are compared with other approaches. The accuracy and computation time of our algorithm demonstrates very impressive performance and has a great potential for practical real-time clinical use.

  17. Automatic registration of satellite imagery

    Science.gov (United States)

    Fonseca, Leila M. G.; Costa, Max H. M.; Manjunath, B. S.; Kenney, C.

    1997-01-01

    Image registration is one of the basic image processing operations in remote sensing. With the increase in the number of images collected every day from different sensors, automated registration of multi-sensor/multi-spectral images has become an important issue. A wide range of registration techniques has been developed for many different types of applications and data. The objective of this paper is to present an automatic registration algorithm which uses a multiresolution analysis procedure based upon the wavelet transform. The procedure is completely automatic and relies on the grey level information content of the images and their local wavelet transform modulus maxima. The registration algorithm is very simple and easy to apply because it needs basically one parameter. We have obtained very encouraging results on test data sets from the TM and SPOT sensor images of forest, urban and agricultural areas.

  18. SU-E-J-136: Multimodality-Image-Based Target Delineation for Dose Painting of Pancreatic Cancer

    Energy Technology Data Exchange (ETDEWEB)

    Dalah, E; Paulson, E; Erickson, B; Li, X [Medical College of Wisconsin, Milwaukee, WI (United States)

    2014-06-01

    Purpose: Dose escalated RT may provide improved disease local-control for selected unresectable pancreatic cancer. Accurate delineation of the gross tumor volume (GTV) inside pancreatic head or body would allow safe dose escalation considering the tolerances of adjacent organs at risk (OAR). Here we explore the potential of multi-modality imaging (DCE-MRI, ADC-MRI, and FDG-PET) to define the GTV for dose painting of pancreatic cancer. Volumetric variations of DCE-MRI, ADC-MRI and FDG-PET defined GTVs were assessed in comparison to the findings on CT, and to pathology specimens for resectable and borderline reseactable cases of pancreatic cancer. Methods: A total of 19 representative patients with DCE-MRI, ADC-MRI and FDG-PET data were analyzed. Of these, 8 patients had pathological specimens. GTV, inside pancreatic head/neck, or body, were delineated on MRI (denoted GTVDCE, and GTVADC), on FDG-PET using SUV of 2.5, 40% SUVmax, and 50% SUVmax (denoted GTV2.5, GTV40%, and GTV50%). A Kruskal-Wallis test was used to determine whether significant differences existed between GTV volumes. Results: Significant statistical differences were found between the GTVs defined by DCE-MRI, ADC-MRI, and FDG-PET, with a mean and range of 4.73 (1.00–9.79), 14.52 (3.21–25.49), 22.04 (1.00–45.69), 19.10 (4.84–45.59), and 9.80 (0.32–35.21) cm3 (p<0.0001) for GTVDCE, GTVADC, GTV2.5, GTV40%, and GTV50%, respectively. The mean difference and range in the measurements of maximum dimension of GTVs based on DCE-MRI, ADC-MRI, SUV2.5, 40% SUVmax, and 50% SUVmax compared with pathologic specimens were −0.84 (−2.24 to 0.9), 0.41 (−0.15 to 2.3), 0.58 (−1.41 to 3.69), 0.66 (−0.67 to 1.32), and 0.15 (−1.53 to 2.38) cm, respectively. Conclusion: Differences exists between DCE, ADC, and PET defined target volumes for RT of pancreatic cancer. Further studies combined with pathological specimens are required to identify the optimal imaging modality and/or acquisition method to

  19. Evidence-based development and first usability testing of a social serious game based multi-modal system for early screening for atypical socio-cognitive development.

    Science.gov (United States)

    Gyori, Miklos; Borsos, Zsófia; Stefanik, Krisztina

    2015-01-01

    At current, screening for, and diagnosis of, autism spectrum disorders (ASD) are based on purely behavioral data; established screening tools rely on human observation and ratings of relevant behaviors. The research and development project in the focus of this paper is aimed at designing, creating and evaluating a social serious game based multi-modal, interactive software system for screening for high functioning cases of ASD at kindergarten age. The aims of this paper are (1) to summarize the evidence-based design process and (2) to present results from the first usability test of the system. Game topic, candidate responses, and candidate game contents were identified via an iterative literature review. On this basis, the 1st partial prototype of the fully playable game has been created, with complete data recording functionality but without the decision making component. A first usability test was carried out on this prototype (n=13). Overall results were unambiguously promising. Although sporadic difficulties in, and slightly negative attitudes towards, using the game occasionally arose, these were confined to non-target-group children only. The next steps of development include (1) completing the game design; (2) carrying out first large-n field test; (3) creating the first prototype of the decision making component. PMID:26294452

  20. Superparamagnetic nanoparticles for enhanced magnetic resonance and multimodal imaging

    Science.gov (United States)

    Sikma, Elise Ann Schultz

    Magnetic resonance imaging (MRI) is a powerful tool for noninvasive tomographic imaging of biological systems with high spatial and temporal resolution. Superparamagnetic (SPM) nanoparticles have emerged as highly effective MR contrast agents due to their biocompatibility, ease of surface modification and magnetic properties. Conventional nanoparticle contrast agents suffer from difficult synthetic reproducibility, polydisperse sizes and weak magnetism. Numerous synthetic techniques and nanoparticle formulations have been developed to overcome these barriers. However, there are still major limitations in the development of new nanoparticle-based probes for MR and multimodal imaging including low signal amplification and absence of biochemical reporters. To address these issues, a set of multimodal (T2/optical) and dual contrast (T1/T2) nanoparticle probes has been developed. Their unique magnetic properties and imaging capabilities were thoroughly explored. An enzyme-activatable contrast agent is currently being developed as an innovative means for early in vivo detection of cancer at the cellular level. Multimodal probes function by combining the strengths of multiple imaging techniques into a single agent. Co-registration of data obtained by multiple imaging modalities validates the data, enhancing its quality and reliability. A series of T2/optical probes were successfully synthesized by attachment of a fluorescent dye to the surface of different types of nanoparticles. The multimodal nanoparticles generated sufficient MR and fluorescence signal to image transplanted islets in vivo. Dual contrast T1/T2 imaging probes were designed to overcome disadvantages inherent in the individual T1 and T2 components. A class of T1/T2 agents was developed consisting of a gadolinium (III) complex (DTPA chelate or DO3A macrocycle) conjugated to a biocompatible silica-coated metal oxide nanoparticle through a disulfide linker. The disulfide linker has the ability to be reduced

  1. Automatic Intensity-based 3D-to-2D Registration of CT Volume and Dual-energy Digital Radiography for the Detection of Cardiac Calcification

    Science.gov (United States)

    Chen, Xiang; Gilkeson, Robert; Fei, Baowei

    2013-01-01

    We are investigating three-dimensional (3D) to two-dimensional (2D) registration methods for computed tomography (CT) and dual-energy digital radiography (DR) for the detection of coronary artery calcification. CT is an established tool for the diagnosis of coronary artery diseases (CADs). Dual-energy digital radiography could be a cost-effective alternative for screening coronary artery calcification. In order to utilize CT as the “gold standard” to evaluate the ability of DR images for the detection and localization of calcium, we developed an automatic intensity-based 3D-to-2D registration method for 3D CT volumes and 2D DR images. To generate digital rendering radiographs (DRR) from the CT volumes, we developed three projection methods, i.e. Gaussian-weighted projection, threshold-based projection, and average-based projection. We tested normalized cross correlation (NCC) and normalized mutual information (NMI) as similarity measurement. We used the Downhill Simplex method as the search strategy. Simulated projection images from CT were fused with the corresponding DR images to evaluate the localization of cardiac calcification. The registration method was evaluated by digital phantoms, physical phantoms, and clinical data sets. The results from the digital phantoms show that the success rate is 100% with mean errors of less 0.8 mm and 0.2 degree for both NCC and NMI. The registration accuracy of the physical phantoms is 0.34 ± 0.27 mm. Color overlay and 3D visualization of the clinical data show that the two images are registered well. This is consistent with the improvement of the NMI values from 0.20 ± 0.03 to 0.25 ± 0.03 after registration. The automatic 3D-to-2D registration method is accurate and robust and may provide a useful tool to evaluate the dual-energy DR images for the detection of coronary artery calcification. PMID:24386527

  2. Non-rigid contour-to-pixel registration of photographic and quantitative light-induced fluorescence imaging of decalcified teeth

    Science.gov (United States)

    Berkels, Benjamin; Deserno, Thomas; Ehrlich, Eva E.; Fritz, Ulrike B.; Sirazitdinova, Ekaterina; Tatano, Rosalia

    2016-03-01

    Quantitative light-induced fluorescence (QLF) is widely used to assess the damage of a tooth due to decalcification. In digital photographs, decalcification appears as white spot lesions, i.e. white spots on the tooth surface. We propose a novel multimodal registration approach for the matching of digital photographs and QLF images of decalcified teeth. The registration is based on the idea of contour-to-pixel matching. Here, the curve, which represents the shape of the tooth, is extracted from the QLF image using a contour segmentation by binarization and morphological processing. This curve is aligned to the photo with a non-rigid variational registration approach. Thus, the registration problem is formulated as minimization problem with an objective function that consists of a data term and a regularizer for the deformation. To construct the data term, the photo is pointwise classified into tooth and non-tooth regions. Then, the signed distance function of the tooth region allows to measure the mismatch between curve and photo. As regularizer a higher order, linear elastic prior is used. The resulting minimization problem is solved numerically using bilinear Finite Elements for the spatial discretization and the Gauss-Newton algorithm. The evaluation is based on 150 image pairs, where an average of 5 teeth have been captured from 32 subjects. All registrations have been confirmed correctly by a dental expert. The contour-to-pixel methods can directly be used in 3D for surface-to-voxel tasks.

  3. Quantifying Quality Aspects of Multimodal Interactive Systems

    CERN Document Server

    Kühnel, Christine

    2012-01-01

    This book systematically addresses the quantification of quality aspects of multimodal interactive systems. The conceptual structure is based on a schematic view on human-computer interaction where the user interacts with the system and perceives it via input and output interfaces. Thus, aspects of multimodal interaction are analyzed first, followed by a discussion of the evaluation of output and input and concluding with a view on the evaluation of a complete system.

  4. A coarse-to-fine automatic and robust registration method for multi-source remote sensing images based on Harris and phase information

    Science.gov (United States)

    Li, Haichao; Man, Yiyun

    2015-10-01

    The image phase coherences (PCs) remain invariant when brightness and contrast changes. A new method of remote sensing image registration is proposed. PCs are firstly extracted from the reference image and the input image. In order to improve the registration efficiency, in the first step the PCs are firstly down-sampled using Gaussian pyramid method, and the coarse translation parameters are calculated using phase correlation. In the second step, Harris corners are detected from the two images, and normalized cross-correlation (NCC) function based on PCs is used to find the corresponding matching corners of the two images, and then obtain parameters of an alignment transform model. Experiments have demonstrated that the coarse-to-fine method can be successfully applied to multi-source images registration.

  5. Inter-subject MR-PET image registration and integration

    International Nuclear Information System (INIS)

    A MR-PET inter-subject image integration technique is developed to provide more precise anatomical location based on a template MR image, and to examine the anatomical variation in sensory-motor stimulation or to obtain cross-subject signal averaging to enhance the delectability of focal brain activity detected by different subject PET images. In this study, a multimodality intrasubject image registration procedure is firstly applied to align MR and PET images of the same subject. The second procedure is to estimate an elastic image transformation that can nonlinearly deform each 3D brain MR image and map them to the template MR image. The estimation procedure of the elastic image transformation is based on a strategy that searches the best local image match to achieve an optimal global image match, iteratively. The final elastic image transformation estimated for each subject will then be used to deform the MR-PET registered PET image. After the nonlinear PET image deformation, MR-PET intersubject mapping, averaging, and fusing are simultaneously accomplished. The developed technique has been implemented to an UNIX based workstation with Motif window system. The software named Elastic-IRIS has few requirements of user interaction. The registered anatomical location of 10 different subjects has a standard deviation of ∼2mm. in the x, y, and z directions. The processing time for one MR-PET inter-subject registration ranged from 20 to 30 minutes on a SUN SPARC-20

  6. Validation for 2D/3D registration II: The comparison of intensity- and gradient-based merit functions using a new gold standard data set

    International Nuclear Information System (INIS)

    Purpose: A new gold standard data set for validation of 2D/3D registration based on a porcine cadaver head with attached fiducial markers was presented in the first part of this article. The advantage of this new phantom is the large amount of soft tissue, which simulates realistic conditions for registration. This article tests the performance of intensity- and gradient-based algorithms for 2D/3D registration using the new phantom data set. Methods: Intensity-based methods with four merit functions, namely, cross correlation, rank correlation, correlation ratio, and mutual information (MI), and two gradient-based algorithms, the backprojection gradient-based (BGB) registration method and the reconstruction gradient-based (RGB) registration method, were compared. Four volumes consisting of CBCT with two fields of view, 64 slice multidetector CT, and magnetic resonance-T1 weighted images were registered to a pair of kV x-ray images and a pair of MV images. A standardized evaluation methodology was employed. Targets were evenly spread over the volumes and 250 starting positions of the 3D volumes with initial displacements of up to 25 mm from the gold standard position were calculated. After the registration, the displacement from the gold standard was retrieved and the root mean square (RMS), mean, and standard deviation mean target registration errors (mTREs) over 250 registrations were derived. Additionally, the following merit properties were computed: Accuracy, capture range, number of minima, risk of nonconvergence, and distinctiveness of optimum for better comparison of the robustness of each merit. Results: Among the merit functions used for the intensity-based method, MI reached the best accuracy with an RMS mTRE down to 1.30 mm. Furthermore, it was the only merit function that could accurately register the CT to the kV x rays with the presence of tissue deformation. As for the gradient-based methods, BGB and RGB methods achieved subvoxel accuracy (RMS m

  7. Research advances in multi-modality medical image registration and fusion methods and their clinical application%多模医学图像配准和融合方法及其临床应用进展

    Institute of Scientific and Technical Information of China (English)

    顾恒乐; 聂生东

    2016-01-01

    多模医学图像处理是当前图像处理中的研究热点,对于临床诊断和治疗都有着重要的意义。不同模态的图像提供了患者的不同信息,解剖图像(如CT、MRI)提供了人体解剖形态结构的信息,功能图像(如SPECT、PET)提供了人体内放射性浓度分布的功能信息,这些不同信息需要通过合成得到信息更为全面的融合图像。而要得到有用的融合图像,不同模态的图像需经配准处理。这里综述了几种应用于医学领域的图像配准和融合技术,指出了不同技术的各自优缺点,同时也对近期各种处理技术在临床应用中的研究做了介绍。%Multi⁃modality medical image processing has become a hot topic for research in the field of image processing and plays an important role in clinical diagnosis and treatment. Images with different modalities provide different information on patients. Anatomical images ( such as computed tomography and magnetic resonance imaging ) provide information on anatomical morphology and the structure of human body, and functional images ( such as single⁃photon emission computed tomography and positron emission tomography) provide the functional information on the distribution of radioactive concentration within human body. Such information needs to be fused to obtain comprehensive fusion images, and the images with different modalities need to be registered to obtain useful fusion images. This article reviews several image registration and fusion techniques used in the medical field, points out their advantages and shortcomings, and introduces the application of various processing techniques in clinical practice.

  8. Critical Analysis of Multimodal Discourse

    DEFF Research Database (Denmark)

    van Leeuwen, Theo

    2013-01-01

    This is an encyclopaedia article which defines the fields of critical discourse analysis and multimodality studies, argues that within critical discourse analysis more attention should be paid to multimodality, and within multimodality to critical analysis, and ends reviewing a few examples...... of recent work in the critical analysis of multimodal discourse....

  9. Position tracking of moving liver lesion based on real-time registration between 2D ultrasound and 3D preoperative images

    Energy Technology Data Exchange (ETDEWEB)

    Weon, Chijun; Hyun Nam, Woo; Lee, Duhgoon; Ra, Jong Beom, E-mail: jbra@kaist.ac.kr [Department of Electrical Engineering, KAIST, Daejeon 305-701 (Korea, Republic of); Lee, Jae Young [Department of Radiology, Seoul National University Hospital, Seoul 110-744 (Korea, Republic of)

    2015-01-15

    Purpose: Registration between 2D ultrasound (US) and 3D preoperative magnetic resonance (MR) (or computed tomography, CT) images has been studied recently for US-guided intervention. However, the existing techniques have some limits, either in the registration speed or the performance. The purpose of this work is to develop a real-time and fully automatic registration system between two intermodal images of the liver, and subsequently an indirect lesion positioning/tracking algorithm based on the registration result, for image-guided interventions. Methods: The proposed position tracking system consists of three stages. In the preoperative stage, the authors acquire several 3D preoperative MR (or CT) images at different respiratory phases. Based on the transformations obtained from nonrigid registration of the acquired 3D images, they then generate a 4D preoperative image along the respiratory phase. In the intraoperative preparatory stage, they properly attach a 3D US transducer to the patient’s body and fix its pose using a holding mechanism. They then acquire a couple of respiratory-controlled 3D US images. Via the rigid registration of these US images to the 3D preoperative images in the 4D image, the pose information of the fixed-pose 3D US transducer is determined with respect to the preoperative image coordinates. As feature(s) to use for the rigid registration, they may choose either internal liver vessels or the inferior vena cava. Since the latter is especially useful in patients with a diffuse liver disease, the authors newly propose using it. In the intraoperative real-time stage, they acquire 2D US images in real-time from the fixed-pose transducer. For each US image, they select candidates for its corresponding 2D preoperative slice from the 4D preoperative MR (or CT) image, based on the predetermined pose information of the transducer. The correct corresponding image is then found among those candidates via real-time 2D registration based on a

  10. A registration-based segmentation method with application to adiposity analysis of mice microCT images

    Science.gov (United States)

    Bai, Bing; Joshi, Anand; Brandhorst, Sebastian; Longo, Valter D.; Conti, Peter S.; Leahy, Richard M.

    2014-04-01

    Obesity is a global health problem, particularly in the U.S. where one third of adults are obese. A reliable and accurate method of quantifying obesity is necessary. Visceral adipose tissue (VAT) and subcutaneous adipose tissue (SAT) are two measures of obesity that reflect different associated health risks, but accurate measurements in humans or rodent models are difficult. In this paper we present an automatic, registration-based segmentation method for mouse adiposity studies using microCT images. We co-register the subject CT image and a mouse CT atlas. Our method is based on surface matching of the microCT image and an atlas. Surface-based elastic volume warping is used to match the internal anatomy. We acquired a whole body scan of a C57BL6/J mouse injected with contrast agent using microCT and created a whole body mouse atlas by manually delineate the boundaries of the mouse and major organs. For method verification we scanned a C57BL6/J mouse from the base of the skull to the distal tibia. We registered the obtained mouse CT image to our atlas. Preliminary results show that we can warp the atlas image to match the posture and shape of the subject CT image, which has significant differences from the atlas. We plan to use this software tool in longitudinal obesity studies using mouse models.

  11. A neural network based 3D/3D image registration quality evaluator for the head-and-neck patient setup in the absence of a ground truth

    International Nuclear Information System (INIS)

    Purpose: To develop a neural network based registration quality evaluator (RQE) that can identify unsuccessful 3D/3D image registrations for the head-and-neck patient setup in radiotherapy. Methods: A two-layer feed-forward neural network was used as a RQE to classify 3D/3D rigid registration solutions as successful or unsuccessful based on the features of the similarity surface near the point-of-solution. The supervised training and test data sets were generated by rigidly registering daily cone-beam CTs to the treatment planning fan-beam CTs of six patients with head-and-neck tumors. Two different similarity metrics (mutual information and mean-squared intensity difference) and two different types of image content (entire image versus bony landmarks) were used. The best solution for each registration pair was selected from 50 optimizing attempts that differed only by the initial transformation parameters. The distance from each individual solution to the best solution in the normalized parametrical space was compared to a user-defined error threshold to determine whether that solution was successful or not. The supervised training was then used to train the RQE. The performance of the RQE was evaluated using the test data set that consisted of registration results that were not used in training. Results: The RQE constructed using the mutual information had very good performance when tested using the test data sets, yielding the sensitivity, the specificity, the positive predictive value, and the negative predictive value in the ranges of 0.960-1.000, 0.993-1.000, 0.983-1.000, and 0.909-1.000, respectively. Adding a RQE into a conventional 3D/3D image registration system incurs only about 10%-20% increase of the overall processing time. Conclusions: The authors' patient study has demonstrated very good performance of the proposed RQE when used with the mutual information in identifying unsuccessful 3D/3D registrations for daily patient setup. The classifier had

  12. Phantom based evaluation of CT to CBCT image registration for proton therapy dose recalculation

    International Nuclear Information System (INIS)

    The ability to perform dose recalculation on the anatomy of the day is important in the context of adaptive proton therapy. The objective of this study was to investigate the use of deformable image registration (DIR) and cone beam CT (CBCT) imaging to generate the daily stopping power distribution of the patient. We investigated the deformation of the planning CT scan (pCT) onto daily CBCT images to generate a virtual CT (vCT) using a deformable phantom designed for the head and neck (H and N) region. The phantom was imaged at a planning CT scanner in planning configuration, yielding a pCT and in deformed, treatment day configuration, yielding a reference CT (refCT). The treatment day configuration was additionally scanned at a CBCT scanner. A Morphons DIR algorithm was used to generate a vCT. The accuracy of the vCT was evaluated by comparison to the refCT in terms of corresponding features as identified by an adaptive scale invariant feature transform (aSIFT) algorithm. Additionally, the vCT CT numbers were compared to those of the refCT using both profiles and regions of interest and the volumes and overlap (DICE coefficients) of various phantom structures were compared. The water equivalent thickness (WET) of the vCT, refCT and pCT were also compared to evaluate proton range differences. Proton dose distributions from the same initial fluence were calculated on the refCT, vCT and pCT and compared in terms of proton range. The method was tested on a clinical dataset using a replanning CT scan acquired close in time to a CBCT scan as reference using the WET evaluation. Results from the aSIFT investigation suggest a deformation accuracy of 2–3 mm. The use of the Morphon algorithm did not distort CT number intensity in uniform regions and WET differences between vCT and refCT were of the order of 2% of the proton range. This result was confirmed by proton dose calculations. The patient results were consistent with phantom observations. In conclusion, our

  13. Efficient Hyperelastic Regularization for Registration

    DEFF Research Database (Denmark)

    Darkner, Sune; Hansen, Michael S; Larsen, Rasmus;

    2011-01-01

    penalization of the eigen values of the stress tensor. We present a computational framework for regularization of image registration for isotropic hyper elasticity. We formulate an efficient and parallel scheme for computing the principal stain based for a given parameterization by decomposing the left Cauchy...... elastic priors such at the Saint Vernant Kirchoff model, the Ogden material model or Riemanian elasticity. We exemplify the approach through synthetic registration and special tests as well as registration of different modalities; 2D cardiac MRI and 3D surfaces of the human ear. The artificial examples...

  14. Evolution of surface-based deformable image registration for adaptive radiotherapy of non-small cell lung cancer (NSCLC)

    International Nuclear Information System (INIS)

    To evaluate the performance of surface-based deformable image registration (DR) for adaptive radiotherapy of non-small cell lung cancer (NSCLC). Based on 13 patients with locally advanced NSCLC, CT images acquired at treatment planning, midway and the end of the radio- (n = 1) or radiochemotherapy (n = 12) course were used for evaluation of DR. All CT images were manually [gross tumor volume (GTV)] and automatically [organs-at-risk (OAR) lung, spinal cord, vertebral spine, trachea, aorta, outline] segmented. Contours were transformed into 3D meshes using the Pinnacle treatment planning system and corresponding mesh points defined control points for DR with interpolation within the structures. Using these deformation maps, follow-up CT images were transformed into the planning images and compared with the original planning CT images. A progressive tumor shrinkage was observed with median GTV volumes of 170 cm3 (range 42 cm3 - 353 cm3), 124 cm3 (19 cm3 - 325 cm3) and 100 cm3 (10 cm3 - 270 cm3) at treatment planning, mid-way and at the end of treatment. Without DR, correlation coefficients (CC) were 0.76 ± 0.11 and 0.74 ± 0.10 for comparison of the planning CT and the CT images acquired mid-way and at the end of treatment, respectively; DR significantly improved the CC to 0.88 ± 0.03 and 0.86 ± 0.05 (p = 0.001), respectively. With manual landmark registration as reference, DR reduced uncertainties on the GTV surface from 11.8 mm ± 5.1 mm to 2.9 mm ± 1.2 mm. Regarding the carina and intrapulmonary vessel bifurcations, DR reduced uncertainties by about 40% with residual errors of 4 mm to 6 mm on average. Severe deformation artefacts were observed in patients with resolving atelectasis and pleural effusion, in one patient, where the tumor was located around large bronchi and separate segmentation of the GTV and OARs was not possible, and in one patient, where no clear shrinkage but more a decay of the tumor was observed. The surface-based DR performed accurately

  15. Multimodal navigated skull base tumor resection using image-based vascular and cranial nerve segmentation: A prospective pilot study

    Directory of Open Access Journals (Sweden)

    Parviz Dolati

    2015-01-01

    Conclusion: Image-based preoperative vascular and neural element segmentation with 3D reconstruction is highly informative preoperatively and could increase the vigilance of neurosurgeons for preventing neurovascular injury during skull base surgeries. Additionally, the accuracy found in this study is superior to previously reported measurements. This novel preliminary study is encouraging for future validation with larger numbers of patients.

  16. Multimodal Processes Rescheduling

    DEFF Research Database (Denmark)

    Bocewicz, Grzegorz; Banaszak, Zbigniew A.; Nielsen, Peter;

    2013-01-01

    -cuted in these kinds of systems can be considered using a declarative modeling framework. Proposed representation provides a unified way for performance evaluation of local cyclic as well as supported by them multimodal processes. The main question regards of reachability of a SCCP cyclic behavior. In this context......Cyclic scheduling problems concerning multimodal processes are usually observed in FMSs producing multi-type parts where the Automated Guided Vehicles System (AGVS) plays a role of a material handling system. Schedulability analysis of concurrently flowing cyclic processes (SCCP) exe......, the sufficient conditions guarantee the reachability of both local and multimodal processes cyclic steady state spaces are discussed....

  17. Performance evaluation of 2D image registration algorithms with the numeric image registration and comparison platform

    International Nuclear Information System (INIS)

    The objective of this work is to present the capabilities of the NUMERICS web platform for evaluation of the performance of image registration algorithms. The NUMERICS platform is a web accessible tool which provides access to dedicated numerical algorithms for registration and comparison of medical images (http://numerics.phys.uni-sofia.bg). The platform allows comparison of noisy medical images by means of different types of image comparison algorithms, which are based on statistical tests for outliers. The platform also allows 2D image registration with different techniques like Elastic Thin-Plate Spline registration, registration based on rigid transformations, affine transformations, as well as non-rigid image registration based on Mobius transformations. In this work we demonstrate how the platform can be used as a tool for evaluation of the quality of the image registration process. We demonstrate performance evaluation of a deformable image registration technique based on Mobius transformations. The transformations are applied with appropriate cost functions like: Mutual information, Correlation coefficient, Sum of Squared Differences. The accent is on the results provided by the platform to the user and their interpretation in the context of the performance evaluation of 2D image registration. The NUMERICS image registration and image comparison platform provides detailed statistical information about submitted image registration jobs and can be used to perform quantitative evaluation of the performance of different image registration techniques. (authors)

  18. A Pipeline for 3D Multimodality Image Integration and Computer-assisted Planning in Epilepsy Surgery

    OpenAIRE

    Nowell, Mark; Rodionov, Roman; Zombori, Gergely; Sparks, Rachel; Rizzi, Michele; Ourselin, Sebastien; Miserocchi, Anna; McEvoy, Andrew; Duncan, John

    2016-01-01

    Epilepsy surgery is challenging and the use of 3D multimodality image integration (3DMMI) to aid presurgical planning is well-established. Multimodality image integration can be technically demanding, and is underutilised in clinical practice. We have developed a single software platform for image integration, 3D visualization and surgical planning. Here, our pipeline is described in step-by-step fashion, starting with image acquisition, proceeding through image co-registration, manual segmen...

  19. Comparison of IGRT Registration Strategies for Optimal Coverage of Primary Lung Tumors and Involved Nodes Based on Multiple Four-Dimensional CT Scans Obtained Throughout the Radiotherapy Course

    International Nuclear Information System (INIS)

    Purpose: To investigate the impact of primary tumor and involved lymph node (LN) geometry (centroid, shape, volume) on internal target volume (ITV) throughout treatment for locally advanced non–small cell lung cancer using weekly four-dimensional computed tomography (4DCT). Methods and Materials: Eleven patients with advanced non–small cell lung cancer were treated using image-guided radiotherapy with acquisition of weekly 10-Phase 4DCTs (n = 51). Initial ITV was based on planning 4DCT. Master-ITV incorporated target geometry across the entire treatment (all 4DCTs). Geographic miss was defined as the % Master-ITV positioned outside of the initial planning ITV after registration is complete. Registration strategies considered were bony (B), primary tumor soft tissue alone (T), and registration based on primary tumor and involved LNs (TLN). Results: The % geographic miss for the primary tumor, mediastinal, and hilar lymph nodes based on each registration strategy were (1) B: 30%, 30%, 30%; (2) T: 21%, 40%, 36%; and (3) TLN: 26%, 26%, 27%. Mean geographic expansions to encompass 100% of the primary tumor and involved LNs were 1.2 ± 0.7 cm and 0.8 ± 0.3 cm, respectively, for B and TLN. Primary and involved LN expansions were 0.7 ± 0.5 cm and 1.1 ± 0.5 cm for T. Conclusion: T is best for solitary targets. When treatments include primary tumor and LNs, B and TLN provide more comprehensive geographic coverage. We have identified high % geographic miss when considering multiple registration strategies. The dosimetric implications are the subject of future study.

  20. Registration-based assessment of regional lung function via volumetric CT images of normal subjects vs. severe asthmatics

    OpenAIRE

    Choi, Sanghun; Eric A Hoffman; Sally E. Wenzel; Tawhai, Merryn H.; Yin, Youbing; Castro, Mario; Lin, Ching-Long

    2013-01-01

    The purpose of this work was to explore the use of image registration-derived variables associated with computed tomographic (CT) imaging of the lung acquired at multiple volumes. As an evaluation of the utility of such an imaging approach, we explored two groups at the extremes of population ranging from normal subjects to severe asthmatics. A mass-preserving image registration technique was employed to match CT images at total lung capacity (TLC) and functional residual capacity (FRC) for a...

  1. Automatic image-to-world registration based on x-ray projections in cone-beam CT-guided interventions

    OpenAIRE

    Hamming, N. M.; Daly, M. J.; Irish, J. C.; Siewerdsen, J. H.

    2009-01-01

    Intraoperative imaging offers a means to account for morphological changes occurring during the procedure and resolve geometric uncertainties via integration with a surgical navigation system. Such integration requires registration of the image and world reference frames, conventionally a time consuming, error-prone manual process. This work presents a method of automatic image-to-world registration of intraoperative cone-beam computed tomography (CBCT) and an optical tracking system. Multimo...

  2. Development and application of pulmonary structure-function registration methods: towards pulmonary image-guidance tools for improved airway targeted therapies and outcomes

    Science.gov (United States)

    Guo, Fumin; Pike, Damien; Svenningsen, Sarah; Coxson, Harvey O.; Drozd, John J.; Yuan, Jing; Fenster, Aaron; Parraga, Grace

    2014-03-01

    Objectives: We aimed to develop a way to rapidly generate multi-modality (MRI-CT) pulmonary imaging structurefunction maps using novel non-rigid image registration methods. This objective is part of our overarching goal to provide an image processing pipeline to generate pulmonary structure-function maps and guide airway-targeted therapies. Methods: Anatomical 1H and functional 3He MRI were acquired in 5 healthy asymptomatic ex-smokers and 7 ex-smokers with chronic obstructive pulmonary disease (COPD) at inspiration breath-hold. Thoracic CT was performed within ten minutes of MRI using the same breath-hold volume. Landmark-based affine registration methods previously validated for imaging of COPD, was based on corresponding fiducial markers located in both CT and 1H MRI coronal slices and compared with shape-based CT-MRI non-rigid registration. Shape-based CT-MRI registration was developed by first identifying the shapes of the lung cavities manually, and then registering the two shapes using affine and thin-plate spline algorithms. We compared registration accuracy using the fiducial localization error (FLE) and target registration error (TRE). Results: For landmark-based registration, the TRE was 8.4±5.3 mm for whole lung and 7.8±4.6 mm for the R and L lungs registered independently (p=0.4). For shape-based registration, the TRE was 8.0±4.6 mm for whole lung as compared to 6.9±4.4 mm for the R and L lung registered independently and this difference was significant (p=0.01). The difference for shape-based (6.9±4.4 mm) and landmark-based R and L lung registration (7.8±4.6 mm) was also significant (p=.04) Conclusion: Shape-based registration TRE was significantly improved compared to landmark-based registration when considering L and R lungs independently.

  3. Mass Preserving Image Registration

    DEFF Research Database (Denmark)

    Gorbunova, V.; Sporring, J.; Lo, P.;

    2010-01-01

    The paper presents results the mass preserving image registration method in the Evaluation of Methods for Pulmonary Image Registration 2010 (EMPIRE10) Challenge. The mass preserving image registration algorithm was applied to the 20 image pairs. Registration was evaluated using four different...

  4. A 3D global-to-local deformable mesh model based registration and anatomy-constrained segmentation method for image guided prostate radiotherapy

    International Nuclear Information System (INIS)

    Purpose: In the external beam radiation treatment of prostate cancers, successful implementation of adaptive radiotherapy and conformal radiation dose delivery is highly dependent on precise and expeditious segmentation and registration of the prostate volume between the simulation and the treatment images. The purpose of this study is to develop a novel, fast, and accurate segmentation and registration method to increase the computational efficiency to meet the restricted clinical treatment time requirement in image guided radiotherapy. Methods: The method developed in this study used soft tissues to capture the transformation between the 3D planning CT (pCT) images and 3D cone-beam CT (CBCT) treatment images. The method incorporated a global-to-local deformable mesh model based registration framework as well as an automatic anatomy-constrained robust active shape model (ACRASM) based segmentation algorithm in the 3D CBCT images. The global registration was based on the mutual information method, and the local registration was to minimize the Euclidian distance of the corresponding nodal points from the global transformation of deformable mesh models, which implicitly used the information of the segmented target volume. The method was applied on six data sets of prostate cancer patients. Target volumes delineated by the same radiation oncologist on the pCT and CBCT were chosen as the benchmarks and were compared to the segmented and registered results. The distance-based and the volume-based estimators were used to quantitatively evaluate the results of segmentation and registration. Results: The ACRASM segmentation algorithm was compared to the original active shape model (ASM) algorithm by evaluating the values of the distance-based estimators. With respect to the corresponding benchmarks, the mean distance ranged from -0.85 to 0.84 mm for ACRASM and from -1.44 to 1.17 mm for ASM. The mean absolute distance ranged from 1.77 to 3.07 mm for ACRASM and from 2.45 to

  5. A 3D global-to-local deformable mesh model based registration and anatomy-constrained segmentation method for image guided prostate radiotherapy

    Energy Technology Data Exchange (ETDEWEB)

    Zhou Jinghao; Kim, Sung; Jabbour, Salma; Goyal, Sharad; Haffty, Bruce; Chen, Ting; Levinson, Lydia; Metaxas, Dimitris; Yue, Ning J. [Department of Radiation Oncology, UMDNJ-Robert Wood Johnson Medical School, Cancer Institute of New Jersey, New Brunswick, New Jersey 08903 (United States); Department of Bioinformatics, UMDNJ-Robert Wood Johnson Medical School, Cancer Institute of New Jersey, New Brunswick, New Jersey 08903 (United States); Department of Radiation Oncology, UMDNJ-Robert Wood Johnson Medical School, Cancer Institute of New Jersey, New Brunswick, New Jersey 08903 (United States); Department of Computer Science, Rutgers, State University of New Jersey, Piscataway, New Jersey 08854 (United States); Department of Radiation Oncology, UMDNJ-Robert Wood Johnson Medical School, Cancer Institute of New Jersey, New Brunswick, New Jersey 08903 (United States)

    2010-03-15

    Purpose: In the external beam radiation treatment of prostate cancers, successful implementation of adaptive radiotherapy and conformal radiation dose delivery is highly dependent on precise and expeditious segmentation and registration of the prostate volume between the simulation and the treatment images. The purpose of this study is to develop a novel, fast, and accurate segmentation and registration method to increase the computational efficiency to meet the restricted clinical treatment time requirement in image guided radiotherapy. Methods: The method developed in this study used soft tissues to capture the transformation between the 3D planning CT (pCT) images and 3D cone-beam CT (CBCT) treatment images. The method incorporated a global-to-local deformable mesh model based registration framework as well as an automatic anatomy-constrained robust active shape model (ACRASM) based segmentation algorithm in the 3D CBCT images. The global registration was based on the mutual information method, and the local registration was to minimize the Euclidian distance of the corresponding nodal points from the global transformation of deformable mesh models, which implicitly used the information of the segmented target volume. The method was applied on six data sets of prostate cancer patients. Target volumes delineated by the same radiation oncologist on the pCT and CBCT were chosen as the benchmarks and were compared to the segmented and registered results. The distance-based and the volume-based estimators were used to quantitatively evaluate the results of segmentation and registration. Results: The ACRASM segmentation algorithm was compared to the original active shape model (ASM) algorithm by evaluating the values of the distance-based estimators. With respect to the corresponding benchmarks, the mean distance ranged from -0.85 to 0.84 mm for ACRASM and from -1.44 to 1.17 mm for ASM. The mean absolute distance ranged from 1.77 to 3.07 mm for ACRASM and from 2.45 to

  6. Multimodality imaging of pulmonary infarction

    International Nuclear Information System (INIS)

    Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis

  7. Multimodality imaging of pulmonary infarction

    Energy Technology Data Exchange (ETDEWEB)

    Bray, T.J.P., E-mail: timothyjpbray@gmail.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); Mortensen, K.H., E-mail: mortensen@doctors.org.uk [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); University Department of Radiology, Addenbrookes Hospital, Cambridge University Hospitals NHS Foundation Trust, Hills Road, Box 318, Cambridge CB2 0QQ (United Kingdom); Gopalan, D., E-mail: deepa.gopalan@btopenworld.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom)

    2014-12-15

    Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis.

  8. Blade tip clearance measurement of the turbine engines based on a multi-mode fiber coupled laser ranging system

    Energy Technology Data Exchange (ETDEWEB)

    Guo, Haotian; Duan, Fajie; Wu, Guoxiu; Zhang, Jilong [State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072 (China)

    2014-11-15

    The blade tip clearance is a parameter of great importance to guarantee the efficiency and safety of the turbine engines. In this article, a laser ranging system designed for blade tip clearance measurement is presented. Multi-mode fiber is utilized for optical transmission to guarantee that enough optical power is received by the sensor probe. The model of the tiny sensor probe is presented. The error brought by the optical path difference of different modes of the fiber is estimated and the length of the fiber is limited to reduce this error. The measurement range in which the optical power received by the probe remains essentially unchanged is analyzed. Calibration experiments and dynamic experiments are conducted. The results of the calibration experiments indicate that the resolution of the system is about 0.02 mm and the range of the system is about 9 mm.

  9. Blade tip clearance measurement of the turbine engines based on a multi-mode fiber coupled laser ranging system

    International Nuclear Information System (INIS)

    The blade tip clearance is a parameter of great importance to guarantee the efficiency and safety of the turbine engines. In this article, a laser ranging system designed for blade tip clearance measurement is presented. Multi-mode fiber is utilized for optical transmission to guarantee that enough optical power is received by the sensor probe. The model of the tiny sensor probe is presented. The error brought by the optical path difference of different modes of the fiber is estimated and the length of the fiber is limited to reduce this error. The measurement range in which the optical power received by the probe remains essentially unchanged is analyzed. Calibration experiments and dynamic experiments are conducted. The results of the calibration experiments indicate that the resolution of the system is about 0.02 mm and the range of the system is about 9 mm

  10. Complementary Metal Oxide Semiconductor Based Multimodal Sensor for In vivo Brain Function Imaging with a Function for Simultaneous Cell Stimulation

    Science.gov (United States)

    Tagawa, Ayato; Mitani, Masahiro; Minami, Hiroki; Noda, Toshihiko; Sasagawa, Kiyotaka; Tokuda, Takashi; Ohta, Jun

    2010-04-01

    We have developed a multimodal complementary metal oxide semiconductor (CMOS) sensor device embedded with Au electrodes for fluorescent imaging and cell stimulation in the deep brain of mice. The Au electrodes were placed on the pixel array of the image sensor. Windows over the photodiodes were opened in the electrode area for simultaneous fluorescent imaging and cell stimulation in the same area of the brain tissue. The sensor chip was shaped like a shank and was packaged by two packaging methods for high strength or minimal invasion. The experimental results showed that the 90 ×90 µm2 Au electrodes with windows were capable of injecting theta burst stimulation (TBS)-like current pulses at 0.2-1 mA in a saline solution. We successfully demonstrated that fluorescent imaging and TBS-like current injection can be simultaneously performed in the electrode area of a brain phantom.

  11. A community intervention trial of multimodal suicide prevention program in Japan: A Novel multimodal Community Intervention program to prevent suicide and suicide attempt in Japan, NOCOMIT-J

    Directory of Open Access Journals (Sweden)

    Suzuki Yuriko

    2008-09-01

    Full Text Available Abstract Background To respond to the rapid surge in the incidence of suicide in Japan, which appears to be an ongoing trend, the Japanese Multimodal Intervention Trials for Suicide Prevention (J-MISP have launched a multimodal community-based suicide prevention program, NOCOMIT-J. The primary aim of this study is to examine whether NOCOMIT-J is effective in reducing suicidal behavior in the community. Methods/DesignThis study is a community intervention trial involving seven intervention regions with accompanying control regions, all with populations of statistically sufficient size. The program focuses on building social support networks in the public health system for suicide prevention and mental health promotion, intending to reinforce human relationships in the community. The intervention program components includes a primary prevention measures of awareness campaign for the public and key personnel, secondary prevention measures for screening of, and assisting, high-risk individuals, after-care for individuals bereaved by suicide, and other measures. The intervention started in July 2006, and will continue for 3.5 years. Participants are Japanese and foreign residents living in the intervention and control regions (a total of population of 2,120,000 individuals. Discussion The present study is designed to evaluate the effectiveness of the community-based suicide prevention program in the seven participating areas. Trial registration UMIN Clinical Trials Registry (UMIN-CTR UMIN000000460.

  12. Automatic Registration of Approximately Leveled Point Clouds of Urban Scenes

    Science.gov (United States)

    Moussa, A.; Elsheimy, N.

    2015-08-01

    Registration of point clouds is a necessary step to obtain a complete overview of scanned objects of interest. The majority of the current registration approaches target the general case where a full range of the registration parameters search space is assumed and searched. It is very common in urban objects scanning to have leveled point clouds with small roll and pitch angles and with also a small height differences. For such scenarios the registration search problem can be handled faster to obtain a coarse registration of two point clouds. In this paper, a fully automatic approach is proposed for registration of approximately leveled point clouds. The proposed approach estimates a coarse registration based on three registration parameters and then conducts a fine registration step using iterative closest point approach. The approach has been tested on three data sets of different areas and the achieved registration results validate the significance of the proposed approach.

  13. SU-C-18A-05: Registration Accuracy of MR-Based Images to On-Board Megavoltage Cone-Beam CT for Brain Patient Setup

    International Nuclear Information System (INIS)

    Purpose: To quantify the difference in isocenter shifts when co-registering MR and MR-based pseudo CTs (pCT) with on-board megavoltage conebeam CT (CBCT) images. Methods: Fast Spoiled Gradient Echo MRs were used to generate pCTs (research version of Advantage Sim MD™, GE Healthcare) for ten patients who had prior brain radiotherapy. The planning CT (rCT) for each was co-registered with the MR, and the plan isocenter and two other reference points were transferred to the MR and pCT. CBCT images (with the machine isocenter) from a single treatment day were coregistered with the 3 test images (MR, pCT and rCT), by two observers and by an automated registration algorithm. The reference points were used to calculate patient shifts and rotations from the registrations. The shifts calculated from the test image registrations were compared to each other and to the shifts performed by the therapists who treated the patients on that day. Results: The average difference in absolute value between the isocenter shifts from the MR-, pCT- and rCT-CBCT registrations, and the therapist shifts, were 2.02, 3.01 and 0.89 mm (craniocaudal), 1.14, 1.34 and 0.46 mm (lateral), and 1.37, 3.43 and 1.43 mm (vertical), respectively. The MR- and pCT-CBCT registrations differed by 1.99, and 2.53 mm (craniocaudal), 1.36, and 1.37 mm (lateral), and 0.74 and 2.34 mm (vertical), respectively, from the average rCT-CBCT shifts. On average, differences of 2.39 (craniocaudal), 1.28 (lateral) and 2.84 mm (vertical) were seen between the MR and pCT shifts. Rotations relative to the CBCT coordinate system were on average <2° for the MR and rCT, and <6° for the pCT. Conclusion: In this study, FSPGR MR-CBCT registrations were more precise compared to the pCT-CBCT registrations. For improved accuracy, MR sequences that are optimal for bony anatomy visualization are necessary. GE healthcare has provided a research version of Advantage Sim MD to UCSF. No financial support was provided

  14. Discriminating between intentional and unintentional gaze fixation using multimodal-based fuzzy logic algorithm for gaze tracking system with NIR camera sensor

    Science.gov (United States)

    Naqvi, Rizwan Ali; Park, Kang Ryoung

    2016-06-01

    Gaze tracking systems are widely used in human-computer interfaces, interfaces for the disabled, game interfaces, and for controlling home appliances. Most studies on gaze detection have focused on enhancing its accuracy, whereas few have considered the discrimination of intentional gaze fixation (looking at a target to activate or select it) from unintentional fixation while using gaze detection systems. Previous research methods based on the use of a keyboard or mouse button, eye blinking, and the dwell time of gaze position have various limitations. Therefore, we propose a method for discriminating between intentional and unintentional gaze fixation using a multimodal fuzzy logic algorithm applied to a gaze tracking system with a near-infrared camera sensor. Experimental results show that the proposed method outperforms the conventional method for determining gaze fixation.

  15. High-performance GPU-based rendering for real-time, rigid 2D/3D-image registration and motion prediction in radiation oncology

    International Nuclear Information System (INIS)

    A common problem in image-guided radiation therapy (IGRT) of lung cancer as well as other malignant diseases is the compensation of periodic and aperiodic motion during dose delivery. Modern systems for image-guided radiation oncology allow for the acquisition of cone-beam computed tomography data in the treatment room as well as the acquisition of planar radiographs during the treatment. A mid-term research goal is the compensation of tumor target volume motion by 2D/3D Registration. In 2D/3D registration, spatial information on organ location is derived by an iterative comparison of perspective volume renderings, so-called digitally rendered radiographs (DRR) from computed tomography volume data, and planar reference X-rays. Currently, this rendering process is very time consuming, and real-time registration, which should at least provide data on organ position in less than a second, has not come into existence. We present two GPU-based rendering algorithms which generate a DRR of 512 x 512 pixels size from a CT dataset of 53 MB size at a pace of almost 100 Hz. This rendering rate is feasible by applying a number of algorithmic simplifications which range from alternative volume-driven rendering approaches - namely so-called wobbled splatting - to sub-sampling of the DRR-image by means of specialized raycasting techniques. Furthermore, general purpose graphics processing unit (GPGPU) programming paradigms were consequently utilized. Rendering quality and performance as well as the influence on the quality and performance of the overall registration process were measured and analyzed in detail. The results show that both methods are competitive and pave the way for fast motion compensation by rigid and possibly even non-rigid 2D/3D registration and, beyond that, adaptive filtering of motion models in IGRT. (orig.)

  16. Adequacy of inhale/exhale breathhold CT based ITV margins and image-guided registration for free-breathing pancreas and liver SBRT

    International Nuclear Information System (INIS)

    To evaluate use of breath-hold CTs and implanted fiducials for definition of the internal target volume (ITV) margin for upper abdominal stereotactic body radiation therapy (SBRT). To study the statistics of inter- and intra-fractional motion information. 11 patients treated with SBRT for locally advanced pancreatic cancer (LAPC) or liver cancer were included in the study. Patients underwent fiducial implantation, free-breathing CT and breath-hold CTs at end inhalation/exhalation. All patients were planned and treated with SBRT using volumetric modulated arc therapy (VMAT). Two margin strategies were studied: Strategy I uses PTV = ITV + 3 mm; Strategy II uses PTV = GTV + 1.5 cm. Both CBCT and kV orthogonal images were taken and analyzed for setup before patient treatments. Tumor motion statistics based on skeletal registration and on fiducial registration were analyzed by fitting to Gaussian functions. All 11 patients met SBRT planning dose constraints using strategy I. Average ITV margins for the 11 patients were 2 mm RL, 6 mm AP, and 6 mm SI. Skeletal registration resulted in high probability (RL = 69%, AP = 4.6%, SI = 39%) that part of the tumor will be outside the ITV. With the 3 mm ITV expansion (Strategy 1), the probability reduced to RL 32%, AP 0.3%, SI 20% for skeletal registration; and RL 1.2%, AP 0%, SI 7% for fiducial registration. All 7 pancreatic patients and 2 liver patients failed to meet SBRT dose constraints using strategy II. The liver dose was increased by 36% for the other 2 liver patients that met the SBRT dose constraints with strategy II. Image guidance matching to skeletal anatomy is inadequate for SBRT positioning in the upper abdomen and usage of fiducials is highly recommended. Even with fiducial implantation and definition of an ITV, a minimal 3 mm planning margin around the ITV is needed to accommodate intra-fractional uncertainties

  17. Automatic and robust method for registration of optical imagery with point cloud data

    Science.gov (United States)

    Wu, Yingdan; Ming, Yang

    2015-12-01

    Aim to the difficulty of automatic and robust registration of optical imagery with point cloud data, this paper propose a new method based on SIFT and Mutual Information (MI). The SIFT features are firstly extracted and matched, whose result is used to derive the coarse geometric relationship between the optical imagery and the point cloud data. Secondly, the MI-based similarity measure is used to derive the conjugate points. And then the RANSAC algorithm is adopted to eliminate the erroneous matching points. Repeating the procedure of MI matching and mismatching points deletion until the finest pyramid image level. Using the matching results, the transform model is determined. The experiments have been made and they demonstrate the potential of the MI-based measure for the registration of optical imagery with the point cloud data, and this highlight the feasibility and robustness of the method proposed in this paper to automated registration of multi-modal, multi-temporal remote sensing data for a wide range of applications.

  18. Voxel-based registration of simulated and real patient CBCT data for accurate dental implant pose estimation

    Science.gov (United States)

    Moreira, António H. J.; Queirós, Sandro; Morais, Pedro; Rodrigues, Nuno F.; Correia, André Ricardo; Fernandes, Valter; Pinho, A. C. M.; Fonseca, Jaime C.; Vilaça, João. L.

    2015-03-01

    The success of dental implant-supported prosthesis is directly linked to the accuracy obtained during implant's pose estimation (position and orientation). Although traditional impression techniques and recent digital acquisition methods are acceptably accurate, a simultaneously fast, accurate and operator-independent methodology is still lacking. Hereto, an image-based framework is proposed to estimate the patient-specific implant's pose using cone-beam computed tomography (CBCT) and prior knowledge of implanted model. The pose estimation is accomplished in a threestep approach: (1) a region-of-interest is extracted from the CBCT data using 2 operator-defined points at the implant's main axis; (2) a simulated CBCT volume of the known implanted model is generated through Feldkamp-Davis-Kress reconstruction and coarsely aligned to the defined axis; and (3) a voxel-based rigid registration is performed to optimally align both patient and simulated CBCT data, extracting the implant's pose from the optimal transformation. Three experiments were performed to evaluate the framework: (1) an in silico study using 48 implants distributed through 12 tridimensional synthetic mandibular models; (2) an in vitro study using an artificial mandible with 2 dental implants acquired with an i-CAT system; and (3) two clinical case studies. The results shown positional errors of 67+/-34μm and 108μm, and angular misfits of 0.15+/-0.08° and 1.4°, for experiment 1 and 2, respectively. Moreover, in experiment 3, visual assessment of clinical data results shown a coherent alignment of the reference implant. Overall, a novel image-based framework for implants' pose estimation from CBCT data was proposed, showing accurate results in agreement with dental prosthesis modelling requirements.

  19. Respiratory motion correction in gated cardiac SPECT using quaternion-based, rigid-body registration.

    Science.gov (United States)

    Parker, Jason G; Mair, Bernard A; Gilland, David R

    2009-10-01

    In this article, a new method is introduced for estimating the motion of the heart due to respiration in gated cardiac SPECT using a rigid-body model with rotation parametrized by a unit quaternion. The method is based on minimizing the sum of squared errors between the reference and the deformed frames resulting from the usual optical flow constraint by using an optimized conjugate gradient routine. This method does not require any user-defined parameters or penalty terms, which simplifies its use in a clinical setting. Using a mathematical phantom, the method was quantitatively compared to the principal axis method, as well as an iterative method in which the rotation matrix was represented by Euler angles. The quaternion-based method was shown to be substantially more accurate and robust across a wide range of extramyocardial activity levels than the principal axis method. Compared with the Euler angle representation, the quaternion-based method resulted in similar accuracy but a significant reduction in computation times. Finally, the quaternion-based method was investigated using a respiratory-gated cardiac SPECT acquisition of a human subject. The motion-corrected image has increased sharpness and myocardial uniformity compared to the uncorrected image. PMID:19928105

  20. POND4Kids: a web-based pediatric cancer database for hospital-based cancer registration and clinical collaboration.

    Science.gov (United States)

    Quintana, Yuri; Patel, Aman N; Naidu, Paula E; Howard, Scott C; Antillon, Federico A; Ribeiro, Raul C

    2011-01-01

    The Pediatric Oncology Network Database, POND4Kids (www.pond4kids.org, POND), is an online, multilingual clinical database created for use by pediatric oncology units in countries with limited resources to meet various clinical data management needs including cancer registration, data collection and changes in treatment outcome. Established as a part of the International Outreach Program at St. Jude Children's Research Hospital in Memphis, Tennessee, POND aims to provide oncology units a tool to store patient data for easy retrieval and analysis and to achieve uniform data collection to facilitate meaningful comparison of information among centers. Currently, POND is being used to store clinical data on thousands of patients and measure their treatment improvement over a period of time. In 2009 POND included more than 100 pediatric oncology units; each has its own virtual private area. A case study of the UNOP Guatemala Clinic's use of POND is presented. On-going challenges at partner sites include inconsistent data collection methods, missing records, training for data managers, and slow or unreliable internet connections. PMID:21335715