WorldWideScience

Sample records for based multimodal registration

  1. Spectral embedding-based registration (SERg) for multimodal fusion of prostate histology and MRI

    Science.gov (United States)

    Hwuang, Eileen; Rusu, Mirabela; Karthigeyan, Sudha; Agner, Shannon C.; Sparks, Rachel; Shih, Natalie; Tomaszewski, John E.; Rosen, Mark; Feldman, Michael; Madabhushi, Anant

    2014-03-01

    Multi-modal image registration is needed to align medical images collected from different protocols or imaging sources, thereby allowing the mapping of complementary information between images. One challenge of multimodal image registration is that typical similarity measures rely on statistical correlations between image intensities to determine anatomical alignment. The use of alternate image representations could allow for mapping of intensities into a space or representation such that the multimodal images appear more similar, thus facilitating their co-registration. In this work, we present a spectral embedding based registration (SERg) method that uses non-linearly embedded representations obtained from independent components of statistical texture maps of the original images to facilitate multimodal image registration. Our methodology comprises the following main steps: 1) image-derived textural representation of the original images, 2) dimensionality reduction using independent component analysis (ICA), 3) spectral embedding to generate the alternate representations, and 4) image registration. The rationale behind our approach is that SERg yields embedded representations that can allow for very different looking images to appear more similar, thereby facilitating improved co-registration. Statistical texture features are derived from the image intensities and then reduced to a smaller set by using independent component analysis to remove redundant information. Spectral embedding generates a new representation by eigendecomposition from which only the most important eigenvectors are selected. This helps to accentuate areas of salience based on modality-invariant structural information and therefore better identifies corresponding regions in both the template and target images. The spirit behind SERg is that image registration driven by these areas of salience and correspondence should improve alignment accuracy. In this work, SERg is implemented using Demons

  2. Mesh-to-raster region-of-interest-based nonrigid registration of multimodal images.

    Science.gov (United States)

    Tatano, Rosalia; Berkels, Benjamin; Deserno, Thomas M

    2017-10-01

    Region of interest (RoI) alignment in medical images plays a crucial role in diagnostics, procedure planning, treatment, and follow-up. Frequently, a model is represented as triangulated mesh while the patient data is provided from computed axial tomography scanners as pixel or voxel data. Previously, we presented a 2-D method for curve-to-pixel registration. This paper contributes (i) a general mesh-to-raster framework to register RoIs in multimodal images; (ii) a 3-D surface-to-voxel application, and (iii) a comprehensive quantitative evaluation in 2-D using ground truth (GT) provided by the simultaneous truth and performance level estimation (STAPLE) method. The registration is formulated as a minimization problem, where the objective consists of a data term, which involves the signed distance function of the RoI from the reference image and a higher order elastic regularizer for the deformation. The evaluation is based on quantitative light-induced fluoroscopy (QLF) and digital photography (DP) of decalcified teeth. STAPLE is computed on 150 image pairs from 32 subjects, each showing one corresponding tooth in both modalities. The RoI in each image is manually marked by three experts (900 curves in total). In the QLF-DP setting, our approach significantly outperforms the mutual information-based registration algorithm implemented with the Insight Segmentation and Registration Toolkit and Elastix.

  3. Development of a hardware-based registration system for the multimodal medical images by USB cameras

    International Nuclear Information System (INIS)

    Iwata, Michiaki; Minato, Kotaro; Watabe, Hiroshi; Koshino, Kazuhiro; Yamamoto, Akihide; Iida, Hidehiro

    2009-01-01

    There are several medical imaging scanners and each modality has different aspect for visualizing inside of human body. By combining these images, diagnostic accuracy could be improved, and therefore, several attempts for multimodal image registration have been implemented. One popular approach is to use hybrid image scanners such as positron emission tomography (PET)/CT and single photon emission computed tomography (SPECT)/CT. However, these hybrid scanners are expensive and not fully available. We developed multimodal image registration system with universal serial bus (USB) cameras, which is inexpensive and applicable to any combinations of existed conventional imaging scanners. The multiple USB cameras will determine the three dimensional positions of a patient while scanning. Using information of these positions and rigid body transformation, the acquired image is registered to the common coordinate which is shared with another scanner. For each scanner, reference marker is attached on gantry of the scanner. For observing the reference marker's position by the USB cameras, the location of the USB cameras can be arbitrary. In order to validate the system, we scanned a cardiac phantom with different positions by PET and MRI scanners. Using this system, images from PET and MRI were visually aligned, and good correlations between PET and MRI images were obtained after the registration. The results suggest this system can be inexpensively used for multimodal image registrations. (author)

  4. Registration for Optical Multimodal Remote Sensing Images Based on FAST Detection, Window Selection, and Histogram Specification

    Directory of Open Access Journals (Sweden)

    Xiaoyang Zhao

    2018-04-01

    Full Text Available In recent years, digital frame cameras have been increasingly used for remote sensing applications. However, it is always a challenge to align or register images captured with different cameras or different imaging sensor units. In this research, a novel registration method was proposed. Coarse registration was first applied to approximately align the sensed and reference images. Window selection was then used to reduce the search space and a histogram specification was applied to optimize the grayscale similarity between the images. After comparisons with other commonly-used detectors, the fast corner detector, FAST (Features from Accelerated Segment Test, was selected to extract the feature points. The matching point pairs were then detected between the images, the outliers were eliminated, and geometric transformation was performed. The appropriate window size was searched and set to one-tenth of the image width. The images that were acquired by a two-camera system, a camera with five imaging sensors, and a camera with replaceable filters mounted on a manned aircraft, an unmanned aerial vehicle, and a ground-based platform, respectively, were used to evaluate the performance of the proposed method. The image analysis results showed that, through the appropriate window selection and histogram specification, the number of correctly matched point pairs had increased by 11.30 times, and that the correct matching rate had increased by 36%, compared with the results based on FAST alone. The root mean square error (RMSE in the x and y directions was generally within 0.5 pixels. In comparison with the binary robust invariant scalable keypoints (BRISK, curvature scale space (CSS, Harris, speed up robust features (SURF, and commercial software ERDAS and ENVI, this method resulted in larger numbers of correct matching pairs and smaller, more consistent RMSE. Furthermore, it was not necessary to choose any tie control points manually before registration

  5. [Multimodal medical image registration using cubic spline interpolation method].

    Science.gov (United States)

    He, Yuanlie; Tian, Lianfang; Chen, Ping; Wang, Lifei; Ye, Guangchun; Mao, Zongyuan

    2007-12-01

    Based on the characteristic of the PET-CT multimodal image series, a novel image registration and fusion method is proposed, in which the cubic spline interpolation method is applied to realize the interpolation of PET-CT image series, then registration is carried out by using mutual information algorithm and finally the improved principal component analysis method is used for the fusion of PET-CT multimodal images to enhance the visual effect of PET image, thus satisfied registration and fusion results are obtained. The cubic spline interpolation method is used for reconstruction to restore the missed information between image slices, which can compensate for the shortage of previous registration methods, improve the accuracy of the registration, and make the fused multimodal images more similar to the real image. Finally, the cubic spline interpolation method has been successfully applied in developing 3D-CRT (3D Conformal Radiation Therapy) system.

  6. Post-operative assessment in Deep Brain Stimulation based on multimodal images: registration workflow and validation

    Science.gov (United States)

    Lalys, Florent; Haegelen, Claire; Abadie, Alexandre; Jannin, Pierre

    2009-02-01

    Object Movement disorders in Parkinson disease patients may require functional surgery, when medical therapy isn't effective. In Deep Brain Stimulation (DBS) electrodes are implanted within the brain to stimulate deep structures such as SubThalamic Nucleus (STN). This paper describes successive steps for constructing a digital Atlas gathering patient's location of electrodes and contacts for post operative assessment. Materials and Method 12 patients who had undergone bilateral STN DBS have participated to the study. Contacts on post-operative CT scans were automatically localized, based on black artefacts. For each patient, post operative CT images were rigidly registered to pre operative MR images. Then, pre operative MR images were registered to a MR template (super-resolution Collin27 average MRI template). This last registration was the combination of global affine, local affine and local non linear registrations, respectively. Four different studies were performed in order to validate the MR patient to template registration process, based on anatomical landmarks and clinical scores (i.e., Unified Parkinson's disease rating Scale). Visualisation software was developed for displaying into the template images the stimulated contacts represented as cylinders with a colour code related to the improvement of the UPDRS. Results The automatic contact localization algorithm was successful for all the patients. Validation studies for the registration process gave a placement error of 1.4 +/- 0.2 mm and coherence with UPDRS scores. Conclusion The developed visualization tool allows post-operative assessment for previous interventions. Correlation with additional clinical scores will certainly permit to learn more about DBS and to better understand clinical side-effects.

  7. Distance-Dependent Multimodal Image Registration for Agriculture Tasks

    OpenAIRE

    Berenstein, Ron; Hočevar, Marko; Godeša, Tone; Edan, Yael; Ben-Shahar, Ohad

    2015-01-01

    Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal sensory systems and operate in natural environments. While not limited to any particular modalities; here we focus on systems with visual and thermal sensory inputs. Our approach is based on pre-cali...

  8. Multimodality image registration with software: state-of-the-art.

    Science.gov (United States)

    Slomka, Piotr J; Baum, Richard P

    2009-03-01

    Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans "paved the way" for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available.

  9. Dimensionality reduction of medical image descriptors for multimodal image registration

    Directory of Open Access Journals (Sweden)

    Degen Johanna

    2015-09-01

    Full Text Available Defining similarity forms a challenging and relevant research topic in multimodal image registration. The frequently used mutual information disregards contextual information, which is shared across modalities. A recent popular approach, called modality independent neigh-bourhood descriptor, is based on local self-similarities of image patches and is therefore able to capture spatial information. This image descriptor generates vectorial representations, i.e. it is multidimensional, which results in a disadvantage in terms of computation time. In this work, we present a problem-adapted solution for dimensionality reduction, by using principal component analysis and Horn’s parallel analysis. Furthermore, the influence of dimensionality reduction in global rigid image registration is investigated. It is shown that the registration results obtained from the reduced descriptor have the same high quality in comparison to those found for the original descriptor.

  10. Distance-Dependent Multimodal Image Registration for Agriculture Tasks.

    Science.gov (United States)

    Berenstein, Ron; Hočevar, Marko; Godeša, Tone; Edan, Yael; Ben-Shahar, Ohad

    2015-08-21

    Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal sensory systems and operate in natural environments. While not limited to any particular modalities; here we focus on systems with visual and thermal sensory inputs. Our approach is based on pre-calibrating a distance-dependent transformation matrix (DDTM) between the sensors; and representing it in a compact way by regressing the distance-dependent coefficients as distance-dependent functions. The DDTM is measured by calculating a projective transformation matrix for varying distances between the sensors and possible targets. To do so we designed a unique experimental setup including unique Artificial Control Points (ACPs) and their detection algorithms for the two sensors. We demonstrate the utility of our approach using different experiments and evaluation criteria.

  11. Distance-Dependent Multimodal Image Registration for Agriculture Tasks

    Directory of Open Access Journals (Sweden)

    Ron Berenstein

    2015-08-01

    Full Text Available Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal sensory systems and operate in natural environments. While not limited to any particular modalities; here we focus on systems with visual and thermal sensory inputs. Our approach is based on pre-calibrating a distance-dependent transformation matrix (DDTM between the sensors; and representing it in a compact way by regressing the distance-dependent coefficients as distance-dependent functions. The DDTM is measured by calculating a projective transformation matrix for varying distances between the sensors and possible targets. To do so we designed a unique experimental setup including unique Artificial Control Points (ACPs and their detection algorithms for the two sensors. We demonstrate the utility of our approach using different experiments and evaluation criteria.

  12. Graph-based surface extraction of the liver using locally adaptive priors for multimodal interventional image registration

    NARCIS (Netherlands)

    Kadoury, S.; Wood, B.; Venkatesan, A.; Ardon, R.; Jago, J.; Kruecker, J.

    2011-01-01

    The 3D fusion of tracked ultrasound with a diagnostic CT image has multiple benefits in a variety of interventional applications for oncology. Still, manual registration is a considerable drawback to theclinical workflow and hinders the widespread clinical adoption of this technique. In this paper,

  13. Improving supervised classification accuracy using non-rigid multimodal image registration: detecting prostate cancer

    Science.gov (United States)

    Chappelow, Jonathan; Viswanath, Satish; Monaco, James; Rosen, Mark; Tomaszewski, John; Feldman, Michael; Madabhushi, Anant

    2008-03-01

    Computer-aided diagnosis (CAD) systems for the detection of cancer in medical images require precise labeling of training data. For magnetic resonance (MR) imaging (MRI) of the prostate, training labels define the spatial extent of prostate cancer (CaP); the most common source for these labels is expert segmentations. When ancillary data such as whole mount histology (WMH) sections, which provide the gold standard for cancer ground truth, are available, the manual labeling of CaP can be improved by referencing WMH. However, manual segmentation is error prone, time consuming and not reproducible. Therefore, we present the use of multimodal image registration to automatically and accurately transcribe CaP from histology onto MRI following alignment of the two modalities, in order to improve the quality of training data and hence classifier performance. We quantitatively demonstrate the superiority of this registration-based methodology by comparing its results to the manual CaP annotation of expert radiologists. Five supervised CAD classifiers were trained using the labels for CaP extent on MRI obtained by the expert and 4 different registration techniques. Two of the registration methods were affi;ne schemes; one based on maximization of mutual information (MI) and the other method that we previously developed, Combined Feature Ensemble Mutual Information (COFEMI), which incorporates high-order statistical features for robust multimodal registration. Two non-rigid schemes were obtained by succeeding the two affine registration methods with an elastic deformation step using thin-plate splines (TPS). In the absence of definitive ground truth for CaP extent on MRI, classifier accuracy was evaluated against 7 ground truth surrogates obtained by different combinations of the expert and registration segmentations. For 26 multimodal MRI-WMH image pairs, all four registration methods produced a higher area under the receiver operating characteristic curve compared to that

  14. Fast and Robust Registration of Multimodal Remote Sensing Images via Dense Orientated Gradient Feature

    Science.gov (United States)

    Ye, Y.

    2017-09-01

    This paper presents a fast and robust method for the registration of multimodal remote sensing data (e.g., optical, LiDAR, SAR and map). The proposed method is based on the hypothesis that structural similarity between images is preserved across different modalities. In the definition of the proposed method, we first develop a pixel-wise feature descriptor named Dense Orientated Gradient Histogram (DOGH), which can be computed effectively at every pixel and is robust to non-linear intensity differences between images. Then a fast similarity metric based on DOGH is built in frequency domain using the Fast Fourier Transform (FFT) technique. Finally, a template matching scheme is applied to detect tie points between images. Experimental results on different types of multimodal remote sensing images show that the proposed similarity metric has the superior matching performance and computational efficiency than the state-of-the-art methods. Moreover, based on the proposed similarity metric, we also design a fast and robust automatic registration system for multimodal images. This system has been evaluated using a pair of very large SAR and optical images (more than 20000 × 20000 pixels). Experimental results show that our system outperforms the two popular commercial software systems (i.e. ENVI and ERDAS) in both registration accuracy and computational efficiency.

  15. FAST AND ROBUST REGISTRATION OF MULTIMODAL REMOTE SENSING IMAGES VIA DENSE ORIENTATED GRADIENT FEATURE

    Directory of Open Access Journals (Sweden)

    Y. Ye

    2017-09-01

    Full Text Available This paper presents a fast and robust method for the registration of multimodal remote sensing data (e.g., optical, LiDAR, SAR and map. The proposed method is based on the hypothesis that structural similarity between images is preserved across different modalities. In the definition of the proposed method, we first develop a pixel-wise feature descriptor named Dense Orientated Gradient Histogram (DOGH, which can be computed effectively at every pixel and is robust to non-linear intensity differences between images. Then a fast similarity metric based on DOGH is built in frequency domain using the Fast Fourier Transform (FFT technique. Finally, a template matching scheme is applied to detect tie points between images. Experimental results on different types of multimodal remote sensing images show that the proposed similarity metric has the superior matching performance and computational efficiency than the state-of-the-art methods. Moreover, based on the proposed similarity metric, we also design a fast and robust automatic registration system for multimodal images. This system has been evaluated using a pair of very large SAR and optical images (more than 20000 × 20000 pixels. Experimental results show that our system outperforms the two popular commercial software systems (i.e. ENVI and ERDAS in both registration accuracy and computational efficiency.

  16. A strategy for multimodal deformable image registration to integrate PET/MR into radiotherapy treatment planning

    International Nuclear Information System (INIS)

    Leibfarth, Sara; Moennich, David; Thorwarth, Daniela; Welz, Stefan; Siegel, Christine; Zips, Daniel; Schwenzer, Nina; Holger Schmidt, Holger

    2013-01-01

    Background: Combined positron emission tomography (PET)/magnetic resonance imaging (MRI) is highly promising for biologically individualized radiotherapy (RT). Hence, the purpose of this work was to develop an accurate and robust registration strategy to integrate combined PET/MR data into RT treatment planning. Material and methods: Eight patient datasets consisting of an FDG PET/computed tomography (CT) and a subsequently acquired PET/MR of the head and neck (HN) region were available. Registration strategies were developed based on CT and MR data only, whereas the PET components were fused with the resulting deformation field. Following a rigid registration, deformable registration was performed with a transform parametrized by B-splines. Three different optimization metrics were investigated: global mutual information (GMI), GMI combined with a bending energy penalty (BEP) for regularization (GMI + BEP) and localized mutual information with BEP (LMI + BEP). Different quantitative registration quality measures were developed, including volumetric overlap and mean distance measures for structures segmented on CT and MR as well as anatomical landmark distances. Moreover, the local registration quality in the tumor region was assessed by the normalized cross correlation (NCC) of the two PET datasets. Results: LMI + BEP yielded the most robust and accurate registration results. For GMI, GMI + BEP and LMI + BEP, mean landmark distances (standard deviations) were 23.9 mm (15.5 mm), 4.8 mm (4.0 mm) and 3.0 mm (1.0 mm), and mean NCC values (standard deviations) were 0.29 (0.29), 0.84 (0.14) and 0.88 (0.06), respectively. Conclusion: Accurate and robust multimodal deformable image registration of CT and MR in the HN region can be performed using a B-spline parametrized transform and LMI + BEP as optimization metric. With this strategy, biologically individualized RT based on combined PET/MRI in terms of dose painting is possible

  17. Multimodal registration of three-dimensional maxillodental cone beam CT and photogrammetry data over time.

    Science.gov (United States)

    Bolandzadeh, N; Bischof, W; Flores-Mir, C; Boulanger, P

    2013-01-01

    In recent years, one of the foci of orthodontics has been on systems for the evaluation of treatment results and the tracking of tissue variations over time. This can be accomplished through analysing three-dimensional orthodontic images obtained before and after the treatments. Since complementary information is achieved by integrating multiple imaging modalities, cone beam CT (CBCT) and stereophotogrammetry technologies are used in this study to develop a method for tracking bone, teeth and facial soft-tissue variations over time. We propose a two-phase procedure of multimodal (Phase 1) and multitemporal (Phase 2) registration which aligns images taken from the same patient by different imaging modalities and at different times. Extrinsic (for Phase 1) and intrinsic (for Phase 2) landmark-based registration methods are employed as an initiation for a robust iterative closest points algorithm. Since the mandible moves independently of the upper skull, the registration procedure is applied separately on the mandible and the upper skull. The results show that the signed error distributions of both mandible and skull registrations follow a mixture of two Gaussian distributions, corresponding to alignment errors (due to our method) and temporal change over time. We suggest that the large values among the total registration errors correspond to the temporal change resulting from (1) the effect of treatment (i.e. the orthodontic changes of teeth positions); (2) the biological changes such as teeth growth over time, especially for teenagers; and (3) the segmentation procedure and CBCT precision change over time.

  18. Multimodal Registration and Fusion for 3D Thermal Imaging

    Directory of Open Access Journals (Sweden)

    Moulay A. Akhloufi

    2015-01-01

    Full Text Available 3D vision is an area of computer vision that has attracted a lot of research interest and has been widely studied. In recent years we witness an increasing interest from the industrial community. This interest is driven by the recent advances in 3D technologies, which enable high precision measurements at an affordable cost. With 3D vision techniques we can conduct advanced manufactured parts inspections and metrology analysis. However, we are not able to detect subsurface defects. This kind of detection is achieved by other techniques, like infrared thermography. In this work, we present a new registration framework for 3D and thermal infrared multimodal fusion. The resulting fused data can be used for advanced 3D inspection in Nondestructive Testing and Evaluation (NDT&E applications. The fusion permits the simultaneous visible surface and subsurface inspections to be conducted in the same process. Experimental tests were conducted with different materials. The obtained results are promising and show how these new techniques can be used efficiently in a combined NDT&E-Metrology analysis of manufactured parts, in areas such as aerospace and automotive.

  19. An embedded system for image segmentation and multimodal registration in noninvasive skin cancer screening.

    Science.gov (United States)

    Diaz, Silvana; Soto, Javier E; Inostroza, Fabian; Godoy, Sebastian E; Figueroa, Miguel

    2017-07-01

    We present a heterogeneous architecture for image registration and multimodal segmentation on an embedded system for noninvasive skin cancer screening. The architecture combines Otsu thresholding and the random walker algorithm to perform image segmentation, and features a hardware implementation of the Harris corner detection algorithm to perform region-of-interest detection and image registration. Running on a Xilinx XC7Z020 reconfigurable system-on-a-chip, our prototype computes the initial segmentation of a 400×400-pixel region of interest in the visible spectrum in 12.1 seconds, and registers infrared images against this region at 540 frames per second, while consuming 1.9W.

  20. Feasibility of Multimodal Deformable Registration for Head and Neck Tumor Treatment Planning

    Energy Technology Data Exchange (ETDEWEB)

    Fortunati, Valerio, E-mail: v.fortunati@erasmusmc.nl [Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands); Verhaart, René F. [Hyperthermia Unit, Department of Radiation Oncology, Erasmus MC University Medical Center Cancer Institute, Rotterdam (Netherlands); Angeloni, Francesco [Istituto di Ricovero e Cura a Carattere Scientifico Foundation SDN for Research and High Education in Nuclear Diagnostics, Naples (Italy); Lugt, Aad van der [Department of Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands); Niessen, Wiro J. [Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands); Faculty of Applied Sciences, Delft University of Technology, Delft (Netherlands); Veenland, Jifke F. [Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands); Paulides, Margarethus M. [Hyperthermia Unit, Department of Radiation Oncology, Erasmus MC University Medical Center Cancer Institute, Rotterdam (Netherlands); Walsum, Theo van [Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC University Medical Center, Rotterdam (Netherlands)

    2014-09-01

    Purpose: To investigate the feasibility of using deformable registration in clinical practice to fuse MR and CT images of the head and neck for treatment planning. Method and Materials: A state-of-the-art deformable registration algorithm was optimized, evaluated, and compared with rigid registration. The evaluation was based on manually annotated anatomic landmarks and regions of interest in both modalities. We also developed a multiparametric registration approach, which simultaneously aligns T1- and T2-weighted MR sequences to CT. This was evaluated and compared with single-parametric approaches. Results: Our results show that deformable registration yielded a better accuracy than rigid registration, without introducing unrealistic deformations. For deformable registration, an average landmark alignment of approximatively 1.7 mm was obtained. For all the regions of interest excluding the cerebellum and the parotids, deformable registration provided a median modified Hausdorff distance of approximatively 1 mm. Similar accuracies were obtained for the single-parameter and multiparameter approaches. Conclusions: This study demonstrates that deformable registration of head-and-neck CT and MR images is feasible, with overall a significanlty higher accuracy than for rigid registration.

  1. Feasibility of Multimodal Deformable Registration for Head and Neck Tumor Treatment Planning

    International Nuclear Information System (INIS)

    Fortunati, Valerio; Verhaart, René F.; Angeloni, Francesco; Lugt, Aad van der; Niessen, Wiro J.; Veenland, Jifke F.; Paulides, Margarethus M.; Walsum, Theo van

    2014-01-01

    Purpose: To investigate the feasibility of using deformable registration in clinical practice to fuse MR and CT images of the head and neck for treatment planning. Method and Materials: A state-of-the-art deformable registration algorithm was optimized, evaluated, and compared with rigid registration. The evaluation was based on manually annotated anatomic landmarks and regions of interest in both modalities. We also developed a multiparametric registration approach, which simultaneously aligns T1- and T2-weighted MR sequences to CT. This was evaluated and compared with single-parametric approaches. Results: Our results show that deformable registration yielded a better accuracy than rigid registration, without introducing unrealistic deformations. For deformable registration, an average landmark alignment of approximatively 1.7 mm was obtained. For all the regions of interest excluding the cerebellum and the parotids, deformable registration provided a median modified Hausdorff distance of approximatively 1 mm. Similar accuracies were obtained for the single-parameter and multiparameter approaches. Conclusions: This study demonstrates that deformable registration of head-and-neck CT and MR images is feasible, with overall a significanlty higher accuracy than for rigid registration

  2. Efficient Variational Approach to Multimodal Registration of Anatomical and Functional Intra-Patient Tumorous Brain Data.

    Science.gov (United States)

    Legaz-Aparicio, Alvar-Ginés; Verdú-Monedero, Rafael; Larrey-Ruiz, Jorge; Morales-Sánchez, Juan; López-Mir, Fernando; Naranjo, Valery; Bernabéu, Ángela

    2017-09-01

    This paper addresses the functional localization of intra-patient images of the brain. Functional images of the brain (fMRI and PET) provide information about brain function and metabolism whereas anatomical images (MRI and CT) supply the localization of structures with high spatial resolution. The goal is to find the geometric correspondence between functional and anatomical images in order to complement and fuse the information provided by each imaging modality. The proposed approach is based on a variational formulation of the image registration problem in the frequency domain. It has been implemented as a C/C[Formula: see text] library which is invoked from a GUI. This interface is routinely used in the clinical setting by physicians for research purposes (Inscanner, Alicante, Spain), and may be used as well for diagnosis and surgical planning. The registration of anatomic and functional intra-patient images of the brain makes it possible to obtain a geometric correspondence which allows for the localization of the functional processes that occur in the brain. Through 18 clinical experiments, it has been demonstrated how the proposed approach outperforms popular state-of-the-art registration methods in terms of efficiency, information theory-based measures (such as mutual information) and actual registration error (distance in space of corresponding landmarks).

  3. A multicore based parallel image registration method.

    Science.gov (United States)

    Yang, Lin; Gong, Leiguang; Zhang, Hong; Nosher, John L; Foran, David J

    2009-01-01

    Image registration is a crucial step for many image-assisted clinical applications such as surgery planning and treatment evaluation. In this paper we proposed a landmark based nonlinear image registration algorithm for matching 2D image pairs. The algorithm was shown to be effective and robust under conditions of large deformations. In landmark based registration, the most important step is establishing the correspondence among the selected landmark points. This usually requires an extensive search which is often computationally expensive. We introduced a nonregular data partition algorithm using the K-means clustering algorithm to group the landmarks based on the number of available processing cores. The step optimizes the memory usage and data transfer. We have tested our method using IBM Cell Broadband Engine (Cell/B.E.) platform.

  4. A Robust and Accurate Two-Step Auto-Labeling Conditional Iterative Closest Points (TACICP Algorithm for Three-Dimensional Multi-Modal Carotid Image Registration.

    Directory of Open Access Journals (Sweden)

    Hengkai Guo

    Full Text Available Atherosclerosis is among the leading causes of death and disability. Combining information from multi-modal vascular images is an effective and efficient way to diagnose and monitor atherosclerosis, in which image registration is a key technique. In this paper a feature-based registration algorithm, Two-step Auto-labeling Conditional Iterative Closed Points (TACICP algorithm, is proposed to align three-dimensional carotid image datasets from ultrasound (US and magnetic resonance (MR. Based on 2D segmented contours, a coarse-to-fine strategy is employed with two steps: rigid initialization step and non-rigid refinement step. Conditional Iterative Closest Points (CICP algorithm is given in rigid initialization step to obtain the robust rigid transformation and label configurations. Then the labels and CICP algorithm with non-rigid thin-plate-spline (TPS transformation model is introduced to solve non-rigid carotid deformation between different body positions. The results demonstrate that proposed TACICP algorithm has achieved an average registration error of less than 0.2mm with no failure case, which is superior to the state-of-the-art feature-based methods.

  5. Multimodality

    DEFF Research Database (Denmark)

    Buhl, Mie

    2010-01-01

    on their teaching and learning situations. The choices they make involve e-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very......In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal' communication, which should not be confused with the term ‘multimedia'. While multimedia...... useful for developing pedagogies where a synergy of different symbol systems facilitates new and flexible learning situations that can meet different needs of different learners. The present paper includes an example from a Danish university program...

  6. An image registration based ultrasound probe calibration

    Science.gov (United States)

    Li, Xin; Kumar, Dinesh; Sarkar, Saradwata; Narayanan, Ram

    2012-02-01

    Reconstructed 3D ultrasound of prostate gland finds application in several medical areas such as image guided biopsy, therapy planning and dose delivery. In our application, we use an end-fire probe rotated about its axis to acquire a sequence of rotational slices to reconstruct 3D TRUS (Transrectal Ultrasound) image. The image acquisition system consists of an ultrasound transducer situated on a cradle directly attached to a rotational sensor. However, due to system tolerances, axis of probe does not align exactly with the designed axis of rotation resulting in artifacts in the 3D reconstructed ultrasound volume. We present a rigid registration based automatic probe calibration approach. The method uses a sequence of phantom images, each pair acquired at angular separation of 180 degrees and registers corresponding image pairs to compute the deviation from designed axis. A modified shadow removal algorithm is applied for preprocessing. An attribute vector is constructed from image intensity and a speckle-insensitive information-theoretic feature. We compare registration between the presented method and expert-corrected images in 16 prostate phantom scans. Images were acquired at multiple resolutions, and different misalignment settings from two ultrasound machines. Screenshots from 3D reconstruction are shown before and after misalignment correction. Registration parameters from automatic and manual correction were found to be in good agreement. Average absolute differences of translation and rotation between automatic and manual methods were 0.27 mm and 0.65 degree, respectively. The registration parameters also showed lower variability for automatic registration (pooled standard deviation σtranslation = 0.50 mm, σrotation = 0.52 degree) compared to the manual approach (pooled standard deviation σtranslation = 0.62 mm, σrotation = 0.78 degree).

  7. A Remote Registration Based on MIDAS

    Science.gov (United States)

    JIN, Xin

    2017-04-01

    We often need for software registration to protect the interests of the software developers. This article narrated one kind of software long-distance registration technology. The registration method is: place the registration information in a database table, after the procedure starts in check table registration information, if it has registered then the procedure may the normal operation; Otherwise, the customer must input the sequence number and registers through the network on the long-distance server. If it registers successfully, then records the registration information in the database table. This remote registration method can protect the rights of software developers.

  8. Canny edge-based deformable image registration.

    Science.gov (United States)

    Kearney, Vasant; Huang, Yihui; Mao, Weihua; Yuan, Baohong; Tang, Liping

    2017-02-07

    This work focuses on developing a 2D Canny edge-based deformable image registration (Canny DIR) algorithm to register in vivo white light images taken at various time points. This method uses a sparse interpolation deformation algorithm to sparsely register regions of the image with strong edge information. A stability criterion is enforced which removes regions of edges that do not deform in a smooth uniform manner. Using a synthetic mouse surface ground truth model, the accuracy of the Canny DIR algorithm was evaluated under axial rotation in the presence of deformation. The accuracy was also tested using fluorescent dye injections, which were then used for gamma analysis to establish a second ground truth. The results indicate that the Canny DIR algorithm performs better than rigid registration, intensity corrected Demons, and distinctive features for all evaluation matrices and ground truth scenarios. In conclusion Canny DIR performs well in the presence of the unique lighting and shading variations associated with white-light-based image registration.

  9. Multiresolution image registration for multimodal brain images and fusion for better neurosurgical planning

    Directory of Open Access Journals (Sweden)

    Siddeshappa Nandish

    2017-12-01

    Conclusion: The end resultant fused images are validated by the radiologists and mutual information measure is used to validate registration results. It is found that CT and MRI sequence with more number of slices gave promising results. Few cases with deformation during misregistrations recorded with low mutual information of about 0.3 and which is not acceptable and few recorded with 0.6 and above mutual information during registration gives promising results.

  10. Registration accuracy for MR images of the prostate using a subvolume based registration protocol

    Directory of Open Access Journals (Sweden)

    Söderström Karin

    2011-06-01

    Full Text Available Abstract Background In recent years, there has been a considerable research effort concerning the integration of magnetic resonance imaging (MRI into the external radiotherapy workflow motivated by the superior soft tissue contrast as compared to computed tomography. Image registration is a necessary step in many applications, e.g. in patient positioning and therapy response assessment with repeated imaging. In this study, we investigate the dependence between the registration accuracy and the size of the registration volume for a subvolume based rigid registration protocol for MR images of the prostate. Methods Ten patients were imaged four times each over the course of radiotherapy treatment using a T2 weighted sequence. The images were registered to each other using a mean square distance metric and a step gradient optimizer for registration volumes of different sizes. The precision of the registrations was evaluated using the center of mass distance between the manually defined prostates in the registered images. The optimal size of the registration volume was determined by minimizing the standard deviation of these distances. Results We found that prostate position was most uncertain in the anterior-posterior (AP direction using traditional full volume registration. The improvement in standard deviation of the mean center of mass distance between the prostate volumes using a registration volume optimized to the prostate was 3.9 mm (p Conclusions Repeated MR imaging of the prostate for therapy set-up or therapy assessment will both require high precision tissue registration. With a subvolume based registration the prostate registration uncertainty can be reduced down to the order of 1 mm (1 SD compared to several millimeters for registration based on the whole pelvis.

  11. Multimodal Data Fusion Based on Mutual Information.

    Science.gov (United States)

    Bramon, Roger; Boada, Imma; Bardera, Anton; Rodríguez, Joaquim; Feixas, Miquel; Puig, Josep; Sbert, Mateu

    2012-09-01

    Multimodal visualization aims at fusing different data sets so that the resulting combination provides more information and understanding to the user. To achieve this aim, we propose a new information-theoretic approach that automatically selects the most informative voxels from two volume data sets. Our fusion criteria are based on the information channel created between the two input data sets that permit us to quantify the information associated with each intensity value. This specific information is obtained from three different ways of decomposing the mutual information of the channel. In addition, an assessment criterion based on the information content of the fused data set can be used to analyze and modify the initial selection of the voxels by weighting the contribution of each data set to the final result. The proposed approach has been integrated in a general framework that allows for the exploration of volumetric data models and the interactive change of some parameters of the fused data set. The proposed approach has been evaluated on different medical data sets with very promising results.

  12. Hierarchical patch-based co-registration of differently stained histopathology slides

    Science.gov (United States)

    Yigitsoy, Mehmet; Schmidt, Günter

    2017-03-01

    Over the past decades, digital pathology has emerged as an alternative way of looking at the tissue at subcellular level. It enables multiplexed analysis of different cell types at micron level. Information about cell types can be extracted by staining sections of a tissue block using different markers. However, robust fusion of structural and functional information from different stains is necessary for reproducible multiplexed analysis. Such a fusion can be obtained via image co-registration by establishing spatial correspondences between tissue sections. Spatial correspondences can then be used to transfer various statistics about cell types between sections. However, the multi-modal nature of images and sparse distribution of interesting cell types pose several challenges for the registration of differently stained tissue sections. In this work, we propose a co-registration framework that efficiently addresses such challenges. We present a hierarchical patch-based registration of intensity normalized tissue sections. Preliminary experiments demonstrate the potential of the proposed technique for the fusion of multi-modal information from differently stained digital histopathology sections.

  13. Multimodality

    DEFF Research Database (Denmark)

    Buhl, Mie

    and learning situations. The choices they make involve E-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very useful......In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal’ communication, which should not be confused with the term ‘multimedia’. While multimedia...... for developing pedagogies where a synergy of different symbol systems facilitates new and flexible learning situations that can meet different needs of different learners. The present paper includes an example from a Danish university program....

  14. Fiber-Optic Vibration Sensor Based on Multimode Fiber

    Directory of Open Access Journals (Sweden)

    I. Lujo

    2008-06-01

    Full Text Available The purpose of this paper is to present a fiberoptic vibration sensor based on the monitoring of the mode distribution in a multimode optical fiber. Detection of vibrations and their parameters is possible through observation of the output speckle pattern from the multimode optical fiber. A working experimental model has been built in which all used components are widely available and cheap: a CCD camera (a simple web-cam, a multimode laser in visible range as a light source, a length of multimode optical fiber, and a computer for signal processing. Measurements have shown good agreement with the actual frequency of vibrations, and promising results were achieved with the amplitude measurements although they require some adaptation of the experimental model. Proposed sensor is cheap and lightweight and therefore presents an interesting alternative for monitoring large smart structures.

  15. Interactive, multi-modality image registrations for combined MRI/MRSI-planned HDR prostate brachytherapy

    Directory of Open Access Journals (Sweden)

    Galen Reed

    2011-03-01

    Full Text Available Purpose: This study presents the steps and criteria involved in the series of image registrations used clinically during the planning and dose delivery of focal high dose-rate (HDR brachytherapy of the prostate. Material and methods: Three imaging modalities – Magnetic Resonance Imaging (MRI, Magnetic Resonance Spectroscopic Imaging (MRSI, and Computed Tomography (CT – were used at different steps during the process. MRSI is used for identification of dominant intraprosatic lesions (DIL. A series of rigid and nonrigid transformations were applied to the data to correct for endorectal-coil-induced deformations and for alignment with the planning CT. Mutual information was calculated as a morphing metric. An inverse planning optimization algorithm was applied to boost dose to the DIL while providing protection to the urethra, penile bulb, rectum, and bladder. Six prostate cancer patients were treated using this protocol. Results: The morphing algorithm successfully modeled the probe-induced prostatic distortion. Mutual information calculated between the morphed images and images acquired without the endorectal probe showed a significant (p = 0.0071 increase to that calculated between the unmorphed images and images acquired without the endorectal probe. Both mutual information and visual inspection serve as effective diagnostics of image morphing. The entire procedure adds less than thirty minutes to the treatment planning. Conclusion: This work demonstrates the utility of image transformations and registrations to HDR brachytherapy of prostate cancer.

  16. Multiscale registration of medical images based on edge preserving scale space with application in image-guided radiation therapy

    Science.gov (United States)

    Li, Dengwang; Li, Hongsheng; Wan, Honglin; Chen, Jinhu; Gong, Guanzhong; Wang, Hongjun; Wang, Liming; Yin, Yong

    2012-08-01

    Mutual information (MI) is a well-accepted similarity measure for image registration in medical systems. However, MI-based registration faces the challenges of high computational complexity and a high likelihood of being trapped into local optima due to an absence of spatial information. In order to solve these problems, multi-scale frameworks can be used to accelerate registration and improve robustness. Traditional Gaussian pyramid representation is one such technique but it suffers from contour diffusion at coarse levels which may lead to unsatisfactory registration results. In this work, a new multi-scale registration framework called edge preserving multiscale registration (EPMR) was proposed based upon an edge preserving total variation L1 norm (TV-L1) scale space representation. TV-L1 scale space is constructed by selecting edges and contours of images according to their size rather than the intensity values of the image features. This ensures more meaningful spatial information with an EPMR framework for MI-based registration. Furthermore, we design an optimal estimation of the TV-L1 parameter in the EPMR framework by training and minimizing the transformation offset between the registered pairs for automated registration in medical systems. We validated our EPMR method on both simulated mono- and multi-modal medical datasets with ground truth and clinical studies from a combined positron emission tomography/computed tomography (PET/CT) scanner. We compared our registration framework with other traditional registration approaches. Our experimental results demonstrated that our method outperformed other methods in terms of the accuracy and robustness for medical images. EPMR can always achieve a small offset value, which is closer to the ground truth both for mono-modality and multi-modality, and the speed can be increased 5-8% for mono-modality and 10-14% for multi-modality registration under the same condition. Furthermore, clinical application by adaptive

  17. Multiscale registration of medical images based on edge preserving scale space with application in image-guided radiation therapy

    International Nuclear Information System (INIS)

    Li Dengwang; Wan Honglin; Li Hongsheng; Chen Jinhu; Gong Guanzhong; Yin Yong; Wang Hongjun; Wang Liming

    2012-01-01

    Mutual information (MI) is a well-accepted similarity measure for image registration in medical systems. However, MI-based registration faces the challenges of high computational complexity and a high likelihood of being trapped into local optima due to an absence of spatial information. In order to solve these problems, multi-scale frameworks can be used to accelerate registration and improve robustness. Traditional Gaussian pyramid representation is one such technique but it suffers from contour diffusion at coarse levels which may lead to unsatisfactory registration results. In this work, a new multi-scale registration framework called edge preserving multiscale registration (EPMR) was proposed based upon an edge preserving total variation L1 norm (TV-L1) scale space representation. TV-L1 scale space is constructed by selecting edges and contours of images according to their size rather than the intensity values of the image features. This ensures more meaningful spatial information with an EPMR framework for MI-based registration. Furthermore, we design an optimal estimation of the TV-L1 parameter in the EPMR framework by training and minimizing the transformation offset between the registered pairs for automated registration in medical systems. We validated our EPMR method on both simulated mono- and multi-modal medical datasets with ground truth and clinical studies from a combined positron emission tomography/computed tomography (PET/CT) scanner. We compared our registration framework with other traditional registration approaches. Our experimental results demonstrated that our method outperformed other methods in terms of the accuracy and robustness for medical images. EPMR can always achieve a small offset value, which is closer to the ground truth both for mono-modality and multi-modality, and the speed can be increased 5–8% for mono-modality and 10–14% for multi-modality registration under the same condition. Furthermore, clinical application by

  18. An agent-based architecture for multimodal interaction

    NARCIS (Netherlands)

    Jonker, C.M.; Treur, J.; Wijngaards, W.C.A.

    2001-01-01

    In this paper, an executable generic process model is proposed for combined verbal and non-verbal communication processes and their interaction. The agent-based architecture can be used to create multimodal interaction. The generic process model has been designed, implemented and used to simulate

  19. An agent-based architecture for multimodal interaction

    NARCIS (Netherlands)

    Jonker, C.M.; Treur, J.; Wijngaards, W.C.A.

    In this paper, an executable generic process model is proposed for combined verbal and non-verbal communication processes and their interaction. The agent-based architecture can be used to create multimodal interaction. The generic process model has been designed, implemented and used to simulate

  20. Evidence Based Therapeutic Outcome of Multimodal Therapy on ...

    African Journals Online (AJOL)

    info

    Abstract. Previous efforts at remediating sexual decision of adolescents in Nigeria have been based on unimodal therapies. Therefore, this study investigated the effectiveness of. Multimodal Therapy (MMT) on sexual decisions of adolescents studying in Remedial. Centres in Rivers state, Nigeria. Pre-test post control group ...

  1. Towards a Noninvasive Intracranial Tumor Irradiation Using 3D Optical Imaging and Multimodal Data Registration

    Science.gov (United States)

    Posada, R.; Daul, Ch.; Wolf, D.; Aletti, P.

    2007-01-01

    Conformal radiotherapy (CRT) results in high-precision tumor volume irradiation. In fractioned radiotherapy (FRT), lesions are irradiated in several sessions so that healthy neighbouring tissues are better preserved than when treatment is carried out in one fraction. In the case of intracranial tumors, classical methods of patient positioning in the irradiation machine coordinate system are invasive and only allow for CRT in one irradiation session. This contribution presents a noninvasive positioning method representing a first step towards the combination of CRT and FRT. The 3D data used for the positioning is point clouds spread over the patient's head (CT-data usually acquired during treatment) and points distributed over the patient's face which are acquired with a structured light sensor fixed in the therapy room. The geometrical transformation linking the coordinate systems of the diagnosis device (CT-modality) and the 3D sensor of the therapy room (visible light modality) is obtained by registering the surfaces represented by the two 3D point sets. The geometrical relationship between the coordinate systems of the 3D sensor and the irradiation machine is given by a calibration of the sensor position in the therapy room. The global transformation, computed with the two previous transformations, is sufficient to predict the tumor position in the irradiation machine coordinate system with only the corresponding position in the CT-coordinate system. Results obtained for a phantom show that the mean positioning error of tumors on the treatment machine isocentre is 0.4 mm. Tests performed with human data proved that the registration algorithm is accurate (0.1 mm mean distance between homologous points) and robust even for facial expression changes. PMID:18364992

  2. Edge-based correlation image registration for multispectral imaging

    Science.gov (United States)

    Nandy, Prabal [Albuquerque, NM

    2009-11-17

    Registration information for images of a common target obtained from a plurality of different spectral bands can be obtained by combining edge detection and phase correlation. The images are edge-filtered, and pairs of the edge-filtered images are then phase correlated to produce phase correlation images. The registration information can be determined based on these phase correlation images.

  3. Wavelet based free-form deformations for nonrigid registration

    NARCIS (Netherlands)

    W. Sun (William); W.J. Niessen (Wiro); S. Klein (Stefan)

    2014-01-01

    textabstractIn nonrigid registration, deformations may take place on the coarse and fine scales. For the conventional B-splines based free-form deformation (FFD) registration, these coarse- and fine-scale deformations are all represented by basis functions of a single scale. Meanwhile, wavelets have

  4. Modification of species-based differential evolution for multimodal optimization

    Science.gov (United States)

    Idrus, Said Iskandar Al; Syahputra, Hermawan; Firdaus, Muliawan

    2015-12-01

    At this time optimization has an important role in various fields as well as between other operational research, industry, finance and management. Optimization problem is the problem of maximizing or minimizing a function of one variable or many variables, which include unimodal and multimodal functions. Differential Evolution (DE), is a random search technique using vectors as an alternative solution in the search for the optimum. To localize all local maximum and minimum on multimodal function, this function can be divided into several domain of fitness using niching method. Species-based niching method is one of method that build sub-populations or species in the domain functions. This paper describes the modification of species-based previously to reduce the computational complexity and run more efficiently. The results of the test functions show species-based modifications able to locate all the local optima in once run the program.

  5. Learning-based deformable registration for infant MRI by integrating random forest with auto-context model.

    Science.gov (United States)

    Wei, Lifang; Cao, Xiaohuan; Wang, Zhensong; Gao, Yaozong; Hu, Shunbo; Wang, Li; Wu, Guorong; Shen, Dinggang

    2017-12-01

    Accurately analyzing the rapid structural evolution of human brain in the first year of life is a key step in early brain development studies, which requires accurate deformable image registration. However, due to (a) dynamic appearance and (b) large anatomical changes, very few methods in the literature can work well for the registration of two infant brain MR images acquired at two arbitrary development phases, such as birth and one-year-old. To address these challenging issues, we propose a learning-based registration method, which can handle the anatomical structures and the appearance changes between the two infant brain MR images with possible time gap. Specifically, in the training stage, we employ a multioutput random forest regression and auto-context model to learn the evolution of anatomical shape and appearance from a training set of longitudinal infant images. To make the learning procedure more robust, we further harness the multimodal MR imaging information. Then, in the testing stage, for registering the two new infant images scanned at two different development phases, the learned model will be used to predict both the deformation field and appearance changes between the images under registration. After that, it becomes much easier to deploy any conventional image registration method to complete the remaining registration since the above-mentioned challenges for state-of-the-art registration methods have been well addressed. We have applied our proposed registration method to intersubject registration of infant brain MR images acquired at 2-week-old, 3-month-old, 6-month-old, and 9-month-old with the images acquired at 12-month-old. Promising registration results have been achieved in terms of registration accuracy, compared with the counterpart nonlearning based registration methods. The proposed new learning-based registration method have tackled the challenging issues in registering infant brain images acquired from the first year of life, by

  6. Computer Based Behavioral Biometric Authentication via Multi-Modal Fusion

    Science.gov (United States)

    2013-03-01

    Bhattacharyya, et al. [25], found that the iris scanner, with an Equal Error Rate (EER) of 0.01% performed the best. 1.2 Behavioral Biometrics Behavioral...include voice and facial recognition; fingerprint, voice, and iris ; and iris and retinal features [33]. 2.7.1 Fusion Methods. Fusion of biometric ...COMPUTER BASED BEHAVIORAL BIOMETRIC AUTHENTICATION VIA MULTI-MODAL FUSION THESIS Kyle O. Bailey, Second Lieutenant, USAF AFIT-ENG-13-M-04 DEPARTMENT

  7. Overlay improvement by exposure map based mask registration optimization

    Science.gov (United States)

    Shi, Irene; Guo, Eric; Chen, Ming; Lu, Max; Li, Gordon; Li, Rivan; Tian, Eric

    2015-03-01

    Along with the increased miniaturization of semiconductor electronic devices, the design rules of advanced semiconductor devices shrink dramatically. [1] One of the main challenges of lithography step is the layer-to-layer overlay control. Furthermore, DPT (Double Patterning Technology) has been adapted for the advanced technology node like 28nm and 14nm, corresponding overlay budget becomes even tighter. [2][3] After the in-die mask registration (pattern placement) measurement is introduced, with the model analysis of a KLA SOV (sources of variation) tool, it's observed that registration difference between masks is a significant error source of wafer layer-to-layer overlay at 28nm process. [4][5] Mask registration optimization would highly improve wafer overlay performance accordingly. It was reported that a laser based registration control (RegC) process could be applied after the pattern generation or after pellicle mounting and allowed fine tuning of the mask registration. [6] In this paper we propose a novel method of mask registration correction, which can be applied before mask writing based on mask exposure map, considering the factors of mask chip layout, writing sequence, and pattern density distribution. Our experiment data show if pattern density on the mask keeps at a low level, in-die mask registration residue error in 3sigma could be always under 5nm whatever blank type and related writer POSCOR (position correction) file was applied; it proves random error induced by material or equipment would occupy relatively fixed error budget as an error source of mask registration. On the real production, comparing the mask registration difference through critical production layers, it could be revealed that registration residue error of line space layers with higher pattern density is always much larger than the one of contact hole layers with lower pattern density. Additionally, the mask registration difference between layers with similar pattern density

  8. Intensity-based hierarchical elastic registration using approximating splines.

    Science.gov (United States)

    Serifovic-Trbalic, Amira; Demirovic, Damir; Cattin, Philippe C

    2014-01-01

    We introduce a new hierarchical approach for elastic medical image registration using approximating splines. In order to obtain the dense deformation field, we employ Gaussian elastic body splines (GEBS) that incorporate anisotropic landmark errors and rotation information. Since the GEBS approach is based on a physical model in form of analytical solutions of the Navier equation, it can very well cope with the local as well as global deformations present in the images by varying the standard deviation of the Gaussian forces. The proposed GEBS approximating model is integrated into the elastic hierarchical image registration framework, which decomposes a nonrigid registration problem into numerous local rigid transformations. The approximating GEBS registration scheme incorporates anisotropic landmark errors as well as rotation information. The anisotropic landmark localization uncertainties can be estimated directly from the image data, and in this case, they represent the minimal stochastic localization error, i.e., the Cramér-Rao bound. The rotation information of each landmark obtained from the hierarchical procedure is transposed in an additional angular landmark, doubling the number of landmarks in the GEBS model. The modified hierarchical registration using the approximating GEBS model is applied to register 161 image pairs from a digital mammogram database. The obtained results are very encouraging, and the proposed approach significantly improved all registrations comparing the mean-square error in relation to approximating TPS with the rotation information. On artificially deformed breast images, the newly proposed method performed better than the state-of-the-art registration algorithm introduced by Rueckert et al. (IEEE Trans Med Imaging 18:712-721, 1999). The average error per breast tissue pixel was less than 2.23 pixels compared to 2.46 pixels for Rueckert's method. The proposed hierarchical elastic image registration approach incorporates the GEBS

  9. Microscopic neural image registration based on the structure of mitochondria

    Science.gov (United States)

    Cao, Huiwen; Han, Hua; Rao, Qiang; Xiao, Chi; Chen, Xi

    2017-02-01

    Microscopic image registration is a key component of the neural structure reconstruction with serial sections of neural tissue. The goal of microscopic neural image registration is to recover the 3D continuity and geometrical properties of specimen. During image registration, various distortions need to be corrected, including image rotation, translation, tissue deformation et.al, which come from the procedure of sample cutting, staining and imaging. Furthermore, there is only certain similarity between adjacent sections, and the degree of similarity depends on local structure of the tissue and the thickness of the sections. These factors make the microscopic neural image registration a challenging problem. To tackle the difficulty of corresponding landmarks extraction, we introduce a novel image registration method for Scanning Electron Microscopy (SEM) images of serial neural tissue sections based on the structure of mitochondria. The ellipsoidal shape of mitochondria ensures that the same mitochondria has similar shape between adjacent sections, and its characteristic of broad distribution in the neural tissue guarantees that landmarks based on the mitochondria distributed widely in the image. The proposed image registration method contains three parts: landmarks extraction between adjacent sections, corresponding landmarks matching and image deformation based on the correspondences. We demonstrate the performance of our method with SEM images of drosophila brain.

  10. Image Registration Algorithm Based on Parallax Constraint and Clustering Analysis

    Science.gov (United States)

    Wang, Zhe; Dong, Min; Mu, Xiaomin; Wang, Song

    2018-01-01

    To resolve the problem of slow computation speed and low matching accuracy in image registration, a new image registration algorithm based on parallax constraint and clustering analysis is proposed. Firstly, Harris corner detection algorithm is used to extract the feature points of two images. Secondly, use Normalized Cross Correlation (NCC) function to perform the approximate matching of feature points, and the initial feature pair is obtained. Then, according to the parallax constraint condition, the initial feature pair is preprocessed by K-means clustering algorithm, which is used to remove the feature point pairs with obvious errors in the approximate matching process. Finally, adopt Random Sample Consensus (RANSAC) algorithm to optimize the feature points to obtain the final feature point matching result, and the fast and accurate image registration is realized. The experimental results show that the image registration algorithm proposed in this paper can improve the accuracy of the image matching while ensuring the real-time performance of the algorithm.

  11. Automated landmark identification for human cortical surface-based registration.

    Science.gov (United States)

    Anticevic, Alan; Repovs, Grega; Dierker, Donna L; Harwell, John W; Coalson, Timothy S; Barch, Deanna M; Van Essen, David C

    2012-02-01

    Volume-based registration (VBR) is the predominant method used in human neuroimaging to compensate for individual variability. However, surface-based registration (SBR) techniques have an inherent advantage over VBR because they respect the topology of the convoluted cortical sheet. There is evidence that existing SBR methods indeed confer a registration advantage over affine VBR. Landmark-SBR constrains registration using explicit landmarks to represent corresponding geographical locations on individual and atlas surfaces. The need for manual landmark identification has been an impediment to the widespread adoption of Landmark-SBR. To circumvent this obstacle, we have implemented and evaluated an automated landmark identification (ALI) algorithm for registration to the human PALS-B12 atlas. We compared ALI performance with that from two trained human raters and one expert anatomical rater (ENR). We employed both quantitative and qualitative quality assurance metrics, including a biologically meaningful analysis of hemispheric asymmetry. ALI performed well across all quality assurance tests, indicating that it yields robust and largely accurate results that require only modest manual correction (<10 min per subject). ALI largely circumvents human error and bias and enables high throughput analysis of large neuroimaging datasets for inter-subject registration to an atlas. Copyright © 2011 Elsevier Inc. All rights reserved.

  12. LINE-BASED REGISTRATION OF DSM AND HYPERSPECTRAL IMAGES

    Directory of Open Access Journals (Sweden)

    J. Avbelj

    2013-04-01

    Full Text Available Data fusion techniques require a good registration of all the used datasets. In remote sensing, images are usually geo-referenced using the GPS and IMU data. However, if more precise registration is required, image processing techniques can be employed. We propose a method for multi-modal image coregistration between hyperspectral images (HSI and digital surface models (DSM. The method is divided in three parts: object and line detection of the same object in HSI and DSM, line matching and determination of transformation parameters. Homogeneous coordinates are used to implement matching and adjustment of transformation parameters. The common object in HSI and DSM are building boundaries. They have apparent change in height and material, that can be detected in DSM and HSI, respectively. Thus, before the matching and transformation parameter computation, building outlines are detected and adjusted in HSI and DSM. We test the method on a HSI and two DSM, using extracted building outbounds and for comparison also extracted lines with a line detector. The results show that estimated building boundaries provide more line assignments, than using line detector.

  13. Scene change detection based on multimodal integration

    Science.gov (United States)

    Zhu, Yingying; Zhou, Dongru

    2003-09-01

    Scene change detection is an essential step to automatic and content-based video indexing, retrieval and browsing. In this paper, a robust scene change detection and classification approach is presented, which analyzes audio, visual and textual sources and accounts for their inter-relations and coincidence to semantically identify and classify video scenes. Audio analysis focuses on the segmentation of audio stream into four types of semantic data such as silence, speech, music and environmental sound. Further processing on speech segments aims at locating speaker changes. Video analysis partitions visual stream into shots. Text analysis can provide a supplemental source of clues for scene classification and indexing information. We integrate the video and audio analysis results to identify video scenes and use the text information detected by the video OCR technology or derived from transcripts available to refine scene classification. Results from single source segmentation are in some cases suboptimal. By combining visual, aural features adn the accessorial text information, the scence extraction accuracy is enhanced, and more semantic segmentations are developed. Experimental results are proven to rather promising.

  14. Intelligent Human Tracking Based on Multimodal Integration

    Science.gov (United States)

    Nakamura, Keisuke; Nakadai, Kazuhiro; Asano, Futoshi; Nakajima, Hirofumi; Ince, Gökhan

    Localization and tracking of humans are essential research topics in robotics. In particular, Sound Source Localization (SSL) has been of great interest. Despite the numerous reported methods, SSL in a real environment had mainly three issues; robustness against noise with high power, no framework for selective listening to sound sources, and tracking of inactive and/or noisy sound sources. For the first issue, we extended Multiple SIgnal Classification by incorporating Generalized Eigen Value Decomposition (GEVD-MUSIC) so that it can deal with high power noise and can select target sound sources. For the second issue, we proposed Sound Source Identification (SSI) based on hierarchical Gaussian mixture models and integrated it with GEVD-MUSIC to realize a function to listen to a specific sound source according to the sort of the sound source. For the third issue, auditory and visual human tracking were integrated using particle filtering. These three techniques are integrated into an intelligent human tracking system. Experimental results showed that integration of SSL and SSI successfully achieved human tracking only by audition, and the audio-visual integration showed considerable improvement in tracking by compensating the loss of auditory or visual information.

  15. Audiovisual Quality Fusion based on Relative Multimodal Complexity

    DEFF Research Database (Denmark)

    You, Junyong; Korhonen, Jari; Reiter, Ulrich

    2011-01-01

    designed auditory and visual features, the relative complexity analysis model across sensory modalities is proposed for deriving the fusion parameter. Experimental results have demonstrated that the content adaptive fusion parameter can improve the prediction accuracy of objective audiovisual quality......In multimodal presentations the perceived audiovisual quality assessment is significantly influenced by the content of both the audio and visual tracks. Based on our earlier subjective quality test for finding the optimal trade-off between audio and video quality, this paper proposes a novel method...

  16. Biomechanical based image registration for head and neck radiation treatment

    Science.gov (United States)

    Al-Mayah, Adil; Moseley, Joanne; Hunter, Shannon; Velec, Mike; Chau, Lily; Breen, Stephen; Brock, Kristy

    2010-02-01

    Deformable image registration of four head and neck cancer patients was conducted using biomechanical based model. Patient specific 3D finite element models have been developed using CT and cone beam CT image data of the planning and a radiation treatment session. The model consists of seven vertebrae (C1 to C7), mandible, larynx, left and right parotid glands, tumor and body. Different combinations of boundary conditions are applied in the model in order to find the configuration with a minimum registration error. Each vertebra in the planning session is individually aligned with its correspondence in the treatment session. Rigid alignment is used for each individual vertebra and to the mandible since deformation is not expected in the bones. In addition, the effect of morphological differences in external body between the two image sessions is investigated. The accuracy of the registration is evaluated using the tumor, and left and right parotid glands by comparing the calculated Dice similarity index of these structures following deformation in relation to their true surface defined in the image of the second session. The registration improves when the vertebrae and mandible are aligned in the two sessions with the highest Dice index of 0.86+/-0.08, 0.84+/-0.11, and 0.89+/-0.04 for the tumor, left and right parotid glands, respectively. The accuracy of the center of mass location of tumor and parotid glands is also improved by deformable image registration where the error in the tumor and parotid glands decreases from 4.0+/-1.1, 3.4+/-1.5, and 3.8+/-0.9 mm using rigid registration to 2.3+/-1.0, 2.5+/-0.8 and 2.0+/-0.9 mm in the deformable image registration when alignment of vertebrae and mandible is conducted in addition to the surface projection of the body.

  17. Compressive Sensing-Based Detection With Multimodal Dependent Data

    Science.gov (United States)

    Wimalajeewa, Thakshila; Varshney, Pramod K.

    2018-02-01

    Detection with high dimensional multimodal data is a challenging problem when there are complex inter- and intra- modal dependencies. While several approaches have been proposed for dependent data fusion (e.g., based on copula theory), their advantages come at a high price in terms of computational complexity. In this paper, we treat the detection problem with compressive sensing (CS) where compression at each sensor is achieved via low dimensional random projections. CS has recently been exploited to solve detection problems under various assumptions on the signals of interest, however, its potential for dependent data fusion has not been explored adequately. We exploit the capability of CS to capture statistical properties of uncompressed data in order to compute decision statistics for detection in the compressed domain. First, a Gaussian approximation is employed to perform likelihood ratio (LR) based detection with compressed data. In this approach, inter-modal dependence is captured via a compressed version of the covariance matrix of the concatenated (temporally and spatially) uncompressed data vector. We show that, under certain conditions, this approach with a small number of compressed measurements per node leads to enhanced performance compared to detection with uncompressed data using widely considered suboptimal approaches. Second, we develop a nonparametric approach where a decision statistic based on the second order statistics of uncompressed data is computed in the compressed domain. The second approach is promising over other related nonparametric approaches and the first approach when multimodal data is highly correlated at the expense of slightly increased computational complexity.

  18. CONCEPT FOR CLASSIFYING FACADE ELEMENTS BASED ON MATERIAL, GEOMETRY AND THERMAL RADIATION USING MULTIMODAL UAV REMOTE SENSING

    Directory of Open Access Journals (Sweden)

    R. Ilehag

    2017-08-01

    Full Text Available This paper presents a concept for classification of facade elements, based on the material and the geometry of the elements in addition to the thermal radiation of the facade with the usage of a multimodal Unmanned Aerial Vehicle (UAV system. Once the concept is finalized and functional, the workflow can be used for energy demand estimations for buildings by exploiting existing methods for estimation of heat transfer coefficient and the transmitted heat loss. The multimodal system consists of a thermal, a hyperspectral and an optical sensor, which can be operational with a UAV. While dealing with sensors that operate in different spectra and have different technical specifications, such as the radiometric and the geometric resolution, the challenges that are faced are presented. Addressed are the different approaches of data fusion, such as image registration, generation of 3D models by performing image matching and the means for classification based on either the geometry of the object or the pixel values. As a first step towards realizing the concept, the result from a geometric calibration with a designed multimodal calibration pattern is presented.

  19. 47 CFR 64.611 - Internet-based TRS registration.

    Science.gov (United States)

    2010-10-01

    ... 47 Telecommunication 3 2010-10-01 2010-10-01 false Internet-based TRS registration. 64.611 Section 64.611 Telecommunication FEDERAL COMMUNICATIONS COMMISSION (CONTINUED) COMMON CARRIER SERVICES (CONTINUED) MISCELLANEOUS RULES RELATING TO COMMON CARRIERS Telecommunications Relay Services and Related...

  20. Advanced Contrast Agents for Multimodal Biomedical Imaging Based on Nanotechnology.

    Science.gov (United States)

    Calle, Daniel; Ballesteros, Paloma; Cerdán, Sebastián

    2018-01-01

    Clinical imaging modalities have reached a prominent role in medical diagnosis and patient management in the last decades. Different image methodologies as Positron Emission Tomography, Single Photon Emission Tomography, X-Rays, or Magnetic Resonance Imaging are in continuous evolution to satisfy the increasing demands of current medical diagnosis. Progress in these methodologies has been favored by the parallel development of increasingly more powerful contrast agents. These are molecules that enhance the intrinsic contrast of the images in the tissues where they accumulate, revealing noninvasively the presence of characteristic molecular targets or differential physiopathological microenvironments. The contrast agent field is currently moving to improve the performance of these molecules by incorporating the advantages that modern nanotechnology offers. These include, mainly, the possibilities to combine imaging and therapeutic capabilities over the same theranostic platform or improve the targeting efficiency in vivo by molecular engineering of the nanostructures. In this review, we provide an introduction to multimodal imaging methods in biomedicine, the sub-nanometric imaging agents previously used and the development of advanced multimodal and theranostic imaging agents based in nanotechnology. We conclude providing some illustrative examples from our own laboratories, including recent progress in theranostic formulations of magnetoliposomes containing ω-3 poly-unsaturated fatty acids to treat inflammatory diseases, or the use of stealth liposomes engineered with a pH-sensitive nanovalve to release their cargo specifically in the acidic extracellular pH microenvironment of tumors.

  1. Improved image registration by sparse patch-based deformation estimation.

    Science.gov (United States)

    Kim, Minjeong; Wu, Guorong; Wang, Qian; Lee, Seong-Whan; Shen, Dinggang

    2015-01-15

    Despite intensive efforts for decades, deformable image registration is still a challenging problem due to the potential large anatomical differences across individual images, which limits the registration performance. Fortunately, this issue could be alleviated if a good initial deformation can be provided for the two images under registration, which are often termed as the moving subject and the fixed template, respectively. In this work, we present a novel patch-based initial deformation prediction framework for improving the performance of existing registration algorithms. Our main idea is to estimate the initial deformation between subject and template in a patch-wise fashion by using the sparse representation technique. We argue that two image patches should follow the same deformation toward the template image if their patch-wise appearance patterns are similar. To this end, our framework consists of two stages, i.e., the training stage and the application stage. In the training stage, we register all training images to the pre-selected template, such that the deformation of each training image with respect to the template is known. In the application stage, we apply the following four steps to efficiently calculate the initial deformation field for the new test subject: (1) We pick a small number of key points in the distinctive regions of the test subject; (2) for each key point, we extract a local patch and form a coupled appearance-deformation dictionary from training images where each dictionary atom consists of the image intensity patch as well as their respective local deformations; (3) a small set of training image patches in the coupled dictionary are selected to represent the image patch of each subject key point by sparse representation. Then, we can predict the initial deformation for each subject key point by propagating the pre-estimated deformations on the selected training patches with the same sparse representation coefficients; and (4) we

  2. Slice correspondence estimation using SURF descriptors and context-based search for prostate whole-mount histology MRI registration.

    Science.gov (United States)

    Guzman, Lina; Commandeur, Frederic; Acosta, Oscar; Simon, Antoine; Fautrel, Alain; Rioux-Leclercq, Nathalie; Romero, Eduardo; Mathieu, Romain; de Crevoisier, Renaud

    2016-08-01

    Registration of histopathology volumes to Magnetic Resonance Images(MRI) is a crucial step for finding correlations in Prostate Cancer (PCa) and assessing tumor agressivity. This paper proposes a two-stage framework aimed at registering both modalities. Firstly, Speeded-Up Robust Features (SURF) algorithm and a context-based search is used to automatically determine slice correspondences between MRI and histology volumes. This step initializes a multimodal nonrigid registration strategy, which allows to propagate histology slices to MRI. Evaluation was performed on 5 prospective studies using a slice index score and landmark distances. With respect to a manual ground truth, the first stage of the framework exhibited an average error of 1,54 slice index and 3,51 mm in the prostate specimen. The reconstruction of a three-dimensional Whole-Mount Histology (WMH) shows promising results aimed to perform later PCa pattern detection and staging.

  3. Agent-based Multimodal Interface for Dynamically Autonomous Mobile Robots

    National Research Council Canada - National Science Library

    Sofge, Donald; Bugajska, Magdalena; Adams, William; Perzanowski, Dennis; Schultz, Alan

    2003-01-01

    .... The robot implements and integrates a variety of artificial intelligence techniques including a multimodal interface that allows natural language understanding, gesture interpretation, simultaneous...

  4. Multimodal recognition based on face and ear using local feature

    Science.gov (United States)

    Yang, Ruyin; Mu, Zhichun; Chen, Long; Fan, Tingyu

    2017-06-01

    The pose issue which may cause loss of useful information has always been a bottleneck in face and ear recognition. To address this problem, we propose a multimodal recognition approach based on face and ear using local feature, which is robust to large facial pose variations in the unconstrained scene. Deep learning method is used for facial pose estimation, and the method of a well-trained Faster R-CNN is used to detect and segment the region of face and ear. Then we propose a weighted region-based recognition method to deal with the local feature. The proposed method has achieved state-of-the-art recognition performance especially when the images are affected by pose variations and random occlusion in unconstrained scene.

  5. DEVELOPMENT OF A MULTIMODAL MONTE CARLO BASED TREATMENT PLANNING SYSTEM.

    Science.gov (United States)

    Kumada, Hiroaki; Takada, Kenta; Sakurai, Yoshinori; Suzuki, Minoru; Takata, Takushi; Sakurai, Hideyuki; Matsumura, Akira; Sakae, Takeji

    2017-10-26

    To establish boron neutron capture therapy (BNCT), the University of Tsukuba is developing a treatment device and peripheral devices required in BNCT, such as a treatment planning system. We are developing a new multimodal Monte Carlo based treatment planning system (developing code: Tsukuba Plan). Tsukuba Plan allows for dose estimation in proton therapy, X-ray therapy and heavy ion therapy in addition to BNCT because the system employs PHITS as the Monte Carlo dose calculation engine. Regarding BNCT, several verifications of the system are being carried out for its practical usage. The verification results demonstrate that Tsukuba Plan allows for accurate estimation of thermal neutron flux and gamma-ray dose as fundamental radiations of dosimetry in BNCT. In addition to the practical use of Tsukuba Plan in BNCT, we are investigating its application to other radiation therapies. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

  6. Multimodal Detection of Music Performances for Intelligent Emotion Based Lighting

    DEFF Research Database (Denmark)

    Bonde, Esben Oxholm Skjødt; Hansen, Ellen Kathrine; Triantafyllidis, Georgios

    2016-01-01

    . Using a microphone and a Kinect camera to detect such cues, the system is able to detect the intended emotion of what is being played. Specific lighting designs are then developed to support the specific emotions and the system is able to change between and alter the lighting design based......Playing music is about conveying emotions and the lighting at a concert can help do that. However, new and unknown bands that play at smaller venues and bands that don’t have the budget to hire a dedicated light technician have to miss out on lighting that will help them to convey the emotions...... of what they play. In this paper it is investigated whether it is possible or not to develop an intelligent system that through a multimodal input detects the intended emotions of the played music and in realtime adjusts the lighting accordingly. A concept for such an intelligent lighting system...

  7. Multi-modal imaging, model-based tracking, and mixed reality visualisation for orthopaedic surgery.

    Science.gov (United States)

    Lee, Sing Chun; Fuerst, Bernhard; Tateno, Keisuke; Johnson, Alex; Fotouhi, Javad; Osgood, Greg; Tombari, Federico; Navab, Nassir

    2017-10-01

    Orthopaedic surgeons are still following the decades old workflow of using dozens of two-dimensional fluoroscopic images to drill through complex 3D structures, e.g. pelvis. This Letter presents a mixed reality support system, which incorporates multi-modal data fusion and model-based surgical tool tracking for creating a mixed reality environment supporting screw placement in orthopaedic surgery. A red-green-blue-depth camera is rigidly attached to a mobile C-arm and is calibrated to the cone-beam computed tomography (CBCT) imaging space via iterative closest point algorithm. This allows real-time automatic fusion of reconstructed surface and/or 3D point clouds and synthetic fluoroscopic images obtained through CBCT imaging. An adapted 3D model-based tracking algorithm with automatic tool segmentation allows for tracking of the surgical tools occluded by hand. This proposed interactive 3D mixed reality environment provides an intuitive understanding of the surgical site and supports surgeons in quickly localising the entry point and orienting the surgical tool during screw placement. The authors validate the augmentation by measuring target registration error and also evaluate the tracking accuracy in the presence of partial occlusion.

  8. Entropy-Based Block Processing for Satellite Image Registration

    Directory of Open Access Journals (Sweden)

    Ikhyun Lee

    2012-11-01

    Full Text Available Image registration is an important task in many computer vision applications such as fusion systems, 3D shape recovery and earth observation. Particularly, registering satellite images is challenging and time-consuming due to limited resources and large image size. In such scenario, state-of-the-art image registration methods such as scale-invariant feature transform (SIFT may not be suitable due to high processing time. In this paper, we propose an algorithm based on block processing via entropy to register satellite images. The performance of the proposed method is evaluated using different real images. The comparative analysis shows that it not only reduces the processing time but also enhances the accuracy.

  9. Photoacoustic-Based Multimodal Nanoprobes: from Constructing to Biological Applications.

    Science.gov (United States)

    Gao, Duyang; Yuan, Zhen

    2017-01-01

    Multimodal nanoprobes have attracted intensive attentions since they can integrate various imaging modalities to obtain complementary merits of single modality. Meanwhile, recent interest in laser-induced photoacoustic imaging is rapidly growing due to its unique advantages in visualizing tissue structure and function with high spatial resolution and satisfactory imaging depth. In this review, we summarize multimodal nanoprobes involving photoacoustic imaging. In particular, we focus on the method to construct multimodal nanoprobes. We have divided the synthetic methods into two types. First, we call it "one for all" concept, which involves intrinsic properties of the element in a single particle. Second, "all in one" concept, which means integrating different functional blocks in one particle. Then, we simply introduce the applications of the multifunctional nanoprobes for in vivo imaging and imaging-guided tumor therapy. At last, we discuss the advantages and disadvantages of the present methods to construct the multimodal nanoprobes and share our viewpoints in this area.

  10. Exploiting multimode waveguides for pure fibre based fluorescence imaging

    Science.gov (United States)

    Čižmár, TomáÅ.¡; Dholakia, Kishan

    2013-03-01

    There has been an immense drive in modern microscopy towards miniaturisation and _bre based technology. This has been necessitated by the need to access hostile or difficult environments particulalrly in-situ and in-vivo. Strategies to date have included the use of specialist fibres and miniaturised scanning systems accompanied by ingenious microfabricated lenses. In parallel recent studies of randomized light fields and their holographic control opened up new ways for imaging. We present a novel approach for this field by utilising disordered light within a standard multimode optical fibre for minimally invasive lenseless microscopy and optical mode conversion. We demonstrate scanning uorescence microscopy at acquisition rates allowing observation of dynamic processes such as Brownian motion of mesoscopic particles. As the sample plane can be defined at any distance from the fibre facet, we eliminate the need for complex or elaborate focusing optics (e.g. miniaturized objectives, GRIN lenses) and instead reconfigure the system dynamically to image different axial planes. Furthermore, we show how such control can realise a new form of mode converter and generate various types of advanced light fields such as propagation-invariant beams and optical vortices. These may be useful for future fibre based implementations of super-resolution or light sheet microscopy. To the best of our knowledge, this technology represents the narrowest possible image guiding system based on light propagation.

  11. Compact Spectrometer based on a silicon multimode waveguide

    DEFF Research Database (Denmark)

    Piels, Molly; Zibar, Darko

    2017-01-01

    A multimode waveguide spectrometer with 4 GHz resolution, 250 GHz usable range, and a 1.6 mm × 2.1 mm footprint is demonstrated. The operating range is greatly extended by including distinct mode-exciting elements on chip.......A multimode waveguide spectrometer with 4 GHz resolution, 250 GHz usable range, and a 1.6 mm × 2.1 mm footprint is demonstrated. The operating range is greatly extended by including distinct mode-exciting elements on chip....

  12. Anatomy-preserving nonlinear registration of deep brain ROIs using confidence-based block-matching.

    Science.gov (United States)

    Bhattacharjee, Manik; Pitiot, Alain; Roche, Alexis; Dormont, Didier; Bardinet, Eric

    2008-01-01

    Brain atlases are commonly used in a number of applications such as MRI segmentation and surgery targetting. Our goal is to register a basal ganglia atlas to a subject using MR image registration. Existing registration methods are for the most part either too constrained (linear registration) or can deform deep brain ROIs into implausible anatomical shapes. We developed a block-matching registration method suitable for atlas registration, using a new confidence-based regularization of the vector field. The method was used to register a set of 17 manually segmented MRI onto one subject. Results show that basal ganglia structures were better registered than when using an affine registration method.

  13. Optimization Model for Web Based Multimodal Interactive Simulations.

    Science.gov (United States)

    Halic, Tansel; Ahn, Woojin; De, Suvranu

    2015-07-15

    This paper presents a technique for optimizing the performance of web based multimodal interactive simulations. For such applications where visual quality and the performance of simulations directly influence user experience, overloading of hardware resources may result in unsatisfactory reduction in the quality of the simulation and user satisfaction. However, optimization of simulation performance on individual hardware platforms is not practical. Hence, we present a mixed integer programming model to optimize the performance of graphical rendering and simulation performance while satisfying application specific constraints. Our approach includes three distinct phases: identification, optimization and update . In the identification phase, the computing and rendering capabilities of the client device are evaluated using an exploratory proxy code. This data is utilized in conjunction with user specified design requirements in the optimization phase to ensure best possible computational resource allocation. The optimum solution is used for rendering (e.g. texture size, canvas resolution) and simulation parameters (e.g. simulation domain) in the update phase. Test results are presented on multiple hardware platforms with diverse computing and graphics capabilities to demonstrate the effectiveness of our approach.

  14. Deformable Image Registration based on Similarity-Steered CNN Regression

    Science.gov (United States)

    Cao, Xiaohuan; Yang, Jianhua; Zhang, Jun; Nie, Dong; Kim, Min-jeong; Wang, Qian

    2017-01-01

    Existing deformable registration methods require exhaustively iterative optimization, along with careful parameter tuning, to estimate the deformation field between images. Although some learning-based methods have been proposed for initiating deformation estimation, they are often template-specific and not flexible in practical use. In this paper, we propose a convolutional neural network (CNN) based regression model to directly learn the complex mapping from the input image pair (i.e., a pair of template and subject) to their corresponding deformation field. Specifically, our CNN architecture is designed in a patch-based manner to learn the complex mapping from the input patch pairs to their respective deformation field. First, the equalized active-points guided sampling strategy is introduced to facilitate accurate CNN model learning upon a limited image dataset. Then, the similarity-steered CNN architecture is designed, where we propose to add the auxiliary contextual cue, i.e., the similarity between input patches, to more directly guide the learning process. Experiments on different brain image datasets demonstrate promising registration performance based on our CNN model. Furthermore, it is found that the trained CNN model from one dataset can be successfully transferred to another dataset, although brain appearances across datasets are quite variable. PMID:29250613

  15. Polyaffine parametrization of image registration based on geodesic flows

    DEFF Research Database (Denmark)

    Hansen, Michael Sass; Thorup, Signe Strann; Warfield, Simon K.

    2012-01-01

    Image registration based on geodesic flows has gained much popularity in recent years. We describe a novel parametrization of the velocity field in a stationary flow equation. We show that the method offers both precision, flexibility, and simplicity of evaluation. With our representation, which ...... of geodesic shooting for computational anatomy. We avoid to do warp field convolution by interpolation in a dense field, we can easily calculate warp derivatives in a reference frame of choice, and we can consequently avoid interpolation in the image space altogether....

  16. Projection-slice theorem based 2D-3D registration

    Science.gov (United States)

    van der Bom, M. J.; Pluim, J. P. W.; Homan, R.; Timmer, J.; Bartels, L. W.

    2007-03-01

    In X-ray guided procedures, the surgeon or interventionalist is dependent on his or her knowledge of the patient's specific anatomy and the projection images acquired during the procedure by a rotational X-ray source. Unfortunately, these X-ray projections fail to give information on the patient's anatomy in the dimension along the projection axis. It would be very profitable to provide the surgeon or interventionalist with a 3D insight of the patient's anatomy that is directly linked to the X-ray images acquired during the procedure. In this paper we present a new robust 2D-3D registration method based on the Projection-Slice Theorem. This theorem gives us a relation between the pre-operative 3D data set and the interventional projection images. Registration is performed by minimizing a translation invariant similarity measure that is applied to the Fourier transforms of the images. The method was tested by performing multiple exhaustive searches on phantom data of the Circle of Willis and on a post-mortem human skull. Validation was performed visually by comparing the test projections to the ones that corresponded to the minimal value of the similarity measure. The Projection-Slice Theorem Based method was shown to be very effective and robust, and provides capture ranges up to 62 degrees. Experiments have shown that the method is capable of retrieving similar results when translations are applied to the projection images.

  17. Bi-objective optimization for multi-modal transportation routing planning problem based on Pareto optimality

    Directory of Open Access Journals (Sweden)

    Yan Sun

    2015-09-01

    Full Text Available Purpose: The purpose of study is to solve the multi-modal transportation routing planning problem that aims to select an optimal route to move a consignment of goods from its origin to its destination through the multi-modal transportation network. And the optimization is from two viewpoints including cost and time. Design/methodology/approach: In this study, a bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. Minimizing the total transportation cost and the total transportation time are set as the optimization objectives of the model. In order to balance the benefit between the two objectives, Pareto optimality is utilized to solve the model by gaining its Pareto frontier. The Pareto frontier of the model can provide the multi-modal transportation operator (MTO and customers with better decision support and it is gained by the normalized normal constraint method. Then, an experimental case study is designed to verify the feasibility of the model and Pareto optimality by using the mathematical programming software Lingo. Finally, the sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case. Findings: The calculation results indicate that the proposed model and Pareto optimality have good performance in dealing with the bi-objective optimization. The sensitivity analysis also shows the influence of the variation of the demand and supply on the multi-modal transportation organization clearly. Therefore, this method can be further promoted to the practice. Originality/value: A bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. The Pareto frontier based sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case.

  18. Information theory-based automatic multimodal transfer function design.

    Science.gov (United States)

    Bramon, Roger; Ruiz, Marc; Bardera, Anton; Boada, Imma; Feixas, Miquel; Sbert, Mateu

    2013-07-01

    In this paper, we present a new framework for multimodal volume visualization that combines several information-theoretic strategies to define both colors and opacities of the multimodal transfer function. To the best of our knowledge, this is the first fully automatic scheme to visualize multimodal data. To define the fused color, we set an information channel between two registered input datasets, and afterward, we compute the informativeness associated with the respective intensity bins. This informativeness is used to weight the color contribution from both initial 1-D transfer functions. To obtain the opacity, we apply an optimization process that minimizes the informational divergence between the visibility distribution captured by a set of viewpoints and a target distribution proposed by the user. This distribution is defined either from the dataset features, from manually set importances, or from both. Other problems related to the multimodal visualization, such as the computation of the fused gradient and the histogram binning, have also been solved using new information-theoretic strategies. The quality and performance of our approach are evaluated on different datasets.

  19. Multimodal imaging and in vivo/post mortem co-registration in rodents and non human primates

    International Nuclear Information System (INIS)

    Delzescaux, T.

    2006-01-01

    provided information (typically 15-70 μm versus several hundreds μm to several mm for in vivo anatomy and function devices), make post mortem imaging a real advantage over in vivo and a gold standard for macroscopic in vivo studies. However, post mortem imaging does not allow longitudinal follow-up studies, requires brain cutting into serial sections producing up to several hundreds/thousands of histological and autoradiographic data, individual brain sections are spatially separated and 3-D spatial geometry (available with in vivo imaging systems) is lost. These later years, many methods have been proposed in the literature to align 2-D histological or autoradiographic . However, a few works have specifically addressed the registration of post mortem images from two modalities, such as histology and autoradiography or the in vivo/post mortem co-registration. Moreover, despite the diffusion of 3-D reconstruction automated tools, generic and robust algorithms, allowing massive digitization as well as automated data analysis taking advantage of the 3-D anatomo-functional reconstruction, are still missing. Hence, post mortem imaging encompasses low cost, easily available, very accurate methods which main limitations are the very large amounts of data, the duration time for the whole data processing and the loss of volumetric consistency. Thus, without dedicated computer tools able to easily and quickly process them, the analysis of such biological post mortem data is traditionally realized with a limited number of 2-D sections and remains time-consuming and labor-intensive . Our research projects aim at proposing automated image processing protocols of post mortem biological data obtained in rodent and non-human primates in order to reconstruct in 3-D post mortem data and to integrate both in vivo/post mortem and anatomical/functional information. The first project deals with animals presenting small brains such as rodents. It includes the optimized acquisition and the

  20. Research based on the SoPC platform of feature-based image registration

    Science.gov (United States)

    Shi, Yue-dong; Wang, Zhi-hui

    2015-12-01

    This paper focuses on the study of implementing feature-based image registration by System on a Programmable Chip (SoPC) hardware platform. We solidify the image registration algorithm on the FPGA chip, in which embedded soft core processor Nios II can speed up the image processing system. In this way, we can make image registration technology get rid of the PC. And, consequently, this kind of technology will be got an extensive use. The experiment result indicates that our system shows stable performance, particularly in terms of matching processing which noise immunity is good. And feature points of images show a reasonable distribution.

  1. Rolled fingerprint construction using MRF-based nonrigid image registration.

    Science.gov (United States)

    Kwon, Dongjin; Yun, Il Dong; Lee, Sang Uk

    2010-12-01

    This paper proposes a new rolled fingerprint construction approach incorporating a state-of-the-art nonrigid image registration method based upon a Markov random field (MRF) energy model. The proposed method finds dense correspondences between images from a rolled fingerprint sequence and warps the entire fingerprint area to synthesize a rolled fingerprint. This method can generate conceptually more accurate rolled fingerprints by preserving the geometric properties of the finger surface as opposed to ink-based rolled impressions and other existing rolled fingerprint construction methods. To verify the accuracy of the proposed method, various comparative experiments were designed to reveal differences among the rolled construction methods. The results show that the proposed method is significantly superior in various aspects compared to previous approaches.

  2. COMPARISON OF VOLUMETRIC REGISTRATION ALGORITHMS FOR TENSOR-BASED MORPHOMETRY.

    Science.gov (United States)

    Villalon, Julio; Joshi, Anand A; Toga, Arthur W; Thompson, Paul M

    2011-01-01

    Nonlinear registration of brain MRI scans is often used to quantify morphological differences associated with disease or genetic factors. Recently, surface-guided fully 3D volumetric registrations have been developed that combine intensity-guided volume registrations with cortical surface constraints. In this paper, we compare one such algorithm to two popular high-dimensional volumetric registration methods: large-deformation viscous fluid registration, formulated in a Riemannian framework, and the diffeomorphic "Demons" algorithm. We performed an objective morphometric comparison, by using a large MRI dataset from 340 young adult twin subjects to examine 3D patterns of correlations in anatomical volumes. Surface-constrained volume registration gave greater effect sizes for detecting morphometric associations near the cortex, while the other two approaches gave greater effects sizes subcortically. These findings suggest novel ways to combine the advantages of multiple methods in the future.

  3. Facial Emotion Recognition Using Context Based Multimodal Approach

    Directory of Open Access Journals (Sweden)

    Priya Metri

    2011-12-01

    Full Text Available Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user’s emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion . Multimodal system gives more accurate result than a signal or bimodal system

  4. Natural Language Based Multimodal Interface for UAV Mission Planning

    Science.gov (United States)

    Chandarana, Meghan; Meszaros, Erica L.; Trujillo, Anna; Allen, B. Danette

    2017-01-01

    As the number of viable applications for unmanned aerial vehicle (UAV) systems increases at an exponential rate, interfaces that reduce the reliance on highly skilled engineers and pilots must be developed. Recent work aims to make use of common human communication modalities such as speech and gesture. This paper explores a multimodal natural language interface that uses a combination of speech and gesture input modalities to build complex UAV flight paths by defining trajectory segment primitives. Gesture inputs are used to define the general shape of a segment while speech inputs provide additional geometric information needed to fully characterize a trajectory segment. A user study is conducted in order to evaluate the efficacy of the multimodal interface.

  5. Feature and Intensity Based Medical Image Registration Using Particle Swarm Optimization.

    Science.gov (United States)

    Abdel-Basset, Mohamed; Fakhry, Ahmed E; El-Henawy, Ibrahim; Qiu, Tie; Sangaiah, Arun Kumar

    2017-11-03

    Image registration is an important aspect in medical image analysis, and kinds use in a variety of medical applications. Examples include diagnosis, pre/post surgery guidance, comparing/merging/integrating images from multi-modal like Magnetic Resonance Imaging (MRI), and Computed Tomography (CT). Whether registering images across modalities for a single patient or registering across patients for a single modality, registration is an effective way to combine information from different images into a normalized frame for reference. Registered datasets can be used for providing information relating to the structure, function, and pathology of the organ or individual being imaged. In this paper a hybrid approach for medical images registration has been developed. It employs a modified Mutual Information (MI) as a similarity metric and Particle Swarm Optimization (PSO) method. Computation of mutual information is modified using a weighted linear combination of image intensity and image gradient vector flow (GVF) intensity. In this manner, statistical as well as spatial image information is included into the image registration process. Maximization of the modified mutual information is effected using the versatile Particle Swarm Optimization which is developed easily with adjusted less parameter. The developed approach has been tested and verified successfully on a number of medical image data sets that include images with missing parts, noise contamination, and/or of different modalities (CT, MRI). The registration results indicate the proposed model as accurate and effective, and show the posture contribution in inclusion of both statistical and spatial image data to the developed approach.

  6. Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

    Directory of Open Access Journals (Sweden)

    Jing-Yu Yang

    2012-04-01

    Full Text Available When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person’s overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA. Specifically, one person’s different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

  7. A Microcontroller Based Multimodal Wheelchair Prototype for the Disabled

    OpenAIRE

    Sandeep Kumar; Vikrant Verma; Deepika

    2017-01-01

    Here an attempt is made to provide a reliable, more user-friendly, eco-friendly and viable mobility aid in the form of a smart multimodal power assisted wheelchair for those who are disabled in movement. The wheelchair is designed for a social cause and the purpose is to raise the self-confidence level of a significant class of disabled and elder people of a country like India, by providing them maximum autonomy so that they can lead a better life and participate in the community.

  8. Researchers and teachers learning together and from each other using video-based multimodal analysis

    DEFF Research Database (Denmark)

    Davidsen, Jacob; Vanderlinde, Ruben

    2014-01-01

    This paper discusses a year-long technology integration project, during which teachers and researchers joined forces to explore children’s collaborative activities through the use of touch-screens. In the research project, discussed in this paper, 16 touch-screens were integrated into teaching...... integrated touch-screens into their teaching and learning. This paper examines the methodological usefulness of video-based multimodal analysis. Through reflection on the research project, we discuss how, by using video-based multimodal analysis, researchers and teachers can study children’s touch-screen...

  9. FPGA Accelerator for Wavelet-Based Automated Global Image Registration

    Directory of Open Access Journals (Sweden)

    Baofeng Li

    2009-01-01

    Full Text Available Wavelet-based automated global image registration (WAGIR is fundamental for most remote sensing image processing algorithms and extremely computation-intensive. With more and more algorithms migrating from ground computing to onboard computing, an efficient dedicated architecture of WAGIR is desired. In this paper, a BWAGIR architecture is proposed based on a block resampling scheme. BWAGIR achieves a significant performance by pipelining computational logics, parallelizing the resampling process and the calculation of correlation coefficient and parallel memory access. A proof-of-concept implementation with 1 BWAGIR processing unit of the architecture performs at least 7.4X faster than the CL cluster system with 1 node, and at least 3.4X than the MPM massively parallel machine with 1 node. Further speedup can be achieved by parallelizing multiple BWAGIR units. The architecture with 5 units achieves a speedup of about 3X against the CL with 16 nodes and a comparative speed with the MPM with 30 nodes. More importantly, the BWAGIR architecture can be deployed onboard economically.

  10. FPGA Accelerator for Wavelet-Based Automated Global Image Registration

    Directory of Open Access Journals (Sweden)

    Li Baofeng

    2009-01-01

    Full Text Available Abstract Wavelet-based automated global image registration (WAGIR is fundamental for most remote sensing image processing algorithms and extremely computation-intensive. With more and more algorithms migrating from ground computing to onboard computing, an efficient dedicated architecture of WAGIR is desired. In this paper, a BWAGIR architecture is proposed based on a block resampling scheme. BWAGIR achieves a significant performance by pipelining computational logics, parallelizing the resampling process and the calculation of correlation coefficient and parallel memory access. A proof-of-concept implementation with 1 BWAGIR processing unit of the architecture performs at least 7.4X faster than the CL cluster system with 1 node, and at least 3.4X than the MPM massively parallel machine with 1 node. Further speedup can be achieved by parallelizing multiple BWAGIR units. The architecture with 5 units achieves a speedup of about 3X against the CL with 16 nodes and a comparative speed with the MPM with 30 nodes. More importantly, the BWAGIR architecture can be deployed onboard economically.

  11. A Surface-Based Spatial Registration Method Based on Sense Three-Dimensional Scanner.

    Science.gov (United States)

    Fan, Yifeng; Xu, Xiufang; Wang, Manning

    2017-01-01

    The purpose of this study was to investigate the feasibility of a surface-based registration method based on a low-cost, hand-held Sense three-dimensional (3D) scanner in image-guided neurosurgery system. The scanner was calibrated prior and fixed on a tripod before registration. During registration, a part of the head surface was scanned at first and the spatial position of the adapter was recorded. Then the scanner was taken off from the tripod and the entire head surface was scanned by moving the scanner around the patient's head. All the scan points were aligned to the recorded spatial position to form a unique point cloud of the head by the automatic mosaic function of the scanner. The coordinates of the scan points were transformed from the device space to the adapter space by a calibration matrix, and then to the patient space. A 2-step patient-to-image registration method was then performed to register the patient space to the image space. The experimental results showed that the mean target registration error of 15 targets on the surface of the phantom was 1.61±0.09 mm. In a clinical experiment, the mean target registration error of 7 targets on the patient's head surface was 2.50±0.31 mm, which was sufficient to meet clinical requirements. It is feasible to use the Sense 3D scanner for patient-to-image registration, and the low-cost Sense 3D scanner can take the place of the current used scanner in the image-guided neurosurgery system.

  12. A CNN based Hybrid approach towards automatic image registration

    Science.gov (United States)

    Arun, Pattathal V.; Katiyar, Sunil K.

    2013-06-01

    Image registration is a key component of various image processing operations which involve the analysis of different image data sets. Automatic image registration domains have witnessed the application of many intelligent methodologies over the past decade; however inability to properly model object shape as well as contextual information had limited the attainable accuracy. In this paper, we propose a framework for accurate feature shape modeling and adaptive resampling using advanced techniques such as Vector Machines, Cellular Neural Network (CNN), SIFT, coreset, and Cellular Automata. CNN has found to be effective in improving feature matching as well as resampling stages of registration and complexity of the approach has been considerably reduced using corset optimization The salient features of this work are cellular neural network approach based SIFT feature point optimisation, adaptive resampling and intelligent object modelling. Developed methodology has been compared with contemporary methods using different statistical measures. Investigations over various satellite images revealed that considerable success was achieved with the approach. System has dynamically used spectral and spatial information for representing contextual knowledge using CNN-prolog approach. Methodology also illustrated to be effective in providing intelligent interpretation and adaptive resampling. Rejestracja obrazu jest kluczowym składnikiem różnych operacji jego przetwarzania. W ostatnich latach do automatycznej rejestracji obrazu wykorzystuje się metody sztucznej inteligencji, których największą wadą, obniżającą dokładność uzyskanych wyników jest brak możliwości dobrego wymodelowania kształtu i informacji kontekstowych. W niniejszej pracy zaproponowano zasady dokładnego modelowania kształtu oraz adaptacyjnego resamplingu z wykorzystaniem zaawansowanych technik, takich jak Vector Machines (VM), komórkowa sieć neuronowa (CNN), przesiewanie (SIFT), Coreset i

  13. CO-REGISTRATION AIRBORNE LIDAR POINT CLOUD DATA AND SYNCHRONOUS DIGITAL IMAGE REGISTRATION BASED ON COMBINED ADJUSTMENT

    Directory of Open Access Journals (Sweden)

    Z. H. Yang

    2016-06-01

    Full Text Available Aim at the problem of co-registration airborne laser point cloud data with the synchronous digital image, this paper proposed a registration method based on combined adjustment. By integrating tie point, point cloud data with elevation constraint pseudo observations, using the principle of least-squares adjustment to solve the corrections of exterior orientation elements of each image, high-precision registration results can be obtained. In order to ensure the reliability of the tie point, and the effectiveness of pseudo observations, this paper proposed a point cloud data constrain SIFT matching and optimizing method, can ensure that the tie points are located on flat terrain area. Experiments with the airborne laser point cloud data and its synchronous digital image, there are about 43 pixels error in image space using the original POS data. If only considering the bore-sight of POS system, there are still 1.3 pixels error in image space. The proposed method regards the corrections of the exterior orientation elements of each image as unknowns and the errors are reduced to 0.15 pixels.

  14. Creative Multimodal Learning Environments and Blended Interaction for Problem-Based Activity in HCI Education

    Science.gov (United States)

    Ioannou, Andri; Vasiliou, Christina; Zaphiris, Panayiotis; Arh, Tanja; Klobucar, Tomaž; Pipan, Matija

    2015-01-01

    This exploratory case study aims to examine how students benefit from a multimodal learning environment while they engage in collaborative problem-based activity in a Human Computer Interaction (HCI) university course. For 12 weeks, 30 students, in groups of 5-7 each, participated in weekly face-to-face meetings and online interactions.…

  15. A Randomized Trial of a Multimodal Community-Based Prisoner Reentry Program Emphasizing Substance Abuse Treatment

    Science.gov (United States)

    Grommon, Eric; Davidson, William S., II; Bynum, Timothy S.

    2013-01-01

    Prisoner reentry programs continue to be developed and implemented to ease the process of transition into the community and to curtail fiscal pressures. This study describes and provides relapse and recidivism outcome findings related to a randomized trial evaluating a multimodal, community-based reentry program that prioritized substance abuse…

  16. A vascular image registration method based on network structure and circuit simulation.

    Science.gov (United States)

    Chen, Li; Lian, Yuxi; Guo, Yi; Wang, Yuanyuan; Hatsukami, Thomas S; Pimentel, Kristi; Balu, Niranjan; Yuan, Chun

    2017-05-02

    Image registration is an important research topic in the field of image processing. Applying image registration to vascular image allows multiple images to be strengthened and fused, which has practical value in disease detection, clinical assisted therapy, etc. However, it is hard to register vascular structures with high noise and large difference in an efficient and effective method. Different from common image registration methods based on area or features, which were sensitive to distortion and uncertainty in vascular structure, we proposed a novel registration method based on network structure and circuit simulation. Vessel images were transformed to graph networks and segmented to branches to reduce the calculation complexity. Weighted graph networks were then converted to circuits, in which node voltages of the circuit reflecting the vessel structures were used for node registration. The experiments in the two-dimensional and three-dimensional simulation and clinical image sets showed the success of our proposed method in registration. The proposed vascular image registration method based on network structure and circuit simulation is stable, fault tolerant and efficient, which is a useful complement to the current mainstream image registration methods.

  17. Elastic registration of prostate MR images based on state estimation of dynamical systems

    Science.gov (United States)

    Marami, Bahram; Ghoul, Suha; Sirouspour, Shahin; Capson, David W.; Davidson, Sean R. H.; Trachtenberg, John; Fenster, Aaron

    2014-03-01

    Magnetic resonance imaging (MRI) is being increasingly used for image-guided biopsy and focal therapy of prostate cancer. A combined rigid and deformable registration technique is proposed to register pre-treatment diagnostic 3T magnetic resonance (MR) images, with the identified target tumor(s), to the intra-treatment 1.5T MR images. The pre-treatment 3T images are acquired with patients in strictly supine position using an endorectal coil, while 1.5T images are obtained intra-operatively just before insertion of the ablation needle with patients in the lithotomy position. An intensity-based registration routine rigidly aligns two images in which the transformation parameters is initialized using three pairs of manually selected approximate corresponding points. The rigid registration is followed by a deformable registration algorithm employing a generic dynamic linear elastic deformation model discretized by the finite element method (FEM). The model is used in a classical state estimation framework to estimate the deformation of the prostate based on a similarity metric between pre- and intra-treatment images. Registration results using 10 sets of prostate MR images showed that the proposed method can significantly improve registration accuracy in terms of target registration error (TRE) for all prostate substructures. The root mean square (RMS) TRE of 46 manually identified fiducial points was found to be 2.40+/-1.20 mm, 2.51+/-1.20 mm, and 2.28+/-1.22mm for the whole gland (WG), central gland (CG), and peripheral zone (PZ), respectively after deformable registration. These values are improved from 3.15+/-1.60 mm, 3.09+/-1.50 mm, and 3.20+/-1.73mm in the WG, CG and PZ, respectively resulted from rigid registration. Registration results are also evaluated based on the Dice similarity coefficient (DSC), mean absolute surface distances (MAD) and maximum absolute surface distances (MAXD) of the WG and CG in the prostate images.

  18. OPTICAL-TO-SAR IMAGE REGISTRATION BASED ON GAUSSIAN MIXTURE MODEL

    Directory of Open Access Journals (Sweden)

    H. Wang

    2012-07-01

    Full Text Available Image registration is a fundamental in remote sensing applications such as inter-calibration and image fusion. Compared to other multi sensor image registration problems such as optical-to-IR, the registration for SAR and optical images has its specials. Firstly, the radiometric and geometric characteristics are different between SAR and optical images. Secondly, the feature extraction methods are heavily suffered with the speckle in SAR images. Thirdly, the structural information is more useful than the point features such as corners. In this work, we proposed a novel Gaussian Mixture Model (GMM based Optical-to-SAR image registration algorithm. The feature of line support region (LSR is used to describe the structural information and the orientation attributes are added into the GMM to avoid Expectation Maximization (EM algorithm falling into local extremum in feature sets matching phase. Through the experiments it proves that our algorithm is very robust for optical-to- SAR image registration problem.

  19. A Novel Multimodal Biometrics Recognition Model Based on Stacked ELM and CCA Methods

    Directory of Open Access Journals (Sweden)

    Jucheng Yang

    2018-04-01

    Full Text Available Multimodal biometrics combine a variety of biological features to have a significant impact on identification performance, which is a newly developed trend in biometrics identification technology. This study proposes a novel multimodal biometrics recognition model based on the stacked extreme learning machines (ELMs and canonical correlation analysis (CCA methods. The model, which has a symmetric structure, is found to have high potential for multimodal biometrics. The model works as follows. First, it learns the hidden-layer representation of biological images using extreme learning machines layer by layer. Second, the canonical correlation analysis method is applied to map the representation to a feature space, which is used to reconstruct the multimodal image feature representation. Third, the reconstructed features are used as the input of a classifier for supervised training and output. To verify the validity and efficiency of the method, we adopt it for new hybrid datasets obtained from typical face image datasets and finger-vein image datasets. Our experimental results demonstrate that our model performs better than traditional methods.

  20. Multimodal System Based on Electrooculography and Voice Recognition to Control a Robot Arm

    Directory of Open Access Journals (Sweden)

    José A. Martínez

    2013-07-01

    Full Text Available People with severe motor disorders cannot use their arms and/or hands to interact with the environment. In such cases, a human-machine interface can be used to allow these people to perform activities of daily life. Voice recognition would be the best method to control a device devoted to help with these tasks, but this method is very dependent on the background noise and, under certain circumstances, it cannot be used successfully. In this sense, other methods must be included in the system to assist the voice recognition module. In this project, electrooculography (EOG has been selected due to its stability and robustness. This way, a multimodal system based on EOG and voice recognition has been developed to control a robotic arm. This paper presents the procedures designed to combine both methods to create a multimodal interface useful for disabled people. Tests presented in this document compare the skills of five different users while controlling the robotic arm to perform pick-and-place tasks. Task duration and accuracy have been measured to obtain specific scores that are used to evaluate both interaction methods independently and the multimodal combination of them. The system works successfully using both methods (EOG and voice recognition. In addition, the multimodal interface improves robustness and reduces the uncertainty generated by the environment when there is background noise.

  1. Comparison of carina-based versus bony anatomy-based registration for setup verification in esophageal cancer radiotherapy.

    Science.gov (United States)

    Machiels, Mélanie; Jin, Peng; van Gurp, Christianne H; van Hooft, Jeanin E; Alderliesten, Tanja; Hulshof, Maarten C C M

    2018-03-21

    To investigate the feasibility and geometric accuracy of carina-based registration for CBCT-guided setup verification in esophageal cancer IGRT, compared with current practice bony anatomy-based registration. Included were 24 esophageal cancer patients with 65 implanted fiducial markers, visible on planning CTs and follow-up CBCTs. All available CBCT scans (n = 236) were rigidly registered to the planning CT with respect to the bony anatomy and the carina. Target coverage was visually inspected and marker position variation was quantified relative to both registration approaches; the variation of systematic (Σ) and random errors (σ) was estimated. Automatic carina-based registration was feasible in 94.9% of the CBCT scans, with an adequate target coverage in 91.1% compared to 100% after bony anatomy-based registration. Overall, Σ (σ) in the LR/CC/AP direction was 2.9(2.4)/4.1(2.4)/2.2(1.8) mm using the bony anatomy registration compared to 3.3(3.0)/3.6(2.6)/3.9(3.1) mm for the carina. Mid-thoracic placed markers showed a non-significant but smaller Σ in CC and AP direction when using the carina-based registration. Compared with a bony anatomy-based registration, carina-based registration for esophageal cancer IGRT results in inadequate target coverage in 8.9% of cases. Furthermore, large Σ and σ, requiring larger anisotropic margins, were seen after carina-based registration. Only for tumors entirely confined to the mid-thoracic region the carina-based registration might be slightly favorable.

  2. Nonrigid free-form registration using landmark-based statistical deformation models

    Science.gov (United States)

    Pszczolkowski, Stefan; Pizarro, Luis; Guerrero, Ricardo; Rueckert, Daniel

    2012-02-01

    In this paper, we propose an image registration algorithm named statistically-based FFD registration (SFFD). This registration method is a modification of a well-known free-form deformations (FFD) approach. Our framework dramatically reduces the number of parameters to optimise and only needs to perform a single-resolution optimisation to account for coarse and fine local displacements, in contrast to the multi-resolution strategy employed by the FFD-based registration. The proposed registration uses statistical deformation models (SDMs) as a priori knowledge to guide the alignment of a new subject to a common reference template. These SDMs account for the anatomical mean and variability across a population of subjects. We also propose that available anatomical landmark information can be encoded within the proposed SDM framework to enforce the alignment of certain anatomical structures. We present results in terms of fiducial localisation error, which illustrate the ability of the SDMs to encode landmark position information. We also show that our statistical registration algorithm can provide registration results comparable to the standard FFD-based approach at a much lower computational cost.

  3. Registration and fusion quantification of augmented reality based nasal endoscopic surgery.

    Science.gov (United States)

    Chu, Yakui; Yang, Jian; Ma, Shaodong; Ai, Danni; Li, Wenjie; Song, Hong; Li, Liang; Chen, Duanduan; Chen, Lei; Wang, Yongtian

    2017-12-01

    This paper quantifies the registration and fusion display errors of augmented reality-based nasal endoscopic surgery (ARNES). We comparatively investigated the spatial calibration process for front-end endoscopy and redefined the accuracy level of a calibrated endoscope by using a calibration tool with improved structural reliability. We also studied how registration accuracy was combined with the number and distribution of the deployed fiducial points (FPs) for positioning and the measured registration time. A physically integrated ARNES prototype was customarily configured for performance evaluation in skull base tumor resection surgery with an innovative approach of dynamic endoscopic vision expansion. As advised by surgical experts in otolaryngology, we proposed a hierarchical rendering scheme to properly adapt the fused images with the required visual sensation. By constraining the rendered sight in a known depth and radius, the visual focus of the surgeon can be induced only on the anticipated critical anatomies and vessel structures to avoid misguidance. Furthermore, error analysis was conducted to examine the feasibility of hybrid optical tracking based on point cloud, which was proposed in our previous work as an in-surgery registration solution. Measured results indicated that the error of target registration for ARNES can be reduced to 0.77 ± 0.07 mm. For initial registration, our results suggest that a trade-off for a new minimal time of registration can be reached when the distribution of five FPs is considered. For in-surgery registration, our findings reveal that the intrinsic registration error is a major cause of performance loss. Rigid model and cadaver experiments confirmed that the scenic integration and display fluency of ARNES are smooth, as demonstrated by three clinical trials that surpassed practicality. Copyright © 2017 Elsevier B.V. All rights reserved.

  4. Albumin based versatile multifunctional nanocarriers for cancer therapy: Fabrication, surface modification, multimodal therapeutics and imaging approaches.

    Science.gov (United States)

    Kudarha, Ritu R; Sawant, Krutika K

    2017-12-01

    Albumin is a versatile protein used as a carrier system for cancer therapeutics. As a carrier it can provide tumor specificity, reduce drug related toxicity, maintain therapeutic concentration of the active moiety like drug, gene, peptide, protein etc. for long period of time and also reduce drug related toxicities. Apart from cancer therapy, it is also utilized in the imaging and multimodal therapy of cancer. This review highlights the important properties, structure and types of albumin based nanocarriers with regards to their use for cancer targeting. It also provides brief discussion on methods of preparation of these nanocarriers and their surface modification. Applications of albumin nanocarriers for cancer therapy, gene delivery, imaging, phototherapy and multimodal therapy have also been discussed. This review also provides brief discussion about albumin based marketed nano formulations and those under clinical trials. Copyright © 2017 Elsevier B.V. All rights reserved.

  5. IR and visual image registration based on mutual information and PSO-Powell algorithm

    Science.gov (United States)

    Zhuang, Youwen; Gao, Kun; Miu, Xianghu

    2014-11-01

    Infrared and visual image registration has a wide application in the fields of remote sensing and military. Mutual information (MI) has proved effective and successful in infrared and visual image registration process. To find the most appropriate registration parameters, optimal algorithms, such as Particle Swarm Optimization (PSO) algorithm or Powell search method, are often used. The PSO algorithm has strong global search ability and search speed is fast at the beginning, while the weakness is low search performance in late search stage. In image registration process, it often takes a lot of time to do useless search and solution's precision is low. Powell search method has strong local search ability. However, the search performance and time is more sensitive to initial values. In image registration, it is often obstructed by local maximum and gets wrong results. In this paper, a novel hybrid algorithm, which combined PSO algorithm and Powell search method, is proposed. It combines both advantages that avoiding obstruction caused by local maximum and having higher precision. Firstly, using PSO algorithm gets a registration parameter which is close to global minimum. Based on the result in last stage, the Powell search method is used to find more precision registration parameter. The experimental result shows that the algorithm can effectively correct the scale, rotation and translation additional optimal algorithm. It can be a good solution to register infrared difference of two images and has a greater performance on time and precision than traditional and visible images.

  6. THE IMAGE REGISTRATION OF FOURIER-MELLIN BASED ON THE COMBINATION OF PROJECTION AND GRADIENT PREPROCESSING

    Directory of Open Access Journals (Sweden)

    D. Gao

    2017-09-01

    Full Text Available Image registration is one of the most important applications in the field of image processing. The method of Fourier Merlin transform, which has the advantages of high precision and good robustness to change in light and shade, partial blocking, noise influence and so on, is widely used. However, not only this method can’t obtain the unique mutual power pulse function for non-parallel image pairs, even part of image pairs also can’t get the mutual power function pulse. In this paper, an image registration method based on Fourier-Mellin transformation in the view of projection-gradient preprocessing is proposed. According to the projection conformational equation, the method calculates the matrix of image projection transformation to correct the tilt image; then, gradient preprocessing and Fourier-Mellin transformation are performed on the corrected image to obtain the registration parameters. Eventually, the experiment results show that the method makes the image registration of Fourier-Mellin transformation not only applicable to the registration of the parallel image pairs, but also to the registration of non-parallel image pairs. What’s more, the better registration effect can be obtained

  7. The Image Registration of Fourier-Mellin Based on the Combination of Projection and Gradient Preprocessing

    Science.gov (United States)

    Gao, D.; Zhao, X.; Pan, X.

    2017-09-01

    Image registration is one of the most important applications in the field of image processing. The method of Fourier Merlin transform, which has the advantages of high precision and good robustness to change in light and shade, partial blocking, noise influence and so on, is widely used. However, not only this method can't obtain the unique mutual power pulse function for non-parallel image pairs, even part of image pairs also can't get the mutual power function pulse. In this paper, an image registration method based on Fourier-Mellin transformation in the view of projection-gradient preprocessing is proposed. According to the projection conformational equation, the method calculates the matrix of image projection transformation to correct the tilt image; then, gradient preprocessing and Fourier-Mellin transformation are performed on the corrected image to obtain the registration parameters. Eventually, the experiment results show that the method makes the image registration of Fourier-Mellin transformation not only applicable to the registration of the parallel image pairs, but also to the registration of non-parallel image pairs. What's more, the better registration effect can be obtained

  8. Multimodal Image-Based Virtual Reality Presurgical Simulation and Evaluation for Trigeminal Neuralgia and Hemifacial Spasm.

    Science.gov (United States)

    Yao, Shujing; Zhang, Jiashu; Zhao, Yining; Hou, Yuanzheng; Xu, Xinghua; Zhang, Zhizhong; Kikinis, Ron; Chen, Xiaolei

    2018-02-21

    To address the feasibility and predictive value of multimodal image-based virtual reality in detecting and assessing features of neurovascular confliction (NVC), particularly regarding the detection of offending vessels, degree of compression exerted on the nerve root, in patients who underwent microvascular decompression for nonlesional trigeminal neuralgia and hemifacial spasm (HFS). This prospective study includes 42 consecutive patients who underwent microvascular decompression for classic primary trigeminal neuralgia or HFS. All patients underwent preoperative 1.5-T magnetic resonance imaging (MRI) with T2-weighted three-dimensional (3D) sampling perfection with application-optimized contrasts by using different flip angle evolutions, 3D time-of-flight magnetic resonance angiography, and 3D T1-weighted gadolinium-enhanced sequences in combination, whereas 2 patients underwent extra experimental preoperative 7.0-T MRI scans with the same imaging protocol. Multimodal MRIs were then coregistered with open-source software 3D Slicer, followed by 3D image reconstruction to generate virtual reality (VR) images for detection of possible NVC in the cerebellopontine angle. Evaluations were performed by 2 reviewers and compared with the intraoperative findings. For detection of NVC, multimodal image-based VR sensitivity was 97.6% (40/41) and specificity was 100% (1/1). Compared with the intraoperative findings, the κ coefficients for predicting the offending vessel and the degree of compression were >0.75 (P impact on detection of small-caliber offending vessels with relatively slow flow speed in cases of HFS. Multimodal image-based VR using 3D sampling perfection with application-optimized contrasts by using different flip angle evolutions in combination with 3D time-of-flight magnetic resonance angiography sequences proved to be reliable in detecting NVC and in predicting the degree of root compression. The VR image-based simulation correlated well with the real

  9. Multiresolution Search of the Rigid Motion Space for Intensity-Based Registration.

    Science.gov (United States)

    Nasihatkon, Behrooz; Kahl, Fredrik

    2018-01-01

    We study the relation between the correlation-based target functions of low-resolution and high-resolution intensity-based registration for the class of rigid transformations. Our results show that low-resolution target values can tightly bound the high-resolution target function in natural images. This can help with analyzing and better understanding the process of multiresolution image registration. It also gives a guideline for designing multiresolution algorithms in which the search space in higher resolution registration is restricted given the fitness values for lower resolution image pairs. To demonstrate this, we incorporate our multiresolution technique into a Lipschitz global optimization framework. We show that using the multiresolution scheme can result in large gains in the efficiency of such algorithms. The method is evaluated by applying to the problems of 2D registration, 3D rotation search, and the detection of reflective symmetry in 2D and 3D images.

  10. Study on Huizhou architecture of point cloud registration based on optimized ICP algorithm

    Science.gov (United States)

    Zhang, Runmei; Wu, Yulu; Zhang, Guangbin; Zhou, Wei; Tao, Yuqian

    2018-03-01

    In view of the current point cloud registration software has high hardware requirements, heavy workload and moltiple interactive definition, the source of software with better processing effect is not open, a two--step registration method based on normal vector distribution feature and coarse feature based iterative closest point (ICP) algorithm is proposed in this paper. This method combines fast point feature histogram (FPFH) algorithm, define the adjacency region of point cloud and the calculation model of the distribution of normal vectors, setting up the local coordinate system for each key point, and obtaining the transformation matrix to finish rough registration, the rough registration results of two stations are accurately registered by using the ICP algorithm. Experimental results show that, compared with the traditional ICP algorithm, the method used in this paper has obvious time and precision advantages for large amount of point clouds.

  11. Hierarchical Spatial Concept Formation Based on Multimodal Information for Human Support Robots

    Directory of Open Access Journals (Sweden)

    Yoshinobu Hagiwara

    2018-03-01

    Full Text Available In this paper, we propose a hierarchical spatial concept formation method based on the Bayesian generative model with multimodal information e.g., vision, position and word information. Since humans have the ability to select an appropriate level of abstraction according to the situation and describe their position linguistically, e.g., “I am in my home” and “I am in front of the table,” a hierarchical structure of spatial concepts is necessary in order for human support robots to communicate smoothly with users. The proposed method enables a robot to form hierarchical spatial concepts by categorizing multimodal information using hierarchical multimodal latent Dirichlet allocation (hMLDA. Object recognition results using convolutional neural network (CNN, hierarchical k-means clustering result of self-position estimated by Monte Carlo localization (MCL, and a set of location names are used, respectively, as features in vision, position, and word information. Experiments in forming hierarchical spatial concepts and evaluating how the proposed method can predict unobserved location names and position categories are performed using a robot in the real world. Results verify that, relative to comparable baseline methods, the proposed method enables a robot to predict location names and position categories closer to predictions made by humans. As an application example of the proposed method in a home environment, a demonstration in which a human support robot moves to an instructed place based on human speech instructions is achieved based on the formed hierarchical spatial concept.

  12. Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain

    Directory of Open Access Journals (Sweden)

    Yong Yang

    2014-01-01

    Full Text Available Multimodal medical image fusion is a powerful tool in clinical applications such as noninvasive diagnosis, image-guided radiotherapy, and treatment planning. In this paper, a novel nonsubsampled Contourlet transform (NSCT based method for multimodal medical image fusion is presented, which is approximately shift invariant and can effectively suppress the pseudo-Gibbs phenomena. The source medical images are initially transformed by NSCT followed by fusing low- and high-frequency components. The phase congruency that can provide a contrast and brightness-invariant representation is applied to fuse low-frequency coefficients, whereas the Log-Gabor energy that can efficiently determine the frequency coefficients from the clear and detail parts is employed to fuse the high-frequency coefficients. The proposed fusion method has been compared with the discrete wavelet transform (DWT, the fast discrete curvelet transform (FDCT, and the dual tree complex wavelet transform (DTCWT based image fusion methods and other NSCT-based methods. Visually and quantitatively experimental results indicate that the proposed fusion method can obtain more effective and accurate fusion results of multimodal medical images than other algorithms. Further, the applicability of the proposed method has been testified by carrying out a clinical example on a woman affected with recurrent tumor images.

  13. Learning-based deformable image registration for infant MR images in the first year of life.

    Science.gov (United States)

    Hu, Shunbo; Wei, Lifang; Gao, Yaozong; Guo, Yanrong; Wu, Guorong; Shen, Dinggang

    2017-01-01

    Many brain development studies have been devoted to investigate dynamic structural and functional changes in the first year of life. To quantitatively measure brain development in such a dynamic period, accurate image registration for different infant subjects with possible large age gap is of high demand. Although many state-of-the-art image registration methods have been proposed for young and elderly brain images, very few registration methods work for infant brain images acquired in the first year of life, because of (a) large anatomical changes due to fast brain development and (b) dynamic appearance changes due to white-matter myelination. To address these two difficulties, we propose a learning-based registration method to not only align the anatomical structures but also alleviate the appearance differences between two arbitrary infant MR images (with large age gap) by leveraging the regression forest to predict both the initial displacement vector and appearance changes. Specifically, in the training stage, two regression models are trained separately, with (a) one model learning the relationship between local image appearance (of one development phase) and its displacement toward the template (of another development phase) and (b) another model learning the local appearance changes between the two brain development phases. Then, in the testing stage, to register a new infant image to the template, we first predict both its voxel-wise displacement and appearance changes by the two learned regression models. Since such initializations can alleviate significant appearance and shape differences between new infant image and the template, it is easy to just use a conventional registration method to refine the remaining registration. We apply our proposed registration method to align 24 infant subjects at five different time points (i.e., 2-week-old, 3-month-old, 6-month-old, 9-month-old, and 12-month-old), and achieve more accurate and robust registration

  14. Handover Based IMS Registration Scheme for Next Generation Mobile Networks

    Directory of Open Access Journals (Sweden)

    Shireen Tahira

    2017-01-01

    Full Text Available Next generation mobile networks aim to provide faster speed and more capacity along with energy efficiency to support video streaming and massive data sharing in social and communication networks. In these networks, user equipment has to register with IP Multimedia Subsystem (IMS which promises quality of service to the mobile users that frequently move across different access networks. After each handover caused due to mobility, IMS provides IPSec Security Association establishment and authentication phases. The main issue is that unnecessary reregistration after every handover results in latency and communication overhead. To tackle these issues, this paper presents a lightweight Fast IMS Mobility (FIM registration scheme that avoids unnecessary conventional registration phases such as security associations, authentication, and authorization. FIM maintains a flag to avoid deregistration and sends a subsequent message to provide necessary parameters to IMS servers after mobility. It also handles the change of IP address for user equipment and transferring the security associations from old to new servers. We have validated the performance of FIM by developing a testbed consisting of IMS servers and user equipment. The experimental results demonstrate the performance supremacy of FIM. It reduces media disruption time, number of messages, and packet loss up to 67%, 100%, and 61%, respectively, as compared to preliminaries.

  15. Automatic vertebral identification using surface-based registration

    Science.gov (United States)

    Herring, Jeannette L.; Dawant, Benoit M.

    2000-06-01

    This work introduces an enhancement to currently existing methods of intra-operative vertebral registration by allowing the portion of the spinal column surface that correctly matches a set of physical vertebral points to be automatically selected from several possible choices. Automatic selection is made possible by the shape variations that exist among lumbar vertebrae. In our experiments, we register vertebral points representing physical space to spinal column surfaces extracted from computed tomography images. The vertebral points are taken from the posterior elements of a single vertebra to represent the region of surgical interest. The surface is extracted using an improved version of the fully automatic marching cubes algorithm, which results in a triangulated surface that contains multiple vertebrae. We find the correct portion of the surface by registering the set of physical points to multiple surface areas, including all vertebral surfaces that potentially match the physical point set. We then compute the standard deviation of the surface error for the set of points registered to each vertebral surface that is a possible match, and the registration that corresponds to the lowest standard deviation designates the correct match. We have performed our current experiments on two plastic spine phantoms and one patient.

  16. A robo-pigeon based on an innovative multi-mode telestimulation system.

    Science.gov (United States)

    Yang, Junqing; Huai, Ruituo; Wang, Hui; Lv, Changzhi; Su, Xuecheng

    2015-01-01

    In this paper, we describe a new multi-mode telestimulation system for brain-microstimulation for the navigation of a robo-pigeon, a new type of bio-robot based on Brain-Computer Interface (BCI) techniques. The multi-mode telestimulation system overcomes neuron adaptation that was a key shortcoming of the previous single-mode stimulation by the use of non-steady TTL biphasic pulses accomplished by randomly alternating pulse modes. To improve efficiency, a new behavior model ("virtual fear") is proposed and applied to the robo-pigeon. Unlike the previous "virtual reward" model, the "virtual fear" behavior model does not require special training. The performance and effectiveness of the system to alleviate the adaptation of neurons was verified by a robo-pigeon navigation test, simultaneously confirming the practicality of the "virtual fear" behavioral model.

  17. A Comparison of FFD-based Nonrigid Registration and AAMs Applied to Myocardial Perfusion MRI

    DEFF Research Database (Denmark)

    Ólafsdóttir, Hildur; Stegmann, Mikkel Bille; Ersbøll, Bjarne Kjær

    2006-01-01

    -form deformations (FFDs). AAMs are known to be much faster than nonrigid registration algorithms. On the other hand nonrigid registration algorithms are independent of a training set as required to build an AAM. To obtain a further comparison of the two methods, they are both applied to automatically register multi......-slice myocardial perfusion images. The images are acquired by magnetic resonance imaging, from infarct patients. A registration of these sequences is crucial for clinical practice, which currently is subjected to manual labor. In the paper, the pros and cons of the two registration approaches are discussed...... and qualitative and quantitative comparisons are provided. The quantitative comparison is obtained by an analysis of variance of landmark errors, i.e. point to point and point to curve errors. Even though the FFD-based approach does not include a training phase it gave similar accuracy as the AAMs in terms...

  18. Landmark Optimization Using Local Curvature for Point-Based Nonlinear Rodent Brain Image Registration

    Directory of Open Access Journals (Sweden)

    Yutong Liu

    2012-01-01

    Full Text Available Purpose. To develop a technique to automate landmark selection for point-based interpolating transformations for nonlinear medical image registration. Materials and Methods. Interpolating transformations were calculated from homologous point landmarks on the source (image to be transformed and target (reference image. Point landmarks are placed at regular intervals on contours of anatomical features, and their positions are optimized along the contour surface by a function composed of curvature similarity and displacements of the homologous landmarks. The method was evaluated in two cases (=5 each. In one, MRI was registered to histological sections; in the second, geometric distortions in EPI MRI were corrected. Normalized mutual information and target registration error were calculated to compare the registration accuracy of the automatically and manually generated landmarks. Results. Statistical analyses demonstrated significant improvement (<0.05 in registration accuracy by landmark optimization in most data sets and trends towards improvement (<0.1 in others as compared to manual landmark selection.

  19. Multimodal biometric authentication based on score level fusion using support vector machine

    Science.gov (United States)

    Wang, F.; Han, J.

    2009-03-01

    Fusion of multiple biometrics for human authentication performance improvement has received considerable attention. This paper presents a novel multimodal biometric authentication method integrating face and iris based on score level fusion. For score level fusion, support vector machine (SVM) based fusion rule is applied to combine two matching scores, respectively from Laplacianface based face verifier and phase information based iris verifier, to generate a single scalar score which is used to make the final decision. Experimental results show that the performance of the proposed method can bring obvious improvement comparing to the unimodal biometric identification methods and the previous fused face-iris methods.

  20. Strain sensor based on gourd-shaped single-mode-multimode-single-mode hybrid optical fibre structure.

    Science.gov (United States)

    Tian, Ke; Farrell, Gerald; Wang, Xianfan; Yang, Wenlei; Xin, Yifan; Liang, Haidong; Lewis, Elfed; Wang, Pengfei

    2017-08-07

    A fibre-optic strain sensor based on a gourd-shaped joint multimode fibre (MMF) sandwiched between two single-mode fibres (SMFs) is described both theoretically and experimentally. The cladding layers of the two MMFs are reshaped to form a hemisphere using an electrical arc method and spliced together, yielding the required gourd shape. The gourd-shaped section forms a Fabry-Perot cavity between the ends of two adjacent but non-contacting multimode fibres' core. The effectiveness of the multimode interference based on the Fabry-Perot interferometer (FPI) formed within the multimode inter-fibre section is greatly improved resulting in an experimentally determined strain sensitivity of -2.60 pm/με over the range 0-1000 με. The sensing characteristics for temperature and humidity of this optical fibre strain sensor are also investigated.

  1. Unified voxel- and tensor-based morphometry (UVTBM) using registration confidence.

    Science.gov (United States)

    Khan, Ali R; Wang, Lei; Beg, Mirza Faisal

    2015-01-01

    Voxel-based morphometry (VBM) and tensor-based morphometry (TBM) both rely on spatial normalization to a template and yet have different requirements for the level of registration accuracy. VBM requires only global alignment of brain structures, with limited degrees of freedom in transformation, whereas TBM performs best when the registration is highly deformable and can achieve higher registration accuracy. In addition, the registration accuracy varies over the whole brain, with higher accuracy typically observed in subcortical areas and lower accuracy seen in cortical areas. Hence, even the determinant of Jacobian of registration maps is spatially varying in their accuracy, and combining these with VBM by direct multiplication introduces errors in VBM maps where the registration is inaccurate. We propose a unified approach to combining these 2 morphometry methods that is motivated by these differing requirements for registration and our interest in harnessing the advantages of both. Our novel method uses local estimates of registration confidence to determine how to weight the influence of VBM- and TBM-like approaches. Results are shown on healthy and mild Alzheimer's subjects (N = 150) investigating age and group differences, and potential of differential diagnosis is shown on a set of Alzheimer's disease (N = 34) and frontotemporal dementia (N = 30) patients compared against controls (N = 14). These show that the group differences detected by our proposed approach are more descriptive than those detected from VBM, Jacobian-modulated VBM, and TBM separately, hence leveraging the advantages of both approaches in a unified framework. Copyright © 2015 Elsevier Inc. All rights reserved.

  2. A Gradient-Based Multistart Algorithm for Multimodal Aerodynamic Shape Optimization Problems Based on Free-Form Deformation

    Science.gov (United States)

    Streuber, Gregg Mitchell

    Environmental and economic factors motivate the pursuit of more fuel-efficient aircraft designs. Aerodynamic shape optimization is a powerful tool in this effort, but is hampered by the presence of multimodality in many design spaces. Gradient-based multistart optimization uses a sampling algorithm and multiple parallel optimizations to reliably apply fast gradient-based optimization to moderately multimodal problems. Ensuring that the sampled geometries remain physically realizable requires manually developing specialized linear constraints for each class of problem. Utilizing free-form deformation geometry control allows these linear constraints to be written in a geometry-independent fashion, greatly easing the process of applying the algorithm to new problems. This algorithm was used to assess the presence of multimodality when optimizing a wing in subsonic and transonic flows, under inviscid and viscous conditions, and a blended wing-body under transonic, viscous conditions. Multimodality was present in every wing case, while the blended wing-body was found to be generally unimodal.

  3. Fast time-of-flight camera based surface registration for radiotherapy patient positioning.

    Science.gov (United States)

    Placht, Simon; Stancanello, Joseph; Schaller, Christian; Balda, Michael; Angelopoulou, Elli

    2012-01-01

    This work introduces a rigid registration framework for patient positioning in radiotherapy, based on real-time surface acquisition by a time-of-flight (ToF) camera. Dynamic properties of the system are also investigated for future gating/tracking strategies. A novel preregistration algorithm, based on translation and rotation-invariant features representing surface structures, was developed. Using these features, corresponding three-dimensional points were computed in order to determine initial registration parameters. These parameters became a robust input to an accelerated version of the iterative closest point (ICP) algorithm for the fine-tuning of the registration result. Distance calibration and Kalman filtering were used to compensate for ToF-camera dependent noise. Additionally, the advantage of using the feature based preregistration over an "ICP only" strategy was evaluated, as well as the robustness of the rigid-transformation-based method to deformation. The proposed surface registration method was validated using phantom data. A mean target registration error (TRE) for translations and rotations of 1.62 ± 1.08 mm and 0.07° ± 0.05°, respectively, was achieved. There was a temporal delay of about 65 ms in the registration output, which can be seen as negligible considering the dynamics of biological systems. Feature based preregistration allowed for accurate and robust registrations even at very large initial displacements. Deformations affected the accuracy of the results, necessitating particular care in cases of deformed surfaces. The proposed solution is able to solve surface registration problems with an accuracy suitable for radiotherapy cases where external surfaces offer primary or complementary information to patient positioning. The system shows promising dynamic properties for its use in gating/tracking applications. The overall system is competitive with commonly-used surface registration technologies. Its main benefit is the

  4. Single-pulse CARS based multimodal nonlinear optical microscope for bioimaging.

    Science.gov (United States)

    Kumar, Sunil; Kamali, Tschackad; Levitte, Jonathan M; Katz, Ori; Hermann, Boris; Werkmeister, Rene; Považay, Boris; Drexler, Wolfgang; Unterhuber, Angelika; Silberberg, Yaron

    2015-05-18

    Noninvasive label-free imaging of biological systems raises demand not only for high-speed three-dimensional prescreening of morphology over a wide-field of view but also it seeks to extract the microscopic functional and molecular details within. Capitalizing on the unique advantages brought out by different nonlinear optical effects, a multimodal nonlinear optical microscope can be a powerful tool for bioimaging. Bringing together the intensity-dependent contrast mechanisms via second harmonic generation, third harmonic generation and four-wave mixing for structural-sensitive imaging, and single-beam/single-pulse coherent anti-Stokes Raman scattering technique for chemical sensitive imaging in the finger-print region, we have developed a simple and nearly alignment-free multimodal nonlinear optical microscope that is based on a single wide-band Ti:Sapphire femtosecond pulse laser source. Successful imaging tests have been realized on two exemplary biological samples, a canine femur bone and collagen fibrils harvested from a rat tail. Since the ultra-broad band-width femtosecond laser is a suitable source for performing high-resolution optical coherence tomography, a wide-field optical coherence tomography arm can be easily incorporated into the presented multimodal microscope making it a versatile optical imaging tool for noninvasive label-free bioimaging.

  5. Algorithm of sub-pixel image registration based on Harris corner and SIFT descriptor

    Science.gov (United States)

    Zhu, Jianguo; Fan, Guihua

    2014-09-01

    Since multi-cameras images involve much differences in spatial characteristics and spectral characteristics, so it is full of difficulties in the image registration. According to the different characteristics of the multi-cameras images, this paper proposed a new algorithm of sub-pixel image registration based on Harris corner and Scale Invariant Features Transform (SIFT) descriptor. The algorithm consists of three procedures: feature detection, pixel-level registration and sub-pixel-level registration. Firstly, the Harris algorithm was selected to extract the feature corners and determine the main direction of the Harris corners. Secondly, the SIFT descriptor was chose to describe the key points. Then, feature points acquired on matching by the two-way nearest neighbor algorithm. Finally, in the sub-pixel-level registration process, we carry out interpolation in the neighborhood of the pixel-level matching points. Then the pixel-level registration is taken once again. The experimental results show that, the proposed algorithm is accurate, efficient, and retains the rotational invariance of the SIFT descriptor. What's more, processing speed is significantly increased.

  6. Comparing registration methods for mapping brain change using tensor-based morphometry.

    Science.gov (United States)

    Yanovsky, Igor; Leow, Alex D; Lee, Suh; Osher, Stanley J; Thompson, Paul M

    2009-10-01

    Measures of brain changes can be computed from sequential MRI scans, providing valuable information on disease progression for neuroscientific studies and clinical trials. Tensor-based morphometry (TBM) creates maps of these brain changes, visualizing the 3D profile and rates of tissue growth or atrophy. In this paper, we examine the power of different nonrigid registration models to detect changes in TBM, and their stability when no real changes are present. Specifically, we investigate an asymmetric version of a recently proposed Unbiased registration method, using mutual information as the matching criterion. We compare matching functionals (sum of squared differences and mutual information), as well as large-deformation registration schemes (viscous fluid and inverse-consistent linear elastic registration methods versus Symmetric and Asymmetric Unbiased registration) for detecting changes in serial MRI scans of 10 elderly normal subjects and 10 patients with Alzheimer's Disease scanned at 2-week and 1-year intervals. We also analyzed registration results when matching images corrupted with artificial noise. We demonstrated that the unbiased methods, both symmetric and asymmetric, have higher reproducibility. The unbiased methods were also less likely to detect changes in the absence of any real physiological change. Moreover, they measured biological deformations more accurately by penalizing bias in the corresponding statistical maps.

  7. Image registration under illumination variations using region-based confidence weighted M-estimators.

    Science.gov (United States)

    Fouad, Mohamed M; Dansereau, Richard M; Whitehead, Anthony D

    2012-03-01

    We present an image registration model for image sets with arbitrarily shaped local illumination variations between images. Any nongeometric variations tend to degrade the geometric registration precision and impact subsequent processing. Traditional image registration approaches do not typically account for changes and movement of light sources, which result in interimage illumination differences with arbitrary shape. In addition, these approaches typically use a least-square estimator that is sensitive to outliers, where interimage illumination variations are often large enough to act as outliers. In this paper, we propose an image registration approach that compensates for arbitrarily shaped interimage illumination variations, which are processed using robust M -estimators tuned to that region. Each M-estimator for each illumination region has a distinct cost function by which small and large interimage residuals are unevenly penalized. Since the segmentation of the interimage illumination variations may not be perfect, a segmentation confidence weighting is also imposed to reduce the negative effect of mis-segmentation around illumination region boundaries. The proposed approach is cast in an iterative coarse-to-fine framework, which allows a convergence rate similar to competing intensity-based image registration approaches. The overall proposed approach is presented in a general framework, but experimental results use the bisquare M-estimator with region segmentation confidence weighting. A nearly tenfold improvement in subpixel registration precision is seen with the proposed technique when convergence is attained, as compared with competing techniques using both simulated and real data sets with interimage illumination variations.

  8. Iterative multi-atlas-based multi-image segmentation with tree-based registration.

    Science.gov (United States)

    Jia, Hongjun; Yap, Pew-Thian; Shen, Dinggang

    2012-01-02

    In this paper, we present a multi-atlas-based framework for accurate, consistent and simultaneous segmentation of a group of target images. Multi-atlas-based segmentation algorithms consider concurrently complementary information from multiple atlases to produce optimal segmentation outcomes. However, the accuracy of these algorithms relies heavily on the precise alignment of the atlases with the target image. In particular, the commonly used pairwise registration may result in inaccurate alignment especially between images with large shape differences. Additionally, when segmenting a group of target images, most current methods consider these images independently with disregard of their correlation, thus resulting in inconsistent segmentations of the same structures across different target images. We propose two novel strategies to address these limitations: 1) a novel tree-based groupwise registration method for concurrent alignment of both the atlases and the target images, and 2) an iterative groupwise segmentation method for simultaneous consideration of segmentation information propagated from all available images, including the atlases and other newly segmented target images. Evaluation based on various datasets indicates that the proposed multi-atlas-based multi-image segmentation (MABMIS) framework yields substantial improvements in terms of consistency and accuracy over methods that do not consider the group of target images holistically. Copyright © 2011 Elsevier Inc. All rights reserved.

  9. Quality-based Multimodal Classification Using Tree-Structured Sparsity

    Science.gov (United States)

    2014-03-08

    ASI Series F, Computer and Systems Sciences, 163:446–456, 1999. 5 [7] D. Hall and J. Llinas. An introduction to multisensor data fusion . Proceedings of...advantages of in- formation fusion based on sparsity models for multi- modal classification. Among several sparsity models, tree- structured sparsity provides...rithm is proposed to solve the optimization problem, which is an efficient tool for feature-level fusion among either ho- mogeneous or heterogeneous

  10. Geometry-based vs. intensity-based medical image registration: A comparative study on 3D CT data.

    Science.gov (United States)

    Savva, Antonis D; Economopoulos, Theodore L; Matsopoulos, George K

    2016-02-01

    Spatial alignment of Computed Tomography (CT) data sets is often required in numerous medical applications and it is usually achieved by applying conventional exhaustive registration techniques, which are mainly based on the intensity of the subject data sets. Those techniques consider the full range of data points composing the data, thus negatively affecting the required processing time. Alternatively, alignment can be performed using the correspondence of extracted data points from both sets. Moreover, various geometrical characteristics of those data points can be used, instead of their chromatic properties, for uniquely characterizing each point, by forming a specific geometrical descriptor. This paper presents a comparative study reviewing variations of geometry-based, descriptor-oriented registration techniques, as well as conventional, exhaustive, intensity-based methods for aligning three-dimensional (3D) CT data pairs. In this context, three general image registration frameworks were examined: a geometry-based methodology featuring three distinct geometrical descriptors, an intensity-based methodology using three different similarity metrics, as well as the commonly used Iterative Closest Point algorithm. All techniques were applied on a total of thirty 3D CT data pairs with both known and unknown initial spatial differences. After an extensive qualitative and quantitative assessment, it was concluded that the proposed geometry-based registration framework performed similarly to the examined exhaustive registration techniques. In addition, geometry-based methods dramatically improved processing time over conventional exhaustive registration. Copyright © 2015 Elsevier Ltd. All rights reserved.

  11. The Pose Estimation of Mobile Robot Based on Improved Point Cloud Registration

    Directory of Open Access Journals (Sweden)

    Yanzi Miao

    2016-03-01

    Full Text Available Due to GPS restrictions, an inertial sensor is usually used to estimate the location of indoor mobile robots. However, it is difficult to achieve high-accuracy localization and control by inertial sensors alone. In this paper, a new method is proposed to estimate an indoor mobile robot pose with six degrees of freedom based on an improved 3D-Normal Distributions Transform algorithm (3D-NDT. First, point cloud data are captured by a Kinect sensor and segmented according to the distance to the robot. After the segmentation, the input point cloud data are processed by the Approximate Voxel Grid Filter algorithm in different sized voxel grids. Second, the initial registration and precise registration are performed respectively according to the distance to the sensor. The most distant point cloud data use the 3D-Normal Distributions Transform algorithm (3D-NDT with large-sized voxel grids for initial registration, based on the transformation matrix from the odometry method. The closest point cloud data use the 3D-NDT algorithm with small-sized voxel grids for precise registration. After the registrations above, a final transformation matrix is obtained and coordinated. Based on this transformation matrix, the pose estimation problem of the indoor mobile robot is solved. Test results show that this method can obtain accurate robot pose estimation and has better robustness.

  12. Rapid block matching based nonlinear registration on GPU for image guided radiation therapy

    Science.gov (United States)

    Wang, An; Disher, Brandon; Carnes, Greg; Peters, Terry M.

    2010-02-01

    To compensate for non-uniform deformation due to patient motion within and between fractions in image guided radiation therapy, a block matching technique was adapted and implemented on a standard graphics processing unit (GPU) to determine the displacement vector field that maps the nonlinear transformation between successive CT images. Normalized cross correlation (NCC) was chosen as the similarity metric for the matching step, with regularization of the displacement vector field being performed by Gaussian smoothing. A multi-resolution framework was adopted to further improve the performance of the algorithm. The nonlinear registration algorithm was first applied to estimate the intrafractional motion from 4D lung CT images. It was also used to calculate the inter-fractional organ deformation between planning CT (PCT) and Daily Cone Beam CT (CBCT) images of thorax. For both experiments, manual landmark-based evaluation was performed to quantify the registration performance. In 4D CT registration, the mean TRE of 5 cases was 1.75 mm. In PCT-CBCT registration, the TRE of one case was 2.26mm. Compared to the CPU-based AtamaiWarp program, our GPU-based implementation achieves comparable registration accuracy and is ~25 times faster. The results highlight the potential utility of our algorithm for online adaptive radiation treatment.

  13. A dental implant-based registration method for measuring mandibular kinematics using cone beam computed tomography-based fluoroscopy.

    Science.gov (United States)

    Lin, Cheng-Chung; Chen, Chien-Chih; Chen, Yunn-Jy; Lu, Tung-Wu; Hong, Shih-Wun

    2014-01-01

    This study aimed to develop and evaluate experimentally an implant-based registration method for measuring three-dimensional (3D) kinematics of the mandible and dental implants in the mandible based on dental cone beam computed tomography (CBCT), modified to include fluoroscopic function. The proposed implant-based registration method was based on the registration of CBCT data of implants/bones with single-plane fluoroscopy images. Seven registration conditions that included one to three implants were evaluated experimentally for their performance in a cadaveric porcine headmodel. The implant-based registration method was shown to have measurement errors (SD) of less than -0.2 (0.3) mm, 1.1 (2.2) mm, and 0.7 degrees (1.3 degrees) for the in-plane translation, out-of-plane translation, and all angular components, respectively, regardless of the number of implants used. The corresponding errors were reduced to less than -0.1 (0.1) mm, -0.3 (1.7) mm, and 0.5 degree (0.4 degree) when three implants were used. An implant-based registration method was developed to measure the 3D kinematics of the mandible/implants. With its high accuracy and reliability, the new method will be useful for measuring the 3D motion of the bones/implants for relevant applications.

  14. Multimodality Imaging with Silica-Based Targeted Nanoparticle Platforms

    International Nuclear Information System (INIS)

    Lewis, Jason S.

    2012-01-01

    Objectives: To synthesize and characterize a C-Dot silica-based nanoparticle containing 'clickable' groups for the subsequent attachment of targeting moieties (e.g., peptides) and multiple contrast agents (e.g., radionuclides with high specific activity) (1,2). These new constructs will be tested in suitable tumor models in vitro and in vivo to ensure maintenance of target-specificity and high specific activity. Methods: Cy5 dye molecules are cross-linked to a silica precursor which is reacted to form a dye-rich core particle. This core is then encapsulated in a layer of pure silica to create the core-shell C-Dot (Figure 1) (2). A 'click' chemistry approach has been used to functionalize the silica shell with radionuclides conferring high contrast and specific activity (e.g. 64Cu and 89Zr) and peptides for tumor targeting (e.g. cRGD and octreotate) (3). Based on the selective Diels-Alder reaction between tetrazine and norbornene, the reaction is bioorthogonal, highyielding, rapid, and water-compatible. This radiolabeling approach has already been employed successfully with both short peptides (e.g. octreotate) and antibodies (e.g. trastuzumab) as model systems for the ultimate labeling of the nanoparticles (1). Results: PEGylated C-Dots with a Cy5 core and labeled with tetrazine have been synthesized (d = 55 nm, zeta potential = -3 mV) reliably and reproducibly and have been shown to be stable under physiological conditions for up to 1 month. Characterization of the nanoparticles revealed that the immobilized Cy5 dye within the C-Dots exhibited fluorescence intensities over twice that of the fluorophore alone. The nanoparticles were successfully radiolabeled with Cu-64. Efforts toward the conjugation of targeting peptides (e.g. cRGD) are underway. In vitro stability, specificity, and uptake studies as well as in vivo imaging and biodistribution investigations will be presented. Conclusions: C-Dot silica-based nanoparticles offer a robust, versatile, and multi

  15. Multimodality Imaging with Silica-Based Targeted Nanoparticle Platforms

    Energy Technology Data Exchange (ETDEWEB)

    Jason S. Lewis

    2012-04-09

    Objectives: To synthesize and characterize a C-Dot silica-based nanoparticle containing 'clickable' groups for the subsequent attachment of targeting moieties (e.g., peptides) and multiple contrast agents (e.g., radionuclides with high specific activity) [1,2]. These new constructs will be tested in suitable tumor models in vitro and in vivo to ensure maintenance of target-specificity and high specific activity. Methods: Cy5 dye molecules are cross-linked to a silica precursor which is reacted to form a dye-rich core particle. This core is then encapsulated in a layer of pure silica to create the core-shell C-Dot (Figure 1) [2]. A 'click' chemistry approach has been used to functionalize the silica shell with radionuclides conferring high contrast and specific activity (e.g. 64Cu and 89Zr) and peptides for tumor targeting (e.g. cRGD and octreotate) [3]. Based on the selective Diels-Alder reaction between tetrazine and norbornene, the reaction is bioorthogonal, highyielding, rapid, and water-compatible. This radiolabeling approach has already been employed successfully with both short peptides (e.g. octreotate) and antibodies (e.g. trastuzumab) as model systems for the ultimate labeling of the nanoparticles [1]. Results: PEGylated C-Dots with a Cy5 core and labeled with tetrazine have been synthesized (d = 55 nm, zeta potential = -3 mV) reliably and reproducibly and have been shown to be stable under physiological conditions for up to 1 month. Characterization of the nanoparticles revealed that the immobilized Cy5 dye within the C-Dots exhibited fluorescence intensities over twice that of the fluorophore alone. The nanoparticles were successfully radiolabeled with Cu-64. Efforts toward the conjugation of targeting peptides (e.g. cRGD) are underway. In vitro stability, specificity, and uptake studies as well as in vivo imaging and biodistribution investigations will be presented. Conclusions: C-Dot silica-based nanoparticles offer a robust

  16. Adaptive multimodal vibration suppression using fuzzy-based control with limited structural data

    International Nuclear Information System (INIS)

    Makihara, Kanjuro; Kuroishi, Chikako; Fukunaga, Hisao

    2013-01-01

    We propose a novel fuzzy-based method of adaptive multimodal vibration suppression with limited structural data. The adaptive control consists of fuzzy inference and a semi-active switching approach. We demonstrate it to be applicable to multimodal vibration suppression for vibrating structures, where a single piezoelectric actuator suppresses two modal vibrations simultaneously. Our fuzzy-based semi-active control requires only the structural information of natural frequencies for real-time adaptive feedback, whereas common adaptive controls require highly precise structural models or complete equations of motion. We conduct experiments in semi-active vibration suppression using the proposed fuzzy-based control, and compare the suppression performance of our fuzzy-based approach with conventional controls. The experiments indicate that the proposed fuzzy-based control demonstrates good adaptability when experiencing sudden changes in disturbance excitation, and also demonstrates high suppression performance. The fuzzy-based control can adapt to a wide range of disturbance conditions, both within and outside the range of vibration excitations assumed when the controller is designed. (paper)

  17. Multimodal Microchannel and Nanowell-Based Microfluidic Platforms for Bioimaging

    Energy Technology Data Exchange (ETDEWEB)

    Geng, Tao; Smallwood, Chuck R.; Zhu, Ying; Bredeweg, Erin L.; Baker, Scott E.; Evans, James E.; Kelly, Ryan T.

    2017-03-30

    Modern live-cell imaging approaches permit real-time visualization of biological processes. However, limitations for unicellular organism trapping, culturing and long-term imaging can preclude complete understanding of how such microorganisms respond to perturbations in their local environment or linking single-cell variability to whole population dynamics. We have developed microfluidic platforms to overcome prior technical bottlenecks to allow both chemostat and compartmentalized cellular growth conditions using the same device. Additionally, a nanowell-based platform enables a high throughput approach to scale up compartmentalized imaging optimized within the microfluidic device. These channel and nanowell platforms are complementary, and both provide fine control over the local environment as well as the ability to add/replace media components at any experimental time point.

  18. Assessing Digital Student Productions, a Design-Based Research Study on the Development of a Criteria-Based Assessment Tool for Students’ Digital Multimodal Productions

    DEFF Research Database (Denmark)

    Hoffmeyer, Mikkeline; Jensen, Jesper Juellund; Olsen, Marie Veisegaard

    2017-01-01

    productions is often vague or lacking. Therefore, the research project aims at developing a tool to support assessment of student’s digital multimodal productions through a design-based research method. This paper presents a proposal for issues to be considered through a prototyping phase, based on interviews......Digital multimodal production is becoming increasingly important as a 21st century skill and as a learning condition in school (K-12). Moreover, there is a growing attention to the significance of criteria-based assessment for learning. Nevertheless, assessment of students’ digital multimodal...

  19. Analysis of Point Based Image Registration Errors With Applications in Single Molecule Microscopy.

    Science.gov (United States)

    Cohen, E A K; Ober, R J

    2013-12-15

    We present an asymptotic treatment of errors involved in point-based image registration where control point (CP) localization is subject to heteroscedastic noise; a suitable model for image registration in fluorescence microscopy. Assuming an affine transform, CPs are used to solve a multivariate regression problem. With measurement errors existing for both sets of CPs this is an errors-in-variable problem and linear least squares is inappropriate; the correct method being generalized least squares. To allow for point dependent errors the equivalence of a generalized maximum likelihood and heteroscedastic generalized least squares model is achieved allowing previously published asymptotic results to be extended to image registration. For a particularly useful model of heteroscedastic noise where covariance matrices are scalar multiples of a known matrix (including the case where covariance matrices are multiples of the identity) we provide closed form solutions to estimators and derive their distribution. We consider the target registration error (TRE) and define a new measure called the localization registration error (LRE) believed to be useful, especially in microscopy registration experiments. Assuming Gaussianity of the CP localization errors, it is shown that the asymptotic distribution for the TRE and LRE are themselves Gaussian and the parameterized distributions are derived. Results are successfully applied to registration in single molecule microscopy to derive the key dependence of the TRE and LRE variance on the number of CPs and their associated photon counts. Simulations show asymptotic results are robust for low CP numbers and non-Gaussianity. The method presented here is shown to outperform GLS on real imaging data.

  20. Deep assessment: an exploratory study of game-based, multimodal learning in Epidemic

    Directory of Open Access Journals (Sweden)

    Jennifer Jenson

    2016-03-01

    Full Text Available n this study, we examine what and how intermediate age students learned from playing in a health-focused game-based digital learning environment, Epidemic. Epidemic is a playful interactive environment designed to deliver factual knowledge, invite critical understanding, and encourage effective self-care practices in dealing with viral contagious diseases, using a social networking interface to integrate both serious games and game-like multimodal design projects. Epidemic invites a playful approach to its deadly serious core concern – communicable disease – in order to see what happens when students are encouraged to critically approach information from multiple or contradictory perspectives. To identify what participants learned while interacting within Epidemic, we deployed two instructional and assessment models, noting the differences each instructional approach could potentially make, and what approach to assessment might help us evaluate game-based learning. We found that each approach provided importantly different perspectives on what and how students learned, and on the very meaning of student success. Recognizing that traditional assessment tools based in print-cultural literacy may prove increasingly ill-suited for assessing emergent multimodal literacies in game-based learning environments, this study seeks to contribute to a growing body of work on the development of novel assessments for learning.

  1. Tensor-based morphometry with stationary velocity field diffeomorphic registration: application to ADNI.

    Science.gov (United States)

    Bossa, Matias; Zacur, Ernesto; Olmos, Salvador

    2010-07-01

    Tensor-based morphometry (TBM) is an analysis technique where anatomical information is characterized by means of the spatial transformations mapping a customized template with the observed images. Therefore, accurate inter-subject non-rigid registration is an essential prerequisite for both template estimation and image warping. Subsequent statistical analysis on the spatial transformations is performed to highlight voxel-wise differences. Most of previous TBM studies did not explore the influence of the registration parameters, such as the parameters defining the deformation and the regularization models. In this work performance evaluation of TBM using stationary velocity field (SVF) diffeomorphic registration was performed in a subset of subjects from Alzheimer's Disease Neuroimaging Initiative (ADNI) study. A wide range of values of the registration parameters that define the transformation smoothness and the balance between image matching and regularization were explored in the evaluation. The proposed methodology provided brain atrophy maps with very detailed anatomical resolution and with a high significance level compared with results recently published on the same data set using a non-linear elastic registration method. Copyright (c) 2010 Elsevier Inc. All rights reserved.

  2. Registration of vehicle based panoramic image and LiDAR point cloud

    Science.gov (United States)

    Chen, Changjun; Cao, Liang; Xie, Hong; Zhuo, Xiangyu

    2013-10-01

    Higher quality surface information would be got when data from optical images and LiDAR were integrated, owing to the fact that optical images and LiDAR point cloud have unique characteristics that make them preferable in many applications. While most previous works focus on registration of pinhole perspective cameras to 2D or 3D LiDAR data. In this paper, a method for the registration of vehicle based panoramic image and LiDAR point cloud is proposed. Using the translation among panoramic image, single CCD image, laser scanner and Position and Orientation System (POS) along with the GPS/IMU data, precise co-registration between the panoramic image and the LiDAR point cloud in the world system is achieved. Results are presented under a real world data set collected by a new developed Mobile Mapping System (MMS) integrated with a high resolution panoramic camera, two laser scanners and a POS.

  3. Multimodal Biometric System Based on the Recognition of Face and Both Irises

    Directory of Open Access Journals (Sweden)

    Yeong Gon Kim

    2012-09-01

    Full Text Available The performance of unimodal biometric systems (based on a single modality such as face or fingerprint has to contend with various problems, such as illumination variation, skin condition and environmental conditions, and device variations. Therefore, multimodal biometric systems have been used to overcome the limitations of unimodal biometrics and provide high accuracy recognition. In this paper, we propose a new multimodal biometric system based on score level fusion of face and both irises' recognition. Our study has the following novel features. First, the device proposed acquires images of the face and both irises simultaneously. The proposed device consists of a face camera, two iris cameras, near-infrared illuminators and cold mirrors. Second, fast and accurate iris detection is based on two circular edge detections, which are accomplished in the iris image on the basis of the size of the iris detected in the face image. Third, the combined accuracy is enhanced by combining each score for the face and both irises using a support vector machine. The experimental results show that the equal error rate for the proposed method is 0.131%, which is lower than that of face or iris recognition and other fusion methods.

  4. Accelerated gradient-based free form deformable registration for online adaptive radiotherapy

    International Nuclear Information System (INIS)

    Yu, Gang; Yang, Guanyu; Shu, Huazhong; Li, Baosheng; Liang, Yueqiang; Yin, Yong; Li, Dengwang

    2015-01-01

    The registration of planning fan-beam computed tomography (FBCT) and daily cone-beam CT (CBCT) is a crucial step in adaptive radiation therapy. The current intensity-based registration algorithms, such as Demons, may fail when they are used to register FBCT and CBCT, because the CT numbers in CBCT cannot exactly correspond to the electron densities. In this paper, we investigated the effects of CBCT intensity inaccuracy on the registration accuracy and developed an accurate gradient-based free form deformation algorithm (GFFD). GFFD distinguishes itself from other free form deformable registration algorithms by (a) measuring the similarity using the 3D gradient vector fields to avoid the effect of inconsistent intensities between the two modalities; (b) accommodating image sampling anisotropy using the local polynomial approximation-intersection of confidence intervals (LPA-ICI) algorithm to ensure a smooth and continuous displacement field; and (c) introducing a ‘bi-directional’ force along with an adaptive force strength adjustment to accelerate the convergence process. It is expected that such a strategy can decrease the effect of the inconsistent intensities between the two modalities, thus improving the registration accuracy and robustness. Moreover, for clinical application, the algorithm was implemented by graphics processing units (GPU) through OpenCL framework. The registration time of the GFFD algorithm for each set of CT data ranges from 8 to 13 s. The applications of on-line adaptive image-guided radiation therapy, including auto-propagation of contours, aperture-optimization and dose volume histogram (DVH) in the course of radiation therapy were also studied by in-house-developed software. (paper)

  5. 75 FR 79320 - Security-Based Swap Data Repository Registration, Duties, and Core Principles

    Science.gov (United States)

    2010-12-20

    ... SECURITIES AND EXCHANGE COMMISSION 17 CFR Parts 240 and 249 [Release No. 34-63347; File No. S7-35-10] RIN 3235-AK79 Security-Based Swap Data Repository Registration, Duties, and Core Principles Correction In proposed rule document 2010-29719 beginning on page 77306 in the issue of December 10, 2010...

  6. Improving Feature-based Non-rigid Registration for Applications in Radiotherapy

    NARCIS (Netherlands)

    E.M. Vásquez Osorio (Eliana)

    2012-01-01

    textabstractThis thesis describes the improvements of a feature-based non-rigid registration method that were essential for its application in radiotherapy. In addition, this thesis presents three practical applications of the improved method: 1) quantification of anatomical changes in 3D for head

  7. Surface membrane based bladder registration for evaluation of accumulated dose during brachytherapy in cervical cancer

    DEFF Research Database (Denmark)

    Noe, Karsten Østergaard; Tanderup, Kari; Sørensen, Thomas Sangild

    2011-01-01

    of the fixed surface. Optional landmark based matches can be included in the suggested iterative solver. The technique is demonstrated for bladder registration in brachytherapy treatment evaluation of cervical cancer. It holds promise to better estimate the accumulated but unintentional dose delivered...

  8. Registration-based Reconstruction of Four-dimensional Cone Beam Computed Tomography

    DEFF Research Database (Denmark)

    Christoffersen, Christian; Hansen, David Christoffer; Poulsen, Per Rugaard

    2013-01-01

    We present a new method for reconstruction of four-dimensional (4D) cone beam computed tomography from an undersampled set of X-ray projections. The novelty of the proposed method lies in utilizing optical flow based registration to facilitate that each temporal phase is reconstructed from the full...

  9. Highly Sensitive Liquid Core Temperature Sensor Based on Multimode Interference Effects

    Directory of Open Access Journals (Sweden)

    Miguel A. Fuentes-Fuentes

    2015-10-01

    Full Text Available A novel fiber optic temperature sensor based on a liquid-core multimode interference device is demonstrated. The advantage of such structure is that the thermo-optic coefficient (TOC of the liquid is at least one order of magnitude larger than that of silica and this, combined with the fact that the TOC of silica and the liquid have opposite signs, provides a liquid-core multimode fiber (MMF highly sensitive to temperature. Since the refractive index of the liquid can be easily modified, this allows us to control the modal properties of the liquid-core MMF at will and the sensor sensitivity can be easily tuned by selecting the refractive index of the liquid in the core of the device. The maximum sensitivity measured in our experiments is 20 nm/°C in the low-temperature regime up to 60 °C. To the best of our knowledge, to date, this is the largest sensitivity reported for fiber-based MMI temperature sensors.

  10. Genetic algorithms-based inversion of multimode guided waves for cortical bone characterization

    Science.gov (United States)

    Bochud, N.; Vallet, Q.; Bala, Y.; Follet, H.; Minonzio, J.-G.; Laugier, P.

    2016-10-01

    Recent progress in quantitative ultrasound has exploited the multimode waveguide response of long bones. Measurements of the guided modes, along with suitable waveguide modeling, have the potential to infer strength-related factors such as stiffness (mainly determined by cortical porosity) and cortical thickness. However, the development of such model-based approaches is challenging, in particular because of the multiparametric nature of the inverse problem. Current estimation methods in the bone field rely on a number of assumptions for pairing the incomplete experimental data with the theoretical guided modes (e.g. semi-automatic selection and classification of the data). The availability of an alternative inversion scheme that is user-independent is highly desirable. Thus, this paper introduces an efficient inversion method based on genetic algorithms using multimode guided waves, in which the mode-order is kept blind. Prior to its evaluation on bone, our proposal is validated using laboratory-controlled measurements on isotropic plates and bone-mimicking phantoms. The results show that the model parameters (i.e. cortical thickness and porosity) estimated from measurements on a few ex vivo human radii are in good agreement with the reference values derived from x-ray micro-computed tomography. Further, the cortical thickness estimated from in vivo measurements at the third from the distal end of the radius is in good agreement with the values delivered by site-matched high-resolution x-ray peripheral computed tomography.

  11. Biomechanical-based image registration for head and neck radiation treatment

    Science.gov (United States)

    Al-Mayah, Adil; Moseley, Joanne; Hunter, Shannon; Velec, Mike; Chau, Lily; Breen, Stephen; Brock, Kristy

    2010-11-01

    Deformable image registration of four head and neck cancer patients has been conducted using a biomechanical-based model. Patient-specific 3D finite element models have been developed using CT and cone-beam CT image data of the planning and a radiation treatment session. The model consists of seven vertebrae (C1 to C7), mandible, larynx, left and right parotid glands, tumor and body. Different combinations of boundary conditions are applied in the model in order to find the configuration with a minimum registration error. Each vertebra in the planning session is individually aligned with its correspondence in the treatment session. Rigid alignment is used for each individual vertebra and the mandible since no deformation is expected in the bones. In addition, the effect of morphological differences in the external body between the two image sessions is investigated. The accuracy of the registration is evaluated using the tumor and both parotid glands by comparing the calculated Dice similarity index of these structures following deformation in relation to their true surface defined in the image of the second session. The registration is improved when the vertebrae and mandible are aligned in the two sessions with the highest average Dice index of 0.86 ± 0.08, 0.84 ± 0.11 and 0.89 ± 0.04 for the tumor, left and right parotid glands, respectively. The accuracy of the center of mass location of tumor and parotid glands is also improved by deformable image registration where the errors in the tumor and parotid glands decrease from 4.0 ± 1.1, 3.4 ± 1.5 and 3.8 ± 0.9 mm using rigid registration to 2.3 ± 1.0, 2.5 ± 0.8 and 2.0 ± 0.9 mm in the deformable image registration when alignment of vertebrae and mandible is conducted in addition to the surface projection of the body. This work was presented at the SPIE conference, California, 2010: Al-Mayah A, Moseley J, Chau L, Breen S, and Brock K 2010 Biomechanical based deformable image registration of head and neck

  12. Feature-based three-dimensional registration for repetitive geometry in machine vision.

    Science.gov (United States)

    Gong, Yuanzheng; Seibel, Eric J

    2016-08-01

    As an important step in three-dimensional (3D) machine vision, 3D registration is a process of aligning two or multiple 3D point clouds that are collected from different perspectives together into a complete one. The most popular approach to register point clouds is to minimize the difference between these point clouds iteratively by Iterative Closest Point (ICP) algorithm. However, ICP does not work well for repetitive geometries. To solve this problem, a feature-based 3D registration algorithm is proposed to align the point clouds that are generated by vision-based 3D reconstruction. By utilizing texture information of the object and the robustness of image features, 3D correspondences can be retrieved so that the 3D registration of two point clouds is to solve a rigid transformation. The comparison of our method and different ICP algorithms demonstrates that our proposed algorithm is more accurate, efficient and robust for repetitive geometry registration. Moreover, this method can also be used to solve high depth uncertainty problem caused by little camera baseline in vision-based 3D reconstruction.

  13. Performance Evaluation and Optimal Management of Distance-Based Registration Using a Semi-Markov Process

    Directory of Open Access Journals (Sweden)

    Jae Joon Suh

    2017-01-01

    Full Text Available We consider the distance-based registration (DBR which is a kind of dynamic location registration scheme in a mobile communication network. In the DBR, the location of a mobile station (MS is updated when it enters a base station more than or equal to a specified distance away from the base station where the location registration for the MS was done last. In this study, we first investigate the existing performance-evaluation methods on the DBR with implicit registration (DBIR presented to improve the performance of the DBR and point out some problems of the evaluation methods. We propose a new performance-evaluation method for the DBIR scheme using a semi-Markov process (SMP which can resolve the controversial issues of the existing methods. The numerical results obtained with the proposed SMP model are compared with those from previous models. It is shown that the SMP model should be considered to get an accurate performance of the DBIR scheme.

  14. Line-Based Registration of Panoramic Images and LiDAR Point Clouds for Mobile Mapping

    Directory of Open Access Journals (Sweden)

    Tingting Cui

    2016-12-01

    Full Text Available For multi-sensor integrated systems, such as the mobile mapping system (MMS, data fusion at sensor-level, i.e., the 2D-3D registration between an optical camera and LiDAR, is a prerequisite for higher level fusion and further applications. This paper proposes a line-based registration method for panoramic images and a LiDAR point cloud collected by a MMS. We first introduce the system configuration and specification, including the coordinate systems of the MMS, the 3D LiDAR scanners, and the two panoramic camera models. We then establish the line-based transformation model for the panoramic camera. Finally, the proposed registration method is evaluated for two types of camera models by visual inspection and quantitative comparison. The results demonstrate that the line-based registration method can significantly improve the alignment of the panoramic image and the LiDAR datasets under either the ideal spherical or the rigorous panoramic camera model, with the latter being more reliable.

  15. MSM: a new flexible framework for Multimodal Surface Matching.

    Science.gov (United States)

    Robinson, Emma C; Jbabdi, Saad; Glasser, Matthew F; Andersson, Jesper; Burgess, Gregory C; Harms, Michael P; Smith, Stephen M; Van Essen, David C; Jenkinson, Mark

    2014-10-15

    Surface-based cortical registration methods that are driven by geometrical features, such as folding, provide sub-optimal alignment of many functional areas due to variable correlation between cortical folding patterns and function. This has led to the proposal of new registration methods using features derived from functional and diffusion imaging. However, as yet there is no consensus over the best set of features for optimal alignment of brain function. In this paper we demonstrate the utility of a new Multimodal Surface Matching (MSM) algorithm capable of driving alignment using a wide variety of descriptors of brain architecture, function and connectivity. The versatility of the framework originates from adapting the discrete Markov Random Field (MRF) registration method to surface alignment. This has the benefit of being very flexible in the choice of a similarity measure and relatively insensitive to local minima. The method offers significant flexibility in the choice of feature set, and we demonstrate the advantages of this by performing registrations using univariate descriptors of surface curvature and myelination, multivariate feature sets derived from resting fMRI, and multimodal descriptors of surface curvature and myelination. We compare the results with two state of the art surface registration methods that use geometric features: FreeSurfer and Spherical Demons. In the future, the MSM technique will allow explorations into the best combinations of features and alignment strategies for inter-subject alignment of cortical functional areas for a wide range of neuroimaging data sets. Copyright © 2014 Elsevier Inc. All rights reserved.

  16. Global image registration using a symmetric block-matching approach.

    Science.gov (United States)

    Modat, Marc; Cash, David M; Daga, Pankaj; Winston, Gavin P; Duncan, John S; Ourselin, Sébastien

    2014-07-01

    Most medical image registration algorithms suffer from a directionality bias that has been shown to largely impact subsequent analyses. Several approaches have been proposed in the literature to address this bias in the context of nonlinear registration, but little work has been done for global registration. We propose a symmetric approach based on a block-matching technique and least-trimmed square regression. The proposed method is suitable for multimodal registration and is robust to outliers in the input images. The symmetric framework is compared with the original asymmetric block-matching technique and is shown to outperform it in terms of accuracy and robustness. The methodology presented in this article has been made available to the community as part of the NiftyReg open-source package.

  17. Facial expression recognition in the wild based on multimodal texture features

    Science.gov (United States)

    Sun, Bo; Li, Liandong; Zhou, Guoyan; He, Jun

    2016-11-01

    Facial expression recognition in the wild is a very challenging task. We describe our work in static and continuous facial expression recognition in the wild. We evaluate the recognition results of gray deep features and color deep features, and explore the fusion of multimodal texture features. For the continuous facial expression recognition, we design two temporal-spatial dense scale-invariant feature transform (SIFT) features and combine multimodal features to recognize expression from image sequences. For the static facial expression recognition based on video frames, we extract dense SIFT and some deep convolutional neural network (CNN) features, including our proposed CNN architecture. We train linear support vector machine and partial least squares classifiers for those kinds of features on the static facial expression in the wild (SFEW) and acted facial expression in the wild (AFEW) dataset, and we propose a fusion network to combine all the extracted features at decision level. The final achievement we gained is 56.32% on the SFEW testing set and 50.67% on the AFEW validation set, which are much better than the baseline recognition rates of 35.96% and 36.08%.

  18. A multimodal wave spectrum-based approach for statistical downscaling of local wave climate

    Science.gov (United States)

    Hegermiller, Christie; Antolinez, Jose A A; Rueda, Ana C.; Camus, Paula; Perez, Jorge; Erikson, Li; Barnard, Patrick; Mendez, Fernando J.

    2017-01-01

    Characterization of wave climate by bulk wave parameters is insufficient for many coastal studies, including those focused on assessing coastal hazards and long-term wave climate influences on coastal evolution. This issue is particularly relevant for studies using statistical downscaling of atmospheric fields to local wave conditions, which are often multimodal in large ocean basins (e.g. the Pacific). Swell may be generated in vastly different wave generation regions, yielding complex wave spectra that are inadequately represented by a single set of bulk wave parameters. Furthermore, the relationship between atmospheric systems and local wave conditions is complicated by variations in arrival time of wave groups from different parts of the basin. Here, we address these two challenges by improving upon the spatiotemporal definition of the atmospheric predictor used in statistical downscaling of local wave climate. The improved methodology separates the local wave spectrum into “wave families,” defined by spectral peaks and discrete generation regions, and relates atmospheric conditions in distant regions of the ocean basin to local wave conditions by incorporating travel times computed from effective energy flux across the ocean basin. When applied to locations with multimodal wave spectra, including Southern California and Trujillo, Peru, the new methodology improves the ability of the statistical model to project significant wave height, peak period, and direction for each wave family, retaining more information from the full wave spectrum. This work is the base of statistical downscaling by weather types, which has recently been applied to coastal flooding and morphodynamic applications.

  19. Real-time estimation of FLE for point-based registration

    Science.gov (United States)

    Wiles, Andrew D.; Peters, Terry M.

    2009-02-01

    In image-guide surgery, optimizing the accuracy in localizing the surgical tools within the virtual reality environment or 3D image is vitally important, significant effort has been spent reducing the measurement errors at the point of interest or target. This target registration error (TRE) is often defined by a root-mean-square statistic which reduces the vector data to a single term that can be minimized. However, lost in the data reduction is the directionality of the error which, can be modelled using a 3D covariance matrix. Recently, we developed a set of expressions that modeled the TRE statistics for point-based registrations as a function of the fiducial marker geometry, target location and the fiducial localizer error (FLE). Unfortunately, these expressions are only as good as the definition of the FLE. In order to close the gap, we have subsequently developed a closed form expression that estimates the FLE as a function of the estimated fiducial registration error (FRE, the error between the measured fiducials and the best fit locations of those fiducials). The FRE covariance matrix is estimated using a sliding window technique and used as input into the closed form expression to estimate the FLE. The estimated FLE can then used to estimate the TRE which, can be given to the surgeon to permit the procedure to be designed such that the errors associated with the point-based registrations are minimized.

  20. Sequential Registration-Based Segmentation of the Prostate Gland in MR Image Volumes.

    Science.gov (United States)

    Khalvati, Farzad; Salmanpour, Aryan; Rahnamayan, Shahryar; Haider, Masoom A; Tizhoosh, H R

    2016-04-01

    Accurate and fast segmentation and volume estimation of the prostate gland in magnetic resonance (MR) images are necessary steps in the diagnosis, treatment, and monitoring of prostate cancer. This paper presents an algorithm for the prostate gland volume estimation based on the semi-automated segmentation of individual slices in T2-weighted MR image sequences. The proposed sequential registration-based segmentation (SRS) algorithm, which was inspired by the clinical workflow during medical image contouring, relies on inter-slice image registration and user interaction/correction to segment the prostate gland without the use of an anatomical atlas. It automatically generates contours for each slice using a registration algorithm, provided that the user edits and approves the marking in some previous slices. We conducted comprehensive experiments to measure the performance of the proposed algorithm using three registration methods (i.e., rigid, affine, and nonrigid). Five radiation oncologists participated in the study where they contoured the prostate MR (T2-weighted) images of 15 patients both manually and using the SRS algorithm. Compared to the manual segmentation, on average, the SRS algorithm reduced the contouring time by 62% (a speedup factor of 2.64×) while maintaining the segmentation accuracy at the same level as the intra-user agreement level (i.e., Dice similarity coefficient of 91 versus 90%). The proposed algorithm exploits the inter-slice similarity of volumetric MR image series to achieve highly accurate results while significantly reducing the contouring time.

  1. An Efficient Multimodal 2D + 3D Feature-based Approach to Automatic Facial Expression Recognition

    KAUST Repository

    Li, Huibin

    2015-07-29

    We present a fully automatic multimodal 2D + 3D feature-based facial expression recognition approach and demonstrate its performance on the BU-3DFE database. Our approach combines multi-order gradient-based local texture and shape descriptors in order to achieve efficiency and robustness. First, a large set of fiducial facial landmarks of 2D face images along with their 3D face scans are localized using a novel algorithm namely incremental Parallel Cascade of Linear Regression (iPar-CLR). Then, a novel Histogram of Second Order Gradients (HSOG) based local image descriptor in conjunction with the widely used first-order gradient based SIFT descriptor are used to describe the local texture around each 2D landmark. Similarly, the local geometry around each 3D landmark is described by two novel local shape descriptors constructed using the first-order and the second-order surface differential geometry quantities, i.e., Histogram of mesh Gradients (meshHOG) and Histogram of mesh Shape index (curvature quantization, meshHOS). Finally, the Support Vector Machine (SVM) based recognition results of all 2D and 3D descriptors are fused at both feature-level and score-level to further improve the accuracy. Comprehensive experimental results demonstrate that there exist impressive complementary characteristics between the 2D and 3D descriptors. We use the BU-3DFE benchmark to compare our approach to the state-of-the-art ones. Our multimodal feature-based approach outperforms the others by achieving an average recognition accuracy of 86.32%. Moreover, a good generalization ability is shown on the Bosphorus database.

  2. Automated diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks

    Science.gov (United States)

    Le, Minh Hung; Chen, Jingyu; Wang, Liang; Wang, Zhiwei; Liu, Wenyu; (Tim Cheng, Kwang-Ting; Yang, Xin

    2017-08-01

    Automated methods for prostate cancer (PCa) diagnosis in multi-parametric magnetic resonance imaging (MP-MRIs) are critical for alleviating requirements for interpretation of radiographs while helping to improve diagnostic accuracy (Artan et al 2010 IEEE Trans. Image Process. 19 2444-55, Litjens et al 2014 IEEE Trans. Med. Imaging 33 1083-92, Liu et al 2013 SPIE Medical Imaging (International Society for Optics and Photonics) p 86701G, Moradi et al 2012 J. Magn. Reson. Imaging 35 1403-13, Niaf et al 2014 IEEE Trans. Image Process. 23 979-91, Niaf et al 2012 Phys. Med. Biol. 57 3833, Peng et al 2013a SPIE Medical Imaging (International Society for Optics and Photonics) p 86701H, Peng et al 2013b Radiology 267 787-96, Wang et al 2014 BioMed. Res. Int. 2014). This paper presents an automated method based on multimodal convolutional neural networks (CNNs) for two PCa diagnostic tasks: (1) distinguishing between cancerous and noncancerous tissues and (2) distinguishing between clinically significant (CS) and indolent PCa. Specifically, our multimodal CNNs effectively fuse apparent diffusion coefficients (ADCs) and T2-weighted MP-MRI images (T2WIs). To effectively fuse ADCs and T2WIs we design a new similarity loss function to enforce consistent features being extracted from both ADCs and T2WIs. The similarity loss is combined with the conventional classification loss functions and integrated into the back-propagation procedure of CNN training. The similarity loss enables better fusion results than existing methods as the feature learning processes of both modalities are mutually guided, jointly facilitating CNN to ‘see’ the true visual patterns of PCa. The classification results of multimodal CNNs are further combined with the results based on handcrafted features using a support vector machine classifier. To achieve a satisfactory accuracy for clinical use, we comprehensively investigate three critical factors which could greatly affect the performance of our

  3. An Image Registration Based Technique for Noninvasive Vascular Elastography

    OpenAIRE

    Valizadeh, Sina; Makkiabadi, Bahador; Mirbagheri, Alireza; Soozande, Mehdi; Manwar, Rayyan; Mozaffarzadeh, Moein; Nasiriavanaki, Mohammadreza

    2018-01-01

    Non-invasive vascular elastography is an emerging technique in vascular tissue imaging. During the past decades, several techniques have been suggested to estimate the tissue elasticity by measuring the displacement of the Carotid vessel wall. Cross correlation-based methods are the most prevalent approaches to measure the strain exerted in the wall vessel by the blood pressure. In the case of a low pressure, the displacement is too small to be apparent in ultrasound imaging, especially in th...

  4. A digital 3D atlas of the marmoset brain based on multi-modal MRI.

    Science.gov (United States)

    Liu, Cirong; Ye, Frank Q; Yen, Cecil Chern-Chyi; Newman, John D; Glen, Daniel; Leopold, David A; Silva, Afonso C

    2018-04-01

    The common marmoset (Callithrix jacchus) is a New-World monkey of growing interest in neuroscience. Magnetic resonance imaging (MRI) is an essential tool to unveil the anatomical and functional organization of the marmoset brain. To facilitate identification of regions of interest, it is desirable to register MR images to an atlas of the brain. However, currently available atlases of the marmoset brain are mainly based on 2D histological data, which are difficult to apply to 3D imaging techniques. Here, we constructed a 3D digital atlas based on high-resolution ex-vivo MRI images, including magnetization transfer ratio (a T1-like contrast), T2w images, and multi-shell diffusion MRI. Based on the multi-modal MRI images, we manually delineated 54 cortical areas and 16 subcortical regions on one hemisphere of the brain (the core version). The 54 cortical areas were merged into 13 larger cortical regions according to their locations to yield a coarse version of the atlas, and also parcellated into 106 sub-regions using a connectivity-based parcellation method to produce a refined atlas. Finally, we compared the new atlas set with existing histology atlases and demonstrated its applications in connectome studies, and in resting state and stimulus-based fMRI. The atlas set has been integrated into the widely-distributed neuroimaging data analysis software AFNI and SUMA, providing a readily usable multi-modal template space with multi-level anatomical labels (including labels from the Paxinos atlas) that can facilitate various neuroimaging studies of marmosets. Published by Elsevier Inc.

  5. MIDA: A Multimodal Imaging-Based Detailed Anatomical Model of the Human Head and Neck.

    Directory of Open Access Journals (Sweden)

    Maria Ida Iacono

    Full Text Available Computational modeling and simulations are increasingly being used to complement experimental testing for analysis of safety and efficacy of medical devices. Multiple voxel- and surface-based whole- and partial-body models have been proposed in the literature, typically with spatial resolution in the range of 1-2 mm and with 10-50 different tissue types resolved. We have developed a multimodal imaging-based detailed anatomical model of the human head and neck, named "MIDA". The model was obtained by integrating three different magnetic resonance imaging (MRI modalities, the parameters of which were tailored to enhance the signals of specific tissues: i structural T1- and T2-weighted MRIs; a specific heavily T2-weighted MRI slab with high nerve contrast optimized to enhance the structures of the ear and eye; ii magnetic resonance angiography (MRA data to image the vasculature, and iii diffusion tensor imaging (DTI to obtain information on anisotropy and fiber orientation. The unique multimodal high-resolution approach allowed resolving 153 structures, including several distinct muscles, bones and skull layers, arteries and veins, nerves, as well as salivary glands. The model offers also a detailed characterization of eyes, ears, and deep brain structures. A special automatic atlas-based segmentation procedure was adopted to include a detailed map of the nuclei of the thalamus and midbrain into the head model. The suitability of the model to simulations involving different numerical methods, discretization approaches, as well as DTI-based tensorial electrical conductivity, was examined in a case-study, in which the electric field was generated by transcranial alternating current stimulation. The voxel- and the surface-based versions of the models are freely available to the scientific community.

  6. Applying Connectivist Principles and the Task-Based Approach to the Design of a Multimodal Didactic Unit

    Directory of Open Access Journals (Sweden)

    Yeraldine Aldana Gutiérrez

    2012-12-01

    Full Text Available This article describes the pedagogical intervention developed in a public school as part of the research “Exploring Communications Practices through Facebook as a Mediatic Device”, framed within the computer mediated communications field. Twelve ninth graders’ communications practices were explored and addressed by means of multimodal technological resources and tasks based on the connectivist learning view. As a result, a didactic unit was designed in the form of the digital book Diverface. This one in turn displayed information through different media channels and semiotic elements to support its multimodal features. Teachers and students might thus need to reconstruct an alternative multimodal literacy so that they can produce and interpret texts of the same nature in online environments.

  7. Relating multimodal imagery data in three dimensions

    Science.gov (United States)

    Walli, Karl C.

    This research develops and improves the fundamental mathematical approaches and techniques required to relate imagery and imagery derived multimodal products in 3D. Image registration, in a 2D sense, will always be limited by the 3D effects of viewing geometry on the target. Therefore, effects such as occlusion, parallax, shadowing, and terrain/building elevation can often be mitigated with even a modest amounts of 3D target modeling. Additionally, the imaged scene may appear radically different based on the sensed modality of interest; this is evident from the differences in visible, infrared, polarimetric, and radar imagery of the same site. This thesis develops a 'model-centric' approach to relating multimodal imagery in a 3D environment. By correctly modeling a site of interest, both geometrically and physically, it is possible to remove/mitigate some of the most difficult challenges associated with multimodal image registration. In order to accomplish this feat, the mathematical framework necessary to relate imagery to geometric models is thoroughly examined. Since geometric models may need to be generated to apply this 'model-centric' approach, this research develops methods to derive 3D models from imagery and LIDAR data. Of critical note, is the implementation of complimentary techniques for relating multimodal imagery that utilize the geometric model in concert with physics based modeling to simulate scene appearance under diverse imaging scenarios. Finally, the often neglected final phase of mapping localized image registration results back to the world coordinate system model for final data archival are addressed. In short, once a target site is properly modeled, both geometrically and physically, it is possible to orient the 3D model to the same viewing perspective as a captured image to enable proper registration. If done accurately, the synthetic model's physical appearance can simulate the imaged modality of interest while simultaneously removing the

  8. Design of polarization-insensitive 2 × 2 multimode interference coupler based on double strip silicon nitride waveguides

    Science.gov (United States)

    Yang, Huimin; Zheng, Pengfei; Liu, Panpan; Hu, Guohua; Yun, Binfeng; Cui, Yiping

    2018-03-01

    A polarization-insensitive 2 × 2 multimode interference coupler based on double strip silicon nitride waveguides is proposed and optimized by using the three-dimensional finite difference time domain method. By optimizing the device's structure parameters in detail, polarization independent excess loss of -0.32dB is obtained, and negligible output uniformities of -0.02dB and -0.03dB could be achieved for the TE and TM mode, respectively. The optimized polarization-insensitive 2 × 2 multimode interference coupler could be served as a building block on the double strip silicon nitride waveguides platform.

  9. Multimode fiber modal decomposition based on hybrid genetic global optimization algorithm

    Science.gov (United States)

    Li, Lei; Leng, Jinyong; Zhou, Pu; Chen, Jinbao

    2017-10-01

    Numerical modal decomposition (MD) is an effective approach to reveal modal characteristics in high power fiber lasers. The main challenge is to find a suitable multi-dimensional optimization algorithm to reveal exact superposition of eigenmodes, especially for multimode fiber. A novel hybrid genetic global optimization algorithm, named GA-SPGD, which combines the advantages of genetic algorithm (GA) and stochastic parallel gradient descent (SPGD) algorithm, is firstly proposed to reduce local minima possibilities from sensitivity initial values. Firstly, GA is applied to search the rough global optimization position based on near-far-field intensity distribution with high accuracy. Upon those initial values, SPGD algorithm is afterwards used to find the exact optimization values based on near-field intensity distribution with fast convergence speed. Numerical simulations validate the feasibility and reliability.

  10. MRF-based deformable registration and ventilation estimation of lung CT.

    Science.gov (United States)

    Heinrich, Mattias P; Jenkinson, Mark; Brady, Michael; Schnabel, Julia A

    2013-07-01

    Deformable image registration is an important tool in medical image analysis. In the case of lung computed tomography (CT) registration there are three major challenges: large motion of small features, sliding motions between organs, and changing image contrast due to compression. Recently, Markov random field (MRF)-based discrete optimization strategies have been proposed to overcome problems involved with continuous optimization for registration, in particular its susceptibility to local minima. However, to date the simplifications made to obtain tractable computational complexity reduced the registration accuracy. We address these challenges and preserve the potentially higher quality of discrete approaches with three novel contributions. First, we use an image-derived minimum spanning tree as a simplified graph structure, which copes well with the complex sliding motion and allows us to find the global optimum very efficiently. Second, a stochastic sampling approach for the similarity cost between images is introduced within a symmetric, diffeomorphic B-spline transformation model with diffusion regularization. The complexity is reduced by orders of magnitude and enables the minimization of much larger label spaces. In addition to the geometric transform labels, hyper-labels are introduced, which represent local intensity variations in this task, and allow for the direct estimation of lung ventilation. We validate the improvements in accuracy and performance on exhale-inhale CT volume pairs using a large number of expert landmarks.

  11. AUTOMATED FEATURE BASED TLS DATA REGISTRATION FOR 3D BUILDING MODELING

    Directory of Open Access Journals (Sweden)

    K. Kitamura

    2012-07-01

    Full Text Available In this paper we present a novel method for the registration of point cloud data obtained using terrestrial laser scanner (TLS. The final goal of our investigation is the automated reconstruction of CAD drawings and the 3D modeling of objects surveyed by TLS. Because objects are scanned from multiple positions, individual point cloud need to be registered to the same coordinate system. We propose in this paper an automated feature based registration procedure. Our proposed method does not require the definition of initial values or the placement of targets and is robust against noise and background elements. A feature extraction procedure is performed for each point cloud as pre-processing. The registration of the point clouds from different viewpoints is then performed by utilizing the extracted features. The feature extraction method which we had developed previously (Kitamura, 2010 is used: planes and edges are extracted from the point cloud. By utilizing these features, the amount of information to process is reduced and the efficiency of the whole registration procedure is increased. In this paper, we describe the proposed algorithm and, in order to demonstrate its effectiveness, we show the results obtained by using real data.

  12. a SAR Image Registration Method Based on Sift Algorithm

    Science.gov (United States)

    Lu, W.; Yue, X.; Zhao, Y.; Han, C.

    2017-09-01

    In order to improve the stability and rapidity of synthetic aperture radar (SAR) images matching, an effective method was presented. Firstly, the adaptive smoothing filtering was employed for image denoising in image processing based on Wallis filtering to avoid the follow-up noise is amplified. Secondly, feature points were extracted by a simplified SIFT algorithm. Finally, the exact matching of the images was achieved with these points. Compared with the existing methods, it not only maintains the richness of features, but a-lso reduces the noise of the image. The simulation results show that the proposed algorithm can achieve better matching effect.

  13. Physics-based elastic image registration using splines and including landmark localization uncertainties.

    Science.gov (United States)

    Wörz, Stefan; Rohr, Karl

    2006-01-01

    We introduce an elastic registration approach which is based on a physical deformation model and uses Gaussian elastic body splines (GEBS). We formulate an extended energy functional related to the Navier equation under Gaussian forces which also includes landmark localization uncertainties. These uncertainties are characterized by weight matrices representing anisotropic errors. Since the approach is based on a physical deformation model, cross-effects in elastic deformations can be taken into account. Moreover, we have a free parameter to control the locality of the transformation for improved registration of local geometric image differences. We demonstrate the applicability of our scheme based on 3D CT images from the Truth Cube experiment, 2D MR images of the brain, as well as 2D gel electrophoresis images. It turns out that the new scheme achieves more accurate results compared to previous approaches.

  14. 2.5D Multi-View Gait Recognition Based on Point Cloud Registration

    Science.gov (United States)

    Tang, Jin; Luo, Jian; Tjahjadi, Tardi; Gao, Yan

    2014-01-01

    This paper presents a method for modeling a 2.5-dimensional (2.5D) human body and extracting the gait features for identifying the human subject. To achieve view-invariant gait recognition, a multi-view synthesizing method based on point cloud registration (MVSM) to generate multi-view training galleries is proposed. The concept of a density and curvature-based Color Gait Curvature Image is introduced to map 2.5D data onto a 2D space to enable data dimension reduction by discrete cosine transform and 2D principle component analysis. Gait recognition is achieved via a 2.5D view-invariant gait recognition method based on point cloud registration. Experimental results on the in-house database captured by a Microsoft Kinect camera show a significant performance gain when using MVSM. PMID:24686727

  15. MO-F-BRA-04: Voxel-Based Statistical Analysis of Deformable Image Registration Error via a Finite Element Method.

    Science.gov (United States)

    Li, S; Lu, M; Kim, J; Glide-Hurst, C; Chetty, I; Zhong, H

    2012-06-01

    Purpose Clinical implementation of adaptive treatment planning is limited by the lack of quantitative tools to assess deformable image registration errors (R-ERR). The purpose of this study was to develop a method, using finite element modeling (FEM), to estimate registration errors based on mechanical changes resulting from them. Methods An experimental platform to quantify the correlation between registration errors and their mechanical consequences was developed as follows: diaphragm deformation was simulated on the CT images in patients with lung cancer using a finite element method (FEM). The simulated displacement vector fields (F-DVF) were used to warp each CT image to generate a FEM image. B-Spline based (Elastix) registrations were performed from reference to FEM images to generate a registration DVF (R-DVF). The F- DVF was subtracted from R-DVF. The magnitude of the difference vector was defined as the registration error, which is a consequence of mechanically unbalanced energy (UE), computed using 'in-house-developed' FEM software. A nonlinear regression model was used based on imaging voxel data and the analysis considered clustered voxel data within images. Results A regression model analysis showed that UE was significantly correlated with registration error, DVF and the product of registration error and DVF respectively with R̂2=0.73 (R=0.854). The association was verified independently using 40 tracked landmarks. A linear function between the means of UE values and R- DVF*R-ERR has been established. The mean registration error (N=8) was 0.9 mm. 85.4% of voxels fit this model within one standard deviation. Conclusions An encouraging relationship between UE and registration error has been found. These experimental results suggest the feasibility of UE as a valuable tool for evaluating registration errors, thus supporting 4D and adaptive radiotherapy. The research was supported by NIH/NCI R01CA140341. © 2012 American Association of Physicists in

  16. All-optical flip-flop operation based on asymmetric active-multimode interferometer bi-stable laser diodes

    DEFF Research Database (Denmark)

    Jiang, H.; Chaen, Y.; Hagio, T.

    2011-01-01

    We demonstrate fast and low energy all optical flip-flop devices based on asymmetric active-multimode interferometer using high-mesa waveguide structure. The implemented devices showed high speed alloptical flip-flop operation with 25ps long pulses. The rising and falling times of the output sign...

  17. Seizure Onset Detection based on a Uni- or Multi-modal Intelligent Seizure Acquisition (UISA/MISA) System

    DEFF Research Database (Denmark)

    Conradsen, Isa; Beniczky, Sándor; Wolf, Peter

    2010-01-01

    An automatic Uni- or Multi-modal Inteligent Seizure Acquisition (UISA/MISA) system is highly applicable for onset detection of epileptic seizures based on motion data. The modalities used are surface electromyography (sEMG), acceleration (ACC) and angular velocity (ANG). The new proposed automatic...

  18. Automated Coarse Registration of Point Clouds in 3d Urban Scenes Using Voxel Based Plane Constraint

    Science.gov (United States)

    Xu, Y.; Boerner, R.; Yao, W.; Hoegner, L.; Stilla, U.

    2017-09-01

    For obtaining a full coverage of 3D scans in a large-scale urban area, the registration between point clouds acquired via terrestrial laser scanning (TLS) is normally mandatory. However, due to the complex urban environment, the automatic registration of different scans is still a challenging problem. In this work, we propose an automatic marker free method for fast and coarse registration between point clouds using the geometric constrains of planar patches under a voxel structure. Our proposed method consists of four major steps: the voxelization of the point cloud, the approximation of planar patches, the matching of corresponding patches, and the estimation of transformation parameters. In the voxelization step, the point cloud of each scan is organized with a 3D voxel structure, by which the entire point cloud is partitioned into small individual patches. In the following step, we represent points of each voxel with the approximated plane function, and select those patches resembling planar surfaces. Afterwards, for matching the corresponding patches, a RANSAC-based strategy is applied. Among all the planar patches of a scan, we randomly select a planar patches set of three planar surfaces, in order to build a coordinate frame via their normal vectors and their intersection points. The transformation parameters between scans are calculated from these two coordinate frames. The planar patches set with its transformation parameters owning the largest number of coplanar patches are identified as the optimal candidate set for estimating the correct transformation parameters. The experimental results using TLS datasets of different scenes reveal that our proposed method can be both effective and efficient for the coarse registration task. Especially, for the fast orientation between scans, our proposed method can achieve a registration error of less than around 2 degrees using the testing datasets, and much more efficient than the classical baseline methods.

  19. SU-E-J-91: FFT Based Medical Image Registration Using a Graphics Processing Unit (GPU).

    Science.gov (United States)

    Luce, J; Hoggarth, M; Lin, J; Block, A; Roeske, J

    2012-06-01

    To evaluate the efficiency gains obtained from using a Graphics Processing Unit (GPU) to perform a Fourier Transform (FT) based image registration. Fourier-based image registration involves obtaining the FT of the component images, and analyzing them in Fourier space to determine the translations and rotations of one image set relative to another. An important property of FT registration is that by enlarging the images (adding additional pixels), one can obtain translations and rotations with sub-pixel resolution. The expense, however, is an increased computational time. GPUs may decrease the computational time associated with FT image registration by taking advantage of their parallel architecture to perform matrix computations much more efficiently than a Central Processor Unit (CPU). In order to evaluate the computational gains produced by a GPU, images with known translational shifts were utilized. A program was written in the Interactive Data Language (IDL; Exelis, Boulder, CO) to performCPU-based calculations. Subsequently, the program was modified using GPU bindings (Tech-X, Boulder, CO) to perform GPU-based computation on the same system. Multiple image sizes were used, ranging from 256×256 to 2304×2304. The time required to complete the full algorithm by the CPU and GPU were benchmarked and the speed increase was defined as the ratio of the CPU-to-GPU computational time. The ratio of the CPU-to- GPU time was greater than 1.0 for all images, which indicates the GPU is performing the algorithm faster than the CPU. The smallest improvement, a 1.21 ratio, was found with the smallest image size of 256×256, and the largest speedup, a 4.25 ratio, was observed with the largest image size of 2304×2304. GPU programming resulted in a significant decrease in computational time associated with a FT image registration algorithm. The inclusion of the GPU may provide near real-time, sub-pixel registration capability. © 2012 American Association of Physicists in

  20. Minimizing fiducial localization error using sphere-based registration in jaw tracking.

    Science.gov (United States)

    Abdi, Amir H; Hannam, Alan G; Stavness, Ian K; Fels, Sidney

    2018-02-08

    Some of the jaw tracking methods may be limited in terms of their accuracy or clinical applicability. This article introduces the sphere-based registration method to minimize the fiducial (reference landmark) localization error (FLE) in tracking and coregistration of physical and virtual dental models, to enable an effective clinical analysis of the patient's masticatory functions. In this method, spheres (registration fiducials) are placed on the corresponding polygonal concavities of the physical and virtual dental models based on the geometrical principle that establishes a unique spatial position for a sphere inside an infinite trihedron. The experiments in this study were implemented using an optical system which tracked active tracking markers connected to the upper and lower dental casts. The accuracy of the tracking workflow was confirmed in vitro, based on comparing virtually calculated interocclusal regions of close proximity against the physical interocclusal impressions. The target registration error of the tracking was estimated based on the leave-one-sphere-out method to be the sum of the error of the sensors, i.e., the FLE was negligible. Moreover, based on a user study, the FLE of the proposed method was confirmed to be 5 and 10 times smaller than the FLE of conventional fiducial selections on the physical and virtual models, respectively. The proposed tracking method is non-invasive and appears to be sufficiently accurate. To conclude, the proposed registration and tracking principles can be extended to track any biomedical and non-biomedical geometries that contain polygonal concavities. Copyright © 2017 Elsevier Ltd. All rights reserved.

  1. Multimodal nonlinear microscope based on a compact fiber-format laser source

    Science.gov (United States)

    Crisafi, Francesco; Kumar, Vikas; Perri, Antonio; Marangoni, Marco; Cerullo, Giulio; Polli, Dario

    2018-01-01

    We present a multimodal non-linear optical (NLO) laser-scanning microscope, based on a compact fiber-format excitation laser and integrating coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS) and two-photon-excitation fluorescence (TPEF) on a single platform. We demonstrate its capabilities in simultaneously acquiring CARS and SRS images of a blend of 6-μm poly(methyl methacrylate) beads and 3-μm polystyrene beads. We then apply it to visualize cell walls and chloroplast of an unprocessed fresh leaf of Elodea aquatic plant via SRS and TPEF modalities, respectively. The presented NLO microscope, developed in house using off-the-shelf components, offers full accessibility to the optical path and ensures its easy re-configurability and flexibility.

  2. An on-chip silicon compact triplexer based on cascaded tilted multimode interference couplers

    Science.gov (United States)

    Chen, Jingye; Liu, Penghao; Shi, Yaocheng

    2018-03-01

    An on-chip triplexer based on cascaded tilted multimode interference (MMI) couplers has been demonstrated to separate the 1310 nm wavelength band into one port and 1490 nm and 1550 nm wavelength bands into the other two ports respectively. By utilizing the dispersive self-imaging and pseudo self-imaging, the device length is not critically determined by the common multiple of beat lengths for different wavelengths. The total device size can be reduced to ∼450 μm, which is half of the butterfly structure reported. The whole device, fabricated with only one fully-etching step, is characterized with <-15 dB low crosstalk (CT) and ∼1 dB insertion loss (IL).

  3. Drastic sensitivity enhancement of temperature sensing based on multimodal interference in polymer optical fibers

    Science.gov (United States)

    Numata, Goki; Hayashi, Neisei; Tabaru, Marie; Mizuno, Yosuke; Nakamura, Kentaro

    2015-07-01

    It has been reported that temperature sensors based on modal interference in perfluorinated graded-index polymer optical fibers show extremely high temperature sensitivity at room temperature. In this work, we confirm that the temperature sensitivity (absolute value) is significantly enhanced when the temperature increases toward ∼70 °C, which is close to the glass-transition temperature of the core polymer. When the core diameter is 62.5 µm, the sensitivity at 72 °C at 1300 nm is 202 nm/°C/m, which is approximately 26 times the value obtained at room temperature and >7000 times the highest value previously reported using a silica multimode fiber.

  4. Authorship in the verbovocovisual composition of multimodal short stories based on selfies

    Directory of Open Access Journals (Sweden)

    Isabel Cristina Michelan de Azevedo

    2016-10-01

    Full Text Available http://dx.doi.org/10.5007/1984-8412.2016v13n3p1492 This study aims at showing how a didactic and pedagogical proposal that uses digital information and communication technologies (DICT can contribute to the verbivocovisual text authors’ education, , from the literary and digital spheres, in two public schools of basic education. Based on the concepts developed by Bakhtin and the Circle, we also intend, through the analysis of a multimodal short story, to indicate criteria to encourage the understanding of students' responsive attitudes in Portuguese classes. Discussions compiled in this article indicate that the school practices associated with DICT (1 contribute towards the activities of reading and textual production, and (2 stimulate protagonism and the exercise of citizenship.

  5. Refractive index sensors based on the fused tapered special multi-mode fiber

    Science.gov (United States)

    Fu, Xing-hu; Xiu, Yan-li; Liu, Qin; Xie, Hai-yang; Yang, Chuan-qing; Zhang, Shun-yang; Fu, Guang-wei; Bi, Wei-hong

    2016-01-01

    In this paper, a novel refractive index (RI) sensor is proposed based on the fused tapered special multi-mode fiber (SMMF). Firstly, a section of SMMF is spliced between two single-mode fibers (SMFs). Then, the SMMF is processed by a fused tapering machine, and a tapered fiber structure is fabricated. Finally, a fused tapered SMMF sensor is obtained for measuring external RI. The RI sensing mechanism of tapered SMMF sensor is analyzed in detail. For different fused tapering lengths, the experimental results show that the RI sensitivity can be up to 444.517 81 nm/RIU in the RI range of 1.334 9—1.347 0. The RI sensitivity is increased with the increase of fused tapering length. Moreover, it has many advantages, including high sensitivity, compact structure, fast response and wide application range. So it can be used to measure the solution concentration in the fields of biochemistry, health care and food processing.

  6. Template security analysis of multimodal biometric frameworks based on fingerprint and hand geometry

    Directory of Open Access Journals (Sweden)

    Arvind Selwal

    2016-09-01

    Full Text Available Biometric systems are automatic tools used to provide authentication during various applications of modern computing. In this work, three different design frameworks for multimodal biometric systems based on fingerprint and hand geometry modalities are proposed. An analysis is also presented to diagnose various types of template security issues in the proposed system. Fuzzy analytic hierarchy process (FAHP is applied with five decision parameters on all the designs and framework 1 is found to be better in terms of template data security, templates fusion and computational efficiency. It is noticed that template data security before storage in database is a challenging task. An important observation is that a template may be secured at feature fusion level and an indexing technique may be used to improve the size of secured templates.

  7. Combined model-based segmentation and elastic registration for accurate quantification of the aortic arch.

    Science.gov (United States)

    Biesdorf, Andreas; Rohr, Karl; von Tengg-Kobligk, Hendrik; Wörz, Stefan

    2010-01-01

    Accurate quantification of the morphology of vessels is important for diagnosis and treatment of cardiovascular diseases. We introduce a new approach for the quantification of the aortic arch morphology that combines 3D model-based segmentation with elastic image registration. The performance of the approach has been evaluated using 3D synthetic images and clinically relevant 3D CTA images including pathologies. We also performed a comparison with a previous approach.

  8. Simulating Deformations of MR Brain Images for Validation of Atlas-based Segmentation and Registration Algorithms

    OpenAIRE

    Xue, Zhong; Shen, Dinggang; Karacali, Bilge; Stern, Joshua; Rottenberg, David; Davatzikos, Christos

    2006-01-01

    Simulated deformations and images can act as the gold standard for evaluating various template-based image segmentation and registration algorithms. Traditional deformable simulation methods, such as the use of analytic deformation fields or the displacement of landmarks followed by some form of interpolation, are often unable to construct rich (complex) and/or realistic deformations of anatomical organs. This paper presents new methods aiming to automatically simulate realistic inter- and in...

  9. 3D Physics-Based Registration of 2D Dynamic MRI Data.

    Science.gov (United States)

    Trivisonne, Raffaella; Peterlik, Igor; Cotin, Stéphane; Courtecuisse, Hadrien

    2016-01-01

    We present a method allowing for intra-operative targeting of a specific anatomical feature. The method is based on a registration of 3D pre-operative data to 2D intra-operative images. Such registration is performed using an elastic model reconstructed from the 3D images, in combination with sliding constraints imposed via Lagrange multipliers. We register the pre-operative data, where the feature is clearly detectable, to intra-operative dynamic images where such feature is no more visible. Despite the lack of visibility on the 2D MRI images, we are able both to determine the location of the target as well as follow its displacement due to respiratory motion.

  10. [Affine transformation-based automatic registration for peripheral digital subtraction angiography (DSA)].

    Science.gov (United States)

    Kong, Gang; Dai, Dao-Qing; Zou, Lu-Min

    2008-07-01

    In order to remove the artifacts of peripheral digital subtraction angiography (DSA), an affine transformation-based automatic image registration algorithm is introduced here. The whole process is described as follows: First, rectangle feature templates are constructed with their centers of the extracted Harris corners in the mask, and motion vectors of the central feature points are estimated using template matching technology with the similarity measure of maximum histogram energy. And then the optimal parameters of the affine transformation are calculated with the matrix singular value decomposition (SVD) method. Finally, bilinear intensity interpolation is taken to the mask according to the specific affine transformation. More than 30 peripheral DSA registrations are performed with the presented algorithm, and as the result, moving artifacts of the images are removed with sub-pixel precision, and the time consumption is less enough to satisfy the clinical requirements. Experimental results show the efficiency and robustness of the algorithm.

  11. A Matlab user interface for the statistically assisted fluid registration algorithm and tensor-based morphometry

    Science.gov (United States)

    Yepes-Calderon, Fernando; Brun, Caroline; Sant, Nishita; Thompson, Paul; Lepore, Natasha

    2015-01-01

    Tensor-Based Morphometry (TBM) is an increasingly popular method for group analysis of brain MRI data. The main steps in the analysis consist of a nonlinear registration to align each individual scan to a common space, and a subsequent statistical analysis to determine morphometric differences, or difference in fiber structure between groups. Recently, we implemented the Statistically-Assisted Fluid Registration Algorithm or SAFIRA,1 which is designed for tracking morphometric differences among populations. To this end, SAFIRA allows the inclusion of statistical priors extracted from the populations being studied as regularizers in the registration. This flexibility and degree of sophistication limit the tool to expert use, even more so considering that SAFIRA was initially implemented in command line mode. Here, we introduce a new, intuitive, easy to use, Matlab-based graphical user interface for SAFIRA's multivariate TBM. The interface also generates different choices for the TBM statistics, including both the traditional univariate statistics on the Jacobian matrix, and comparison of the full deformation tensors.2 This software will be freely disseminated to the neuroimaging research community.

  12. A block matching-based registration algorithm for localization of locally advanced lung tumors.

    Science.gov (United States)

    Robertson, Scott P; Weiss, Elisabeth; Hugo, Geoffrey D

    2014-04-01

    To implement and evaluate a block matching-based registration (BMR) algorithm for locally advanced lung tumor localization during image-guided radiotherapy. Small (1 cm(3)), nonoverlapping image subvolumes ("blocks") were automatically identified on the planning image to cover the tumor surface using a measure of the local intensity gradient. Blocks were independently and automatically registered to the on-treatment image using a rigid transform. To improve speed and robustness, registrations were performed iteratively from coarse to fine image resolution. At each resolution, all block displacements having a near-maximum similarity score were stored. From this list, a single displacement vector for each block was iteratively selected which maximized the consistency of displacement vectors across immediately neighboring blocks. These selected displacements were regularized using a median filter before proceeding to registrations at finer image resolutions. After evaluating all image resolutions, the global rigid transform of the on-treatment image was computed using a Procrustes analysis, providing the couch shift for patient setup correction. This algorithm was evaluated for 18 locally advanced lung cancer patients, each with 4-7 weekly on-treatment computed tomography scans having physician-delineated gross tumor volumes. Volume overlap (VO) and border displacement errors (BDE) were calculated relative to the nominal physician-identified targets to establish residual error after registration. Implementation of multiresolution registration improved block matching accuracy by 39% compared to registration using only the full resolution images. By also considering multiple potential displacements per block, initial errors were reduced by 65%. Using the final implementation of the BMR algorithm, VO was significantly improved from 77% ± 21% (range: 0%-100%) in the initial bony alignment to 91% ± 8% (range: 56%-100%;p < 0.001). Left-right, anterior-posterior, and

  13. A block matching-based registration algorithm for localization of locally advanced lung tumors

    Energy Technology Data Exchange (ETDEWEB)

    Robertson, Scott P.; Weiss, Elisabeth; Hugo, Geoffrey D., E-mail: gdhugo@vcu.edu [Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia, 23298 (United States)

    2014-04-15

    Purpose: To implement and evaluate a block matching-based registration (BMR) algorithm for locally advanced lung tumor localization during image-guided radiotherapy. Methods: Small (1 cm{sup 3}), nonoverlapping image subvolumes (“blocks”) were automatically identified on the planning image to cover the tumor surface using a measure of the local intensity gradient. Blocks were independently and automatically registered to the on-treatment image using a rigid transform. To improve speed and robustness, registrations were performed iteratively from coarse to fine image resolution. At each resolution, all block displacements having a near-maximum similarity score were stored. From this list, a single displacement vector for each block was iteratively selected which maximized the consistency of displacement vectors across immediately neighboring blocks. These selected displacements were regularized using a median filter before proceeding to registrations at finer image resolutions. After evaluating all image resolutions, the global rigid transform of the on-treatment image was computed using a Procrustes analysis, providing the couch shift for patient setup correction. This algorithm was evaluated for 18 locally advanced lung cancer patients, each with 4–7 weekly on-treatment computed tomography scans having physician-delineated gross tumor volumes. Volume overlap (VO) and border displacement errors (BDE) were calculated relative to the nominal physician-identified targets to establish residual error after registration. Results: Implementation of multiresolution registration improved block matching accuracy by 39% compared to registration using only the full resolution images. By also considering multiple potential displacements per block, initial errors were reduced by 65%. Using the final implementation of the BMR algorithm, VO was significantly improved from 77% ± 21% (range: 0%–100%) in the initial bony alignment to 91% ± 8% (range: 56%–100%;p < 0

  14. A block matching-based registration algorithm for localization of locally advanced lung tumors

    International Nuclear Information System (INIS)

    Robertson, Scott P.; Weiss, Elisabeth; Hugo, Geoffrey D.

    2014-01-01

    Purpose: To implement and evaluate a block matching-based registration (BMR) algorithm for locally advanced lung tumor localization during image-guided radiotherapy. Methods: Small (1 cm 3 ), nonoverlapping image subvolumes (“blocks”) were automatically identified on the planning image to cover the tumor surface using a measure of the local intensity gradient. Blocks were independently and automatically registered to the on-treatment image using a rigid transform. To improve speed and robustness, registrations were performed iteratively from coarse to fine image resolution. At each resolution, all block displacements having a near-maximum similarity score were stored. From this list, a single displacement vector for each block was iteratively selected which maximized the consistency of displacement vectors across immediately neighboring blocks. These selected displacements were regularized using a median filter before proceeding to registrations at finer image resolutions. After evaluating all image resolutions, the global rigid transform of the on-treatment image was computed using a Procrustes analysis, providing the couch shift for patient setup correction. This algorithm was evaluated for 18 locally advanced lung cancer patients, each with 4–7 weekly on-treatment computed tomography scans having physician-delineated gross tumor volumes. Volume overlap (VO) and border displacement errors (BDE) were calculated relative to the nominal physician-identified targets to establish residual error after registration. Results: Implementation of multiresolution registration improved block matching accuracy by 39% compared to registration using only the full resolution images. By also considering multiple potential displacements per block, initial errors were reduced by 65%. Using the final implementation of the BMR algorithm, VO was significantly improved from 77% ± 21% (range: 0%–100%) in the initial bony alignment to 91% ± 8% (range: 56%–100%;p < 0.001). Left

  15. “Abstractive description” of land registration system based on the theory of “public confidence”

    Directory of Open Access Journals (Sweden)

    Nasrini Tabatabai Hesari

    2014-10-01

    Full Text Available the system of land registration is protective formalism that is formed based on the theory of “public confidence”. This theory presumes that what reflected by the land registration offices is based on the legal fact. This theory, which provides legal stability and security in transactions, is manifested in three guiding principles including “mirror principle”, “curtain principle” and “insurance principle”, and offers an “abstractive description” to a land registration system. This character has different effects on diverse legal systems and can be studied for both positive and negative systems.

  16. Fast Rotation-Free Feature-Based Image Registration Using Improved N-SIFT and GMM-Based Parallel Optimization.

    Science.gov (United States)

    Yu, Dongdong; Yang, Feng; Yang, Caiyun; Leng, Chengcai; Cao, Jian; Wang, Yining; Tian, Jie

    2016-08-01

    Image registration is a key problem in a variety of applications, such as computer vision, medical image processing, pattern recognition, etc., while the application of registration is limited by time consumption and the accuracy in the case of large pose differences. Aimed at these two kinds of problems, we propose a fast rotation-free feature-based rigid registration method based on our proposed accelerated-NSIFT and GMM registration-based parallel optimization (PO-GMMREG). Our method is accelerated by using the GPU/CUDA programming and preserving only the location information without constructing the descriptor of each interest point, while its robustness to missing correspondences and outliers is improved by converting the interest point matching to Gaussian mixture model alignment. The accuracy in the case of large pose differences is settled by our proposed PO-GMMREG algorithm by constructing a set of initial transformations. Experimental results demonstrate that our proposed algorithm can fast rigidly register 3-D medical images and is reliable for aligning 3-D scans even when they exhibit a poor initialization.

  17. A novel multimodal chromatography based single step purification process for efficient manufacturing of an E. coli based biotherapeutic protein product.

    Science.gov (United States)

    Bhambure, Rahul; Gupta, Darpan; Rathore, Anurag S

    2013-11-01

    Methionine oxidized, reduced and fMet forms of a native recombinant protein product are often the critical product variants which are associated with proteins expressed as bacterial inclusion bodies in E. coli. Such product variants differ from native protein in their structural and functional aspects, and may lead to loss of biological activity and immunogenic response in patients. This investigation focuses on evaluation of multimodal chromatography for selective removal of these product variants using recombinant human granulocyte colony stimulating factor (GCSF) as the model protein. Unique selectivity in separation of closely related product variants was obtained using combined pH and salt based elution gradients in hydrophobic charge induction chromatography. Simultaneous removal of process related impurities was also achieved in flow-through leading to single step purification process for the GCSF. Results indicate that the product recovery of up to 90.0% can be obtained with purity levels of greater than 99.0%. Binding the target protein at pHbased elution gradient and removal of the host cell impurities in flow-through are the key novel features of the developed multimodal chromatographic purification step. Copyright © 2013 Elsevier B.V. All rights reserved.

  18. Automatic markerless registration of point clouds with semantic-keypoint-based 4-points congruent sets

    Science.gov (United States)

    Ge, Xuming

    2017-08-01

    The coarse registration of point clouds from urban building scenes has become a key topic in applications of terrestrial laser scanning technology. Sampling-based algorithms in the random sample consensus (RANSAC) model have emerged as mainstream solutions to address coarse registration problems. In this paper, we propose a novel combined solution to automatically align two markerless point clouds from building scenes. Firstly, the method segments non-ground points from ground points. Secondly, the proposed method detects feature points from each cross section and then obtains semantic keypoints by connecting feature points with specific rules. Finally, the detected semantic keypoints from two point clouds act as inputs to a modified 4PCS algorithm. Examples are presented and the results compared with those of K-4PCS to demonstrate the main contributions of the proposed method, which are the extension of the original 4PCS to handle heavy datasets and the use of semantic keypoints to improve K-4PCS in relation to registration accuracy and computational efficiency.

  19. Cellular neural network-based hybrid approach toward automatic image registration

    Science.gov (United States)

    Arun, Pattathal VijayaKumar; Katiyar, Sunil Kumar

    2013-01-01

    Image registration is a key component of various image processing operations that involve the analysis of different image data sets. Automatic image registration domains have witnessed the application of many intelligent methodologies over the past decade; however, inability to properly model object shape as well as contextual information has limited the attainable accuracy. A framework for accurate feature shape modeling and adaptive resampling using advanced techniques such as vector machines, cellular neural network (CNN), scale invariant feature transform (SIFT), coreset, and cellular automata is proposed. CNN has been found to be effective in improving feature matching as well as resampling stages of registration and complexity of the approach has been considerably reduced using coreset optimization. The salient features of this work are cellular neural network approach-based SIFT feature point optimization, adaptive resampling, and intelligent object modelling. Developed methodology has been compared with contemporary methods using different statistical measures. Investigations over various satellite images revealed that considerable success was achieved with the approach. This system has dynamically used spectral and spatial information for representing contextual knowledge using CNN-prolog approach. This methodology is also illustrated to be effective in providing intelligent interpretation and adaptive resampling.

  20. Model-based registration for assessment of spinal deformities in idiopathic scoliosis

    Science.gov (United States)

    Forsberg, Daniel; Lundström, Claes; Andersson, Mats; Knutsson, Hans

    2014-01-01

    Detailed analysis of spinal deformity is important within orthopaedic healthcare, in particular for assessment of idiopathic scoliosis. This paper addresses this challenge by proposing an image analysis method, capable of providing a full three-dimensional spine characterization. The proposed method is based on the registration of a highly detailed spine model to image data from computed tomography. The registration process provides an accurate segmentation of each individual vertebra and the ability to derive various measures describing the spinal deformity. The derived measures are estimated from landmarks attached to the spine model and transferred to the patient data according to the registration result. Evaluation of the method provides an average point-to-surface error of 0.9 mm ± 0.9 (comparing segmentations), and an average target registration error of 2.3 mm ± 1.7 (comparing landmarks). Comparing automatic and manual measurements of axial vertebral rotation provides a mean absolute difference of 2.5° ± 1.8, which is on a par with other computerized methods for assessing axial vertebral rotation. A significant advantage of our method, compared to other computerized methods for rotational measurements, is that it does not rely on vertebral symmetry for computing the rotational measures. The proposed method is fully automatic and computationally efficient, only requiring three to four minutes to process an entire image volume covering vertebrae L5 to T1. Given the use of landmarks, the method can be readily adapted to estimate other measures describing a spinal deformity by changing the set of employed landmarks. In addition, the method has the potential to be utilized for accurate segmentations of the vertebrae in routine computed tomography examinations, given the relatively low point-to-surface error.

  1. Intensity-based 2D 3D registration for lead localization in robot guided deep brain stimulation

    Science.gov (United States)

    Hunsche, Stefan; Sauner, Dieter; El Majdoub, Faycal; Neudorfer, Clemens; Poggenborg, Jörg; Goßmann, Axel; Maarouf, Mohammad

    2017-03-01

    Intraoperative assessment of lead localization has become a standard procedure during deep brain stimulation surgery in many centers, allowing immediate verification of targeting accuracy and, if necessary, adjustment of the trajectory. The most suitable imaging modality to determine lead positioning, however, remains controversially discussed. Current approaches entail the implementation of computed tomography and magnetic resonance imaging. In the present study, we adopted the technique of intensity-based 2D 3D registration that is commonly employed in stereotactic radiotherapy and spinal surgery. For this purpose, intraoperatively acquired 2D x-ray images were fused with preoperative 3D computed tomography (CT) data to verify lead placement during stereotactic robot assisted surgery. Accuracy of lead localization determined from 2D 3D registration was compared to conventional 3D 3D registration in a subsequent patient study. The mean Euclidian distance of lead coordinates estimated from intensity-based 2D 3D registration versus flat-panel detector CT 3D 3D registration was 0.7 mm  ±  0.2 mm. Maximum values of these distances amounted to 1.2 mm. To further investigate 2D 3D registration a simulation study was conducted, challenging two observers to visually assess artificially generated 2D 3D registration errors. 95% of deviation simulations, which were visually assessed as sufficient, had a registration error below 0.7 mm. In conclusion, 2D 3D intensity-based registration revealed high accuracy and reliability during robot guided stereotactic neurosurgery and holds great potential as a low dose, cost effective means for intraoperative lead localization.

  2. Two-port multimode interference reflectors based on aluminium mirrors in a thick SOI platform.

    Science.gov (United States)

    Fandiño, Javier S; Doménech, José David; Muñoz, Pascual

    2015-08-10

    Multimode interference reflectors (MIRs) were recently introduced as a new type of photonic integrated devices for on-chip, broadband light reflection. In the original proposal, different MIRs were demonstrated based on total internal reflection mirrors made of two deep-etched facets. Although simpler to fabricate, this approach imposes certain limits on the shape of the field pattern at the reflecting facets, which in turn restricts the types of MIRs that can be implemented. In this work, we propose and experimentally demonstrate the use of aluminium-based mirrors for the design of 2-port MIRs with variable reflectivity. These mirrors do not impose any restrictions on the incident field, and thus give more flexibility at the design stage. Devices with different reflectivities in the range between 0 and 0.5 were fabricated in a 3 um thick SOI platform, and characterization of multiple dies was performed to extract statistical data about their performance. Our measurements show that, on average, losses both in the aluminium mirror and in the access waveguides reduce the reflectivities to about 79% of their target value. Moreover, standard deviations lower than ±5% are obtained over a 20 nm wavelength range (1540-1560 nm). We also provide a theoretical model of the aluminium mirror based on the effective index method and Fresnel equations in multilayer thin films, which shows good agreement with FDTD simulations.

  3. New chaff point based fuzzy vault for multimodal biometric cryptosystem using particle swarm optimization

    Directory of Open Access Journals (Sweden)

    Gandhimathi Amirthalingam

    2016-10-01

    Full Text Available An effective fusion method for combining information from single modality system requires Multimodal biometric crypto system. Fuzzy vault has been widely used for providing security, but the disadvantage is that the biometric data are easily visible and chaff points generated randomly can be easily found, so that there is a chance for the data to be hacked by the attackers. In order to improve the security by hiding the secret key within the biometric data, a new chaff point based fuzzy vault is proposed. For the generation of the secret key in the fuzzy vault, grouped feature vectors are generated by combining the extracted shape and texture feature vectors with the new chaff point feature vectors. With the help of the locations of the extracted feature vector points, x and y co-ordinate chaff matrixes are generated. New chaff points can be made, by picking best locations from the feature vectors. The optimal locations are found out by using particle swarm optimization (PSO algorithm. In PSO, extracted feature locations are considered particles and from these locations, best location for generating the chaff feature point is selected based on the fitness value. The experimentation of the proposed work is done on Yale face and IIT Delhi ear databases and its performance are evaluated using the measures such as Jaccard coefficient (JC, Genuine Acceptance Rate (GAR, False Matching Rate (FMR, Dice Coefficient (DC and False Non Matching Rate (FNMR. The results of the implementation give better recognition of person by facilitating 90% recognition result.

  4. Theoretical modeling of a coupled plasmon waveguide resonance sensor based on multimode optical fiber

    Science.gov (United States)

    Liu, Kun; Xue, Meng; Jiang, Junfeng; Wang, Tao; Chang, Pengxiang; Liu, Tiegen

    2018-03-01

    A coupled plasmon waveguide resonance (CPWR) sensor based on metal/dielectric-coated step index multimode optical fiber is proposed. Theoretical simulations using the four-layer Fresnel equations based on a bi-dimensional optical fiber model were implemented on four structures: Ag-ZnO, Au-ZnO, Ag-TiO2 and Au-TiO2. By controlling the thickness of dielectric layer, we managed to manipulate the CPWR resonance wavelengths. When a CPWR resonance dip is in the short wavelength region, it is insensitive to the change of surrounding refractive index (SRI) and can be used as a reference to improve the sensing accuracy of surface plasmon resonance (SPR) mode. With the increase of the thickness of the dielectric layer, the CPWR resonance dips shift to longer wavelength and the corresponding sensitivities increase. When the 1st CPWR resonance wavelength is near 1550 nm and SRI is around 1.333, the sensitivities of four structures reach 1360.61 nm/RIU, 1375.76 nm/RIU, 1048.48 nm/RIU and 1015.15 nm/RIU, respectively. The values are close to that of the conventional SPR optical fiber sensor while the spectral bandwidths of the optical fiber CPWR sensors are narrower.

  5. Face-iris multimodal biometric scheme based on feature level fusion

    Science.gov (United States)

    Huo, Guang; Liu, Yuanning; Zhu, Xiaodong; Dong, Hongxing; He, Fei

    2015-11-01

    Unlike score level fusion, feature level fusion demands all the features extracted from unimodal traits with high distinguishability, as well as homogeneity and compatibility, which is difficult to achieve. Therefore, most multimodal biometric research focuses on score level fusion, whereas few investigate feature level fusion. We propose a face-iris recognition method based on feature level fusion. We build a special two-dimensional-Gabor filter bank to extract local texture features from face and iris images, and then transform them by histogram statistics into an energy-orientation variance histogram feature with lower dimensions and higher distinguishability. Finally, through a fusion-recognition strategy based on principal components analysis and support vector machine (FRSPS), feature level fusion and one-to-n identification are accomplished. The experimental results demonstrate that this method can not only effectively extract face and iris features but also provide higher recognition accuracy. Compared with some state-of-the-art fusion methods, the proposed method has a significant performance advantage.

  6. Automated geographic registration and radiometric correction for UAV-based mosaics

    Science.gov (United States)

    Thomasson, J. Alex; Shi, Yeyin; Sima, Chao; Yang, Chenghai; Cope, Dale A.

    2017-05-01

    Texas A and M University has been operating a large-scale, UAV-based, agricultural remote-sensing research project since 2015. To use UAV-based images in agricultural production, many high-resolution images must be mosaicked together to create an image of an agricultural field. Two key difficulties to science-based utilization of such mosaics are geographic registration and radiometric calibration. In our current research project, image files are taken to the computer laboratory after the flight, and semi-manual pre-processing is implemented on the raw image data, including ortho-mosaicking and radiometric calibration. Ground control points (GCPs) are critical for high-quality geographic registration of images during mosaicking. Applications requiring accurate reflectance data also require radiometric-calibration references so that reflectance values of image objects can be calculated. We have developed a method for automated geographic registration and radiometric correction with targets that are installed semi-permanently at distributed locations around fields. The targets are a combination of black (≍5% reflectance), dark gray (≍20% reflectance), and light gray (≍40% reflectance) sections that provide for a transformation of pixel-value to reflectance in the dynamic range of crop fields. The exact spectral reflectance of each target is known, having been measured with a spectrophotometer. At the time of installation, each target is measured for position with a real-time kinematic GPS receiver to give its precise latitude and longitude. Automated location of the reference targets in the images is required for precise, automated, geographic registration; and automated calculation of the digital-number to reflectance transformation is required for automated radiometric calibration. To validate the system for radiometric calibration, a calibrated UAV-based image mosaic of a field was compared to a calibrated single image from a manned aircraft. Reflectance

  7. A phantom study of the accuracy of CT, MR and PET image registrations with a block matching-based algorithm.

    Science.gov (United States)

    Isambert, A; Bonniaud, G; Lavielle, F; Malandain, G; Lefkopoulos, D

    2008-12-01

    The aim of the present study was to quantitatively assess the performance of a block matching-based automatic registration algorithm integrated within the commercial treatment planning system designated ISOgray from Dosisoft. The accuracy of the process was evaluated by a phantom study on computed tomography (CT), magnetic resonance (MR) and positron emission tomography (PET) images. Two phantoms were used to carry out this study: the cylindrical Jaszczak phantom and the anthropomorphic Liqui-Phil Head Phantom (the Phantom Laboratory), containing fillable spheres. External fiducial markers were used to quantify the accuracy of 41 CT/CT, MR/CT and PET/CT automatic registrations with images of the rotated and tilted phantoms. The study first showed that a cylindrical phantom was not adapted for the evaluation of the performance of a block matching-based registration software. Secondly, the Liqui-Phil Head Phantom study showed that the algorithm was able to perform automatic registrations of CT/CT and MR/CT images with differences of up to 40 degrees in phantom rotation and of up to 20-30 degrees for PET/CT with accuracy below the image voxel size. The study showed that the block matching-based automatic registration software under investigation was robust, reliable and yielded very satisfactory results. This phantom-based test can be integrated into a periodical quality assurance process and used for any commissioning of image registration software for radiation therapy.

  8. Registration-based Bone Morphometry for Shape Analysis of the Bones of the Human Wrist

    Science.gov (United States)

    Joshi, Anand A.; Leahy, Richard M.; Badawi, Ramsey D.; Chaudhari, Abhijit J.

    2015-01-01

    We present a method that quantifies point-wise changes in surface morphology of the bones of the human wrist. The proposed method, referred to as Registration-based Bone Morphometry (RBM), consists of two steps: an atlas selection step and an atlas warping step. The atlas for individual wrist bones was selected based on the shortest l2 distance to the ensemble of wrist bones from a database of a healthy population of subjects. The selected atlas was then warped to the corresponding bones of individuals in the population using a non-linear registration method based on regularized l2 distance minimization. The displacement field thus calculated showed local differences in bone shape that then were used for the analysis of group differences. Our results indicate that RBM has potential to provide a standardized approach to shape analysis of bones of the human wrist. We demonstrate the performance of RBM for examining group differences in wrist bone shapes based on sex and between those of the right and left wrists in healthy individuals. We also present data to show the application of RBM for tracking bone erosion status in rheumatoid arthritis. PMID:26353369

  9. MatchGUI: A Graphical MATLAB-Based Tool for Automatic Image Co-Registration

    Science.gov (United States)

    Ansar, Adnan I.

    2011-01-01

    MatchGUI software, based on MATLAB, automatically matches two images and displays the match result by superimposing one image on the other. A slider bar allows focus to shift between the two images. There are tools for zoom, auto-crop to overlap region, and basic image markup. Given a pair of ortho-rectified images (focused primarily on Mars orbital imagery for now), this software automatically co-registers the imagery so that corresponding image pixels are aligned. MatchGUI requires minimal user input, and performs a registration over scale and inplane rotation fully automatically

  10. 3D Part-Based Sparse Tracker with Automatic Synchronization and Registration

    KAUST Repository

    Bibi, Adel Aamer

    2016-12-13

    In this paper, we present a part-based sparse tracker in a particle filter framework where both the motion and appearance model are formulated in 3D. The motion model is adaptive and directed according to a simple yet powerful occlusion handling paradigm, which is intrinsically fused in the motion model. Also, since 3D trackers are sensitive to synchronization and registration noise in the RGB and depth streams, we propose automated methods to solve these two issues. Extensive experiments are conducted on a popular RGBD tracking benchmark, which demonstrate that our tracker can achieve superior results, outperforming many other recent and state-of-the-art RGBD trackers.

  11. A Proposed Multiple Scan Biometric-Based Registration System for Ghana Electoral Commission

    OpenAIRE

    Yeboah, Dr. Thomas; Opoku-Mensah, Dr Ing Edward; Abilimi, Christopher Ayaaba

    2013-01-01

    In most of developing countries such as Ghana electioneering process normally results in election fraud such as double registration and other forms of election drawbacks during registration of voters and casting of votes by eligible voters. In the just ended Ghanaian election, electronic biometric registration and verification system was introduced during the registration and verification of voters. It was observed on the elections day that some of the genuine registered voters were not recog...

  12. Highly sensitive curvature sensor based on asymmetrical twin core fiber and multimode fiber

    Science.gov (United States)

    Wu, Yue; Pei, Li; Jin, Wenxing; Jiang, Youchao; Yang, Yuguang; Shen, Ya; Jian, Shuisheng

    2017-07-01

    A highly sensitive curvature sensor based on asymmetrical twin core fiber (TCF) and multimode fiber (MMF) is proposed and experimentally demonstrated. By applying the coupled-mode theory and equivalent refractive index model, we theoretically analyze the uncoupled feature of the TCF and the relationship between peak wavelength and the curvature. Two segments of MMF used as beam splitter and combiner are embedded on the two ends of the TCF, and the extinction ratio of the comb transmission spectrum is about 15 dB. The experimental result shows that the curvature sensitivity of the sensor can be achieved as high as 103.35 nm/m-1 ranging from 0.24 m-1 to 0.6 m-1, and the strain sensitivity is up to -4.01 pm/με in the range from 0 μεto 1400 με. The simultaneous detection of the curvature and strain can be realized. The temperature sensitivity is 0.431 nm/°C in the range from 40 °C to 70 °C. This fiber sensor exhibits the advantages of low cost, easy and repeated fabrication, and high sensitivity.

  13. Multi-mode dynamics of optical oscillators based on intracavity nonlinear frequency down-conversion

    Science.gov (United States)

    Morozov, Yuri A.

    2018-01-01

    The transient power characteristics of two optical oscillators—a difference frequency generator (ICDFG) and a singly resonant optical parametric oscillator (ICSRO)—based on intracavity nonlinear optical frequency conversion, are described. The simulation has been performed via the rate-equation mathematical model, which features a multi-mode behavior of all optical fields. The reason for unattainability of single-mode emission in these devices without an additional frequency-selective element (e.g., a Fabry-Perot etalon) is clarified. It is shown that the dynamics of a short-wavelength emission (pump) results mainly from the nonlinear optical interaction, while that of the longer-wavelength optical fields (signal and idler) depends on selectivity of the etalon. With the suitable etalons inserted in their cavities, both devices are shown to operate dynamically single-mode under conventional experimental conditions. The nonlinear interaction makes the pump emission collapse to the single-mode operation very fast (it takes no more than a few tens of the photon lifetimes). To overcome the threshold of parametric generation, the intracavity pump power in the ICSRO has to exceed ˜ 100 W, while the ICDFG is essentially a "thresholdless" device.

  14. Feature-Fusion Guidelines for Image-Based Multi-Modal Biometric Fusion

    Directory of Open Access Journals (Sweden)

    Dane Brown

    2017-07-01

    Full Text Available The feature level, unlike the match score level, lacks multi-modal fusion guidelines. This work demonstrates a new approach for improved image-based biometric feature-fusion. The approach extracts and combines the face, fingerprint and palmprint at the feature level for improved human identification accuracy. Feature-fusion guidelines, proposed in our recent work, are extended by adding a new face segmentation method and the support vector machine classifier. The new face segmentation method improves the face identification equal error rate (EER by 10%. The support vector machine classifier combined with the new feature selection approach, proposed in our recent work, outperforms other classifiers when using a single training sample. Feature-fusion guidelines take the form of strengths and weaknesses as observed in the applied feature processing modules during preliminary experiments. The guidelines are used to implement an effective biometric fusion system at the feature level, using a novel feature-fusion methodology, reducing the EER of two groups of three datasets namely: SDUMLA face, SDUMLA fingerprint and IITD palmprint; MUCT Face, MCYT Fingerprint and CASIA Palmprint.

  15. Multi-modal particle manipulator to enhance bead-based bioassays

    Science.gov (United States)

    Glynne-Jones, P.; Boltryk, R. J.; Hill, M.; Zhang, F.; Dong, L.; Wilkinson, J. S.; Brown, T.; Melvin, T.; Harris, N. R.

    2010-01-01

    By sequentially pushing micro-beads towards and away from a sensing surface, we show that ultrasonic radiation forces can be used to enhance the interaction between a functionalized glass surface and polystyrene micro-beads, and distinguish those that bind to the surface, ultimately by using an integrated optical waveguide implanted in the reflector to facilitate optical detection. The movement towards and immobilization of streptavidin coated beads onto a biotin functionalized waveguide surface is achieved by using a quarter-wavelength mode pushing beads onto the surface, while the removal of non-specifically bound beads uses a second quarter-wavelength mode which exhibits a kinetic energy maxima at the boundary between the carrier layer and fluid, drawing beads towards this surface. This has been achieved using a multi-modal acoustic device which exhibits both these quarter-wavelength resonances. Both 1-D acoustic modeling and finite element analysis has been used to design this device and investigate the spatial uniformity of the field. We demonstrate experimentally that 90% of specifically bound beads remain attached after applying ultrasound, with 80% of non-specifically bound control beads being successfully removed acoustically. This approach overcomes problems associated with lengthy sedimentation processes used for bead-based bioassays and surface (electrostatic) forces, which delay or prevent immobilization. We explain the potential of this technique in the development of DNA and protein assays in terms of detection speed and multiplexing.

  16. Accuracy of radiotherapy dose calculations based on cone-beam CT: comparison of deformable registration and image correction based methods

    Science.gov (United States)

    Marchant, T. E.; Joshi, K. D.; Moore, C. J.

    2018-03-01

    Radiotherapy dose calculations based on cone-beam CT (CBCT) images can be inaccurate due to unreliable Hounsfield units (HU) in the CBCT. Deformable image registration of planning CT images to CBCT, and direct correction of CBCT image values are two methods proposed to allow heterogeneity corrected dose calculations based on CBCT. In this paper we compare the accuracy and robustness of these two approaches. CBCT images for 44 patients were used including pelvis, lung and head & neck sites. CBCT HU were corrected using a ‘shading correction’ algorithm and via deformable registration of planning CT to CBCT using either Elastix or Niftyreg. Radiotherapy dose distributions were re-calculated with heterogeneity correction based on the corrected CBCT and several relevant dose metrics for target and OAR volumes were calculated. Accuracy of CBCT based dose metrics was determined using an ‘override ratio’ method where the ratio of the dose metric to that calculated on a bulk-density assigned version of the same image is assumed to be constant for each patient, allowing comparison to the patient’s planning CT as a gold standard. Similar performance is achieved by shading corrected CBCT and both deformable registration algorithms, with mean and standard deviation of dose metric error less than 1% for all sites studied. For lung images, use of deformed CT leads to slightly larger standard deviation of dose metric error than shading corrected CBCT with more dose metric errors greater than 2% observed (7% versus 1%).

  17. An Automated Parallel Image Registration Technique Based on the Correlation of Wavelet Features

    Science.gov (United States)

    LeMoigne, Jacqueline; Campbell, William J.; Cromp, Robert F.; Zukor, Dorothy (Technical Monitor)

    2001-01-01

    With the increasing importance of multiple platform/multiple remote sensing missions, fast and automatic integration of digital data from disparate sources has become critical to the success of these endeavors. Our work utilizes maxima of wavelet coefficients to form the basic features of a correlation-based automatic registration algorithm. Our wavelet-based registration algorithm is tested successfully with data from the National Oceanic and Atmospheric Administration (NOAA) Advanced Very High Resolution Radiometer (AVHRR) and the Landsat/Thematic Mapper(TM), which differ by translation and/or rotation. By the choice of high-frequency wavelet features, this method is similar to an edge-based correlation method, but by exploiting the multi-resolution nature of a wavelet decomposition, our method achieves higher computational speeds for comparable accuracies. This algorithm has been implemented on a Single Instruction Multiple Data (SIMD) massively parallel computer, the MasPar MP-2, as well as on the CrayT3D, the Cray T3E and a Beowulf cluster of Pentium workstations.

  18. The STM32 microcontroller based pulse intensity registration system for the neutron monitor

    Directory of Open Access Journals (Sweden)

    Shepetov Alexander

    2017-01-01

    Full Text Available We present the outlines of a new microcontroller based data acquisition system which is aimed for reliable operation in a typical cosmic ray particle registration experiment. The system supports connection of up to 16 input signals and ensures the following operation functionality: (1 stable monitoring of the intensity of a digital pulse signal, or digitization of a continuous potential level with a low time resolution (typically, about 1 s–100 s; (2 registration of uninterruptable high-resolution (up to 5–10 μs time series of the input signal intensity; (3 synchronization of registered time series with both external (physical or local (program-based trigger signal; (4 possibility of an on-the-fly change of the whole configuration of informational system (both the combination and type of input signals, time resolution and sum duration of the time series measurements, trigger logic, etc. immediately in operation time through convenient communication by plain text messages in dialog mode. In particular, the considered system is applied now for a long-term, high precision measurement of the counting rate of neutron signals at the NM64 type neutron supermonitor of the Tien Shan mountain cosmic ray station, with a real-time representation of the whole collected dataset in a WWW database.

  19. Background Registration-Based Adaptive Noise Filtering of LWIR/MWIR Imaging Sensors for UAV Applications.

    Science.gov (United States)

    Kim, Byeong Hak; Kim, Min Young; Chae, You Seong

    2017-12-27

    Unmanned aerial vehicles (UAVs) are equipped with optical systems including an infrared (IR) camera such as electro-optical IR (EO/IR), target acquisition and designation sights (TADS), or forward looking IR (FLIR). However, images obtained from IR cameras are subject to noise such as dead pixels, lines, and fixed pattern noise. Nonuniformity correction (NUC) is a widely employed method to reduce noise in IR images, but it has limitations in removing noise that occurs during operation. Methods have been proposed to overcome the limitations of the NUC method, such as two-point correction (TPC) and scene-based NUC (SBNUC). However, these methods still suffer from unfixed pattern noise. In this paper, a background registration-based adaptive noise filtering (BRANF) method is proposed to overcome the limitations of conventional methods. The proposed BRANF method utilizes background registration processing and robust principle component analysis (RPCA). In addition, image quality verification methods are proposed that can measure the noise filtering performance quantitatively without ground truth images. Experiments were performed for performance verification with middle wave infrared (MWIR) and long wave infrared (LWIR) images obtained from practical military optical systems. As a result, it is found that the image quality improvement rate of BRANF is 30% higher than that of conventional NUC.

  20. Simulating deformations of MR brain images for validation of atlas-based segmentation and registration algorithms.

    Science.gov (United States)

    Xue, Zhong; Shen, Dinggang; Karacali, Bilge; Stern, Joshua; Rottenberg, David; Davatzikos, Christos

    2006-11-15

    Simulated deformations and images can act as the gold standard for evaluating various template-based image segmentation and registration algorithms. Traditional deformable simulation methods, such as the use of analytic deformation fields or the displacement of landmarks followed by some form of interpolation, are often unable to construct rich (complex) and/or realistic deformations of anatomical organs. This paper presents new methods aiming to automatically simulate realistic inter- and intra-individual deformations. The paper first describes a statistical approach to capturing inter-individual variability of high-deformation fields from a number of examples (training samples). In this approach, Wavelet-Packet Transform (WPT) of the training deformations and their Jacobians, in conjunction with a Markov random field (MRF) spatial regularization, are used to capture both coarse and fine characteristics of the training deformations in a statistical fashion. Simulated deformations can then be constructed by randomly sampling the resultant statistical distribution in an unconstrained or a landmark-constrained fashion. The paper also describes a model for generating tissue atrophy or growth in order to simulate intra-individual brain deformations. Several sets of simulated deformation fields and respective images are generated, which can be used in the future for systematic and extensive validation studies of automated atlas-based segmentation and deformable registration methods. The code and simulated data are available through our Web site.

  1. Appearance-Based Multimodal Human Tracking and Identification for Healthcare in the Digital Home

    Directory of Open Access Journals (Sweden)

    Mau-Tsuen Yang

    2014-08-01

    Full Text Available There is an urgent need for intelligent home surveillance systems to provide home security, monitor health conditions, and detect emergencies of family members. One of the fundamental problems to realize the power of these intelligent services is how to detect, track, and identify people at home. Compared to RFID tags that need to be worn all the time, vision-based sensors provide a natural and nonintrusive solution. Observing that body appearance and body build, as well as face, provide valuable cues for human identification, we model and record multi-view faces, full-body colors and shapes of family members in an appearance database by using two Kinects located at a home’s entrance. Then the Kinects and another set of color cameras installed in other parts of the house are used to detect, track, and identify people by matching the captured color images with the registered templates in the appearance database. People are detected and tracked by multisensor fusion (Kinects and color cameras using a Kalman filter that can handle duplicate or partial measurements. People are identified by multimodal fusion (face, body appearance, and silhouette using a track-based majority voting. Moreover, the appearance-based human detection, tracking, and identification modules can cooperate seamlessly and benefit from each other. Experimental results show the effectiveness of the human tracking across multiple sensors and human identification considering the information of multi-view faces, full-body clothes, and silhouettes. The proposed home surveillance system can be applied to domestic applications in digital home security and intelligent healthcare.

  2. Appearance-based multimodal human tracking and identification for healthcare in the digital home.

    Science.gov (United States)

    Yang, Mau-Tsuen; Huang, Shen-Yen

    2014-08-05

    There is an urgent need for intelligent home surveillance systems to provide home security, monitor health conditions, and detect emergencies of family members. One of the fundamental problems to realize the power of these intelligent services is how to detect, track, and identify people at home. Compared to RFID tags that need to be worn all the time, vision-based sensors provide a natural and nonintrusive solution. Observing that body appearance and body build, as well as face, provide valuable cues for human identification, we model and record multi-view faces, full-body colors and shapes of family members in an appearance database by using two Kinects located at a home's entrance. Then the Kinects and another set of color cameras installed in other parts of the house are used to detect, track, and identify people by matching the captured color images with the registered templates in the appearance database. People are detected and tracked by multisensor fusion (Kinects and color cameras) using a Kalman filter that can handle duplicate or partial measurements. People are identified by multimodal fusion (face, body appearance, and silhouette) using a track-based majority voting. Moreover, the appearance-based human detection, tracking, and identification modules can cooperate seamlessly and benefit from each other. Experimental results show the effectiveness of the human tracking across multiple sensors and human identification considering the information of multi-view faces, full-body clothes, and silhouettes. The proposed home surveillance system can be applied to domestic applications in digital home security and intelligent healthcare.

  3. MOBILTEL - Mobile Multimodal Telecommunications dialogue system based on VoIP telephony

    Directory of Open Access Journals (Sweden)

    Anton Čižmár

    2009-10-01

    Full Text Available In this paper the project MobilTel ispresented. The communication itself is becoming amultimodal interactive process. The MobilTel projectprovides research and development activities inmultimodal interfaces area. The result is a functionalarchitecture for mobile multimodal telecommunicationsystem running on handheld device. The MobilTelcommunicator is a multimodal Slovak speech andgraphical interface with integrated VoIP client. Theother possible modalities are pen – touch screeninteraction, keyboard, and display on which theinformation is more user friendly presented (icons,emoticons, etc., and provides hyperlink and scrollingmenu availability.We describe the method of interaction between mobileterminal (PDA and MobilTel multimodal PCcommunicator over a VoIP WLAN connection basedon SIP protocol. We also present the graphicalexamples of services that enable users to obtaininformation about weather or information about trainconnection between two train stations.

  4. An optical tracker based robot registration and servoing method for ultrasound guided percutaneous renal access

    Science.gov (United States)

    2013-01-01

    over (0 ~ 100) mm. Conclusions The proposed optical tracker based robot registration and servoing method is capable of accurate three dimension needle operation for PRA procedure with improved precision and shortened time. PMID:23705678

  5. Multimodal analgesia versus traditional opiate based analgesia after cardiac surgery, a randomized controlled trial

    DEFF Research Database (Denmark)

    Rafiq, Sulman; Steinbrüchel, Daniel Andreas; Wanscher, Michael Jaeger

    2014-01-01

    significantly lower average pain scores from the day of surgery throughout the third postoperative day. Extensive nausea and vomiting, was found in no patient in the multimodal group but in 13 patients in the morphine group, p levels demonstrated a non....... 1, p = 0.31). 30-day mortality was 1 vs. 2, p = 0.54. CONCLUSIONS: In patients undergoing cardiac surgery, a multimodal regimen offered significantly better analgesia than a traditional opiate regimen. Nausea and vomiting complaints were significantly reduced. No safety issues were observed...

  6. Assessment of Eye Fatigue Caused by 3D Displays Based on Multimodal Measurements

    Directory of Open Access Journals (Sweden)

    Jae Won Bang

    2014-09-01

    Full Text Available With the development of 3D displays, user’s eye fatigue has been an important issue when viewing these displays. There have been previous studies conducted on eye fatigue related to 3D display use, however, most of these have employed a limited number of modalities for measurements, such as electroencephalograms (EEGs, biomedical signals, and eye responses. In this paper, we propose a new assessment of eye fatigue related to 3D display use based on multimodal measurements. compared to previous works Our research is novel in the following four ways: first, to enhance the accuracy of assessment of eye fatigue, we measure EEG signals, eye blinking rate (BR, facial temperature (FT, and a subjective evaluation (SE score before and after a user watches a 3D display; second, in order to accurately measure BR in a manner that is convenient for the user, we implement a remote gaze-tracking system using a high speed (mega-pixel camera that measures eye blinks of both eyes; thirdly, changes in the FT are measured using a remote thermal camera, which can enhance the measurement of eye fatigue, and fourth, we perform various statistical analyses to evaluate the correlation between the EEG signal, eye BR, FT, and the SE score based on the T-test, correlation matrix, and effect size. Results show that the correlation of the SE with other data (FT, BR, and EEG is the highest, while those of the FT, BR, and EEG with other data are second, third, and fourth highest, respectively.

  7. Nonmelanoma cutaneous cancers involving the skull base: outcomes of aggressive multimodal management.

    Science.gov (United States)

    Raza, Shaan M; Ramakrishna, Rohan; Weber, Randal S; Kupferman, Michael E; Gidley, Paul W; Hanna, Ehab Y; DeMonte, Franco

    2015-09-01

    A relative paucity of information exists regarding outcomes from craniofacial resection for advanced nonmelanoma skin cancers involving the skull base. In light of advances in surgical technique and adjuvant therapy protocols, the authors reviewed their surgical experience to determine disease control rates, overall survival (OS), morbidity, and mortality. A retrospective review of 24 patients with nonmelanoma cutaneous cancers with skull base involvement treated with craniofacial resection at The University of Texas MD Anderson Cancer Center from 1994 to 2012 was performed. Of these patients, 19 (79%) had squamous cell carcinoma (SCC), 4 (17%) had basosquamous carcinoma (BSCC), and 1 patient (4%) had adenocarcinoma. Factors as assessed were prior treatment, TNM staging, tumor involvement, extent of intracranial extension, margin status, postoperative complications, recurrence, disease status at last follow-up, and long-term survival. The majority of tumors were T4 (67%) according to the TNM classification; perineural extension was noted in 58%, cavernous sinus involvement in 25%, and dural involvement in 29%. Postoperative complications occurred in 4 patients (17%) including 1 death. Kaplan-Meier estimates were calculated for OS and progression-free survival (PFS). Median OS was 43.2 months with an 82% 1-year OS and 37% 5-year OS; the median PFS was 91.2 months. Margin status was positively associated with median OS in SCC (91 months [for negative margins] vs 57 months, p = 0.8) and in BSCC (23.7 vs 3.2 months, p management with surgery and postoperative radiotherapy can positively impact locoregional control and OS. With improvements in technique and adjuvant therapy protocols, treatment can still be considered in situations of perineural disease and cavernous sinus involvement and as a salvage option for patients in whom prior treatment has failed. As patients with advanced NMSCs often have few options, craniofacial resection, as part of a coordinated multimodal

  8. Automated assessment of diabetic retinopathy severity using content-based image retrieval in multimodal fundus photographs.

    Science.gov (United States)

    Quellec, Gwénolé; Lamard, Mathieu; Cazuguel, Guy; Bekri, Lynda; Daccache, Wissam; Roux, Christian; Cochener, Béatrice

    2011-10-21

    Recent studies on diabetic retinopathy (DR) screening in fundus photographs suggest that disagreements between algorithms and clinicians are now comparable to disagreements among clinicians. The purpose of this study is to (1) determine whether this observation also holds for automated DR severity assessment algorithms, and (2) show the interest of such algorithms in clinical practice. A dataset of 85 consecutive DR examinations (168 eyes, 1176 multimodal eye fundus photographs) was collected at Brest University Hospital (Brest, France). Two clinicians with different experience levels determined DR severity in each eye, according to the International Clinical Diabetic Retinopathy Disease Severity (ICDRS) scale. Based on Cohen's kappa (κ) measurements, the performance of clinicians at assessing DR severity was compared to the performance of state-of-the-art content-based image retrieval (CBIR) algorithms from our group. At assessing DR severity in each patient, intraobserver agreement was κ = 0.769 for the most experienced clinician. Interobserver agreement between clinicians was κ = 0.526. Interobserver agreement between the most experienced clinicians and the most advanced algorithm was κ = 0.592. Besides, the most advanced algorithm was often able to predict agreements and disagreements between clinicians. Automated DR severity assessment algorithms, trained to imitate experienced clinicians, can be used to predict when young clinicians would agree or disagree with their more experienced fellow members. Such algorithms may thus be used in clinical practice to help validate or invalidate their diagnoses. CBIR algorithms, in particular, may also be used for pooling diagnostic knowledge among peers, with applications in training and coordination of clinicians' prescriptions.

  9. M3BA: A Mobile, Modular, Multimodal Biosignal Acquisition Architecture for Miniaturized EEG-NIRS-Based Hybrid BCI and Monitoring.

    Science.gov (United States)

    von Luhmann, Alexander; Wabnitz, Heidrun; Sander, Tilmann; Muller, Klaus-Robert

    2017-06-01

    For the further development of the fields of telemedicine, neurotechnology, and brain-computer interfaces, advances in hybrid multimodal signal acquisition and processing technology are invaluable. Currently, there are no commonly available hybrid devices combining bioelectrical and biooptical neurophysiological measurements [here electroencephalography (EEG) and functional near-infrared spectroscopy (NIRS)]. Our objective was to design such an instrument in a miniaturized, customizable, and wireless form. We present here the design and evaluation of a mobile, modular, multimodal biosignal acquisition architecture (M3BA) based on a high-performance analog front-end optimized for biopotential acquisition, a microcontroller, and our openNIRS technology. The designed M3BA modules are very small configurable high-precision and low-noise modules (EEG input referred noise @ 500 SPS 1.39 μV pp , NIRS noise equivalent power NEP 750 nm = 5.92 pW pp , and NEP 850 nm = 4.77 pW pp ) with full input linearity, Bluetooth, 3-D accelerometer, and low power consumption. They support flexible user-specified biopotential reference setups and wireless body area/sensor network scenarios. Performance characterization and in-vivo experiments confirmed functionality and quality of the designed architecture. Telemedicine and assistive neurotechnology scenarios will increasingly include wearable multimodal sensors in the future. The M3BA architecture can significantly facilitate future designs for research in these and other fields that rely on customized mobile hybrid biosignal modal biosignal acquisition architecture (M3BA), multimodal, near-infrared spectroscopy (NIRS), wireless body area network (WBAN), wireless body sensor network (WBSN).

  10. Impact of Computed Tomography Image Quality on Image-Guided Radiation Therapy Based on Soft Tissue Registration

    International Nuclear Information System (INIS)

    Morrow, Natalya V.; Lawton, Colleen A.; Qi, X. Sharon; Li, X. Allen

    2012-01-01

    Purpose: In image-guided radiation therapy (IGRT), different computed tomography (CT) modalities with varying image quality are being used to correct for interfractional variations in patient set-up and anatomy changes, thereby reducing clinical target volume to the planning target volume (CTV-to-PTV) margins. We explore how CT image quality affects patient repositioning and CTV-to-PTV margins in soft tissue registration-based IGRT for prostate cancer patients. Methods and Materials: Four CT-based IGRT modalities used for prostate RT were considered in this study: MV fan beam CT (MVFBCT) (Tomotherapy), MV cone beam CT (MVCBCT) (MVision; Siemens), kV fan beam CT (kVFBCT) (CTVision, Siemens), and kV cone beam CT (kVCBCT) (Synergy; Elekta). Daily shifts were determined by manual registration to achieve the best soft tissue agreement. Effect of image quality on patient repositioning was determined by statistical analysis of daily shifts for 136 patients (34 per modality). Inter- and intraobserver variability of soft tissue registration was evaluated based on the registration of a representative scan for each CT modality with its corresponding planning scan. Results: Superior image quality with the kVFBCT resulted in reduced uncertainty in soft tissue registration during IGRT compared with other image modalities for IGRT. The largest interobserver variations of soft tissue registration were 1.1 mm, 2.5 mm, 2.6 mm, and 3.2 mm for kVFBCT, kVCBCT, MVFBCT, and MVCBCT, respectively. Conclusions: Image quality adversely affects the reproducibility of soft tissue-based registration for IGRT and necessitates a careful consideration of residual uncertainties in determining different CTV-to-PTV margins for IGRT using different image modalities.

  11. Entropy-Based Registration of Point Clouds Using Terrestrial Laser Scanning and Smartphone GPS

    Directory of Open Access Journals (Sweden)

    Maolin Chen

    2017-01-01

    Full Text Available Automatic registration of terrestrial laser scanning point clouds is a crucial but unresolved topic that is of great interest in many domains. This study combines terrestrial laser scanner with a smartphone for the coarse registration of leveled point clouds with small roll and pitch angles and height differences, which is a novel sensor combination mode for terrestrial laser scanning. The approximate distance between two neighboring scan positions is firstly calculated with smartphone GPS coordinates. Then, 2D distribution entropy is used to measure the distribution coherence between the two scans and search for the optimal initial transformation parameters. To this end, we propose a method called Iterative Minimum Entropy (IME to correct initial transformation parameters based on two criteria: the difference between the average and minimum entropy and the deviation from the minimum entropy to the expected entropy. Finally, the presented method is evaluated using two data sets that contain tens of millions of points from panoramic and non-panoramic, vegetation-dominated and building-dominated cases and can achieve high accuracy and efficiency.

  12. Installed Base Registration of Decentralised Solar Panels with Applications in Crisis Management

    Science.gov (United States)

    Aarsen, R.; Janssen, M.; Ramkisoen, M.; Biljecki, F.; Quak, W.; Verbree, E.

    2015-08-01

    In case of a calamity in the Netherlands - e.g. a dike breach - parts of the nationwide electric network can fall out. In these occasions it would be useful if decentralised energy sources of the Smart Grid would contribute to balance out the fluctuations of the energy network. Decentralised energy sources include: solar energy, wind energy, combined heat and power, and biogas. In this manner, parts of the built environment - e.g. hospitals - that are in need of a continuous power flow, could be secured of this power. When a calamity happens, information about the Smart Grid is necessary to control the crisis and to ensure a shared view on the energy networks for both the crisis managers and network operators. The current situation of publishing, storing and sharing data of solar energy has been shown a lack of reliability about the current number, physical location, and capacity of installed decentralised photovoltaic (PV) panels in the Netherlands. This study focuses on decentralised solar energy in the form of electricity via PV panels in the Netherlands and addresses this challenge by proposing a new, reliable and up-to-date database. The study reveals the requirements for a registration of the installed base of PV panels in the Netherlands. This new database should serve as a replenishment for the current national voluntary registration, called Production Installation Register of Energy Data Services Netherland (EDSN-PIR), of installed decentralised PV panel installations in the Smart Grid, and provide important information in case of a calamity.

  13. Sensors Based on Thin-Film Coated Cladding Removed Multimode Optical Fiber and Single-Mode Multimode Single-Mode Fiber: A Comparative Study

    Directory of Open Access Journals (Sweden)

    Ignacio Del Villar

    2015-01-01

    Full Text Available Two simple optical fibre structures that do not require the inscription of a grating, a cladding removed multimode optical fibre (CRMOF and a single-mode multimode single-mode structure (SMS, are compared in terms of their adequateness for sensing once they are coated with thin-films. The thin-film deposited (TiO2/PSS permits increasing the sensitivity to surrounding medium refractive index. The results obtained can be extrapolated to other fields such as biological or chemical sensing just by replacing the thin-film by a specific material.

  14. T-Spline Based Unifying Registration Procedure for Free-Form Surface Workpieces in Intelligent CMM

    Directory of Open Access Journals (Sweden)

    Zhenhua Han

    2017-10-01

    Full Text Available With the development of the modern manufacturing industry, the free-form surface is widely used in various fields, and the automatic detection of a free-form surface is an important function of future intelligent three-coordinate measuring machines (CMMs. To improve the intelligence of CMMs, a new visual system is designed based on the characteristics of CMMs. A unified model of the free-form surface is proposed based on T-splines. A discretization method of the T-spline surface formula model is proposed. Under this discretization, the position and orientation of the workpiece would be recognized by point cloud registration. A high accuracy evaluation method is proposed between the measured point cloud and the T-spline surface formula. The experimental results demonstrate that the proposed method has the potential to realize the automatic detection of different free-form surfaces and improve the intelligence of CMMs.

  15. Design of 1x2 wavelength demultiplexer based on multimode interference

    Czech Academy of Sciences Publication Activity Database

    Prajzler, Václav; Nekvindová, P.; Varga, Marián; Kromka, Alexander; Remeš, Zdeněk

    2014-01-01

    Roč. 16, 11-12 (2014), s. 1226-1231 ISSN 1454-4164 R&D Projects: GA ČR(CZ) GA14-05053S Institutional support: RVO:68378271 Keywords : demultiplexer * multimode interference * nanocrystalline diamond Subject RIV: BH - Optics, Masers, Lasers Impact factor: 0.429, year: 2014

  16. Cross Space: The Exploration of SNS-Based Writing Activities in a Multimodal Learning Environment

    Science.gov (United States)

    Lee, Kwang-Soon; Kim, Bong-Gyu

    2016-01-01

    This study explores the positive learning effect of formulating English sentences via Social Network Service (SNS; "Kakao-Talk") on less proficient L2 university students' (LPSs') writing, when the application is utilized as a tool to link in and out-of class activities in a multimodal-learning environment. Its objective is also to…

  17. Multimode Adaptable Microwave Radar Sensor Based on Leaky-Wave Antennas

    Czech Academy of Sciences Publication Activity Database

    Hudec, P.; Pánek, Petr; Jeník, V.

    2017-01-01

    Roč. 65, č. 9 (2017), s. 3464-3473 ISSN 0018-9480 Institutional support: RVO:67985882 Keywords : adaptable sensor * low-range radar * multimode sensor Subject RIV: JA - Electronics ; Optoelectronics, Electrical Engineering OBOR OECD: Electrical and electronic engineering Impact factor: 2.897, year: 2016

  18. Multimodal Voxel-Based Meta-Analysis of White Matter Abnormalities in Obsessive-Compulsive Disorder

    NARCIS (Netherlands)

    Radua, J.; Grau, M.; van den Heuvel, O.A.; Thiebaut de Schotten, M.; Stein, D.J.; Canales-Rodriguez, E.J.; Catani, M.; Mataix-Cols, D.

    2014-01-01

    White matter (WM) abnormalities have long been suspected in obsessive-compulsive disorder (OCD) but the available evidence has been inconsistent. We conducted the first multimodal meta-analysis of WM volume (WMV) and fractional anisotropy (FA) studies in OCD. All voxel-wise studies comparing WMV or

  19. Multimode Adaptable Microwave Radar Sensor Based on Leaky-Wave Antennas

    Czech Academy of Sciences Publication Activity Database

    Hudec, P.; Pánek, Petr; Jeník, V.

    2017-01-01

    Roč. 65, č. 9 (2017), s. 3464-3473 ISSN 0018-9480 Institutional support: RVO:67985882 Keywords : adaptable sensor * low-range radar * multimode sensor Subject RIV: JA - Electronics ; Optoelectronics, Electrical Engineering Impact factor: 2.897, year: 2016

  20. Metal complex-based templates and nanostructures for magnetic resonance/optical multimodal imaging agents

    NARCIS (Netherlands)

    Galindo Millan, Jealemy

    2012-01-01

    In this thesis, new approaches directed towards simple and functional imaging agents (IAs) for magnetic resonance (MR) and fluorescence multimodal imaging are proposed. In Chapter 3, hybrid silver nanostructures (hAgNSs), grown using a polyamino carboxylic acid scaffold, namely

  1. A simultaneous multimodal imaging system for tissue functional parameters

    Science.gov (United States)

    Ren, Wenqi; Zhang, Zhiwu; Wu, Qiang; Zhang, Shiwu; Xu, Ronald

    2014-02-01

    Simultaneous and quantitative assessment of skin functional characteristics in different modalities will facilitate diagnosis and therapy in many clinical applications such as wound healing. However, many existing clinical practices and multimodal imaging systems are subjective, qualitative, sequential for multimodal data collection, and need co-registration between different modalities. To overcome these limitations, we developed a multimodal imaging system for quantitative, non-invasive, and simultaneous imaging of cutaneous tissue oxygenation and blood perfusion parameters. The imaging system integrated multispectral and laser speckle imaging technologies into one experimental setup. A Labview interface was developed for equipment control, synchronization, and image acquisition. Advanced algorithms based on a wide gap second derivative reflectometry and laser speckle contrast analysis (LASCA) were developed for accurate reconstruction of tissue oxygenation and blood perfusion respectively. Quantitative calibration experiments and a new style of skinsimulating phantom were designed to verify the accuracy and reliability of the imaging system. The experimental results were compared with a Moor tissue oxygenation and perfusion monitor. For In vivo testing, a post-occlusion reactive hyperemia (PORH) procedure in human subject and an ongoing wound healing monitoring experiment using dorsal skinfold chamber models were conducted to validate the usability of our system for dynamic detection of oxygenation and perfusion parameters. In this study, we have not only setup an advanced multimodal imaging system for cutaneous tissue oxygenation and perfusion parameters but also elucidated its potential for wound healing assessment in clinical practice.

  2. Multimodality imaging of 131I uptake in nude mice thyroid based on Cerenkov radiation

    International Nuclear Information System (INIS)

    Hu Zhenhua; Liang Jimin; Qu Xiaochao; Yang Weidong; Ma Xiaowei; Wang Jing; Tian Jie

    2012-01-01

    Objective: To perform the multimodality 131 I thyroid imaging using Cerenkov luminescence tomography (CLT) and gamma imaging, and to compare the results of CLT and gamma imaging. Methods The nude mice (n=4, mass: (21 ±3) g) were injected with 1.67 ×10 7 Bq 131 I. CLT and gamma imaging were acquired at 0.5, 3, 12 and 24 h after the injection. Three-dimensional biodistribution of 131 I uptake in thyroid was reconstructed using Cerenkov source reconstruction method based on the diffusion equation (DE), and the reconstructed power of 131 I in different acquisition time points was obtained. Additionally, the ROIs were drawn over the gamma images of the mouse neck, and the counts were read. The correlation between the reconstructed power of CLT and gamma ray counts of gamma imaging was analyzed. Results: The power of 131 I uptake in thyroid at 0.5, 3, 12 and 24 h were 7.80 ×10 -13 , 1.62×10 -12 , 2.20×10 -12 and 2.68 × 10 -12 W, respectively. CLT results showed that reconstructed power increased with the increasing of acquisition time. Gamma imaging results indicated that 131 I uptake decreased in abdomen and increased in thyroid with the collection time. The results of CLT were consistent with that of gamma imaging (r 2 =0.7620, P<0.05). Conclusion: CLT has the potential to identify and monitor functioning thyroid tissue at before and (or) after 131 I treatment. (authors)

  3. Multimodal surface-based morphometry reveals diffuse cortical atrophy in traumatic brain injury.

    Directory of Open Access Journals (Sweden)

    Sorenson Donna J

    2009-12-01

    Full Text Available Abstract Background Patients with traumatic brain injury (TBI often present with significant cognitive deficits without corresponding evidence of cortical damage on neuroradiological examinations. One explanation for this puzzling observation is that the diffuse cortical abnormalities that characterize TBI are difficult to detect with standard imaging procedures. Here we investigated a patient with severe TBI-related cognitive impairments whose scan was interpreted as normal by a board-certified radiologist in order to determine if quantitative neuroimaging could detect cortical abnormalities not evident with standard neuroimaging procedures. Methods Cortical abnormalities were quantified using multimodal surfaced-based morphometry (MSBM that statistically combined information from high-resolution structural MRI and diffusion tensor imaging (DTI. Normal values of cortical anatomy and cortical and pericortical DTI properties were quantified in a population of 43 healthy control subjects. Corresponding measures from the patient were obtained in two independent imaging sessions. These data were quantified using both the average values for each lobe and the measurements from each point on the cortical surface. The results were statistically analyzed as z-scores from the mean with a p Results The TBI patient showed significant regional abnormalities in cortical thickness, gray matter diffusivity and pericortical white matter integrity that replicated across imaging sessions. Consistent with the patient's impaired performance on neuropsychological tests of executive function, cortical abnormalities were most pronounced in the frontal lobes. Conclusions MSBM is a promising tool for detecting subtle cortical abnormalities with high sensitivity and selectivity. MSBM may be particularly useful in evaluating cortical structure in TBI and other neurological conditions that produce diffuse abnormalities in both cortical structure and tissue properties.

  4. Multimodal MRI-based study in patients with SPG4 mutations.

    Directory of Open Access Journals (Sweden)

    Thiago J R Rezende

    Full Text Available Mutations in the SPG4 gene (SPG4-HSP are the most frequent cause of hereditary spastic paraplegia, but the extent of the neurodegeneration related to the disease is not yet known. Therefore, our objective is to identify regions of the central nervous system damaged in patients with SPG4-HSP using a multi-modal neuroimaging approach. In addition, we aimed to identify possible clinical correlates of such damage. Eleven patients (mean age 46.0 ± 15.0 years, 8 men with molecular confirmation of hereditary spastic paraplegia, and 23 matched healthy controls (mean age 51.4 ± 14.1years, 17 men underwent MRI scans in a 3T scanner. We used 3D T1 images to perform volumetric measurements of the brain and spinal cord. We then performed tract-based spatial statistics and tractography analyses of diffusion tensor images to assess microstructural integrity of white matter tracts. Disease severity was quantified with the Spastic Paraplegia Rating Scale. Correlations were then carried out between MRI metrics and clinical data. Volumetric analyses did not identify macroscopic abnormalities in the brain of hereditary spastic paraplegia patients. In contrast, we found extensive fractional anisotropy reduction in the corticospinal tracts, cingulate gyri and splenium of the corpus callosum. Spinal cord morphometry identified atrophy without flattening in the group of patients with hereditary spastic paraplegia. Fractional anisotropy of the corpus callosum and pyramidal tracts did correlate with disease severity. Hereditary spastic paraplegia is characterized by relative sparing of the cortical mantle and remarkable damage to the distal portions of the corticospinal tracts, extending into the spinal cord.

  5. MR/PET quantification tools: Registration, segmentation, classification, and MR-based attenuation correction

    Energy Technology Data Exchange (ETDEWEB)

    Fei, Baowei, E-mail: bfei@emory.edu [Department of Radiology and Imaging Sciences, Emory University School of Medicine, 1841 Clifton Road Northeast, Atlanta, Georgia 30329 (United States); Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, Georgia 30322 (United States); Department of Mathematics and Computer Sciences, Emory University, Atlanta, Georgia 30322 (United States); Yang, Xiaofeng; Nye, Jonathon A.; Raghunath, Nivedita; Votaw, John R. [Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Georgia 30329 (United States); Aarsvold, John N. [Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Georgia 30329 (United States); Nuclear Medicine Service, Atlanta Veterans Affairs Medical Center, Atlanta, Georgia 30033 (United States); Cervo, Morgan; Stark, Rebecca [The Medical Physics Graduate Program in the George W. Woodruff School, Georgia Institute of Technology, Atlanta, Georgia 30332 (United States); Meltzer, Carolyn C. [Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Georgia 30329 (United States); Department of Neurology and Department of Psychiatry and Behavior Sciences, Emory University School of Medicine, Atlanta, Georgia 30322 (United States)

    2012-10-15

    Purpose: Combined MR/PET is a relatively new, hybrid imaging modality. A human MR/PET prototype system consisting of a Siemens 3T Trio MR and brain PET insert was installed and tested at our institution. Its present design does not offer measured attenuation correction (AC) using traditional transmission imaging. This study is the development of quantification tools including MR-based AC for quantification in combined MR/PET for brain imaging. Methods: The developed quantification tools include image registration, segmentation, classification, and MR-based AC. These components were integrated into a single scheme for processing MR/PET data. The segmentation method is multiscale and based on the Radon transform of brain MR images. It was developed to segment the skull on T1-weighted MR images. A modified fuzzy C-means classification scheme was developed to classify brain tissue into gray matter, white matter, and cerebrospinal fluid. Classified tissue is assigned an attenuation coefficient so that AC factors can be generated. PET emission data are then reconstructed using a three-dimensional ordered sets expectation maximization method with the MR-based AC map. Ten subjects had separate MR and PET scans. The PET with [{sup 11}C]PIB was acquired using a high-resolution research tomography (HRRT) PET. MR-based AC was compared with transmission (TX)-based AC on the HRRT. Seventeen volumes of interest were drawn manually on each subject image to compare the PET activities between the MR-based and TX-based AC methods. Results: For skull segmentation, the overlap ratio between our segmented results and the ground truth is 85.2 ± 2.6%. Attenuation correction results from the ten subjects show that the difference between the MR and TX-based methods was <6.5%. Conclusions: MR-based AC compared favorably with conventional transmission-based AC. Quantitative tools including registration, segmentation, classification, and MR-based AC have been developed for use in combined MR/PET.

  6. Registration Service

    CERN Multimedia

    GS Department

    2010-01-01

    Following a reorganization in Building 55, please note that the Registration Service is now organised as follows :  Ground floor: access cards (76903). 1st floor : registration of external firms’ personnel (76611 / 76622); car access stickers (76633); biometric registration (79710). Opening hours: 07-30 to 16-00 non-stop. GS-SEM Group General Infrastructure Services Department

  7. SU-F-I-50: Finite Element-Based Deformable Image Registration of Lung and Heart

    Energy Technology Data Exchange (ETDEWEB)

    Penjweini, R [University of Pennsylvania, Philadelphia, Pennsylvania (United States); Kim, M [University of Pennsylvania, Philadelphia, PA (United States); Zhu, T [University Pennsylvania, Philadelphia, PA (United States)

    2016-06-15

    Purpose: Photodynamic therapy (PDT) is used after surgical resection to treat the microscopic disease for malignant pleural mesothelioma and to increase survival rates. Although accurate light delivery is imperative to PDT efficacy, the deformation of the pleural volume during the surgery impacts the delivered light dose. To facilitate treatment planning, we use a finite-element-based (FEM) deformable image registration to quantify the anatomical variation of lung and heart volumes between CT pre-(or post-) surgery and surface contours obtained during PDT using an infrared camera-based navigation system (NDI). Methods: NDI is used during PDT to obtain the information of the cumulative light fluence on every cavity surface point that is being treated. A wand, comprised of a modified endotrachial tube filled with Intralipid and an optical fiber inside the tube, is used to deliver the light during PDT. The position of the treatment is tracked using an attachment with nine reflective passive markers that are seen by the NDI system. Then, the position points are plotted as three-dimensional volume of the pleural cavity using Matlab and Meshlab. A series of computed tomography (CT) scans of the lungs and heart, in the same patient, are also acquired before and after the surgery. The NDI and CT contours are imported into COMSOL Multiphysics, where the FEM-based deformable image registration is obtained. The NDI and CT contours acquired during and post-PDT are considered as the reference, and the Pre-PDT CT contours are used as the target, which will be deformed. Results: Anatomical variation of the lung and heart volumes, taken at different times from different imaging devices, was determined by using our model. The resulting three-dimensional deformation map along x, y and z-axes was obtained. Conclusion: Our model fuses images acquired by different modalities and provides insights into the variation in anatomical structures over time.

  8. Multi-atlas segmentation with particle-based group-wise image registration.

    Science.gov (United States)

    Lee, Joohwi; Lyu, Ilwoo; Styner, Martin

    2014-03-21

    We propose a novel multi-atlas segmentation method that employs a group-wise image registration method for the brain segmentation on rodent magnetic resonance (MR) images. The core element of the proposed segmentation is the use of a particle-guided image registration method that extends the concept of particle correspondence into the volumetric image domain. The registration method performs a group-wise image registration that simultaneously registers a set of images toward the space defined by the average of particles. The particle-guided image registration method is robust with low signal-to-noise ratio images as well as differing sizes and shapes observed in the developing rodent brain. Also, the use of an implicit common reference frame can prevent potential bias induced by the use of a single template in the segmentation process. We show that the use of a particle guided-image registration method can be naturally extended to a novel multi-atlas segmentation method and improves the registration method to explicitly use the provided template labels as an additional constraint. In the experiment, we show that our segmentation algorithm provides more accuracy with multi-atlas label fusion and stability against pair-wise image registration. The comparison with previous group-wise registration method is provided as well.

  9. A GPU-based symmetric non-rigid image registration method in human lung.

    Science.gov (United States)

    Haghighi, Babak; D Ellingwood, Nathan; Yin, Youbing; Hoffman, Eric A; Lin, Ching-Long

    2018-03-01

    Quantitative computed tomography (QCT) of the lungs plays an increasing role in identifying sub-phenotypes of pathologies previously lumped into broad categories such as chronic obstructive pulmonary disease and asthma. Methods for image matching and linking multiple lung volumes have proven useful in linking structure to function and in the identification of regional longitudinal changes. Here, we seek to improve the accuracy of image matching via the use of a symmetric multi-level non-rigid registration employing an inverse consistent (IC) transformation whereby images are registered both in the forward and reverse directions. To develop the symmetric method, two similarity measures, the sum of squared intensity difference (SSD) and the sum of squared tissue volume difference (SSTVD), were used. The method is based on a novel generic mathematical framework to include forward and backward transformations, simultaneously, eliminating the need to compute the inverse transformation. Two implementations were used to assess the proposed method: a two-dimensional (2-D) implementation using synthetic examples with SSD, and a multi-core CPU and graphics processing unit (GPU) implementation with SSTVD for three-dimensional (3-D) human lung datasets (six normal adults studied at total lung capacity (TLC) and functional residual capacity (FRC)). Success was evaluated in terms of the IC transformation consistency serving to link TLC to FRC. 2-D registration on synthetic images, using both symmetric and non-symmetric SSD methods, and comparison of displacement fields showed that the symmetric method gave a symmetrical grid shape and reduced IC errors, with the mean values of IC errors decreased by 37%. Results for both symmetric and non-symmetric transformations of human datasets showed that the symmetric method gave better results for IC errors in all cases, with mean values of IC errors for the symmetric method lower than the non-symmetric methods using both SSD and SSTVD

  10. Multi-feature-based plaque characterization in ex vivo MRI trained by registration to 3D histology

    International Nuclear Information System (INIS)

    Van Engelen, Arna; Niessen, Wiro J; Klein, Stefan; De Bruijne, Marleen; Groen, Harald C; Wentzel, Jolanda J; Verhagen, Hence JM; Lugt, Aad van der

    2012-01-01

    We present a new method for automated characterization of atherosclerotic plaque composition in ex vivo MRI. It uses MRI intensities as well as four other types of features: smoothed, gradient magnitude and Laplacian images at several scales, and the distances to the lumen and outer vessel wall. The ground truth for fibrous, necrotic and calcified tissue was provided by histology and μCT in 12 carotid plaque specimens. Semi-automatic registration of a 3D stack of histological slices and μCT images to MRI allowed for 3D rotations and in-plane deformations of histology. By basing voxelwise classification on different combinations of features, we evaluated their relative importance. To establish whether training by 3D registration yields different results than training by 2D registration, we determined plaque composition using (1) a 2D slice-based registration approach for three manually selected MRI and histology slices per specimen, and (2) an approach that uses only the three corresponding MRI slices from the 3D-registered volumes. Voxelwise classification accuracy was best when all features were used (73.3 ± 6.3%) and was significantly better than when only original intensities and distance features were used (Friedman, p < 0.05). Although 2D registration or selection of three slices from the 3D set slightly decreased accuracy, these differences were non-significant. (paper)

  11. Segmentation and quantification of the aortic arch using joint 3D model-based segmentation and elastic image registration.

    Science.gov (United States)

    Biesdorf, Andreas; Rohr, Karl; Feng, Duan; von Tengg-Kobligk, Hendrik; Rengier, Fabian; Böckler, Dittmar; Kauczor, Hans-Ulrich; Wörz, Stefan

    2012-08-01

    Accurate quantification of the morphology of vessels is important for diagnosis and treatment of cardiovascular diseases. We introduce a new joint segmentation and registration approach for the quantification of the aortic arch morphology that combines 3D model-based segmentation with elastic image registration. With this combination, the approach benefits from the robustness of model-based segmentation and the accuracy of elastic registration. The approach can cope with a large spectrum of vessel shapes and particularly with pathological shapes that deviate significantly from the underlying model used for segmentation. The performance of the approach has been evaluated on the basis of 3D synthetic images, 3D phantom data, and clinical 3D CTA images including pathologies. We also performed a quantitative comparison with previous approaches. Copyright © 2012 Elsevier B.V. All rights reserved.

  12. One registration multi-atlas-based pseudo-CT generation for attenuation correction in PET/MRI

    DEFF Research Database (Denmark)

    Arabi, H.; Zaidi, H.

    2016-01-01

    Purpose: The outcome of a detailed assessment of various strategies for atlas-based whole-body bone segmentation from magnetic resonance imaging (MRI) was exploited to select the optimal parameters and setting, with the aim of proposing a novel one-registration multi-atlas (ORMA) pseudo-CT genera......Purpose: The outcome of a detailed assessment of various strategies for atlas-based whole-body bone segmentation from magnetic resonance imaging (MRI) was exploited to select the optimal parameters and setting, with the aim of proposing a novel one-registration multi-atlas (ORMA) pseudo...... regarding the accuracy of extracted bone using the different techniques demonstrated the superiority of the VWW atlas fusion algorithm achieving a Dice similarity measure of 0.82 ± 0.04 compared to arithmetic averaging atlas fusion (0.60 ± 0.02), which uses conventional direct registration. Application...

  13. A robust cloud registration method based on redundant data reduction using backpropagation neural network and shift window

    Science.gov (United States)

    Xin, Meiting; Li, Bing; Yan, Xiao; Chen, Lei; Wei, Xiang

    2018-02-01

    A robust coarse-to-fine registration method based on the backpropagation (BP) neural network and shift window technology is proposed in this study. Specifically, there are three steps: coarse alignment between the model data and measured data, data simplification based on the BP neural network and point reservation in the contour region of point clouds, and fine registration with the reweighted iterative closest point algorithm. In the process of rough alignment, the initial rotation matrix and the translation vector between the two datasets are obtained. After performing subsequent simplification operations, the number of points can be reduced greatly. Therefore, the time and space complexity of the accurate registration can be significantly reduced. The experimental results show that the proposed method improves the computational efficiency without loss of accuracy.

  14. Co-registration of the BNCT treatment planning images for clinical practice

    International Nuclear Information System (INIS)

    Salli, Eero; Seppaelae, Tiina; Kankaanranta, Leena; Asikainen, Sami; Savolainen, Sauli; Koivunoro, Hanna

    2006-01-01

    We have co-registered MRI, CT and FBPA-PET images for BNCT in clinical practice. Co-registration improves the spatial accuracy of the treatment planning by enabling use of information from all the co-registered modalities. The multimodal co-registration has been implemented as a service product provided by the Imaging Center of Helsinki University Central Hospital to other departments. To increase the accuracy of co-registration and patient positioning in the head area BNCT, a patient-specific fixation mask suitable for PET, MRI and CT was developed. The goal of the fixation mask is to normalize the orientation of the patient's head and neck. Co-registration is performed at the image processing unit by using a rigid body model, mutual-information based algorithms and partly in-house developed software tools. The accuracy of co-registration is verified by comparing the locations of the external skin markers and anatomical landmarks in different modalities. After co-registration, the images are transformed and covered into a format required by the BNCT dose-planning software and set to the dose-planning unit of the hospital. So far co-registration has been done for 22 patients. The co-registration protocol has proved to be reliable and efficient. Some registration errors are seen on some patients in the neck area because the rigid-body model used in co-registration is not fully valid for the brain-neck entity. The registration accuracy in this area could likely be improved by implementing a co-registration procedure utilizing a partly non-rigid body model. (author)

  15. Normalized Total Gradient: A New Measure for Multispectral Image Registration

    Science.gov (United States)

    Chen, Shu-Jie; Shen, Hui-Liang; Li, Chunguang; Xin, John H.

    2018-03-01

    Image registration is a fundamental issue in multispectral image processing. In filter wheel based multispectral imaging systems, the non-coplanar placement of the filters always causes the misalignment of multiple channel images. The selective characteristic of spectral response in multispectral imaging raises two challenges to image registration. First, the intensity levels of a local region may be different in individual channel images. Second, the local intensity may vary rapidly in some channel images while keeps stationary in others. Conventional multimodal measures, such as mutual information, correlation coefficient, and correlation ratio, can register images with different regional intensity levels, but will fail in the circumstance of severe local intensity variation. In this paper, a new measure, namely normalized total gradient (NTG), is proposed for multispectral image registration. The NTG is applied on the difference between two channel images. This measure is based on the key assumption (observation) that the gradient of difference image between two aligned channel images is sparser than that between two misaligned ones. A registration framework, which incorporates image pyramid and global/local optimization, is further introduced for rigid transform. Experimental results validate that the proposed method is effective for multispectral image registration and performs better than conventional methods.

  16. SU-E-J-112: Intensity-Based Pulmonary Image Registration: An Evaluation Study

    Energy Technology Data Exchange (ETDEWEB)

    Yang, F; Meyer, J; Sandison, G [Department of Radiation Oncology, University of Washington Medical Center, Seattle, WA (United States)

    2015-06-15

    Purpose: Accurate alignment of thoracic CT images is essential for dose tracking and to safely implement adaptive radiotherapy in lung cancers. At the same time it is challenging given the highly elastic nature of lung tissue deformations. The objective of this study was to assess the performances of three state-of-art intensity-based algorithms in terms of their ability to register thoracic CT images subject to affine, barrel, and sinusoid transformation. Methods: Intensity similarity measures of the evaluated algorithms contained sum-of-squared difference (SSD), local mutual information (LMI), and residual complexity (RC). Five thoracic CT scans obtained from the EMPIRE10 challenge database were included and served as reference images. Each CT dataset was distorted by realistic affine, barrel, and sinusoid transformations. Registration performances of the three algorithms were evaluated for each distortion type in terms of intensity root mean square error (IRMSE) between the reference and registered images in the lung regions. Results: For affine distortions, the three algorithms differed significantly in registration of thoracic images both visually and nominally in terms of IRMSE with a mean of 0.011 for SSD, 0.039 for RC, and 0.026 for LMI (p<0.01; Kruskal-Wallis test). For barrel distortion, the three algorithms showed nominally no significant difference in terms of IRMSE with a mean of 0.026 for SSD, 0.086 for RC, and 0.054 for LMI (p=0.16) . A significant difference was seen for sinusoid distorted thoracic CT data with mean lung IRMSE of 0.039 for SSD, 0.092 for RC, and 0.035 for LMI (p=0.02). Conclusion: Pulmonary deformations might vary to a large extent in nature in a daily clinical setting due to factors ranging from anatomy variations to respiratory motion to image quality. It can be appreciated from the results of the present study that the suitability of application of a particular algorithm for pulmonary image registration is deformation-dependent.

  17. 75 FR 77305 - Security-Based Swap Data Repository Registration, Duties, and Core Principles

    Science.gov (United States)

    2010-12-10

    ... Repository Registration, Duties, and Core Principles; Proposed Rule #0;#0;Federal Register / Vol. 75 , No... Swap Data Repository Registration, Duties, and Core Principles AGENCY: Securities and Exchange... process, duties, and core principles. DATES: Comments should be submitted on or before January 24, 2011...

  18. Incidence of unintentional injuries in farming based on one year of weekly registration in Danish farms

    DEFF Research Database (Denmark)

    Rasmussen, K; Carstensen, Ole; Lauritsen, J M

    2000-01-01

    In Denmark, farming ranks as the industry with the highest incidence rate of fatal injuries. For nonfatal injuries, insufficient registration practices prevent valid comparisons between occupations. This study examines the occurrence of farm accidents and injuries, as well as work-specific factors......, via weekly registration in a representative sample of 393 farms in one county during 1 year....

  19. Multimodal Definition:

    African Journals Online (AJOL)

    user

    booming as a common tool of language learning and use. In the field of e-lexi- cography, such ... defining, as indicated under the entry of definition in Oxford Advanced Learner's. Dictionary of Current English (the ... In the above-mentioned context, this article argues for the establishment of the notion of multimodal definition ...

  20. Temperature sensing based on multimodal interference in polymer optical fibers: Room-temperature sensitivity enhancement by annealing

    Science.gov (United States)

    Kawa, Tomohito; Numata, Goki; Lee, Heeyoung; Hayashi, Neisei; Mizuno, Yosuke; Nakamura, Kentaro

    2017-07-01

    To date, we have developed a temperature sensor based on multimodal interference in a polymer optical fiber (POF) with an extremely high sensitivity. Here, we experimentally evaluate the influence of annealing (heat treatment) of the POF on the temperature sensitivity at room temperature. We show that the temperature sensitivity is enhanced with increasing annealing temperature, and that, by annealing the POF at 90 °C, we can achieve a temperature sensitivity of +2.17 nm/°C, which is 2.9 times larger than that without annealing (+0.75 nm/°C).

  1. Spatial Frequency Multiplexing of Fiber-Optic Interferometric Refractive Index Sensors Based on Graded-Index Multimode Fibers

    Science.gov (United States)

    Liu, Li; Gong, Yuan; Wu, Yu; Zhao, Tian; Wu, Hui-Juan; Rao, Yun-Jiang

    2012-01-01

    Fiber-optic interferometric sensors based on graded-index multimode fibers have very high refractive-index sensitivity, as we previously demonstrated. In this paper, spatial-frequency multiplexing of this type of fiber-optic refractive index sensors is investigated. It is estimated that multiplexing of more than 10 such sensors is possible. In the multiplexing scheme, one of the sensors is used to investigate the refractive index and temperature responses. The fast Fourier transform (FFT) of the combined reflective spectra is analyzed. The intensity of the FFT spectra is linearly related with the refractive index and is not sensitive to the temperature.

  2. Registration of Vehicle-Borne Point Clouds and Panoramic Images Based on Sensor Constellations.

    Science.gov (United States)

    Yao, Lianbi; Wu, Hangbin; Li, Yayun; Meng, Bin; Qian, Jinfei; Liu, Chun; Fan, Hongchao

    2017-04-11

    A mobile mapping system (MMS) is usually utilized to collect environmental data on and around urban roads. Laser scanners and panoramic cameras are the main sensors of an MMS. This paper presents a new method for the registration of the point clouds and panoramic images based on sensor constellation. After the sensor constellation was analyzed, a feature point, the intersection of the connecting line between the global positioning system (GPS) antenna and the panoramic camera with a horizontal plane, was utilized to separate the point clouds into blocks. The blocks for the central and sideward laser scanners were extracted with the segmentation feature points. Then, the point clouds located in the blocks were separated from the original point clouds. Each point in the blocks was used to find the accurate corresponding pixel in the relative panoramic images via a collinear function, and the position and orientation relationship amongst different sensors. A search strategy is proposed for the correspondence of laser scanners and lenses of panoramic cameras to reduce calculation complexity and improve efficiency. Four cases of different urban road types were selected to verify the efficiency and accuracy of the proposed method. Results indicate that most of the point clouds (with an average of 99.7%) were successfully registered with the panoramic images with great efficiency. Geometric evaluation results indicate that horizontal accuracy was approximately 0.10-0.20 m, and vertical accuracy was approximately 0.01-0.02 m for all cases. Finally, the main factors that affect registration accuracy, including time synchronization amongst different sensors, system positioning and vehicle speed, are discussed.

  3. INSTALLED BASE REGISTRATION OF DECENTRALISED SOLAR PANELS WITH APPLICATIONS IN CRISIS MANAGEMENT

    Directory of Open Access Journals (Sweden)

    R. Aarsen

    2015-08-01

    Full Text Available In case of a calamity in the Netherlands - e.g. a dike breach - parts of the nationwide electric network can fall out. In these occasions it would be useful if decentralised energy sources of the Smart Grid would contribute to balance out the fluctuations of the energy network. Decentralised energy sources include: solar energy, wind energy, combined heat and power, and biogas. In this manner, parts of the built environment - e.g. hospitals - that are in need of a continuous power flow, could be secured of this power. When a calamity happens, information about the Smart Grid is necessary to control the crisis and to ensure a shared view on the energy networks for both the crisis managers and network operators. The current situation of publishing, storing and sharing data of solar energy has been shown a lack of reliability about the current number, physical location, and capacity of installed decentralised photovoltaic (PV panels in the Netherlands. This study focuses on decentralised solar energy in the form of electricity via PV panels in the Netherlands and addresses this challenge by proposing a new, reliable and up-to-date database. The study reveals the requirements for a registration of the installed base of PV panels in the Netherlands. This new database should serve as a replenishment for the current national voluntary registration, called Production Installation Register of Energy Data Services Netherland (EDSN-PIR, of installed decentralised PV panel installations in the Smart Grid, and provide important information in case of a calamity.

  4. Finding a Good Feature Detector-Descriptor Combination for the 2d Keypoint-Based Registration of Tls Point Clouds

    Science.gov (United States)

    Urban, S.; Weinmann, M.

    2015-08-01

    The automatic and accurate registration of terrestrial laser scanning (TLS) data is a topic of great interest in the domains of city modeling, construction surveying or cultural heritage. While numerous of the most recent approaches focus on keypoint-based point cloud registration relying on forward-projected 2D keypoints detected in panoramic intensity images, little attention has been paid to the selection of appropriate keypoint detector-descriptor combinations. Instead, keypoints are commonly detected and described by applying well-known methods such as the Scale Invariant Feature Transform (SIFT) or Speeded-Up Robust Features (SURF). In this paper, we present a framework for evaluating the influence of different keypoint detector-descriptor combinations on the results of point cloud registration. For this purpose, we involve five different approaches for extracting local features from the panoramic intensity images and exploit the range information of putative feature correspondences in order to define bearing vectors which, in turn, may be exploited to transfer the task of point cloud registration from the object space to the observation space. With an extensive evaluation of our framework on a standard benchmark TLS dataset, we clearly demonstrate that replacing SIFT and SURF detectors and descriptors by more recent approaches significantly alleviates point cloud registration in terms of accuracy, efficiency and robustness.

  5. TPS-HAMMER: improving HAMMER registration algorithm by soft correspondence matching and thin-plate splines based deformation interpolation.

    Science.gov (United States)

    Wu, Guorong; Yap, Pew-Thian; Kim, Minjeong; Shen, Dinggang

    2010-02-01

    We present an improved MR brain image registration algorithm, called TPS-HAMMER, which is based on the concepts of attribute vectors and hierarchical landmark selection scheme proposed in the highly successful HAMMER registration algorithm. We demonstrate that TPS-HAMMER algorithm yields better registration accuracy, robustness, and speed over HAMMER owing to (1) the employment of soft correspondence matching and (2) the utilization of thin-plate splines (TPS) for sparse-to-dense deformation field generation. These two aspects can be integrated into a unified framework to refine the registration iteratively by alternating between soft correspondence matching and dense deformation field estimation. Compared with HAMMER, TPS-HAMMER affords several advantages: (1) unlike the Gaussian propagation mechanism employed in HAMMER, which can be slow and often leaves unreached blotches in the deformation field, the deformation interpolation in the non-landmark points can be obtained immediately with TPS in our algorithm; (2) the smoothness of deformation field is preserved due to the nice properties of TPS; (3) possible misalignments can be alleviated by allowing the matching of the landmarks with a number of possible candidate points and enforcing more exact matches in the final stages of the registration. Extensive experiments have been conducted, using the original HAMMER as a comparison baseline, to validate the merits of TPS-HAMMER. The results show that TPS-HAMMER yields significant improvement in both accuracy and speed, indicating high applicability for the clinical scenario. Copyright (c) 2009 Elsevier Inc. All rights reserved.

  6. MRI to X-ray mammography intensity-based registration with simultaneous optimisation of pose and biomechanical transformation parameters

    NARCIS (Netherlands)

    Mertzanidou, T.; Hipwell, J.; Johnsen, S.; Han, L.; Eiben, B.; Taylor, Z.; Ourselin, S.; Huisman, H.; Mann, R.; Bick, U.; Karssemeijer, N.; Hawkes, D.

    2014-01-01

    Determining corresponding regions between an MRI and an X-ray mammogram is a clinically useful task that is challenging for radiologists due to the large deformation that the breast undergoes between the two image acquisitions. In this work we propose an intensity-based image registration framework,

  7. Improving Intensity-Based Lung CT Registration Accuracy Utilizing Vascular Information

    Directory of Open Access Journals (Sweden)

    Kunlin Cao

    2012-01-01

    Full Text Available Accurate pulmonary image registration is a challenging problem when the lungs have a deformation with large distance. In this work, we present a nonrigid volumetric registration algorithm to track lung motion between a pair of intrasubject CT images acquired at different inflation levels and introduce a new vesselness similarity cost that improves intensity-only registration. Volumetric CT datasets from six human subjects were used in this study. The performance of four intensity-only registration algorithms was compared with and without adding the vesselness similarity cost function. Matching accuracy was evaluated using landmarks, vessel tree, and fissure planes. The Jacobian determinant of the transformation was used to reveal the deformation pattern of local parenchymal tissue. The average matching error for intensity-only registration methods was on the order of 1 mm at landmarks and 1.5 mm on fissure planes. After adding the vesselness preserving cost function, the landmark and fissure positioning errors decreased approximately by 25% and 30%, respectively. The vesselness cost function effectively helped improve the registration accuracy in regions near thoracic cage and near the diaphragm for all the intensity-only registration algorithms tested and also helped produce more consistent and more reliable patterns of regional tissue deformation.

  8. 3D-2D Deformable Image Registration Using Feature-Based Nonuniform Meshes.

    Science.gov (United States)

    Zhong, Zichun; Guo, Xiaohu; Cai, Yiqi; Yang, Yin; Wang, Jing; Jia, Xun; Mao, Weihua

    2016-01-01

    By using prior information of planning CT images and feature-based nonuniform meshes, this paper demonstrates that volumetric images can be efficiently registered with a very small portion of 2D projection images of a Cone-Beam Computed Tomography (CBCT) scan. After a density field is computed based on the extracted feature edges from planning CT images, nonuniform tetrahedral meshes will be automatically generated to better characterize the image features according to the density field; that is, finer meshes are generated for features. The displacement vector fields (DVFs) are specified at the mesh vertices to drive the deformation of original CT images. Digitally reconstructed radiographs (DRRs) of the deformed anatomy are generated and compared with corresponding 2D projections. DVFs are optimized to minimize the objective function including differences between DRRs and projections and the regularity. To further accelerate the above 3D-2D registration, a procedure to obtain good initial deformations by deforming the volume surface to match 2D body boundary on projections has been developed. This complete method is evaluated quantitatively by using several digital phantoms and data from head and neck cancer patients. The feature-based nonuniform meshing method leads to better results than either uniform orthogonal grid or uniform tetrahedral meshes.

  9. 3D-2D Deformable Image Registration Using Feature-Based Nonuniform Meshes

    Directory of Open Access Journals (Sweden)

    Zichun Zhong

    2016-01-01

    Full Text Available By using prior information of planning CT images and feature-based nonuniform meshes, this paper demonstrates that volumetric images can be efficiently registered with a very small portion of 2D projection images of a Cone-Beam Computed Tomography (CBCT scan. After a density field is computed based on the extracted feature edges from planning CT images, nonuniform tetrahedral meshes will be automatically generated to better characterize the image features according to the density field; that is, finer meshes are generated for features. The displacement vector fields (DVFs are specified at the mesh vertices to drive the deformation of original CT images. Digitally reconstructed radiographs (DRRs of the deformed anatomy are generated and compared with corresponding 2D projections. DVFs are optimized to minimize the objective function including differences between DRRs and projections and the regularity. To further accelerate the above 3D-2D registration, a procedure to obtain good initial deformations by deforming the volume surface to match 2D body boundary on projections has been developed. This complete method is evaluated quantitatively by using several digital phantoms and data from head and neck cancer patients. The feature-based nonuniform meshing method leads to better results than either uniform orthogonal grid or uniform tetrahedral meshes.

  10. TH-CD-206-09: Learning-Based MRI-CT Prostate Registration Using Spare Patch-Deformation Dictionary

    International Nuclear Information System (INIS)

    Yang, X; Jani, A; Rossi, P; Mao, H; Curran, W; Liu, T

    2016-01-01

    Purpose: To enable MRI-guided prostate radiotherapy, MRI-CT deformable registration is required to map the MRI-defined tumor and key organ contours onto the CT images. Due to the intrinsic differences in grey-level intensity characteristics between MRI and CT images, the integration of MRI into CT-based radiotherapy is very challenging. We are developing a learning-based registration approach to address this technical challenge. Methods: We propose to estimate the deformation between MRI and CT images in a patch-wise fashion by using the sparse representation technique. Specifically, we assume that two image patches should follow the same deformation if their patch-wise appearance patterns are similar. We first extract a set of key points in the new CT image. Then, for each key point, we adaptively construct a coupled dictionary from the training MRI-CT images, where each coupled element includes both appearance and deformation of the same image patch. After calculating the sparse coefficients in representing the patch appearance of each key point based on the constructed dictionary, we can predict the deformation for this point by applying the same sparse coefficients to the respective deformations in the dictionary. Results: This registration technique was validated with 10 prostate-cancer patients’ data and its performance was compared with the commonly used free-form-deformation-based registration. Several landmarks in both images were identified to evaluate the accuracy of our approach. Overall, the averaged target registration error of the intensity-based registration and the proposed method was 3.8±0.4 mm and 1.9±0.3 mm, respectively. Conclusion: We have developed a novel prostate MR-CT registration approach based on patch-deformation dictionary, demonstrated its clinical feasibility, and validated its accuracy. This technique will either reduce or compensate for the effect of patient-specific treatment variation measured during the course of

  11. A Registration Method Based on Contour Point Cloud for 3D Whole-Body PET and CT Images

    Directory of Open Access Journals (Sweden)

    Zhiying Song

    2017-01-01

    Full Text Available The PET and CT fusion image, combining the anatomical and functional information, has important clinical meaning. An effective registration of PET and CT images is the basis of image fusion. This paper presents a multithread registration method based on contour point cloud for 3D whole-body PET and CT images. Firstly, a geometric feature-based segmentation (GFS method and a dynamic threshold denoising (DTD method are creatively proposed to preprocess CT and PET images, respectively. Next, a new automated trunk slices extraction method is presented for extracting feature point clouds. Finally, the multithread Iterative Closet Point is adopted to drive an affine transform. We compare our method with a multiresolution registration method based on Mattes Mutual Information on 13 pairs (246~286 slices per pair of 3D whole-body PET and CT data. Experimental results demonstrate the registration effectiveness of our method with lower negative normalization correlation (NC = −0.933 on feature images and less Euclidean distance error (ED = 2.826 on landmark points, outperforming the source data (NC = −0.496, ED = 25.847 and the compared method (NC = −0.614, ED = 16.085. Moreover, our method is about ten times faster than the compared one.

  12. A multi-mode operation control strategy for flexible microgrid based on sliding-mode direct voltage and hierarchical controls.

    Science.gov (United States)

    Zhang, Qinjin; Liu, Yancheng; Zhao, Youtao; Wang, Ning

    2016-03-01

    Multi-mode operation and transient stability are two problems that significantly affect flexible microgrid (MG). This paper proposes a multi-mode operation control strategy for flexible MG based on a three-layer hierarchical structure. The proposed structure is composed of autonomous, cooperative, and scheduling controllers. Autonomous controller is utilized to control the performance of the single micro-source inverter. An adaptive sliding-mode direct voltage loop and an improved droop power loop based on virtual negative impedance are presented respectively to enhance the system disturbance-rejection performance and the power sharing accuracy. Cooperative controller, which is composed of secondary voltage/frequency control and phase synchronization control, is designed to eliminate the voltage/frequency deviations produced by the autonomous controller and prepare for grid connection. Scheduling controller manages the power flow between the MG and the grid. The MG with the improved hierarchical control scheme can achieve seamless transitions from islanded to grid-connected mode and have a good transient performance. In addition the presented work can also optimize the power quality issues and improve the load power sharing accuracy between parallel VSIs. Finally, the transient performance and effectiveness of the proposed control scheme are evaluated by theoretical analysis and simulation results. Copyright © 2015 ISA. Published by Elsevier Ltd. All rights reserved.

  13. Patient-specific port placement for laparoscopic surgery using atlas-based registration

    Science.gov (United States)

    Enquobahrie, Andinet; Shivaprabhu, Vikas; Aylward, Stephen; Finet, Julien; Cleary, Kevin; Alterovitz, Ron

    2013-03-01

    Laparoscopic surgery is a minimally invasive surgical approach, in which abdominal surgical procedures are performed through trocars via small incisions. Patients benefit by reduced postoperative pain, shortened hospital stays, improved cosmetic results, and faster recovery times. Optimal port placement can improve surgeon dexterity and avoid the need to move the trocars, which would cause unnecessary trauma to the patient. We are building an intuitive open source visualization system to help surgeons identify ports. Our methodology is based on an intuitive port placement visualization module and atlas-based registration algorithm to transfer port locations to individual patients. The methodology follows three steps:1) Use a port placement visualization module to manually place ports in an abdominal organ atlas. This step generates port-augmented abdominal atlas. This is done only once for a given patient population. 2) Register the atlas data with the patient CT data, to transfer the prescribed ports to the individual patient 3) Review and adjust the transferred port locations using the port placement visualization module. Tool maneuverability and target reachability can be tested using the visualization system. Our methodology would decrease the amount of physician input necessary to optimize port placement for each patient case. In a follow up work, we plan to use the transferred ports as starting point for further optimization of the port locations by formulating a cost function that will take into account factors such as tool dexterity and likelihood of collision between instruments.

  14. Motion-compensated detection of heart rate based on the time registration adaptive filter

    Science.gov (United States)

    Yang, Lei; Zhou, Jinsong; Jing, Juanjuan; Li, Yacan; Wei, Lidong; Feng, Lei; He, Xiaoying; Bu, Meixia; Fu, Xilu

    2018-01-01

    A non-contact heart rate detection method based on the dual-wavelength technique is proposed and demonstrated experimentally. The heart rate is obtained based on the PhotoPlethysmoGraphy (PPG). Each detection module uses the reflection detection probe which is composed of the LED and the photodiode. It is a well-known fact that the differences in the circuits of two detection modules result in different responses of two modules for motion artifacts. It will cause a time delay between the two signals. This poses a great challenge to compensate the motion artifacts during measurements. In order to solve this problem, we have firstly used the time registration and translated the signals to ensure that the two signals are consistent in time domain. Then the adaptive filter is used to compensate the motion artifacts. Moreover, the data obtained by using this non-contact detection system is compared with those of the conventional finger blood volume pulse (BVP) sensor by simultaneously measuring the heart rate of the subject. During the experiment, the left hand remains stationary and is detected by a conventional finger BVP sensor. Meanwhile, the moving palm of right hand is detected by the proposed system. The data obtained from the proposed non-contact system are consistent and comparable with that of the BVP sensor. This method can effectively suppress the interference caused by the two circuit differences and successfully compensate the motion artifacts. This technology can be used in medical and daily heart rate measurement.

  15. Atlas-based deformable image registration for MRI-guided prostate radiation therapy

    International Nuclear Information System (INIS)

    Dowling, J.; Fripp, J.; Salvado, O.; Lambert, J.; Denham, J.W.; Capp, A.; Grer, P.B.; Parker, J.

    2010-01-01

    Full text: To develop atlas-based deformable image registration methods to automatically segment organs and map electron densities to pelvic MRI scans for MRI-guided radiation therapy. Methods An MRT pelvic atlas and corresponding CT atlas were developed based on whole pelvic T 2 MRI scans and CT scans for 39 patients. Expert manual segmentations on both MRI and CT scans were obtained. The atlas was deformably registered to the individual patient MRI scans for automatic prostate, rectum, bladder and bone segmentation. These were compared to the manual segmentations using the Dice overlap coefficient. The same deformation vectors were then applied to the CT-atlas to produce pseudo-CT scans that correspond to the patient MRI scan anatomy but are populated with Hounsfield units. The original patient plan was recalculated on the pseudo-CT and compared to the original CT plan and bulk density plans on the MRI scans. Results Dice coefficient results were high (>0.8) for bone and prostate but lower (<0.7) for bladder and rectum which exhibit greater changes in shape and volume. Doses calculated on pseudo-CT scans were within 3% of original patient plans. Two sources of discrepancy were found; MR anatomy differences from CT due to patient setup differences at the MR scanner. and Hounsfield unit differences for bone in the pseudo-CT from original CT. Patient setup will be adressed with a

  16. Model based estimation for multi-modal user interface component selection

    CSIR Research Space (South Africa)

    Coetzee, L

    2009-12-01

    Full Text Available for inter- action are well understood, the general problem of integrated multi-modal systems are yet to be understood to the same level. User modelling plays an important role within user- adaptive systems. Kobsa [5] presents a review on the devel... and providers of services and therefore user modelling tools will continue to play an important role in computer systems. Even though the utilisation of multiple modalities to break down the access barrier has been addressed by several re- searchers...

  17. Multimodality and Ambient Intelligence

    NARCIS (Netherlands)

    Nijholt, Antinus; Verhaegh, W.; Aarts, E.; Korst, J.

    2004-01-01

    In this chapter we discuss multimodal interface technology. We present eexamples of multimodal interfaces and show problems and opportunities. Fusion of modalities is discussed and some roadmap discussions on research in multimodality are summarized. This chapter also discusses future developments

  18. Multimodal connectivity based eloquence score computation and visualisation for computer-aided neurosurgical path planning.

    Science.gov (United States)

    Bakhshmand, Saeed M; Eagleson, Roy; de Ribaupierre, Sandrine

    2017-10-01

    Non-invasive assessment of cognitive importance has been a major challenge for planning of neurosurgical procedures. In the past decade, in vivo brain imaging modalities have been considered for estimating the 'eloquence' of brain areas. In order to estimate the impact of damage caused by an access path towards a target region inside of the skull, multi-modal metrics are introduced in this paper. Accordingly, this estimated damage is obtained by combining multi-modal metrics. In other words, this damage is an aggregate of intervened grey matter volume and axonal fibre numbers, weighted by their importance within the assigned anatomical and functional networks. To validate these metrics, an exhaustive search algorithm is implemented for characterising the solution space and visually representing connectional cost associated with a path initiated from underlying points. In this presentation, brain networks are built from resting state functional magnetic resonance imaging (fMRI) and deterministic tractography. their results demonstrate that the proposed approach is capable of refining traditional heuristics, such as choosing the minimal distance from the lesion, by supplementing connectional importance of the resected tissue. This provides complementary information to help the surgeon in avoiding important functional hubs and their anatomical linkages; which are derived from neuroimaging modalities and incorporated to the related anatomical landmarks.

  19. Multi-Modality Phantom Development

    Energy Technology Data Exchange (ETDEWEB)

    Huber, Jennifer S.; Peng, Qiyu; Moses, William W.

    2009-03-20

    Multi-modality imaging has an increasing role in the diagnosis and treatment of a large number of diseases, particularly if both functional and anatomical information are acquired and accurately co-registered. Hence, there is a resulting need for multi modality phantoms in order to validate image co-registration and calibrate the imaging systems. We present our PET-ultrasound phantom development, including PET and ultrasound images of a simple prostate phantom. We use agar and gelatin mixed with a radioactive solution. We also present our development of custom multi-modality phantoms that are compatible with PET, transrectal ultrasound (TRUS), MRI and CT imaging. We describe both our selection of tissue mimicking materials and phantom construction procedures. These custom PET-TRUS-CT-MRI prostate phantoms use agargelatin radioactive mixtures with additional contrast agents and preservatives. We show multi-modality images of these custom prostate phantoms, as well as discuss phantom construction alternatives. Although we are currently focused on prostate imaging, this phantom development is applicable to many multi-modality imaging applications.

  20. Automatic kidney segmentation in CT images based on multi-atlas image registration.

    Science.gov (United States)

    Yang, Guanyu; Gu, Jinjin; Chen, Yang; Liu, Wangyan; Tang, Lijun; Shu, Huazhong; Toumoulin, Christine

    2014-01-01

    Kidney segmentation is an important step for computer-aided diagnosis or treatment in urology. In this paper, we present an automatic method based on multi-atlas image registration for kidney segmentation. The method mainly relies on a two-step framework to obtain coarse-to-fine segmentation results. In the first step, down-sampled patient image is registered with a set of low-resolution atlas images. A coarse kidney segmentation result is generated to locate the left and right kidneys. In the second step, the left and right kidneys are cropped from original images and aligned with another set of high-resolution atlas images to obtain the final results respectively. Segmentation results from 14 CT angiographic (CTA) images show that our proposed method can segment the kidneys with a high accuracy. The average Dice similarity coefficient and surface-to-surface distance between segmentation results and reference standard are 0.952 and 0.913mm. Furthermore, the kidney segmentation in CT urography (CTU) and CTA images of 12 patients were performed to show the feasibility of our method in CTU images.

  1. Free Form Deformation-Based Image Registration Improves Accuracy of Traction Force Microscopy.

    Directory of Open Access Journals (Sweden)

    Alvaro Jorge-Peñas

    Full Text Available Traction Force Microscopy (TFM is a widespread method used to recover cellular tractions from the deformation that they cause in their surrounding substrate. Particle Image Velocimetry (PIV is commonly used to quantify the substrate's deformations, due to its simplicity and efficiency. However, PIV relies on a block-matching scheme that easily underestimates the deformations. This is especially relevant in the case of large, locally non-uniform deformations as those usually found in the vicinity of a cell's adhesions to the substrate. To overcome these limitations, we formulate the calculation of the deformation of the substrate in TFM as a non-rigid image registration process that warps the image of the unstressed material to match the image of the stressed one. In particular, we propose to use a B-spline -based Free Form Deformation (FFD algorithm that uses a connected deformable mesh to model a wide range of flexible deformations caused by cellular tractions. Our FFD approach is validated in 3D fields using synthetic (simulated data as well as with experimental data obtained using isolated endothelial cells lying on a deformable, polyacrylamide substrate. Our results show that FFD outperforms PIV providing a deformation field that allows a better recovery of the magnitude and orientation of tractions. Together, these results demonstrate the added value of the FFD algorithm for improving the accuracy of traction recovery.

  2. The plant virus microscope image registration method based on mismatches removing.

    Science.gov (United States)

    Wei, Lifang; Zhou, Shucheng; Dong, Heng; Mao, Qianzhuo; Lin, Jiaxiang; Chen, Riqing

    2016-01-01

    The electron microscopy is one of the major means to observe the virus. The view of virus microscope images is limited by making specimen and the size of the camera's view field. To solve this problem, the virus sample is produced into multi-slice for information fusion and image registration techniques are applied to obtain large field and whole sections. Image registration techniques have been developed in the past decades for increasing the camera's field of view. Nevertheless, these approaches typically work in batch mode and rely on motorized microscopes. Alternatively, the methods are conceived just to provide visually pleasant registration for high overlap ratio image sequence. This work presents a method for virus microscope image registration acquired with detailed visual information and subpixel accuracy, even when overlap ratio of image sequence is 10% or less. The method proposed focus on the correspondence set and interimage transformation. A mismatch removal strategy is proposed by the spatial consistency and the components of keypoint to enrich the correspondence set. And the translation model parameter as well as tonal inhomogeneities is corrected by the hierarchical estimation and model select. In the experiments performed, we tested different registration approaches and virus images, confirming that the translation model is not always stationary, despite the fact that the images of the sample come from the same sequence. The mismatch removal strategy makes building registration of virus microscope images at subpixel accuracy easier and optional parameters for building registration according to the hierarchical estimation and model select strategies make the proposed method high precision and reliable for low overlap ratio image sequence. Copyright © 2015 Elsevier Ltd. All rights reserved.

  3. [Landmark-based automatic registration of serial cross-sectional images of Chinese digital human using Photoshop and Matlab software].

    Science.gov (United States)

    Su, Xiu-yun; Pei, Guo-xian; Yu, Bin; Hu, Yan-ling; Li, Jin; Huang, Qian; Li, Xu; Zhang, Yuan-zhi

    2007-12-01

    This paper describes automatic registration of the serial cross-sectional images of Chinese digital human by projective registration method based on the landmarks using the commercially available software Photoshop and Matlab. During cadaver embedment for acquisition of the Chinese digital human images, 4 rods were placed parallel to the vertical axis of the frozen cadaver to allow orientation. Projective distortion of the rod positions on the cross-sectional images was inevitable due to even slight changes of the relative position of the camera. The original cross-sectional images were first processed using Photoshop software firstly to obtain the images of the orientation rods, and the centroid coordinate of every rod image was acquired with Matlab software. With the average coordinate value of the rods as the fiducial point, two-dimensional projective transformation coefficient of each image was determined. Projective transformation was then carried out and projective distortion from each original serial image was eliminated. The rectified cross-sectional images were again processed using Photoshop to obtain the image of the first orientation rod, the coordinate value of first rod image was calculated using Matlab software, and the cross-sectional images were cut into images of the same size according to the first rod spatial coordinate, to achieve automatic registration of the serial cross-sectional images. sing Photoshop and Matlab softwares, projective transformation can accurately accomplish the image registration for the serial images with simpler calculation processes and easier computer processing.

  4. Radiation dose response simulation for biomechanical-based deformable image registration of head and neck cancer treatment

    Science.gov (United States)

    Al-Mayah, Adil; Moseley, Joanne; Hunter, Shannon; Brock, Kristy

    2015-11-01

    Biomechanical-based deformable image registration is conducted on the head and neck region. Patient specific 3D finite element models consisting of parotid glands (PG), submandibular glands (SG), tumor, vertebrae (VB), mandible, and external body are used to register pre-treatment MRI to post-treatment MR images to model the dose response using image data of five patients. The images are registered using combinations of vertebrae and mandible alignments, and surface projection of the external body as boundary conditions. In addition, the dose response is simulated by applying a new loading technique in the form of a dose-induced shrinkage using the dose-volume relationship. The dose-induced load is applied as dose-induced shrinkage of the tumor and four salivary glands. The Dice Similarity Coefficient (DSC) is calculated for the four salivary glands, and tumor to calculate the volume overlap of the structures after deformable registration. A substantial improvement in the registration is found by including the dose-induced shrinkage. The greatest registration improvement is found in the four glands where the average DSC increases from 0.53, 0.55, 0.32, and 0.37 to 0.68, 0.68, 0.51, and 0.49 in the left PG, right PG, left SG, and right SG, respectively by using bony alignment of vertebrae and mandible (M), body (B) surface projection and dose (D) (VB+M+B+D).

  5. Validation of experts versus atlas-based and automatic registration methods for subthalamic nucleus targeting on MRI

    Energy Technology Data Exchange (ETDEWEB)

    Sanchez Castro, F.J.; Cuisenaire, O.; Thiran, J.P. [Ecole Polytechnique Federale de Lausanne (EPFL) (Switzerland). Signal Processing Inst.; Pollo, C. [Ecole Polytechnique Federale de Lausanne (EPFL) (Switzerland). Signal Processing Inst.; Centre Hospitalier Universitaire Vaudois (CHUV), Lausanne (Switzerland). Dept. of Neurosurgery; Villemure, J.G. [Centre Hospitalier Universitaire Vaudois (CHUV), Lausanne (Switzerland). Dept. of Neurosurgery

    2006-03-15

    Objects: In functional stereotactic neurosurgery, one of the cornerstones upon which the success and the operating time depends is an accurate targeting. The subthalamic nucleus (STN) is the usual target involved when applying deep brain stimulation for Parkinson's disease (PD). Unfortunately, STN is usually not clearly visible in common medical imaging modalities, which justifies the use of atlas-based segmentation techniques to infer the STN location. Materials and methods: Eight bilaterally implanted PD patients were included in this study. A three-dimensional T1-weighted sequence and inversion recovery T2-weighted coronal slices were acquired pre-operatively. We propose a methodology for the construction of a ground truth of the STN location and a scheme that allows both, to perform a comparison between different non-rigid registration algorithms and to evaluate their usability to locate the STN automatically. Results: The intra-expert variability in identifying the STN location is 1.06{+-}0.61 mm while the best non-rigid registration method gives an error of 1.80{+-}0.62 mm. On the other hand, statistical tests show that an affine registration with only 12 degrees of freedom is not enough for this application. Conclusions: Using our validation-evaluation scheme, we demonstrate that automatic STN localization is possible and accurate with non-rigid registration algorithms. (orig.)

  6. Evaluation of Deformable Image Registration-Based Contour Propagation From Planning CT to Cone-Beam CT.

    Science.gov (United States)

    Woerner, Andrew J; Choi, Mehee; Harkenrider, Matthew M; Roeske, John C; Surucu, Murat

    2017-01-01

    We evaluated the performance of organ contour propagation from a planning computed tomography to cone-beam computed tomography with deformable image registration by comparing contours to manual contouring. Sixteen patients were retrospectively identified based on showing considerable physical change throughout the course of treatment. Multiple organs in the 3 regions (head and neck, prostate, and pancreas) were evaluated. A cone-beam computed tomography from the end of treatment was registered to the planning computed tomography using rigid registration, followed by deformable image registration. The contours were copied on cone-beam computed tomography image sets using rigid registration and modified by 2 radiation oncologists. Contours were compared using Dice similarity coefficient, mean surface distance, and Hausdorff distance. The mean physician-to-physician Dice similarity coefficient for all organs was 0.90. When compared to each physician's contours, the overall mean for rigid was 0.76 ( P cone-beam computed tomography to evaluate the changes during treatment should be used with caution.

  7. COLLINARUS: collection of image-derived non-linear attributes for registration using splines

    Science.gov (United States)

    Chappelow, Jonathan; Bloch, B. Nicolas; Rofsky, Neil; Genega, Elizabeth; Lenkinski, Robert; DeWolf, William; Viswanath, Satish; Madabhushi, Anant

    2009-02-01

    We present a new method for fully automatic non-rigid registration of multimodal imagery, including structural and functional data, that utilizes multiple texutral feature images to drive an automated spline based non-linear image registration procedure. Multimodal image registration is significantly more complicated than registration of images from the same modality or protocol on account of difficulty in quantifying similarity between different structural and functional information, and also due to possible physical deformations resulting from the data acquisition process. The COFEMI technique for feature ensemble selection and combination has been previously demonstrated to improve rigid registration performance over intensity-based MI for images of dissimilar modalities with visible intensity artifacts. Hence, we present here the natural extension of feature ensembles for driving automated non-rigid image registration in our new technique termed Collection of Image-derived Non-linear Attributes for Registration Using Splines (COLLINARUS). Qualitative and quantitative evaluation of the COLLINARUS scheme is performed on several sets of real multimodal prostate images and synthetic multiprotocol brain images. Multimodal (histology and MRI) prostate image registration is performed for 6 clinical data sets comprising a total of 21 groups of in vivo structural (T2-w) MRI, functional dynamic contrast enhanced (DCE) MRI, and ex vivo WMH images with cancer present. Our method determines a non-linear transformation to align WMH with the high resolution in vivo T2-w MRI, followed by mapping of the histopathologic cancer extent onto the T2-w MRI. The cancer extent is then mapped from T2-w MRI onto DCE-MRI using the combined non-rigid and affine transformations determined by the registration. Evaluation of prostate registration is performed by comparison with the 3 time point (3TP) representation of functional DCE data, which provides an independent estimate of cancer

  8. Student Teachers' Modeling of Acceleration Using a Video-Based Laboratory in Physics Education: A Multimodal Case Study

    Directory of Open Access Journals (Sweden)

    Louis Trudel

    2016-06-01

    Full Text Available This exploratory study intends to model kinematics learning of a pair of student teachers when exposed to prescribed teaching strategies in a video-based laboratory. Two student teachers were chosen from the Francophone B.Ed. program of the Faculty of Education of a Canadian university. The study method consisted of having the participants interact with a video-based laboratory to complete two activities for learning properties of acceleration in rectilinear motion. Time limits were placed on the learning activities during which the researcher collected detailed multimodal information from the student teachers' answers to questions, the graphs they produced from experimental data, and the videos taken during the learning sessions. As a result, we describe the learning approach each one followed, the evidence of conceptual change and the difficulties they face in tackling various aspects of the accelerated motion. We then specify advantages and limits of our research and propose recommendations for further study.

  9. Image-based dose planning of intracavitary brachytherapy: registration of serial-imaging studies using deformable anatomic templates

    International Nuclear Information System (INIS)

    Christensen, Gary E.; Carlson, Blake; Chao, K.S. Clifford; Yin Pen; Grigsby, Perry W.; Nguyen, Kim; Dempsey, James F; Lerma, Fritz A.; Bae, Kyongtae T.; Vannier, Michael W.; Williamson, Jeffrey F.

    2001-01-01

    cancer. These changes cannot be modeled by the conventional rigid landmark transformation method. In the current study, we found that the deformable anatomic template registration method, based on continuum-mechanics models of deformation, successfully described these large anatomic shape changes before and after ICT. These promising modeling results indicate that realistic registration of the cumulative dose distribution to the organs (or targets) of interest for radiation therapy of cervical cancers is achievable

  10. Registration for deceased organ and tissue donation among Ontario immigrants: a population-based cross-sectional study.

    Science.gov (United States)

    Li, Alvin Ho-Ting; Lam, Ngan N; Dhanani, Sonny; Weir, Matthew; Prakash, Versha; Kim, Joseph; Knoll, Greg; Garg, Amit X

    2016-01-01

    Canada has low rates of deceased organ and tissue donation. Immigrants to Canada may differ in their registered support for deceased organ donation based on their country of origin. We used linked administrative databases in Ontario (about 11 million residents aged ≥ 16 yr) to study the proportion of immigrants and long-term residents registered for deceased organ and tissue donation as of October 2013. We used modified Poisson regression to identify and quantify predictors of donor registration. Compared with long-term residents ( n = 9 244 570), immigrants ( n = 1 947 646) were much less likely to register for deceased organ and tissue donation (11.9% v. 26.5%). Immigrants from the United States, Australia and New Zealand had the highest registration rate (40.0%), whereas immigrants with the lowest registration rates were from Eastern Europe and Central Asia (9.4%), East Asia and Pacific (8.4%) and sub-Saharan Africa (7.9%). The largest numbers of unregistered immigrants were from India ( n = 202 548), China ( n = 186 678) and the Philippines ( n = 125 686). Characteristics among the immigrant population associated with a higher likelihood of registration included economic immigrant status, living in a rural area (population speak English and French, and more years residing in Canada. Immigrants in Ontario were less likely to register for deceased organ and tissue donation than long-term residents. There is a need to better understand reasons for lower registration rates among Canadian immigrants and to create culture-sensitive materials to build support for deceased organ and tissue donation.

  11. An Image-Based Approach for the Co-Registration of Multi-Temporal UAV Image Datasets

    Directory of Open Access Journals (Sweden)

    Irene Aicardi

    2016-09-01

    Full Text Available During the past years, UAVs (Unmanned Aerial Vehicles became very popular as low-cost image acquisition platforms since they allow for high resolution and repetitive flights in a flexible way. One application is to monitor dynamic scenes. However, the fully automatic co-registration of the acquired multi-temporal data still remains an open issue. Most UAVs are not able to provide accurate direct image georeferencing and the co-registration process is mostly performed with the manual introduction of ground control points (GCPs, which is time consuming, costly and sometimes not possible at all. A new technique to automate the co-registration of multi-temporal high resolution image blocks without the use of GCPs is investigated in this paper. The image orientation is initially performed on a reference epoch and the registration of the following datasets is achieved including some anchor images from the reference data. The interior and exterior orientation parameters of the anchor images are then fixed in order to constrain the Bundle Block Adjustment of the slave epoch to be aligned with the reference one. The study involved the use of two different datasets acquired over a construction site and a post-earthquake damaged area. Different tests have been performed to assess the registration procedure using both a manual and an automatic approach for the selection of anchor images. The tests have shown that the procedure provides results comparable to the traditional GCP-based strategy and both the manual and automatic selection of the anchor images can provide reliable results.

  12. Spherical harmonics based intrasubject 3-D kidney modeling/registration technique applied on partial information

    Science.gov (United States)

    Dillenseger, Jean-Louis; Guillaume, Hélène; Patard, Jean-Jacques

    2006-01-01

    This paper presents a 3D shape reconstruction/intra-patient rigid registration technique used to establish a Nephron-Sparing Surgery preoperative planning. The usual preoperative imaging system is the Spiral CT Urography, which provides successive 3D acquisitions of complementary information on kidney anatomy. Because the kidney is difficult to demarcate from the liver or from the spleen only limited information on its volume or surface is available. In our paper we propose a methodology allowing a global kidney spatial representation on a spherical harmonics basis. The spherical harmonics are exploited to recover the kidney 3D shape and also to perform intra-patient 3D rigid registration. An evaluation performed on synthetic data showed that this technique presented lower performance then expected for the 3D shape recovering but exhibited registration results slightly more accurate as the ICP technique with faster computation time. PMID:17073323

  13. An optical authentication system based on encryption technique and multimodal biometrics

    Science.gov (United States)

    Yuan, Sheng; Zhang, Tong; Zhou, Xin; Liu, Xuemei; Liu, Mingtang

    2013-12-01

    A major concern nowadays for a biometric credential management system is its potential vulnerability to protect its information sources. To prevent a genuine user's templates from both internal and external threats, a novel and simple method combined optical encryption with multimodal biometric authentication technique is proposed. In this method, the standard biometric templates are generated real-timely by the verification keys owned by legal user so that they are unnecessary to be stored in a database. Compared with the traditional recognition algorithms, storage space and matching time are greatly saved. In addition, the verification keys are difficult to be forged due to the utilization of optical encryption technique. Although the verification keys are lost or stolen, they are useless for others in absence of the legal owner's biometric. A series of numerical simulations are performed to demonstrate the feasibility and performance of this method.

  14. Multimodal human-machine interface based on a brain-computer interface and an electrooculography interface.

    Science.gov (United States)

    Iáñez, Eduardo; Ùbeda, Andrés; Azorín, José M

    2011-01-01

    This paper describes a multimodal interface that combines a Brain-Computer Interface (BCI) with an electrooculography (EOG) interface. The non-invasive spontaneous BCI registers the electrical brain activity through surface electrodes. The EOG interface detects the eye movements through electrodes placed on the face around the eyes. Both kind of signals are registered together and processed to obtain the mental task that the user is thinking and the eye movement performed by the user. Both commands (mental task and eye movement) are combined in order to move a dot in a graphic user interface (GUI). Several experimental tests have been made where the users perform a trajectory to get closer to some targets. To perform the trajectory the user moves the dot in a plane with the EOG interface and using the BCI the dot changes its height.

  15. Compact multimode fiber beam-shaping system based on GPU accelerated digital holography.

    Science.gov (United States)

    Plöschner, Martin; Čižmár, Tomáš

    2015-01-15

    Real-time, on-demand, beam shaping at the end of the multimode fiber has recently been made possible by exploiting the computational power of rapidly evolving graphics processing unit (GPU) technology [Opt. Express 22, 2933 (2014)]. However, the current state-of-the-art system requires the presence of an acousto-optic deflector (AOD) to produce images at the end of the fiber without interference effects between neighboring output points. Here, we present a system free from the AOD complexity where we achieve the removal of the undesired interference effects computationally using GPU implemented Gerchberg-Saxton and Yang-Gu algorithms. The GPU implementation is two orders of magnitude faster than the CPU implementation which allows video-rate image control at the distal end of the fiber virtually free of interference effects.

  16. Inorganic Nanoparticles for Multimodal Molecular Imaging

    Directory of Open Access Journals (Sweden)

    Magdalena Swierczewska

    2011-01-01

    Full Text Available Multimodal molecular imaging can offer a synergistic improvement of diagnostic ability over a single imaging modality. Recent development of hybrid imaging systems has profoundly impacted the pool of available multimodal imaging probes. In particular, much interest has been focused on biocompatible, inorganic nanoparticle-based multimodal probes. Inorganic nanoparticles offer exceptional advantages to the field of multimodal imaging owing to their unique characteristics, such as nanometer dimensions, tunable imaging properties, and multifunctionality. Nanoparticles mainly based on iron oxide, quantum dots, gold, and silica have been applied to various imaging modalities to characterize and image specific biologic processes on a molecular level. A combination of nanoparticles and other materials such as biomolecules, polymers, and radiometals continue to increase functionality for in vivo multimodal imaging and therapeutic agents. In this review, we discuss the unique concepts, characteristics, and applications of the various multimodal imaging probes based on inorganic nanoparticles.

  17. A multimodal 3D framework for fire characteristics estimation

    Science.gov (United States)

    Toulouse, T.; Rossi, L.; Akhloufi, M. A.; Pieri, A.; Maldague, X.

    2018-02-01

    In the last decade we have witnessed an increasing interest in using computer vision and image processing in forest fire research. Image processing techniques have been successfully used in different fire analysis areas such as early detection, monitoring, modeling and fire front characteristics estimation. While the majority of the work deals with the use of 2D visible spectrum images, recent work has introduced the use of 3D vision in this field. This work proposes a new multimodal vision framework permitting the extraction of the three-dimensional geometrical characteristics of fires captured by multiple 3D vision systems. The 3D system is a multispectral stereo system operating in both the visible and near-infrared (NIR) spectral bands. The framework supports the use of multiple stereo pairs positioned so as to capture complementary views of the fire front during its propagation. Multimodal registration is conducted using the captured views in order to build a complete 3D model of the fire front. The registration process is achieved using multisensory fusion based on visual data (2D and NIR images), GPS positions and IMU inertial data. Experiments were conducted outdoors in order to show the performance of the proposed framework. The obtained results are promising and show the potential of using the proposed framework in operational scenarios for wildland fire research and as a decision management system in fighting.

  18. Bladder dose accumulation based on a biomechanical deformable image registration algorithm in volumetric modulated arc therapy for prostate cancer

    DEFF Research Database (Denmark)

    Andersen, E S; Muren, L P; Sørensen, T S

    2012-01-01

    Variations in bladder position, shape and volume cause uncertainties in the doses delivered to this organ during a course of radiotherapy for pelvic tumors. The purpose of this study was to evaluate the potential of dose accumulation based on repeat imaging and deformable image registration (DIR...... in individual patients between the doses from the initial treatment plan and the accumulated bladder doses. Hence, the use of repeat imaging has a potential for improved accuracy in treatment dose reporting....

  19. Broad bandwidth and large fabrication tolerance polarization beam splitter based on multimode anti-symmetric Bragg sidewall gratings.

    Science.gov (United States)

    Qiu, Huiye; Jiang, Jianfei; Yu, Ping; Yang, Jianyi; Yu, Hui; Jiang, Xiaoqing

    2017-10-01

    A novel polarization beam splitter based on an anti-symmetric sidewall Bragg grating in a multimode silicon-on-insulator strip waveguide is demonstrated. Anti-symmetric spatially periodic refractive-index perturbations are designed for strong coupling between the fundamental (TE 0 ) and the first-order transverse electric modes (TE 1 ), while not for transfer magnetic modes. An adiabatic coupler is cascaded at the input-port, so as to drop the TE 1 reflection. The Bragg grating has a compact length of ∼20  μm (55 periods). The polarization isolations of the through- and drop-ports at the wavelength of 1557 nm are 34 and 31 dB, respectively. A broad bandwidth of 64 nm and a large fabrication tolerance of 80 nm for polarization isolation over 20 dB are also achieved.

  20. A Photonic 1 × 4 Power Splitter Based on Multimode Interference in Silicon–Gallium-Nitride Slot Waveguide Structures

    Directory of Open Access Journals (Sweden)

    Dror Malka

    2016-06-01

    Full Text Available In this paper, a design for a 1 × 4 optical power splitter based on the multimode interference (MMI coupler in a silicon (Si–gallium nitride (GaN slot waveguide structure is presented—to our knowledge, for the first time. Si and GaN were found as suitable materials for the slot waveguide structure. Numerical optimizations were carried out on the device parameters using the full vectorial-beam propagation method (FV-BPM. Simulation results show that the proposed device can be useful to divide optical signal energy uniformly in the C-band range (1530–1565 nm into four output ports with low insertion losses (0.07 dB.

  1. GPU-based streaming architectures for fast cone-beam CT image reconstruction and demons deformable registration

    Energy Technology Data Exchange (ETDEWEB)

    Sharp, G C [Department of Radiation Oncology, Massachusetts General Hospital, Boston, MA 02114 (United States); Kandasamy, N [Electrical and Computer Engineering Department, Drexel University, Philadelphia, PA 19104 (United States); Singh, H [Electrical and Computer Engineering Department, Drexel University, Philadelphia, PA 19104 (United States); Folkert, M [Department of Radiation Oncology, Massachusetts General Hospital, Boston, MA 02114 (United States)

    2007-09-21

    This paper shows how to significantly accelerate cone-beam CT reconstruction and 3D deformable image registration using the stream-processing model. We describe data-parallel designs for the Feldkamp, Davis and Kress (FDK) reconstruction algorithm, and the demons deformable registration algorithm, suitable for use on a commodity graphics processing unit. The streaming versions of these algorithms are implemented using the Brook programming environment and executed on an NVidia 8800 GPU. Performance results using CT data of a preserved swine lung indicate that the GPU-based implementations of the FDK and demons algorithms achieve a substantial speedup-up to 80 times for FDK and 70 times for demons when compared to an optimized reference implementation on a 2.8 GHz Intel processor. In addition, the accuracy of the GPU-based implementations was found to be excellent. Compared with CPU-based implementations, the RMS differences were less than 0.1 Hounsfield unit for reconstruction and less than 0.1 mm for deformable registration.

  2. Planetary Crater Detection and Registration Using Marked Point Processes, Multiple Birth and Death Algorithms, and Region-Based Analysis

    Science.gov (United States)

    Solarna, David; Moser, Gabriele; Le Moigne-Stewart, Jacqueline; Serpico, Sebastiano B.

    2017-01-01

    Because of the large variety of sensors and spacecraft collecting data, planetary science needs to integrate various multi-sensor and multi-temporal images. These multiple data represent a precious asset, as they allow the study of targets spectral responses and of changes in the surface structure; because of their variety, they also require accurate and robust registration. A new crater detection algorithm, used to extract features that will be integrated in an image registration framework, is presented. A marked point process-based method has been developed to model the spatial distribution of elliptical objects (i.e. the craters) and a birth-death Markov chain Monte Carlo method, coupled with a region-based scheme aiming at computational efficiency, is used to find the optimal configuration fitting the image. The extracted features are exploited, together with a newly defined fitness function based on a modified Hausdorff distance, by an image registration algorithm whose architecture has been designed to minimize the computational time.

  3. Incidence of unintentional injuries in farming based on one year of weekly registration in Danish farms

    DEFF Research Database (Denmark)

    Rasmussen, K; Carstensen, O; Lauritsen, Jens

    2000-01-01

    In Denmark, farming ranks as the industry with the highest incidence rate of fatal injuries. For nonfatal injuries, insufficient registration practices prevent valid comparisons between occupations. This study examines the occurrence of farm accidents and injuries, as well as work-specific factors...

  4. Fast Geodesic Active Fields for Image Registration Based on Splitting and Augmented Lagrangian Approaches.

    Science.gov (United States)

    Zosso, Dominique; Bresson, Xavier; Thiran, Jean-Philippe

    2014-02-01

    In this paper, we present an efficient numerical scheme for the recently introduced geodesic active fields (GAF) framework for geometric image registration. This framework considers the registration task as a weighted minimal surface problem. Hence, the data-term and the regularization-term are combined through multiplication in a single, parametrization invariant and geometric cost functional. The multiplicative coupling provides an intrinsic, spatially varying and data-dependent tuning of the regularization strength, and the parametrization invariance allows working with images of nonflat geometry, generally defined on any smoothly parametrizable manifold. The resulting energy-minimizing flow, however, has poor numerical properties. Here, we provide an efficient numerical scheme that uses a splitting approach; data and regularity terms are optimized over two distinct deformation fields that are constrained to be equal via an augmented Lagrangian approach. Our approach is more flexible than standard Gaussian regularization, since one can interpolate freely between isotropic Gaussian and anisotropic TV-like smoothing. In this paper, we compare the geodesic active fields method with the popular Demons method and three more recent state-of-the-art algorithms: NL-optical flow, MRF image registration, and landmark-enhanced large displacement optical flow. Thus, we can show the advantages of the proposed FastGAF method. It compares favorably against Demons, both in terms of registration speed and quality. Over the range of example applications, it also consistently produces results not far from more dedicated state-of-the-art methods, illustrating the flexibility of the proposed framework.

  5. Multimodal label-free microscopy

    Directory of Open Access Journals (Sweden)

    Nicolas Pavillon

    2014-09-01

    Full Text Available This paper reviews the different multimodal applications based on a large extent of label-free imaging modalities, ranging from linear to nonlinear optics, while also including spectroscopic measurements. We put specific emphasis on multimodal measurements going across the usual boundaries between imaging modalities, whereas most multimodal platforms combine techniques based on similar light interactions or similar hardware implementations. In this review, we limit the scope to focus on applications for biology such as live cells or tissues, since by their nature of being alive or fragile, we are often not free to take liberties with the image acquisition times and are forced to gather the maximum amount of information possible at one time. For such samples, imaging by a given label-free method usually presents a challenge in obtaining sufficient optical signal or is limited in terms of the types of observable targets. Multimodal imaging is then particularly attractive for these samples in order to maximize the amount of measured information. While multimodal imaging is always useful in the sense of acquiring additional information from additional modes, at times it is possible to attain information that could not be discovered using any single mode alone, which is the essence of the progress that is possible using a multimodal approach.

  6. SU-E-J-111: Finite Element-Based Deformable Image Registration of Pleural Cavity for Photodynamic Therapy

    Energy Technology Data Exchange (ETDEWEB)

    Penjweini, R; Zhu, T [Univ Pennsylvania, Philadelphia, PA (United States)

    2015-06-15

    Purpose: The pleural volumes will deform during surgery portion of the pleural photodynamic therapy (PDT) of lung cancer when the pleural cavity is opened. This impact the delivered dose when using highly conformal treatment techniques. In this study, a finite element-based (FEM) deformable image registration is used to quantify the anatomical variation between the contours for the pleural cavities obtained in the operating room and those determined from pre-surgery computed tomography (CT) scans. Methods: An infrared camera-based navigation system (NDI) is used during PDT to track the anatomical changes and contour the lung and chest cavity. A series of CTs of the lungs, in the same patient, are also acquired before the surgery. The structure contour of lung and the CTs are processed and contoured in Matlab and MeshLab. Then, the contours are imported into COMSOL Multiphysics 5.0, where the FEM-based deformable image registration is obtained using the deformed mesh - moving mesh (ALE) model. The NDI acquired lung contour is considered as the reference contour, and the CT contour is used as the target one, which will be deformed. Results: The reconstructed three-dimensional contours from both NDI and CT can be converted to COMSOL so that a three-dimensional ALE model can be developed. The contours can be registered using COMSOL ALE moving mesh model, which takes into account the deformation along x, y and z-axes. The deformed contour has good matches to the reference contour after the dynamic matching process. The resulting 3D deformation map can be used to obtain the locations of other critical anatomic structures, e.g., heart, during surgery. Conclusion: Deformable image registration can fuse images acquired by different modalities. It provides insights into the development of phenomenon and variation in normal anatomical structures over time. The initial assessments of three-dimensional registration show good agreement.

  7. Monoplane 3D-2D registration of cerebral angiograms based on multi-objective stratified optimization

    Science.gov (United States)

    Aksoy, T.; Špiclin, Ž.; Pernuš, F.; Unal, G.

    2017-12-01

    Registration of 3D pre-interventional to 2D intra-interventional medical images has an increasingly important role in surgical planning, navigation and treatment, because it enables the physician to co-locate depth information given by pre-interventional 3D images with the live information in intra-interventional 2D images such as x-ray. Most tasks during image-guided interventions are carried out under a monoplane x-ray, which is a highly ill-posed problem for state-of-the-art 3D to 2D registration methods. To address the problem of rigid 3D-2D monoplane registration we propose a novel multi-objective stratified parameter optimization, wherein a small set of high-magnitude intensity gradients are matched between the 3D and 2D images. The stratified parameter optimization matches rotation templates to depth templates, first sampled from projected 3D gradients and second from the 2D image gradients, so as to recover 3D rigid-body rotations and out-of-plane translation. The objective for matching was the gradient magnitude correlation coefficient, which is invariant to in-plane translation. The in-plane translations are then found by locating the maximum of the gradient phase correlation between the best matching pair of rotation and depth templates. On twenty pairs of 3D and 2D images of ten patients undergoing cerebral endovascular image-guided intervention the 3D to monoplane 2D registration experiments were setup with a rather high range of initial mean target registration error from 0 to 100 mm. The proposed method effectively reduced the registration error to below 2 mm, which was further refined by a fast iterative method and resulted in a high final registration accuracy (0.40 mm) and high success rate (> 96%). Taking into account a fast execution time below 10 s, the observed performance of the proposed method shows a high potential for application into clinical image-guidance systems.

  8. 3D registration method based on scattered point cloud from B-model ultrasound image

    Science.gov (United States)

    Hu, Lei; Xu, Xiaojun; Wang, Lifeng; Guo, Na; Xie, Feng

    2017-01-01

    The paper proposes a registration method on 3D point cloud of the bone tissue surface extracted by B-mode ultrasound image and the CT model . The B-mode ultrasound is used to get two-dimensional images of the femur tissue . The binocular stereo vision tracker is used to obtain spatial position and orientation of the optical positioning device fixed on the ultrasound probe. The combining of the two kind of data generates 3D point cloud of the bone tissue surface. The pixel coordinates of the bone surface are automatically obtained from ultrasound image using an improved local phase symmetry (phase symmetry, PS) . The mapping of the pixel coordinates on the ultrasound image and 3D space is obtained through a series of calibration methods. In order to detect the effect of registration, six markers are implanted on a complete fresh pig femoral .The actual coordinates of the marks are measured with two methods. The first method is to get the coordinates with measuring tools under a coordinate system. The second is to measure the coordinates of the markers in the CT model registered with 3D point cloud using the ICP registration algorithm under the same coordinate system. Ten registration experiments are carried out in the same way. Error results are obtained by comparing the two sets of mark point coordinates obtained by two different methods. The results is that a minimum error is 1.34mm, the maximum error is 3.22mm,and the average error of 2.52mm; ICP registration algorithm calculates the average error of 0.89mm and a standard deviation of 0.62mm.This evaluation standards of registration accuracy is different from the average error obtained by the ICP registration algorithm. It can be intuitive to show the error caused by the operation of clinical doctors. Reference to the accuracy requirements of different operation in the Department of orthopedics, the method can be apply to the bone reduction and the anterior cruciate ligament surgery.

  9. Tensor Fusion Network for Multimodal Sentiment Analysis

    OpenAIRE

    Zadeh, Amir; Chen, Minghai; Poria, Soujanya; Cambria, Erik; Morency, Louis-Philippe

    2017-01-01

    Multimodal sentiment analysis is an increasingly popular research area, which extends the conventional language-based definition of sentiment analysis to a multimodal setup where other relevant modalities accompany language. In this paper, we pose the problem of multimodal sentiment analysis as modeling intra-modality and inter-modality dynamics. We introduce a novel model, termed Tensor Fusion Network, which learns both such dynamics end-to-end. The proposed approach is tailored for the vola...

  10. MRI to X-ray mammography intensity-based registration with simultaneous optimisation of pose and biomechanical transformation parameters.

    Science.gov (United States)

    Mertzanidou, Thomy; Hipwell, John; Johnsen, Stian; Han, Lianghao; Eiben, Bjoern; Taylor, Zeike; Ourselin, Sebastien; Huisman, Henkjan; Mann, Ritse; Bick, Ulrich; Karssemeijer, Nico; Hawkes, David

    2014-05-01

    Determining corresponding regions between an MRI and an X-ray mammogram is a clinically useful task that is challenging for radiologists due to the large deformation that the breast undergoes between the two image acquisitions. In this work we propose an intensity-based image registration framework, where the biomechanical transformation model parameters and the rigid-body transformation parameters are optimised simultaneously. Patient-specific biomechanical modelling of the breast derived from diagnostic, prone MRI has been previously used for this task. However, the high computational time associated with breast compression simulation using commercial packages, did not allow the optimisation of both pose and FEM parameters in the same framework. We use a fast explicit Finite Element (FE) solver that runs on a graphics card, enabling the FEM-based transformation model to be fully integrated into the optimisation scheme. The transformation model has seven degrees of freedom, which include parameters for both the initial rigid-body pose of the breast prior to mammographic compression, and those of the biomechanical model. The framework was tested on ten clinical cases and the results were compared against an affine transformation model, previously proposed for the same task. The mean registration error was 11.6±3.8mm for the CC and 11±5.4mm for the MLO view registrations, indicating that this could be a useful clinical tool. Copyright © 2014 The Authors. Published by Elsevier B.V. All rights reserved.

  11. A molecular modeling based method to predict elution behavior and binding patches of proteins in multimodal chromatography.

    Science.gov (United States)

    Banerjee, Suvrajit; Parimal, Siddharth; Cramer, Steven M

    2017-08-18

    Multimodal (MM) chromatography provides a powerful means to enhance the selectivity of protein separations by taking advantage of multiple weak interactions that include electrostatic, hydrophobic and van der Waals interactions. In order to increase our understanding of such phenomena, a computationally efficient approach was developed that combines short molecular dynamics simulations and continuum solvent based coarse-grained free energy calculations in order to study the binding of proteins to Self Assembled Monolayers (SAM) presenting MM ligands. Using this method, the free energies of protein-MM SAM binding over a range of incident orientations of the protein can be determined. The resulting free energies were then examined to identify the more "strongly bound" orientations of different proteins with two multimodal surfaces. The overall free energy of protein-MM surface binding was then determined and correlated to retention factors from isocratic chromatography. This correlation, combined with analytical expressions from the literature, was then employed to predict protein gradient elution salt concentrations as well as selectivity reversals with different MM resin systems. Patches on protein surfaces that interacted strongly with MM surfaces were also identified by determining the frequency of heavy atom contacts with the atoms of the MM SAMs. A comparison of these patches to Electrostatic Potential and hydrophobicity maps indicated that while all of these patches contained significant positive charge, only the highest frequency sites also possessed hydrophobicity. The ability to identify key binding patches on proteins may have significant impact on process development for the separation of bioproduct related impurities. Copyright © 2017 Elsevier B.V. All rights reserved.

  12. Inter-slice bidirectional registration-based segmentation of the prostate gland in MR and CT image sequences

    International Nuclear Information System (INIS)

    Khalvati, Farzad; Tizhoosh, Hamid R.; Salmanpour, Aryan; Rahnamayan, Shahryar; Rodrigues, George

    2013-01-01

    Purpose: Accurate segmentation and volume estimation of the prostate gland in magnetic resonance (MR) and computed tomography (CT) images are necessary steps in diagnosis, treatment, and monitoring of prostate cancer. This paper presents an algorithm for the prostate gland volume estimation based on the semiautomated segmentation of individual slices in T2-weighted MR and CT image sequences. Methods: The proposedInter-Slice Bidirectional Registration-based Segmentation (iBRS) algorithm relies on interslice image registration of volume data to segment the prostate gland without the use of an anatomical atlas. It requires the user to mark only three slices in a given volume dataset, i.e., the first, middle, and last slices. Next, the proposed algorithm uses a registration algorithm to autosegment the remaining slices. We conducted comprehensive experiments to measure the performance of the proposed algorithm using three registration methods (i.e., rigid, affine, and nonrigid techniques). Results: The results with the proposed technique were compared with manual marking using prostate MR and CT images from 117 patients. Manual marking was performed by an expert user for all 117 patients. The median accuracies for individual slices measured using the Dice similarity coefficient (DSC) were 92% and 91% for MR and CT images, respectively. The iBRS algorithm was also evaluated regarding user variability, which confirmed that the algorithm was robust to interuser variability when marking the prostate gland. Conclusions: The proposed algorithm exploits the interslice data redundancy of the images in a volume dataset of MR and CT images and eliminates the need for an atlas, minimizing the computational cost while producing highly accurate results which are robust to interuser variability

  13. Inter-slice bidirectional registration-based segmentation of the prostate gland in MR and CT image sequences

    Energy Technology Data Exchange (ETDEWEB)

    Khalvati, Farzad, E-mail: farzad.khalvati@uwaterloo.ca; Tizhoosh, Hamid R. [Department of Systems Design Engineering, University of Waterloo, Waterloo, Ontario N2L 3G1 (Canada); Salmanpour, Aryan; Rahnamayan, Shahryar [Department of Engineering and Applied Science, University of Ontario Institute of Technology, Oshawa, Ontario L1H 7K4 (Canada); Rodrigues, George [Department of Radiation Oncology, London Regional Cancer Program, London, Ontario N6C 2R6, Canada and Department of Epidemiology/Biostatistics, University of Western Ontario, London, Ontario N6A 3K7 (Canada)

    2013-12-15

    Purpose: Accurate segmentation and volume estimation of the prostate gland in magnetic resonance (MR) and computed tomography (CT) images are necessary steps in diagnosis, treatment, and monitoring of prostate cancer. This paper presents an algorithm for the prostate gland volume estimation based on the semiautomated segmentation of individual slices in T2-weighted MR and CT image sequences. Methods: The proposedInter-Slice Bidirectional Registration-based Segmentation (iBRS) algorithm relies on interslice image registration of volume data to segment the prostate gland without the use of an anatomical atlas. It requires the user to mark only three slices in a given volume dataset, i.e., the first, middle, and last slices. Next, the proposed algorithm uses a registration algorithm to autosegment the remaining slices. We conducted comprehensive experiments to measure the performance of the proposed algorithm using three registration methods (i.e., rigid, affine, and nonrigid techniques). Results: The results with the proposed technique were compared with manual marking using prostate MR and CT images from 117 patients. Manual marking was performed by an expert user for all 117 patients. The median accuracies for individual slices measured using the Dice similarity coefficient (DSC) were 92% and 91% for MR and CT images, respectively. The iBRS algorithm was also evaluated regarding user variability, which confirmed that the algorithm was robust to interuser variability when marking the prostate gland. Conclusions: The proposed algorithm exploits the interslice data redundancy of the images in a volume dataset of MR and CT images and eliminates the need for an atlas, minimizing the computational cost while producing highly accurate results which are robust to interuser variability.

  14. Clinical significance of creative 3D-image fusion across multimodalities [PET + CT + MR] based on characteristic coregistration

    International Nuclear Information System (INIS)

    Peng, Matthew Jian-qiao; Ju Xiangyang; Khambay, Balvinder S.; Ayoub, Ashraf F.; Chen, Chin-Tu; Bai Bo

    2012-01-01

    Objective: To investigate a registration approach for 2-dimension (2D) based on characteristic localization to achieve 3-dimension (3D) fusion from images of PET, CT and MR one by one. Method: A cubic oriented scheme of“9-point and 3-plane” for co-registration design was verified to be geometrically practical. After acquisiting DICOM data of PET/CT/MR (directed by radiotracer 18 F-FDG etc.), through 3D reconstruction and virtual dissection, human internal feature points were sorted to combine with preselected external feature points for matching process. By following the procedure of feature extraction and image mapping, “picking points to form planes” and “picking planes for segmentation” were executed. Eventually, image fusion was implemented at real-time workstation mimics based on auto-fuse techniques so called “information exchange” and “signal overlay”. Result: The 2D and 3D images fused across modalities of [CT + MR], [PET + MR], [PET + CT] and [PET + CT + MR] were tested on data of patients suffered from tumors. Complementary 2D/3D images simultaneously presenting metabolic activities and anatomic structures were created with detectable-rate of 70%, 56%, 54% (or 98%) and 44% with no significant difference for each in statistics. Conclusion: Currently, based on the condition that there is no complete hybrid detector integrated of triple-module [PET + CT + MR] internationally, this sort of multiple modality fusion is doubtlessly an essential complement for the existing function of single modality imaging.

  15. Co-Registration of Terrestrial and Uav-Based Images - Experimental Results

    Science.gov (United States)

    Gerke, M.; Nex, F.; Jende, P.

    2016-03-01

    For many applications within urban environments the combined use of images taken from the ground and from unmanned aerial platforms seems interesting: while from the airborne perspective the upper parts of objects including roofs can be observed, the ground images can complement the data from lateral views to retrieve a complete visualisation or 3D reconstruction of interesting areas. The automatic co-registration of air- and ground-based images is still a challenge and cannot be considered solved. The main obstacle is originating from the fact that objects are photographed from quite different angles, and hence state-of-the-art tie point measurement approaches cannot cope with the induced perspective transformation. One first important step towards a solution is to use airborne images taken under slant directions. Those oblique views not only help to connect vertical images and horizontal views but also provide image information from 3D-structures not visible from the other two directions. According to our experience, however, still a good planning and many images taken under different viewing angles are needed to support an automatic matching across all images and complete bundle block adjustment. Nevertheless, the entire process is still quite sensible - the removal of a single image might lead to a completely different or wrong solution, or separation of image blocks. In this paper we analyse the impact different parameters and strategies have on the solution. Those are a) the used tie point matcher, b) the used software for bundle adjustment. Using the data provided in the context of the ISPRS benchmark on multi-platform photogrammetry, we systematically address the mentioned influences. Concerning the tie-point matching we test the standard SIFT point extractor and descriptor, but also the SURF and ASIFT-approaches, the ORB technique, as well as (A)KAZE, which are based on a nonlinear scale space. In terms of pre-processing we analyse the Wallis

  16. CO-REGISTRATION OF TERRESTRIAL AND UAV-BASED IMAGES – EXPERIMENTAL RESULTS

    Directory of Open Access Journals (Sweden)

    M. Gerke

    2016-03-01

    Full Text Available For many applications within urban environments the combined use of images taken from the ground and from unmanned aerial platforms seems interesting: while from the airborne perspective the upper parts of objects including roofs can be observed, the ground images can complement the data from lateral views to retrieve a complete visualisation or 3D reconstruction of interesting areas. The automatic co-registration of air- and ground-based images is still a challenge and cannot be considered solved. The main obstacle is originating from the fact that objects are photographed from quite different angles, and hence state-of-the-art tie point measurement approaches cannot cope with the induced perspective transformation. One first important step towards a solution is to use airborne images taken under slant directions. Those oblique views not only help to connect vertical images and horizontal views but also provide image information from 3D-structures not visible from the other two directions. According to our experience, however, still a good planning and many images taken under different viewing angles are needed to support an automatic matching across all images and complete bundle block adjustment. Nevertheless, the entire process is still quite sensible – the removal of a single image might lead to a completely different or wrong solution, or separation of image blocks. In this paper we analyse the impact different parameters and strategies have on the solution. Those are a the used tie point matcher, b the used software for bundle adjustment. Using the data provided in the context of the ISPRS benchmark on multi-platform photogrammetry, we systematically address the mentioned influences. Concerning the tie-point matching we test the standard SIFT point extractor and descriptor, but also the SURF and ASIFT-approaches, the ORB technique, as well as (AKAZE, which are based on a nonlinear scale space. In terms of pre-processing we analyse the

  17. Multimodal eye recognition

    Science.gov (United States)

    Zhou, Zhi; Du, Yingzi; Thomas, N. L.; Delp, Edward J., III

    2010-04-01

    Multimodal biometrics use more than one means of biometric identification to achieve higher recognition accuracy, since sometimes a unimodal biometric is not good enough used to do identification and classification. In this paper, we proposed a multimodal eye recognition system, which can obtain both iris and sclera patterns from one color eye image. Gabor filter and 1-D Log-Gabor filter algorithms have been applied as the iris recognition algorithms. In sclera recognition, we introduced automatic sclera segmentation, sclera pattern enhancement, sclera pattern template generation, and sclera pattern matching. We applied kernelbased matching score fusion to improve the performance of the eye recognition system. The experimental results show that the proposed eye recognition method can achieve better performance compared to unimodal biometric identification, and the accuracy of our proposed kernel-based matching score fusion method is higher than two classic linear matching score fusion methods: Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA).

  18. A Fuzzy-Based Fusion Method of Multimodal Sensor-Based Measurements for the Quantitative Evaluation of Eye Fatigue on 3D Displays

    Directory of Open Access Journals (Sweden)

    Jae Won Bang

    2015-05-01

    Full Text Available With the rapid increase of 3-dimensional (3D content, considerable research related to the 3D human factor has been undertaken for quantitatively evaluating visual discomfort, including eye fatigue and dizziness, caused by viewing 3D content. Various modalities such as electroencephalograms (EEGs, biomedical signals, and eye responses have been investigated. However, the majority of the previous research has analyzed each modality separately to measure user eye fatigue. This cannot guarantee the credibility of the resulting eye fatigue evaluations. Therefore, we propose a new method for quantitatively evaluating eye fatigue related to 3D content by combining multimodal measurements. This research is novel for the following four reasons: first, for the evaluation of eye fatigue with high credibility on 3D displays, a fuzzy-based fusion method (FBFM is proposed based on the multimodalities of EEG signals, eye blinking rate (BR, facial temperature (FT, and subjective evaluation (SE; second, to measure a more accurate variation of eye fatigue (before and after watching a 3D display, we obtain the quality scores of EEG signals, eye BR, FT and SE; third, for combining the values of the four modalities we obtain the optimal weights of the EEG signals BR, FT and SE using a fuzzy system based on quality scores; fourth, the quantitative level of the variation of eye fatigue is finally obtained using the weighted sum of the values measured by the four modalities. Experimental results confirm that the effectiveness of the proposed FBFM is greater than other conventional multimodal measurements. Moreover, the credibility of the variations of the eye fatigue using the FBFM before and after watching the 3D display is proven using a t-test and descriptive statistical analysis using effect size.

  19. Pulmonary nodule registration in serial CT scans based on rib anatomy and nodule template matching

    International Nuclear Information System (INIS)

    Shi Jiazheng; Sahiner, Berkman; Chan, H.-P.; Hadjiiski, Lubomir; Zhou, C.; Cascade, Philip N.; Bogot, Naama; Kazerooni, Ella A.; Wu, Y.-T.; Wei, J.

    2007-01-01

    An automated method is being developed in order to identify corresponding nodules in serial thoracic CT scans for interval change analysis. The method uses the rib centerlines as the reference for initial nodule registration. A spatially adaptive rib segmentation method first locates the regions where the ribs join the spine, which define the starting locations for rib tracking. Each rib is tracked and locally segmented by expectation-maximization. The ribs are automatically labeled, and the centerlines are estimated using skeletonization. For a given nodule in the source scan, the closest three ribs are identified. A three-dimensional (3D) rigid affine transformation guided by simplex optimization aligns the centerlines of each of the three rib pairs in the source and target CT volumes. Automatically defined control points along the centerlines of the three ribs in the source scan and the registered ribs in the target scan are used to guide an initial registration using a second 3D rigid affine transformation. A search volume of interest (VOI) is then located in the target scan. Nodule candidate locations within the search VOI are identified as regions with high Hessian responses. The initial registration is refined by searching for the maximum cross-correlation between the nodule template from the source scan and the candidate locations. The method was evaluated on 48 CT scans from 20 patients. Experienced radiologists identified 101 pairs of corresponding nodules. Three metrics were used for performance evaluation. The first metric was the Euclidean distance between the nodule centers identified by the radiologist and the computer registration, the second metric was a volume overlap measure between the nodule VOIs identified by the radiologist and the computer registration, and the third metric was the hit rate, which measures the fraction of nodules whose centroid computed by the computer registration in the target scan falls within the VOI identified by the

  20. Comparison of DCT, SVD and BFOA based multimodal biometric watermarking system

    Directory of Open Access Journals (Sweden)

    S. Anu H. Nair

    2015-12-01

    Full Text Available Digital image watermarking is a major domain for hiding the biometric information, in which the watermark data are made to be concealed inside a host image imposing imperceptible change in the picture. Due to the advance in digital image watermarking, the majority of research aims to make a reliable improvement in robustness to prevent the attack. The reversible invisible watermarking scheme is used for fingerprint and iris multimodal biometric system. A novel approach is used for fusing different biometric modalities. Individual unique modalities of fingerprint and iris biometric are extracted and fused using different fusion techniques. The performance of different fusion techniques is evaluated and the Discrete Wavelet Transform fusion method is identified as the best. Then the best fused biometric template is watermarked into a cover image. The various watermarking techniques such as the Discrete Cosine Transform (DCT, Singular Value Decomposition (SVD and Bacterial Foraging Optimization Algorithm (BFOA are implemented to the fused biometric feature image. Performance of watermarking systems is compared using different metrics. It is found that the watermarked images are found robust over different attacks and they are able to reverse the biometric template for Bacterial Foraging Optimization Algorithm (BFOA watermarking technique.

  1. Filterless low-phase-noise frequency-quadrupled microwave generation based on a multimode optoelectronic oscillator

    Science.gov (United States)

    Teng, Yichao; Zhang, Pin; Zhang, Baofu; Chen, Yiwang

    2018-02-01

    A scheme to realize low-phase-noise frequency-quadrupled microwave generation without any filter is demonstrated. In this scheme, a multimode optoelectronic oscillator is mainly contributed by dual-parallel Mach-Zehnder modulators, fiber, photodetector, and microwave amplifier. The local source signal is modulated by a child MZM (MZMa), which is worked at maximum transmission point. Through properly adjusting the bias voltages of the other child MZM (MZMb) and the parent MZM (MZMc), optical carrier is effectively suppressed and second sidebands are retained, then the survived optical signal is fed back to the photodetector and MZMb to form an optoelectronic hybrid resonator and realize frequency-quadrupled signal generation. Due to the high Q-factor and mode selection effect of the optoelectronic hybrid resonator, compared with the source signal, the generated frequency-quadrupled signal has a lower phase noise. The approach has verified by experiments, and 18, 22, and 26 GHz frequency-quadrupled signal are generated by 4.5, 5.5, and 6.5 GHz local source signals. Compared with 4.5 GHz source signal, the phase noise of generated 18 GHz signal at 10 kHz frequency offset has 26.5 dB reduction.

  2. MO-DE-202-04: Multimodality Image-Guided Surgery and Intervention: For the Rest of Us

    International Nuclear Information System (INIS)

    Shekhar, R.

    2016-01-01

    At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504

  3. Constraint-based simulation for non-rigid real-time registration.

    Science.gov (United States)

    Courtecuisse, Hadrien; Peterlik, Igor; Trivisonne, Raffaella; Duriez, Christian; Cotin, Stéphane

    2014-01-01

    In this paper we propose a method to address the problem of non-rigid registration in real-time. We use Lagrange multipliers and soft sliding constraints to combine data acquired from dynamic image sequence and a biomechanical model of the structure of interest. The biomechanical model plays a role of regularization to improve the robustness and the flexibility of the registration. We apply our method to a pre-operative 3D CT scan of a porcine liver that is registered to a sequence of 2D dynamic MRI slices during the respiratory motion. The finite element simulation provides a full 3D representation (including heterogeneities such as vessels, tumor,...) of the anatomical structure in real-time.

  4. [The characteristics of falls based on the prospective registration in nursing home].

    Science.gov (United States)

    Szczerbińska, Katarzyna; Topór-Madry, Roman

    2011-01-01

    Knowledge of the most frequent circumstances of falls is crucial from a doctor's, nurse's or caregiver's point of view, as it allows them to anticipate the threat of a fall and to take appropriate precautionary measures. It is for this reason that a fall registration system has been developed within the EUNESE (EUropean NEtwork for Safety among Elderly) international project, and then introduced in 4 nursing homes (NH) for older and chronically ill people and for chronic psychiatric patients. The article presents the results of a year's registration of falls in these facilities, also describing the typical features of the falls, considering the type of NH. The study revealed that the falls occured most frequently in a resident's room, while walking or getting up from a bed, chair, wheelchair or toilet seat, as a result of tripping or slipping on slippery, wet or insufficiently illuminated floor, in connection with gait or balance disorder, dizziness, agitation or taking particular medicines. The most frequent results of falls were head injuries, hematomas, skin abrasions and lacerations. Less than 10% of falls required intervention of a family doctor, ambulance or hospitalization. In NHs for psychiatric patients the falls more often resulted in injuries, took place outside the facility building, and were connected to psychomotor agitation, taking psychotropic and anticonvulsant medicines. In NHs for elderly and chronically ill people, on the other hand, falls during sitting down and connected to taking cardiological medicines were recorded more frequently. The fall registration chart, developed within the EUNESE project, is a tool that allows to provide a detailed description of the incident: the cause of the fall, its course and consequences. It may also be used as a starting point for elaborating internal systems of fall registration in long term care facilities, as well as preventive measures against the falls.

  5. SU-E-J-263: Dosimetric Analysis On Breast Brachytherapy Based On Deformable Image Registration

    Energy Technology Data Exchange (ETDEWEB)

    Chen, T; Nie, K; Narra, V; Zou, J; Zhang, M; Khan, A; Haffty, B; Yue, N [Rutgers - Cancer Institute of New Jersey, New Brunswick, NJ (United States)

    2014-06-01

    Purpose: To quantitatively compare and evaluate the dosimetry difference between breast brachytherapy protocols with different fractionation using deformable image registration. Methods: The accumulative dose distribution for multiple breast brachytherapy patients using four different applicators: Contura, Mammosite, Savi, and interstitial catheters, under two treatment protocols: 340cGy by 10 fractions in 5 days and 825cGy by 3 fractions in 2days has been reconstructed using a two stage deformable image registration approach. For all patients, daily CT was acquired with the same slice thickness (2.5mm). In the first stage, the daily CT images were rigidly registered to the initial planning CT using the registration module in Eclipse (Varian) to align the applicators. In the second stage, the tissues surrounding the applicator in the rigidly registered daily CT image were non-rigidly registered to the initial CT using a combination of image force and the local constraint that enforce zero normal motion on the surface of the applicator, using a software developed in house. We calculated the dose distribution in the daily CTs and deformed them using the final registration to convert into the image domain of the initial planning CT. The accumulative dose distributions were evaluated by dosimetry parameters including D90, V150 and V200, as well as DVH. Results: Dose reconstruction results showed that the two day treatment has a significant dosimetry improvement over the five day protocols. An average daily drop of D90 at 1.3% of the prescription dose has been observed on multiple brachytherapy patients. There is no significant difference on V150 and V200 between those two protocols. Conclusion: Brachytherapy with higher fractional dose and less fractions has an improved performance on being conformal to the dose distribution in the initial plan. Elongated brachytherapy treatments need to consider the dose uncertainty caused by the temporal changes of the soft tissue.

  6. Contrast-Based 3D/2D Registration of the Left Atrium: Fast versus Consistent

    Directory of Open Access Journals (Sweden)

    Matthias Hoffmann

    2016-01-01

    Full Text Available For augmented fluoroscopy during cardiac ablation, a preoperatively acquired 3D model of a patient’s left atrium (LA can be registered to X-ray images recorded during a contrast agent (CA injection. An automatic registration method that works also for small amounts of CA is desired. We propose two similarity measures: The first focuses on edges of the patient anatomy. The second computes a contrast agent distribution estimate (CADE inside the 3D model and rates its consistency with the CA as seen in biplane fluoroscopic images. Moreover, temporal filtering on the obtained registration results of a sequence is applied using a Markov chain framework. Evaluation was performed on 11 well-contrasted clinical angiographic sequences and 10 additional sequences with less CA. For well-contrasted sequences, the error for all 73 frames was 7.9 ± 6.3 mm and it dropped to 4.6 ± 4.0 mm when registering to an automatically selected, well enhanced frame in each sequence. Temporal filtering reduced the error for all frames from 7.9 ± 6.3 mm to 5.7 ± 4.6 mm. The error was typically higher if less CA was used. A combination of both similarity measures outperforms a previously proposed similarity measure. The mean accuracy for well contrasted sequences is in the range of other proposed manual registration methods.

  7. Study on Low Illumination Simultaneous Polarization Image Registration Based on Improved SURF Algorithm

    Science.gov (United States)

    Zhang, Wanjun; Yang, Xu

    2017-12-01

    Registration of simultaneous polarization images is the premise of subsequent image fusion operations. However, in the process of shooting all-weather, the polarized camera exposure time need to be kept unchanged, sometimes polarization images under low illumination conditions due to too dark result in SURF algorithm can not extract feature points, thus unable to complete the registration, therefore this paper proposes an improved SURF algorithm. Firstly, the luminance operator is used to improve overall brightness of low illumination image, and then create integral image, using Hession matrix to extract the points of interest to get the main direction of characteristic points, calculate Haar wavelet response in X and Y directions to get the SURF descriptor information, then use the RANSAC function to make precise matching, the function can eliminate wrong matching points and improve accuracy rate. And finally resume the brightness of the polarized image after registration, the effect of the polarized image is not affected. Results show that the improved SURF algorithm can be applied well under low illumination conditions.

  8. Automatic registration of terrestrial point clouds based on panoramic reflectance images and efficient BaySAC

    Science.gov (United States)

    Kang, Zhizhong

    2013-10-01

    This paper presents a new approach to automatic registration of terrestrial laser scanning (TLS) point clouds utilizing a novel robust estimation method by an efficient BaySAC (BAYes SAmpling Consensus). The proposed method directly generates reflectance images from 3D point clouds, and then using SIFT algorithm extracts keypoints to identify corresponding image points. The 3D corresponding points, from which transformation parameters between point clouds are computed, are acquired by mapping the 2D ones onto the point cloud. To remove false accepted correspondences, we implement a conditional sampling method to select the n data points with the highest inlier probabilities as a hypothesis set and update the inlier probabilities of each data point using simplified Bayes' rule for the purpose of improving the computation efficiency. The prior probability is estimated by the verification of the distance invariance between correspondences. The proposed approach is tested on four data sets acquired by three different scanners. The results show that, comparing with the performance of RANSAC, BaySAC leads to less iterations and cheaper computation cost when the hypothesis set is contaminated with more outliers. The registration results also indicate that, the proposed algorithm can achieve high registration accuracy on all experimental datasets.

  9. Visible and infrared image registration algorithm based on NSCT and gradient mirroring

    Science.gov (United States)

    Huang, Qingqing; Gao, Qiong; Yang, Jian; Chen, Jiansheng; Song, Zhanjie

    2014-11-01

    Multi-sensor image registration is an important part of the remote sensing image processing. The gray property of the same object would have large differences in infrared and visible imaging mode, so it could get less matching points by using traditional SIFT algorithm directly in registration. However, NSCT decomposition can represent the structural information of the image very well and extract more SIFT feature points in its high frequency decomposed image. In addition, traditional SIFT descriptors' gradient is affected by gray contrast, which could get less feature matching points during the similarity search in the matching procedure. Gradient mirroring (GM) is a method that can modify the direction of the feature points, which can reduce the contrast impact on the similarity matching. Therefore, a novel method combining NSCT and GM is proposed in this article. The experiments prove that, comparing with the traditional SIFT algorithm, the new method can get more matching points, better distributing and higher matching rate in infrared and visible image registration.

  10. 3D ultrasound-CT registration of the liver using combined landmark-intensity information

    International Nuclear Information System (INIS)

    Lange, Thomas; Schlag, Peter M.; Papenberg, Nils; Heldmann, Stefan; Modersitzki, Jan; Fischer, Bernd; Lamecker, Hans

    2009-01-01

    An important issue in computer-assisted surgery of the liver is a fast and reliable transfer of preoperative resection plans to the intraoperative situation. One problem is to match the planning data, derived from preoperative CT or MR images, with 3D ultrasound images of the liver, acquired during surgery. As the liver deforms significantly in the intraoperative situation non-rigid registration is necessary. This is a particularly challenging task because pre- and intraoperative image data stem from different modalities and ultrasound images are generally very noisy. One way to overcome these problems is to incorporate prior knowledge into the registration process. We propose a method of combining anatomical landmark information with a fast non-parametric intensity registration approach. Mathematically, this leads to a constrained optimization problem. As distance measure we use the normalized gradient field which allows for multimodal image registration. A qualitative and quantitative validation on clinical liver data sets of three different patients has been performed. We used the distance of dense corresponding points on vessel center lines for quantitative validation. The combined landmark and intensity approach improves the mean and percentage of point distances above 3 mm compared to rigid and thin-plate spline registration based only on landmarks. The proposed algorithm offers the possibility to incorporate additional a priori knowledge - in terms of few landmarks - provided by a human expert into a non-rigid registration process. (orig.)

  11. Multi-mode optical fibers for connecting space-based spectrometers

    Science.gov (United States)

    Roberts, W. T.; Lindenmisth, C. A.; Bender, S.; Miller, E. A.; Motts, E.; Ott, M.; LaRocca, F.; Thomes, J.

    2017-11-01

    significantly smaller, less massive and less robust. Large core multi-mode optical fibers are often used to accommodate the optical connection of the two separated portions of such instrumentation. In some cases, significant throughput efficiency improvement can be realized by judiciously orienting the strands of multi-fiber cable, close-bunching them to accommodate a tight focus of the optical system on the optical side of the connection, and splaying them out linearly along a spectrometer slit on the other end. For such instrumentation to work effectively in identifying elements and molecules, and especially to produce accurate quantitative results, the spectral throughput of the optical fiber connection must be consistent over varying temperatures, over the range of motion of the optical head (and it's implied optical cable stresses), and over angle-aperture invariant of the total system. While the first two of these conditions have been demonstrated[4], spectral observations of the latter present a cause for concern, and may have an impact on future design of fiber-connected LIBS and Raman spectroscopy instruments. In short, we have observed that the shape of the spectral efficiency curve of a large multi-mode core optical fiber changes as a function of input angle.

  12. Easily processable multimodal spectral converters based on metal oxide/organic—inorganic hybrid nanocomposites

    Science.gov (United States)

    Julián-López, Beatriz; Gonell, Francisco; Lima, Patricia P.; Freitas, Vânia T.; André, Paulo S.; Carlos, Luis D.; Ferreira, Rute A. S.

    2015-10-01

    This manuscript reports the synthesis and characterization of the first organic-inorganic hybrid material exhibiting efficient multimodal spectral converting properties. The nanocomposite, made of Er3+, Yb3+ codoped zirconia nanoparticles (NPs) entrapped in a di-ureasil d-U(600) hybrid matrix, is prepared by an easy two-step sol-gel synthesis leading to homogeneous and transparent materials that can be very easily processed as monolith or film. Extensive structural characterization reveals that zirconia nanocrystals of 10-20 nm in size are efficiently dispersed into the hybrid matrix and that the local structure of the di-ureasil is not affected by the presence of the NPs. A significant enhancement in the refractive index of the di-ureasil matrix with the incorporation of the ZrO2 nanocrystals is observed. The optical study demonstrates that luminescent properties of both constituents are perfectly preserved in the final hybrid. Thus, the material displays a white-light photoluminescence from the di-ureasil component upon excitation at UV/visible radiation and also intense green and red emissions from the Er3+- and Yb3+-doped NPs after NIR excitation. The dynamics of the optical processes were also studied as a function of the lanthanide content and the thickness of the films. Our results indicate that these luminescent hybrids represent a low-cost, environmentally friendly, size-controlled, easily processed and chemically stable alternative material to be used in light harvesting devices such as luminescent solar concentrators, optical fibres and sensors. Furthermore, this synthetic approach can be extended to a wide variety of luminescent NPs entrapped in hybrid matrices, thus leading to multifunctional and versatile materials for efficient tuneable nonlinear optical nanodevices.

  13. Experimental and numerical study on refractive index sensors based on fibre Bragg gratings inscribed in multimode fibre

    Science.gov (United States)

    Filipe Kuhne, Jean; Rocha, Ana Maria; de Oliveira, Valmir; José Kalinowski, Hypolito; Canute Kamikawachi, Ricardo

    2018-02-01

    In this work is reported the experimental and numerical results of the refractive index response of etched fibre Bragg gratings written in a graded index multimode fibre. The responses of the modes coupled by the grating inscribed in a multimode fibre are compared with the mode coupled by a grating inscribed in single mode fibre. The results of this study show that the refractive index sensitivity and the dynamical range of etched fibre Bragg gratings written in multimode fibres are higher than the ones verified in single-mode fibres. The determination of oil-biodiesel blend concentrations are also compared as an example of practical applications. It is shown that a greater core diameter of the multimode fibre enables the Bragg gratings to exhibit enhanced sensitivity without requiring further fibre diameter reduction.

  14. A novel registration-based methodology for prediction of trabecular bone fabric from clinical QCT: A comprehensive analysis.

    Science.gov (United States)

    Chandran, Vimal; Reyes, Mauricio; Zysset, Philippe

    2017-01-01

    Osteoporosis leads to hip fractures in aging populations and is diagnosed by modern medical imaging techniques such as quantitative computed tomography (QCT). Hip fracture sites involve trabecular bone, whose strength is determined by volume fraction and orientation, known as fabric. However, bone fabric cannot be reliably assessed in clinical QCT images of proximal femur. Accordingly, we propose a novel registration-based estimation of bone fabric designed to preserve tensor properties of bone fabric and to map bone fabric by a global and local decomposition of the gradient of a non-rigid image registration transformation. Furthermore, no comprehensive analysis on the critical components of this methodology has been previously conducted. Hence, the aim of this work was to identify the best registration-based strategy to assign bone fabric to the QCT image of a patient's proximal femur. The normalized correlation coefficient and curvature-based regularization were used for image-based registration and the Frobenius norm of the stretch tensor of the local gradient was selected to quantify the distance among the proximal femora in the population. Based on this distance, closest, farthest and mean femora with a distinction of sex were chosen as alternative atlases to evaluate their influence on bone fabric prediction. Second, we analyzed different tensor mapping schemes for bone fabric prediction: identity, rotation-only, rotation and stretch tensor. Third, we investigated the use of a population average fabric atlas. A leave one out (LOO) evaluation study was performed with a dual QCT and HR-pQCT database of 36 pairs of human femora. The quality of the fabric prediction was assessed with three metrics, the tensor norm (TN) error, the degree of anisotropy (DA) error and the angular deviation of the principal tensor direction (PTD). The closest femur atlas (CTP) with a full rotation (CR) for fabric mapping delivered the best results with a TN error of 7.3 ± 0.9%, a DA

  15. Multi-Mode Estimation for Small Fixed Wing Unmanned Aerial Vehicle Localization Based on a Linear Matrix Inequality Approach.

    Science.gov (United States)

    Elzoghby, Mostafa; Li, Fu; Arafa, Ibrahim I; Arif, Usman

    2017-04-18

    Information fusion from multiple sensors ensures the accuracy and robustness of a navigation system, especially in the absence of global positioning system (GPS) data which gets degraded in many cases. A way to deal with multi-mode estimation for a small fixed wing unmanned aerial vehicle (UAV) localization framework is proposed, which depends on utilizing a Luenberger observer-based linear matrix inequality (LMI) approach. The proposed estimation technique relies on the interaction between multiple measurement modes and a continuous observer. The state estimation is performed in a switching environment between multiple active sensors to exploit the available information as much as possible, especially in GPS-denied environments. Luenberger observer-based projection is implemented as a continuous observer to optimize the estimation performance. The observer gain might be chosen by solving a Lyapunov equation by means of a LMI algorithm. Convergence is achieved by utilizing the linear matrix inequality (LMI), based on Lyapunov stability which keeps the dynamic estimation error bounded by selecting the observer gain matrix (L). Simulation results are presented for a small UAV fixed wing localization problem. The results obtained using the proposed approach are compared with a single mode Extended Kalman Filter (EKF). Simulation results are presented to demonstrate the viability of the proposed strategy.

  16. An Entropy-Based Upper Bound Methodology for Robust Predictive Multi-Mode RCPSP Schedules

    Directory of Open Access Journals (Sweden)

    Angela Hsiang-Ling Chen

    2014-09-01

    Full Text Available Projects are an important part of our activities and regardless of their magnitude, scheduling is at the very core of every project. In an ideal world makespan minimization, which is the most commonly sought objective, would give us an advantage. However, every time we execute a project we have to deal with uncertainty; part of it coming from known sources and part remaining unknown until it affects us. For this reason, it is much more practical to focus on making our schedules robust, capable of handling uncertainty, and even to determine a range in which the project could be completed. In this paper we focus on an approach to determine such a range for the Multi-mode Resource Constrained Project Scheduling Problem (MRCPSP, a widely researched, NP-complete problem, but without adding any subjective considerations to its estimation. We do this by using a concept well known in the domain of thermodynamics, entropy and a three-stage approach. First we use Artificial Bee Colony (ABC—an effective and powerful meta-heuristic—to determine a schedule with minimized makespan which serves as a lower bound. The second stage defines buffer times and creates an upper bound makespan using an entropy function, with the advantage over other methods that it only considers elements which are inherent to the schedule itself and does not introduce any subjectivity to the buffer time generation. In the last stage, we use the ABC algorithm with an objective function that seeks to maximize robustness while staying within the makespan boundaries defined previously and in some cases even below the lower boundary. We evaluate our approach with two different benchmarks sets: when using the PSPLIB for the MRCPSP benchmark set, the computational results indicate that it is possible to generate robust schedules which generally result in an increase of less than 10% of the best known solutions while increasing the robustness in at least 20% for practically every

  17. Multi-modal Intelligent Seizure Acquisition (MISA) system - A new approach towards seizure detection based on full body motion measures

    DEFF Research Database (Denmark)

    Conradsen, Isa; Beniczky, Sándor; Wolf, Peter

    2009-01-01

    Many epilepsy patients cannot call for help during a seizure, because they are unconscious or because of the affection of their motor system or speech function. This can lead to injuries, medical complications and at worst death. An alarm system setting off at seizure onset could help to avoid ha...... is individualized (subject specific) it is able to detect all simulated seizures with a maximum of 1 false positive. Based on the results from the simulated seizures and normal movements the MISA system seems to be a promising approach to seizure detection....... hazards. Today no reliable alarm systems are available. A Multi-modal Intelligent Seizure Acquisition (MISA) system based on full body motion data seems as a good approach towards detection of epileptic seizures. The system is the first to provide a full body description for epilepsy applications. Three......) and audio and video recording. The results showed that a non-subject specific MISA system developed on data from the modalities: accelerometer (ACM), gyroscope and EMG is able to detect 98% of the simulated seizures and at the same time mistakes only 4 of the normal movements for seizures. If the system...

  18. Toward defining deep brain stimulation targets in MNI space: A subcortical atlas based on multimodal MRI, histology and structural connectivity.

    Science.gov (United States)

    Ewert, Siobhan; Plettig, Philip; Li, Ningfei; Chakravarty, M Mallar; Collins, D Louis; Herrington, Todd M; Kühn, Andrea A; Horn, Andreas

    2018-04-15

    Three-dimensional atlases of subcortical brain structures are valuable tools to reference anatomy in neuroscience and neurology. For instance, they can be used to study the position and shape of the three most common deep brain stimulation (DBS) targets, the subthalamic nucleus (STN), internal part of the pallidum (GPi) and ventral intermediate nucleus of the thalamus (VIM) in spatial relationship to DBS electrodes. Here, we present a composite atlas based on manual segmentations of a multimodal high resolution brain template, histology and structural connectivity. In a first step, four key structures were defined on the template itself using a combination of multispectral image analysis and manual segmentation. Second, these structures were used as anchor points to coregister a detailed histological atlas into standard space. Results show that this approach significantly improved coregistration accuracy over previously published methods. Finally, a sub-segmentation of STN and GPi into functional zones was achieved based on structural connectivity. The result is a composite atlas that defines key nuclei on the template itself, fills the gaps between them using histology and further subdivides them using structural connectivity. We show that the atlas can be used to segment DBS targets in single subjects, yielding more accurate results compared to priorly published atlases. The atlas will be made publicly available and constitutes a resource to study DBS electrode localizations in combination with modern neuroimaging methods. Copyright © 2017 Elsevier Inc. All rights reserved.

  19. Multimodal Nonlinear Optical Imaging of MoS₂ and MoS₂-Based van der Waals Heterostructures.

    Science.gov (United States)

    Li, Dawei; Xiong, Wei; Jiang, Lijia; Xiao, Zhiyong; Golgir, Hossein Rabiee; Wang, Mengmeng; Huang, Xi; Zhou, Yunshen; Lin, Zhe; Song, Jingfeng; Ducharme, Stephen; Jiang, Lan; Silvain, Jean-Francois; Lu, Yongfeng

    2016-03-22

    van der Waals layered structures, notably the transitional metal dichalcogenides (TMDs) and TMD-based heterostructures, have recently attracted immense interest due to their unique physical properties and potential applications in electronics, optoelectronics, and energy harvesting. Despite the recent progress, it is still a challenge to perform comprehensive characterizations of critical properties of these layered structures, including crystal structures, chemical dynamics, and interlayer coupling, using a single characterization platform. In this study, we successfully developed a multimodal nonlinear optical imaging method to characterize these critical properties of molybdenum disulfide (MoS2) and MoS2-based heterostructures. Our results demonstrate that MoS2 layers exhibit strong four-wave mixing (FWM), sum-frequency generation (SFG), and second-harmonic generation (SHG) nonlinear optical characteristics. We believe this is the first observation of FWM and SFG from TMD layers. All three kinds of optical nonlinearities are sensitive to layer numbers, crystal orientation, and interlayer coupling. The combined and simultaneous SHG/SFG-FWM imaging not only is capable of rapid evaluation of crystal quality and precise determination of odd-even layers but also provides in situ monitoring of the chemical dynamics of thermal oxidation in MoS2 and interlayer coupling in MoS2-graphene heterostructures. This method has the advantages of versatility, high fidelity, easy operation, and fast imaging, enabling comprehensive characterization of van der Waals layered structures for fundamental research and practical applications.

  20. Registration of airborne LiDAR data and aerial images based on straight lines and POS data

    Science.gov (United States)

    Du, Quanye; Xu, Biao; Cao, Hui

    2009-10-01

    This paper presents a registration method which based on straight lines primitive. Firstly, 2D straight lines are extracted from aerial images using Canny operator and straight line fitting. In the similar way, 3D straight lines are extracted from LiDAR range images which derive from laser scanning point cloud. Secondly, 3D straight lines are projected to aerial images using collinearity equations and Position and Orientation System (POS) data. Then the corresponding lines are determined by straight line error. At last, each image's new exterior orientation elements are calculated by generalized point (straight line) photogrammetry.

  1. Multi-feature-based plaque characterization in ex vivo MRI trained by registration to 3D histology

    DEFF Research Database (Denmark)

    Engelen, Arna van; Niessen, Wiro J.; Klein, Stefan

    2012-01-01

    . The ground truth for fibrous, necrotic and calcified tissue was provided by histology and micro-CT in 12 carotid plaque specimens. Semi-automatic registration of a 3D stack of histological slices and micro-CT images to MRI allowed for 3D rotations and inplane deformations of histology. By basing voxelwise...... MRI and histology slices per specimen, and (2) an approach that uses only the three corresponding MRI slices from the 3D-registered volumes. Voxelwise classification accuracy was best when all features were used (73.3 ± 6.3 %) and was significantly better than when only original intensities...

  2. Radical multimodality therapy for malignant pleural mesothelioma.

    Science.gov (United States)

    Abdel-Rahman, Omar; Elsayed, Zeinab; Mohamed, Hadeer; Eltobgy, Mostafa

    2018-01-08

    the evidence as moderate quality for overall survival and low quality for all other outcomes. One trial compared combined extrapleural pneumonectomy (EPP) plus neoadjuvant platinum-based chemotherapy plus postoperative high-dose hemithoracic radiotherapy with combined EPP plus platinum-based chemotherapy. The other trial compared EPP plus postoperative hemithoracic radiotherapy with standard (non-radical) therapy alone following platinum-based chemotherapy (patients in the standard therapy arm received continued oncological management according to local policy, which could include further chemotherapy or palliative radiotherapy).For the first trial, median overall survival calculated from registration was 20.8 months (95% confidence interval (CI) 14.4 to 27.8) in the no-radiotherapy group and 19.3 months (95% CI 11.5 to 21.8) in the radiotherapy group. For the second trial, median overall survival was 14.4 months (95% CI 5.3 to 18.7) for patients allocated to EPP and 19.5 months (95% CI 13.4 to time not yet reached) for patients randomised to standard non-radical therapy. In the second trial, 12 serious adverse events were reported during the study period: ten in the EPP group and two in the non-radical therapy group. Overall health-related quality of life scores were not different between the two arms in either study. We could not perform a meta-analysis of the two included trials due to clinical heterogeneity. We also identified three ongoing trials evaluating the topic of our review. The overall strength of the evidence gathered in this review is low and there is a lack of available evidence to support the use of radical multimodality therapy in routine clinical practice (particularly as one trial suggests greater harm). Given the added cost of multimodality treatment and the possible increase in risk of adverse effects, the lack of evidence of their effectiveness probably means that these interventions should currently be limited to clinical trials alone.

  3. Spectroelectrochemical Sensing Based on Multimode Selectivity simultaneously Achievable in a Single Device. 11. Design and Evaluation of a Small Portable Sensor for the Determination of Ferrocyanide in Hanford Waste Samples

    International Nuclear Information System (INIS)

    Stegemiller, Michael L.; Heineman, William R.; Seliskar, Carl J.; Ridgway, Thomas H.; Bryan, Samuel A.; Hubler, Timothy L.; Sell, Richard L.

    2003-01-01

    Spectroelectrochemical sensing based on multimode selectivity simultaneously achievable in a single device. 11. Design and evaluation of a small portable sensor for the determination of ferrocyanide in Hanford waste samples

  4. SU-E-J-132: Automated Segmentation with Post-Registration Atlas Selection Based On Mutual Information

    International Nuclear Information System (INIS)

    Ren, X; Gao, H; Sharp, G

    2015-01-01

    Purpose: The delineation of targets and organs-at-risk is a critical step during image-guided radiation therapy, for which manual contouring is the gold standard. However, it is often time-consuming and may suffer from intra- and inter-rater variability. The purpose of this work is to investigate the automated segmentation. Methods: The automatic segmentation here is based on mutual information (MI), with the atlas from Public Domain Database for Computational Anatomy (PDDCA) with manually drawn contours.Using dice coefficient (DC) as the quantitative measure of segmentation accuracy, we perform leave-one-out cross-validations for all PDDCA images sequentially, during which other images are registered to each chosen image and DC is computed between registered contour and ground truth. Meanwhile, six strategies, including MI, are selected to measure the image similarity, with MI to be the best. Then given a target image to be segmented and an atlas, automatic segmentation consists of: (a) the affine registration step for image positioning; (b) the active demons registration method to register the atlas to the target image; (c) the computation of MI values between the deformed atlas and the target image; (d) the weighted image fusion of three deformed atlas images with highest MI values to form the segmented contour. Results: MI was found to be the best among six studied strategies in the sense that it had the highest positive correlation between similarity measure (e.g., MI values) and DC. For automated segmentation, the weighted image fusion of three deformed atlas images with highest MI values provided the highest DC among four proposed strategies. Conclusion: MI has the highest correlation with DC, and therefore is an appropriate choice for post-registration atlas selection in atlas-based segmentation. Xuhua Ren and Hao Gao were partially supported by the NSFC (#11405105), the 973 Program (#2015CB856000) and the Shanghai Pujiang Talent Program (#14PJ1404500)

  5. Nonrigid Registration of Brain Tumor Resection MR Images Based on Joint Saliency Map and Keypoint Clustering

    Directory of Open Access Journals (Sweden)

    Binjie Qin

    2009-12-01

    Full Text Available This paper proposes a novel global-to-local nonrigid brain MR image registration to compensate for the brain shift and the unmatchable outliers caused by the tumor resection. The mutual information between the corresponding salient structures, which are enhanced by the joint saliency map (JSM, is maximized to achieve a global rigid registration of the two images. Being detected and clustered at the paired contiguous matching areas in the globally registered images, the paired pools of DoG keypoints in combination with the JSM provide a useful cluster-to-cluster correspondence to guide the local control-point correspondence detection and the outlier keypoint rejection. Lastly, a quasi-inverse consistent deformation is smoothly approximated to locally register brain images through the mapping the clustered control points by compact support radial basis functions. The 2D implementation of the method can model the brain shift in brain tumor resection MR images, though the theory holds for the 3D case.

  6. Osteo-cise: Strong Bones for Life: Protocol for a community-based randomised controlled trial of a multi-modal exercise and osteoporosis education program for older adults at risk of falls and fractures

    Directory of Open Access Journals (Sweden)

    Gianoudis Jenny

    2012-05-01

    maximal muscle strength, balance and function (four square step test, functional reach test, timed up-and-go test and 30-second sit-to-stand, falls incidence and health-related quality of life. Cost-effectiveness will also be assessed. Discussion The findings from the Osteo-cise: Strong Bones for Life study will provide new information on the efficacy of a targeted multi-modal community-based exercise program incorporating high velocity resistance training, together with an osteoporosis education and behavioural change program for improving multiple risk factors for falls and fracture in older adults at risk of fragility fracture. Trial registration Australian New Zealand Clinical Trials Registry reference ACTRN12609000100291

  7. SU-F-J-96: Comparison of Frame-Based and Mutual Information Registration Techniques for CT and MR Image Sets

    Energy Technology Data Exchange (ETDEWEB)

    Popple, R; Bredel, M; Brezovich, I; Dobelbower, M; Fisher, W; Fiveash, J; Guthrie, B; Riley, K; Wu, X [The University of Alabama at Birmingham, Birmingham, AL (United States)

    2016-06-15

    Purpose: To compare the accuracy of CT-MR registration using a mutual information method with registration using a frame-based localizer box. Methods: Ten patients having the Leksell head frame and scanned with a modality specific localizer box were imported into the treatment planning system. The fiducial rods of the localizer box were contoured on both the MR and CT scans. The skull was contoured on the CT images. The MR and CT images were registered by two methods. The frame-based method used the transformation that minimized the mean square distance of the centroids of the contours of the fiducial rods from a mathematical model of the localizer. The mutual information method used automated image registration tools in the TPS and was restricted to a volume-of-interest defined by the skull contours with a 5 mm margin. For each case, the two registrations were adjusted by two evaluation teams, each comprised of an experienced radiation oncologist and neurosurgeon, to optimize alignment in the region of the brainstem. The teams were blinded to the registration method. Results: The mean adjustment was 0.4 mm (range 0 to 2 mm) and 0.2 mm (range 0 to 1 mm) for the frame and mutual information methods, respectively. The median difference between the frame and mutual information registrations was 0.3 mm, but was not statistically significant using the Wilcoxon signed rank test (p=0.37). Conclusion: The difference between frame and mutual information registration techniques was neither statistically significant nor, for most applications, clinically important. These results suggest that mutual information is equivalent to frame-based image registration for radiosurgery. Work is ongoing to add additional evaluators and to assess the differences between evaluators.

  8. Deformable Registration of Biomedical Images using 2D Hidden Markov Models.

    Science.gov (United States)

    Shenoy, Renuka; Shih, Min-Chi; Rose, Kenneth

    2016-07-18

    Robust registration of unimodal and multimodal images is a key task in biomedical image analysis, and is often utilized as an initial step on which subsequent analysis techniques critically depend. We propose a novel probabilistic framework, based on a variant of the 2D hidden Markov model, namely the turbo hidden Markov model, to capture the deformation between pairs of images. The HMM is tailored to capture spatial transformations across images via state transitions, and modalityspecific data costs via emission probabilities. The method is derived for the unimodal setting (where simpler matching metrics may be used) as well as the multimodal setting, where different modalities may provide very different representations for a given class of objects, necessitating the use of advanced similarity measures. We utilize a rich model with hundreds of model parameters to describe the deformation relationships across such modalities. We also introduce a local edge-adaptive constraint to allow for varying degrees of smoothness between object boundaries and homogeneous regions. The parameters of the described method are estimated in a principled manner from training data via maximum likelihood learning, and the deformation is subsequently estimated using an efficient dynamic programming algorithm. Experimental results demonstrate the improved performance of the proposed approach over state-ofthe- art deformable registration techniques, on both unimodal and multimodal biomedical datasets.

  9. Melatonin potentiates “inside-out” nano-thermotherapy in human breast cancer cells: a potential cancer target multimodality treatment based on melatonin-loaded nanocomposite particles

    Science.gov (United States)

    Xie, Wensheng; Gao, Qin; Wang, Dan; Wang, Wei; Yuan, Jie; Guo, Zhenhu; Yan, Hao; Wang, Xiumei; Sun, Xiaodan; Zhao, Lingyun

    2017-01-01

    Purpose With the wide recognition of oncostatic effect of melatonin, the current study proposes a potential breast cancer target multimodality treatment based on melatonin-loaded magnetic nanocomposite particles (Melatonin-MNPs). Methods Melatonin-MNPs were fabricated by the single emulsion solvent extraction/evaporation method. Results Based on the facilitated transport of melatonin by the GLUT overexpressed on the cell membrane, such Melatonin-MNPs can be more favorably uptaken by MCF-7 cells compared with the melatonin-free nanocomposite particles, which indicates the cancer targeting ability of melatonin molecule. Inductive heating can be generated by exposure to the Melatonin-MNPs internalized within cancer cells under alternative magnetic field, so as to achieve the “inside-out” magnetic nano-thermotherapy. In addition to demonstrating the superior cytotoxic effect of such nano-thermotherapy over the conventional exogenous heating by metal bath, more importantly, the sustainable release of melatonin from the Melatonin-MNPs can be greatly promoted upon responsive to the magnetic heating. The multimodality treatment based on Melatonin-MNPs can lead to more significant decrease in cell viability than any single treatment, suggesting the potentiated effect of melatonin on the cytotoxic response to nano-thermotherapy. Conclusion This study is the first to fabricate the precisely engineered melatonin-loaded multifunctional nanocomposite particles and demonstrate the potential in breast cancer target multimodality treatment. PMID:29066887

  10. Melatonin potentiates "inside-out" nano-thermotherapy in human breast cancer cells: a potential cancer target multimodality treatment based on melatonin-loaded nanocomposite particles.

    Science.gov (United States)

    Xie, Wensheng; Gao, Qin; Wang, Dan; Wang, Wei; Yuan, Jie; Guo, Zhenhu; Yan, Hao; Wang, Xiumei; Sun, Xiaodan; Zhao, Lingyun

    2017-01-01

    With the wide recognition of oncostatic effect of melatonin, the current study proposes a potential breast cancer target multimodality treatment based on melatonin-loaded magnetic nanocomposite particles (Melatonin-MNPs). Melatonin-MNPs were fabricated by the single emulsion solvent extraction/evaporation method. Based on the facilitated transport of melatonin by the GLUT overexpressed on the cell membrane, such Melatonin-MNPs can be more favorably uptaken by MCF-7 cells compared with the melatonin-free nanocomposite particles, which indicates the cancer targeting ability of melatonin molecule. Inductive heating can be generated by exposure to the Melatonin-MNPs internalized within cancer cells under alternative magnetic field, so as to achieve the "inside-out" magnetic nano-thermotherapy. In addition to demonstrating the superior cytotoxic effect of such nano-thermotherapy over the conventional exogenous heating by metal bath, more importantly, the sustainable release of melatonin from the Melatonin-MNPs can be greatly promoted upon responsive to the magnetic heating. The multimodality treatment based on Melatonin-MNPs can lead to more significant decrease in cell viability than any single treatment, suggesting the potentiated effect of melatonin on the cytotoxic response to nano-thermotherapy. This study is the first to fabricate the precisely engineered melatonin-loaded multifunctional nanocomposite particles and demonstrate the potential in breast cancer target multimodality treatment.

  11. Multimodal Physiotherapy Based on a Biobehavioral Approach as a Treatment for Chronic Tension-Type Headache: A Case Report.

    Science.gov (United States)

    Beltran-Alacreu, Hector; Lopez-de-Uralde-Villanueva, Ibai; La Touche, Roy

    2015-12-01

    Tension-type headache (TTH) is the most common primary headache affecting the general population, which is characterized by bilateral headache and mild to moderate pain. This disorder causes high levels of disability and recent scientific evidence suggests that manual therapy (MT) and therapeutic exercise are effective in reducing medication intake and decreasing the frequency and intensity of headaches in patients with TTH. A 34-year-old woman was known to have chronic TTH. Initially, the patient presented moderate headaches 5 days per week, mechanical neck pain and no positive response to analgesics. A battery of self-reports was given to the patient to assess disability (using the Spanish versions of the Headache Impact Test-6 and the neck disability index), pain (visual analogue scale) and psychosocial issues (Spanish version of the pain catastrophizing scale) involved in the headaches. All measurements were taken four times during 161 days. Eleven sessions of treatment including MT, motor control therapeutic exercise (MCTE) and therapeutic patient education (TPE) were applied. This biobehavioral-based multimodal physical rehabilitation treatment combining MT, TPE and MCTE produced a substantial reduction in pain intensity, pain catastrophizing, disability and the impact of headaches on patient's life.

  12. A semi-automated 2D/3D marker-based registration algorithm modelling prostate shrinkage during radiotherapy for prostate cancer

    International Nuclear Information System (INIS)

    Budiharto, Tom; Slagmolen, Pieter; Hermans, Jeroen; Maes, Frederik; Verstraete, Jan; Heuvel, Frank Van den; Depuydt, Tom; Oyen, Raymond; Haustermans, Karin

    2009-01-01

    Background and purpose: Currently, most available patient alignment tools based on implanted markers use manual marker matching and rigid registration transformations to measure the needed translational shifts. To quantify the particular effect of prostate gland shrinkage, implanted gold markers were tracked during a course of radiotherapy including an isotropic scaling factor to model prostate shrinkage. Materials and methods: Eight patients with prostate cancer had gold markers implanted transrectally and seven were treated with (neo) adjuvant androgen deprivation therapy. After patient alignment to skin tattoos, orthogonal electronic portal images (EPIs) were taken. A semi-automated 2D/3D marker-based registration was performed to calculate the necessary couch shifts. The registration consists of a rigid transformation combined with an isotropic scaling to model prostate shrinkage. Results: The inclusion of an isotropic shrinkage model in the registration algorithm cancelled the corresponding increase in registration error. The mean scaling factor was 0.89 ± 0.09. For all but two patients, a decrease of the isotropic scaling factor during treatment was observed. However, there was almost no difference in the translation offset between the manual matching of the EPIs to the digitally reconstructed radiographs and the semi-automated 2D/3D registration. A decrease in the intermarker distance was found correlating with prostate shrinkage rather than with random marker migration. Conclusions: Inclusion of shrinkage in the registration process reduces registration errors during a course of radiotherapy. Nevertheless, this did not lead to a clinically significant change in the proposed table translations when compared to translations obtained with manual marker matching without a scaling correction

  13. SU-C-18A-02: Image-Based Camera Tracking: Towards Registration of Endoscopic Video to CT

    International Nuclear Information System (INIS)

    Ingram, S; Rao, A; Wendt, R; Castillo, R; Court, L; Yang, J; Beadle, B

    2014-01-01

    Purpose: Endoscopic examinations are routinely performed on head and neck and esophageal cancer patients. However, these images are underutilized for radiation therapy because there is currently no way to register them to a CT of the patient. The purpose of this work is to develop a method to track the motion of an endoscope within a structure using images from standard clinical equipment. This method will be incorporated into a broader endoscopy/CT registration framework. Methods: We developed a software algorithm to track the motion of an endoscope within an arbitrary structure. We computed frame-to-frame rotation and translation of the camera by tracking surface points across the video sequence and utilizing two-camera epipolar geometry. The resulting 3D camera path was used to recover the surrounding structure via triangulation methods. We tested this algorithm on a rigid cylindrical phantom with a pattern spray-painted on the inside. We did not constrain the motion of the endoscope while recording, and we did not constrain our measurements using the known structure of the phantom. Results: Our software algorithm can successfully track the general motion of the endoscope as it moves through the phantom. However, our preliminary data do not show a high degree of accuracy in the triangulation of 3D point locations. More rigorous data will be presented at the annual meeting. Conclusion: Image-based camera tracking is a promising method for endoscopy/CT image registration, and it requires only standard clinical equipment. It is one of two major components needed to achieve endoscopy/CT registration, the second of which is tying the camera path to absolute patient geometry. In addition to this second component, future work will focus on validating our camera tracking algorithm in the presence of clinical imaging features such as patient motion, erratic camera motion, and dynamic scene illumination

  14. Lesion registration for longitudinal disease tracking in an imaging informatics-based multiple sclerosis eFolder

    Science.gov (United States)

    Ma, Kevin; Liu, Joseph; Zhang, Xuejun; Lerner, Alex; Shiroishi, Mark; Amezcua, Lilyana; Liu, Brent

    2016-03-01

    We have designed and developed a multiple sclerosis eFolder system for patient data storage, image viewing, and automatic lesion quantification results stored in DICOM-SR format. The web-based system aims to be integrated in DICOM-compliant clinical and research environments to aid clinicians in patient treatments and data analysis. The system needs to quantify lesion volumes, identify and register lesion locations to track shifts in volume and quantity of lesions in a longitudinal study. In order to perform lesion registration, we have developed a brain warping and normalizing methodology using Statistical Parametric Mapping (SPM) MATLAB toolkit for brain MRI. Patients' brain MR images are processed via SPM's normalization processes, and the brain images are analyzed and warped according to the tissue probability map. Lesion identification and contouring are completed by neuroradiologists, and lesion volume quantification is completed by the eFolder's CAD program. Lesion comparison results in longitudinal studies show key growth and active regions. The results display successful lesion registration and tracking over a longitudinal study. Lesion change results are graphically represented in the web-based user interface, and users are able to correlate patient progress and changes in the MRI images. The completed lesion and disease tracking tool would enable the eFolder to provide complete patient profiles, improve the efficiency of patient care, and perform comprehensive data analysis through an integrated imaging informatics system.

  15. Simplified Multimodal Biometric Identification

    Directory of Open Access Journals (Sweden)

    Abhijit Shete

    2014-03-01

    Full Text Available Multibiometric systems are expected to be more reliable than unimodal biometric systems for personal identification due to the presence of multiple, fairly independent pieces of evidence e.g. Unique Identification Project "Aadhaar" of Government of India. In this paper, we present a novel wavelet based technique to perform fusion at the feature level and score level by considering two biometric modalities, face and fingerprint. The results indicate that the proposed technique can lead to substantial improvement in multimodal matching performance. The proposed technique is simple because of no preprocessing of raw biometric traits as well as no feature and score normalization.

  16. 76 FR 65783 - Registration of Security-Based Swap Dealers and Major Security-Based Swap Participants

    Science.gov (United States)

    2011-10-24

    .... Special Situations 1. Succession: Proposed Rule 15Fb2-5 2. Insolvency: Proposed Rule 15Fb2-6 F. Technical...) procedures for succession to, or withdrawal from, registration; and (3) procedures for the Commission to..., to be able to assure the prompt, accurate, and reliable performance of its functions as an SDR...

  17. All-Fiber Laser Curvature Sensor Using an In-Fiber Modal Interferometer Based on a Double Clad Fiber and a Multimode Fiber Structure

    Science.gov (United States)

    Durán-Sánchez, Manuel; Prieto-Cortés, Patricia; Salceda-Delgado, Guillermo; Castillo-Guzmán, Arturo A.; Selvas-Aguilar, Romeo; Ibarra-Escamilla, Baldemar; Kuzin, Evgeny A.

    2017-01-01

    An all-fiber curvature laser sensor by using a novel modal interference in-fiber structure is proposed and experimentally demonstrated. The in-fiber device, fabricated by fusion splicing of multimode fiber and double-clad fiber segments, is used as wavelength filter as well as the sensing element. By including a multimode fiber in an ordinary modal interference structure based on a double-clad fiber, the fringe visibility of the filter transmission spectrum is significantly increased. By using the modal interferometer as a curvature sensitive wavelength filter within a ring cavity erbium-doped fiber laser, the spectral quality factor Q is considerably increased. The results demonstrate the reliability of the proposed curvature laser sensor with advantages of robustness, ease of fabrication, low cost, repeatability on the fabrication process and simple operation. PMID:29182527

  18. Musculoskeletal complaints among nurses related to patient handling tasks and psychosocial factors - Based on logbook registrations

    DEFF Research Database (Denmark)

    Warming, S.; Precht, D.H.; Suadicani, P.

    2009-01-01

    ) fulfilled logbooks for three consecutive working days followed by a day off. Low back pain (LBP), neck/shoulder pain (NSP), knee pain (KP), psychosocial factors (time pressure, stress, conscience of the quality of work) and patient transfers and care tasks were reported. The logbook was reliable for both......The aims were to evaluate the inter-method reliability of a registration sheet for patient handling tasks, to study the day-to-day variation of musculoskeletal complaints (MSC) and to examine whether patient handling tasks and psychosocial factors were associated with MSC. Nurses (n = 148...... transfer and care tasks. The numbers of nurses reporting MSC and the level of pain increased significantly during the three working days (15%-30% and 17%-37%, respectively) and decreased on the day off. Stress and transfer task were associated with LPB and transfer tasks were associated with KP. Our...

  19. Robust CPD Algorithm for Non-Rigid Point Set Registration Based on Structure Information.

    Directory of Open Access Journals (Sweden)

    Lei Peng

    Full Text Available Recently, the Coherent Point Drift (CPD algorithm has become a very popular and efficient method for point set registration. However, this method does not take into consideration the neighborhood structure information of points to find the correspondence and requires a manual assignment of the outlier ratio. Therefore, CPD is not robust for large degrees of degradation. In this paper, an improved method is proposed to overcome the two limitations of CPD. A structure descriptor, such as shape context, is used to perform the auxiliary calculation of the correspondence, and the proportion of each GMM component is adjusted by the similarity. The outlier ratio is formulated in the EM framework so that it can be automatically calculated and optimized iteratively. The experimental results on both synthetic data and real data demonstrate that the proposed method described here is more robust to deformation, noise, occlusion, and outliers than CPD and other state-of-the-art algorithms.

  20. Motion tracking in the liver: Validation of a method based on 4D ultrasound using a nonrigid registration technique

    Energy Technology Data Exchange (ETDEWEB)

    Vijayan, Sinara, E-mail: sinara.vijayan@ntnu.no [Norwegian University of Science and Technology, 7491 Trondheim (Norway); Klein, Stefan [Norwegian University of Science and Technology, 7491 Trondheim, Norway and Biomedical Imaging Group Rotterdam, Department of Medical Informatics and Radiology, Erasmus MC, 3000 CA Rotterdam (Netherlands); Hofstad, Erlend Fagertun; Langø, Thomas [SINTEF, Department Medical Technology, 7465 Trondheim (Norway); Lindseth, Frank [Norwegian University of Science and Technology, 7491 Trondheim, Norway and SINTEF, Department Medical Technology, 7465 Trondheim (Norway); Ystgaard, Brynjulf [Department of Surgery, St. Olavs Hospital, 7030 Trondheim (Norway)

    2014-08-15

    Purpose: Treatments like radiotherapy and focused ultrasound in the abdomen require accurate motion tracking, in order to optimize dosage delivery to the target and minimize damage to critical structures and healthy tissues around the target. 4D ultrasound is a promising modality for motion tracking during such treatments. In this study, the authors evaluate the accuracy of motion tracking in the liver based on deformable registration of 4D ultrasound images. Methods: The offline analysis was performed using a nonrigid registration algorithm that was specifically designed for motion estimation from dynamic imaging data. The method registers the entire 4D image data sequence in a groupwise optimization fashion, thus avoiding a bias toward a specifically chosen reference time point. Three healthy volunteers were scanned over several breathing cycles (12 s) from three different positions and angles on the abdomen; a total of nine 4D scans for the three volunteers. Well-defined anatomic landmarks were manually annotated in all 96 time frames for assessment of the automatic algorithm. The error of the automatic motion estimation method was compared with interobserver variability. The authors also performed experiments to investigate the influence of parameters defining the deformation field flexibility and evaluated how well the method performed with a lower temporal resolution in order to establish the minimum frame rate required for accurate motion estimation. Results: The registration method estimated liver motion with an error of 1 mm (75% percentile over all datasets), which was lower than the interobserver variability of 1.4 mm. The results were only slightly dependent on the degrees of freedom of the deformation model. The registration error increased to 2.8 mm with an eight times lower temporal resolution. Conclusions: The authors conclude that the methodology was able to accurately track the motion of the liver in the 4D ultrasound data. The authors believe

  1. One registration multi-atlas-based pseudo-CT generation for attenuation correction in PET/MRI

    Energy Technology Data Exchange (ETDEWEB)

    Arabi, Hossein [Geneva University Hospital, Division of Nuclear Medicine and Molecular Imaging, Geneva 4 (Switzerland); Zaidi, Habib [Geneva University Hospital, Division of Nuclear Medicine and Molecular Imaging, Geneva 4 (Switzerland); Geneva University, Geneva Neuroscience Center, Geneva (Switzerland); University of Groningen, University Medical Center Groningen, Department of Nuclear Medicine and Molecular Imaging, Groningen (Netherlands); University of Southern Denmark, Department of Nuclear Medicine, Odense (Denmark)

    2016-10-15

    The outcome of a detailed assessment of various strategies for atlas-based whole-body bone segmentation from magnetic resonance imaging (MRI) was exploited to select the optimal parameters and setting, with the aim of proposing a novel one-registration multi-atlas (ORMA) pseudo-CT generation approach. The proposed approach consists of only one online registration between the target and reference images, regardless of the number of atlas images (N), while for the remaining atlas images, the pre-computed transformation matrices to the reference image are used to align them to the target image. The performance characteristics of the proposed method were evaluated and compared with conventional atlas-based attenuation map generation strategies (direct registration of the entire atlas images followed by voxel-wise weighting (VWW) and arithmetic averaging atlas fusion). To this end, four different positron emission tomography (PET) attenuation maps were generated via arithmetic averaging and VWW scheme using both direct registration and ORMA approaches as well as the 3-class attenuation map obtained from the Philips Ingenuity TF PET/MRI scanner commonly used in the clinical setting. The evaluation was performed based on the accuracy of extracted whole-body bones by the different attenuation maps and by quantitative analysis of resulting PET images compared to CT-based attenuation-corrected PET images serving as reference. The comparison of validation metrics regarding the accuracy of extracted bone using the different techniques demonstrated the superiority of the VWW atlas fusion algorithm achieving a Dice similarity measure of 0.82 ± 0.04 compared to arithmetic averaging atlas fusion (0.60 ± 0.02), which uses conventional direct registration. Application of the ORMA approach modestly compromised the accuracy, yielding a Dice similarity measure of 0.76 ± 0.05 for ORMA-VWW and 0.55 ± 0.03 for ORMA-averaging. The results of quantitative PET analysis followed the same

  2. A Multi-Modal Digital Game-Based Learning Environment for Hospitalized Children with Chronic Illnesses.

    Science.gov (United States)

    Chin, Jui-Chih; Tsuei, Mengping

    2014-01-01

    The aim of this study was to explore the digital game-based learning for children with chronic illnesses in the hospital settings. The design-based research and qualitative methods were applied. Three eight-year-old children with leukemia participated in this study. In the first phase, the multi-user game-based learning system was developed and…

  3. Multimodal mapping of human skin.

    Science.gov (United States)

    Heuke, S; Vogler, N; Meyer, T; Akimov, D; Kluschke, F; Röwert-Huber, H-J; Lademann, J; Dietzek, B; Popp, J

    2013-10-01

    The combination of coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG) and two-photon excited fluorescence (TPEF) imaging--referred to as multimodal imaging--provides complementary contrast based on molecular vibrations, the structure of various tissue components and endogenous fluorophores, respectively. To present a comprehensive overview of the appearance of human skin in multimodal imaging. Multimodal imaging of unstained skin cross-sections of 32 individuals was performed using a laser scanning microscope and picosecond laser pulse for excitation. The epidermis, dermis and subcutis are distinguishable in all three applied modalities, but are unveiled best in multimodal images. While the subcutis is dominated by the CARS signal, predominately SHG and the secondary TPEF signal detect the dermis. In contrast, no SHG signal is detected in the epidermis, whereas CARS and TPEF show equal contributions. Additionally, the appearance of the major skin appendages is described, i.e. the hair follicle, sebaceous and sweat glands, and blood vessels belonging to the vascular system. All four investigated functional units show a characteristic morphochemistry in TPEF and CARS, allowing identification of further subunits, e.g. the major components of the hair follicle, while the SHG signal delineates the localization of the functional units. Multimodal imaging is a powerful tool to investigate human skin by providing high contrast based on the molecular constitution. It is therefore suggested that multimodal imaging has a high potential in application to dermatological research and clinical diagnostics of various skin alterations. © 2013 The Authors BJD © 2013 British Association of Dermatologists.

  4. Optical Splitters Based on Self-Imaging Effect in Multi-Mode Waveguide Made by Ion Exchange in Glass

    Directory of Open Access Journals (Sweden)

    O. Barkman

    2013-04-01

    Full Text Available Design and modeling of single mode optical multi-mode interference structures with graded refractive index is reported. Several samples of planar optical channel waveguides were obtained by Ag+, Na+ and K+, Na+ one step thermal ion exchange process in molten salt on GIL49 glass substrate and new special optical glass for ion exchange technology. Waveguide properties were measured by optical mode spectroscopy. Obtained data were used for further design and modeling of single mode channel waveguide and subsequently for the design of 1 to 3 multimode interference power splitter in order to improve simulation accuracy. Designs were developed by utilizing finite difference beam propagation method.

  5. Global Registration of 3D LiDAR Point Clouds Based on Scene Features: Application to Structured Environments

    Directory of Open Access Journals (Sweden)

    Julia Sanchez

    2017-09-01

    Full Text Available Acquiring 3D data with LiDAR systems involves scanning multiple scenes from different points of view. In actual systems, the ICP algorithm (Iterative Closest Point is commonly used to register the acquired point clouds together to form a unique one. However, this method faces local minima issues and often needs a coarse initial alignment to converge to the optimum. This paper develops a new method for registration adapted to indoor environments and based on structure priors of such scenes. Our method works without odometric data or physical targets. The rotation and translation of the rigid transformation are computed separately, using, respectively, the Gaussian image of the point clouds and a correlation of histograms. To evaluate our algorithm on challenging registration cases, two datasets were acquired and are available for comparison with other methods online. The evaluation of our algorithm on four datasets against six existing methods shows that the proposed method is more robust against sampling and scene complexity. Moreover, the time performances enable a real-time implementation.

  6. A registration based approach for 4D cardiac micro-CT using combined prospective and retrospective gating.

    Science.gov (United States)

    Badea, Cristian T; Schreibmann, Eduard; Fox, Tim

    2008-04-01

    Recent advances in murine cardiac studies with three-dimensional cone beam micro-computed tomography (CT) have used either prospective or retrospective gating technique. While prospective gating ensures the best image quality and the highest resolution, it involves longer sampling times and higher radiation dose. Sampling is faster and the radiation dose can be reduced with retrospective gating but the image quality is affected by the limited number of projections with an irregular angular distribution which complicate the reconstruction process, causing significant streaking artifacts. This work involves both prospective and retrospective gating in sampling. Deformable registration is used between a high quality image set acquired with prospective gating with the multiple data sets during the cardiac cycle obtained using retrospective gating. Tests were conducted on a four-dimensional (4D) cardiac mouse phantom and after optimization, the method was applied to in vivo cardiac micro-CT data. Results indicate that, by using our method, the sampling time can be reduced by a factor of 2.5 and the radiation dose can be reduced 35% compared to the prospective sampling while the image quality can be maintained. In conclusion, we proposed a novel solution to 4D cine cardiac micro-CT based on a combined prospective with retrospective gating in sampling and deformable registration post reconstruction that mixed the advantages of both strategies.

  7. Passively Q-switched dual-wavelength thulium-doped fiber laser based on a multimode interference filter and a semiconductor saturable absorber

    Science.gov (United States)

    Wang, M.; Huang, Y. J.; Ruan, S. C.

    2018-04-01

    In this paper, we have demonstrated a theta cavity passively Q-switched dual-wavelength fiber laser based on a multimode interference filter and a semiconductor saturable absorber. Relying on the properties of the fiber theta cavity, the laser can operate unidirectionally without an optical isolator. A semiconductor saturable absorber played the role of passive Q-switch while a section of single-mode-multimode-single-mode fiber structure served as an multimode interference filter and was used for selecting the lasing wavelengths. By suitably manipulating the polarization controller, stable dual-wavelength Q-switched operation was obtained at ~1946.8 nm and ~1983.8 nm with maximum output power and minimum pulse duration of ~47 mW and ~762.5 ns, respectively. The pulse repetition rate can be tuned from ~20.2 kHz to ~79.7 kHz by increasing the pump power from ~2.12 W to ~5.4 W.

  8. Bi-Objective Modelling for Hazardous Materials Road-Rail Multimodal Routing Problem with Railway Schedule-Based Space-Time Constraints.

    Science.gov (United States)

    Sun, Yan; Lang, Maoxiang; Wang, Danzhu

    2016-07-28

    The transportation of hazardous materials is always accompanied by considerable risk that will impact public and environment security. As an efficient and reliable transportation organization, a multimodal service should participate in the transportation of hazardous materials. In this study, we focus on transporting hazardous materials through the multimodal service network and explore the hazardous materials multimodal routing problem from the operational level of network planning. To formulate this problem more practicably, minimizing the total generalized costs of transporting the hazardous materials and the social risk along the planned routes are set as the optimization objectives. Meanwhile, the following formulation characteristics will be comprehensively modelled: (1) specific customer demands; (2) multiple hazardous material flows; (3) capacitated schedule-based rail service and uncapacitated time-flexible road service; and (4) environmental risk constraint. A bi-objective mixed integer nonlinear programming model is first built to formulate the routing problem that combines the formulation characteristics above. Then linear reformations are developed to linearize and improve the initial model so that it can be effectively solved by exact solution algorithms on standard mathematical programming software. By utilizing the normalized weighted sum method, we can generate the Pareto solutions to the bi-objective optimization problem for a specific case. Finally, a large-scale empirical case study from the Beijing-Tianjin-Hebei Region in China is presented to demonstrate the feasibility of the proposed methods in dealing with the practical problem. Various scenarios are also discussed in the case study.

  9. Bi-Objective Modelling for Hazardous Materials Road–Rail Multimodal Routing Problem with Railway Schedule-Based Space–Time Constraints

    Science.gov (United States)

    Sun, Yan; Lang, Maoxiang; Wang, Danzhu

    2016-01-01

    The transportation of hazardous materials is always accompanied by considerable risk that will impact public and environment security. As an efficient and reliable transportation organization, a multimodal service should participate in the transportation of hazardous materials. In this study, we focus on transporting hazardous materials through the multimodal service network and explore the hazardous materials multimodal routing problem from the operational level of network planning. To formulate this problem more practicably, minimizing the total generalized costs of transporting the hazardous materials and the social risk along the planned routes are set as the optimization objectives. Meanwhile, the following formulation characteristics will be comprehensively modelled: (1) specific customer demands; (2) multiple hazardous material flows; (3) capacitated schedule-based rail service and uncapacitated time-flexible road service; and (4) environmental risk constraint. A bi-objective mixed integer nonlinear programming model is first built to formulate the routing problem that combines the formulation characteristics above. Then linear reformations are developed to linearize and improve the initial model so that it can be effectively solved by exact solution algorithms on standard mathematical programming software. By utilizing the normalized weighted sum method, we can generate the Pareto solutions to the bi-objective optimization problem for a specific case. Finally, a large-scale empirical case study from the Beijing–Tianjin–Hebei Region in China is presented to demonstrate the feasibility of the proposed methods in dealing with the practical problem. Various scenarios are also discussed in the case study. PMID:27483294

  10. Importance of nanoparticle size in colorimetric and SERS-based multimodal trace detection of Ni(II) ions with functional gold nanoparticles.

    Science.gov (United States)

    Krpetić, Zeljka; Guerrini, Luca; Larmour, Iain A; Reglinski, John; Faulds, Karen; Graham, Duncan

    2012-03-12

    Colorimetric detection of analytes using gold nanoparticles along with surface-enhanced Raman spectroscopy (SERS) are areas of intense research activity since they both offer sensing of very low concentrations of target species. Multimodal detection promotes the simultaneous detection of a sample by a combination of different techniques; consequently, surface chemistry design in the development of multimodal nanosensors is important for rapid and sensitive evaluation of the analytes by diverse analytical methods. Herein it is shown that nanoparticle size plays an important role in the design of functional nanoparticles for colorimetric and SERS-based sensing applications, allowing controlled nanoparticle assembly and tunable sensor response. The design and preparation of robust nanoparticle systems and their assembly is reported for trace detection of Ni(II) ions as a model system in an aqueous solution. The combination of covalently attached nitrilotriacetic acid moieties along with the L-carnosine dipeptide on the nanoparticle surface represents a highly sensitive platform for rapid and selective detection of Ni(II) ions. This systematic study demonstrates that significantly lower detection limits can be achieved by finely tuning the assembly of gold nanoparticles of different core sizes. The results clearly demonstrate the feasibility and usefulness of a multimodal approach. Copyright © 2012 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

  11. Non-Rigid Contour-Based Registration of Cell Nuclei in 2-D Live Cell Microscopy Images Using a Dynamic Elasticity Model.

    Science.gov (United States)

    Sorokin, Dmitry V; Peterlik, Igor; Tektonidis, Marco; Rohr, Karl; Matula, Pavel

    2018-01-01

    The analysis of the pure motion of subnuclear structures without influence of the cell nucleus motion and deformation is essential in live cell imaging. In this paper, we propose a 2-D contour-based image registration approach for compensation of nucleus motion and deformation in fluorescence microscopy time-lapse sequences. The proposed approach extends our previous approach, which uses a static elasticity model to register cell images. Compared with that scheme, the new approach employs a dynamic elasticity model for the forward simulation of nucleus motion and deformation based on the motion of its contours. The contour matching process is embedded as a constraint into the system of equations describing the elastic behavior of the nucleus. This results in better performance in terms of the registration accuracy. Our approach was successfully applied to real live cell microscopy image sequences of different types of cells including image data that was specifically designed and acquired for evaluation of cell image registration methods. An experimental comparison with the existing contour-based registration methods and an intensity-based registration method has been performed. We also studied the dependence of the results on the choice of method parameters.

  12. OptoCeramic-Based High Speed Fiber Multiplexer for Multimode Fiber, Phase I

    Data.gov (United States)

    National Aeronautics and Space Administration — A fiber-based fixed-array laser transmitter can be combined with a fiber-arrayed detector to create the next-generation NASA array LIDAR systems. High speed optical...

  13. Registration-based approach for reconstruction of high-resolution in utero fetal MR brain images.

    Science.gov (United States)

    Rousseau, Francois; Glenn, Orit A; Iordanova, Bistra; Rodriguez-Carranza, Claudia; Vigneron, Daniel B; Barkovich, James A; Studholme, Colin

    2006-09-01

    This paper describes a novel approach to forming high-resolution MR images of the human fetal brain. It addresses the key problem of fetal motion by proposing a registration-refined compounding of multiple sets of orthogonal fast two-dimensional MRI slices, which are currently acquired for clinical studies, into a single high-resolution MRI volume. A robust multiresolution slice alignment is applied iteratively to the data to correct motion of the fetus that occurs between two-dimensional acquisitions. This is combined with an intensity correction step and a super-resolution reconstruction step, to form a single high isotropic resolution volume of the fetal brain. Experimental validation on synthetic image data with known motion types and underlying anatomy, together with retrospective application to sets of clinical acquisitions, are included. Results indicate that this method promises a unique route to acquiring high-resolution MRI of the fetal brain in vivo allowing comparable quality to that of neonatal MRI. Such data provide a highly valuable window into the process of normal and abnormal brain development, which is directly applicable in a clinical setting.

  14. Observing Coaching and Reflecting: A Multi-modal Natural Language-based Dialogue System in a Learning Context

    NARCIS (Netherlands)

    Van Helvert, Joy; Van Rosmalen, Peter; Börner, Dirk; Petukhova, Volha; Alexandersson, Jan

    2016-01-01

    The Metalogue project aims to develop a multi-modal, multi-party dialogue system with metacognitive abilities that will advance our understanding of natural conversational human-machine interaction and dialogue interfaces. This paper introduces the vision for the system and discusses its application

  15. Score level fusion scheme based on adaptive local Gabor features for face-iris-fingerprint multimodal biometric

    Science.gov (United States)

    He, Fei; Liu, Yuanning; Zhu, Xiaodong; Huang, Chun; Han, Ye; Chen, Ying

    2014-05-01

    A multimodal biometric system has been considered a promising technique to overcome the defects of unimodal biometric systems. We have introduced a fusion scheme to gain a better understanding and fusion method for a face-iris-fingerprint multimodal biometric system. In our case, we use particle swarm optimization to train a set of adaptive Gabor filters in order to achieve the proper Gabor basic functions for each modality. For a closer analysis of texture information, two different local Gabor features for each modality are produced by the corresponding Gabor coefficients. Next, all matching scores of the two Gabor features for each modality are projected to a single-scalar score via a trained, supported, vector regression model for a final decision. A large-scale dataset is formed to validate the proposed scheme using the Facial Recognition Technology database-fafb and CASIA-V3-Interval together with FVC2004-DB2a datasets. The experimental results demonstrate that as well as achieving further powerful local Gabor features of multimodalities and obtaining better recognition performance by their fusion strategy, our architecture also outperforms some state-of-the-art individual methods and other fusion approaches for face-iris-fingerprint multimodal biometric systems.

  16. The UCLA Multimodal Connectivity Database: A web-based platform for brain connectivity matrix sharing and analysis

    Directory of Open Access Journals (Sweden)

    Jesse A. Brown

    2012-11-01

    Full Text Available Brain connectomics research has rapidly expanded using functional MRI (fMRI and diffusion-weighted MRI (dwMRI. A common product of these varied analyses is a connectivity matrix (CM. A CM stores the connection strength between any two regions (nodes in a brain network. This format is useful for several reasons: 1 it is highly distilled, with minimal data size and complexity, 2 graph theory can be applied to characterize the network’s topology, and 3 it retains sufficient information to capture individual differences such as age, gender, intelligence quotient, or disease state. Here we introduce the UCLA Multimodal Connectivity Database (http://umcd.humanconnectomeproject.org, an openly available website for brain network analysis and data sharing. The site is a repository for researchers to publicly share CMs derived from their data. The site also allows users to select any CM shared by another user, compute graph theoretical metrics on the site, visualize a report of results, or download the raw CM. To date, users have contributed over 2000 individual CMs, spanning different imaging modalities (fMRI, dwMRI and disorders (Alzheimer’s, autism, Attention Deficit Hyperactive Disorder. To demonstrate the site’s functionality, whole brain functional and structural connectivity matrices are derived from 60 subjects’ (ages 26-45 resting state fMRI (rs-fMRI and dwMRI data and uploaded to the site. The site is utilized to derive graph theory global and regional measures for the rs-fMRI and dwMRI networks. Global and nodal graph theoretical measures between functional and structural networks exhibit low correspondence. This example demonstrates how this tool can enhance the comparability of brain networks from different imaging modalities and studies. The existence of this connectivity-based repository should foster broader data sharing and enable larger-scale meta analyses comparing networks across imaging modality, age group, and disease state.

  17. Luminescent, Fire-Resistant, and Water-Proof Ultralong Hydroxyapatite Nanowire-Based Paper for Multimode Anticounterfeiting Applications.

    Science.gov (United States)

    Yang, Ri-Long; Zhu, Ying-Jie; Chen, Fei-Fei; Dong, Li-Ying; Xiong, Zhi-Chao

    2017-08-02

    Counterfeiting of valuable certificates, documents, and banknotes is a serious issue worldwide. As a result, the need for developing novel anticounterfeiting materials is greatly increasing. Herein, we report a new kind of ultralong hydroxyapatite nanowire (HAPNW)-based paper with luminescence, fire resistance, and waterproofness properties that may be exploited for anticounterfeiting applications. In this work, lanthanide-ion-doped HAPNWs (HAPNW:Ln 3+ ) with lengths over 100 μm have been synthesized and used as a raw material to fabricating a free-standing luminescent, fire-resistant, water-proof paper through a simple vacuum filtration process. It is interesting to find that the luminescence intensity, structure, and morphology of HAPNW:Ln 3+ highly depend on the experimental conditions. The as-prepared HAPNW:Ln 3+ paper has a unique combination of properties, such as high flexibility, good processability, writing and printing abilities, luminescence, tunable emission color, waterproofness, and fire resistance. In addition, a well-designed pattern can be embedded in the paper that is invisible under ambient light but viewable as a luminescent color under ultraviolet light. Moreover, the HAPNW:Ln 3+ paper can be well-preserved without any damage after being burned by fire or soaked in water. The unique combination of luminescence, fire resistance, and waterproofness properties and the nanowire structure of the as-prepared HAPNW:Ln 3+ paper may be exploited toward developing a new kind of multimode anticounterfeiting technology for various high-level security antiforgery applications, such as in making forgery-proof documents, certificates, labels, and tags and in packaging.

  18. Deformable medical image registration of pleural cavity for photodynamic therapy by using finite-element based method

    Science.gov (United States)

    Penjweini, Rozhin; Kim, Michele M.; Dimofte, Andrea; Finlay, Jarod C.; Zhu, Timothy C.

    2016-03-01

    When the pleural cavity is opened during the surgery portion of pleural photodynamic therapy (PDT) of malignant mesothelioma, the pleural volume will deform. This impacts the delivered dose when using highly conformal treatment techniques. To track the anatomical changes and contour the lung and chest cavity, an infrared camera-based navigation system (NDI) is used during PDT. In the same patient, a series of computed tomography (CT) scans of the lungs are also acquired before the surgery. The reconstructed three-dimensional contours from both NDI and CTs are imported into COMSOL Multiphysics software, where a finite element-based (FEM) deformable image registration is obtained. The CT contour is registered to the corresponding NDI contour by overlapping the center of masses and aligning their orientations. The NDI contour is considered as the reference contour, and the CT contour is used as the target one, which will be deformed. Deformed Geometry model is applied in COMSOL to obtain a deformed target contour. The distortion of the volume at X, Y and Z is mapped to illustrate the transformation of the target contour. The initial assessment shows that FEM-based image deformable registration can fuse images acquired by different modalities. It provides insights into the deformation of anatomical structures along X, Y and Z-axes. The deformed contour has good matches to the reference contour after the dynamic matching process. The resulting three-dimensional deformation map can be used to obtain the locations of other critical anatomic structures, e.g., heart, during surgery.

  19. Contextual Multivariate Segmentation of Pork Tissue from Grating-Based Multimodal X-Ray Tomography

    DEFF Research Database (Denmark)

    Einarsdottir, Hildur; Nielsen, Mikkel S.; Ersbøll, Bjarne Kjær

    2013-01-01

    X-ray computed tomography is increasingly used as a nondestructive method for studying three dimensional food structures. For meat products, studies have focused mainly on fat and protein content due to limited contrast capabilities of absorption based techniques. Recent advances in X-ray imaging...... have made novel X-ray image modalities available, where the refraction and scattering of X-rays is obtained simultaneously with the absorption properties, providing enhanced contrast for soft biological tissues. This paper demonstrates how data obtained from grating-based imaging can be segmented...

  20. Design of Polymer Wavelength Splitter 1310 nm/1550 nm Based on Multimode Interferences

    Directory of Open Access Journals (Sweden)

    V. Prajzler

    2010-12-01

    Full Text Available We report about design of 1x2 1310/1550 nm optical wavelength division multiplexer based on polymer waveguides. The polymer splitter was designed by using RSoft software based on beam propagation method. Epoxy novolak resin polymer was used as core waveguides layer, silicon substrate with silica layer was used as buffer layer and polymethylmethacrylate was used as protection cover layer. The simulation shows that the output energy for the fundamental mode is 67.1 % for 1310 nm and 67.8 % for 1550 nm wavelength.

  1. Multimodal Emotion Recognition for Assessment of Learning in a Game-Based Communication Skills Training

    NARCIS (Netherlands)

    Bahreini, Kiavash; Nadolski, Rob; Westera, Wim

    2015-01-01

    This paper describes how our FILTWAM software artifacts for face and voice emotion recognition will be used for assessing learners' progress and providing adequate feedback in an online game-based communication skills training. This constitutes an example of in-game assessment for mainly formative

  2. Multimodal emotion recognition as assessment for learning in a game-based communication skills training

    NARCIS (Netherlands)

    Nadolski, Rob; Bahreini, Kiavash; Westera, Wim

    2014-01-01

    This paper presentation describes how our FILTWAM software artifacts for face and voice emotion recognition will be used for assessing learners' progress and providing adequate feedback in an online game-based communication skills training. This constitutes an example of in-game assessment for

  3. Problem-Based Learning in Multimodal Learning Environments: Learners' Technology Adoption Experiences

    Science.gov (United States)

    Ioannou, Andri; Vasiliou, Christina; Zaphiris, Panayiotis

    2016-01-01

    In this study, we enhanced a problem-based learning (PBL) environment with affordable, everyday technologies that can be found in most university classrooms (e.g., projectors, tablets, students' own smartphones, traditional paper-pencil, and Facebook). The study was conducted over a 3-year period, with 60 postgraduate learners in a human-computer…

  4. Registration strategy using occlusal splint based on augmented reality for mandibular angle oblique split osteotomy.

    Science.gov (United States)

    Zhu, Ming; Chai, Gang; Zhang, Yan; Ma, Xiaofei; Gan, Jiliang

    2011-09-01

    An augmented reality tool allows for visual tracking of real anatomic structures in superposition with volume-rendered computed tomographic or magnetic resonance imaging scans and thus can be used for navigated translocation of important structures during operation. In this feasibility study, ARToolKit was used in mandibular angle oblique split osteotomy to define the cutting planes according to an operative plan. We overlay the operative plan on the model of a mandible made by rapid prototyping technology, and the technology was successfully used in 15 patients. Before the operation, all patients underwent computed tomographic scan, and dental casts were prepared by surgeons. Then, surgeons make the occlusal splint according to a dental cast to fix the marker, which can be recognized by the ARToolKit. The occlusal splint and marker were transformed to three-dimensional data using a laser scanner, and a programmer that runs on a personal computer named Rapidform matches the marker and the mandible image to generate the virtual image. By this step, the virtual image describing the marker, occlusal splint, and the mandible image of the patient are integrated. During the operation, the operative plan was overlaid on the rapid prototyping model of the mandible as soon as the ARToolKit recognized the marker. The technology was successfully used in 15 patients; the virtual image of the mandible and the cutting-plane both overlaid the real model of the mandible. This study has reported a new and effective way for mandibular angle oblique split osteotomy, and using occlusal splint might be a powerful option for the registration of augmented reality. Augmented reality tools like ARToolKit may be helpful for control of maxillary translocation in orthognathic surgery.

  5. Design of Tank Velocity Based on Multi-Mode Natural Frequencies for Suppression of Sloshing

    Energy Technology Data Exchange (ETDEWEB)

    Sim, Taegwon; Kim, Dongjoo [Kumoh Nat’l Institute of Technology, Gumi (Korea, Republic of)

    2017-05-15

    Suppression of sloshing is essential to achieve fast transportation and stable maneuvering of tanks partially filled with liquid. In this study, numerical simulations are performed to investigate the effects of the acceleration magnitude and the acceleration duration of triangular velocity profiles on sloshing when a rectangular tank moves horizontally. We previously reported, based on only the first natural mode, that sloshing is significantly suppressed when the acceleration duration equals the first natural period of sloshing. On the other hand, the present CFD simulations find the best acceleration duration for minimum sloshing and explains the results considering higher modes as well as the first mode. We also perform the analysis using an equivalent model based on masses and springs, and evaluate its accuracy by comparing it with the CFD simulation results.

  6. TU-CD-BRA-01: A Novel 3D Registration Method for Multiparametric Radiological Images

    International Nuclear Information System (INIS)

    Akhbardeh, A; Parekth, VS; Jacobs, MA

    2015-01-01

    Purpose: Multiparametric and multimodality radiological imaging methods, such as, magnetic resonance imaging(MRI), computed tomography(CT), and positron emission tomography(PET), provide multiple types of tissue contrast and anatomical information for clinical diagnosis. However, these radiological modalities are acquired using very different technical parameters, e.g.,field of view(FOV), matrix size, and scan planes, which, can lead to challenges in registering the different data sets. Therefore, we developed a hybrid registration method based on 3D wavelet transformation and 3D interpolations that performs 3D resampling and rotation of the target radiological images without loss of information Methods: T1-weighted, T2-weighted, diffusion-weighted-imaging(DWI), dynamic-contrast-enhanced(DCE) MRI and PET/CT were used in the registration algorithm from breast and prostate data at 3T MRI and multimodality(PET/CT) cases. The hybrid registration scheme consists of several steps to reslice and match each modality using a combination of 3D wavelets, interpolations, and affine registration steps. First, orthogonal reslicing is performed to equalize FOV, matrix sizes and the number of slices using wavelet transformation. Second, angular resampling of the target data is performed to match the reference data. Finally, using optimized angles from resampling, 3D registration is performed using similarity transformation(scaling and translation) between the reference and resliced target volume is performed. After registration, the mean-square-error(MSE) and Dice Similarity(DS) between the reference and registered target volumes were calculated. Results: The 3D registration method registered synthetic and clinical data with significant improvement(p<0.05) of overlap between anatomical structures. After transforming and deforming the synthetic data, the MSE and Dice similarity were 0.12 and 0.99. The average improvement of the MSE in breast was 62%(0.27 to 0.10) and prostate was

  7. FPGA-based multimodal embedded sensor system integrating low- and mid-level vision.

    Science.gov (United States)

    Botella, Guillermo; Martín H, José Antonio; Santos, Matilde; Meyer-Baese, Uwe

    2011-01-01

    Motion estimation is a low-level vision task that is especially relevant due to its wide range of applications in the real world. Many of the best motion estimation algorithms include some of the features that are found in mammalians, which would demand huge computational resources and therefore are not usually available in real-time. In this paper we present a novel bioinspired sensor based on the synergy between optical flow and orthogonal variant moments. The bioinspired sensor has been designed for Very Large Scale Integration (VLSI) using properties of the mammalian cortical motion pathway. This sensor combines low-level primitives (optical flow and image moments) in order to produce a mid-level vision abstraction layer. The results are described trough experiments showing the validity of the proposed system and an analysis of the computational resources and performance of the applied algorithms.

  8. Molecular signatures based on 2-methoxy phenylpiperazine for neuroreceptor imaging using multimodality approach

    International Nuclear Information System (INIS)

    Hazari, Puja P.; Singh, N.; Raunak; Uppal, J.K.; Chuttani, K.; Mathur, R.; Soni, S.; Mishra, A.K.

    2010-01-01

    Full text: 5-HT1A, the best-characterized subtype of currently known 5-HT receptors, is tightly implicated in the pathogenesis of depression, anxiety, epilepsy and eating disorders. Specific radioligands and positron emission tomography (PET) allow for a quantitative imaging of brain 5-HT1A receptor distribution in living animals and humans. Potent and selective ligands for 5-HT1A receptors labeled with 18 F and 11 C with high specific activity aids the progress of understanding the pharmacological function of the patient's brain. It is not only desirable to find new compound based on 2-methoxyphenyl piperazine (MPP) selective to 5-HT1A receptors for possible pharmacological activity; such ligands are desired as they may be labeled with different PET/SPECT radioisotopes. We have envisaged to associate 2-methoxyphenyl piperazine with p-nitrophenyl derivative which was then subjected to 18 F-fluorination reaction (An efficient one-step approach to label MPP with 18 F for PET Imaging). We have developed short-lived 11 C (t1/2=20 min) labeled methoxy phenylpiperazine based derivative, (N-methyl- 11 C)bis(2-(4-(2-methoxy-phenyl)-piperazin-1-yl)ethyl)-amine ((N-methyl- 11 C)bis-MPP) with high specific activity for PET. The synthesis, characterization and biological evaluation of conjugate the 1-(2-methoxyphenylpiperazine) moiety complexed with paramagnetic metal ion, a fragment of the true 5-HT1A antagonist was carried out and characterized by spectroscopic methods for MRI. Initial studies with primary cultures of rat hippocampal cell lines indicated that the novel derivatives of MPP are highly selective for the serotonin (5-HT1A) receptor. It has significantly higher uptake in the hippocampal region of the brain, where 5-HT1A receptor density is high

  9. A Review Of Multimodal Biometric Authentication Systems

    Directory of Open Access Journals (Sweden)

    Kunal Kumar

    2015-08-01

    Full Text Available Authentication is the process of validating the identity of a person based on certain input that the person provides. Authentication has become a major topic of research due to the increasing number of attacks on computer networks around the globe. This review paper focuses on multimodal biometric authentication systems in use today. The aim is to elicit the best combination of authentication factors for multimodal use. We study the strengths and weakness of selected biometric mechanisms and recommend novel solutions to include in multimodal biometric systems to improve on the current biometric drawbacks. We believe this paper will provide security researchers some useful insight whilst designing better biometric systems.

  10. Distributed XQuery-Based Integration and Visualization of Multimodality Brain Mapping Data.

    Science.gov (United States)

    Detwiler, Landon T; Suciu, Dan; Franklin, Joshua D; Moore, Eider B; Poliakov, Andrew V; Lee, Eunjung S; Corina, David P; Ojemann, George A; Brinkley, James F

    2009-01-01

    This paper addresses the need for relatively small groups of collaborating investigators to integrate distributed and heterogeneous data about the brain. Although various national efforts facilitate large-scale data sharing, these approaches are generally too "heavyweight" for individual or small groups of investigators, with the result that most data sharing among collaborators continues to be ad hoc. Our approach to this problem is to create a "lightweight" distributed query architecture, in which data sources are accessible via web services that accept arbitrary query languages but return XML results. A Distributed XQuery Processor (DXQP) accepts distributed XQueries in which subqueries are shipped to the remote data sources to be executed, with the resulting XML integrated by DXQP. A web-based application called DXBrain accesses DXQP, allowing a user to create, save and execute distributed XQueries, and to view the results in various formats including a 3-D brain visualization. Example results are presented using distributed brain mapping data sources obtained in studies of language organization in the brain, but any other XML source could be included. The advantage of this approach is that it is very easy to add and query a new source, the tradeoff being that the user needs to understand XQuery and the schemata of the underlying sources. For small numbers of known sources this burden is not onerous for a knowledgeable user, leading to the conclusion that the system helps to fill the gap between ad hoc local methods and large scale but complex national data sharing efforts.

  11. Multimodality molecular imaging and extracellular vesicle release based genetic profiling with porphyrin nanodroplets (Conference Presentation)

    Science.gov (United States)

    Zemp, Roger J.; Paproski, Robert J.

    2017-03-01

    For emerging tissue-engineering applications, transplants, and cell-based therapies it is important to assess cell viability and function in vivo in deep tissues. Bioluminescence and fluorescence methods are poorly suited to deep monitoring applications with high resolution and require genetically-engineered reporters which are not always feasible. We report on a method for imaging cell viability using deep, high-resolution photoacoustic imaging. We use an exogenous dye, Resazurin, itself weakly fluorescent until it is reduced from blue to a pink color with bright red fluorescence. Upon cell death fluorescence is lost and an absorption shift is observed. The irreversible reaction of resazurin to resorufin is proportional to aerobic respiration. We detect colorimetric absorption shifts using multispectral photoacoustic imaging and quantify the fraction of viable cells. SKOV-3 cells with and without ±80oC heat treatment were imaged after Resazurin treatment. High 575nm:620nm ratiometric absorption and photoacoustic signals in viable cells were observed with a much lower ratio in low-viability populations.

  12. ACCURATE REGISTRATION OF THE CHANG’E-1 IIM DATA BASED ON LRO LROC-WAC MOSICA DATA

    Directory of Open Access Journals (Sweden)

    Z. Yang

    2017-07-01

    Full Text Available In the detection of the moon, the visible and near-infrared reflectance data of the lunar material are important information sources for lunar chemical substances and mineral inversion. The Interferometer Imaging Spectrometer (IIM aboard the Chang'E-1 lunar orbiter is the first multispectral imaging spectrometer for Chinese lunar missions. In this paper, we use the mosaic image of global moon acquired by the Wide-angle Camera (WAC of the Lunar Reconnaissance Orbiter Camera (LROC to realize the accurate registration of Chang'E-1 IIM hyperspectral images. Due to the lack of GCPs, the emphasis of this work is to find a huge number of homologous points. The method proposed in this paper is to obtain several homologous points by manually matching, and then we utilize those points to calculate the initial homography matrix of LROC-WAC image and IIM image. This matrix is used to predict the area on IIM image where homologous points may be located, and the locations of the homologous points are determined by the orientation correlation in frequency domain. Finally we save the parts of homologous points which satisfied the conversion relationship of initial homography matrix to calculate homography matrix again. We use this iterative way to obtain a more accurate location of the homologous points. In this process, we take into account that the geometric deformations of different regions on IIM image are quite different. Therefore, we added image threshold segmentation based on the initial homography matrix in the experiment, and completed the above work of finding the homologous points on the segmented images. The final realization of registration accuracy of IIM images are in 1–2 pixels (RMSE. This provides a reliable data assurance for the subsequent study of using IIM images to inverse the lunar elements.

  13. Image registration algorithm for high-voltage electric power live line working robot based on binocular vision

    Science.gov (United States)

    Li, Chengqi; Ren, Zhigang; Yang, Bo; An, Qinghao; Yu, Xiangru; Li, Jinping

    2017-12-01

    In the process of dismounting and assembling the drop switch for the high-voltage electric power live line working (EPL2W) robot, one of the key problems is the precision of positioning for manipulators, gripper and the bolts used to fix drop switch. To solve it, we study the binocular vision system theory of the robot and the characteristic of dismounting and assembling drop switch. We propose a coarse-to-fine image registration algorithm based on image correlation, which can improve the positioning precision of manipulators and bolt significantly. The algorithm performs the following three steps: firstly, the target points are marked respectively in the right and left visions, and then the system judges whether the target point in right vision can satisfy the lowest registration accuracy by using the similarity of target points' backgrounds in right and left visions, this is a typical coarse-to-fine strategy; secondly, the system calculates the epipolar line, and then the regional sequence existing matching points is generated according to neighborhood of epipolar line, the optimal matching image is confirmed by calculating the similarity between template image in left vision and the region in regional sequence according to correlation matching; finally, the precise coordinates of target points in right and left visions are calculated according to the optimal matching image. The experiment results indicate that the positioning accuracy of image coordinate is within 2 pixels, the positioning accuracy in the world coordinate system is within 3 mm, the positioning accuracy of binocular vision satisfies the requirement dismounting and assembling the drop switch.

  14. A B-spline image registration based CAD scheme to evaluate drug treatment response of ovarian cancer patients

    Science.gov (United States)

    Tan, Maxine; Li, Zheng; Moore, Kathleen; Thai, Theresa; Ding, Kai; Liu, Hong; Zheng, Bin

    2016-03-01

    Ovarian cancer is the second most common cancer amongst gynecologic malignancies, and has the highest death rate. Since the majority of ovarian cancer patients (>75%) are diagnosed in the advanced stage with tumor metastasis, chemotherapy is often required after surgery to remove the primary ovarian tumors. In order to quickly assess patient response to the chemotherapy in the clinical trials, two sets of CT examinations are taken pre- and post-therapy (e.g., after 6 weeks). Treatment efficacy is then evaluated based on Response Evaluation Criteria in Solid Tumors (RECIST) guideline, whereby tumor size is measured by the longest diameter on one CT image slice and only a subset of selected tumors are tracked. However, this criterion cannot fully represent the volumetric changes of the tumors and might miss potentially problematic unmarked tumors. Thus, we developed a new CAD approach to measure and analyze volumetric tumor growth/shrinkage using a cubic B-spline deformable image registration method. In this initial study, on 14 sets of pre- and post-treatment CT scans, we registered the two consecutive scans using cubic B-spline registration in a multiresolution (from coarse to fine) framework. We used Mattes mutual information metric as the similarity criterion and the L-BFGS-B optimizer. The results show that our method can quantify volumetric changes in the tumors more accurately than RECIST, and also detect (highlight) potentially problematic regions that were not originally targeted by radiologists. Despite the encouraging results of this preliminary study, further validation of scheme performance is required using large and diverse datasets in future.

  15. Digital photography and 3D MRI-based multimodal imaging for individualized planning of resective neocortical epilepsy surgery.

    Science.gov (United States)

    Wellmer, Jörg; von Oertzen, Joachim; Schaller, Carlo; Urbach, Horst; König, Roy; Widman, Guido; Van Roost, Dirk; Elger, Christian E

    2002-12-01

    Invasive presurgical work up of pharmacoresistant epilepsies presumes integration of multiple diagnostic modalities into a comprehensive picture of seizure onset and eloquent brain areas. During resection, reliable transfer of evaluation results to the patient's individual anatomy must be made. We investigated the value of digital photography-based grid localization in combination with preoperative three-dimensional (3D) magnetic resonance imaging (MRI) for clinical routine. Digital photographs of the exposed cortex were taken before and after grid placement. Location of electrode contacts on the cortex was identified and schematically indicated on native cortex prints. Accordingly, transfer of contact positions to a 3D MRI brain-surface rendering was carried out manually by using the rendering software. Results of the electrophysiologic evaluation were transferred to either electrode contact reproduction and co-registered with imaging-based techniques such as single-photon emission computed tomography (SPECT), positron emission tomography (PET), and functional MRI (fMRI). Digital photography allows precise and highly realistic documentation of electrode contact positions on the individual neocortical surface. Lesions underneath grids can be highlighted by semitransparent MRI surface rendering, and lobar boundaries can be identified. Because of integrating electrode contact positions into the postprocessed 3D MRI data set, imaging-based techniques can be codisplayed with the results of the electrophysiologic evaluation. Comparison with CT/MRI co-registration showed good accuracy of the method. However, grids not sewn to the dura at implantation can become subject to significant displacement. Digital photography in combination with preimplantation 3D MRI allows the generation of reliable tailored resection plans in neocortical epilepsy surgery. The method enhances surgical safety and confidence.

  16. Distributed XQuery-based integration and visualization of multimodality brain mapping data

    Directory of Open Access Journals (Sweden)

    Landon T Detwiler

    2009-01-01

    Full Text Available This paper addresses the need for relatively small groups of collaborating investigators to integrate distributed and heterogeneous data about the brain. Although various national efforts facilitate large-scale data sharing, these approaches are generally too “heavyweight” for individual or small groups of investigators, with the result that most data sharing among collaborators continues to be ad hoc. Our approach to this problem is to create a “lightweight” distributed query architecture, in which data sources are accessible via web services that accept arbitrary query languages but return XML results. A Distributed XQuery Processor (DXQP accepts distributed XQueries in which subqueries are shipped to the remote data sources to be executed, with the resulting XML integrated by DXQP. A web-based application called DXBrain accesses DXQP, allowing a user to create, save and execute distributed XQueries, and to view the results in various formats including a 3-D brain visualization. Example results are presented using distributed brain mapping data sources obtained in studies of language organization in the brain, but any other XML source could be included. The advantage of this approach is that it is very easy to add and query a new source, the tradeoff being that the user needs to understand XQuery and the schemata of the underlying sources. For small numbers of known sources this burden is not onerous for a knowledgeable user, leading to the conclusion that the system helps to fill the gap between ad hoc local methods and large scale but complex national data sharing efforts.

  17. Design and evaluation of a multimodal mHealth based medication management system for patient self administration.

    Science.gov (United States)

    Schreier, Gunter; Schwarz, Mark; Modre-Osprian, Robert; Kastner, Peter; Scherr, Daniel; Fruhwald, Friedrich

    2013-01-01

    The intake of prescribed medication presents a challenge, in particular for elderly people and in cases where a variety of medications have to be taken in accordance to a complex schedule. To support patients with this task, an mHealth-concept was developed and evaluated in the course of a clinical trial. The system used a multimodal user interface concept, i.e. both RFID tags and barcodes to identify and document the intake of medications. Results of the clinical study with 20 patients indicate that the multimodal mHealth concept utilizing barcode and RFID tags enabled easy-to-use medication management. Although further clinical evaluation is needed to assess whether such a tool can also enhance adherence, the system shows the potential for targeting the problem of medication management with mHealth methods.

  18. Optical Splitters Based on Self-Imaging Effect in Multi-Mode Waveguide Made by Ion Exchange in Glass

    OpenAIRE

    Barkman, O.; Jerabek, V.; Prajzler, V.

    2013-01-01

    Design and modeling of single mode optical multi-mode interference structures with graded refractive index is reported. Several samples of planar optical channel waveguides were obtained by Ag+Na+ and K+Na+ one step thermal ion exchange process in molten salt on GIL49 glass substrate and new special optical glass for ion exchange technology. Waveguide properties were measured by optical mode spectroscopy. Obtained data were used for further design and modeling of single mode channel waveguide...

  19. A registration-based segmentation method with application to adiposity analysis of mice microCT images

    Science.gov (United States)

    Bai, Bing; Joshi, Anand; Brandhorst, Sebastian; Longo, Valter D.; Conti, Peter S.; Leahy, Richard M.

    2014-04-01

    Obesity is a global health problem, particularly in the U.S. where one third of adults are obese. A reliable and accurate method of quantifying obesity is necessary. Visceral adipose tissue (VAT) and subcutaneous adipose tissue (SAT) are two measures of obesity that reflect different associated health risks, but accurate measurements in humans or rodent models are difficult. In this paper we present an automatic, registration-based segmentation method for mouse adiposity studies using microCT images. We co-register the subject CT image and a mouse CT atlas. Our method is based on surface matching of the microCT image and an atlas. Surface-based elastic volume warping is used to match the internal anatomy. We acquired a whole body scan of a C57BL6/J mouse injected with contrast agent using microCT and created a whole body mouse atlas by manually delineate the boundaries of the mouse and major organs. For method verification we scanned a C57BL6/J mouse from the base of the skull to the distal tibia. We registered the obtained mouse CT image to our atlas. Preliminary results show that we can warp the atlas image to match the posture and shape of the subject CT image, which has significant differences from the atlas. We plan to use this software tool in longitudinal obesity studies using mouse models.

  20. Validation for 2D/3D registration. II: The comparison of intensity- and gradient-based merit functions using a new gold standard data set.

    Science.gov (United States)

    Gendrin, Christelle; Markelj, Primoz; Pawiro, Supriyanto Ardjo; Spoerk, Jakob; Bloch, Christoph; Weber, Christoph; Figl, Michael; Bergmann, Helmar; Birkfellner, Wolfgang; Likar, Bostjan; Pernus, Franjo

    2011-03-01

    A new gold standard data set for validation of 2D/3D registration based on a porcine cadaver head with attached fiducial markers was presented in the first part of this article. The advantage of this new phantom is the large amount of soft tissue, which simulates realistic conditions for registration. This article tests the performance of intensity- and gradient-based algorithms for 2D/3D registration using the new phantom data set. Intensity-based methods with four merit functions, namely, cross correlation, rank correlation, correlation ratio, and mutual information (MI), and two gradient-based algorithms, the backprojection gradient-based (BGB) registration method and the reconstruction gradient-based (RGB) registration method, were compared. Four volumes consisting of CBCT with two fields of view, 64 slice multidetector CT, and magnetic resonance-T1 weighted images were registered to a pair of kV x-ray images and a pair of MV images. A standardized evaluation methodology was employed. Targets were evenly spread over the volumes and 250 starting positions of the 3D volumes with initial displacements of up to 25 mm from the gold standard position were calculated. After the registration, the displacement from the gold standard was retrieved and the root mean square (RMS), mean, and standard deviation mean target registration errors (mTREs) over 250 registrations were derived. Additionally, the following merit properties were computed: Accuracy, capture range, number of minima, risk of nonconvergence, and distinctiveness of optimum for better comparison of the robustness of each merit. Among the merit functions used for the intensity-based method, MI reached the best accuracy with an RMS mTRE down to 1.30 mm. Furthermore, it was the only merit function that could accurately register the CT to the kV x rays with the presence of tissue deformation. As for the gradient-based methods, BGB and RGB methods achieved subvoxel accuracy (RMS mTRE down to 0.56 and 0.70 mm

  1. Multimodal brain-tumor segmentation based on Dirichlet process mixture model with anisotropic diffusion and Markov random field prior.

    Science.gov (United States)

    Lu, Yisu; Jiang, Jun; Yang, Wei; Feng, Qianjin; Chen, Wufan

    2014-01-01

    Brain-tumor segmentation is an important clinical requirement for brain-tumor diagnosis and radiotherapy planning. It is well-known that the number of clusters is one of the most important parameters for automatic segmentation. However, it is difficult to define owing to the high diversity in appearance of tumor tissue among different patients and the ambiguous boundaries of lesions. In this study, a nonparametric mixture of Dirichlet process (MDP) model is applied to segment the tumor images, and the MDP segmentation can be performed without the initialization of the number of clusters. Because the classical MDP segmentation cannot be applied for real-time diagnosis, a new nonparametric segmentation algorithm combined with anisotropic diffusion and a Markov random field (MRF) smooth constraint is proposed in this study. Besides the segmentation of single modal brain-tumor images, we developed the algorithm to segment multimodal brain-tumor images by the magnetic resonance (MR) multimodal features and obtain the active tumor and edema in the same time. The proposed algorithm is evaluated using 32 multimodal MR glioma image sequences, and the segmentation results are compared with other approaches. The accuracy and computation time of our algorithm demonstrates very impressive performance and has a great potential for practical real-time clinical use.

  2. Move it to improve it (Mitii): study protocol of a randomised controlled trial of a novel web-based multimodal training program for children and adolescents with cerebral palsy

    Science.gov (United States)

    Boyd, Roslyn N; Mitchell, Louise E; James, Sarah T; Ziviani, Jenny; Sakzewski, Leanne; Smith, Anthony; Rose, Stephen; Cunnington, Ross; Whittingham, Koa; Ware, Robert S; Comans, Tracey A; Scuffham, Paul A

    2013-01-01

    Introduction Persons with cerebral palsy require a lifetime of costly and resource intensive interventions which are often limited by equity of access. With increasing burden being placed on health systems, new methods to deliver intensive rehabilitation therapies are needed. Move it to improve it (Mitii) is an internet-based multimodal programme comprising upper-limb and cognitive training with physical activity. It can be accessed in the client's home at their convenience. The proposed study aims to test the efficacy of Mitii in improving upper-limb function and motor planning. Additionally, this study hopes to further our understanding of the central neurovascular mechanisms underlying the proposed changes and determine the cost effectiveness of Mitii. Methods and analysis Children with congenital hemiplegia will be recruited to participate in this waitlist control, matched pairs, single-blind randomised trial. Children be matched at baseline and randomly allocated to receive 20 weeks of 30 min of daily Mitii training immediately, or waitlisted for 20 weeks before receiving the same Mitii training (potential total dose=70 h). Outcomes will be assessed at 20 weeks after the start of Mitii, and retention effects tested at 40 weeks. The primary outcomes will be the Assessment of Motor and Process Skills (AMPS), the Assisting Hand Assessment (AHA) and unimanual upper-limb capacity using the Jebsen-Taylor Test of Hand Function (JTTHF). Advanced brain imaging will assess use-dependant neuroplasticity. Measures of body structure and functions, activity, participation and quality of life will be used to assess Mitii efficacy across all domains of the International Classification of Functioning, Disability and Health framework. Ethics and dissemination This project has received Ethics Approval from the Medical Ethics Committee of The University of Queensland (2011000608) and the Royal Children's Hospital Brisbane (HREC/11/QRCH/35). Findings will be

  3. "MedTRIS" (Medical Triage and Registration Informatics System): A Web-based Client Server System for the Registration of Patients Being Treated in First Aid Posts at Public Events and Mass Gatherings.

    Science.gov (United States)

    Gogaert, Stefan; Vande Veegaete, Axel; Scholliers, Annelies; Vandekerckhove, Philippe

    2016-10-01

    First aid (FA) services are provisioned on-site as a preventive measure at most public events. In Flanders, Belgium, the Belgian Red Cross-Flanders (BRCF) is the major provider of these FA services with volunteers being deployed at approximately 10,000 public events annually. The BRCF has systematically registered information on the patients being treated in FA posts at major events and mass gatherings during the last 10 years. This information has been collected in a web-based client server system called "MedTRIS" (Medical Triage and Registration Informatics System). MedTRIS contains data on more than 200,000 patients at 335 mass events. This report describes the MedTRIS architecture, the data collected, and how the system operates in the field. This database consolidates different types of information with regards to FA interventions in a standardized way for a variety of public events. MedTRIS allows close monitoring in "real time" of the situation at mass gatherings and immediate intervention, when necessary; allows more accurate prediction of resources needed; allows to validate conceptual and predictive models for medical resources at (mass) public events; and can contribute to the definition of a standardized minimum data set (MDS) for mass-gathering health research and evaluation. Gogaert S , Vande veegaete A , Scholliers A , Vandekerckhove P . "MedTRIS" (Medical Triage and Registration Informatics System): a web-based client server system for the registration of patients being treated in first aid posts at public events and mass gatherings. Prehosp Disaster Med. 2016;31(5):557-562.

  4. Evolution of surface-based deformable image registration for adaptive radiotherapy of non-small cell lung cancer (NSCLC

    Directory of Open Access Journals (Sweden)

    Richter Anne

    2009-12-01

    Full Text Available Abstract Background To evaluate the performance of surface-based deformable image registration (DR for adaptive radiotherapy of non-small cell lung cancer (NSCLC. Methods Based on 13 patients with locally advanced NSCLC, CT images acquired at treatment planning, midway and the end of the radio- (n = 1 or radiochemotherapy (n = 12 course were used for evaluation of DR. All CT images were manually [gross tumor volume (GTV] and automatically [organs-at-risk (OAR lung, spinal cord, vertebral spine, trachea, aorta, outline] segmented. Contours were transformed into 3D meshes using the Pinnacle treatment planning system and corresponding mesh points defined control points for DR with interpolation within the structures. Using these deformation maps, follow-up CT images were transformed into the planning images and compared with the original planning CT images. Results A progressive tumor shrinkage was observed with median GTV volumes of 170 cm3 (range 42 cm3 - 353 cm3, 124 cm3 (19 cm3 - 325 cm3 and 100 cm3 (10 cm3 - 270 cm3 at treatment planning, mid-way and at the end of treatment. Without DR, correlation coefficients (CC were 0.76 ± 0.11 and 0.74 ± 0.10 for comparison of the planning CT and the CT images acquired mid-way and at the end of treatment, respectively; DR significantly improved the CC to 0.88 ± 0.03 and 0.86 ± 0.05 (p = 0.001, respectively. With manual landmark registration as reference, DR reduced uncertainties on the GTV surface from 11.8 mm ± 5.1 mm to 2.9 mm ± 1.2 mm. Regarding the carina and intrapulmonary vessel bifurcations, DR reduced uncertainties by about 40% with residual errors of 4 mm to 6 mm on average. Severe deformation artefacts were observed in patients with resolving atelectasis and pleural effusion, in one patient, where the tumor was located around large bronchi and separate segmentation of the GTV and OARs was not possible, and in one patient, where no clear shrinkage but more a decay of the tumor was observed

  5. Automatic histology registration in application to x-ray modalities

    Science.gov (United States)

    Chicherova, Natalia; Hieber, Simone E.; Schulz, Georg; Khimchenko, Anna; Bikis, Christos; Cattin, Philippe C.; Müller, Bert

    2016-10-01

    Registration of microscope images to Computed Tomography (CT) 3D volumes is a challenging task because it requires not only multi-modal similarity measure but also 2D-3D or slice-to-volume correspondence. This type of registration is usually done manually which is very time-consuming and prone to errors. Recently we have developed the first automatic approach to localize histological sections in μCT data of a jaw bone. The median distance between the automatically found slices and the ground truth was below 35 μm. Here we explore the limitations of the method by applying it to three tomography datasets acquired with grating interferometry, laboratory-based μCT and single-distance phase retrieval. Moreover, we compare the performance of three feature detectors in the proposed framework, i.e. Speeded Up Robust Features (SURF), Scale Invariant Feature Transform (SIFT) and Affine SIFT (ASIFT). Our results show that all the feature detectors performed significantly better on the grating interferometry dataset than on other modalities. The median accuracy for the vertical position was 0.06 mm. Across the feature detector types the smallest error was achieved by the SURF-based feature detector (0.29 mm). Furthermore, the SURF-based method was computationally the most efficient. Thus, we recommend to use the SURF feature detector for the proposed framework.

  6. [Multimodal serotonergic antidepressants].

    Science.gov (United States)

    Danilov, D S

    Based on the original literature, the author for the first time describes a history of selective serotonergic antidepressants simultaneously inhibiting the serotonin reuptake and directly interacting with serotonin receptors. A history of creation and introduction of their main representatives is presented. A history of investigation of their neurochemical activity is analyzed in details. The history of the evolution of their classifications is systemized. The data presented suggest the rationale for unifying all selective serotonergic antidepressants, simultaneously inhibiting the serotonin reuptake and directly interacting with serotonin receptors (trazodone, etoperidone, nefazodone, vilazodone, vortioxetine), in one group of 'multimodal serotonergic antidepressants'. The expediency to include this group in the modern neurochemical classification of nootropic drugs is substantiated.

  7. Multimodality in organization studies

    DEFF Research Database (Denmark)

    Van Leeuwen, Theo

    2017-01-01

    This afterword reviews the chapters in this volume and reflects on the synergies between organization and management studies and multimodality studies that emerge from the volume. These include the combination of strong sociological theorizing and detailed multimodal analysis, a focus on material...

  8. Multimodal fluorescence imaging spectroscopy

    NARCIS (Netherlands)

    Stopel, Martijn H W; Blum, Christian; Subramaniam, Vinod; Engelborghs, Yves; Visser, Anthonie J.W.G.

    2014-01-01

    Multimodal fluorescence imaging is a versatile method that has a wide application range from biological studies to materials science. Typical observables in multimodal fluorescence imaging are intensity, lifetime, excitation, and emission spectra which are recorded at chosen locations at the sample.

  9. Quantifying Quality Aspects of Multimodal Interactive Systems

    CERN Document Server

    Kühnel, Christine

    2012-01-01

    This book systematically addresses the quantification of quality aspects of multimodal interactive systems. The conceptual structure is based on a schematic view on human-computer interaction where the user interacts with the system and perceives it via input and output interfaces. Thus, aspects of multimodal interaction are analyzed first, followed by a discussion of the evaluation of output and input and concluding with a view on the evaluation of a complete system.

  10. Automated geographic registration and radiometric correction for UAV-based mosaics

    Science.gov (United States)

    Texas A&M University has been operating a large-scale, UAV-based, agricultural remote-sensing research project since 2015. To use UAV-based images in agricultural production, many high-resolution images must be mosaicked together to create an image of an agricultural field. Two key difficulties to s...

  11. Combined multimodal photoacoustic tomography, optical coherence tomography (OCT) and OCT based angiography system for in vivo imaging of multiple skin disorders in human(Conference Presentation)

    Science.gov (United States)

    Liu, Mengyang; Chen, Zhe; Sinz, Christoph; Rank, Elisabet; Zabihian, Behrooz; Zhang, Edward Z.; Beard, Paul C.; Kittler, Harald; Drexler, Wolfgang

    2017-02-01

    All optical photoacoustic tomography (PAT) using a planar Fabry-Perot interferometer polymer film sensor has been demonstrated for in vivo human palm imaging with an imaging penetration depth of 5 mm. The relatively larger vessels in the superficial plexus and the vessels in the dermal plexus are visible in PAT. However, due to both resolution and sensitivity limits, all optical PAT cannot reveal the smaller vessels such as capillary loops and venules. Melanin absorption also sometimes causes difficulties in PAT to resolve vessels. Optical coherence tomography (OCT) based angiography, on the other hand, has been proven suitable for microvasculature visualization in the first couple millimeters in human. In our work, we combine an all optical PAT system with an OCT system featuring a phase stable akinetic swept source. This multimodal PAT/OCT/OCT-angiography system provides us co-registered human skin vasculature information as well as the structural information of cutaneous. The scanning units of the sub-systems are assembled into one probe, which is then mounted onto a portable rack. The probe and rack design gives six degrees of freedom, allowing the multimodal optical imaging probe to access nearly all regions of human body. Utilizing this probe, we perform imaging on patients with various skin disorders as well as on healthy controls. Fused PAT/OCT-angiography volume shows the complete blood vessel network in human skin, which is further embedded in the morphology provided by OCT. A comparison between the results from the disordered regions and the normal regions demonstrates the clinical translational value of this multimodal optical imaging system in dermatology.

  12. Non-rigid contour-to-pixel registration of photographic and quantitative light-induced fluorescence imaging of decalcified teeth

    Science.gov (United States)

    Berkels, Benjamin; Deserno, Thomas; Ehrlich, Eva E.; Fritz, Ulrike B.; Sirazitdinova, Ekaterina; Tatano, Rosalia

    2016-03-01

    Quantitative light-induced fluorescence (QLF) is widely used to assess the damage of a tooth due to decalcification. In digital photographs, decalcification appears as white spot lesions, i.e. white spots on the tooth surface. We propose a novel multimodal registration approach for the matching of digital photographs and QLF images of decalcified teeth. The registration is based on the idea of contour-to-pixel matching. Here, the curve, which represents the shape of the tooth, is extracted from the QLF image using a contour segmentation by binarization and morphological processing. This curve is aligned to the photo with a non-rigid variational registration approach. Thus, the registration problem is formulated as minimization problem with an objective function that consists of a data term and a regularizer for the deformation. To construct the data term, the photo is pointwise classified into tooth and non-tooth regions. Then, the signed distance function of the tooth region allows to measure the mismatch between curve and photo. As regularizer a higher order, linear elastic prior is used. The resulting minimization problem is solved numerically using bilinear Finite Elements for the spatial discretization and the Gauss-Newton algorithm. The evaluation is based on 150 image pairs, where an average of 5 teeth have been captured from 32 subjects. All registrations have been confirmed correctly by a dental expert. The contour-to-pixel methods can directly be used in 3D for surface-to-voxel tasks.

  13. Validation of Shape Context Based Image Registration Method Using Digital Image Correlation Measurement on a Rat Stomach

    DEFF Research Database (Denmark)

    Liao, Donghua; Wang, P; Zhao, Jingbo

    2014-01-01

    needs to be further verified by using a feature tracking measurement. Hence, the aim of this study was to verify the SC method-based calculation by using digital image correlation (DIC) measurement on a rat stomach. The rat stomach exposed to distension pressures 0.0, 0.2, 0.4, and 0.6 kPa were studied...... using both 3D DIC system and SC-based image registration calculation. Three different surface sample counts between the reference and the target surfaces were usedto gauge the effect of the surface sample counts on the calculation. Each pair of the surface points between the DIC measured target surface...... and the SC calculated correspondence surface was compared. Compared with DIC measurement, the SC calculated surface had errors from 5% to 23% at pressures from 0.2 to 0.6 kPa with different surface sample counts between the reference surface and the target surface. This indicates good qualitative...

  14. Mass preserving image registration

    DEFF Research Database (Denmark)

    Gorbunova, Vladlena; Sporring, Jon; Lo, Pechin Chien Pau

    2010-01-01

    The paper presents results the mass preserving image registration method in the Evaluation of Methods for Pulmonary Image Registration 2010 (EMPIRE10) Challenge. The mass preserving image registration algorithm was applied to the 20 image pairs. Registration was evaluated using four different...

  15. Comparison of IGRT Registration Strategies for Optimal Coverage of Primary Lung Tumors and Involved Nodes Based on Multiple Four-Dimensional CT Scans Obtained Throughout the Radiotherapy Course

    Energy Technology Data Exchange (ETDEWEB)

    Mohammed, Nasiruddin; Kestin, Larry; Grills, Inga; Shah, Chirag; Glide-Hurst, Carri; Yan, Di [Department of Radiation Oncology, William Beaumont Hospital, Royal Oak, MI (United States); Ionascu, Dan, E-mail: Dan.ionascu@beaumont.edu [Department of Radiation Oncology, William Beaumont Hospital, Royal Oak, MI (United States)

    2012-03-15

    Purpose: To investigate the impact of primary tumor and involved lymph node (LN) geometry (centroid, shape, volume) on internal target volume (ITV) throughout treatment for locally advanced non-small cell lung cancer using weekly four-dimensional computed tomography (4DCT). Methods and Materials: Eleven patients with advanced non-small cell lung cancer were treated using image-guided radiotherapy with acquisition of weekly 10-Phase 4DCTs (n = 51). Initial ITV was based on planning 4DCT. Master-ITV incorporated target geometry across the entire treatment (all 4DCTs). Geographic miss was defined as the % Master-ITV positioned outside of the initial planning ITV after registration is complete. Registration strategies considered were bony (B), primary tumor soft tissue alone (T), and registration based on primary tumor and involved LNs (T{sub L}N). Results: The % geographic miss for the primary tumor, mediastinal, and hilar lymph nodes based on each registration strategy were (1) B: 30%, 30%, 30%; (2) T: 21%, 40%, 36%; and (3) T{sub L}N: 26%, 26%, 27%. Mean geographic expansions to encompass 100% of the primary tumor and involved LNs were 1.2 {+-} 0.7 cm and 0.8 {+-} 0.3 cm, respectively, for B and T{sub L}N. Primary and involved LN expansions were 0.7 {+-} 0.5 cm and 1.1 {+-} 0.5 cm for T. Conclusion: T is best for solitary targets. When treatments include primary tumor and LNs, B and T{sub L}N provide more comprehensive geographic coverage. We have identified high % geographic miss when considering multiple registration strategies. The dosimetric implications are the subject of future study.

  16. Comparison of IGRT Registration Strategies for Optimal Coverage of Primary Lung Tumors and Involved Nodes Based on Multiple Four-Dimensional CT Scans Obtained Throughout the Radiotherapy Course

    International Nuclear Information System (INIS)

    Mohammed, Nasiruddin; Kestin, Larry; Grills, Inga; Shah, Chirag; Glide-Hurst, Carri; Yan, Di; Ionascu, Dan

    2012-01-01

    Purpose: To investigate the impact of primary tumor and involved lymph node (LN) geometry (centroid, shape, volume) on internal target volume (ITV) throughout treatment for locally advanced non–small cell lung cancer using weekly four-dimensional computed tomography (4DCT). Methods and Materials: Eleven patients with advanced non–small cell lung cancer were treated using image-guided radiotherapy with acquisition of weekly 10-Phase 4DCTs (n = 51). Initial ITV was based on planning 4DCT. Master-ITV incorporated target geometry across the entire treatment (all 4DCTs). Geographic miss was defined as the % Master-ITV positioned outside of the initial planning ITV after registration is complete. Registration strategies considered were bony (B), primary tumor soft tissue alone (T), and registration based on primary tumor and involved LNs (T L N). Results: The % geographic miss for the primary tumor, mediastinal, and hilar lymph nodes based on each registration strategy were (1) B: 30%, 30%, 30%; (2) T: 21%, 40%, 36%; and (3) T L N: 26%, 26%, 27%. Mean geographic expansions to encompass 100% of the primary tumor and involved LNs were 1.2 ± 0.7 cm and 0.8 ± 0.3 cm, respectively, for B and T L N. Primary and involved LN expansions were 0.7 ± 0.5 cm and 1.1 ± 0.5 cm for T. Conclusion: T is best for solitary targets. When treatments include primary tumor and LNs, B and T L N provide more comprehensive geographic coverage. We have identified high % geographic miss when considering multiple registration strategies. The dosimetric implications are the subject of future study.

  17. Critical Analysis of Multimodal Discourse

    DEFF Research Database (Denmark)

    van Leeuwen, Theo

    2013-01-01

    This is an encyclopaedia article which defines the fields of critical discourse analysis and multimodality studies, argues that within critical discourse analysis more attention should be paid to multimodality, and within multimodality to critical analysis, and ends reviewing a few examples...... of recent work in the critical analysis of multimodal discourse....

  18. 76 FR 10947 - Registration and Regulation of Security-Based Swap Execution Facilities

    Science.gov (United States)

    2011-02-28

    ... Dodd-Frank Wall Street Reform and Consumer Protection Act of 2010 (``Dodd-Frank Act''), the Securities... interpretation of the definition of ``security-based swap execution facility'' set forth in Section 3(a)(77) of... satisfy the statutory definition. In addition, the Commission is proposing to amend Rule 3a-1 under the...

  19. Rapid prototype modeling in a multimodality world

    Science.gov (United States)

    Bidaut, Luc; Madewell, John; Yasko, Alan

    2006-03-01

    Introduction: Rapid prototype modeling (RPM) has been used in medicine principally for bones - that are easily extracted from CT data sets - for planning orthopaedic, plastic or maxillo-facial interventions, and/or for designing custom prostheses and implants. Based on newly available technology, highly valuable multimodality approaches can now be applied to RPM, particularly for complex musculo-skeletal (MSK) tumors where multimodality often transcends CT alone. Methods: CT data sets are acquired for primary evaluation of MSK tumors in parallel with other modalities (e.g., MR, PET, SPECT). In our approach, CT is first segmented to provide bony anatomy for RPM and all other data sets are then registered to the CT reference. Parametric information relevant to the tumor's characterization is then extracted from the multimodality space and merged with the CT anatomy to produce a hybrid RPM-ready model. This model - that also accommodates digital multimodality visualization - is then produced on the latest generation of 3D printers, which permits both shapes and colors. Results: Multimodality models of complex MSK tumors have been physically produced on modern RPM equipment. This new approach has been found to be a clear improvement over the previously disconnected physical RPM and digital multimodality visualization. Conclusions: New technical developments keep opening doors to sophisticated medical applications that can directly impact the quality of patient care. Although this early work still deals with bones as base models for RPM, its use to encompass soft tissues is already envisioned for future approaches.

  20. CIS-based registration of quality of life in a single source approach

    Directory of Open Access Journals (Sweden)

    Riek Markus

    2011-04-01

    Full Text Available Abstract Background Documenting quality of life (QoL in routine medical care and using it both for treatment and for clinical research is not common, although such information is absolutely valuable for physicians and patients alike. We therefore aimed at developing an efficient method to integrate quality of life information into the clinical information system (CIS and thus make it available for clinical care and secondary use. Methods We piloted our method in three different medical departments, using five different QoL questionnaires. In this setting we used structured interviews and onsite observations to perform workflow and form analyses. The forms and pertinent data reports were implemented using the integrated tools of the local CIS. A web-based application for mobile devices was developed based on XML schemata to facilitate data import into the CIS. Data exports of the CIS were analysed with statistical software to perform an analysis of data quality. Results The quality of life questionnaires are now regularly documented by patients and physicians. The resulting data is available in the Electronic Health Record (EHR and can be used for treatment purposes and communication as well as research functionalities. The completion of questionnaires by the patients themselves using a mobile device (iPad and the import of the respective data into the CIS forms were successfully tested in a pilot installation. The quality of data is rendered high by the use of automatic score calculations as well as the automatic creation of forms for follow-up documentation. The QoL data was exported to research databases for use in scientific analysis. Conclusion The CIS-based QoL is technically feasible, clinically accepted and provides an excellent quality of data for medical treatment and clinical research. Our approach with a commercial CIS and the web-based application is transferable to other sites.

  1. CIS-based registration of quality of life in a single source approach.

    Science.gov (United States)

    Fritz, Fleur; Ständer, Sonja; Breil, Bernhard; Riek, Markus; Dugas, Martin

    2011-04-21

    Documenting quality of life (QoL) in routine medical care and using it both for treatment and for clinical research is not common, although such information is absolutely valuable for physicians and patients alike. We therefore aimed at developing an efficient method to integrate quality of life information into the clinical information system (CIS) and thus make it available for clinical care and secondary use. We piloted our method in three different medical departments, using five different QoL questionnaires. In this setting we used structured interviews and onsite observations to perform workflow and form analyses. The forms and pertinent data reports were implemented using the integrated tools of the local CIS. A web-based application for mobile devices was developed based on XML schemata to facilitate data import into the CIS. Data exports of the CIS were analysed with statistical software to perform an analysis of data quality. The quality of life questionnaires are now regularly documented by patients and physicians. The resulting data is available in the Electronic Health Record (EHR) and can be used for treatment purposes and communication as well as research functionalities. The completion of questionnaires by the patients themselves using a mobile device (iPad) and the import of the respective data into the CIS forms were successfully tested in a pilot installation. The quality of data is rendered high by the use of automatic score calculations as well as the automatic creation of forms for follow-up documentation. The QoL data was exported to research databases for use in scientific analysis. The CIS-based QoL is technically feasible, clinically accepted and provides an excellent quality of data for medical treatment and clinical research. Our approach with a commercial CIS and the web-based application is transferable to other sites.

  2. A Fast Multimodal Ectopic Beat Detection Method Applied for Blood Pressure Estimation Based on Pulse Wave Velocity Measurements in Wearable Sensors

    Directory of Open Access Journals (Sweden)

    Maik Pflugradt

    2017-01-01

    Full Text Available Automatic detection of ectopic beats has become a thoroughly researched topic, with literature providing manifold proposals typically incorporating morphological analysis of the electrocardiogram (ECG. Although being well understood, its utilization is often neglected, especially in practical monitoring situations like online evaluation of signals acquired in wearable sensors. Continuous blood pressure estimation based on pulse wave velocity considerations is a prominent example, which depends on careful fiducial point extraction and is therefore seriously affected during periods of increased occurring extrasystoles. In the scope of this work, a novel ectopic beat discriminator with low computational complexity has been developed, which takes advantage of multimodal features derived from ECG and pulse wave relating measurements, thereby providing additional information on the underlying cardiac activity. Moreover, the blood pressure estimations’ vulnerability towards ectopic beats is closely examined on records drawn from the Physionet database as well as signals recorded in a small field study conducted in a geriatric facility for the elderly. It turns out that a reliable extrasystole identification is essential to unsupervised blood pressure estimation, having a significant impact on the overall accuracy. The proposed method further convinces by its applicability to battery driven hardware systems with limited processing power and is a favorable choice when access to multimodal signal features is given anyway.

  3. A Fast Multimodal Ectopic Beat Detection Method Applied for Blood Pressure Estimation Based on Pulse Wave Velocity Measurements in Wearable Sensors

    Science.gov (United States)

    Pflugradt, Maik; Geissdoerfer, Kai; Goernig, Matthias; Orglmeister, Reinhold

    2017-01-01

    Automatic detection of ectopic beats has become a thoroughly researched topic, with literature providing manifold proposals typically incorporating morphological analysis of the electrocardiogram (ECG). Although being well understood, its utilization is often neglected, especially in practical monitoring situations like online evaluation of signals acquired in wearable sensors. Continuous blood pressure estimation based on pulse wave velocity considerations is a prominent example, which depends on careful fiducial point extraction and is therefore seriously affected during periods of increased occurring extrasystoles. In the scope of this work, a novel ectopic beat discriminator with low computational complexity has been developed, which takes advantage of multimodal features derived from ECG and pulse wave relating measurements, thereby providing additional information on the underlying cardiac activity. Moreover, the blood pressure estimations’ vulnerability towards ectopic beats is closely examined on records drawn from the Physionet database as well as signals recorded in a small field study conducted in a geriatric facility for the elderly. It turns out that a reliable extrasystole identification is essential to unsupervised blood pressure estimation, having a significant impact on the overall accuracy. The proposed method further convinces by its applicability to battery driven hardware systems with limited processing power and is a favorable choice when access to multimodal signal features is given anyway. PMID:28098831

  4. Performance evaluation of 2D image registration algorithms with the numeric image registration and comparison platform

    International Nuclear Information System (INIS)

    Gerganov, G.; Kuvandjiev, V.; Dimitrova, I.; Mitev, K.; Kawrakow, I.

    2012-01-01

    The objective of this work is to present the capabilities of the NUMERICS web platform for evaluation of the performance of image registration algorithms. The NUMERICS platform is a web accessible tool which provides access to dedicated numerical algorithms for registration and comparison of medical images (http://numerics.phys.uni-sofia.bg). The platform allows comparison of noisy medical images by means of different types of image comparison algorithms, which are based on statistical tests for outliers. The platform also allows 2D image registration with different techniques like Elastic Thin-Plate Spline registration, registration based on rigid transformations, affine transformations, as well as non-rigid image registration based on Mobius transformations. In this work we demonstrate how the platform can be used as a tool for evaluation of the quality of the image registration process. We demonstrate performance evaluation of a deformable image registration technique based on Mobius transformations. The transformations are applied with appropriate cost functions like: Mutual information, Correlation coefficient, Sum of Squared Differences. The accent is on the results provided by the platform to the user and their interpretation in the context of the performance evaluation of 2D image registration. The NUMERICS image registration and image comparison platform provides detailed statistical information about submitted image registration jobs and can be used to perform quantitative evaluation of the performance of different image registration techniques. (authors)

  5. Vision-based markerless registration using stereo vision and an augmented reality surgical navigation system: a pilot study

    International Nuclear Information System (INIS)

    Suenaga, Hideyuki; Tran, Huy Hoang; Liao, Hongen; Masamune, Ken; Dohi, Takeyoshi; Hoshi, Kazuto; Takato, Tsuyoshi

    2015-01-01

    This study evaluated the use of an augmented reality navigation system that provides a markerless registration system using stereo vision in oral and maxillofacial surgery. A feasibility study was performed on a subject, wherein a stereo camera was used for tracking and markerless registration. The computed tomography data obtained from the volunteer was used to create an integral videography image and a 3-dimensional rapid prototype model of the jaw. The overlay of the subject’s anatomic site and its 3D-IV image were displayed in real space using a 3D-AR display. Extraction of characteristic points and teeth matching were done using parallax images from two stereo cameras for patient-image registration. Accurate registration of the volunteer’s anatomy with IV stereoscopic images via image matching was done using the fully automated markerless system, which recognized the incisal edges of the teeth and captured information pertaining to their position with an average target registration error of < 1 mm. These 3D-CT images were then displayed in real space with high accuracy using AR. Even when the viewing position was changed, the 3D images could be observed as if they were floating in real space without using special glasses. Teeth were successfully used for registration via 3D image (contour) matching. This system, without using references or fiducial markers, displayed 3D-CT images in real space with high accuracy. The system provided real-time markerless registration and 3D image matching via stereo vision, which, combined with AR, could have significant clinical applications. The online version of this article (doi:10.1186/s12880-015-0089-5) contains supplementary material, which is available to authorized users

  6. An ellipse-fitting based method for efficient registration of breast masses on two mammographic views

    International Nuclear Information System (INIS)

    Pu Jiantao; Zheng Bin; Leader, Joseph Ken; Gur, David

    2008-01-01

    When reading mammograms, radiologists routinely search for and compare suspicious breast lesions identified on two corresponding craniocaudal (CC) and mediolateral oblique (MLO) views. Automatically identifying and matching the same true-positive breast lesions depicted on two views is an important step for developing successful multiview based computer-aided detection (CAD) schemes. The authors developed a method to automatically register breast areas and detect matching strips of interest used to identify the matched mass regions depicted on CC and MLO views. The method uses an ellipse based model to fit the breast boundary contour (skin line) and set a local Cartesian coordinate system for each view. One intersection point between the major/minor axis and the fitted ellipse perimeter passed through breast boundary is selected as the origin and the majoraxis and the minoraxis of the ellipse are used as the two axis of the Cartesian coordinate system. When a mass is identified on one view, the scheme computes its position in the local coordinate system. Then, the distance is mapped onto the local coordinate of the other view. At the end of the mapped distance a registered centerline of the matching strip is created. The authors established an image database that includes 200 test examinations each depicting one verified mass visible on the two views. They tested whether the registered centerline identified on another view can be used to locate the matched mass region. The experiments show that the average distance between the mass region centers and the registered centerlines was ±8.3 mm and in 91% of testing cases the registered centerline actually passes through the matched mass regions. A matching strip width of 47 mm was required to achieve 100% sensitivity for the test database. The results demonstrate the feasibility of the proposed method to automatically identify masses depicted on CC and MLO views, which may improve future development of multiview based

  7. Translating evidence-based practice for managing comorbid substance use and mental illness using a multi-modal training package.

    Science.gov (United States)

    Louie, Eva; Giannopoulos, Vicki; Baillie, Andrew; Uribe, Gabriela; Byrne, Simon; Deady, Mark; Teesson, Maree; Baker, Amanda; Haber, Paul S; Morley, Kirsten C

    2018-02-28

    Comorbid mental health and substance use problems are highly prevalent in substance use treatment settings and generally lead to poorer treatment outcomes. Pathways to Comorbidity Care (PCC) is a multi-modal training program developed to encourage an integrated service approach to improve clinicians' capacity to identify and manage comorbid substance use and mental health outcomes within public drug and alcohol treatment settings. In this paper we describe the concepts underlying the PCC Package and the use of Implementation Science to assess and overcome potential barriers, including clinicians' preferences, knowledge about best practice and professional culture. The training components include didactic seminars, group workshops run by a local clinical champion on relevant subjects such as Motivational Interviewing and Cognitive Behaviour Therapy, individual clinical consultation and feedback with a senior clinical psychologist. The PCC also includes an online portal containing comorbidity resources including manuals, guidelines and booster webinars. Finally, we describe the evaluation of PCC implementation. Drug Health Services need to be equipped to treat the majority of their clients who present with comorbid mental health conditions: we anticipate that this multimodal training package, which applies the principles of Implementation Science, will facilitate effective and integrated care for these vulnerable clients.

  8. A 3D global-to-local deformable mesh model based registration and anatomy-constrained segmentation method for image guided prostate radiotherapy

    International Nuclear Information System (INIS)

    Zhou Jinghao; Kim, Sung; Jabbour, Salma; Goyal, Sharad; Haffty, Bruce; Chen, Ting; Levinson, Lydia; Metaxas, Dimitris; Yue, Ning J.

    2010-01-01

    Purpose: In the external beam radiation treatment of prostate cancers, successful implementation of adaptive radiotherapy and conformal radiation dose delivery is highly dependent on precise and expeditious segmentation and registration of the prostate volume between the simulation and the treatment images. The purpose of this study is to develop a novel, fast, and accurate segmentation and registration method to increase the computational efficiency to meet the restricted clinical treatment time requirement in image guided radiotherapy. Methods: The method developed in this study used soft tissues to capture the transformation between the 3D planning CT (pCT) images and 3D cone-beam CT (CBCT) treatment images. The method incorporated a global-to-local deformable mesh model based registration framework as well as an automatic anatomy-constrained robust active shape model (ACRASM) based segmentation algorithm in the 3D CBCT images. The global registration was based on the mutual information method, and the local registration was to minimize the Euclidian distance of the corresponding nodal points from the global transformation of deformable mesh models, which implicitly used the information of the segmented target volume. The method was applied on six data sets of prostate cancer patients. Target volumes delineated by the same radiation oncologist on the pCT and CBCT were chosen as the benchmarks and were compared to the segmented and registered results. The distance-based and the volume-based estimators were used to quantitatively evaluate the results of segmentation and registration. Results: The ACRASM segmentation algorithm was compared to the original active shape model (ASM) algorithm by evaluating the values of the distance-based estimators. With respect to the corresponding benchmarks, the mean distance ranged from -0.85 to 0.84 mm for ACRASM and from -1.44 to 1.17 mm for ASM. The mean absolute distance ranged from 1.77 to 3.07 mm for ACRASM and from 2.45 to

  9. Voxel-based registration of simulated and real patient CBCT data for accurate dental implant pose estimation

    Science.gov (United States)

    Moreira, António H. J.; Queirós, Sandro; Morais, Pedro; Rodrigues, Nuno F.; Correia, André Ricardo; Fernandes, Valter; Pinho, A. C. M.; Fonseca, Jaime C.; Vilaça, João. L.

    2015-03-01

    The success of dental implant-supported prosthesis is directly linked to the accuracy obtained during implant's pose estimation (position and orientation). Although traditional impression techniques and recent digital acquisition methods are acceptably accurate, a simultaneously fast, accurate and operator-independent methodology is still lacking. Hereto, an image-based framework is proposed to estimate the patient-specific implant's pose using cone-beam computed tomography (CBCT) and prior knowledge of implanted model. The pose estimation is accomplished in a threestep approach: (1) a region-of-interest is extracted from the CBCT data using 2 operator-defined points at the implant's main axis; (2) a simulated CBCT volume of the known implanted model is generated through Feldkamp-Davis-Kress reconstruction and coarsely aligned to the defined axis; and (3) a voxel-based rigid registration is performed to optimally align both patient and simulated CBCT data, extracting the implant's pose from the optimal transformation. Three experiments were performed to evaluate the framework: (1) an in silico study using 48 implants distributed through 12 tridimensional synthetic mandibular models; (2) an in vitro study using an artificial mandible with 2 dental implants acquired with an i-CAT system; and (3) two clinical case studies. The results shown positional errors of 67+/-34μm and 108μm, and angular misfits of 0.15+/-0.08° and 1.4°, for experiment 1 and 2, respectively. Moreover, in experiment 3, visual assessment of clinical data results shown a coherent alignment of the reference implant. Overall, a novel image-based framework for implants' pose estimation from CBCT data was proposed, showing accurate results in agreement with dental prosthesis modelling requirements.

  10. Spherical Demons: Fast Surface Registration

    Science.gov (United States)

    Yeo, B.T. Thomas; Sabuncu, Mert; Vercauteren, Tom; Ayache, Nicholas; Fischl, Bruce; Golland, Polina

    2009-01-01

    We present the fast Spherical Demons algorithm for registering two spherical images. By exploiting spherical vector spline interpolation theory, we show that a large class of regularizers for the modified demons objective function can be efficiently implemented on the sphere using convolution. Based on the one parameter subgroups of diffeomorphisms, the resulting registration is diffeomorphic and fast – registration of two cortical mesh models with more than 100k nodes takes less than 5 minutes, comparable to the fastest surface registration algorithms. Moreover, the accuracy of our method compares favorably to the popular FreeSurfer registration algorithm. We validate the technique in two different settings: (1) parcellation in a set of in-vivo cortical surfaces and (2) Brodmann area localization in ex-vivo cortical surfaces. PMID:18979813

  11. Semi-Automatic Anatomical Tree Matching for Landmark-Based Elastic Registration of Liver Volumes

    Directory of Open Access Journals (Sweden)

    Klaus Drechsler

    2010-01-01

    Full Text Available One promising approach to register liver volume acquisitions is based on the branching points of the vessel trees as anatomical landmarks inherently available in the liver. Automated tree matching algorithms were proposed to automatically find pair-wise correspondences between two vessel trees. However, to the best of our knowledge, none of the existing automatic methods are completely error free. After a review of current literature and methodologies on the topic, we propose an efficient interaction method that can be employed to support tree matching algorithms with important pre-selected correspondences or after an automatic matching to manually correct wrongly matched nodes. We used this method in combination with a promising automatic tree matching algorithm also presented in this work. The proposed method was evaluated by 4 participants and a CT dataset that we used to derive multiple artificial datasets.

  12. Principal modes in multimode waveguides.

    Science.gov (United States)

    Fan, Shanhui; Kahn, Joseph M

    2005-01-15

    We generalize the concept of principal states of polarization and prove the existence of principal modes in multimode waveguides. Principal modes do not suffer from modal dispersion to first order of frequency variation and form orthogonal bases at both the input and the output ends of the waveguide. We show that principal modes are generally different from eigenmodes, even in uniform waveguides, unlike the special case of a single-mode fiber with uniform birefringence. The difference is most pronounced when different eigenmodes possess similar group velocities and when their field patterns vary as a function of frequency. This work may provide a new basis for analysis and control of dispersion in multimode fiber systems.

  13. Multimodal character viewpoint in quoted dialogue sequences

    Directory of Open Access Journals (Sweden)

    Kashmiri Stec

    2017-05-01

    Full Text Available We investigate the multimodal production of character viewpoint in spoken American English narratives by performing complementary qualitative and quantitative analyses of two quoted dialogues, focusing on the storyteller’s use of character viewpoint gestures, character intonation, character facial expression, spatial orientation and gaze. A micro-analysis revealed that the extent of multimodal articulation depends on (i the quoted speaker, with different multimodal articulatory patterns found for quotes by the speaker’s past self vs. a third-person character, and (ii the position of the quoted utterance within the quoted dialogue, with mid-dialogue utterances garnering less co-articulation than initial or final utterances within the quoted dialogue. We further investigated these observations using a quantitative approach, which was based on 'generalized additive modeling' (GAM. The GAM analysis revealed different multimodal patterns for each quoted character, as indicated by the number of co-produced multimodal articulators. These patterns were found to hold regardless of the quote’s position within the narrative. We discuss these findings with respect to previous work on multimodal quotation. This article is part of the special collection: Perspective Taking

  14. Bi-Objective Modelling for Hazardous Materials Road?Rail Multimodal Routing Problem with Railway Schedule-Based Space?Time Constraints

    OpenAIRE

    Sun, Yan; Lang, Maoxiang; Wang, Danzhu

    2016-01-01

    The transportation of hazardous materials is always accompanied by considerable risk that will impact public and environment security. As an efficient and reliable transportation organization, a multimodal service should participate in the transportation of hazardous materials. In this study, we focus on transporting hazardous materials through the multimodal service network and explore the hazardous materials multimodal routing problem from the operational level of network planning. To formu...

  15. Multimodal navigated skull base tumor resection using image-based vascular and cranial nerve segmentation: A prospective pilot study.

    Science.gov (United States)

    Dolati, Parviz; Gokoglu, Abdulkerim; Eichberg, Daniel; Zamani, Amir; Golby, Alexandra; Al-Mefty, Ossama

    2015-01-01

    Skull base tumors frequently encase or invade adjacent normal neurovascular structures. For this reason, optimal tumor resection with incomplete knowledge of patient anatomy remains a challenge. To determine the accuracy and utility of image-based preoperative segmentation in skull base tumor resections, we performed a prospective study. Ten patients with skull base tumors underwent preoperative 3T magnetic resonance imaging, which included thin section three-dimensional (3D) space T2, 3D time of flight, and magnetization-prepared rapid acquisition gradient echo sequences. Imaging sequences were loaded in the neuronavigation system for segmentation and preoperative planning. Five different neurovascular landmarks were identified in each case and measured for accuracy using the neuronavigation system. Each segmented neurovascular element was validated by manual placement of the navigation probe, and errors of localization were measured. Strong correspondence between image-based segmentation and microscopic view was found at the surface of the tumor and tumor-normal brain interfaces in all cases. The accuracy of the measurements was 0.45 ± 0.21 mm (mean ± standard deviation). This information reassured the surgeon and prevented vascular injury intraoperatively. Preoperative segmentation of the related cranial nerves was possible in 80% of cases and helped the surgeon localize involved cranial nerves in all cases. Image-based preoperative vascular and neural element segmentation with 3D reconstruction is highly informative preoperatively and could increase the vigilance of neurosurgeons for preventing neurovascular injury during skull base surgeries. Additionally, the accuracy found in this study is superior to previously reported measurements. This novel preliminary study is encouraging for future validation with larger numbers of patients.

  16. Evaluation of multimodal segmentation based on 3D T1-, T2- and FLAIR-weighted images - the difficulty of choosing.

    Science.gov (United States)

    Lindig, Tobias; Kotikalapudi, Raviteja; Schweikardt, Daniel; Martin, Pascal; Bender, Friedemann; Klose, Uwe; Ernemann, Ulrike; Focke, Niels K; Bender, Benjamin

    2018-04-15

    Voxel-based morphometry is still mainly based on T1-weighted MRI scans. Misclassification of vessels and dura mater as gray matter has been previously reported. Goal of the present work was to evaluate the effect of multimodal segmentation methods available in SPM12, and their influence on identification of age related atrophy and lesion detection in epilepsy patients. 3D T1-, T2- and FLAIR-images of 77 healthy adults (mean age 35.8 years, 19-66 years, 45 females), 7 patients with malformation of cortical development (MCD) (mean age 28.1 years,19-40 years, 3 females), and 5 patients with left hippocampal sclerosis (LHS) (mean age 49.0 years, 25-67 years, 3 females) from a 3T scanner were evaluated. Segmentation based on T1-only, T1+T2, T1+FLAIR, T2+FLAIR, and T1+T2+FLAIR were compared in the healthy subjects. Clinical VBM results based on the different segmentation approaches for MCD and for LHS were compared. T1-only segmentation overestimated total intracranial volume by about 80ml compared to the other segmentation methods. This was due to misclassification of dura mater and vessels as GM and CSF. Significant differences were found for several anatomical regions: the occipital lobe, the basal ganglia/thalamus, the pre- and postcentral gyrus, the cerebellum, and the brainstem. None of the segmentation methods yielded completely satisfying results for the basal ganglia/thalamus and the brainstem. The best correlation with age could be found for the multimodal T1+T2+FLAIR segmentation. Highest T-scores for identification of LHS were found for T1+T2 segmentation, while highest T-scores for MCD were dependent on lesion and anatomical location. Multimodal segmentation is superior to T1-only segmentation and reduces the misclassification of dura mater and vessels as GM and CSF. Depending on the anatomical region and the pathology of interest (atrophy, lesion detection, etc.), different combinations of T1, T2 and FLAIR yield optimal results. Copyright © 2017 Elsevier

  17. Keypoint-based 4-Points Congruent Sets - Automated marker-less registration of laser scans

    Science.gov (United States)

    Theiler, Pascal Willy; Wegner, Jan Dirk; Schindler, Konrad

    2014-10-01

    We propose a method to automatically register two point clouds acquired with a terrestrial laser scanner without placing any markers in the scene. What makes this task challenging are the strongly varying point densities caused by the line-of-sight measurement principle, and the huge amount of data. The first property leads to low point densities in potential overlap areas with scans taken from different viewpoints while the latter calls for highly efficient methods in terms of runtime and memory requirements. A crucial yet largely unsolved step is the initial coarse alignment of two scans without any simplifying assumptions, that is, point clouds are given in arbitrary local coordinates and no knowledge about their relative orientation is available. Once coarse alignment has been solved, scans can easily be fine-registered with standard methods like least-squares surface or Iterative Closest Point matching. In order to drastically thin out the original point clouds while retaining characteristic features, we resort to extracting 3D keypoints. Such clouds of keypoints, which can be viewed as a sparse but nevertheless discriminative representation of the original scans, are then used as input to a very efficient matching method originally developed in computer graphics, called 4-Points Congruent Sets (4PCS) algorithm. We adapt the 4PCS matching approach to better suit the characteristics of laser scans. The resulting Keypoint-based 4-Points Congruent Sets (K-4PCS) method is extensively evaluated on challenging indoor and outdoor scans. Beyond the evaluation on real terrestrial laser scans, we also perform experiments with simulated indoor scenes, paying particular attention to the sensitivity of the approach with respect to highly symmetric scenes.

  18. High-performance GPU-based rendering for real-time, rigid 2D/3D-image registration and motion prediction in radiation oncology

    Science.gov (United States)

    Spoerk, Jakob; Gendrin, Christelle; Weber, Christoph; Figl, Michael; Pawiro, Supriyanto Ardjo; Furtado, Hugo; Fabri, Daniella; Bloch, Christoph; Bergmann, Helmar; Gröller, Eduard; Birkfellner, Wolfgang

    2012-01-01

    A common problem in image-guided radiation therapy (IGRT) of lung cancer as well as other malignant diseases is the compensation of periodic and aperiodic motion during dose delivery. Modern systems for image-guided radiation oncology allow for the acquisition of cone-beam computed tomography data in the treatment room as well as the acquisition of planar radiographs during the treatment. A mid-term research goal is the compensation of tumor target volume motion by 2D/3D registration. In 2D/3D registration, spatial information on organ location is derived by an iterative comparison of perspective volume renderings, so-called digitally rendered radiographs (DRR) from computed tomography volume data, and planar reference x-rays. Currently, this rendering process is very time consuming, and real-time registration, which should at least provide data on organ position in less than a second, has not come into existence. We present two GPU-based rendering algorithms which generate a DRR of 512 × 512 pixels size from a CT dataset of 53 MB size at a pace of almost 100 Hz. This rendering rate is feasible by applying a number of algorithmic simplifications which range from alternative volume-driven rendering approaches – namely so-called wobbled splatting – to sub-sampling of the DRR-image by means of specialized raycasting techniques. Furthermore, general purpose graphics processing unit (GPGPU) programming paradigms were consequently utilized. Rendering quality and performance as well as the influence on the quality and performance of the overall registration process were measured and analyzed in detail. The results show that both methods are competitive and pave the way for fast motion compensation by rigid and possibly even non-rigid 2D/3D registration and, beyond that, adaptive filtering of motion models in IGRT. PMID:21782399

  19. A novel image fusion algorithm based on 2D scale-mixing complex wavelet transform and Bayesian MAP estimation for multimodal medical images

    Directory of Open Access Journals (Sweden)

    Abdallah Bengueddoudj

    2017-05-01

    Full Text Available In this paper, we propose a new image fusion algorithm based on two-dimensional Scale-Mixing Complex Wavelet Transform (2D-SMCWT. The fusion of the detail 2D-SMCWT coefficients is performed via a Bayesian Maximum a Posteriori (MAP approach by considering a trivariate statistical model for the local neighboring of 2D-SMCWT coefficients. For the approximation coefficients, a new fusion rule based on the Principal Component Analysis (PCA is applied. We conduct several experiments using three different groups of multimodal medical images to evaluate the performance of the proposed method. The obtained results prove the superiority of the proposed method over the state of the art fusion methods in terms of visual quality and several commonly used metrics. Robustness of the proposed method is further tested against different types of noise. The plots of fusion metrics establish the accuracy of the proposed fusion method.

  20. Multimodal Processes Rescheduling

    DEFF Research Database (Denmark)

    Bocewicz, Grzegorz; Banaszak, Zbigniew A.; Nielsen, Peter

    2013-01-01

    Cyclic scheduling problems concerning multimodal processes are usually observed in FMSs producing multi-type parts where the Automated Guided Vehicles System (AGVS) plays a role of a material handling system. Schedulability analysis of concurrently flowing cyclic processes (SCCP) exe...

  1. Multimodal freight investment criteria.

    Science.gov (United States)

    2010-07-01

    Literature was reviewed on multi-modal investment criteria for freight projects, examining measures and techniques for quantifying project benefits and costs, as well as ways to describe the economic importance of freight transportation. : A limited ...

  2. TU-AB-202-05: GPU-Based 4D Deformable Image Registration Using Adaptive Tetrahedral Mesh Modeling

    Energy Technology Data Exchange (ETDEWEB)

    Zhong, Z; Zhuang, L [Wayne State University, Detroit, MI (United States); Gu, X; Wang, J [UT Southwestern Medical Center, Dallas, TX (United States); Chen, H; Zhen, X [Southern Medical University, Guangzhou, Guangdong (China)

    2016-06-15

    Purpose: Deformable image registration (DIR) has been employed today as an automated and effective segmentation method to transfer tumor or organ contours from the planning image to daily images, instead of manual segmentation. However, the computational time and accuracy of current DIR approaches are still insufficient for online adaptive radiation therapy (ART), which requires real-time and high-quality image segmentation, especially in a large datasets of 4D-CT images. The objective of this work is to propose a new DIR algorithm, with fast computational speed and high accuracy, by using adaptive feature-based tetrahedral meshing and GPU-based parallelization. Methods: The first step is to generate the adaptive tetrahedral mesh based on the image features of a reference phase of 4D-CT, so that the deformation can be well captured and accurately diffused from the mesh vertices to voxels of the image volume. Subsequently, the deformation vector fields (DVF) and other phases of 4D-CT can be obtained by matching each phase of the target 4D-CT images with the corresponding deformed reference phase. The proposed 4D DIR method is implemented on GPU, resulting in significantly increasing the computational efficiency due to its parallel computing ability. Results: A 4D NCAT digital phantom was used to test the efficiency and accuracy of our method. Both the image and DVF results show that the fine structures and shapes of lung are well preserved, and the tumor position is well captured, i.e., 3D distance error is 1.14 mm. Compared to the previous voxel-based CPU implementation of DIR, such as demons, the proposed method is about 160x faster for registering a 10-phase 4D-CT with a phase dimension of 256×256×150. Conclusion: The proposed 4D DIR method uses feature-based mesh and GPU-based parallelism, which demonstrates the capability to compute both high-quality image and motion results, with significant improvement on the computational speed.

  3. A novel Gravity-FREAK feature extraction and Gravity-KLT tracking registration algorithm based on iPhone MEMS mobile sensor in mobile environment.

    Science.gov (United States)

    Hong, Zhiling; Lin, Fan; Xiao, Bin

    2017-01-01

    Based on the traditional Fast Retina Keypoint (FREAK) feature description algorithm, this paper proposed a Gravity-FREAK feature description algorithm based on Micro-electromechanical Systems (MEMS) sensor to overcome the limited computing performance and memory resources of mobile devices and further improve the reality interaction experience of clients through digital information added to the real world by augmented reality technology. The algorithm takes the gravity projection vector corresponding to the feature point as its feature orientation, which saved the time of calculating the neighborhood gray gradient of each feature point, reduced the cost of calculation and improved the accuracy of feature extraction. In the case of registration method of matching and tracking natural features, the adaptive and generic corner detection based on the Gravity-FREAK matching purification algorithm was used to eliminate abnormal matches, and Gravity Kaneda-Lucas Tracking (KLT) algorithm based on MEMS sensor can be used for the tracking registration of the targets and robustness improvement of tracking registration algorithm under mobile environment.

  4. A study on the theoretical and practical accuracy of conoscopic holography-based surface measurements: toward image registration in minimally invasive surgery†

    Science.gov (United States)

    Burgner, J.; Simpson, A. L.; Fitzpatrick, J. M.; Lathrop, R. A.; Herrell, S. D.; Miga, M. I.; Webster, R. J.

    2013-01-01

    Background Registered medical images can assist with surgical navigation and enable image-guided therapy delivery. In soft tissues, surface-based registration is often used and can be facilitated by laser surface scanning. Tracked conoscopic holography (which provides distance measurements) has been recently proposed as a minimally invasive way to obtain surface scans. Moving this technique from concept to clinical use requires a rigorous accuracy evaluation, which is the purpose of our paper. Methods We adapt recent non-homogeneous and anisotropic point-based registration results to provide a theoretical framework for predicting the accuracy of tracked distance measurement systems. Experiments are conducted a complex objects of defined geometry, an anthropomorphic kidney phantom and a human cadaver kidney. Results Experiments agree with model predictions, producing point RMS errors consistently holography is clinically viable; it enables minimally invasive surface scan accuracy comparable to current clinical methods that require open surgery. PMID:22761086

  5. A study on the theoretical and practical accuracy of conoscopic holography-based surface measurements: toward image registration in minimally invasive surgery.

    Science.gov (United States)

    Burgner, J; Simpson, A L; Fitzpatrick, J M; Lathrop, R A; Herrell, S D; Miga, M I; Webster, R J

    2013-06-01

    Registered medical images can assist with surgical navigation and enable image-guided therapy delivery. In soft tissues, surface-based registration is often used and can be facilitated by laser surface scanning. Tracked conoscopic holography (which provides distance measurements) has been recently proposed as a minimally invasive way to obtain surface scans. Moving this technique from concept to clinical use requires a rigorous accuracy evaluation, which is the purpose of our paper. We adapt recent non-homogeneous and anisotropic point-based registration results to provide a theoretical framework for predicting the accuracy of tracked distance measurement systems. Experiments are conducted a complex objects of defined geometry, an anthropomorphic kidney phantom and a human cadaver kidney. Experiments agree with model predictions, producing point RMS errors consistently holography is clinically viable; it enables minimally invasive surface scan accuracy comparable to current clinical methods that require open surgery. Copyright © 2012 John Wiley & Sons, Ltd.

  6. 20-years of population-based cancer registration in hepatitis B and liver cancer prevention in the Gambia, West Africa.

    Science.gov (United States)

    Bah, Ebrima; Carrieri, Maria Patrizia; Hainaut, Pierre; Bah, Yusupha; Nyan, Ousman; Taal, Makie

    2013-01-01

    The Gambia Hepatitis Intervention Study (GHIS) was designed as a randomised control trial of infant hepatitis B vaccination applied to public health policy, with the main goal of preventing primary liver cancer later in adult life in The Gambia. To that effect, the National Cancer Registry of The Gambia (NCR), a population-based cancer registry (PBCR), was established in 1986 to actively collect data on all cancer diagnosis nation-wide. We extracted 20-years (1990-2009) of data to assess for the first time, the evolution of the most common cancers, also describe and demonstrate the role of the PBCR in a hepatitis B and liver cancer prevention programme in this population. We estimated Age-Standardised Incidence Rates (ASR (W)) of the most common cancers registered during the period by gender. The registration period was divided into four 5-year intervals and incidence rates were estimated for each interval. The most common cancers in males were liver, prostate, lung plus bronchus, non-Hodgkin lymphoma (NHL) and stomach, accounting for 60%, 5%, 4%, 5% and 3%, respectively. Similarly, cancers of the cervix uteri, liver, breast and NHL, were the most common in females, accounting for 33%, 24%, 11% and 4% of the female cancers, respectively. Cancer incidence has remained relatively stable over time, but as shown elsewhere in sub-Saharan Africa the disease is a threat in The Gambia. The infection related cancers which are mostly preventable (HBV in men and HPV/HIV in women) were the most common. At the moment the data is not enough to detect an effect of hepatitis B vaccination on liver cancer incidence in The Gambia. However, we observed that monitoring case occurrence through PBCR is a key public health pre-requisite for rational planning and implementation of targeted interventions for improving the health of the population.

  7. 20-years of population-based cancer registration in hepatitis B and liver cancer prevention in the Gambia, West Africa.

    Directory of Open Access Journals (Sweden)

    Ebrima Bah

    Full Text Available The Gambia Hepatitis Intervention Study (GHIS was designed as a randomised control trial of infant hepatitis B vaccination applied to public health policy, with the main goal of preventing primary liver cancer later in adult life in The Gambia. To that effect, the National Cancer Registry of The Gambia (NCR, a population-based cancer registry (PBCR, was established in 1986 to actively collect data on all cancer diagnosis nation-wide. We extracted 20-years (1990-2009 of data to assess for the first time, the evolution of the most common cancers, also describe and demonstrate the role of the PBCR in a hepatitis B and liver cancer prevention programme in this population.We estimated Age-Standardised Incidence Rates (ASR (W of the most common cancers registered during the period by gender. The registration period was divided into four 5-year intervals and incidence rates were estimated for each interval. The most common cancers in males were liver, prostate, lung plus bronchus, non-Hodgkin lymphoma (NHL and stomach, accounting for 60%, 5%, 4%, 5% and 3%, respectively. Similarly, cancers of the cervix uteri, liver, breast and NHL, were the most common in females, accounting for 33%, 24%, 11% and 4% of the female cancers, respectively.Cancer incidence has remained relatively stable over time, but as shown elsewhere in sub-Saharan Africa the disease is a threat in The Gambia. The infection related cancers which are mostly preventable (HBV in men and HPV/HIV in women were the most common. At the moment the data is not enough to detect an effect of hepatitis B vaccination on liver cancer incidence in The Gambia. However, we observed that monitoring case occurrence through PBCR is a key public health pre-requisite for rational planning and implementation of targeted interventions for improving the health of the population.

  8. 20-Years of Population-Based Cancer Registration in Hepatitis B and Liver Cancer Prevention in The Gambia, West Africa

    Science.gov (United States)

    Bah, Ebrima; Carrieri, Maria Patrizia; Hainaut, Pierre; Bah, Yusupha; Nyan, Ousman; Taal, Makie

    2013-01-01

    Background The Gambia Hepatitis Intervention Study (GHIS) was designed as a randomised control trial of infant hepatitis B vaccination applied to public health policy, with the main goal of preventing primary liver cancer later in adult life in The Gambia. To that effect, the National Cancer Registry of The Gambia (NCR), a population-based cancer registry (PBCR), was established in 1986 to actively collect data on all cancer diagnosis nation-wide. We extracted 20-years (1990-2009) of data to assess for the first time, the evolution of the most common cancers, also describe and demonstrate the role of the PBCR in a hepatitis B and liver cancer prevention programme in this population. Methods and Findings We estimated Age-Standardised Incidence Rates (ASR (W)) of the most common cancers registered during the period by gender. The registration period was divided into four 5-year intervals and incidence rates were estimated for each interval. The most common cancers in males were liver, prostate, lung plus bronchus, non-Hodgkin lymphoma (NHL) and stomach, accounting for 60%, 5%, 4%, 5% and 3%, respectively. Similarly, cancers of the cervix uteri, liver, breast and NHL, were the most common in females, accounting for 33%, 24%, 11% and 4% of the female cancers, respectively. Conclusions Cancer incidence has remained relatively stable over time, but as shown elsewhere in sub-Saharan Africa the disease is a threat in The Gambia. The infection related cancers which are mostly preventable (HBV in men and HPV/HIV in women) were the most common. At the moment the data is not enough to detect an effect of hepatitis B vaccination on liver cancer incidence in The Gambia. However, we observed that monitoring case occurrence through PBCR is a key public health pre-requisite for rational planning and implementation of targeted interventions for improving the health of the population. PMID:24098724

  9. Issues In Image Registration

    Science.gov (United States)

    Kiremidjian, Garo K.

    1987-06-01

    This paper presents a concept for automated model-based image registration. The overall approach relies on computing a correspondence between a three-dimensional (1-D) data base and a reconnaissance image in terms of an appropriate sensor model as a function of such parameters as sensor location, orientation, scale, etc. The construction of such models is illustrated for frame camera and SAR sensors. Initial (platform ephemeris) parameter estimates are refined to achieve accurate correspondence by techniques which optimally match a collection of 3-D lineal features to an edge set extracted from the image. In the case of 3-D data bases consisting of stereo imagery (such as PPDBs) 3-D lineal features are automatically generated by applying the Marr-Poggio-Grimson computational models for stereo vision. The computed 3-D data-base-to-image correspondence can be used to predict accurately the image location of any 3-D point and to develop an elevation surface model associated with the image. This also leads to establishing automated model-based image-to-image registration.

  10. 3D atlas-based registration can calculate malalignment of femoral shaft fractures in six degrees of freedom.

    Science.gov (United States)

    Crookshank, Meghan C; Beek, Maarten; Hardisty, Michael R; Schemitsch, Emil H; Whyne, Cari M

    2014-01-01

    This study presents and evaluates a semi-automated algorithm for quantifying malalignment in complex femoral shaft fractures from a single intraoperative cone-beam CT (CBCT) image of the fractured limb. CBCT images were acquired of complex comminuted diaphyseal fractures created in 9 cadaveric femora (27 cases). Scans were segmented using intensity-based thresholding, yielding image stacks of the proximal, distal and comminuted bone. Semi-deformable and rigid affine registrations to an intact femur atlas (synthetic or cadaveric-based) were performed to transform the distal fragment to its neutral alignment. Leg length was calculated from the volume of bone within the comminution fragment. The transformations were compared to the physical input malalignments. Using the synthetic atlas, translations were within 1.71 ± 1.08 mm (medial/lateral) and 2.24 ± 2.11 mm (anterior/posterior). The varus/valgus, flexion/extension and periaxial rotation errors were 3.45 ± 2.6°, 1.86 ± 1.5° and 3.4 ± 2.0°, respectively. The cadaveric-based atlas yielded similar results in medial/lateral and anterior/posterior translation (1.73 ± 1.28 mm and 2.15 ± 2.13 mm, respectively). Varus/valgus, flexion/extension and periaxial rotation errors were 2.3 ± 1.3°, 2.0 ± 1.6° and 3.4 ± 2.0°, respectively. Leg length errors were 1.41 ± 1.01 mm (synthetic) and 1.26 ± 0.94 mm (cadaveric). The cadaveric model demonstrated a small improvement in flexion/extension and the synthetic atlas performed slightly faster (6 min 24 s ± 50 s versus 8 min 42 s ± 2 min 25 s). This atlas-based algorithm quantified malalignment in complex femoral shaft fractures within clinical tolerances from a single CBCT image of the fractured limb.

  11. Automated registration of freehand B-mode ultrasound and magnetic resonance imaging of the carotid arteries based on geometric features

    DEFF Research Database (Denmark)

    Carvalho, Diego D. B.; Arias Lorza, Andres Mauricio; Niessen, Wiro J.

    2017-01-01

    An automated method for registering B-mode ultrasound (US) and magnetic resonance imaging (MRI) of the carotid arteries is proposed. The registration uses geometric features, namely, lumen centerlines and lumen segmentations, which are extracted fully automatically from the images after manual an...

  12. Intersection-based registration of slice stacks to form 3D images of the human fetal brain

    DEFF Research Database (Denmark)

    Kim, Kio; Hansen, Mads Fogtmann; Habas, Piotr

    2008-01-01

    Clinical fetal MR imaging of the brain commonly makes use of fast 2D acquisitions of multiple sets of approximately orthogonal 2D slices. We and others have previously proposed an iterative slice-to-volume registration process to recover a geometrically consistent 3D image. However...... of the approach applied to simulated data and clinically acquired fetal images....

  13. Process Evaluation of a School-Based Education Program about Organ Donation and Registration, and the Intention for Continuance

    Science.gov (United States)

    Reubsaet, A.; Reinaerts, E. B. M.; Brug, J.; van Hooff, J. P.; van den Borne, H. W.

    2004-01-01

    This paper describes the process evaluation of an organ donation education program for high school students aged 15-18 years of which the effectiveness was established. The program consisted of three components: a video with group discussion, an interactive computer-tailored program and a registration training session. A cross-sectional survey was…

  14. A wavelength tunable ONU transmitter based on multi-mode Fabry-Perot laser and micro-ring resonator for bandwidth symmetric TWDM-PON

    Science.gov (United States)

    Gao, Zhensen; Sun, Xiao; Zhang, Kaibin

    2016-02-01

    Wavelength tunable optical transmitter is an essential component for the newly standardized time and wavelength division multiplexed passive optical network (TWDM-PON), where tunable ONU with 10Gb/s bit rate is desired to provide 40Gb/s symmetric bandwidth. In this paper, a novel wavelength tunable optical transmitter is proposed by reusing legacy low speed multi-mode Fabry-Perot laser and connecting it with an integrated photonic chip with two coupled micro-ring resonators to generate a tunable single mode signal based on Vernier effect for 10Gb/s high speed modulation, which makes it as a promising solution for colorless ONU in future symmetric TWDM-PON.

  15. Multimodal Dialogue Management - State of the art

    NARCIS (Netherlands)

    Bui Huu Trung, B.H.T.

    This report is about the state of the art in dialogue management. We first introduce an overview of a multimodal dialogue system and its components. Second, four main approaches to dialogue management are described (finite-state and frame-based, information-state based and probabilistic, plan-based,

  16. Effects of land registration on validity of juridical acts (Emphasis on Functions of land registration System

    Directory of Open Access Journals (Sweden)

    Nasrin tabatabai hesari

    2015-12-01

    Full Text Available Guaranty of security of juridical act about lands is a more important difficulties in every country. Disregarding the independence of land registration system from the system of civil law and disregarding bases and functions of land registration system has resulted in making mistakes by judicial doctrine and precedent in order to propose proper suggestions for solving the problems related to land registration system and to sanction for juridical acts about lands. Whiles presentation every solution in this scope must be proper regarding to protective bases of owner and third parties and two functional characters of the land registration system including “informing” and “protective” features. land registration systems can be divided in constitutive registration system and confirmative one. This classification means land registration in any case, has a very effective role in credit of judicial act about of land although the degree of this effect is different depending on the system.

  17. Epidemiology of paediatric injury in low income environment: Value of hospital based data prior to the institution of a formal registration system

    Directory of Open Access Journals (Sweden)

    Alain Chichom-Mefire

    2013-01-01

    Full Text Available Background: Little attention is generally paid to paediatric injuries, especially in low income settings. The aim of this study is to provide an overview of the epidemiology of hospital-based paediatric injuries in a semi-urban area in Cameroon prior to the initiation of a formal registration system. Patients and Methods: A sixteen items data collection sheet derived from a newly instituted trauma registry is used to retrospectively gather hospital-based basic information about epidemiology of injuries in patients aged 15 years or below in a low income setting. Results: Two hundred and seventy seven cases representing 16% of all injury cases could be analysed. The frequency of injuries significantly increased with age with a peak between 11 and 15 years (P < 0.001. Children in school playgrounds carried a significantly higher risk of sustaining an injury (P < 0.001. Falls and interpersonal violence were the most frequent mechanisms. The face and locomotor systems were the most commonly involved. More than 60% of patients were discharged back home. Conclusions: The data from the present registration system seem to indicate a higher injury rate in pre-adolescent children and in the school playground. The institution of a formal registration system is likely to improve the quality of data recording system.

  18. Epidemiology of paediatric injury in low income environment: value of hospital based data prior to the institution of a formal registration system.

    Science.gov (United States)

    Chichom-Mefire, Alain; Fokou, Marcus

    2013-01-01

    Little attention is generally paid to paediatric injuries, especially in low income settings. The aim of this study is to provide an overview of the epidemiology of hospital-based paediatric injuries in a semi-urban area in Cameroon prior to the initiation of a formal registration system. A sixteen items data collection sheet derived from a newly instituted trauma registry is used to retrospectively gather hospital-based basic information about epidemiology of injuries in patients aged 15 years or below in a low income setting. Two hundred and seventy seven cases representing 16% of all injury cases could be analysed. The frequency of injuries significantly increased with age with a peak between 11 and 15 years (P violence were the most frequent mechanisms. The face and locomotor systems were the most commonly involved. More than 60% of patients were discharged back home. The data from the present registration system seem to indicate a higher injury rate in pre-adolescent children and in the school playground. The institution of a formal registration system is likely to improve the quality of data recording system.

  19. Multimodal warnings to enhance risk communication and safety

    NARCIS (Netherlands)

    Haas, E.C.; Erp, J.B.F. van

    2014-01-01

    Multimodal warnings incorporate audio and/or skin-based (tactile) cues to supplement or replace visual cues in environments where the user’s visual perception is busy, impaired, or nonexistent. This paper describes characteristics of audio, tactile, and multimodal warning displays and their role in

  20. Fracturing Writing Spaces: Multimodal Storytelling Ignites Process Writing

    Science.gov (United States)

    Lenters, Kimberly; Winters, Kari-Lynn

    2013-01-01

    In this paper, we explore the affordances of literature-based, arts-infused and digital media processes for students, as multimodal practices take centre stage in an English Language Arts unit on fractured fairy tales. The study takes up the challenge of addressing multimodal literacy instruction and research in ways that utilize a range of…

  1. OAM-enhanced transmission for multimode short-range links

    DEFF Research Database (Denmark)

    Tatarczak, Anna; Usuga Castaneda, Mario A.; Tafur Monroy, Idelfonso

    2015-01-01

    We propose, experimentally demonstrate, and evaluate the performance of a multimode (MM) transmission fiber data link which is based on orbital angular momentum (OAM) modes. The proposed scheme uses OAM modes to increase capacity or reach without recurring to mode division multiplexing (MDM) or s...... interconnects and short range links that employ the existing multimode fiber infrastructure....

  2. Enabling multimode wireless access networks using remote radio heads

    DEFF Research Database (Denmark)

    Kardaras, Georgios; Soler, José; Dittmann, Lars

    2012-01-01

    the advantages of using distributed base station architectures to provide multimode capabilities. In particular, it focuses on the radio unit, commonly known in industry as remote radio head. Multimode radio units capable of operating according to different wireless standards (WCDMA, LTE and WiMAX) can be proven....... © 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering....

  3. Individual Multimodal Therapy for Weight Loss: A Case Example.

    Science.gov (United States)

    Kilmartin, Christopher; Robbins, Steven

    1987-01-01

    Presents a case study highlighting a treatment model based on a multimodal conceptualization. Suggests that individual multimodal therapy provides a comprehensive approach to the treatment of overeating, helping to target social and emotional issues related to eating disorders as well as the eating behaviors themselves. (Author/ABB)

  4. A community intervention trial of multimodal suicide prevention program in Japan: A Novel multimodal Community Intervention program to prevent suicide and suicide attempt in Japan, NOCOMIT-J

    Directory of Open Access Journals (Sweden)

    Suzuki Yuriko

    2008-09-01

    Full Text Available Abstract Background To respond to the rapid surge in the incidence of suicide in Japan, which appears to be an ongoing trend, the Japanese Multimodal Intervention Trials for Suicide Prevention (J-MISP have launched a multimodal community-based suicide prevention program, NOCOMIT-J. The primary aim of this study is to examine whether NOCOMIT-J is effective in reducing suicidal behavior in the community. Methods/DesignThis study is a community intervention trial involving seven intervention regions with accompanying control regions, all with populations of statistically sufficient size. The program focuses on building social support networks in the public health system for suicide prevention and mental health promotion, intending to reinforce human relationships in the community. The intervention program components includes a primary prevention measures of awareness campaign for the public and key personnel, secondary prevention measures for screening of, and assisting, high-risk individuals, after-care for individuals bereaved by suicide, and other measures. The intervention started in July 2006, and will continue for 3.5 years. Participants are Japanese and foreign residents living in the intervention and control regions (a total of population of 2,120,000 individuals. Discussion The present study is designed to evaluate the effectiveness of the community-based suicide prevention program in the seven participating areas. Trial registration UMIN Clinical Trials Registry (UMIN-CTR UMIN000000460.

  5. Examination of tapered plastic multimode fiber-based sensor performance with silver coating for different concentrations of calcium hypochlorite by soft computing methodologies--a comparative study.

    Science.gov (United States)

    Zakaria, Rozalina; Sheng, Ong Yong; Wern, Kam; Shamshirband, Shahaboddin; Wahab, Ainuddin Wahid Abdul; Petković, Dalibor; Saboohi, Hadi

    2014-05-01

    A soft methodology study has been applied on tapered plastic multimode sensors. This study basically used tapered plastic multimode fiber [polymethyl methacrylate (PMMA)] optics as a sensor. The tapered PMMA fiber was fabricated using an etching method involving deionized water and acetone to achieve a waist diameter and length of 0.45 and 10 mm, respectively. In addition, a tapered PMMA probe, which was coated by silver film, was fabricated and demonstrated using a calcium hypochlorite (G70) solution. The working mechanism of such a device is based on the observation increment in the transmission of the sensor that is immersed in solutions at high concentrations. As the concentration was varied from 0 to 6 ppm, the output voltage of the sensor increased linearly. The silver film coating increased the sensitivity of the proposed sensor because of the effective cladding refractive index, which increases with the coating and thus allows more light to be transmitted from the tapered fiber. In this study, the polynomial and radial basis function (RBF) were applied as the kernel function of the support vector regression (SVR) to estimate and predict the output voltage response of the sensors with and without silver film according to experimental tests. Instead of minimizing the observed training error, SVR_poly and SVR_rbf were used in an attempt to minimize the generalization error bound so as to achieve generalized performance. An adaptive neuro-fuzzy interference system (ANFIS) approach was also investigated for comparison. The experimental results showed that improvements in the predictive accuracy and capacity for generalization can be achieved by the SVR_poly approach in comparison to the SVR_rbf methodology. The same testing errors were found for the SVR_poly approach and the ANFIS approach.

  6. The effect of a community-based self-help multimodal behavioral intervention in Korean American seniors with high blood pressure.

    Science.gov (United States)

    Kim, Kim B; Han, Hae-Ra; Huh, Boyun; Nguyen, Tam; Lee, Hochang; Kim, Miyong T

    2014-09-01

    Great strides have been made in improving heart health in the United States during the last 2 decades, yet these strides have not encompassed many ethnic minority populations. There are significant health disparity gaps stemming from both a paucity of valid research and a lack of culturally sensitive interventions. In particular, many Korean Americans with chronic illnesses encounter difficulty navigating the healthcare system because of limited health literacy. The effect of a multimodal Self-Help Intervention Program on the Control of High Blood Pressure (HBP) was tested in a community-based clinical trial for Korean American seniors. Of 440 seniors enrolled, 369 completed the study (184 in the intervention group and 185 in the control group; mean age = 70.9±5.3 years). The intervention group received 6 weekly educational sessions on HBP management skill building, including health literacy training, followed by telephone counseling and home blood pressure (BP) monitoring for 12 months. Findings support that the Self-Help Intervention Program on the Control of HBP was effective in controlling BP in this ethnic/linguistic minority population. The BP control rates for the intervention and control groups were 49.5% vs. 43.2% at baseline, 58.5% vs. 42.4% at 6 months, 67.9% vs. 52.5% at 12 months, and 54.3% vs. 53.0% at 18 months. Significant changes were observed over time in some psychobehavioral outcomes, including self-efficacy for BP control, medication adherence behavior, HBP knowledge, and depression. The study findings suggest that the multimodal Self-Help Intervention Program on the Control of HBP is effective at promoting optimal HBP control for this ethnic/linguistic minority population. NCT00406614. © American Journal of Hypertension, Ltd 2014. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

  7. Multimodal Resources in Transnational Adoption

    DEFF Research Database (Denmark)

    Raudaskoski, Pirkko Liisa

    The paper discusses an empirical analysis which highlights the multimodal nature of identity construction. A documentary on transnational adoption provides real life incidents as research material. The incidents involve (or from them emerge) various kinds of multimodal resources and participants...

  8. Robust patella motion tracking using intensity-based 2D-3D registration on dynamic bi-plane fluoroscopy: towards quantitative assessment in MPFL reconstruction surgery

    Science.gov (United States)

    Otake, Yoshito; Esnault, Matthieu; Grupp, Robert; Kosugi, Shinichi; Sato, Yoshinobu

    2016-03-01

    The determination of in vivo motion of multiple-bones using dynamic fluoroscopic images and computed tomography (CT) is useful for post-operative assessment of orthopaedic surgeries such as medial patellofemoral ligament reconstruction. We propose a robust method to measure the 3D motion of multiple rigid objects with high accuracy using a series of bi-plane fluoroscopic images and a multi-resolution, intensity-based, 2D-3D registration. A Covariance Matrix Adaptation Evolution Strategy (CMA-ES) optimizer was used with a gradient correlation similarity metric. Four approaches to register three rigid objects (femur, tibia-fibula and patella) were implemented: 1) an individual bone approach registering one bone at a time, each with optimization of a six degrees of freedom (6DOF) parameter, 2) a sequential approach registering one bone at a time but using the previous bone results as the background in DRR generation, 3) a simultaneous approach registering all the bones together (18DOF) and 4) a combination of the sequential and the simultaneous approaches. These approaches were compared in experiments using simulated images generated from the CT of a healthy volunteer and measured fluoroscopic images. Over the 120 simulated frames of motion, the simultaneous approach showed improved registration accuracy compared to the individual approach: with less than 0.68mm root-mean-square error (RMSE) for translation and less than 1.12° RMSE for rotation. A robustness evaluation was conducted with 45 trials of a randomly perturbed initialization showed that the sequential approach improved robustness significantly (74% success rate) compared to the individual bone approach (34% success) for patella registration (femur and tibia-fibula registration had a 100% success rate with each approach).

  9. Integrating community-based verbal autopsy into civil registration and vital statistics (CRVS): system-level considerations.

    OpenAIRE

    de Savigny, D; Riley, I; Chandramohan, D; Odhiambo, F; Nichols, E; Notzon, S; AbouZahr, C; Mitra, R; Cobos Muñoz, D; Firth, S; Maire, N; Sankoh, O; Bronson, G; Setel, P; Byass, P

    2017-01-01

    ABSTRACT Background: Reliable and representative cause of death (COD) statistics are essential to inform public health policy, respond to emerging health needs, and document progress towards Sustainable Development Goals. However, less than one-third of deaths worldwide are assigned a cause. Civil registration and vital statistics (CRVS) systems in low- and lower-middle-income countries are failing to provide timely, complete and accurate vital statistics, and it will still be some time befor...

  10. A Piecewise Monotone Subgradient Algorithm for Accurate L1 -TV Based Registration of Physical Slices With Discontinuities in Microscopy

    Czech Academy of Sciences Publication Activity Database

    Michálek, Jan; Čapek, Martin

    2013-01-01

    Roč. 32, č. 5 (2013), s. 901-918 ISSN 0278-0062 R&D Projects: GA MŠk(CZ) LH13028; GA ČR(CZ) GAP501/10/0340; GA ČR(CZ) GAP108/11/0794; GA TA ČR(CZ) TA02011193 Institutional support: RVO:67985823 Keywords : convex optimization * image registration * subgradient algorithm * total variation Subject RIV: EA - Cell Biology Impact factor: 3.799, year: 2013

  11. A non-rigid registration method for mouse whole body skeleton registration

    Science.gov (United States)

    Xiao, Di; Zahra, David; Bourgeat, Pierrick; Berghofer, Paula; Acosta Tamayo, Oscar; Wimberley, Catriona; Gregoire, Marie Claude; Salvado, Olivier

    2010-03-01

    Micro-CT/PET imaging scanner provides a powerful tool to study tumor in small rodents in response to therapy. Accurate image registration is a necessary step to quantify the characteristics of images acquired in longitudinal studies. Small animal registration is challenging because of the very deformable body of the animal often resulting in different postures despite physical restraints. In this paper, we propose a non-rigid registration approach for the automatic registration of mouse whole body skeletons, which is based on our improved 3D shape context non-rigid registration method. The whole body skeleton registration approach has been tested on 21 pairs of mouse CT images with variations of individuals and time-instances. The experimental results demonstrated the stability and accuracy of the proposed method for automatic mouse whole body skeleton registration.

  12. Lung CT registration combining intensity, curves and surfaces

    DEFF Research Database (Denmark)

    Gorbunova, Vladlena; Durrieman, Stanley; Lo, Pechin Chien Pau

    2010-01-01

    applied to align the pulmonary vessel tree and the lungsurfaces. Subsequently, the resulting deformation field wasused to constrain an intensity-based registration method. Weapplied the combined registration on a set of image pairs, extractedat the end exhale and the end inhale phases of 4DCTscans....... The proposed combined registration was comparedto intensity-based registration, using a set of manuallyselected landmarks. The proposed registration decreases themean and the standard deviation of the target registration errorsfor all 5 cases to on average 1:47 +/- 1:05 mm, compared tothe intensity...

  13. Modeling Multimodal Stratification

    DEFF Research Database (Denmark)

    Boeriis, Morten

    2017-01-01

    This article discusses one of the core axioms of social semiotic theory, namely stratification, in the light of developments in multimodality in recent years. The discussion takes a point of departure in the approaches to stratification taken by Hjelmslev, Halliday, and Kress and van Leeuwen....... The article outlines a theoretical experiment exploring how an alternative way of modeling stratification and instantiation may raise some interesting ideas on the concepts of realization dynamics, system-instance, and the different contexts of the semiotic text. This is elaborated in a discussion of how...... the relationship between stratification and instantiation in the multimodal instantiation of resources at different strata may provide a new approach to mapping out the dynamics of multimodal meaning making....

  14. Multimodality imaging techniques.

    Science.gov (United States)

    Martí-Bonmatí, Luis; Sopena, Ramón; Bartumeus, Paula; Sopena, Pablo

    2010-01-01

    In multimodality imaging, the need to combine morphofunctional information can be approached by either acquiring images at different times (asynchronous), and fused them through digital image manipulation techniques or simultaneously acquiring images (synchronous) and merging them automatically. The asynchronous post-processing solution presents various constraints, mainly conditioned by the different positioning of the patient in the two scans acquired at different times in separated machines. The best solution to achieve consistency in time and space is obtained by the synchronous image acquisition. There are many multimodal technologies in molecular imaging. In this review we will focus on those multimodality image techniques more commonly used in the field of diagnostic imaging (SPECT-CT, PET-CT) and new developments (as PET-MR). The technological innovations and development of new tracers and smart probes are the main key points that will condition multimodality image and diagnostic imaging professionals' future. Although SPECT-CT and PET-CT are standard in most clinical scenarios, MR imaging has some advantages, providing excellent soft-tissue contrast and multidimensional functional, structural and morphological information. The next frontier is to develop efficient detectors and electronics systems capable of detecting two modality signals at the same time. Not only PET-MR but also MR-US or optic-PET will be introduced in clinical scenarios. Even more, MR diffusion-weighted, pharmacokinetic imaging, spectroscopy or functional BOLD imaging will merge with PET tracers to further increase molecular imaging as a relevant medical discipline. Multimodality imaging techniques will play a leading role in relevant clinical applications. The development of new diagnostic imaging research areas, mainly in the field of oncology, cardiology and neuropsychiatry, will impact the way medicine is performed today. Both clinical and experimental multimodality studies, in

  15. Multimodal Similarity Gaussian Process Latent Variable Model.

    Science.gov (United States)

    Song, Guoli; Wang, Shuhui; Huang, Qingming; Tian, Qi

    2017-09-01

    Data from real applications involve multiple modalities representing content with the same semantics from complementary aspects. However, relations among heterogeneous modalities are simply treated as observation-to-fit by existing work, and the parameterized modality specific mapping functions lack flexibility in directly adapting to the content divergence and semantic complicacy in multimodal data. In this paper, we build our work based on the Gaussian process latent variable model (GPLVM) to learn the non-parametric mapping functions and transform heterogeneous modalities into a shared latent space. We propose multimodal Similarity Gaussian Process latent variable model (m-SimGP), which learns the mapping functions between the intra-modal similarities and latent representation. We further propose multimodal distance-preserved similarity GPLVM (m-DSimGP) to preserve the intra-modal global similarity structure, and multimodal regularized similarity GPLVM (m-RSimGP) by encouraging similar/dissimilar points to be similar/dissimilar in the latent space. We propose m-DRSimGP, which combines the distance preservation in m-DSimGP and semantic preservation in m-RSimGP to learn the latent representation. The overall objective functions of the four models are solved by simple and scalable gradient decent techniques. They can be applied to various tasks to discover the nonlinear correlations and to obtain the comparable low-dimensional representation for heterogeneous modalities. On five widely used real-world data sets, our approaches outperform existing models on cross-modal content retrieval and multimodal classification.

  16. Multimodal Strategies of Theorization

    DEFF Research Database (Denmark)

    Cartel, Melodie; Colombero, Sylvain; Boxenbaum, Eva

    This paper examines the role of multimodal strategies in processes of theorization. Empirically, we investigate the theorization process of a highly disruptive innovation in the history of architecture: reinforced concrete. Relying on archival data from a dominant French architectural journal from...... with well-known rhetorical strategies and develop a process model of theorization....... 1885 to 1939, we studied how this new material became legitimized for the construction of buildings. Our early coding revealed three multimodal strategies associated with theorization: emotional, narrative, and lexical. Our intention when developing the full paper is to articulate these findings...

  17. A GPU based high-resolution multilevel biomechanical head and neck model for validating deformable image registration

    Energy Technology Data Exchange (ETDEWEB)

    Neylon, J., E-mail: jneylon@mednet.ucla.edu; Qi, X.; Sheng, K.; Low, D. A.; Kupelian, P.; Santhanam, A. [Department of Radiation Oncology, University of California Los Angeles, 200 Medical Plaza, #B265, Los Angeles, California 90095 (United States); Staton, R.; Pukala, J.; Manon, R. [Department of Radiation Oncology, M.D. Anderson Cancer Center, Orlando, 1440 South Orange Avenue, Orlando, Florida 32808 (United States)

    2015-01-15

    Purpose: Validating the usage of deformable image registration (DIR) for daily patient positioning is critical for adaptive radiotherapy (RT) applications pertaining to head and neck (HN) radiotherapy. The authors present a methodology for generating biomechanically realistic ground-truth data for validating DIR algorithms for HN anatomy by (a) developing a high-resolution deformable biomechanical HN model from a planning CT, (b) simulating deformations for a range of interfraction posture changes and physiological regression, and (c) generating subsequent CT images representing the deformed anatomy. Methods: The biomechanical model was developed using HN kVCT datasets and the corresponding structure contours. The voxels inside a given 3D contour boundary were clustered using a graphics processing unit (GPU) based algorithm that accounted for inconsistencies and gaps in the boundary to form a volumetric structure. While the bony anatomy was modeled as rigid body, the muscle and soft tissue structures were modeled as mass–spring-damper models with elastic material properties that corresponded to the underlying contoured anatomies. Within a given muscle structure, the voxels were classified using a uniform grid and a normalized mass was assigned to each voxel based on its Hounsfield number. The soft tissue deformation for a given skeletal actuation was performed using an implicit Euler integration with each iteration split into two substeps: one for the muscle structures and the other for the remaining soft tissues. Posture changes were simulated by articulating the skeletal structure and enabling the soft structures to deform accordingly. Physiological changes representing tumor regression were simulated by reducing the target volume and enabling the surrounding soft structures to deform accordingly. Finally, the authors also discuss a new approach to generate kVCT images representing the deformed anatomy that accounts for gaps and antialiasing artifacts that may

  18. Instrumentation challenges in multi-modality imaging

    International Nuclear Information System (INIS)

    Brasse, D.; Boisson, F.

    2016-01-01

    Based on different physical principles, imaging procedures currently used in both clinical and preclinical applications present different performance that allow researchers to achieve a large number of studies. However, the relevance of obtaining a maximum of information relating to the same subject is undeniable. The last two decades have thus seen the advent of a full-fledged research axis, the multimodal in vivo imaging. Whether from an instrumentation point of view, for medical research or the development of new probes, all these research works illustrate the growing interest of the scientific community for multimodal imaging, which can be approached with different backgrounds and perspectives from engineers to end-users point of views. In the present review, we discuss the multimodal imaging concept, which focuses not only on PET/CT and PET/MRI instrumentation but also on recent investigations of what could become a possible future in the field.

  19. Video genre classification using multimodal features

    Science.gov (United States)

    Jin, Sung Ho; Bae, Tae Meon; Choo, Jin Ho; Ro, Yong Man

    2003-12-01

    We propose a video genre classification method using multimodal features. The proposed method is applied for the preprocessing of automatic video summarization or the retrieval and classification of broadcasting video contents. Through a statistical analysis of low-level and middle-level audio-visual features in video, the proposed method can achieve good performance in classifying several broadcasting genres such as cartoon, drama, music video, news, and sports. In this paper, we adopt MPEG-7 audio-visual descriptors as multimodal features of video contents and evaluate the performance of the classification by feeding the features into a decision tree-based classifier which is trained by CART. The experimental results show that the proposed method can recognize several broadcasting video genres with a high accuracy and the classification performance with multimodal features is superior to the one with unimodal features in the genre classification.

  20. Language proficiency and nursing registration.

    Science.gov (United States)

    Müller, Amanda

    2016-02-01

    This discussion paper focuses on English proficiency standards for nursing registration in Australia, how Australia has dealt with the issue of language proficiency, and the factors which have led to the establishment of the current language standards. Also, this paper will provide a comparison of the two language tests that are currently accepted in Australia (OET and IELTS), including the appropriateness of these tests and the minimum standards used. The paper will also examine the use of educational background as an indicator of language proficiency. Finally, communication-based complaints in the post-registration environment will be explored, and some discussion will be provided about why pre-registration measures might have failed to prevent such problematic situations from occurring. Copyright © 2015 Elsevier Ltd. All rights reserved.

  1. Efficient nonrigid registration using ranked order statistics

    DEFF Research Database (Denmark)

    Tennakoon, Ruwan B.; Bab-Hadiashar, Alireza; de Bruijne, Marleen

    2013-01-01

    of research. In this paper we propose a fast and accurate non-rigid registration method for intra-modality volumetric images. Our approach exploits the information provided by an order statistics based segmentation method, to find the important regions for registration and use an appropriate sampling scheme...

  2. Evaluating a method for automated rigid registration

    DEFF Research Database (Denmark)

    Darkner, Sune; Vester-Christensen, Martin; Larsen, Rasmus

    2007-01-01

    We evaluate a novel method for fully automated rigid registration of 2D manifolds in 3D space based on distance maps, the Gibbs sampler and Iterated Conditional Modes (ICM). The method is tested against the ICP considered as the gold standard for automated rigid registration. Furthermore...

  3. Fast fluid registration of medical images

    DEFF Research Database (Denmark)

    Bro-Nielsen, Morten; Gramkow, Claus

    1996-01-01

    This paper offers a new fast algorithm for non-rigid viscous fluid registration of medical images that is at least an order of magnitude faster than the previous method by (Christensen et al., 1994). The core algorithm in the fluid registration method is based on a linear elastic deformation...

  4. Second-order optimization of mutual information for real-time image registration.

    Science.gov (United States)

    Dame, Amaury; Marchand, Eric

    2012-09-01

    In this paper, we present a direct image registration approach that uses mutual information (MI) as a metric for alignment. The proposed approach is robust and gives an accurate estimation of a set of 2-D motion parameters in real time. MI is a measure of the quantity of information shared by signals. Although it has the ability to perform robust alignment with illumination changes, multimodality, and partial occlusions, few works have proposed MI-based applications related to spatiotemporal image registration or object tracking in image sequences because of some optimization problems, which we will explain. In this paper, we propose a new optimization method that is adapted to the MI cost function and gives a practical solution for real-time tracking. We show that by refining the computation of the Hessian matrix and using a specific optimization approach, the registration results are far more robust and accurate than the existing solutions, with the computation also being cheaper. A new approach is also proposed to speed up the computation of the derivatives and keep the same optimization efficiency. To validate the advantages of the proposed approach, several experiments are performed.

  5. Strategy development management of Multimodal Transport Network

    Directory of Open Access Journals (Sweden)

    Nesterova Natalia S.

    2016-01-01

    Full Text Available The article gives a brief overview of works on the development of transport infrastructure for multimodal transportation and integration of Russian transport system into the international transport corridors. The technology for control of the strategy, that changes shape and capacity of Multi-modal Transport Network (MTN, is considered as part of the methodology for designing and development of MTN. This technology allows to carry out strategic and operational management of the strategy implementation based on the use of the balanced scorecard.

  6. The use of team-based learning in a second year undergraduate pre-registration nursing course on evidence-informed decision making.

    Science.gov (United States)

    Morris, Jenny

    2016-11-01

    More engaging teaching and learning strategies are needed to teach research-related courses to pre-registration nursing students. Team-based learning was implemented within a second year pre-registration nursing evidence-informed decision making course. Results from a questionnaire survey indicated that 70% believed team-based learning was appropriate for the course, 60% that it was an effective and motivating learning strategy, and 54% recommended using team-based learning in other courses. The results from ten student interviews illustrated the positive way in which team-based learning was perceived, and how the students thought it contributed to their learning. Test results were improved with an increase in the numbers of students achieving 70% or higher; and higher scores for students in the lowest quartile. Team-based learning was shown to be an effective strategy that preserved the benefits of small group teaching with large student groups. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

  7. Model-based measurement of food portion size for image-based dietary assessment using 3D/2D registration

    International Nuclear Information System (INIS)

    Chen, Hsin-Chen; Yue, Yaofeng; Sun, Mingui; Jia, Wenyan; Li, Zhaoxin; Sun, Yung-Nien; Fernstrom, John D

    2013-01-01

    Dietary assessment is important in health maintenance and intervention in many chronic conditions, such as obesity, diabetes and cardiovascular disease. However, there is currently a lack of convenient methods for measuring the volume of food (portion size) in real-life settings. We present a computational method to estimate food volume from a single photographic image of food contained on a typical dining plate. First, we calculate the food location with respect to a 3D camera coordinate system using the plate as a scale reference. Then, the food is segmented automatically from the background in the image. Adaptive thresholding and snake modeling are implemented based on several image features, such as color contrast, regional color homogeneity and curve bending degree. Next, a 3D model representing the general shape of the food (e.g., a cylinder, a sphere, etc) is selected from a pre-constructed shape model library. The position, orientation and scale of the selected shape model are determined by registering the projected 3D model and the food contour in the image, where the properties of the reference are used as constraints. Experimental results using various realistically shaped foods with known volumes demonstrated satisfactory performance of our image-based food volume measurement method even if the 3D geometric surface of the food is not completely represented in the input image. (paper)

  8. Multimode optical fiber

    Science.gov (United States)

    Bigot-Astruc, Marianne; Molin, Denis; Sillard, Pierre

    2014-11-04

    A depressed graded-index multimode optical fiber includes a central core, an inner depressed cladding, a depressed trench, an outer depressed cladding, and an outer cladding. The central core has an alpha-index profile. The depressed claddings limit the impact of leaky modes on optical-fiber performance characteristics (e.g., bandwidth, core size, and/or numerical aperture).

  9. Multimodal news framing effects

    NARCIS (Netherlands)

    Powell, T.E.

    2017-01-01

    Visuals in news media play a vital role in framing citizens’ political preferences. Yet, compared to the written w