Overcoming Registration Uncertainty in Image Super-Resolution: Maximize or Marginalize?

Directory of Open Access Journals (Sweden)

Andrew Zisserman

2007-01-01

Full Text Available In multiple-image super-resolution, a high-resolution image is estimated from a number of lower-resolution images. This usually involves computing the parameters of a generative imaging model (such as geometric and photometric registration, and blur and obtaining a MAP estimate by minimizing a cost function including an appropriate prior. Two alternative approaches are examined. First, both registrations and the super-resolution image are found simultaneously using a joint MAP optimization. Second, we perform Bayesian integration over the unknown image registration parameters, deriving a cost function whose only variables of interest are the pixel values of the super-resolution image. We also introduce a scheme to learn the parameters of the image prior as part of the super-resolution algorithm. We show examples on a number of real sequences including multiple stills, digital video, and DVDs of movies.

Super-resolution Microscopy in Plant Cell Imaging.

Science.gov (United States)

Komis, George; Šamajová, Olga; Ovečka, Miroslav; Šamaj, Jozef

2015-12-01

Although the development of super-resolution microscopy methods dates back to 1994, relevant applications in plant cell imaging only started to emerge in 2010. Since then, the principal super-resolution methods, including structured-illumination microscopy (SIM), photoactivation localization microscopy (PALM), stochastic optical reconstruction microscopy (STORM), and stimulated emission depletion microscopy (STED), have been implemented in plant cell research. However, progress has been limited due to the challenging properties of plant material. Here we summarize the basic principles of existing super-resolution methods and provide examples of applications in plant science. The limitations imposed by the nature of plant material are reviewed and the potential for future applications in plant cell imaging is highlighted. Copyright © 2015 Elsevier Ltd. All rights reserved.

Super-resolution imaging of subcortical white matter using stochastic optical reconstruction microscopy (STORM) and super-resolution optical fluctuation imaging (SOFI)

Science.gov (United States)

Hainsworth, A. H.; Lee, S.; Patel, A.; Poon, W. W.; Knight, A. E.

2018-01-01

Aims The spatial resolution of light microscopy is limited by the wavelength of visible light (the ‘diffraction limit’, approximately 250 nm). Resolution of sub-cellular structures, smaller than this limit, is possible with super resolution methods such as stochastic optical reconstruction microscopy (STORM) and super-resolution optical fluctuation imaging (SOFI). We aimed to resolve subcellular structures (axons, myelin sheaths and astrocytic processes) within intact white matter, using STORM and SOFI. Methods Standard cryostat-cut sections of subcortical white matter from donated human brain tissue and from adult rat and mouse brain were labelled, using standard immunohistochemical markers (neurofilament-H, myelin-associated glycoprotein, glial fibrillary acidic protein, GFAP). Image sequences were processed for STORM (effective pixel size 8–32 nm) and for SOFI (effective pixel size 80 nm). Results In human, rat and mouse, subcortical white matter high-quality images for axonal neurofilaments, myelin sheaths and filamentous astrocytic processes were obtained. In quantitative measurements, STORM consistently underestimated width of axons and astrocyte processes (compared with electron microscopy measurements). SOFI provided more accurate width measurements, though with somewhat lower spatial resolution than STORM. Conclusions Super resolution imaging of intact cryo-cut human brain tissue is feasible. For quantitation, STORM can under-estimate diameters of thin fluorescent objects. SOFI is more robust. The greatest limitation for super-resolution imaging in brain sections is imposed by sample preparation. We anticipate that improved strategies to reduce autofluorescence and to enhance fluorophore performance will enable rapid expansion of this approach. PMID:28696566

Super-resolution imaging of subcortical white matter using stochastic optical reconstruction microscopy (STORM) and super-resolution optical fluctuation imaging (SOFI).

Science.gov (United States)

Hainsworth, A H; Lee, S; Foot, P; Patel, A; Poon, W W; Knight, A E

2017-07-11

The spatial resolution of light microscopy is limited by the wavelength of visible light (the 'diffraction limit', approximately 250 nm). Resolution of sub-cellular structures, smaller than this limit, is possible with super resolution methods such as stochastic optical reconstruction microscopy (STORM) and super-resolution optical fluctuation imaging (SOFI). We aimed to resolve subcellular structures (axons, myelin sheaths and astrocytic processes) within intact white matter, using STORM and SOFI. Standard cryostat-cut sections of subcortical white matter from donated human brain tissue and from adult rat and mouse brain were labelled, using standard immunohistochemical markers (neurofilament-H, myelin-associated glycoprotein, glial fibrillary acidic protein, GFAP). Image sequences were processed for STORM (effective pixel size 8-32 nm) and for SOFI (effective pixel size 80 nm). In human, rat and mouse, subcortical white matter high-quality images for axonal neurofilaments, myelin sheaths and filamentous astrocytic processes were obtained. In quantitative measurements, STORM consistently underestimated width of axons and astrocyte processes (compared with electron microscopy measurements). SOFI provided more accurate width measurements, though with somewhat lower spatial resolution than STORM. Super resolution imaging of intact cryo-cut human brain tissue is feasible. For quantitation, STORM can under-estimate diameters of thin fluorescent objects. SOFI is more robust. The greatest limitation for super-resolution imaging in brain sections is imposed by sample preparation. We anticipate that improved strategies to reduce autofluorescence and to enhance fluorophore performance will enable rapid expansion of this approach. © 2017 British Neuropathological Society.

Super-Planckian far-field radiative heat transfer

Science.gov (United States)

Fernández-Hurtado, V.; Fernández-Domínguez, A. I.; Feist, J.; García-Vidal, F. J.; Cuevas, J. C.

2018-01-01

We present here a theoretical analysis that demonstrates that the far-field radiative heat transfer between objects with dimensions smaller than the thermal wavelength can overcome the Planckian limit by orders of magnitude. To guide the search for super-Planckian far-field radiative heat transfer, we make use of the theory of fluctuational electrodynamics and derive a relation between the far-field radiative heat transfer and the directional absorption efficiency of the objects involved. Guided by this relation, and making use of state-of-the-art numerical simulations, we show that the far-field radiative heat transfer between highly anisotropic objects can largely overcome the black-body limit when some of their dimensions are smaller than the thermal wavelength. In particular, we illustrate this phenomenon in the case of suspended pads made of polar dielectrics like SiN or SiO2. These structures are widely used to measure the thermal transport through nanowires and low-dimensional systems and can be employed to test our predictions. Our work illustrates the dramatic failure of the classical theory to predict the far-field radiative heat transfer between micro- and nanodevices.

Microsphere-based super-resolution scanning optical microscope.

Science.gov (United States)

Huszka, Gergely; Yang, Hui; Gijs, Martin A M

2017-06-26

High-refractive index dielectric microspheres positioned within the field of view of a microscope objective in a dielectric medium can focus the light into a so-called photonic nanojet. A sample placed in such nanojet can be imaged by the objective with super-resolution, i.e. with a resolution beyond the classical diffraction limit. However, when imaging nanostructures on a substrate, the propagation distance of a light wave in the dielectric medium in between the substrate and the microsphere must be small enough to reveal the sample's nanometric features. Therefore, only the central part of an image obtained through a microsphere shows super-resolution details, which are typically ∼100 nm using white light (peak at λ = 600 nm). We have performed finite element simulations of the role of this critical distance in the super-resolution effect. Super-resolution imaging of a sample placed beneath the microsphere is only possible within a very restricted central area of ∼10 μm 2 , where the separation distance between the substrate and the microsphere surface is very small (∼1 μm). To generate super-resolution images over larger areas of the sample, we have fixed a microsphere on a frame attached to the microscope objective, which is automatically scanned over the sample in a step-by-step fashion. This generates a set of image tiles, which are subsequently stitched into a single super-resolution image (with resolution of λ/4-λ/5) of a sample area of up to ∼10 4 μm 2 . Scanning a standard optical microscope objective with microsphere therefore enables super-resolution microscopy over the complete field-of-view of the objective.

Long-distance super-resolution imaging assisted by enhanced spatial Fourier transform.

Science.gov (United States)

Tang, Heng-He; Liu, Pu-Kun

2015-09-07

A new gradient-index (GRIN) lens that can realize enhanced spatial Fourier transform (FT) over optically long distances is demonstrated. By using an anisotropic GRIN metamaterial with hyperbolic dispersion, evanescent wave in free space can be transformed into propagating wave in the metamaterial and then focused outside due to negative-refraction. Both the results based on the ray tracing and the finite element simulation show that the spatial frequency bandwidth of the spatial FT can be extended to 2.7k(0) (k(0) is the wave vector in free space). Furthermore, assisted by the enhanced spatial FT, a new long-distance (in the optical far-field region) super-resolution imaging scheme is also proposed and the super resolved capability of λ/5 (λ is the wavelength in free space) is verified. The work may provide technical support for designing new-type high-speed microscopes with long working distances.

Image inpainting and super-resolution using non-local recursive deep convolutional network with skip connections

Science.gov (United States)

Liu, Miaofeng

2017-07-01

In recent years, deep convolutional neural networks come into use in image inpainting and super-resolution in many fields. Distinct to most of the former methods requiring to know beforehand the local information for corrupted pixels, we propose a 20-depth fully convolutional network to learn an end-to-end mapping a dataset of damaged/ground truth subimage pairs realizing non-local blind inpainting and super-resolution. As there often exist image with huge corruptions or inpainting on a low-resolution image that the existing approaches unable to perform well, we also share parameters in local area of layers to achieve spatial recursion and enlarge the receptive field. To avoid the difficulty of training this deep neural network, skip-connections between symmetric convolutional layers are designed. Experimental results shows that the proposed method outperforms state-of-the-art methods for diverse corrupting and low-resolution conditions, it works excellently when realizing super-resolution and image inpainting simultaneously

Single Image Super Resolution via Sparse Reconstruction

NARCIS (Netherlands)

Kruithof, M.C.; Eekeren, A.W.M. van; Dijk, J.; Schutte, K.

2012-01-01

High resolution sensors are required for recognition purposes. Low resolution sensors, however, are still widely used. Software can be used to increase the resolution of such sensors. One way of increasing the resolution of the images produced is using multi-frame super resolution algorithms.

Localization-based super-resolution imaging of cellular structures.

Science.gov (United States)

Kanchanawong, Pakorn; Waterman, Clare M

2013-01-01

Fluorescence microscopy allows direct visualization of fluorescently tagged proteins within cells. However, the spatial resolution of conventional fluorescence microscopes is limited by diffraction to ~250 nm, prompting the development of super-resolution microscopy which offers resolution approaching the scale of single proteins, i.e., ~20 nm. Here, we describe protocols for single molecule localization-based super-resolution imaging, using focal adhesion proteins as an example and employing either photoswitchable fluorophores or photoactivatable fluorescent proteins. These protocols should also be easily adaptable to imaging a broad array of macromolecular assemblies in cells whose components can be fluorescently tagged and assemble into high density structures.

Example-Based Super-Resolution Fluorescence Microscopy.

Science.gov (United States)

Jia, Shu; Han, Boran; Kutz, J Nathan

2018-04-23

Capturing biological dynamics with high spatiotemporal resolution demands the advancement in imaging technologies. Super-resolution fluorescence microscopy offers spatial resolution surpassing the diffraction limit to resolve near-molecular-level details. While various strategies have been reported to improve the temporal resolution of super-resolution imaging, all super-resolution techniques are still fundamentally limited by the trade-off associated with the longer image acquisition time that is needed to achieve higher spatial information. Here, we demonstrated an example-based, computational method that aims to obtain super-resolution images using conventional imaging without increasing the imaging time. With a low-resolution image input, the method provides an estimate of its super-resolution image based on an example database that contains super- and low-resolution image pairs of biological structures of interest. The computational imaging of cellular microtubules agrees approximately with the experimental super-resolution STORM results. This new approach may offer potential improvements in temporal resolution for experimental super-resolution fluorescence microscopy and provide a new path for large-data aided biomedical imaging.

Large-area super-resolution optical imaging by using core-shell microfibers

Science.gov (United States)

Liu, Cheng-Yang; Lo, Wei-Chieh

2017-09-01

We first numerically and experimentally report large-area super-resolution optical imaging achieved by using core-shell microfibers. The particular spatial electromagnetic waves for different core-shell microfibers are studied by using finite-difference time-domain and ray tracing calculations. The focusing properties of photonic nanojets are evaluated in terms of intensity profile and full width at half-maximum along propagation and transversal directions. In experiment, the general optical fiber is chemically etched down to 6 μm diameter and coated with different metallic thin films by using glancing angle deposition. The direct imaging of photonic nanojets for different core-shell microfibers is performed with a scanning optical microscope system. We show that the intensity distribution of a photonic nanojet is highly related to the metallic shell due to the surface plasmon polaritons. Furthermore, large-area super-resolution optical imaging is performed by using different core-shell microfibers placed over the nano-scale grating with 150 nm line width. The core-shell microfiber-assisted imaging is achieved with super-resolution and hundreds of times the field-of-view in contrast to microspheres. The possible applications of these core-shell optical microfibers include real-time large-area micro-fluidics and nano-structure inspections.

Super-Resolution Enhancement From Multiple Overlapping Images: A Fractional Area Technique

Science.gov (United States)

Michaels, Joshua A.

With the availability of large quantities of relatively low-resolution data from several decades of space borne imaging, methods of creating an accurate, higher-resolution image from the multiple lower-resolution images (i.e. super-resolution), have been developed almost since such imagery has been around. The fractional-area super-resolution technique developed in this thesis has never before been documented. Satellite orbits, like Landsat, have a quantifiable variation, which means each image is not centered on the exact same spot more than once and the overlapping information from these multiple images may be used for super-resolution enhancement. By splitting a single initial pixel into many smaller, desired pixels, a relationship can be created between them using the ratio of the area within the initial pixel. The ideal goal for this technique is to obtain smaller pixels with exact values and no error, yielding a better potential result than those methods that yield interpolated pixel values with consequential loss of spatial resolution. A Fortran 95 program was developed to perform all calculations associated with the fractional-area super-resolution technique. The fractional areas are calculated using traditional trigonometry and coordinate geometry and Linear Algebra Package (LAPACK; Anderson et al., 1999) is used to solve for the higher-resolution pixel values. In order to demonstrate proof-of-concept, a synthetic dataset was created using the intrinsic Fortran random number generator and Adobe Illustrator CS4 (for geometry). To test the real-life application, digital pictures from a Sony DSC-S600 digital point-and-shoot camera with a tripod were taken of a large US geological map under fluorescent lighting. While the fractional-area super-resolution technique works in perfect synthetic conditions, it did not successfully produce a reasonable or consistent solution in the digital photograph enhancement test. The prohibitive amount of processing time (up to

Wavelet Filter Banks for Super-Resolution SAR Imaging

Science.gov (United States)

Sheybani, Ehsan O.; Deshpande, Manohar; Memarsadeghi, Nargess

2011-01-01

This paper discusses Innovative wavelet-based filter banks designed to enhance the analysis of super resolution Synthetic Aperture Radar (SAR) images using parametric spectral methods and signal classification algorithms, SAR finds applications In many of NASA's earth science fields such as deformation, ecosystem structure, and dynamics of Ice, snow and cold land processes, and surface water and ocean topography. Traditionally, standard methods such as Fast-Fourier Transform (FFT) and Inverse Fast-Fourier Transform (IFFT) have been used to extract Images from SAR radar data, Due to non-parametric features of these methods and their resolution limitations and observation time dependence, use of spectral estimation and signal pre- and post-processing techniques based on wavelets to process SAR radar data has been proposed. Multi-resolution wavelet transforms and advanced spectral estimation techniques have proven to offer efficient solutions to this problem.

An Example-Based Super-Resolution Algorithm for Selfie Images

Directory of Open Access Journals (Sweden)

Jino Hans William

2016-01-01

Full Text Available A selfie is typically a self-portrait captured using the front camera of a smartphone. Most state-of-the-art smartphones are equipped with a high-resolution (HR rear camera and a low-resolution (LR front camera. As selfies are captured by front camera with limited pixel resolution, the fine details in it are explicitly missed. This paper aims to improve the resolution of selfies by exploiting the fine details in HR images captured by rear camera using an example-based super-resolution (SR algorithm. HR images captured by rear camera carry significant fine details and are used as an exemplar to train an optimal matrix-value regression (MVR operator. The MVR operator serves as an image-pair priori which learns the correspondence between the LR-HR patch-pairs and is effectively used to super-resolve LR selfie images. The proposed MVR algorithm avoids vectorization of image patch-pairs and preserves image-level information during both learning and recovering process. The proposed algorithm is evaluated for its efficiency and effectiveness both qualitatively and quantitatively with other state-of-the-art SR algorithms. The results validate that the proposed algorithm is efficient as it requires less than 3 seconds to super-resolve LR selfie and is effective as it preserves sharp details without introducing any counterfeit fine details.

A novel super-resolution camera model

Science.gov (United States)

Shao, Xiaopeng; Wang, Yi; Xu, Jie; Wang, Lin; Liu, Fei; Luo, Qiuhua; Chen, Xiaodong; Bi, Xiangli

2015-05-01

Aiming to realize super resolution(SR) to single image and video reconstruction, a super resolution camera model is proposed for the problem that the resolution of the images obtained by traditional cameras behave comparatively low. To achieve this function we put a certain driving device such as piezoelectric ceramics in the camera. By controlling the driving device, a set of continuous low resolution(LR) images can be obtained and stored instantaneity, which reflect the randomness of the displacements and the real-time performance of the storage very well. The low resolution image sequences have different redundant information and some particular priori information, thus it is possible to restore super resolution image factually and effectively. The sample method is used to derive the reconstruction principle of super resolution, which analyzes the possible improvement degree of the resolution in theory. The super resolution algorithm based on learning is used to reconstruct single image and the variational Bayesian algorithm is simulated to reconstruct the low resolution images with random displacements, which models the unknown high resolution image, motion parameters and unknown model parameters in one hierarchical Bayesian framework. Utilizing sub-pixel registration method, a super resolution image of the scene can be reconstructed. The results of 16 images reconstruction show that this camera model can increase the image resolution to 2 times, obtaining images with higher resolution in currently available hardware levels.

The super-resolution debate

Science.gov (United States)

Won, Rachel

2018-05-01

In the quest for nanoscopy with super-resolution, consensus from the imaging community is that super-resolution is not always needed and that scientists should choose an imaging technique based on their specific application.

A novel algorithm of super-resolution image reconstruction based on multi-class dictionaries for natural scene

Science.gov (United States)

Wu, Wei; Zhao, Dewei; Zhang, Huan

2015-12-01

Super-resolution image reconstruction is an effective method to improve the image quality. It has important research significance in the field of image processing. However, the choice of the dictionary directly affects the efficiency of image reconstruction. A sparse representation theory is introduced into the problem of the nearest neighbor selection. Based on the sparse representation of super-resolution image reconstruction method, a super-resolution image reconstruction algorithm based on multi-class dictionary is analyzed. This method avoids the redundancy problem of only training a hyper complete dictionary, and makes the sub-dictionary more representatives, and then replaces the traditional Euclidean distance computing method to improve the quality of the whole image reconstruction. In addition, the ill-posed problem is introduced into non-local self-similarity regularization. Experimental results show that the algorithm is much better results than state-of-the-art algorithm in terms of both PSNR and visual perception.

Super-resolution thermographic imaging using blind structured illumination

Science.gov (United States)

Burgholzer, Peter; Berer, Thomas; Gruber, Jürgen; Mayr, Günther

2017-07-01

Using an infrared camera for thermographic imaging allows the contactless temperature measurement of many surface pixels simultaneously. From the measured surface data, the structure below the surface, embedded inside a sample or tissue, can be reconstructed and imaged, if heated by an excitation light pulse. The main drawback in active thermographic imaging is the degradation of the spatial resolution with the imaging depth, which results in blurred images for deeper lying structures. We circumvent this degradation by using blind structured illumination combined with a non-linear joint sparsity reconstruction algorithm. We demonstrate imaging of a line pattern and a star-shaped structure through a 3 mm thick steel sheet with a resolution four times better than the width of the thermal point-spread-function. The structured illumination is realized by parallel slits cut in an aluminum foil, where the excitation coming from a flashlight can penetrate. This realization of super-resolution thermographic imaging demonstrates that blind structured illumination allows thermographic imaging without high degradation of the spatial resolution for deeper lying structures. The groundbreaking concept of super-resolution can be transferred from optics to diffusive imaging by defining a thermal point-spread-function, which gives the principle resolution limit for a certain signal-to-noise ratio, similar to the Abbe limit for a certain optical wavelength. In future work, the unknown illumination pattern could be the speckle pattern generated by a short laser pulse inside a light scattering sample or tissue.

DESIGN OF DYADIC-INTEGER-COEFFICIENTS BASED BI-ORTHOGONAL WAVELET FILTERS FOR IMAGE SUPER-RESOLUTION USING SUB-PIXEL IMAGE REGISTRATION

Directory of Open Access Journals (Sweden)

P.B. Chopade

2014-05-01

Full Text Available This paper presents image super-resolution scheme based on sub-pixel image registration by the design of a specific class of dyadic-integer-coefficient based wavelet filters derived from the construction of a half-band polynomial. First, the integer-coefficient based half-band polynomial is designed by the splitting approach. Next, this designed half-band polynomial is factorized and assigned specific number of vanishing moments and roots to obtain the dyadic-integer coefficients low-pass analysis and synthesis filters. The possibility of these dyadic-integer coefficients based wavelet filters is explored in the field of image super-resolution using sub-pixel image registration. The two-resolution frames are registered at a specific shift from one another to restore the resolution lost by CCD array of camera. The discrete wavelet transform (DWT obtained from the designed coefficients is applied on these two low-resolution images to obtain the high resolution image. The developed approach is validated by comparing the quality metrics with existing filter banks.

Application of Super-Resolution Image Reconstruction to Digital Holography

Directory of Open Access Journals (Sweden)

Zhang Shuqun

2006-01-01

Full Text Available We describe a new application of super-resolution image reconstruction to digital holography which is a technique for three-dimensional information recording and reconstruction. Digital holography has suffered from the low resolution of CCD sensors, which significantly limits the size of objects that can be recorded. The existing solution to this problem is to use optics to bandlimit the object to be recorded, which can cause the loss of details. Here super-resolution image reconstruction is proposed to be applied in enhancing the spatial resolution of digital holograms. By introducing a global camera translation before sampling, a high-resolution hologram can be reconstructed from a set of undersampled hologram images. This permits the recording of larger objects and reduces the distance between the object and the hologram. Practical results from real and simulated holograms are presented to demonstrate the feasibility of the proposed technique.

Simulation of Far-Field Superresolution Fluorescence Imaging with Two-Color One-Photon Excitation of Reversible Photoactivatable Protein

International Nuclear Information System (INIS)

Wang Chen; Qiao Ling-Ling; Mao Zheng-Le

2011-01-01

We propose to achieve far-field super-resolution imaging by using offset two-color one-photon (2C1P) excitation of reversible photoactivatable fluorescence proteins. Due to the distinctive photoswitching performance of the proteins, such as dronpa, the fluorescence emission will only come from the overlapped region of activation beam and excitation beam. The analysis solution of rate equation shows that the resolution of offset 2C1P microscope is 'engineered' by laser power of excitation and activation beams and the power ratio between them. Superior lateral and transverse resolution is theoretically demonstrated compared with conventional fluorescence scanning microscopy. (fundamental areas of phenomenology(including applications))

Liquid microdroplet as an optical component to achieve imaging of 100 nm nanostructures on a far-field microscope

Science.gov (United States)

Hou, Beibei; Zhang, Luning

2018-05-01

We demonstrate that placing liquid microdroplets on a sample surface enables probing of the evanescent wave, thus having super-resolution capability on a far-field optical microscope. A simple method to form diiodomethane (CH2I2) liquid microdroplets with diameters of 10–90 μm in water is proposed. These microdroplets can be used to image various nanostructured samples with a feature size of about 100 nm under white-light illumination.

Nonlinear super-resolution nano-optics and applications

CERN Document Server

Wei, Jingsong

2015-01-01

This book covers many advances in the subjects of nano-optics and nano photonics. The author describes the principle and technical schematics of common methods for breaking through the optical diffraction limit and focuses on realizing optical super-resolution with nonlinear effects of thin film materials. The applications of nonlinear optical super-resolution effects in nano-data storage, nanolithography, and nano-imaging are also presented. This book is useful to graduate students majoring in optics and nano science and also serves as a reference book for academic researchers, engineers, technical professionals in the fields of super-resolution optics and laser techniques, nano-optics and nano photonics, nano-data storage, nano imaging, micro/nanofabrication and nanolithography and nonlinear optics.

Application of Super-Resolution Convolutional Neural Network for Enhancing Image Resolution in Chest CT.

Science.gov (United States)

Umehara, Kensuke; Ota, Junko; Ishida, Takayuki

2017-10-18

In this study, the super-resolution convolutional neural network (SRCNN) scheme, which is the emerging deep-learning-based super-resolution method for enhancing image resolution in chest CT images, was applied and evaluated using the post-processing approach. For evaluation, 89 chest CT cases were sampled from The Cancer Imaging Archive. The 89 CT cases were divided randomly into 45 training cases and 44 external test cases. The SRCNN was trained using the training dataset. With the trained SRCNN, a high-resolution image was reconstructed from a low-resolution image, which was down-sampled from an original test image. For quantitative evaluation, two image quality metrics were measured and compared to those of the conventional linear interpolation methods. The image restoration quality of the SRCNN scheme was significantly higher than that of the linear interpolation methods (p < 0.001 or p < 0.05). The high-resolution image reconstructed by the SRCNN scheme was highly restored and comparable to the original reference image, in particular, for a ×2 magnification. These results indicate that the SRCNN scheme significantly outperforms the linear interpolation methods for enhancing image resolution in chest CT images. The results also suggest that SRCNN may become a potential solution for generating high-resolution CT images from standard CT images.

Introduction to the virtual special issue on super-resolution imaging techniques

Science.gov (United States)

Cao, Liangcai; Liu, Zhengjun

2017-12-01

Until quite recently, the resolution of optical imaging instruments, including telescopes, cameras and microscopes, was considered to be limited by the diffraction of light and by image sensors. In the past few years, many exciting super-resolution approaches have emerged that demonstrate intriguing ways to bypass the classical limit in optics and detectors. More and more research groups are engaged in the study of advanced super-resolution schemes, devices, algorithms, systems, and applications [1-6]. Super-resolution techniques involve new methods in science and engineering of optics [7,8], measurements [9,10], chemistry [11,12] and information [13,14]. Promising applications, particularly in biomedical research and semiconductor industry, have been successfully demonstrated.

Three-dimensional super-resolution imaging for fluorescence emission difference microscopy

Energy Technology Data Exchange (ETDEWEB)

You, Shangting; Kuang, Cuifang, E-mail: cfkuang@zju.edu.cn; Li, Shuai; Liu, Xu; Ding, Zhihua [State key laboratory of modern optical instrumentations, Zhejiang University, Hangzhou 310027 (China)

2015-08-15

We propose a method theoretically to break the diffraction limit and to improve the resolution in all three dimensions for fluorescence emission difference microscopy. We produce two kinds of hollow focal spot by phase modulation. By incoherent superposition, these two kinds of focal spot yield a 3D hollow focal spot. The optimal proportion of these two kinds of spot is given in the paper. By employing 3D hollow focal spot, super-resolution image can be yielded by means of fluorescence emission difference microscopy, with resolution enhanced both laterally and axially. According to computation result, size of point spread function of three-dimensional super-resolution imaging is reduced by about 40% in all three spatial directions with respect to confocal imaging.

Single Image Super-Resolution Based on Multi-Scale Competitive Convolutional Neural Network.

Science.gov (United States)

Du, Xiaofeng; Qu, Xiaobo; He, Yifan; Guo, Di

2018-03-06

Deep convolutional neural networks (CNNs) are successful in single-image super-resolution. Traditional CNNs are limited to exploit multi-scale contextual information for image reconstruction due to the fixed convolutional kernel in their building modules. To restore various scales of image details, we enhance the multi-scale inference capability of CNNs by introducing competition among multi-scale convolutional filters, and build up a shallow network under limited computational resources. The proposed network has the following two advantages: (1) the multi-scale convolutional kernel provides the multi-context for image super-resolution, and (2) the maximum competitive strategy adaptively chooses the optimal scale of information for image reconstruction. Our experimental results on image super-resolution show that the performance of the proposed network outperforms the state-of-the-art methods.

Super-Resolution Reconstruction of Remote Sensing Images Using Multifractal Analysis

Directory of Open Access Journals (Sweden)

Mao-Gui Hu

2009-10-01

Full Text Available Satellite remote sensing (RS is an important contributor to Earth observation, providing various kinds of imagery every day, but low spatial resolution remains a critical bottleneck in a lot of applications, restricting higher spatial resolution analysis (e.g., intraurban. In this study, a multifractal-based super-resolution reconstruction method is proposed to alleviate this problem. The multifractal characteristic is common in Nature. The self-similarity or self-affinity presented in the image is useful to estimate details at larger and smaller scales than the original. We first look for the presence of multifractal characteristics in the images. Then we estimate parameters of the information transfer function and noise of the low resolution image. Finally, a noise-free, spatial resolutionenhanced image is generated by a fractal coding-based denoising and downscaling method. The empirical case shows that the reconstructed super-resolution image performs well indetail enhancement. This method is not only useful for remote sensing in investigating Earth, but also for other images with multifractal characteristics.

Resolution enhancement of tri-stereo remote sensing images by super resolution methods

Science.gov (United States)

Tuna, Caglayan; Akoguz, Alper; Unal, Gozde; Sertel, Elif

2016-10-01

Super resolution (SR) refers to generation of a High Resolution (HR) image from a decimated, blurred, low-resolution (LR) image set, which can be either a single frame or multi-frame that contains a collection of several images acquired from slightly different views of the same observation area. In this study, we propose a novel application of tri-stereo Remote Sensing (RS) satellite images to the super resolution problem. Since the tri-stereo RS images of the same observation area are acquired from three different viewing angles along the flight path of the satellite, these RS images are properly suited to a SR application. We first estimate registration between the chosen reference LR image and other LR images to calculate the sub pixel shifts among the LR images. Then, the warping, blurring and down sampling matrix operators are created as sparse matrices to avoid high memory and computational requirements, which would otherwise make the RS-SR solution impractical. Finally, the overall system matrix, which is constructed based on the obtained operator matrices is used to obtain the estimate HR image in one step in each iteration of the SR algorithm. Both the Laplacian and total variation regularizers are incorporated separately into our algorithm and the results are presented to demonstrate an improved quantitative performance against the standard interpolation method as well as improved qualitative results due expert evaluations.

Detecting breast microcalcifications using super-resolution and wave-equation ultrasound imaging: a numerical phantom study

Energy Technology Data Exchange (ETDEWEB)

Huang, Lianjie [Los Alamos National Laboratory; Simonetti, Francesco [IMPERIAL COLLEGE LONDON; Huthwaite, Peter [IMPERIAL COLLEGE LONDON; Rosenberg, Robert [UNM; Williamson, Michael [UNM

2010-01-01

Ultrasound image resolution and quality need to be significantly improved for breast microcalcification detection. Super-resolution imaging with the factorization method has recently been developed as a promising tool to break through the resolution limit of conventional imaging. In addition, wave-equation reflection imaging has become an effective method to reduce image speckles by properly handling ultrasound scattering/diffraction from breast heterogeneities during image reconstruction. We explore the capabilities of a novel super-resolution ultrasound imaging method and a wave-equation reflection imaging scheme for detecting breast microcalcifications. Super-resolution imaging uses the singular value decomposition and a factorization scheme to achieve an image resolution that is not possible for conventional ultrasound imaging. Wave-equation reflection imaging employs a solution to the acoustic-wave equation in heterogeneous media to backpropagate ultrasound scattering/diffraction waves to scatters and form images of heterogeneities. We construct numerical breast phantoms using in vivo breast images, and use a finite-difference wave-equation scheme to generate ultrasound data scattered from inclusions that mimic microcalcifications. We demonstrate that microcalcifications can be detected at full spatial resolution using the super-resolution ultrasound imaging and wave-equation reflection imaging methods.

Wide-field Spatio-Spectral Interferometry: Bringing High Resolution to the Far- Infrared

Science.gov (United States)

Leisawitx, David

Wide-field spatio-spectral interferometry combines spatial and spectral interferometric data to provide integral field spectroscopic information over a wide field of view. This technology breaks through a mission cost barrier that stands in the way of resolving spatially and measuring spectroscopically at far-infrared wavelengths objects that will lead to a deep understanding of planetary system and galaxy formation processes. A space-based far-IR interferometer will combine Spitzer s superb sensitivity with a two order of magnitude gain in angular resolution, and with spectral resolution in the thousands. With the possible exception of detector technology, which is advancing with support from other research programs, the greatest challenge for far-IR interferometry is to demonstrate that the interferometer will actually produce the images and spectra needed to satisfy mission science requirements. With past APRA support, our team has already developed the highly specialized hardware testbed, image projector, computational model, and image construction software required for the proposed effort, and we have access to an ideal test facility.

Robust microbubble tracking for super resolution imaging in ultrasound

DEFF Research Database (Denmark)

Hansen, Kristoffer B.; Villagómez Hoyos, Carlos Armando; Brasen, Jens Christian

2016-01-01

Currently ultrasound resolution is limited by diffraction to approximately half the wavelength of the sound wave employed. In recent years, super resolution imaging techniques have overcome the diffraction limit through the localization and tracking of a sparse set of microbubbles through...... the vasculature. However, this has only been performed on fixated tissue, limiting its clinical application. This paper proposes a technique for making super resolution images on non-fixated tissue by first compensating for tissue movement and then tracking the individual microbubbles. The experiment is performed...... on the kidney of a anesthetized Sprage-Dawley rat by infusing SonoVue at 0.1× original concentration. The algorithm demonstrated in vivo that the motion compensation was capable of removing the movement caused by the mechanical ventilator. The results shows that microbubbles were localized with a higher...

Color image guided depth image super resolution using fusion filter

Science.gov (United States)

He, Jin; Liang, Bin; He, Ying; Yang, Jun

2018-04-01

Depth cameras are currently playing an important role in many areas. However, most of them can only obtain lowresolution (LR) depth images. Color cameras can easily provide high-resolution (HR) color images. Using color image as a guide image is an efficient way to get a HR depth image. In this paper, we propose a depth image super resolution (SR) algorithm, which uses a HR color image as a guide image and a LR depth image as input. We use the fusion filter of guided filter and edge based joint bilateral filter to get HR depth image. Our experimental results on Middlebury 2005 datasets show that our method can provide better quality in HR depth images both numerically and visually.

Super-resolution processing for pulsed neutron imaging system using a high-speed camera

International Nuclear Information System (INIS)

Ishizuka, Ken; Kai, Tetsuya; Shinohara, Takenao; Segawa, Mariko; Mochiki, Koichi

2015-01-01

Super-resolution and center-of-gravity processing improve the resolution of neutron-transmitted images. These processing methods calculate the center-of-gravity pixel or sub-pixel of the neutron point converted into light by a scintillator. The conventional neutron-transmitted image is acquired using a high-speed camera by integrating many frames when a transmitted image with one frame is not provided. It succeeds in acquiring the transmitted image and calculating a spectrum by integrating frames of the same energy. However, because a high frame rate is required for neutron resonance absorption imaging, the number of pixels of the transmitted image decreases, and the resolution decreases to the limit of the camera performance. Therefore, we attempt to improve the resolution by integrating the frames after applying super-resolution or center-of-gravity processing. The processed results indicate that center-of-gravity processing can be effective in pulsed-neutron imaging with a high-speed camera. In addition, the results show that super-resolution processing is effective indirectly. A project to develop a real-time image data processing system has begun, and this system will be used at J-PARC in JAEA. (author)

Single image super-resolution based on convolutional neural networks

Science.gov (United States)

Zou, Lamei; Luo, Ming; Yang, Weidong; Li, Peng; Jin, Liujia

2018-03-01

We present a deep learning method for single image super-resolution (SISR). The proposed approach learns end-to-end mapping between low-resolution (LR) images and high-resolution (HR) images. The mapping is represented as a deep convolutional neural network which inputs the LR image and outputs the HR image. Our network uses 5 convolution layers, which kernels size include 5×5, 3×3 and 1×1. In our proposed network, we use residual-learning and combine different sizes of convolution kernels at the same layer. The experiment results show that our proposed method performs better than the existing methods in reconstructing quality index and human visual effects on benchmarked images.

Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning.

Science.gov (United States)

Hagita, Katsumi; Higuchi, Takeshi; Jinnai, Hiroshi

2018-04-12

Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano- and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction.

Localization-based super-resolution imaging meets high-content screening.

Science.gov (United States)

Beghin, Anne; Kechkar, Adel; Butler, Corey; Levet, Florian; Cabillic, Marine; Rossier, Olivier; Giannone, Gregory; Galland, Rémi; Choquet, Daniel; Sibarita, Jean-Baptiste

2017-12-01

Single-molecule localization microscopy techniques have proven to be essential tools for quantitatively monitoring biological processes at unprecedented spatial resolution. However, these techniques are very low throughput and are not yet compatible with fully automated, multiparametric cellular assays. This shortcoming is primarily due to the huge amount of data generated during imaging and the lack of software for automation and dedicated data mining. We describe an automated quantitative single-molecule-based super-resolution methodology that operates in standard multiwell plates and uses analysis based on high-content screening and data-mining software. The workflow is compatible with fixed- and live-cell imaging and allows extraction of quantitative data like fluorophore photophysics, protein clustering or dynamic behavior of biomolecules. We demonstrate that the method is compatible with high-content screening using 3D dSTORM and DNA-PAINT based super-resolution microscopy as well as single-particle tracking.

Multiple-image hiding using super resolution reconstruction in high-frequency domains

Science.gov (United States)

Li, Xiao-Wei; Zhao, Wu-Xiang; Wang, Jun; Wang, Qiong-Hua

2017-12-01

In this paper, a robust multiple-image hiding method using the computer-generated integral imaging and the modified super-resolution reconstruction algorithm is proposed. In our work, the host image is first transformed into frequency domains by cellular automata (CA), to assure the quality of the stego-image, the secret images are embedded into the CA high-frequency domains. The proposed method has the following advantages: (1) robustness to geometric attacks because of the memory-distributed property of elemental images, (2) increasing quality of the reconstructed secret images as the scheme utilizes the modified super-resolution reconstruction algorithm. The simulation results show that the proposed multiple-image hiding method outperforms other similar hiding methods and is robust to some geometric attacks, e.g., Gaussian noise and JPEG compression attacks.

Confocal pore size measurement based on super-resolution image restoration.

Science.gov (United States)

Liu, Dali; Wang, Yun; Qiu, Lirong; Mao, Xinyue; Zhao, Weiqian

2014-09-01

A confocal pore size measurement based on super-resolution image restoration is proposed to obtain a fast and accurate measurement for submicrometer pore size of nuclear track-etched membranes (NTEMs). This method facilitates the online inspection of the pore size evolution during etching. Combining confocal microscopy with super-resolution image restoration significantly improves the lateral resolution of the NTEM image, yields a reasonable circle edge-setting criterion of 0.2408, and achieves precise pore edge detection. Theoretical analysis shows that the minimum measuring diameter can reach 0.19 μm, and the root mean square of the residuals is only 1.4 nm. Edge response simulation and experiment reveal that the edge response of the proposed method is better than 80 nm. The NTEM pore size measurement results obtained by the proposed method agree well with that obtained by scanning electron microscopy.

Concept of dual-resolution light field imaging using an organic photoelectric conversion film for high-resolution light field photography.

Science.gov (United States)

Sugimura, Daisuke; Kobayashi, Suguru; Hamamoto, Takayuki

2017-11-01

Light field imaging is an emerging technique that is employed to realize various applications such as multi-viewpoint imaging, focal-point changing, and depth estimation. In this paper, we propose a concept of a dual-resolution light field imaging system to synthesize super-resolved multi-viewpoint images. The key novelty of this study is the use of an organic photoelectric conversion film (OPCF), which is a device that converts spectra information of incoming light within a certain wavelength range into an electrical signal (pixel value), for light field imaging. In our imaging system, we place the OPCF having the green spectral sensitivity onto the micro-lens array of the conventional light field camera. The OPCF allows us to acquire the green spectra information only at the center viewpoint with the full resolution of the image sensor. In contrast, the optical system of the light field camera in our imaging system captures the other spectra information (red and blue) at multiple viewpoints (sub-aperture images) but with low resolution. Thus, our dual-resolution light field imaging system enables us to simultaneously capture information about the target scene at a high spatial resolution as well as the direction information of the incoming light. By exploiting these advantages of our imaging system, our proposed method enables the synthesis of full-resolution multi-viewpoint images. We perform experiments using synthetic images, and the results demonstrate that our method outperforms other previous methods.

Live-cell super-resolution imaging of intrinsically fast moving flagellates

International Nuclear Information System (INIS)

Glogger, M; Subota, I; Spindler, M-C; Engstler, M; Fenz, S F; Stichler, S; Bertlein, S; Teßmar, J; Groll, J

2017-01-01

Recent developments in super-resolution microscopy make it possible to resolve structures in biological cells at a spatial resolution of a few nm and observe dynamical processes with a temporal resolution of ms to μ s. However, the optimal structural resolution requires repeated illumination cycles and is thus limited to chemically fixed cells. For live cell applications substantial improvement over classical Abbe-limited imaging can already be obtained in adherent or slow moving cells. Nonetheless, a large group of cells are fast moving and thus could not yet be addressed with live cell super-resolution microscopy. These include flagellate pathogens like African trypanosomes, the causative agents of sleeping sickness in humans and nagana in livestock. Here, we present an embedding method based on a in situ forming cytocompatible UV-crosslinked hydrogel. The fast cross-linking hydrogel immobilizes trypanosomes efficiently to allow microscopy on the nanoscale. We characterized both the trypanosomes and the hydrogel with respect to their autofluorescence properties and found them suitable for single-molecule fluorescence microscopy (SMFM). As a proof of principle, SMFM was applied to super-resolve a structure inside the living trypanosome. We present an image of a flagellar axoneme component recorded by using the intrinsic blinking behavior of eYFP. (paper)

Novel Super-Resolution Approach to Time-Resolved Volumetric 4-Dimensional Magnetic Resonance Imaging With High Spatiotemporal Resolution for Multi-Breathing Cycle Motion Assessment

International Nuclear Information System (INIS)

Li, Guang; Wei, Jie; Kadbi, Mo; Moody, Jason; Sun, August; Zhang, Shirong; Markova, Svetlana; Zakian, Kristen; Hunt, Margie; Deasy, Joseph O.

2017-01-01

Purpose: To develop and evaluate a super-resolution approach to reconstruct time-resolved 4-dimensional magnetic resonance imaging (TR-4DMRI) with a high spatiotemporal resolution for multi-breathing cycle motion assessment. Methods and Materials: A super-resolution approach was developed to combine fast 3-dimensional (3D) cine MRI with low resolution during free breathing (FB) and high-resolution 3D static MRI during breath hold (BH) using deformable image registration. A T1-weighted, turbo field echo sequence, coronal 3D cine acquisition, partial Fourier approximation, and SENSitivity Encoding parallel acceleration were used. The same MRI pulse sequence, field of view, and acceleration techniques were applied in both FB and BH acquisitions; the intensity-based Demons deformable image registration method was used. Under an institutional review board–approved protocol, 7 volunteers were studied with 3D cine FB scan (voxel size: 5 × 5 × 5 mm"3) at 2 Hz for 40 seconds and a 3D static BH scan (2 × 2 × 2 mm"3). To examine the image fidelity of 3D cine and super-resolution TR-4DMRI, a mobile gel phantom with multi-internal targets was scanned at 3 speeds and compared with the 3D static image. Image similarity among 3D cine, 4DMRI, and 3D static was evaluated visually using difference image and quantitatively using voxel intensity correlation and Dice index (phantom only). Multi-breathing-cycle waveforms were extracted and compared in both phantom and volunteer images using the 3D cine as the references. Results: Mild imaging artifacts were found in the 3D cine and TR-4DMRI of the mobile gel phantom with a Dice index of >0.95. Among 7 volunteers, the super-resolution TR-4DMRI yielded high voxel-intensity correlation (0.92 ± 0.05) and low voxel-intensity difference (<0.05). The detected motion differences between TR-4DMRI and 3D cine were −0.2 ± 0.5 mm (phantom) and −0.2 ± 1.9 mm (diaphragms). Conclusion: Super-resolution TR-4DMRI has been

Novel Super-Resolution Approach to Time-Resolved Volumetric 4-Dimensional Magnetic Resonance Imaging With High Spatiotemporal Resolution for Multi-Breathing Cycle Motion Assessment

Energy Technology Data Exchange (ETDEWEB)

Li, Guang, E-mail: lig2@mskcc.org [Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York (United States); Wei, Jie [Department of Computer Science, City College of New York, New York, New York (United States); Kadbi, Mo [Philips Healthcare, MR Therapy Cleveland, Ohio (United States); Moody, Jason; Sun, August; Zhang, Shirong; Markova, Svetlana; Zakian, Kristen; Hunt, Margie; Deasy, Joseph O. [Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York (United States)

2017-06-01

Purpose: To develop and evaluate a super-resolution approach to reconstruct time-resolved 4-dimensional magnetic resonance imaging (TR-4DMRI) with a high spatiotemporal resolution for multi-breathing cycle motion assessment. Methods and Materials: A super-resolution approach was developed to combine fast 3-dimensional (3D) cine MRI with low resolution during free breathing (FB) and high-resolution 3D static MRI during breath hold (BH) using deformable image registration. A T1-weighted, turbo field echo sequence, coronal 3D cine acquisition, partial Fourier approximation, and SENSitivity Encoding parallel acceleration were used. The same MRI pulse sequence, field of view, and acceleration techniques were applied in both FB and BH acquisitions; the intensity-based Demons deformable image registration method was used. Under an institutional review board–approved protocol, 7 volunteers were studied with 3D cine FB scan (voxel size: 5 × 5 × 5 mm{sup 3}) at 2 Hz for 40 seconds and a 3D static BH scan (2 × 2 × 2 mm{sup 3}). To examine the image fidelity of 3D cine and super-resolution TR-4DMRI, a mobile gel phantom with multi-internal targets was scanned at 3 speeds and compared with the 3D static image. Image similarity among 3D cine, 4DMRI, and 3D static was evaluated visually using difference image and quantitatively using voxel intensity correlation and Dice index (phantom only). Multi-breathing-cycle waveforms were extracted and compared in both phantom and volunteer images using the 3D cine as the references. Results: Mild imaging artifacts were found in the 3D cine and TR-4DMRI of the mobile gel phantom with a Dice index of >0.95. Among 7 volunteers, the super-resolution TR-4DMRI yielded high voxel-intensity correlation (0.92 ± 0.05) and low voxel-intensity difference (<0.05). The detected motion differences between TR-4DMRI and 3D cine were −0.2 ± 0.5 mm (phantom) and −0.2 ± 1.9 mm (diaphragms). Conclusion: Super-resolution TR-4

All-optical control and super-resolution imaging of quantum emitters in layered materials.

Science.gov (United States)

Kianinia, Mehran; Bradac, Carlo; Sontheimer, Bernd; Wang, Fan; Tran, Toan Trong; Nguyen, Minh; Kim, Sejeong; Xu, Zai-Quan; Jin, Dayong; Schell, Andreas W; Lobo, Charlene J; Aharonovich, Igor; Toth, Milos

2018-02-28

Layered van der Waals materials are emerging as compelling two-dimensional platforms for nanophotonics, polaritonics, valleytronics and spintronics, and have the potential to transform applications in sensing, imaging and quantum information processing. Among these, hexagonal boron nitride (hBN) is known to host ultra-bright, room-temperature quantum emitters, whose nature is yet to be fully understood. Here we present a set of measurements that give unique insight into the photophysical properties and level structure of hBN quantum emitters. Specifically, we report the existence of a class of hBN quantum emitters with a fast-decaying intermediate and a long-lived metastable state accessible from the first excited electronic state. Furthermore, by means of a two-laser repumping scheme, we show an enhanced photoluminescence and emission intensity, which can be utilized to realize a new modality of far-field super-resolution imaging. Our findings expand current understanding of quantum emitters in hBN and show new potential ways of harnessing their nonlinear optical properties in sub-diffraction nanoscopy.

Underwater video enhancement using multi-camera super-resolution

Science.gov (United States)

Quevedo, E.; Delory, E.; Callicó, G. M.; Tobajas, F.; Sarmiento, R.

2017-12-01

Image spatial resolution is critical in several fields such as medicine, communications or satellite, and underwater applications. While a large variety of techniques for image restoration and enhancement has been proposed in the literature, this paper focuses on a novel Super-Resolution fusion algorithm based on a Multi-Camera environment that permits to enhance the quality of underwater video sequences without significantly increasing computation. In order to compare the quality enhancement, two objective quality metrics have been used: PSNR (Peak Signal-to-Noise Ratio) and the SSIM (Structural SIMilarity) index. Results have shown that the proposed method enhances the objective quality of several underwater sequences, avoiding the appearance of undesirable artifacts, with respect to basic fusion Super-Resolution algorithms.

Adaptive optics improves multiphoton super-resolution imaging

Science.gov (United States)

Zheng, Wei; Wu, Yicong; Winter, Peter; Shroff, Hari

2018-02-01

Three dimensional (3D) fluorescence microscopy has been essential for biological studies. It allows interrogation of structure and function at spatial scales spanning the macromolecular, cellular, and tissue levels. Critical factors to consider in 3D microscopy include spatial resolution, signal-to-noise (SNR), signal-to-background (SBR), and temporal resolution. Maintaining high quality imaging becomes progressively more difficult at increasing depth (where optical aberrations, induced by inhomogeneities of refractive index in the sample, degrade resolution and SNR), and in thick or densely labeled samples (where out-of-focus background can swamp the valuable, in-focus-signal from each plane). In this report, we introduce our new instrumentation to address these problems. A multiphoton structured illumination microscope was simply modified to integrate an adpative optics system for optical aberrations correction. Firstly, the optical aberrations are determined using direct wavefront sensing with a nonlinear guide star and subsequently corrected using a deformable mirror, restoring super-resolution information. We demonstrate the flexibility of our adaptive optics approach on a variety of semi-transparent samples, including bead phantoms, cultured cells in collagen gels and biological tissues. The performance of our super-resolution microscope is improved in all of these samples, as peak intensity is increased (up to 40-fold) and resolution recovered (up to 176+/-10 nm laterally and 729+/-39 nm axially) at depths up to 250 μm from the coverslip surface.

Super-resolution Phase Tomography

KAUST Repository

Depeursinge, Christian; Cotte, Yann; Toy, Fatih; Jourdain, Pascal; Boss, Daiel; Marquet, Pierre; Magistretti, Pierre J.

2013-01-01

Digital Holographic Microscopy (DHM) yields reconstructed complex wavefields. It allows synthesizing the aperture of a virtual microscope up to 2π, offering super-resolution phase images. Live images of micro-organisms and neurons with resolution less than 100 nm are presented.

Super-resolution Phase Tomography

KAUST Repository

Depeursinge, Christian

2013-04-21

Digital Holographic Microscopy (DHM) yields reconstructed complex wavefields. It allows synthesizing the aperture of a virtual microscope up to 2π, offering super-resolution phase images. Live images of micro-organisms and neurons with resolution less than 100 nm are presented.

Sparsity-Based Super Resolution for SEM Images.

Science.gov (United States)

Tsiper, Shahar; Dicker, Or; Kaizerman, Idan; Zohar, Zeev; Segev, Mordechai; Eldar, Yonina C

2017-09-13

The scanning electron microscope (SEM) is an electron microscope that produces an image of a sample by scanning it with a focused beam of electrons. The electrons interact with the atoms in the sample, which emit secondary electrons that contain information about the surface topography and composition. The sample is scanned by the electron beam point by point, until an image of the surface is formed. Since its invention in 1942, the capabilities of SEMs have become paramount in the discovery and understanding of the nanometer world, and today it is extensively used for both research and in industry. In principle, SEMs can achieve resolution better than one nanometer. However, for many applications, working at subnanometer resolution implies an exceedingly large number of scanning points. For exactly this reason, the SEM diagnostics of microelectronic chips is performed either at high resolution (HR) over a small area or at low resolution (LR) while capturing a larger portion of the chip. Here, we employ sparse coding and dictionary learning to algorithmically enhance low-resolution SEM images of microelectronic chips-up to the level of the HR images acquired by slow SEM scans, while considerably reducing the noise. Our methodology consists of two steps: an offline stage of learning a joint dictionary from a sequence of LR and HR images of the same region in the chip, followed by a fast-online super-resolution step where the resolution of a new LR image is enhanced. We provide several examples with typical chips used in the microelectronics industry, as well as a statistical study on arbitrary images with characteristic structural features. Conceptually, our method works well when the images have similar characteristics, as microelectronics chips do. This work demonstrates that employing sparsity concepts can greatly improve the performance of SEM, thereby considerably increasing the scanning throughput without compromising on analysis quality and resolution.

Super-resolution fluorescence microscopy by stepwise optical saturation

Science.gov (United States)

Zhang, Yide; Nallathamby, Prakash D.; Vigil, Genevieve D.; Khan, Aamir A.; Mason, Devon E.; Boerckel, Joel D.; Roeder, Ryan K.; Howard, Scott S.

2018-01-01

Super-resolution fluorescence microscopy is an important tool in biomedical research for its ability to discern features smaller than the diffraction limit. However, due to its difficult implementation and high cost, the super-resolution microscopy is not feasible in many applications. In this paper, we propose and demonstrate a saturation-based super-resolution fluorescence microscopy technique that can be easily implemented and requires neither additional hardware nor complex post-processing. The method is based on the principle of stepwise optical saturation (SOS), where M steps of raw fluorescence images are linearly combined to generate an image with a M-fold increase in resolution compared with conventional diffraction-limited images. For example, linearly combining (scaling and subtracting) two images obtained at regular powers extends the resolution by a factor of 1.4 beyond the diffraction limit. The resolution improvement in SOS microscopy is theoretically infinite but practically is limited by the signal-to-noise ratio. We perform simulations and experimentally demonstrate super-resolution microscopy with both one-photon (confocal) and multiphoton excitation fluorescence. We show that with the multiphoton modality, the SOS microscopy can provide super-resolution imaging deep in scattering samples. PMID:29675306

Application of super-resolution optical microscopy in biology

International Nuclear Information System (INIS)

Mao Xiuhai; Du Jiancong; Huang Qing; Fan Chunhai; Deng Suhui

2013-01-01

Background: A noninvasive, real-time far-field optical microscopy is needed to study the dynamic function inside cells and proteins. However, the resolution limit of traditional optical microscope is about 200 nm due to the diffraction limit of light. So, it's hard to directly observe the subcellular structures. Over the past several years of microscopy development, the diffraction limit of fluorescence microscopy has been overcome and its resolution limit is about tens of nanometers. Methods: To overcome the diffraction limit of light, many super-resolution fluoresce microscopes, including stimulated emission of depletion microscopy (STED), photoactivation localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM), have been developed. Conclusions: These methods have been applied in cell biology, microbiology and neurobiology, and the technology of super-resolution provides a new insight into the life science. (authors)

Super Resolution Imaging of Genetically Labeled Synapses in Drosophila Brain Tissue.

Science.gov (United States)

Spühler, Isabelle A; Conley, Gaurasundar M; Scheffold, Frank; Sprecher, Simon G

2016-01-01

Understanding synaptic connectivity and plasticity within brain circuits and their relationship to learning and behavior is a fundamental quest in neuroscience. Visualizing the fine details of synapses using optical microscopy remains however a major technical challenge. Super resolution microscopy opens the possibility to reveal molecular features of synapses beyond the diffraction limit. With direct stochastic optical reconstruction microscopy, dSTORM, we image synaptic proteins in the brain tissue of the fruit fly, Drosophila melanogaster. Super resolution imaging of brain tissue harbors difficulties due to light scattering and the density of signals. In order to reduce out of focus signal, we take advantage of the genetic tools available in the Drosophila and have fluorescently tagged synaptic proteins expressed in only a small number of neurons. These neurons form synapses within the calyx of the mushroom body, a distinct brain region involved in associative memory formation. Our results show that super resolution microscopy, in combination with genetically labeled synaptic proteins, is a powerful tool to investigate synapses in a quantitative fashion providing an entry point for studies on synaptic plasticity during learning and memory formation.

Effects of whispering gallery mode in microsphere super-resolution imaging

Science.gov (United States)

Zhou, Song; Deng, Yongbo; Zhou, Wenchao; Yu, Muxin; Urbach, H. P.; Wu, Yihui

2017-09-01

Whispering Gallery modes have been presented in microscopic glass spheres or toruses with many applications. In this paper, the possible approaches to enhance the imaging resolution by Whispering Gallery modes are discussed, including evanescent waves coupling, transformed and illustration by Whispering Gallery modes. It shows that the high-order scattering modes play the dominant role in the reconstructed virtual image when the Whispering Gallery modes exist. Furthermore, we find that the high image resolution of electric dipoles can be achieved, when the out-of-phase components exist from the illustration of Whispering Gallery modes. Those results of our simulation could contribute to the knowledge of microsphere-assisted super-resolution imaging and its potential applications.

New learning based super-resolution: use of DWT and IGMRF prior.

Science.gov (United States)

Gajjar, Prakash P; Joshi, Manjunath V

2010-05-01

In this paper, we propose a new learning-based approach for super-resolving an image captured at low spatial resolution. Given the low spatial resolution test image and a database consisting of low and high spatial resolution images, we obtain super-resolution for the test image. We first obtain an initial high-resolution (HR) estimate by learning the high-frequency details from the available database. A new discrete wavelet transform (DWT) based approach is proposed for learning that uses a set of low-resolution (LR) images and their corresponding HR versions. Since the super-resolution is an ill-posed problem, we obtain the final solution using a regularization framework. The LR image is modeled as the aliased and noisy version of the corresponding HR image, and the aliasing matrix entries are estimated using the test image and the initial HR estimate. The prior model for the super-resolved image is chosen as an Inhomogeneous Gaussian Markov random field (IGMRF) and the model parameters are estimated using the same initial HR estimate. A maximum a posteriori (MAP) estimation is used to arrive at the cost function which is minimized using a simple gradient descent approach. We demonstrate the effectiveness of the proposed approach by conducting the experiments on gray scale as well as on color images. The method is compared with the standard interpolation technique and also with existing learning-based approaches. The proposed approach can be used in applications such as wildlife sensor networks, remote surveillance where the memory, the transmission bandwidth, and the camera cost are the main constraints.

Signal Characteristics of Super-Resolution Near-Field Structure Disks with 100 GB Capacity

Science.gov (United States)

Kim, Jooho; Hwang, Inoh; Kim, Hyunki; Park, Insik; Tominaga, Junji

2005-05-01

We report the basic characteristics of super resolution near-field structure (Super-RENS) media at a blue laser optical system (laser wavelength 405 nm, numerical aperture 0.85). Using a novel write once read many (WORM) structure for a blue laser system, we obtained a carrier-to-noise ratio (CNR) above 33 dB from the signal of the 37.5 nm mark length, which is equivalent to a 100 GB capacity with a 0.32 micrometer track pitch, and an eye pattern for 50 GB (2T: 75 nm) capacity using a patterned signal. Using a novel super-resolution material (tellurium, Te) with low super-resolution readout power, we also improved the read stability.

Droplet Image Super Resolution Based on Sparse Representation and Kernel Regression

Science.gov (United States)

Zou, Zhenzhen; Luo, Xinghong; Yu, Qiang

2018-05-01

Microgravity and containerless conditions, which are produced via electrostatic levitation combined with a drop tube, are important when studying the intrinsic properties of new metastable materials. Generally, temperature and image sensors can be used to measure the changes of sample temperature, morphology and volume. Then, the specific heat, surface tension, viscosity changes and sample density can be obtained. Considering that the falling speed of the material sample droplet is approximately 31.3 m/s when it reaches the bottom of a 50-meter-high drop tube, a high-speed camera with a collection rate of up to 106 frames/s is required to image the falling droplet. However, at the high-speed mode, very few pixels, approximately 48-120, will be obtained in each exposure time, which results in low image quality. Super-resolution image reconstruction is an algorithm that provides finer details than the sampling grid of a given imaging device by increasing the number of pixels per unit area in the image. In this work, we demonstrate the application of single image-resolution reconstruction in the microgravity and electrostatic levitation for the first time. Here, using the image super-resolution method based on sparse representation, a low-resolution droplet image can be reconstructed. Employed Yang's related dictionary model, high- and low-resolution image patches were combined with dictionary training, and high- and low-resolution-related dictionaries were obtained. The online double-sparse dictionary training algorithm was used in the study of related dictionaries and overcome the shortcomings of the traditional training algorithm with small image patch. During the stage of image reconstruction, the algorithm of kernel regression is added, which effectively overcomes the shortcomings of the Yang image's edge blurs.

Evaluation of deep neural networks for single image super-resolution in a maritime context

NARCIS (Netherlands)

Nieuwenhuizen, R.P.J.; Kruithof, M.; Schutte, K.

2017-01-01

High resolution imagery is of crucial importance for the performance on visual recognition tasks. Super-resolution (SR) reconstruction algorithms aim to enhance the image resolution beyond the capability of the image sensor being used. Traditional SR algorithms approach this inverse problem using

Focusing super resolution on the cytoskeleton [version 1; referees: 3 approved

Directory of Open Access Journals (Sweden)

Eric A. Shelden

2016-05-01

Full Text Available Super resolution imaging is becoming an increasingly important tool in the arsenal of methods available to cell biologists. In recognition of its potential, the Nobel Prize for chemistry was awarded to three investigators involved in the development of super resolution imaging methods in 2014. The availability of commercial instruments for super resolution imaging has further spurred the development of new methods and reagents designed to take advantage of super resolution techniques. Super resolution offers the advantages traditionally associated with light microscopy, including the use of gentle fixation and specimen preparation methods, the ability to visualize multiple elements within a single specimen, and the potential to visualize dynamic changes in living specimens over time. However, imaging of living cells over time is difficult and super resolution imaging is computationally demanding. In this review, we discuss the advantages/disadvantages of different super resolution systems for imaging fixed live specimens, with particular regard to cytoskeleton structures.

Live-cell super-resolution imaging of intrinsically fast moving flagellates

Science.gov (United States)

Glogger, M.; Stichler, S.; Subota, I.; Bertlein, S.; Spindler, M.-C.; Teßmar, J.; Groll, J.; Engstler, M.; Fenz, S. F.

2017-02-01

Recent developments in super-resolution microscopy make it possible to resolve structures in biological cells at a spatial resolution of a few nm and observe dynamical processes with a temporal resolution of ms to μs. However, the optimal structural resolution requires repeated illumination cycles and is thus limited to chemically fixed cells. For live cell applications substantial improvement over classical Abbe-limited imaging can already be obtained in adherent or slow moving cells. Nonetheless, a large group of cells are fast moving and thus could not yet be addressed with live cell super-resolution microscopy. These include flagellate pathogens like African trypanosomes, the causative agents of sleeping sickness in humans and nagana in livestock. Here, we present an embedding method based on a in situ forming cytocompatible UV-crosslinked hydrogel. The fast cross-linking hydrogel immobilizes trypanosomes efficiently to allow microscopy on the nanoscale. We characterized both the trypanosomes and the hydrogel with respect to their autofluorescence properties and found them suitable for single-molecule fluorescence microscopy (SMFM). As a proof of principle, SMFM was applied to super-resolve a structure inside the living trypanosome. We present an image of a flagellar axoneme component recorded by using the intrinsic blinking behavior of eYFP. , which features invited work from the best early-career researchers working within the scope of J Phys D. This project is part of the Journal of Physics series’ 50th anniversary celebrations in 2017. Susanne Fenz was selected by the Editorial Board of J Phys D as an Emerging Talent/Leader.

Apertureless near-field/far-field CW two-photon microscope for biological and material imaging and spectroscopic applications.

Science.gov (United States)

Nowak, Derek B; Lawrence, A J; Sánchez, Erik J

2010-12-10

We present the development of a versatile spectroscopic imaging tool to allow for imaging with single-molecule sensitivity and high spatial resolution. The microscope allows for near-field and subdiffraction-limited far-field imaging by integrating a shear-force microscope on top of a custom inverted microscope design. The instrument has the ability to image in ambient conditions with optical resolutions on the order of tens of nanometers in the near field. A single low-cost computer controls the microscope with a field programmable gate array data acquisition card. High spatial resolution imaging is achieved with an inexpensive CW multiphoton excitation source, using an apertureless probe and simplified optical pathways. The high-resolution, combined with high collection efficiency and single-molecule sensitive optical capabilities of the microscope, are demonstrated with a low-cost CW laser source as well as a mode-locked laser source.

Super resolution imaging of genetically labelled synapses in Drosophila brain tissue

Directory of Open Access Journals (Sweden)

Isabelle Ayumi Spühler

2016-05-01

Full Text Available Understanding synaptic connectivity and plasticity within brain circuits and their relationship to learning and behavior is a fundamental quest in neuroscience. Visualizing the fine details of synapses using optical microscopy remains however a major technical challenge. Super resolution microscopy opens the possibility to reveal molecular features of synapses beyond the diffraction limit. With direct stochastic optical reconstruction microscopy, dSTORM, we image synaptic proteins in the brain tissue of the fruit fly, Drosophila melanogaster. Super resolution imaging of brain tissue harbors difficulties due to light scattering and the density of signals. In order to reduce out of focus signal, we take advantage of the genetic tools available in the Drosophila and have fluorescently tagged synaptic proteins expressed in only a small number of neurons. These neurons form synapses within the calyx of the mushroom body, a distinct brain region involved in associative memory formation. Our results show that super resolution microscopy, in combination with genetically labelled synaptic proteins, is a powerful tool to investigate synapses in a quantitative fashion providing an entry point for studies on synaptic plasticity during learning and memory formation

Controlled power delivery for super-resolution imaging of biological samples using digital micromirror device

Science.gov (United States)

Valiya Peedikakkal, Liyana; Cadby, Ashley

2017-02-01

Localization based super resolution images of a biological sample is generally achieved by using high power laser illumination with long exposure time which unfortunately increases photo-toxicity of a sample, making super resolution microscopy, in general, incompatible with live cell imaging. Furthermore, the limitation of photobleaching reduces the ability to acquire time lapse images of live biological cells using fluorescence microscopy. Digital Light Processing (DLP) technology can deliver light at grey scale levels by flickering digital micromirrors at around 290 Hz enabling highly controlled power delivery to samples. In this work, Digital Micromirror Device (DMD) is implemented in an inverse Schiefspiegler telescope setup to control the power and pattern of illumination for super resolution microscopy. We can achieve spatial and temporal patterning of illumination by controlling the DMD pixel by pixel. The DMD allows us to control the power and spatial extent of the laser illumination. We have used this to show that we can reduce the power delivered to the sample to allow for longer time imaging in one area while achieving sub-diffraction STORM imaging in another using higher power densities.

Multisensor Super Resolution Using Directionally-Adaptive Regularization for UAV Images.

Science.gov (United States)

Kang, Wonseok; Yu, Soohwan; Ko, Seungyong; Paik, Joonki

2015-05-22

In various unmanned aerial vehicle (UAV) imaging applications, the multisensor super-resolution (SR) technique has become a chronic problem and attracted increasing attention. Multisensor SR algorithms utilize multispectral low-resolution (LR) images to make a higher resolution (HR) image to improve the performance of the UAV imaging system. The primary objective of the paper is to develop a multisensor SR method based on the existing multispectral imaging framework instead of using additional sensors. In order to restore image details without noise amplification or unnatural post-processing artifacts, this paper presents an improved regularized SR algorithm by combining the directionally-adaptive constraints and multiscale non-local means (NLM) filter. As a result, the proposed method can overcome the physical limitation of multispectral sensors by estimating the color HR image from a set of multispectral LR images using intensity-hue-saturation (IHS) image fusion. Experimental results show that the proposed method provides better SR results than existing state-of-the-art SR methods in the sense of objective measures.

Extreme super-resolution using the spherical geodesic waveguide

Science.gov (United States)

Miñano, Juan Carlos; González, Juan Carlos; Benítez, Pablo; Grabovičkić, Dejan

2012-06-01

Leonhardt demonstrated (2009) that the 2D Maxwell Fish Eye lens (MFE) can focus perfectly 2D Helmholtz waves of arbitrary frequency, i.e., it can transport perfectly an outward (monopole) 2D Helmholtz wave field, generated by a point source, towards a "perfect point drain" located at the corresponding image point. Moreover, a prototype with λ/5 super-resolution (SR) property for one microwave frequency has been manufactured and tested (Ma et al, 2010). Although this prototype has been loaded with an impedance different from the "perfect point drain", it has shown super-resolution property. However, neither software simulations nor experimental measurements for a broad band of frequencies have yet been reported. Here we present steady state simulations for two cases, using perfect drain as suggested by Leonhardt and without perfect drain as in the prototype. All the simulations have been done using a device equivalent to the MFE, called the Spherical Geodesic Waveguide (SGW). The results show the super-resolution up to λ/3000, for the system loaded with the perfect drain, and up to λ /500 for a not perfect load. In both cases super-resolution only happens for discrete number of frequencies. Out of these frequencies, the SGW does not show super-resolution in the analysis carried out.

A super-resolution approach for uncertainty estimation of PIV measurements

NARCIS (Netherlands)

Sciacchitano, A.; Wieneke, B.; Scarano, F.

2012-01-01

A super-resolution approach is proposed for the a posteriori uncertainty estimation of PIV measurements. The measured velocity field is employed to determine the displacement of individual particle images. A disparity set is built from the residual distance between paired particle images of

Windowed time-reversal music technique for super-resolution ultrasound imaging

Science.gov (United States)

Huang, Lianjie; Labyed, Yassin

2018-05-01

Systems and methods for super-resolution ultrasound imaging using a windowed and generalized TR-MUSIC algorithm that divides the imaging region into overlapping sub-regions and applies the TR-MUSIC algorithm to the windowed backscattered ultrasound signals corresponding to each sub-region. The algorithm is also structured to account for the ultrasound attenuation in the medium and the finite-size effects of ultrasound transducer elements.

Super-resolution and super-localization microscopy: A novel tool for imaging chemical and biological processes

Energy Technology Data Exchange (ETDEWEB)

Dong, Bin [Iowa State Univ., Ames, IA (United States)

2015-01-01

Optical microscopy imaging of single molecules and single particles is an essential method for studying fundamental biological and chemical processes at the molecular and nanometer scale. The best spatial resolution (~ λ/2) achievable in traditional optical microscopy is governed by the diffraction of light. However, single molecule-based super-localization and super-resolution microscopy imaging techniques have emerged in the past decade. Individual molecules can be localized with nanometer scale accuracy and precision for studying of biological and chemical processes.This work uncovered the heterogeneous properties of the pore structures. In this dissertation, the coupling of molecular transport and catalytic reaction at the single molecule and single particle level in multilayer mesoporous nanocatalysts was elucidated. Most previous studies dealt with these two important phenomena separately. A fluorogenic oxidation reaction of non-fluorescent amplex red to highly fluorescent resorufin was tested. The diffusion behavior of single resorufin molecules in aligned nanopores was studied using total internal reflection fluorescence microscopy (TIRFM).

Brain Atlas Fusion from High-Thickness Diagnostic Magnetic Resonance Images by Learning-Based Super-Resolution.

Science.gov (United States)

Zhang, Jinpeng; Zhang, Lichi; Xiang, Lei; Shao, Yeqin; Wu, Guorong; Zhou, Xiaodong; Shen, Dinggang; Wang, Qian

2017-03-01

It is fundamentally important to fuse the brain atlas from magnetic resonance (MR) images for many imaging-based studies. Most existing works focus on fusing the atlases from high-quality MR images. However, for low-quality diagnostic images (i.e., with high inter-slice thickness), the problem of atlas fusion has not been addressed yet. In this paper, we intend to fuse the brain atlas from the high-thickness diagnostic MR images that are prevalent for clinical routines. The main idea of our works is to extend the conventional groupwise registration by incorporating a novel super-resolution strategy. The contribution of the proposed super-resolution framework is two-fold. First, each high-thickness subject image is reconstructed to be isotropic by the patch-based sparsity learning. Then, the reconstructed isotropic image is enhanced for better quality through the random-forest-based regression model. In this way, the images obtained by the super-resolution strategy can be fused together by applying the groupwise registration method to construct the required atlas. Our experiments have shown that the proposed framework can effectively solve the problem of atlas fusion from the low-quality brain MR images.

Learning-based compressed sensing for infrared image super resolution

Science.gov (United States)

Zhao, Yao; Sui, Xiubao; Chen, Qian; Wu, Shaochi

2016-05-01

This paper presents an infrared image super-resolution method based on compressed sensing (CS). First, the reconstruction model under the CS framework is established and a Toeplitz matrix is selected as the sensing matrix. Compared with traditional learning-based methods, the proposed method uses a set of sub-dictionaries instead of two coupled dictionaries to recover high resolution (HR) images. And Toeplitz sensing matrix allows the proposed method time-efficient. Second, all training samples are divided into several feature spaces by using the proposed adaptive k-means classification method, which is more accurate than the standard k-means method. On the basis of this approach, a complex nonlinear mapping from the HR space to low resolution (LR) space can be converted into several compact linear mappings. Finally, the relationships between HR and LR image patches can be obtained by multi-sub-dictionaries and HR infrared images are reconstructed by the input LR images and multi-sub-dictionaries. The experimental results show that the proposed method is quantitatively and qualitatively more effective than other state-of-the-art methods.

All-passive pixel super-resolution of time-stretch imaging

Science.gov (United States)

Chan, Antony C. S.; Ng, Ho-Cheung; Bogaraju, Sharat C. V.; So, Hayden K. H.; Lam, Edmund Y.; Tsia, Kevin K.

2017-03-01

Based on image encoding in a serial-temporal format, optical time-stretch imaging entails a stringent requirement of state-of-the-art fast data acquisition unit in order to preserve high image resolution at an ultrahigh frame rate — hampering the widespread utilities of such technology. Here, we propose a pixel super-resolution (pixel-SR) technique tailored for time-stretch imaging that preserves pixel resolution at a relaxed sampling rate. It harnesses the subpixel shifts between image frames inherently introduced by asynchronous digital sampling of the continuous time-stretch imaging process. Precise pixel registration is thus accomplished without any active opto-mechanical subpixel-shift control or other additional hardware. Here, we present the experimental pixel-SR image reconstruction pipeline that restores high-resolution time-stretch images of microparticles and biological cells (phytoplankton) at a relaxed sampling rate (≈2-5 GSa/s)—more than four times lower than the originally required readout rate (20 GSa/s) — is thus effective for high-throughput label-free, morphology-based cellular classification down to single-cell precision. Upon integration with the high-throughput image processing technology, this pixel-SR time-stretch imaging technique represents a cost-effective and practical solution for large scale cell-based phenotypic screening in biomedical diagnosis and machine vision for quality control in manufacturing.

Single-Image Super-Resolution Based on Rational Fractal Interpolation.

Science.gov (United States)

Zhang, Yunfeng; Fan, Qinglan; Bao, Fangxun; Liu, Yifang; Zhang, Caiming

2018-08-01

This paper presents a novel single-image super-resolution (SR) procedure, which upscales a given low-resolution (LR) input image to a high-resolution image while preserving the textural and structural information. First, we construct a new type of bivariate rational fractal interpolation model and investigate its analytical properties. This model has different forms of expression with various values of the scaling factors and shape parameters; thus, it can be employed to better describe image features than current interpolation schemes. Furthermore, this model combines the advantages of rational interpolation and fractal interpolation, and its effectiveness is validated through theoretical analysis. Second, we develop a single-image SR algorithm based on the proposed model. The LR input image is divided into texture and non-texture regions, and then, the image is interpolated according to the characteristics of the local structure. Specifically, in the texture region, the scaling factor calculation is the critical step. We present a method to accurately calculate scaling factors based on local fractal analysis. Extensive experiments and comparisons with the other state-of-the-art methods show that our algorithm achieves competitive performance, with finer details and sharper edges.

Dynamic placement of plasmonic hotspots for super-resolution surface-enhanced Raman scattering.

Science.gov (United States)

Ertsgaard, Christopher T; McKoskey, Rachel M; Rich, Isabel S; Lindquist, Nathan C

2014-10-28

In this paper, we demonstrate dynamic placement of locally enhanced plasmonic fields using holographic laser illumination of a silver nanohole array. To visualize these focused "hotspots", the silver surface was coated with various biological samples for surface-enhanced Raman spectroscopy (SERS) imaging. Due to the large field enhancements, blinking behavior of the SERS hotspots was observed and processed using a stochastic optical reconstruction microscopy algorithm enabling super-resolution localization of the hotspots to within 10 nm. These hotspots were then shifted across the surface in subwavelength (hotspots. Using this technique, we also show that such subwavelength shifting and localization of plasmonic hotspots has potential for imaging applications. Interestingly, illuminating the surface with randomly shifting SERS hotspots was sufficient to completely fill in a wide field of view for super-resolution chemical imaging.

Application of regularization technique in image super-resolution algorithm via sparse representation

Science.gov (United States)

Huang, De-tian; Huang, Wei-qin; Huang, Hui; Zheng, Li-xin

2017-11-01

To make use of the prior knowledge of the image more effectively and restore more details of the edges and structures, a novel sparse coding objective function is proposed by applying the principle of the non-local similarity and manifold learning on the basis of super-resolution algorithm via sparse representation. Firstly, the non-local similarity regularization term is constructed by using the similar image patches to preserve the edge information. Then, the manifold learning regularization term is constructed by utilizing the locally linear embedding approach to enhance the structural information. The experimental results validate that the proposed algorithm has a significant improvement compared with several super-resolution algorithms in terms of the subjective visual effect and objective evaluation indices.

Super-resolution imaging of a 2.5 kb non-repetitive DNA in situ in the nuclear genome using molecular beacon probes

Science.gov (United States)

Ni, Yanxiang; Cao, Bo; Ma, Tszshan; Niu, Gang; Huo, Yingdong; Huang, Jiandong; Chen, Danni; Liu, Yi; Yu, Bin; Zhang, Michael Q; Niu, Hanben

2017-01-01

High-resolution visualization of short non-repetitive DNA in situ in the nuclear genome is essential for studying looping interactions and chromatin organization in single cells. Recent advances in fluorescence in situ hybridization (FISH) using Oligopaint probes have enabled super-resolution imaging of genomic domains with a resolution limit of 4.9 kb. To target shorter elements, we developed a simple FISH method that uses molecular beacon (MB) probes to facilitate the probe-target binding, while minimizing non-specific fluorescence. We used three-dimensional stochastic optical reconstruction microscopy (3D-STORM) with optimized imaging conditions to efficiently distinguish sparsely distributed Alexa-647 from background cellular autofluorescence. Utilizing 3D-STORM and only 29–34 individual MB probes, we observed 3D fine-scale nanostructures of 2.5 kb integrated or endogenous unique DNA in situ in human or mouse genome, respectively. We demonstrated our MB-based FISH method was capable of visualizing the so far shortest non-repetitive genomic sequence in 3D at super-resolution. DOI: http://dx.doi.org/10.7554/eLife.21660.001 PMID:28485713

Video super-resolution using simultaneous motion and intensity calculations

DEFF Research Database (Denmark)

Keller, Sune Høgild; Lauze, Francois Bernard; Nielsen, Mads

2011-01-01

for the joint estimation of a super-resolution sequence and its flow field. Via the calculus of variations, this leads to a coupled system of partial differential equations for image sequence and motion estimation. We solve a simplified form of this system and as a by-product we indeed provide a motion field...

Texton-based super-resolution for achieving high spatiotemporal resolution in hybrid camera system

Science.gov (United States)

Kamimura, Kenji; Tsumura, Norimichi; Nakaguchi, Toshiya; Miyake, Yoichi

2010-05-01

Many super-resolution methods have been proposed to enhance the spatial resolution of images by using iteration and multiple input images. In a previous paper, we proposed the example-based super-resolution method to enhance an image through pixel-based texton substitution to reduce the computational cost. In this method, however, we only considered the enhancement of a texture image. In this study, we modified this texton substitution method for a hybrid camera to reduce the required bandwidth of a high-resolution video camera. We applied our algorithm to pairs of high- and low-spatiotemporal-resolution videos, which were synthesized to simulate a hybrid camera. The result showed that the fine detail of the low-resolution video can be reproduced compared with bicubic interpolation and the required bandwidth could be reduced to about 1/5 in a video camera. It was also shown that the peak signal-to-noise ratios (PSNRs) of the images improved by about 6 dB in a trained frame and by 1.0-1.5 dB in a test frame, as determined by comparison with the processed image using bicubic interpolation, and the average PSNRs were higher than those obtained by the well-known Freeman’s patch-based super-resolution method. Compared with that of the Freeman’s patch-based super-resolution method, the computational time of our method was reduced to almost 1/10.

Identification and super-resolution imaging of ligand-activated receptor dimers in live cells

Science.gov (United States)

Winckler, Pascale; Lartigue, Lydia; Giannone, Gregory; de Giorgi, Francesca; Ichas, François; Sibarita, Jean-Baptiste; Lounis, Brahim; Cognet, Laurent

2013-08-01

Molecular interactions are key to many chemical and biological processes like protein function. In many signaling processes they occur in sub-cellular areas displaying nanoscale organizations and involving molecular assemblies. The nanometric dimensions and the dynamic nature of the interactions make their investigations complex in live cells. While super-resolution fluorescence microscopies offer live-cell molecular imaging with sub-wavelength resolutions, they lack specificity for distinguishing interacting molecule populations. Here we combine super-resolution microscopy and single-molecule Förster Resonance Energy Transfer (FRET) to identify dimers of receptors induced by ligand binding and provide super-resolved images of their membrane distribution in live cells. By developing a two-color universal-Point-Accumulation-In-the-Nanoscale-Topography (uPAINT) method, dimers of epidermal growth factor receptors (EGFR) activated by EGF are studied at ultra-high densities, revealing preferential cell-edge sub-localization. This methodology which is specifically devoted to the study of molecules in interaction, may find other applications in biological systems where understanding of molecular organization is crucial.

Single image super-resolution via regularized extreme learning regression for imagery from microgrid polarimeters

Science.gov (United States)

Sargent, Garrett C.; Ratliff, Bradley M.; Asari, Vijayan K.

2017-08-01

The advantage of division of focal plane imaging polarimeters is their ability to obtain temporally synchronized intensity measurements across a scene; however, they sacrifice spatial resolution in doing so due to their spatially modulated arrangement of the pixel-to-pixel polarizers and often result in aliased imagery. Here, we propose a super-resolution method based upon two previously trained extreme learning machines (ELM) that attempt to recover missing high frequency and low frequency content beyond the spatial resolution of the sensor. This method yields a computationally fast and simple way of recovering lost high and low frequency content from demosaicing raw microgrid polarimetric imagery. The proposed method outperforms other state-of-the-art single-image super-resolution algorithms in terms of structural similarity and peak signal-to-noise ratio.

Under the Microscope: Single-Domain Antibodies for Live-Cell Imaging and Super-Resolution Microscopy

Directory of Open Access Journals (Sweden)

Bjoern Traenkle

2017-08-01

Full Text Available Single-domain antibodies (sdAbs have substantially expanded the possibilities of advanced cellular imaging such as live-cell or super-resolution microscopy to visualize cellular antigens and their dynamics. In addition to their unique properties including small size, high stability, and solubility in many environments, sdAbs can be efficiently functionalized according to the needs of the respective imaging approach. Genetically encoded intrabodies fused to fluorescent proteins (chromobodies have become versatile tools to study dynamics of endogenous proteins in living cells. Additionally, sdAbs conjugated to organic dyes were shown to label cellular structures with high density and minimal fluorophore displacement making them highly attractive probes for super-resolution microscopy. Here, we review recent advances of the chromobody technology to visualize localization and dynamics of cellular targets and the application of chromobody-based cell models for compound screening. Acknowledging the emerging importance of super-resolution microscopy in cell biology, we further discuss advantages and challenges of sdAbs for this technology.

Under the Microscope: Single-Domain Antibodies for Live-Cell Imaging and Super-Resolution Microscopy.

Science.gov (United States)

Traenkle, Bjoern; Rothbauer, Ulrich

2017-01-01

Single-domain antibodies (sdAbs) have substantially expanded the possibilities of advanced cellular imaging such as live-cell or super-resolution microscopy to visualize cellular antigens and their dynamics. In addition to their unique properties including small size, high stability, and solubility in many environments, sdAbs can be efficiently functionalized according to the needs of the respective imaging approach. Genetically encoded intrabodies fused to fluorescent proteins (chromobodies) have become versatile tools to study dynamics of endogenous proteins in living cells. Additionally, sdAbs conjugated to organic dyes were shown to label cellular structures with high density and minimal fluorophore displacement making them highly attractive probes for super-resolution microscopy. Here, we review recent advances of the chromobody technology to visualize localization and dynamics of cellular targets and the application of chromobody-based cell models for compound screening. Acknowledging the emerging importance of super-resolution microscopy in cell biology, we further discuss advantages and challenges of sdAbs for this technology.

Super-resolution for scanning light stimulation systems

Energy Technology Data Exchange (ETDEWEB)

Bitzer, L. A.; Neumann, K.; Benson, N., E-mail: niels.benson@uni-due.de; Schmechel, R. [Faculty of Engineering, NST and CENIDE, University of Duisburg-Essen, Bismarckstr. 81, 47057 Duisburg (Germany)

2016-09-15

Super-resolution (SR) is a technique used in digital image processing to overcome the resolution limitation of imaging systems. In this process, a single high resolution image is reconstructed from multiple low resolution images. SR is commonly used for CCD and CMOS (Complementary Metal-Oxide-Semiconductor) sensor images, as well as for medical applications, e.g., magnetic resonance imaging. Here, we demonstrate that super-resolution can be applied with scanning light stimulation (LS) systems, which are common to obtain space-resolved electro-optical parameters of a sample. For our purposes, the Projection Onto Convex Sets (POCS) was chosen and modified to suit the needs of LS systems. To demonstrate the SR adaption, an Optical Beam Induced Current (OBIC) LS system was used. The POCS algorithm was optimized by means of OBIC short circuit current measurements on a multicrystalline solar cell, resulting in a mean square error reduction of up to 61% and improved image quality.

Oblique reconstructions in tomosynthesis. II. Super-resolution

International Nuclear Information System (INIS)

Acciavatti, Raymond J.; Maidment, Andrew D. A.

2013-01-01

Purpose: In tomosynthesis, super-resolution has been demonstrated using reconstruction planes parallel to the detector. Super-resolution allows for subpixel resolution relative to the detector. The purpose of this work is to develop an analytical model that generalizes super-resolution to oblique reconstruction planes.Methods: In a digital tomosynthesis system, a sinusoidal test object is modeled along oblique angles (i.e., “pitches”) relative to the plane of the detector in a 3D divergent-beam acquisition geometry. To investigate the potential for super-resolution, the input frequency is specified to be greater than the alias frequency of the detector. Reconstructions are evaluated in an oblique plane along the extent of the object using simple backprojection (SBP) and filtered backprojection (FBP). By comparing the amplitude of the reconstruction against the attenuation coefficient of the object at various frequencies, the modulation transfer function (MTF) is calculated to determine whether modulation is within detectable limits for super-resolution. For experimental validation of super-resolution, a goniometry stand was used to orient a bar pattern phantom along various pitches relative to the breast support in a commercial digital breast tomosynthesis system.Results: Using theoretical modeling, it is shown that a single projection image cannot resolve a sine input whose frequency exceeds the detector alias frequency. The high frequency input is correctly visualized in SBP or FBP reconstruction using a slice along the pitch of the object. The Fourier transform of this reconstructed slice is maximized at the input frequency as proof that the object is resolved. Consistent with the theoretical results, experimental images of a bar pattern phantom showed super-resolution in oblique reconstructions. At various pitches, the highest frequency with detectable modulation was determined by visual inspection of the bar patterns. The dependency of the highest

Oblique reconstructions in tomosynthesis. II. Super-resolution

Science.gov (United States)

Acciavatti, Raymond J.; Maidment, Andrew D. A.

2013-01-01

Purpose: In tomosynthesis, super-resolution has been demonstrated using reconstruction planes parallel to the detector. Super-resolution allows for subpixel resolution relative to the detector. The purpose of this work is to develop an analytical model that generalizes super-resolution to oblique reconstruction planes. Methods: In a digital tomosynthesis system, a sinusoidal test object is modeled along oblique angles (i.e., “pitches”) relative to the plane of the detector in a 3D divergent-beam acquisition geometry. To investigate the potential for super-resolution, the input frequency is specified to be greater than the alias frequency of the detector. Reconstructions are evaluated in an oblique plane along the extent of the object using simple backprojection (SBP) and filtered backprojection (FBP). By comparing the amplitude of the reconstruction against the attenuation coefficient of the object at various frequencies, the modulation transfer function (MTF) is calculated to determine whether modulation is within detectable limits for super-resolution. For experimental validation of super-resolution, a goniometry stand was used to orient a bar pattern phantom along various pitches relative to the breast support in a commercial digital breast tomosynthesis system. Results: Using theoretical modeling, it is shown that a single projection image cannot resolve a sine input whose frequency exceeds the detector alias frequency. The high frequency input is correctly visualized in SBP or FBP reconstruction using a slice along the pitch of the object. The Fourier transform of this reconstructed slice is maximized at the input frequency as proof that the object is resolved. Consistent with the theoretical results, experimental images of a bar pattern phantom showed super-resolution in oblique reconstructions. At various pitches, the highest frequency with detectable modulation was determined by visual inspection of the bar patterns. The dependency of the highest

Tilted Light Sheet Microscopy with 3D Point Spread Functions for Single-Molecule Super-Resolution Imaging in Mammalian Cells.

Science.gov (United States)

Gustavsson, Anna-Karin; Petrov, Petar N; Lee, Maurice Y; Shechtman, Yoav; Moerner, W E

2018-02-01

To obtain a complete picture of subcellular nanostructures, cells must be imaged with high resolution in all three dimensions (3D). Here, we present tilted light sheet microscopy with 3D point spread functions (TILT3D), an imaging platform that combines a novel, tilted light sheet illumination strategy with engineered long axial range point spread functions (PSFs) for low-background, 3D super localization of single molecules as well as 3D super-resolution imaging in thick cells. TILT3D is built upon a standard inverted microscope and has minimal custom parts. The axial positions of the single molecules are encoded in the shape of the PSF rather than in the position or thickness of the light sheet, and the light sheet can therefore be formed using simple optics. The result is flexible and user-friendly 3D super-resolution imaging with tens of nm localization precision throughout thick mammalian cells. We validated TILT3D for 3D super-resolution imaging in mammalian cells by imaging mitochondria and the full nuclear lamina using the double-helix PSF for single-molecule detection and the recently developed Tetrapod PSF for fiducial bead tracking and live axial drift correction. We envision TILT3D to become an important tool not only for 3D super-resolution imaging, but also for live whole-cell single-particle and single-molecule tracking.

Performance Evaluations for Super-Resolution Mosaicing on UAS Surveillance Videos

Directory of Open Access Journals (Sweden)

Aldo Camargo

2013-05-01

Full Text Available Abstract Unmanned Aircraft Systems (UAS have been widely applied for reconnaissance and surveillance by exploiting information collected from the digital imaging payload. The super-resolution (SR mosaicing of low-resolution (LR UAS surveillance video frames has become a critical requirement for UAS video processing and is important for further effective image understanding. In this paper we develop a novel super-resolution framework, which does not require the construction of sparse matrices. The proposed method implements image operations in the spatial domain and applies an iterated back-projection to construct super-resolution mosaics from the overlapping UAS surveillance video frames. The Steepest Descent method, the Conjugate Gradient method and the Levenberg-Marquardt algorithm are used to numerically solve the nonlinear optimization problem for estimating a super-resolution mosaic. A quantitative performance comparison in terms of computation time and visual quality of the super-resolution mosaics through the three numerical techniques is presented.

Comparison of super-resolution benefits for downsampled iages and real low-resolution data

NARCIS (Netherlands)

Peng, Y.; Spreeuwers, Lieuwe Jan; Gökberk, B.; Veldhuis, Raymond N.J.

2013-01-01

Recently, more and more researchers are exploring the benefits of super-resolution methods on low-resolution face recognition. However, often results presented are obtained on downsampled high-resolution face images. Because downsampled images are different from real images taken at low resolution,

Super-resolution convolutional neural network for the improvement of the image quality of magnified images in chest radiographs

Science.gov (United States)

Umehara, Kensuke; Ota, Junko; Ishimaru, Naoki; Ohno, Shunsuke; Okamoto, Kentaro; Suzuki, Takanori; Shirai, Naoki; Ishida, Takayuki

2017-02-01

Single image super-resolution (SR) method can generate a high-resolution (HR) image from a low-resolution (LR) image by enhancing image resolution. In medical imaging, HR images are expected to have a potential to provide a more accurate diagnosis with the practical application of HR displays. In recent years, the super-resolution convolutional neural network (SRCNN), which is one of the state-of-the-art deep learning based SR methods, has proposed in computer vision. In this study, we applied and evaluated the SRCNN scheme to improve the image quality of magnified images in chest radiographs. For evaluation, a total of 247 chest X-rays were sampled from the JSRT database. The 247 chest X-rays were divided into 93 training cases with non-nodules and 152 test cases with lung nodules. The SRCNN was trained using the training dataset. With the trained SRCNN, the HR image was reconstructed from the LR one. We compared the image quality of the SRCNN and conventional image interpolation methods, nearest neighbor, bilinear and bicubic interpolations. For quantitative evaluation, we measured two image quality metrics, peak signal-to-noise ratio (PSNR) and structural similarity (SSIM). In the SRCNN scheme, PSNR and SSIM were significantly higher than those of three interpolation methods (pmethods without any obvious artifacts. These preliminary results indicate that the SRCNN scheme significantly outperforms conventional interpolation algorithms for enhancing image resolution and that the use of the SRCNN can yield substantial improvement of the image quality of magnified images in chest radiographs.

Optimized multiple linear mappings for single image super-resolution

Science.gov (United States)

Zhang, Kaibing; Li, Jie; Xiong, Zenggang; Liu, Xiuping; Gao, Xinbo

2017-12-01

Learning piecewise linear regression has been recognized as an effective way for example learning-based single image super-resolution (SR) in literature. In this paper, we employ an expectation-maximization (EM) algorithm to further improve the SR performance of our previous multiple linear mappings (MLM) based SR method. In the training stage, the proposed method starts with a set of linear regressors obtained by the MLM-based method, and then jointly optimizes the clustering results and the low- and high-resolution subdictionary pairs for regression functions by using the metric of the reconstruction errors. In the test stage, we select the optimal regressor for SR reconstruction by accumulating the reconstruction errors of m-nearest neighbors in the training set. Thorough experimental results carried on six publicly available datasets demonstrate that the proposed SR method can yield high-quality images with finer details and sharper edges in terms of both quantitative and perceptual image quality assessments.

Image Super-Resolution Algorithm Based on an Improved Sparse Autoencoder

Directory of Open Access Journals (Sweden)

Detian Huang

2018-01-01

Full Text Available Due to the limitations of the resolution of the imaging system and the influence of scene changes and other factors, sometimes only low-resolution images can be acquired, which cannot satisfy the practical application’s requirements. To improve the quality of low-resolution images, a novel super-resolution algorithm based on an improved sparse autoencoder is proposed. Firstly, in the training set preprocessing stage, the high- and low-resolution image training sets are constructed, respectively, by using high-frequency information of the training samples as the characterization, and then the zero-phase component analysis whitening technique is utilized to decorrelate the formed joint training set to reduce its redundancy. Secondly, a constructed sparse regularization term is added to the cost function of the traditional sparse autoencoder to further strengthen the sparseness constraint on the hidden layer. Finally, in the dictionary learning stage, the improved sparse autoencoder is adopted to achieve unsupervised dictionary learning to improve the accuracy and stability of the dictionary. Experimental results validate that the proposed algorithm outperforms the existing algorithms both in terms of the subjective visual perception and the objective evaluation indices, including the peak signal-to-noise ratio and the structural similarity measure.

A Microfluidic Platform for Correlative Live-Cell and Super-Resolution Microscopy

Science.gov (United States)

Tam, Johnny; Cordier, Guillaume Alan; Bálint, Štefan; Sandoval Álvarez, Ángel; Borbely, Joseph Steven; Lakadamyali, Melike

2014-01-01

Recently, super-resolution microscopy methods such as stochastic optical reconstruction microscopy (STORM) have enabled visualization of subcellular structures below the optical resolution limit. Due to the poor temporal resolution, however, these methods have mostly been used to image fixed cells or dynamic processes that evolve on slow time-scales. In particular, fast dynamic processes and their relationship to the underlying ultrastructure or nanoscale protein organization cannot be discerned. To overcome this limitation, we have recently developed a correlative and sequential imaging method that combines live-cell and super-resolution microscopy. This approach adds dynamic background to ultrastructural images providing a new dimension to the interpretation of super-resolution data. However, currently, it suffers from the need to carry out tedious steps of sample preparation manually. To alleviate this problem, we implemented a simple and versatile microfluidic platform that streamlines the sample preparation steps in between live-cell and super-resolution imaging. The platform is based on a microfluidic chip with parallel, miniaturized imaging chambers and an automated fluid-injection device, which delivers a precise amount of a specified reagent to the selected imaging chamber at a specific time within the experiment. We demonstrate that this system can be used for live-cell imaging, automated fixation, and immunostaining of adherent mammalian cells in situ followed by STORM imaging. We further demonstrate an application by correlating mitochondrial dynamics, morphology, and nanoscale mitochondrial protein distribution in live and super-resolution images. PMID:25545548

Development of the super high angular resolution principle for X-ray imaging

International Nuclear Information System (INIS)

Zhang Chen; Zhang Shuangnan

2011-01-01

Development of the Super High Angular Resolution Principle (SHARP) for coded-mask X-ray imaging is presented. We prove that SHARP can be considered as a generalized coded mask imaging method with a coding pattern comprised of diffraction-interference fringes in the mask pattern. The angular resolution of SHARP can be improved by detecting the fringes more precisely than the mask's element size, i.e. by using a detector with a pixel size smaller than the mask's element size. The proposed mission SHARP-X for solar X-ray observations is also briefly discussed. (research papers)

Remote classification from an airborne camera using image super-resolution.

Science.gov (United States)

Woods, Matthew; Katsaggelos, Aggelos

2017-02-01

The image processing technique known as super-resolution (SR), which attempts to increase the effective pixel sampling density of a digital imager, has gained rapid popularity over the last decade. The majority of literature focuses on its ability to provide results that are visually pleasing to a human observer. In this paper, we instead examine the ability of SR to improve the resolution-critical capability of an imaging system to perform a classification task from a remote location, specifically from an airborne camera. In order to focus the scope of the study, we address and quantify results for the narrow case of text classification. However, we expect the results generalize to a large set of related, remote classification tasks. We generate theoretical results through simulation, which are corroborated by experiments with a camera mounted on a DJI Phantom 3 quadcopter.

Optimization of super-resolution processing using incomplete image sets in PET imaging.

Science.gov (United States)

Chang, Guoping; Pan, Tinsu; Clark, John W; Mawlawi, Osama R

2008-12-01

Super-resolution (SR) techniques are used in PET imaging to generate a high-resolution image by combining multiple low-resolution images that have been acquired from different points of view (POVs). The number of low-resolution images used defines the processing time and memory storage necessary to generate the SR image. In this paper, the authors propose two optimized SR implementations (ISR-1 and ISR-2) that require only a subset of the low-resolution images (two sides and diagonal of the image matrix, respectively), thereby reducing the overall processing time and memory storage. In an N x N matrix of low-resolution images, ISR-1 would be generated using images from the two sides of the N x N matrix, while ISR-2 would be generated from images across the diagonal of the image matrix. The objective of this paper is to investigate whether the two proposed SR methods can achieve similar performance in contrast and signal-to-noise ratio (SNR) as the SR image generated from a complete set of low-resolution images (CSR) using simulation and experimental studies. A simulation, a point source, and a NEMA/IEC phantom study were conducted for this investigation. In each study, 4 (2 x 2) or 16 (4 x 4) low-resolution images were reconstructed from the same acquired data set while shifting the reconstruction grid to generate images from different POVs. SR processing was then applied in each study to combine all as well as two different subsets of the low-resolution images to generate the CSR, ISR-1, and ISR-2 images, respectively. For reference purpose, a native reconstruction (NR) image using the same matrix size as the three SR images was also generated. The resultant images (CSR, ISR-1, ISR-2, and NR) were then analyzed using visual inspection, line profiles, SNR plots, and background noise spectra. The simulation study showed that the contrast and the SNR difference between the two ISR images and the CSR image were on average 0.4% and 0.3%, respectively. Line profiles of

Far-field superresolution by imaging of resonance scattering

KAUST Repository

Schuster, Gerard T.

2014-10-31

We show that superresolution imaging in the far-field region of the sources and receivers is theoretically and practically possible if migration of resonant multiples is employed. A resonant multiple is one that bounces back and forth between two scattering points; it can also be the multiple between two smoothly varying interfaces as long as the reflection wave paths partially overlap and reflect from the same Fresnel zone. For a source with frequency f, compared to a one-way trip, N round trips in propagating between two scatterers increase the effective frequency by 2N × f and decrease the effective wavelength by λ/(2N). Thus, multiples can, in principle, be used as high-frequency probes to estimate detailed properties of layers. Tests with both synthetic and field data validate this claim. Improved resolution by multiple imaging is not only feasible for crustal reflections, but might be applicable to mantle and core reverberations recorded by earthquake seismologists.

Super-Resolution Image Reconstruction Applied to Medical Ultrasound

Science.gov (United States)

Ellis, Michael

Ultrasound is the preferred imaging modality for many diagnostic applications due to its real-time image reconstruction and low cost. Nonetheless, conventional ultrasound is not used in many applications because of limited spatial resolution and soft tissue contrast. Most commercial ultrasound systems reconstruct images using a simple delay-and-sum architecture on receive, which is fast and robust but does not utilize all information available in the raw data. Recently, more sophisticated image reconstruction methods have been developed that make use of far more information in the raw data to improve resolution and contrast. One such method is the Time-Domain Optimized Near-Field Estimator (TONE), which employs a maximum a priori estimation to solve a highly underdetermined problem, given a well-defined system model. TONE has been shown to significantly improve both the contrast and resolution of ultrasound images when compared to conventional methods. However, TONE's lack of robustness to variations from the system model and extremely high computational cost hinder it from being readily adopted in clinical scanners. This dissertation aims to reduce the impact of TONE's shortcomings, transforming it from an academic construct to a clinically viable image reconstruction algorithm. By altering the system model from a collection of individual hypothetical scatterers to a collection of weighted, diffuse regions, dTONE is able to achieve much greater robustness to modeling errors. A method for efficient parallelization of dTONE is presented that reduces reconstruction time by more than an order of magnitude with little loss in image fidelity. An alternative reconstruction algorithm, called qTONE, is also developed and is able to reduce reconstruction times by another two orders of magnitude while simultaneously improving image contrast. Each of these methods for improving TONE are presented, their limitations are explored, and all are used in concert to reconstruct in

MAP-MRF-Based Super-Resolution Reconstruction Approach for Coded Aperture Compressive Temporal Imaging

Directory of Open Access Journals (Sweden)

Tinghua Zhang

2018-02-01

Full Text Available Coded Aperture Compressive Temporal Imaging (CACTI can afford low-cost temporal super-resolution (SR, but limits are imposed by noise and compression ratio on reconstruction quality. To utilize inter-frame redundant information from multiple observations and sparsity in multi-transform domains, a robust reconstruction approach based on maximum a posteriori probability and Markov random field (MAP-MRF model for CACTI is proposed. The proposed approach adopts a weighted 3D neighbor system (WNS and the coordinate descent method to perform joint estimation of model parameters, to achieve the robust super-resolution reconstruction. The proposed multi-reconstruction algorithm considers both total variation (TV and ℓ 2 , 1 norm in wavelet domain to address the minimization problem for compressive sensing, and solves it using an accelerated generalized alternating projection algorithm. The weighting coefficient for different regularizations and frames is resolved by the motion characteristics of pixels. The proposed approach can provide high visual quality in the foreground and background of a scene simultaneously and enhance the fidelity of the reconstruction results. Simulation results have verified the efficacy of our new optimization framework and the proposed reconstruction approach.

Super-resolution imaging and tracking of protein-protein interactions in sub-diffraction cellular space

Science.gov (United States)

Liu, Zhen; Xing, Dong; Su, Qian Peter; Zhu, Yun; Zhang, Jiamei; Kong, Xinyu; Xue, Boxin; Wang, Sheng; Sun, Hao; Tao, Yile; Sun, Yujie

2014-07-01

Imaging the location and dynamics of individual interacting protein pairs is essential but often difficult because of the fluorescent background from other paired and non-paired molecules, particularly in the sub-diffraction cellular space. Here we develop a new method combining bimolecular fluorescence complementation and photoactivated localization microscopy for super-resolution imaging and single-molecule tracking of specific protein-protein interactions. The method is used to study the interaction of two abundant proteins, MreB and EF-Tu, in Escherichia coli cells. The super-resolution imaging shows interesting distribution and domain sizes of interacting MreB-EF-Tu pairs as a subpopulation of total EF-Tu. The single-molecule tracking of MreB, EF-Tu and MreB-EF-Tu pairs reveals intriguing localization-dependent heterogonous dynamics and provides valuable insights to understanding the roles of MreB-EF-Tu interactions.

Super-resolution imaging and tracking of protein–protein interactions in sub-diffraction cellular space

Science.gov (United States)

Liu, Zhen; Xing, Dong; Su, Qian Peter; Zhu, Yun; Zhang, Jiamei; Kong, Xinyu; Xue, Boxin; Wang, Sheng; Sun, Hao; Tao, Yile; Sun, Yujie

2014-01-01

Imaging the location and dynamics of individual interacting protein pairs is essential but often difficult because of the fluorescent background from other paired and non-paired molecules, particularly in the sub-diffraction cellular space. Here we develop a new method combining bimolecular fluorescence complementation and photoactivated localization microscopy for super-resolution imaging and single-molecule tracking of specific protein–protein interactions. The method is used to study the interaction of two abundant proteins, MreB and EF-Tu, in Escherichia coli cells. The super-resolution imaging shows interesting distribution and domain sizes of interacting MreB–EF-Tu pairs as a subpopulation of total EF-Tu. The single-molecule tracking of MreB, EF-Tu and MreB–EF-Tu pairs reveals intriguing localization-dependent heterogonous dynamics and provides valuable insights to understanding the roles of MreB–EF-Tu interactions. PMID:25030837

Improved Interpolation Kernels for Super-resolution Algorithms

DEFF Research Database (Denmark)

Rasti, Pejman; Orlova, Olga; Tamberg, Gert

2016-01-01

Super resolution (SR) algorithms are widely used in forensics investigations to enhance the resolution of images captured by surveillance cameras. Such algorithms usually use a common interpolation algorithm to generate an initial guess for the desired high resolution (HR) image. This initial guess...... when their original interpolation kernel is replaced by the ones introduced in this work....

Super-Resolution Molecular and Functional Imaging of Nanoscale Architectures in Life and Materials Science

KAUST Repository

Habuchi, Satoshi

2014-06-12

Super-resolution (SR) fluorescence microscopy has been revolutionizing the way in which we investigate the structures, dynamics, and functions of a wide range of nanoscale systems. In this review, I describe the current state of various SR fluorescence microscopy techniques along with the latest developments of fluorophores and labeling for the SR microscopy. I discuss the applications of SR microscopy in the fields of life science and materials science with a special emphasis on quantitative molecular imaging and nanoscale functional imaging. These studies open new opportunities for unraveling the physical, chemical, and optical properties of a wide range of nanoscale architectures together with their nanostructures and will enable the development of new (bio-)nanotechnology.

Super resolution for astronomical observations

Science.gov (United States)

Li, Zhan; Peng, Qingyu; Bhanu, Bir; Zhang, Qingfeng; He, Haifeng

2018-05-01

In order to obtain detailed information from multiple telescope observations a general blind super-resolution (SR) reconstruction approach for astronomical images is proposed in this paper. A pixel-reliability-based SR reconstruction algorithm is described and implemented, where the developed process incorporates flat field correction, automatic star searching and centering, iterative star matching, and sub-pixel image registration. Images captured by the 1-m telescope at Yunnan Observatory are used to test the proposed technique. The results of these experiments indicate that, following SR reconstruction, faint stars are more distinct, bright stars have sharper profiles, and the backgrounds have higher details; thus these results benefit from the high-precision star centering and image registration provided by the developed method. Application of the proposed approach not only provides more opportunities for new discoveries from astronomical image sequences, but will also contribute to enhancing the capabilities of most spatial or ground-based telescopes.

A super-oscillatory lens optical microscope for subwavelength imaging.

Science.gov (United States)

Rogers, Edward T F; Lindberg, Jari; Roy, Tapashree; Savo, Salvatore; Chad, John E; Dennis, Mark R; Zheludev, Nikolay I

2012-03-25

The past decade has seen an intensive effort to achieve optical imaging resolution beyond the diffraction limit. Apart from the Pendry-Veselago negative index superlens, implementation of which in optics faces challenges of losses and as yet unattainable fabrication finesse, other super-resolution approaches necessitate the lens either to be in the near proximity of the object or manufactured on it, or work only for a narrow class of samples, such as intensely luminescent or sparse objects. Here we report a new super-resolution microscope for optical imaging that beats the diffraction limit of conventional instruments and the recently demonstrated near-field optical superlens and hyperlens. This non-invasive subwavelength imaging paradigm uses a binary amplitude mask for direct focusing of laser light into a subwavelength spot in the post-evanescent field by precisely tailoring the interference of a large number of beams diffracted from a nanostructured mask. The new technology, which--in principle--has no physical limits on resolution, could be universally used for imaging at any wavelength and does not depend on the luminescence of the object, which can be tens of micrometres away from the mask. It has been implemented as a straightforward modification of a conventional microscope showing resolution better than λ/6.

Tilted light sheet microscopy with 3D point spread functions for single-molecule super-resolution imaging in mammalian cells

Science.gov (United States)

Gustavsson, Anna-Karin; Petrov, Petar N.; Lee, Maurice Y.; Shechtman, Yoav; Moerner, W. E.

2018-02-01

To obtain a complete picture of subcellular nanostructures, cells must be imaged with high resolution in all three dimensions (3D). Here, we present tilted light sheet microscopy with 3D point spread functions (TILT3D), an imaging platform that combines a novel, tilted light sheet illumination strategy with engineered long axial range point spread functions (PSFs) for low-background, 3D super localization of single molecules as well as 3D super-resolution imaging in thick cells. TILT3D is built upon a standard inverted microscope and has minimal custom parts. The axial positions of the single molecules are encoded in the shape of the PSF rather than in the position or thickness of the light sheet, and the light sheet can therefore be formed using simple optics. The result is flexible and user-friendly 3D super-resolution imaging with tens of nm localization precision throughout thick mammalian cells. We validated TILT3D for 3D superresolution imaging in mammalian cells by imaging mitochondria and the full nuclear lamina using the double-helix PSF for single-molecule detection and the recently developed Tetrapod PSF for fiducial bead tracking and live axial drift correction. We envision TILT3D to become an important tool not only for 3D super-resolution imaging, but also for live whole-cell single-particle and single-molecule tracking.

New device based on the super spatial resolution (SSR) method

International Nuclear Information System (INIS)

Soluri, A.; Atzeni, G.; Ucci, A.; Bellone, T.; Cusanno, F.; Rodilossi, G.; Massari, R.

2013-01-01

Recently it have been described that innovative methods, namely Super Spatial Resolution (SSR), can be used to improve the scintigraphic imaging. The aim of SSR techniques is the enhancement of the resolution of an imaging system, using information from several images. In this paper we describe a new experimental apparatus that could be used for molecular imaging and small animal imaging. In fact we present a new device, completely automated, that uses the SSR method and provides images with better spatial resolution in comparison to the original resolution. Preliminary small animal imaging studies confirm the feasibility of a very high resolution system in scintigraphic imaging and the possibility to have gamma cameras using the SSR method, to perform the applications on functional imaging. -- Highlights: • Super spatial resolution brings a high resolution image from scintigraphic images. • Resolution improvement depends on the signal to noise ratio of the original images. • The SSR shows significant improvement on spatial resolution in scintigraphic images. • The SSR method is potentially utilizable for all scintigraphic devices

Super-resolution in plenoptic cameras using FPGAs.

Science.gov (United States)

Pérez, Joel; Magdaleno, Eduardo; Pérez, Fernando; Rodríguez, Manuel; Hernández, David; Corrales, Jaime

2014-05-16

Plenoptic cameras are a new type of sensor that extend the possibilities of current commercial cameras allowing 3D refocusing or the capture of 3D depths. One of the limitations of plenoptic cameras is their limited spatial resolution. In this paper we describe a fast, specialized hardware implementation of a super-resolution algorithm for plenoptic cameras. The algorithm has been designed for field programmable graphic array (FPGA) devices using VHDL (very high speed integrated circuit (VHSIC) hardware description language). With this technology, we obtain an acceleration of several orders of magnitude using its extremely high-performance signal processing capability through parallelism and pipeline architecture. The system has been developed using generics of the VHDL language. This allows a very versatile and parameterizable system. The system user can easily modify parameters such as data width, number of microlenses of the plenoptic camera, their size and shape, and the super-resolution factor. The speed of the algorithm in FPGA has been successfully compared with the execution using a conventional computer for several image sizes and different 3D refocusing planes.

Super-Resolution in Plenoptic Cameras Using FPGAs

Directory of Open Access Journals (Sweden)

Joel Pérez

2014-05-01

Full Text Available Plenoptic cameras are a new type of sensor that extend the possibilities of current commercial cameras allowing 3D refocusing or the capture of 3D depths. One of the limitations of plenoptic cameras is their limited spatial resolution. In this paper we describe a fast, specialized hardware implementation of a super-resolution algorithm for plenoptic cameras. The algorithm has been designed for field programmable graphic array (FPGA devices using VHDL (very high speed integrated circuit (VHSIC hardware description language. With this technology, we obtain an acceleration of several orders of magnitude using its extremely high-performance signal processing capability through parallelism and pipeline architecture. The system has been developed using generics of the VHDL language. This allows a very versatile and parameterizable system. The system user can easily modify parameters such as data width, number of microlenses of the plenoptic camera, their size and shape, and the super-resolution factor. The speed of the algorithm in FPGA has been successfully compared with the execution using a conventional computer for several image sizes and different 3D refocusing planes.

3D high- and super-resolution imaging using single-objective SPIM.

Science.gov (United States)

Galland, Remi; Grenci, Gianluca; Aravind, Ajay; Viasnoff, Virgile; Studer, Vincent; Sibarita, Jean-Baptiste

2015-07-01

Single-objective selective-plane illumination microscopy (soSPIM) is achieved with micromirrored cavities combined with a laser beam-steering unit installed on a standard inverted microscope. The illumination and detection are done through the same objective. soSPIM can be used with standard sample preparations and features high background rejection and efficient photon collection, allowing for 3D single-molecule-based super-resolution imaging of whole cells or cell aggregates. Using larger mirrors enabled us to broaden the capabilities of our system to image Drosophila embryos.

Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement.

Science.gov (United States)

Zhu, Hong; Tang, Xinming; Xie, Junfeng; Song, Weidong; Mo, Fan; Gao, Xiaoming

2018-02-07

There are many problems in existing reconstruction-based super-resolution algorithms, such as the lack of texture-feature representation and of high-frequency details. Multi-scale detail enhancement can produce more texture information and high-frequency information. Therefore, super-resolution reconstruction of remote-sensing images based on adaptive multi-scale detail enhancement (AMDE-SR) is proposed in this paper. First, the information entropy of each remote-sensing image is calculated, and the image with the maximum entropy value is regarded as the reference image. Subsequently, spatio-temporal remote-sensing images are processed using phase normalization, which is to reduce the time phase difference of image data and enhance the complementarity of information. The multi-scale image information is then decomposed using the L ₀ gradient minimization model, and the non-redundant information is processed by difference calculation and expanding non-redundant layers and the redundant layer by the iterative back-projection (IBP) technique. The different-scale non-redundant information is adaptive-weighted and fused using cross-entropy. Finally, a nonlinear texture-detail-enhancement function is built to improve the scope of small details, and the peak signal-to-noise ratio (PSNR) is used as an iterative constraint. Ultimately, high-resolution remote-sensing images with abundant texture information are obtained by iterative optimization. Real results show an average gain in entropy of up to 0.42 dB for an up-scaling of 2 and a significant promotion gain in enhancement measure evaluation for an up-scaling of 2. The experimental results show that the performance of the AMED-SR method is better than existing super-resolution reconstruction methods in terms of visual and accuracy improvements.

Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement

Science.gov (United States)

Zhu, Hong; Tang, Xinming; Xie, Junfeng; Song, Weidong; Mo, Fan; Gao, Xiaoming

2018-01-01

There are many problems in existing reconstruction-based super-resolution algorithms, such as the lack of texture-feature representation and of high-frequency details. Multi-scale detail enhancement can produce more texture information and high-frequency information. Therefore, super-resolution reconstruction of remote-sensing images based on adaptive multi-scale detail enhancement (AMDE-SR) is proposed in this paper. First, the information entropy of each remote-sensing image is calculated, and the image with the maximum entropy value is regarded as the reference image. Subsequently, spatio-temporal remote-sensing images are processed using phase normalization, which is to reduce the time phase difference of image data and enhance the complementarity of information. The multi-scale image information is then decomposed using the L0 gradient minimization model, and the non-redundant information is processed by difference calculation and expanding non-redundant layers and the redundant layer by the iterative back-projection (IBP) technique. The different-scale non-redundant information is adaptive-weighted and fused using cross-entropy. Finally, a nonlinear texture-detail-enhancement function is built to improve the scope of small details, and the peak signal-to-noise ratio (PSNR) is used as an iterative constraint. Ultimately, high-resolution remote-sensing images with abundant texture information are obtained by iterative optimization. Real results show an average gain in entropy of up to 0.42 dB for an up-scaling of 2 and a significant promotion gain in enhancement measure evaluation for an up-scaling of 2. The experimental results show that the performance of the AMED-SR method is better than existing super-resolution reconstruction methods in terms of visual and accuracy improvements. PMID:29414893

Shedding light on endocytosis with optimized super-resolution microscopy

NARCIS (Netherlands)

Leyton Puig, D.M.

2017-01-01

Super-resolution microscopy is a relatively new microscopy technique that is still under optimization. In this thesis we focus on the improvement of the quality of super-resolution images, to apply them to the study of the processes of cell signaling and endocytosis. First, we show that the use of a

Super-resolution reconstruction in frequency, image, and wavelet domains to reduce through-plane partial voluming in MRI

International Nuclear Information System (INIS)

Gholipour, Ali; Afacan, Onur; Scherrer, Benoit; Prabhu, Sanjay P.; Warfield, Simon K.; Aganj, Iman; Sahin, Mustafa

2015-01-01

Purpose: To compare and evaluate the use of super-resolution reconstruction (SRR), in frequency, image, and wavelet domains, to reduce through-plane partial voluming effects in magnetic resonance imaging. Methods: The reconstruction of an isotropic high-resolution image from multiple thick-slice scans has been investigated through techniques in frequency, image, and wavelet domains. Experiments were carried out with thick-slice T2-weighted fast spin echo sequence on the Academic College of Radiology MRI phantom, where the reconstructed images were compared to a reference high-resolution scan using peak signal-to-noise ratio (PSNR), structural similarity image metric (SSIM), mutual information (MI), and the mean absolute error (MAE) of image intensity profiles. The application of super-resolution reconstruction was then examined in retrospective processing of clinical neuroimages of ten pediatric patients with tuberous sclerosis complex (TSC) to reduce through-plane partial voluming for improved 3D delineation and visualization of thin radial bands of white matter abnormalities. Results: Quantitative evaluation results show improvements in all evaluation metrics through super-resolution reconstruction in the frequency, image, and wavelet domains, with the highest values obtained from SRR in the image domain. The metric values for image-domain SRR versus the original axial, coronal, and sagittal images were PSNR = 32.26 vs 32.22, 32.16, 30.65; SSIM = 0.931 vs 0.922, 0.924, 0.918; MI = 0.871 vs 0.842, 0.844, 0.831; and MAE = 5.38 vs 7.34, 7.06, 6.19. All similarity metrics showed high correlations with expert ranking of image resolution with MI showing the highest correlation at 0.943. Qualitative assessment of the neuroimages of ten TSC patients through in-plane and out-of-plane visualization of structures showed the extent of partial voluming effect in a real clinical scenario and its reduction using SRR. Blinded expert evaluation of image resolution in

Super-resolution reconstruction in frequency, image, and wavelet domains to reduce through-plane partial voluming in MRI

Energy Technology Data Exchange (ETDEWEB)

Gholipour, Ali, E-mail: ali.gholipour@childrens.harvard.edu; Afacan, Onur; Scherrer, Benoit; Prabhu, Sanjay P.; Warfield, Simon K. [Department of Radiology, Boston Children’s Hospital, Boston, Massachusetts 02115 and Harvard Medical School, Boston, Massachusetts 02115 (United States); Aganj, Iman [Radiology Department, Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, Massachusetts 02129 and Harvard Medical School, Boston, Massachusetts 02115 (United States); Sahin, Mustafa [Department of Neurology, Boston Children’s Hospital, Boston, Massachusetts 02115 and Harvard Medical School, Boston, Massachusetts 02115 (United States)

2015-12-15

Purpose: To compare and evaluate the use of super-resolution reconstruction (SRR), in frequency, image, and wavelet domains, to reduce through-plane partial voluming effects in magnetic resonance imaging. Methods: The reconstruction of an isotropic high-resolution image from multiple thick-slice scans has been investigated through techniques in frequency, image, and wavelet domains. Experiments were carried out with thick-slice T2-weighted fast spin echo sequence on the Academic College of Radiology MRI phantom, where the reconstructed images were compared to a reference high-resolution scan using peak signal-to-noise ratio (PSNR), structural similarity image metric (SSIM), mutual information (MI), and the mean absolute error (MAE) of image intensity profiles. The application of super-resolution reconstruction was then examined in retrospective processing of clinical neuroimages of ten pediatric patients with tuberous sclerosis complex (TSC) to reduce through-plane partial voluming for improved 3D delineation and visualization of thin radial bands of white matter abnormalities. Results: Quantitative evaluation results show improvements in all evaluation metrics through super-resolution reconstruction in the frequency, image, and wavelet domains, with the highest values obtained from SRR in the image domain. The metric values for image-domain SRR versus the original axial, coronal, and sagittal images were PSNR = 32.26 vs 32.22, 32.16, 30.65; SSIM = 0.931 vs 0.922, 0.924, 0.918; MI = 0.871 vs 0.842, 0.844, 0.831; and MAE = 5.38 vs 7.34, 7.06, 6.19. All similarity metrics showed high correlations with expert ranking of image resolution with MI showing the highest correlation at 0.943. Qualitative assessment of the neuroimages of ten TSC patients through in-plane and out-of-plane visualization of structures showed the extent of partial voluming effect in a real clinical scenario and its reduction using SRR. Blinded expert evaluation of image resolution in

High-resolution and super stacking of time-reversal mirrors in locating seismic sources

KAUST Repository

Cao, Weiping

2011-07-08

Time reversal mirrors can be used to backpropagate and refocus incident wavefields to their actual source location, with the subsequent benefits of imaging with high-resolution and super-stacking properties. These benefits of time reversal mirrors have been previously verified with computer simulations and laboratory experiments but not with exploration-scale seismic data. We now demonstrate the high-resolution and the super-stacking properties in locating seismic sources with field seismic data that include multiple scattering. Tests on both synthetic data and field data show that a time reversal mirror has the potential to exceed the Rayleigh resolution limit by factors of 4 or more. Results also show that a time reversal mirror has a significant resilience to strong Gaussian noise and that accurate imaging of source locations from passive seismic data can be accomplished with traces having signal-to-noise ratios as low as 0.001. Synthetic tests also demonstrate that time reversal mirrors can sometimes enhance the signal by a factor proportional to the square root of the product of the number of traces, denoted as N and the number of events in the traces. This enhancement property is denoted as super-stacking and greatly exceeds the classical signal-to-noise enhancement factor of. High-resolution and super-stacking are properties also enjoyed by seismic interferometry and reverse-time migration with the exact velocity model. © 2011 European Association of Geoscientists & Engineers.

Low-Cost Super-Resolution Algorithms Implementation Over a HW/SW Video Compression Platform

Directory of Open Access Journals (Sweden)

Llopis Rafael Peset

2006-01-01

Full Text Available Two approaches are presented in this paper to improve the quality of digital images over the sensor resolution using super-resolution techniques: iterative super-resolution (ISR and noniterative super-resolution (NISR algorithms. The results show important improvements in the image quality, assuming that sufficient sample data and a reasonable amount of aliasing are available at the input images. These super-resolution algorithms have been implemented over a codesign video compression platform developed by Philips Research, performing minimal changes on the overall hardware architecture. In this way, a novel and feasible low-cost implementation has been obtained by using the resources encountered in a generic hybrid video encoder. Although a specific video codec platform has been used, the methodology presented in this paper is easily extendable to any other video encoder architectures. Finally a comparison in terms of memory, computational load, and image quality for both algorithms, as well as some general statements about the final impact of the sampling process on the quality of the super-resolved (SR image, are also presented.

Fourier-transform ghost imaging with pure far-field correlated thermal light

International Nuclear Information System (INIS)

Liu Honglin; Shen Xia; Han Shensheng; Zhu Daming

2007-01-01

Pure far-field correlated thermal light beams are created with phase grating, and Fourier-transform ghost imaging depending only on the far-field correlation is demonstrated experimentally. Theoretical analysis and the results of experimental investigation of this pure far-field correlated thermal light are presented. Applications which may be exploited with this imaging scheme are discussed

A Fast Algorithm for Image Super-Resolution from Blurred Observations

Directory of Open Access Journals (Sweden)

Ng Michael K

2006-01-01

Full Text Available We study the problem of reconstruction of a high-resolution image from several blurred low-resolution image frames. The image frames consist of blurred, decimated, and noisy versions of a high-resolution image. The high-resolution image is modeled as a Markov random field (MRF, and a maximum a posteriori (MAP estimation technique is used for the restoration. We show that with the periodic boundary condition, a high-resolution image can be restored efficiently by using fast Fourier transforms. We also apply the preconditioned conjugate gradient method to restore high-resolution images in the aperiodic boundary condition. Computer simulations are given to illustrate the effectiveness of the proposed approach.

Single Image Super-Resolution Using Global Regression Based on Multiple Local Linear Mappings.

Science.gov (United States)

Choi, Jae-Seok; Kim, Munchurl

2017-03-01

Super-resolution (SR) has become more vital, because of its capability to generate high-quality ultra-high definition (UHD) high-resolution (HR) images from low-resolution (LR) input images. Conventional SR methods entail high computational complexity, which makes them difficult to be implemented for up-scaling of full-high-definition input images into UHD-resolution images. Nevertheless, our previous super-interpolation (SI) method showed a good compromise between Peak-Signal-to-Noise Ratio (PSNR) performances and computational complexity. However, since SI only utilizes simple linear mappings, it may fail to precisely reconstruct HR patches with complex texture. In this paper, we present a novel SR method, which inherits the large-to-small patch conversion scheme from SI but uses global regression based on local linear mappings (GLM). Thus, our new SR method is called GLM-SI. In GLM-SI, each LR input patch is divided into 25 overlapped subpatches. Next, based on the local properties of these subpatches, 25 different local linear mappings are applied to the current LR input patch to generate 25 HR patch candidates, which are then regressed into one final HR patch using a global regressor. The local linear mappings are learned cluster-wise in our off-line training phase. The main contribution of this paper is as follows: Previously, linear-mapping-based conventional SR methods, including SI only used one simple yet coarse linear mapping to each patch to reconstruct its HR version. On the contrary, for each LR input patch, our GLM-SI is the first to apply a combination of multiple local linear mappings, where each local linear mapping is found according to local properties of the current LR patch. Therefore, it can better approximate nonlinear LR-to-HR mappings for HR patches with complex texture. Experiment results show that the proposed GLM-SI method outperforms most of the state-of-the-art methods, and shows comparable PSNR performance with much lower

Multi-frame super-resolution with quality self-assessment for retinal fundus videos.

Science.gov (United States)

Köhler, Thomas; Brost, Alexander; Mogalle, Katja; Zhang, Qianyi; Köhler, Christiane; Michelson, Georg; Hornegger, Joachim; Tornow, Ralf P

2014-01-01

This paper proposes a novel super-resolution framework to reconstruct high-resolution fundus images from multiple low-resolution video frames in retinal fundus imaging. Natural eye movements during an examination are used as a cue for super-resolution in a robust maximum a-posteriori scheme. In order to compensate heterogeneous illumination on the fundus, we integrate retrospective illumination correction for photometric registration to the underlying imaging model. Our method utilizes quality self-assessment to provide objective quality scores for reconstructed images as well as to select regularization parameters automatically. In our evaluation on real data acquired from six human subjects with a low-cost video camera, the proposed method achieved considerable enhancements of low-resolution frames and improved noise and sharpness characteristics by 74%. In terms of image analysis, we demonstrate the importance of our method for the improvement of automatic blood vessel segmentation as an example application, where the sensitivity was increased by 13% using super-resolution reconstruction.

Simultaneous super-resolution and blind deconvolution

International Nuclear Information System (INIS)

Sroubek, F; Flusser, J; Cristobal, G

2008-01-01

In many real applications, blur in input low-resolution images is a nuisance, which prevents traditional super-resolution methods from working correctly. This paper presents a unifying approach to the blind deconvolution and superresolution problem of multiple degraded low-resolution frames of the original scene. We introduce a method which assumes no prior information about the shape of degradation blurs and which is properly defined for any rational (fractional) resolution factor. The method minimizes a regularized energy function with respect to the high-resolution image and blurs, where regularization is carried out in both the image and blur domains. The blur regularization is based on a generalized multichannel blind deconvolution constraint. Experiments on real data illustrate robustness and utilization of the method

Single image super-resolution based on approximated Heaviside functions and iterative refinement

Science.gov (United States)

Wang, Xin-Yu; Huang, Ting-Zhu; Deng, Liang-Jian

2018-01-01

One method of solving the single-image super-resolution problem is to use Heaviside functions. This has been done previously by making a binary classification of image components as “smooth” and “non-smooth”, describing these with approximated Heaviside functions (AHFs), and iteration including l1 regularization. We now introduce a new method in which the binary classification of image components is extended to different degrees of smoothness and non-smoothness, these components being represented by various classes of AHFs. Taking into account the sparsity of the non-smooth components, their coefficients are l1 regularized. In addition, to pick up more image details, the new method uses an iterative refinement for the residuals between the original low-resolution input and the downsampled resulting image. Experimental results showed that the new method is superior to the original AHF method and to four other published methods. PMID:29329298

Hyperspectral Super-Resolution of Locally Low Rank Images From Complementary Multisource Data.

Science.gov (United States)

Veganzones, Miguel A; Simoes, Miguel; Licciardi, Giorgio; Yokoya, Naoto; Bioucas-Dias, Jose M; Chanussot, Jocelyn

2016-01-01

Remote sensing hyperspectral images (HSIs) are quite often low rank, in the sense that the data belong to a low dimensional subspace/manifold. This has been recently exploited for the fusion of low spatial resolution HSI with high spatial resolution multispectral images in order to obtain super-resolution HSI. Most approaches adopt an unmixing or a matrix factorization perspective. The derived methods have led to state-of-the-art results when the spectral information lies in a low-dimensional subspace/manifold. However, if the subspace/manifold dimensionality spanned by the complete data set is large, i.e., larger than the number of multispectral bands, the performance of these methods mainly decreases because the underlying sparse regression problem is severely ill-posed. In this paper, we propose a local approach to cope with this difficulty. Fundamentally, we exploit the fact that real world HSIs are locally low rank, that is, pixels acquired from a given spatial neighborhood span a very low-dimensional subspace/manifold, i.e., lower or equal than the number of multispectral bands. Thus, we propose to partition the image into patches and solve the data fusion problem independently for each patch. This way, in each patch the subspace/manifold dimensionality is low enough, such that the problem is not ill-posed anymore. We propose two alternative approaches to define the hyperspectral super-resolution through local dictionary learning using endmember induction algorithms. We also explore two alternatives to define the local regions, using sliding windows and binary partition trees. The effectiveness of the proposed approaches is illustrated with synthetic and semi real data.

Sparse coded image super-resolution using K-SVD trained dictionary based on regularized orthogonal matching pursuit.

Science.gov (United States)

Sajjad, Muhammad; Mehmood, Irfan; Baik, Sung Wook

2015-01-01

Image super-resolution (SR) plays a vital role in medical imaging that allows a more efficient and effective diagnosis process. Usually, diagnosing is difficult and inaccurate from low-resolution (LR) and noisy images. Resolution enhancement through conventional interpolation methods strongly affects the precision of consequent processing steps, such as segmentation and registration. Therefore, we propose an efficient sparse coded image SR reconstruction technique using a trained dictionary. We apply a simple and efficient regularized version of orthogonal matching pursuit (ROMP) to seek the coefficients of sparse representation. ROMP has the transparency and greediness of OMP and the robustness of the L1-minization that enhance the dictionary learning process to capture feature descriptors such as oriented edges and contours from complex images like brain MRIs. The sparse coding part of the K-SVD dictionary training procedure is modified by substituting OMP with ROMP. The dictionary update stage allows simultaneously updating an arbitrary number of atoms and vectors of sparse coefficients. In SR reconstruction, ROMP is used to determine the vector of sparse coefficients for the underlying patch. The recovered representations are then applied to the trained dictionary, and finally, an optimization leads to high-resolution output of high-quality. Experimental results demonstrate that the super-resolution reconstruction quality of the proposed scheme is comparatively better than other state-of-the-art schemes.

Synthetic biology's tall order: Reconstruction of 3D, super resolution images of single molecules in real-time

CSIR Research Space (South Africa)

Henriques, R

2010-08-31

Full Text Available -to-use reconstruction software coupled with image acquisition. Here, we present QuickPALM, an Image plugin, enabling real-time reconstruction of 3D super-resolution images during acquisition and drift correction. We illustrate its application by reconstructing Cy5...

Robust Single Image Super-Resolution via Deep Networks With Sparse Prior.

Science.gov (United States)

Liu, Ding; Wang, Zhaowen; Wen, Bihan; Yang, Jianchao; Han, Wei; Huang, Thomas S

2016-07-01

Single image super-resolution (SR) is an ill-posed problem, which tries to recover a high-resolution image from its low-resolution observation. To regularize the solution of the problem, previous methods have focused on designing good priors for natural images, such as sparse representation, or directly learning the priors from a large data set with models, such as deep neural networks. In this paper, we argue that domain expertise from the conventional sparse coding model can be combined with the key ingredients of deep learning to achieve further improved results. We demonstrate that a sparse coding model particularly designed for SR can be incarnated as a neural network with the merit of end-to-end optimization over training data. The network has a cascaded structure, which boosts the SR performance for both fixed and incremental scaling factors. The proposed training and testing schemes can be extended for robust handling of images with additional degradation, such as noise and blurring. A subjective assessment is conducted and analyzed in order to thoroughly evaluate various SR techniques. Our proposed model is tested on a wide range of images, and it significantly outperforms the existing state-of-the-art methods for various scaling factors both quantitatively and perceptually.

Generation of super-resolution stills from video

CSIR Research Space (South Africa)

Duvenhage, B

2014-11-01

Full Text Available plane. If one accurately registers the image of the target on the focal plane to some reference then one can increase the effective sensor pixel density by stacking or appropriately combining the registered images. The super-resolution technique operates...

Time reversal and phase coherent music techniques for super-resolution ultrasound imaging

Science.gov (United States)

Huang, Lianjie; Labyed, Yassin

2018-05-01

Systems and methods for super-resolution ultrasound imaging using a windowed and generalized TR-MUSIC algorithm that divides the imaging region into overlapping sub-regions and applies the TR-MUSIC algorithm to the windowed backscattered ultrasound signals corresponding to each sub-region. The algorithm is also structured to account for the ultrasound attenuation in the medium and the finite-size effects of ultrasound transducer elements. A modified TR-MUSIC imaging algorithm is used to account for ultrasound scattering from both density and compressibility contrasts. The phase response of ultrasound transducer elements is accounted for in a PC-MUSIC system.

Target-oriented retrieval of subsurface wave fields - Pushing the resolution limits in seismic imaging

Science.gov (United States)

Vasconcelos, Ivan; Ozmen, Neslihan; van der Neut, Joost; Cui, Tianci

2017-04-01

Travelling wide-bandwidth seismic waves have long been used as a primary tool in exploration seismology because they can probe the subsurface over large distances, while retaining relatively high spatial resolution. The well-known Born resolution limit often seems to be the lower bound on spatial imaging resolution in real life examples. In practice, data acquisition cost, time constraints and other factors can worsen the resolution achieved by wavefield imaging. Could we obtain images whose resolution beats the Born limits? Would it be practical to achieve it, and what are we missing today to achieve this? In this talk, we will cover aspects of linear and nonlinear seismic imaging to understand elements that play a role in obtaining "super-resolved" seismic images. New redatuming techniques, such as the Marchenko method, enable the retrieval of subsurface fields that include multiple scattering interactions, while requiring relatively little knowledge of model parameters. Together with new concepts in imaging, such as Target-Enclosing Extended Images, these new redatuming methods enable new targeted imaging frameworks. We will make a case as to why target-oriented approaches to reconstructing subsurface-domain wavefields from surface data may help in increasing the resolving power of seismic imaging, and in pushing the limits on parameter estimation. We will illustrate this using a field data example. Finally, we will draw connections between seismic and other imaging modalities, and discuss how this framework could be put to use in other applications

Exploring sex differences in the adult zebra finch brain: In vivo diffusion tensor imaging and ex vivo super-resolution track density imaging.

Science.gov (United States)

Hamaide, Julie; De Groof, Geert; Van Steenkiste, Gwendolyn; Jeurissen, Ben; Van Audekerke, Johan; Naeyaert, Maarten; Van Ruijssevelt, Lisbeth; Cornil, Charlotte; Sijbers, Jan; Verhoye, Marleen; Van der Linden, Annemie

2017-02-01

Zebra finches are an excellent model to study the process of vocal learning, a complex socially-learned tool of communication that forms the basis of spoken human language. So far, structural investigation of the zebra finch brain has been performed ex vivo using invasive methods such as histology. These methods are highly specific, however, they strongly interfere with performing whole-brain analyses and exclude longitudinal studies aimed at establishing causal correlations between neuroplastic events and specific behavioral performances. Therefore, the aim of the current study was to implement an in vivo Diffusion Tensor Imaging (DTI) protocol sensitive enough to detect structural sex differences in the adult zebra finch brain. Voxel-wise comparison of male and female DTI parameter maps shows clear differences in several components of the song control system (i.e. Area X surroundings, the high vocal center (HVC) and the lateral magnocellular nucleus of the anterior nidopallium (LMAN)), which corroborate previous findings and are in line with the clear behavioral difference as only males sing. Furthermore, to obtain additional insights into the 3-dimensional organization of the zebra finch brain and clarify findings obtained by the in vivo study, ex vivo DTI data of the male and female brain were acquired as well, using a recently established super-resolution reconstruction (SRR) imaging strategy. Interestingly, the SRR-DTI approach led to a marked reduction in acquisition time without interfering with the (spatial and angular) resolution and SNR which enabled to acquire a data set characterized by a 78μm isotropic resolution including 90 diffusion gradient directions within 44h of scanning time. Based on the reconstructed SRR-DTI maps, whole brain probabilistic Track Density Imaging (TDI) was performed for the purpose of super resolved track density imaging, further pushing the resolution up to 40μm isotropic. The DTI and TDI maps realized atlas

Towards breaking the spatial resolution barriers: An optical flow and super-resolution approach for sea ice motion estimation

Science.gov (United States)

Petrou, Zisis I.; Xian, Yang; Tian, YingLi

2018-04-01

Estimation of sea ice motion at fine scales is important for a number of regional and local level applications, including modeling of sea ice distribution, ocean-atmosphere and climate dynamics, as well as safe navigation and sea operations. In this study, we propose an optical flow and super-resolution approach to accurately estimate motion from remote sensing images at a higher spatial resolution than the original data. First, an external example learning-based super-resolution method is applied on the original images to generate higher resolution versions. Then, an optical flow approach is applied on the higher resolution images, identifying sparse correspondences and interpolating them to extract a dense motion vector field with continuous values and subpixel accuracies. Our proposed approach is successfully evaluated on passive microwave, optical, and Synthetic Aperture Radar data, proving appropriate for multi-sensor applications and different spatial resolutions. The approach estimates motion with similar or higher accuracy than the original data, while increasing the spatial resolution of up to eight times. In addition, the adopted optical flow component outperforms a state-of-the-art pattern matching method. Overall, the proposed approach results in accurate motion vectors with unprecedented spatial resolutions of up to 1.5 km for passive microwave data covering the entire Arctic and 20 m for radar data, and proves promising for numerous scientific and operational applications.

Super-resolution fluorescence imaging of nanoimprinted polymer patterns by selective fluorophore adsorption combined with redox switching

KAUST Repository

Yabiku, Y.; Kubo, S.; Nakagawa, M.; Vacha, M.; Habuchi, Satoshi

2013-01-01

We applied a super-resolution fluorescence imaging based on selective adsorption and redox switching of the fluorescent dye molecules for studying polymer nanostructures. We demonstrate that nano-scale structures of polymer thin films can

Solid-immersion fluorescence microscopy with increased emission and super resolution

Energy Technology Data Exchange (ETDEWEB)

Liau, Z. L.; Porter, J. M. [Lincoln Laboratory, Massachusetts Institute of Technology, Lexington, Massachusetts 02420 (United States); Liau, A. A.; Chen, J. J. [Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139 (United States); Salmon, W. C. [Whitehead Institute, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139 (United States); Sheu, S. S. [Department of Medicine, Jefferson Medical College, Philadelphia, Pennsylvania 19107 (United States)

2015-01-07

We investigate solid-immersion fluorescence microscopy suitable for super-resolution nanotechnology and biological imaging, and have observed limit of resolution as small as 15 nm with microspheres, mitochondria, and chromatin fibers. We have further observed that fluorescence efficiency increases with excitation power density, implicating appreciable stimulated emission and increased resolution. We discuss potential advantages of the solid-immersion microscopy, including combined use with previously established super-resolution techniques for reaching deeper beyond the conventional diffraction limit.

Optical super-resolution effect induced by nonlinear characteristics of graphene oxide films

Science.gov (United States)

Zhao, Yong-chuang; Nie, Zhong-quan; Zhai, Ai-ping; Tian, Yan-ting; Liu, Chao; Shi, Chang-kun; Jia, Bao-hua

2018-01-01

In this work, we focus on the optical super-resolution effect induced by strong nonlinear saturation absorption (NSA) of graphene oxide (GO) membranes. The third-order optical nonlinearities are characterized by the canonical Z-scan technique under femtosecond laser (wavelength: 800 nm, pulse width: 100 fs) excitation. Through controlling the applied femtosecond laser energy, NSA of the GO films can be tuned continuously. The GO film is placed at the focal plane as a unique amplitude filter to improve the resolution of the focused field. A multi-layer system model is proposed to present the generation of a deep sub-wavelength spot associated with the nonlinearity of GO films. Moreover, the parameter conditions to achieve the best resolution (˜λ/6) are determined entirely. The demonstrated results here are useful for high density optical recoding and storage, nanolithography, and super-resolution optical imaging.

Under the Microscope: Single-Domain Antibodies for Live-Cell Imaging and Super-Resolution Microscopy

OpenAIRE

Traenkle, Bjoern; Rothbauer, Ulrich

2017-01-01

Single-domain antibodies (sdAbs) have substantially expanded the possibilities of advanced cellular imaging such as live-cell or super-resolution microscopy to visualize cellular antigens and their dynamics. In addition to their unique properties including small size, high stability, and solubility in many environments, sdAbs can be efficiently functionalized according to the needs of the respective imaging approach. Genetically encoded intrabodies fused to fluorescent proteins (chromobodies)...

3D single-molecule super-resolution microscopy with a tilted light sheet.

Science.gov (United States)

Gustavsson, Anna-Karin; Petrov, Petar N; Lee, Maurice Y; Shechtman, Yoav; Moerner, W E

2018-01-09

Tilted light sheet microscopy with 3D point spread functions (TILT3D) combines a novel, tilted light sheet illumination strategy with long axial range point spread functions (PSFs) for low-background, 3D super-localization of single molecules as well as 3D super-resolution imaging in thick cells. Because the axial positions of the single emitters are encoded in the shape of each single-molecule image rather than in the position or thickness of the light sheet, the light sheet need not be extremely thin. TILT3D is built upon a standard inverted microscope and has minimal custom parts. The result is simple and flexible 3D super-resolution imaging with tens of nm localization precision throughout thick mammalian cells. We validate TILT3D for 3D super-resolution imaging in mammalian cells by imaging mitochondria and the full nuclear lamina using the double-helix PSF for single-molecule detection and the recently developed tetrapod PSFs for fiducial bead tracking and live axial drift correction.

Triple-color super-resolution imaging of live cells: resolving submicroscopic receptor organization in the plasma membrane.

Science.gov (United States)

Wilmes, Stephan; Staufenbiel, Markus; Lisse, Domenik; Richter, Christian P; Beutel, Oliver; Busch, Karin B; Hess, Samuel T; Piehler, Jacob

2012-05-14

In living color: efficient intracellular covalent labeling of proteins with a photoswitchable dye using the HaloTag for dSTORM super-resolution imaging in live cells is described. The dynamics of cellular nanostructures at the plasma membrane were monitored with a time resolution of a few seconds. In combination with dual-color FPALM imaging, submicroscopic receptor organization within the context of the membrane skeleton was resolved. Copyright © 2012 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Image quality assessment for selfies with and without super resolution

Science.gov (United States)

Kubota, Aya; Gohshi, Seiichi

2018-04-01

With the advent of cellphone cameras, in particular, on smartphones, many people now take photos of themselves alone and with others in the frame; such photos are popularly known as "selfies". Most smartphones are equipped with two cameras: the front-facing and rear cameras. The camera located on the back of the smartphone is referred to as the "out-camera," whereas the one located on the front of the smartphone is called the "in-camera." In-cameras are mainly used for selfies. Some smartphones feature high-resolution cameras. However, the original image quality cannot be obtained because smartphone cameras often have low-performance lenses. Super resolution (SR) is one of the recent technological advancements that has increased image resolution. We developed a new SR technology that can be processed on smartphones. Smartphones with new SR technology are currently available in the market have already registered sales. However, the effective use of new SR technology has not yet been verified. Comparing the image quality with and without SR on smartphone display is necessary to confirm the usefulness of this new technology. Methods that are based on objective and subjective assessments are required to quantitatively measure image quality. It is known that the typical object assessment value, such as Peak Signal to Noise Ratio (PSNR), does not go together with how we feel when we assess image/video. When digital broadcast started, the standard was determined using subjective assessment. Although subjective assessment usually comes at high cost because of personnel expenses for observers, the results are highly reproducible when they are conducted under right conditions and statistical analysis. In this study, the subjective assessment results for selfie images are reported.

Comparison between beamforming and super resolution imaging algorithms for non-destructive evaluation

Energy Technology Data Exchange (ETDEWEB)

Fan, Chengguang [College of Mechatronic Engineering and Automation, National University of Defense Technology, Changsha 410073, PR China and Department of Mechanical Engineering, University of Bristol, Queen' s Building, University Walk, Bristol BS8 1TR (United Kingdom); Drinkwater, Bruce W. [Department of Mechanical Engineering, University of Bristol, Queen' s Building, University Walk, Bristol BS8 1TR (United Kingdom)

2014-02-18

In this paper the performance of total focusing method is compared with the widely used time-reversal MUSIC super resolution technique. The algorithms are tested with simulated and experimental ultrasonic array data, each containing different noise levels. The simulated time domain signals allow the effects of array geometry, frequency, scatterer location, scatterer size, scatterer separation and random noise to be carefully controlled. The performance of the imaging algorithms is evaluated in terms of resolution and sensitivity to random noise. It is shown that for the low noise situation, time-reversal MUSIC provides enhanced lateral resolution when compared to the total focusing method. However, for higher noise levels, the total focusing method shows robustness, whilst the performance of time-reversal MUSIC is significantly degraded.

Comparison between beamforming and super resolution imaging algorithms for non-destructive evaluation

International Nuclear Information System (INIS)

Fan, Chengguang; Drinkwater, Bruce W.

2014-01-01

In this paper the performance of total focusing method is compared with the widely used time-reversal MUSIC super resolution technique. The algorithms are tested with simulated and experimental ultrasonic array data, each containing different noise levels. The simulated time domain signals allow the effects of array geometry, frequency, scatterer location, scatterer size, scatterer separation and random noise to be carefully controlled. The performance of the imaging algorithms is evaluated in terms of resolution and sensitivity to random noise. It is shown that for the low noise situation, time-reversal MUSIC provides enhanced lateral resolution when compared to the total focusing method. However, for higher noise levels, the total focusing method shows robustness, whilst the performance of time-reversal MUSIC is significantly degraded

Super-resolution reconstruction of MR image with a novel residual learning network algorithm

Science.gov (United States)

Shi, Jun; Liu, Qingping; Wang, Chaofeng; Zhang, Qi; Ying, Shihui; Xu, Haoyu

2018-04-01

Spatial resolution is one of the key parameters of magnetic resonance imaging (MRI). The image super-resolution (SR) technique offers an alternative approach to improve the spatial resolution of MRI due to its simplicity. Convolutional neural networks (CNN)-based SR algorithms have achieved state-of-the-art performance, in which the global residual learning (GRL) strategy is now commonly used due to its effectiveness for learning image details for SR. However, the partial loss of image details usually happens in a very deep network due to the degradation problem. In this work, we propose a novel residual learning-based SR algorithm for MRI, which combines both multi-scale GRL and shallow network block-based local residual learning (LRL). The proposed LRL module works effectively in capturing high-frequency details by learning local residuals. One simulated MRI dataset and two real MRI datasets have been used to evaluate our algorithm. The experimental results show that the proposed SR algorithm achieves superior performance to all of the other compared CNN-based SR algorithms in this work.

Super-resolution for a point source better than λ/500 using positive refraction

Science.gov (United States)

Miñano, Juan C.; Marqués, Ricardo; González, Juan C.; Benítez, Pablo; Delgado, Vicente; Grabovickic, Dejan; Freire, Manuel

2011-12-01

Leonhardt (2009 New J. Phys. 11 093040) demonstrated that the two-dimensional (2D) Maxwell fish eye (MFE) lens can focus perfectly 2D Helmholtz waves of arbitrary frequency; that is, it can transport perfectly an outward (monopole) 2D Helmholtz wave field, generated by a point source, towards a ‘perfect point drain’ located at the corresponding image point. Moreover, a prototype with λ/5 super-resolution property for one microwave frequency has been manufactured and tested (Ma et al 2010 arXiv:1007.2530v1; Ma et al 2010 New J. Phys. 13 033016). However, neither software simulations nor experimental measurements for a broad band of frequencies have yet been reported. Here, we present steady-state simulations with a non-perfect drain for a device equivalent to the MFE, called the spherical geodesic waveguide (SGW), which predicts up to λ/500 super-resolution close to discrete frequencies. Out of these frequencies, the SGW does not show super-resolution in the analysis carried out.

Super-resolution for a point source better than λ/500 using positive refraction

International Nuclear Information System (INIS)

Miñano, Juan C; González, Juan C; Benítez, Pablo; Grabovickic, Dejan; Marqués, Ricardo; Delgado, Vicente; Freire, Manuel

2011-01-01

Leonhardt (2009 New J. Phys. 11 093040) demonstrated that the two-dimensional (2D) Maxwell fish eye (MFE) lens can focus perfectly 2D Helmholtz waves of arbitrary frequency; that is, it can transport perfectly an outward (monopole) 2D Helmholtz wave field, generated by a point source, towards a ‘perfect point drain’ located at the corresponding image point. Moreover, a prototype with λ/5 super-resolution property for one microwave frequency has been manufactured and tested (Ma et al 2010 arXiv:1007.2530v1; Ma et al 2010 New J. Phys. 13 033016). However, neither software simulations nor experimental measurements for a broad band of frequencies have yet been reported. Here, we present steady-state simulations with a non-perfect drain for a device equivalent to the MFE, called the spherical geodesic waveguide (SGW), which predicts up to λ/500 super-resolution close to discrete frequencies. Out of these frequencies, the SGW does not show super-resolution in the analysis carried out. (paper)

Fluorescent Nanodiamond: A Versatile Tool for Long-Term Cell Tracking, Super-Resolution Imaging, and Nanoscale Temperature Sensing.

Science.gov (United States)

Hsiao, Wesley Wei-Wen; Hui, Yuen Yung; Tsai, Pei-Chang; Chang, Huan-Cheng

2016-03-15

Fluorescent nanodiamond (FND) has recently played a central role in fueling new discoveries in interdisciplinary fields spanning biology, chemistry, physics, and materials sciences. The nanoparticle is unique in that it contains a high density ensemble of negatively charged nitrogen-vacancy (NV(-)) centers as built-in fluorophores. The center possesses a number of outstanding optical and magnetic properties. First, NV(-) has an absorption maximum at ∼550 nm, and when exposed to green-orange light, it emits bright fluorescence at ∼700 nm with a lifetime of longer than 10 ns. These spectroscopic properties are little affected by surface modification but are distinctly different from those of cell autofluorescence and thus enable background-free imaging of FNDs in tissue sections. Such characteristics together with its excellent biocompatibility render FND ideal for long-term cell tracking applications, particularly in stem cell research. Next, as an artificial atom in the solid state, the NV(-) center is perfectly photostable, without photobleaching and blinking. Therefore, the NV-containing FND is suitable as a contrast agent for super-resolution imaging by stimulated emission depletion (STED). An improvement of the spatial resolution by 20-fold is readily achievable by using a high-power STED laser to deplete the NV(-) fluorescence. Such improvement is crucial in revealing the detailed structures of biological complexes and assemblies, including cellular organelles and subcellular compartments. Further enhancement of the resolution for live cell imaging is possible by manipulating the charge states of the NV centers. As the "brightest" member of the nanocarbon family, FND holds great promise and potential for bioimaging with unprecedented resolution and precision. Lastly, the NV(-) center in diamond is an atom-like quantum system with a total electron spin of 1. The ground states of the spins show a crystal field splitting of 2.87 GHz, separating the ms = 0 and

Single image super-resolution based on compressive sensing and improved TV minimization sparse recovery

Science.gov (United States)

Vishnukumar, S.; Wilscy, M.

2017-12-01

In this paper, we propose a single image Super-Resolution (SR) method based on Compressive Sensing (CS) and Improved Total Variation (TV) Minimization Sparse Recovery. In the CS framework, low-resolution (LR) image is treated as the compressed version of high-resolution (HR) image. Dictionary Training and Sparse Recovery are the two phases of the method. K-Singular Value Decomposition (K-SVD) method is used for dictionary training and the dictionary represents HR image patches in a sparse manner. Here, only the interpolated version of the LR image is used for training purpose and thereby the structural self similarity inherent in the LR image is exploited. In the sparse recovery phase the sparse representation coefficients with respect to the trained dictionary for LR image patches are derived using Improved TV Minimization method. HR image can be reconstructed by the linear combination of the dictionary and the sparse coefficients. The experimental results show that the proposed method gives better results quantitatively as well as qualitatively on both natural and remote sensing images. The reconstructed images have better visual quality since edges and other sharp details are preserved.

Polarization-Dependent Quasi-Far-Field Superfocusing Strategy of Nanoring-Based Plasmonic Lenses.

Science.gov (United States)

Sun, Hao; Zhu, Yechuan; Gao, Bo; Wang, Ping; Yu, Yiting

2017-12-01

The two-dimensional superfocusing of nanoring-based plasmonic lenses (NRPLs) beyond the diffraction limit in the far-field region remains a great challenge at optical wavelengths. In this paper, in addition to the modulation of structural parameters, we investigated the polarization-dependent focusing performance of a NRPL employing the finite-difference time-domain (FDTD) method. By utilizing the state of polarization (SOP) of incident light, we successfully realize the elliptical-, donut-, and circular-shape foci. The minimum full widths at half maximum (FWHMs) of these foci are ~0.32, ~0.34, and ~0.42 λ 0 in the total electric field, respectively, and the depth of focus (DOF) lies in 1.41~1.77 λ 0 . These sub-diffraction-limit foci are well controlled in the quasi-far-field region. The underlying physical mechanism on the focal shift and an effective way to control the focusing position are proposed. Furthermore, in the case of a high numerical aperture, the longitudinal component, which occupies over 80% of the electric-field energy, decides the focusing patterns of the foci. The achieved sub-diffraction-limit focusing can be widely used for many engineering applications, including the super-resolution imaging, particle acceleration, quantum optical information processing, and optical data storage.

Super-resolution fluorescence imaging of nanoimprinted polymer patterns by selective fluorophore adsorption combined with redox switching

KAUST Repository

Yabiku, Y.

2013-10-22

We applied a super-resolution fluorescence imaging based on selective adsorption and redox switching of the fluorescent dye molecules for studying polymer nanostructures. We demonstrate that nano-scale structures of polymer thin films can be visualized with the image resolution better than 80 nm. The method was applied to image 100 nm-wide polymer nanopatterns fabricated by thermal nanoimprinting. The results point to the applicability of the method for evaluating residual polymer thin films and dewetting defect of the polymer resist patterns which are important for the quality control of the fine nanoimprinted patterns. 2013 Author(s).

Super-resolution fluorescence imaging of nanoimprinted polymer patterns by selective fluorophore adsorption combined with redox switching

Directory of Open Access Journals (Sweden)

Yu Yabiku

2013-10-01

Full Text Available We applied a super-resolution fluorescence imaging based on selective adsorption and redox switching of the fluorescent dye molecules for studying polymer nanostructures. We demonstrate that nano-scale structures of polymer thin films can be visualized with the image resolution better than 80 nm. The method was applied to image 100 nm-wide polymer nanopatterns fabricated by thermal nanoimprinting. The results point to the applicability of the method for evaluating residual polymer thin films and dewetting defect of the polymer resist patterns which are important for the quality control of the fine nanoimprinted patterns.

Column ratio mapping: a processing technique for atomic resolution high-angle annular dark-field (HAADF) images.

Science.gov (United States)

Robb, Paul D; Craven, Alan J

2008-12-01

An image processing technique is presented for atomic resolution high-angle annular dark-field (HAADF) images that have been acquired using scanning transmission electron microscopy (STEM). This technique is termed column ratio mapping and involves the automated process of measuring atomic column intensity ratios in high-resolution HAADF images. This technique was developed to provide a fuller analysis of HAADF images than the usual method of drawing single intensity line profiles across a few areas of interest. For instance, column ratio mapping reveals the compositional distribution across the whole HAADF image and allows a statistical analysis and an estimation of errors. This has proven to be a very valuable technique as it can provide a more detailed assessment of the sharpness of interfacial structures from HAADF images. The technique of column ratio mapping is described in terms of a [110]-oriented zinc-blende structured AlAs/GaAs superlattice using the 1 angstroms-scale resolution capability of the aberration-corrected SuperSTEM 1 instrument.

Column ratio mapping: A processing technique for atomic resolution high-angle annular dark-field (HAADF) images

International Nuclear Information System (INIS)

Robb, Paul D.; Craven, Alan J.

2008-01-01

An image processing technique is presented for atomic resolution high-angle annular dark-field (HAADF) images that have been acquired using scanning transmission electron microscopy (STEM). This technique is termed column ratio mapping and involves the automated process of measuring atomic column intensity ratios in high-resolution HAADF images. This technique was developed to provide a fuller analysis of HAADF images than the usual method of drawing single intensity line profiles across a few areas of interest. For instance, column ratio mapping reveals the compositional distribution across the whole HAADF image and allows a statistical analysis and an estimation of errors. This has proven to be a very valuable technique as it can provide a more detailed assessment of the sharpness of interfacial structures from HAADF images. The technique of column ratio mapping is described in terms of a [1 1 0]-oriented zinc-blende structured AlAs/GaAs superlattice using the 1 A-scale resolution capability of the aberration-corrected SuperSTEM 1 instrument.

Super-Resolution for Synthetic Zooming

Directory of Open Access Journals (Sweden)

Li Xin

2006-01-01

Full Text Available Optical zooming is an important feature of imaging systems. In this paper, we investigate a low-cost signal processing alternative to optical zooming—synthetic zooming by super-resolution (SR techniques. Synthetic zooming is achieved by registering a sequence of low-resolution (LR images acquired at varying focal lengths and reconstructing the SR image at a larger focal length or increased spatial resolution. Under the assumptions of constant scene depth and zooming speed, we argue that the motion trajectories of all physical points are related to each other by a unique vanishing point and present a robust technique for estimating its D coordinate. Such a line-geometry-based registration is the foundation of SR for synthetic zooming. We address the issue of data inconsistency arising from the varying focal length of optical lens during the zooming process. To overcome the difficulty of data inconsistency, we propose a two-stage Delaunay-triangulation-based interpolation for fusing the LR image data. We also present a PDE-based nonlinear deblurring to accommodate the blindness and variation of sensor point spread functions. Simulation results with real-world images have verified the effectiveness of the proposed SR techniques for synthetic zooming.

Far-field high resolution effects and manipulating of electromagnetic waves based on transformation optics

Science.gov (United States)

Ji, XueBin; Zang, XiaoFei; Li, Zhou; Shi, Cheng; Chen, Lin; Cai, Bin; Zhu, YiMing

2015-05-01

Based on the transformation optics (TO) and the effective medium theory (EMT), a new illusion media with homogeneous and isotropic materials is proposed to realize the far-field high resolution effects. When two point sources with the separation distance of λ0 / 4 are covered with the illusion media (λ0 is the free-space wavelength), the corresponding far-field pattern is equivalent to the case of two point sources with the separation distance larger than λ0 / 2 in free space, leading to the far-field high resolution effects (in free space, the separation distance of λ0 / 4 is less than half-wavelength, and thus the two point sources cannot be distinguished from each other). Furthermore, such illusion media can be applied to design tunable high-directivity antenna and an angle-dependent floating carpet cloak. Full wave simulations are carried out to verify the performance of our device.

Unraveling the Thousand Word Picture: An Introduction to Super-Resolution Data Analysis.

Science.gov (United States)

Lee, Antony; Tsekouras, Konstantinos; Calderon, Christopher; Bustamante, Carlos; Pressé, Steve

2017-06-14

Super-resolution microscopy provides direct insight into fundamental biological processes occurring at length scales smaller than light's diffraction limit. The analysis of data at such scales has brought statistical and machine learning methods into the mainstream. Here we provide a survey of data analysis methods starting from an overview of basic statistical techniques underlying the analysis of super-resolution and, more broadly, imaging data. We subsequently break down the analysis of super-resolution data into four problems: the localization problem, the counting problem, the linking problem, and what we've termed the interpretation problem.

Imaging cellular structures in super-resolution with SIM, STED and Localisation Microscopy: A practical comparison.

Science.gov (United States)

Wegel, Eva; Göhler, Antonia; Lagerholm, B Christoffer; Wainman, Alan; Uphoff, Stephan; Kaufmann, Rainer; Dobbie, Ian M

2016-06-06

Many biological questions require fluorescence microscopy with a resolution beyond the diffraction limit of light. Super-resolution methods such as Structured Illumination Microscopy (SIM), STimulated Emission Depletion (STED) microscopy and Single Molecule Localisation Microscopy (SMLM) enable an increase in image resolution beyond the classical diffraction-limit. Here, we compare the individual strengths and weaknesses of each technique by imaging a variety of different subcellular structures in fixed cells. We chose examples ranging from well separated vesicles to densely packed three dimensional filaments. We used quantitative and correlative analyses to assess the performance of SIM, STED and SMLM with the aim of establishing a rough guideline regarding the suitability for typical applications and to highlight pitfalls associated with the different techniques.

Far-field superresolution by imaging of resonance scattering

KAUST Repository

Schuster, Gerard T.; Huang, Y.

2014-01-01

We show that superresolution imaging in the far-field region of the sources and receivers is theoretically and practically possible if migration of resonant multiples is employed. A resonant multiple is one that bounces back and forth between two

CINCH (confocal incoherent correlation holography) super resolution fluorescence microscopy based upon FINCH (Fresnel incoherent correlation holography).

Science.gov (United States)

Siegel, Nisan; Storrie, Brian; Bruce, Marc; Brooker, Gary

2015-02-07

FINCH holographic fluorescence microscopy creates high resolution super-resolved images with enhanced depth of focus. The simple addition of a real-time Nipkow disk confocal image scanner in a conjugate plane of this incoherent holographic system is shown to reduce the depth of focus, and the combination of both techniques provides a simple way to enhance the axial resolution of FINCH in a combined method called "CINCH". An important feature of the combined system allows for the simultaneous real-time image capture of widefield and holographic images or confocal and confocal holographic images for ready comparison of each method on the exact same field of view. Additional GPU based complex deconvolution processing of the images further enhances resolution.

Projections onto Convex Sets Super-Resolution Reconstruction Based on Point Spread Function Estimation of Low-Resolution Remote Sensing Images

Directory of Open Access Journals (Sweden)

Chong Fan

2017-02-01

Full Text Available To solve the problem on inaccuracy when estimating the point spread function (PSF of the ideal original image in traditional projection onto convex set (POCS super-resolution (SR reconstruction, this paper presents an improved POCS SR algorithm based on PSF estimation of low-resolution (LR remote sensing images. The proposed algorithm can improve the spatial resolution of the image and benefit agricultural crop visual interpolation. The PSF of the highresolution (HR image is unknown in reality. Therefore, analysis of the relationship between the PSF of the HR image and the PSF of the LR image is important to estimate the PSF of the HR image by using multiple LR images. In this study, the linear relationship between the PSFs of the HR and LR images can be proven. In addition, the novel slant knife-edge method is employed, which can improve the accuracy of the PSF estimation of LR images. Finally, the proposed method is applied to reconstruct airborne digital sensor 40 (ADS40 three-line array images and the overlapped areas of two adjacent GF-2 images by embedding the estimated PSF of the HR image to the original POCS SR algorithm. Experimental results show that the proposed method yields higher quality of reconstructed images than that produced by the blind SR method and the bicubic interpolation method.

Learning from errors in super-resolution.

Science.gov (United States)

Tang, Yi; Yuan, Yuan

2014-11-01

A novel framework of learning-based super-resolution is proposed by employing the process of learning from the estimation errors. The estimation errors generated by different learning-based super-resolution algorithms are statistically shown to be sparse and uncertain. The sparsity of the estimation errors means most of estimation errors are small enough. The uncertainty of the estimation errors means the location of the pixel with larger estimation error is random. Noticing the prior information about the estimation errors, a nonlinear boosting process of learning from these estimation errors is introduced into the general framework of the learning-based super-resolution. Within the novel framework of super-resolution, a low-rank decomposition technique is used to share the information of different super-resolution estimations and to remove the sparse estimation errors from different learning algorithms or training samples. The experimental results show the effectiveness and the efficiency of the proposed framework in enhancing the performance of different learning-based algorithms.

Super-resolution for imagery from integrated microgrid polarimeters.

Science.gov (United States)

Hardie, Russell C; LeMaster, Daniel A; Ratliff, Bradley M

2011-07-04

Imagery from microgrid polarimeters is obtained by using a mosaic of pixel-wise micropolarizers on a focal plane array (FPA). Each distinct polarization image is obtained by subsampling the full FPA image. Thus, the effective pixel pitch for each polarization channel is increased and the sampling frequency is decreased. As a result, aliasing artifacts from such undersampling can corrupt the true polarization content of the scene. Here we present the first multi-channel multi-frame super-resolution (SR) algorithms designed specifically for the problem of image restoration in microgrid polarization imagers. These SR algorithms can be used to address aliasing and other degradations, without sacrificing field of view or compromising optical resolution with an anti-aliasing filter. The new SR methods are designed to exploit correlation between the polarimetric channels. One of the new SR algorithms uses a form of regularized least squares and has an iterative solution. The other is based on the faster adaptive Wiener filter SR method. We demonstrate that the new multi-channel SR algorithms are capable of providing significant enhancement of polarimetric imagery and that they outperform their independent channel counterparts.

High energy near- and far-field ptychographic tomography at the ESRF

Science.gov (United States)

da Silva, Julio C.; Haubrich, Jan; Requena, Guillermo; Hubert, Maxime; Pacureanu, Alexandra; Bloch, Leonid; Yang, Yang; Cloetens, Peter

2017-09-01

In high-resolution tomography, one needs high-resolved projections in order to reconstruct a high-quality 3D map of a sample. X-ray ptychography is a robust technique which can provide such high-resolution 2D projections taking advantage of coherent X-rays. This technique was used in the far-field regime for a fair amount of time, but it can now also be implemented in the near-field regime. In both regimes, the technique enables not only high-resolution imaging, but also high sensitivity to the electron density of the sample. The combination with tomography makes 3D imaging possible via ptychographic X-ray computed tomography (PXCT), which can provide a 3D map of the complex-valued refractive index of the sample. The extension of PXCT to X-ray energies above 15 keV is challenging, but it can allow the imaging of object opaque to lower energy. We present here the implementation and developments of high-energy near- and far-field PXCT at the ESRF.

A super-high angular resolution principle for coded-mask X-ray imaging beyond the diffraction limit of a single pinhole

International Nuclear Information System (INIS)

Zhang Chen; Zhang Shuangnan

2009-01-01

High angular resolution X-ray imaging is always useful in astrophysics and solar physics. In principle, it can be performed by using coded-mask imaging with a very long mask-detector distance. Previously, the diffraction-interference effect was thought to degrade coded-mask imaging performance dramatically at the low energy end with its very long mask-detector distance. The diffraction-interference effect is described with numerical calculations, and the diffraction-interference cross correlation reconstruction method (DICC) is developed in order to overcome the imaging performance degradation. Based on the DICC, a super-high angular resolution principle (SHARP) for coded-mask X-ray imaging is proposed. The feasibility of coded mask imaging beyond the diffraction limit of a single pinhole is demonstrated with simulations. With the specification that the mask element size is 50 x 50 μm 2 and the mask-detector distance is 50 m, the achieved angular resolution is 0.32 arcsec above about 10 keV and 0.36 arcsec at 1.24 keV (λ = 1 nm), where diffraction cannot be neglected. The on-axis source location accuracy is better than 0.02 arcsec. Potential applications for solar observations and wide-field X-ray monitors are also briefly discussed. (invited reviews)

Measuring true localization accuracy in super resolution microscopy with DNA-origami nanostructures

International Nuclear Information System (INIS)

Reuss, Matthias; Blom, Hans; Brismar, Hjalmar; Fördős, Ferenc; Högberg, Björn; Öktem, Ozan

2017-01-01

A common method to assess the performance of (super resolution) microscopes is to use the localization precision of emitters as an estimate for the achieved resolution. Naturally, this is widely used in super resolution methods based on single molecule stochastic switching. This concept suffers from the fact that it is hard to calibrate measures against a real sample (a phantom), because true absolute positions of emitters are almost always unknown. For this reason, resolution estimates are potentially biased in an image since one is blind to true position accuracy, i.e. deviation in position measurement from true positions. We have solved this issue by imaging nanorods fabricated with DNA-origami. The nanorods used are designed to have emitters attached at each end in a well-defined and highly conserved distance. These structures are widely used to gauge localization precision. Here, we additionally determined the true achievable localization accuracy and compared this figure of merit to localization precision values for two common super resolution microscope methods STED and STORM. (paper)

Dark-field hyperlens: Super-resolution imaging of weakly scattering objects

DEFF Research Database (Denmark)

Repän, Taavi; Lavrinenko, Andrei; Zhukovsky, Sergei

2015-01-01

: We propose a device for subwavelength optical imaging based on a metal-dielectric multilayer hyperlens designed in such a way that only large-wavevector (evanescent) waves are transmitted while all propagating (small-wavevector) waves from the object area are blocked by the hyperlens. We...... numerically demonstrate that as the result of such filtering, the image plane only contains scattered light from subwavelength features of the objects and is completely free from background illumination. Similar in spirit to conventional dark-field microscopy, the proposed dark-field hyperlens is shown...

Observation of Eye Pattern on Super-Resolution Near-Field Structure Disk with Write-Strategy Technique

Science.gov (United States)

Fuji, Hiroshi; Kikukawa, Takashi; Tominaga, Junji

2004-07-01

Pit-edge recording at a density of 150 nm pits and spaces is carried out on a super-resolution near-field structure (super-RENS) disk with a platinum oxide layer. Pits are recorded and read using a 635-nm-wavelength laser and an objective lens with a 0.6 numerical aperture. We arrange laser pulses to correctly record the pits on the disk by a write-strategy technique. The laser-pulse figure includes a unit time of 0.25 T and intensities of Pw1, Pw2 and Pw3. After recording pits of various lengths, the observation of an eye pattern is achieved despite a pit smaller than the resolution limit. Furthermore, the eye pattern maintains its shape even though other pits fill the adjacent tracks at a track density of 600 nm. The disk can be used as a pit-edge recording system through a write-strategy technique.

Super-resolution using a light inception layer in convolutional neural network

Science.gov (United States)

Mou, Qinyang; Guo, Jun

2018-04-01

Recently, several models based on CNN architecture have achieved great result on Single Image Super-Resolution (SISR) problem. In this paper, we propose an image super-resolution method (SR) using a light inception layer in convolutional network (LICN). Due to the strong representation ability of our well-designed inception layer that can learn richer representation with less parameters, we can build our model with shallow architecture that can reduce the effect of vanishing gradients problem and save computational costs. Our model strike a balance between computational speed and the quality of the result. Compared with state-of-the-art result, we produce comparable or better results with faster computational speed.

Image super-resolution reconstruction based on regularization technique and guided filter

Science.gov (United States)

Huang, De-tian; Huang, Wei-qin; Gu, Pei-ting; Liu, Pei-zhong; Luo, Yan-min

2017-06-01

In order to improve the accuracy of sparse representation coefficients and the quality of reconstructed images, an improved image super-resolution algorithm based on sparse representation is presented. In the sparse coding stage, the autoregressive (AR) regularization and the non-local (NL) similarity regularization are introduced to improve the sparse coding objective function. A group of AR models which describe the image local structures are pre-learned from the training samples, and one or several suitable AR models can be adaptively selected for each image patch to regularize the solution space. Then, the image non-local redundancy is obtained by the NL similarity regularization to preserve edges. In the process of computing the sparse representation coefficients, the feature-sign search algorithm is utilized instead of the conventional orthogonal matching pursuit algorithm to improve the accuracy of the sparse coefficients. To restore image details further, a global error compensation model based on weighted guided filter is proposed to realize error compensation for the reconstructed images. Experimental results demonstrate that compared with Bicubic, L1SR, SISR, GR, ANR, NE + LS, NE + NNLS, NE + LLE and A + (16 atoms) methods, the proposed approach has remarkable improvement in peak signal-to-noise ratio, structural similarity and subjective visual perception.

Deep Learning- and Transfer Learning-Based Super Resolution Reconstruction from Single Medical Image

Directory of Open Access Journals (Sweden)

YiNan Zhang

2017-01-01

Full Text Available Medical images play an important role in medical diagnosis and research. In this paper, a transfer learning- and deep learning-based super resolution reconstruction method is introduced. The proposed method contains one bicubic interpolation template layer and two convolutional layers. The bicubic interpolation template layer is prefixed by mathematics deduction, and two convolutional layers learn from training samples. For saving training medical images, a SIFT feature-based transfer learning method is proposed. Not only can medical images be used to train the proposed method, but also other types of images can be added into training dataset selectively. In empirical experiments, results of eight distinctive medical images show improvement of image quality and time reduction. Further, the proposed method also produces slightly sharper edges than other deep learning approaches in less time and it is projected that the hybrid architecture of prefixed template layer and unfixed hidden layers has potentials in other applications.

Aberrations and adaptive optics in super-resolution microscopy

Science.gov (United States)

Booth, Martin; Andrade, Débora; Burke, Daniel; Patton, Brian; Zurauskas, Mantas

2015-01-01

As one of the most powerful tools in the biological investigation of cellular structures and dynamic processes, fluorescence microscopy has undergone extraordinary developments in the past decades. The advent of super-resolution techniques has enabled fluorescence microscopy – or rather nanoscopy – to achieve nanoscale resolution in living specimens and unravelled the interior of cells with unprecedented detail. The methods employed in this expanding field of microscopy, however, are especially prone to the detrimental effects of optical aberrations. In this review, we discuss how super-resolution microscopy techniques based upon single-molecule switching, stimulated emission depletion and structured illumination each suffer from aberrations in different ways that are dependent upon intrinsic technical aspects. We discuss the use of adaptive optics as an effective means to overcome this problem. PMID:26124194

Improved Wallis Dodging Algorithm for Large-Scale Super-Resolution Reconstruction Remote Sensing Images

Directory of Open Access Journals (Sweden)

Chong Fan

2017-03-01

Full Text Available A sub-block algorithm is usually applied in the super-resolution (SR reconstruction of images because of limitations in computer memory. However, the sub-block SR images can hardly achieve a seamless image mosaicking because of the uneven distribution of brightness and contrast among these sub-blocks. An effectively improved weighted Wallis dodging algorithm is proposed, aiming at the characteristic that SR reconstructed images are gray images with the same size and overlapping region. This algorithm can achieve consistency of image brightness and contrast. Meanwhile, a weighted adjustment sequence is presented to avoid the spatial propagation and accumulation of errors and the loss of image information caused by excessive computation. A seam line elimination method can share the partial dislocation in the seam line to the entire overlapping region with a smooth transition effect. Subsequently, the improved method is employed to remove the uneven illumination for 900 SR reconstructed images of ZY-3. Then, the overlapping image mosaic method is adopted to accomplish a seamless image mosaic based on the optimal seam line.

TH-EF-BRA-11: Feasibility of Super-Resolution Time-Resolved 4DMRI for Multi-Breath Volumetric Motion Simulation in Radiotherapy Planning

Energy Technology Data Exchange (ETDEWEB)

Li, G; Zakian, K; Deasy, J [Memorial Sloan Kettering Cancer Center, New York, NY (United States); Wei, J [City College of New York, New York, NY (United States); Hunt, M [Mem Sloan-Kettering Cancer Ctr, New York, NY (United States)

2016-06-15

Purpose: To develop a novel super-resolution time-resolved 4DMRI technique to evaluate multi-breath, irregular and complex organ motion without respiratory surrogate for radiotherapy planning. Methods: The super-resolution time-resolved (TR) 4DMRI approach combines a series of low-resolution 3D cine MRI images acquired during free breathing (FB) with a high-resolution breath-hold (BH) 3DMRI via deformable image registration (DIR). Five volunteers participated in the study under an IRB-approved protocol. The 3D cine images with voxel size of 5×5×5 mm{sup 3} at two volumes per second (2Hz) were acquired coronally using a T1 fast field echo sequence, half-scan (0.8) acceleration, and SENSE (3) parallel imaging. Phase-encoding was set in the lateral direction to minimize motion artifacts. The BH image with voxel size of 2×2×2 mm{sup 3} was acquired using the same sequence within 10 seconds. A demons-based DIR program was employed to produce super-resolution 2Hz 4DMRI. Registration quality was visually assessed using difference images between TR 4DMRI and 3D cine and quantitatively assessed using average voxel correlation. The fidelity of the 3D cine images was assessed using a gel phantom and a 1D motion platform by comparing mobile and static images. Results: Owing to voxel intensity similarity using the same MRI scanning sequence, accurate DIR between FB and BH images is achieved. The voxel correlations between 3D cine and TR 4DMRI are greater than 0.92 in all cases and the difference images illustrate minimal residual error with little systematic patterns. The 3D cine images of the mobile gel phantom preserve object geometry with minimal scanning artifacts. Conclusion: The super-resolution time-resolved 4DMRI technique has been achieved via DIR, providing a potential solution for multi-breath motion assessment. Accurate DIR mapping has been achieved to map high-resolution BH images to low-resolution FB images, producing 2Hz volumetric high-resolution 4DMRI

Low drive field amplitude for improved image resolution in magnetic particle imaging.

Science.gov (United States)

Croft, Laura R; Goodwill, Patrick W; Konkle, Justin J; Arami, Hamed; Price, Daniel A; Li, Ada X; Saritas, Emine U; Conolly, Steven M

2016-01-01

Magnetic particle imaging (MPI) is a new imaging technology that directly detects superparamagnetic iron oxide nanoparticles. The technique has potential medical applications in angiography, cell tracking, and cancer detection. In this paper, the authors explore how nanoparticle relaxation affects image resolution. Historically, researchers have analyzed nanoparticle behavior by studying the time constant of the nanoparticle physical rotation. In contrast, in this paper, the authors focus instead on how the time constant of nanoparticle rotation affects the final image resolution, and this reveals nonobvious conclusions for tailoring MPI imaging parameters for optimal spatial resolution. The authors first extend x-space systems theory to include nanoparticle relaxation. The authors then measure the spatial resolution and relative signal levels in an MPI relaxometer and a 3D MPI imager at multiple drive field amplitudes and frequencies. Finally, these image measurements are used to estimate relaxation times and nanoparticle phase lags. The authors demonstrate that spatial resolution, as measured by full-width at half-maximum, improves at lower drive field amplitudes. The authors further determine that relaxation in MPI can be approximated as a frequency-independent phase lag. These results enable the authors to accurately predict MPI resolution and sensitivity across a wide range of drive field amplitudes and frequencies. To balance resolution, signal-to-noise ratio, specific absorption rate, and magnetostimulation requirements, the drive field can be a low amplitude and high frequency. Continued research into how the MPI drive field affects relaxation and its adverse effects will be crucial for developing new nanoparticles tailored to the unique physics of MPI. Moreover, this theory informs researchers how to design scanning sequences to minimize relaxation-induced blurring for better spatial resolution or to exploit relaxation-induced blurring for MPI with

Structural analysis of herpes simplex virus by optical super-resolution imaging

Science.gov (United States)

Laine, Romain F.; Albecka, Anna; van de Linde, Sebastian; Rees, Eric J.; Crump, Colin M.; Kaminski, Clemens F.

2015-01-01

Herpes simplex virus type-1 (HSV-1) is one of the most widespread pathogens among humans. Although the structure of HSV-1 has been extensively investigated, the precise organization of tegument and envelope proteins remains elusive. Here we use super-resolution imaging by direct stochastic optical reconstruction microscopy (dSTORM) in combination with a model-based analysis of single-molecule localization data, to determine the position of protein layers within virus particles. We resolve different protein layers within individual HSV-1 particles using multi-colour dSTORM imaging and discriminate envelope-anchored glycoproteins from tegument proteins, both in purified virions and in virions present in infected cells. Precise characterization of HSV-1 structure was achieved by particle averaging of purified viruses and model-based analysis of the radial distribution of the tegument proteins VP16, VP1/2 and pUL37, and envelope protein gD. From this data, we propose a model of the protein organization inside the tegument.

Deterministic phase measurements exhibiting super-sensitivity and super-resolution

DEFF Research Database (Denmark)

Schäfermeier, Clemens; Ježek, Miroslav; Madsen, Lars S.

2018-01-01

Phase super-sensitivity is obtained when the sensitivity in a phase measurement goes beyond the quantum shot noise limit, whereas super-resolution is obtained when the interference fringes in an interferometer are narrower than half the input wavelength. Here we show experimentally that these two...

Accelerating cross-validation with total variation and its application to super-resolution imaging.

Directory of Open Access Journals (Sweden)

Tomoyuki Obuchi

Full Text Available We develop an approximation formula for the cross-validation error (CVE of a sparse linear regression penalized by ℓ1-norm and total variation terms, which is based on a perturbative expansion utilizing the largeness of both the data dimensionality and the model. The developed formula allows us to reduce the necessary computational cost of the CVE evaluation significantly. The practicality of the formula is tested through application to simulated black-hole image reconstruction on the event-horizon scale with super resolution. The results demonstrate that our approximation reproduces the CVE values obtained via literally conducted cross-validation with reasonably good precision.

Far- and near-field second-harmonic imaging of ferroelectric domain walls

DEFF Research Database (Denmark)

Bozhevolnyi, Sergey I.; Pedersen, K.; Skettrup, Torben

1998-01-01

Domain walls in periodically poled ferroelectric LiNbO3 crystals are observed with both far- and near-field imaging techniques that make use of second harmonic generation in the transition regions between neighbouring domains. Second harmonic images of domain walls represent bright lines of about.......5 micrometers in width (as measured with the near-field microscope) for the polarization of the second harmonic radiation perpendicular to the domain walls. Origin and selection rules for the constrast in second harmonic images of domain walls are discussed....

Effective deep learning training for single-image super-resolution in endomicroscopy exploiting video-registration-based reconstruction.

Science.gov (United States)

Ravì, Daniele; Szczotka, Agnieszka Barbara; Shakir, Dzhoshkun Ismail; Pereira, Stephen P; Vercauteren, Tom

2018-06-01

Probe-based confocal laser endomicroscopy (pCLE) is a recent imaging modality that allows performing in vivo optical biopsies. The design of pCLE hardware, and its reliance on an optical fibre bundle, fundamentally limits the image quality with a few tens of thousands fibres, each acting as the equivalent of a single-pixel detector, assembled into a single fibre bundle. Video registration techniques can be used to estimate high-resolution (HR) images by exploiting the temporal information contained in a sequence of low-resolution (LR) images. However, the alignment of LR frames, required for the fusion, is computationally demanding and prone to artefacts. In this work, we propose a novel synthetic data generation approach to train exemplar-based Deep Neural Networks (DNNs). HR pCLE images with enhanced quality are recovered by the models trained on pairs of estimated HR images (generated by the video registration algorithm) and realistic synthetic LR images. Performance of three different state-of-the-art DNNs techniques were analysed on a Smart Atlas database of 8806 images from 238 pCLE video sequences. The results were validated through an extensive image quality assessment that takes into account different quality scores, including a Mean Opinion Score (MOS). Results indicate that the proposed solution produces an effective improvement in the quality of the obtained reconstructed image. The proposed training strategy and associated DNNs allows us to perform convincing super-resolution of pCLE images.

Super-resolved terahertz microscopy by knife-edge scan

Science.gov (United States)

Giliberti, V.; Flammini, M.; Ciano, C.; Pontecorvo, E.; Del Re, E.; Ortolani, M.

2017-08-01

We present a compact, all solid-state THz confocal microscope operating at 0.30 THz that achieves super-resolution by using the knife-edge scan approach. In the final reconstructed image, a lateral resolution of 60 μm ≍ λ/17 is demonstrated when the knife-edge is deep in the near-field of the sample surface. When the knife-edge is lifted up to λ/4 from the sample surface, a certain degree of super-resolution is maintained with a resolution of 0.4 mm, i.e. more than a factor 2 if compared to the diffraction-limited scheme. The present results open an interesting path towards super-resolved imaging with in-depth information that would be peculiar to THz microscopy systems.

Video Super-Resolution via Bidirectional Recurrent Convolutional Networks.

Science.gov (United States)

Huang, Yan; Wang, Wei; Wang, Liang

2018-04-01

Super resolving a low-resolution video, namely video super-resolution (SR), is usually handled by either single-image SR or multi-frame SR. Single-Image SR deals with each video frame independently, and ignores intrinsic temporal dependency of video frames which actually plays a very important role in video SR. Multi-Frame SR generally extracts motion information, e.g., optical flow, to model the temporal dependency, but often shows high computational cost. Considering that recurrent neural networks (RNNs) can model long-term temporal dependency of video sequences well, we propose a fully convolutional RNN named bidirectional recurrent convolutional network for efficient multi-frame SR. Different from vanilla RNNs, 1) the commonly-used full feedforward and recurrent connections are replaced with weight-sharing convolutional connections. So they can greatly reduce the large number of network parameters and well model the temporal dependency in a finer level, i.e., patch-based rather than frame-based, and 2) connections from input layers at previous timesteps to the current hidden layer are added by 3D feedforward convolutions, which aim to capture discriminate spatio-temporal patterns for short-term fast-varying motions in local adjacent frames. Due to the cheap convolutional operations, our model has a low computational complexity and runs orders of magnitude faster than other multi-frame SR methods. With the powerful temporal dependency modeling, our model can super resolve videos with complex motions and achieve well performance.

From local pixel structure to global image super-resolution: a new face hallucination framework.

Science.gov (United States)

Hu, Yu; Lam, Kin-Man; Qiu, Guoping; Shen, Tingzhi

2011-02-01

We have developed a new face hallucination framework termed from local pixel structure to global image super-resolution (LPS-GIS). Based on the assumption that two similar face images should have similar local pixel structures, the new framework first uses the input low-resolution (LR) face image to search a face database for similar example high-resolution (HR) faces in order to learn the local pixel structures for the target HR face. It then uses the input LR face and the learned pixel structures as priors to estimate the target HR face. We present a three-step implementation procedure for the framework. Step 1 searches the database for K example faces that are the most similar to the input, and then warps the K example images to the input using optical flow. Step 2 uses the warped HR version of the K example faces to learn the local pixel structures for the target HR face. An effective method for learning local pixel structures from an individual face, and an adaptive procedure for fusing the local pixel structures of different example faces to reduce the influence of warping errors, have been developed. Step 3 estimates the target HR face by solving a constrained optimization problem by means of an iterative procedure. Experimental results show that our new method can provide good performances for face hallucination, both in terms of reconstruction error and visual quality; and that it is competitive with existing state-of-the-art methods.

DMD-based LED-illumination super-resolution and optical sectioning microscopy.

Science.gov (United States)

Dan, Dan; Lei, Ming; Yao, Baoli; Wang, Wen; Winterhalder, Martin; Zumbusch, Andreas; Qi, Yujiao; Xia, Liang; Yan, Shaohui; Yang, Yanlong; Gao, Peng; Ye, Tong; Zhao, Wei

2013-01-01

Super-resolution three-dimensional (3D) optical microscopy has incomparable advantages over other high-resolution microscopic technologies, such as electron microscopy and atomic force microscopy, in the study of biological molecules, pathways and events in live cells and tissues. We present a novel approach of structured illumination microscopy (SIM) by using a digital micromirror device (DMD) for fringe projection and a low-coherence LED light for illumination. The lateral resolution of 90 nm and the optical sectioning depth of 120 μm were achieved. The maximum acquisition speed for 3D imaging in the optical sectioning mode was 1.6×10(7) pixels/second, which was mainly limited by the sensitivity and speed of the CCD camera. In contrast to other SIM techniques, the DMD-based LED-illumination SIM is cost-effective, ease of multi-wavelength switchable and speckle-noise-free. The 2D super-resolution and 3D optical sectioning modalities can be easily switched and applied to either fluorescent or non-fluorescent specimens.

SuperAGILE: The hard X-ray imager for the AGILE space mission

International Nuclear Information System (INIS)

Feroci, M.; Costa, E.; Soffitta, P.; Del Monte, E.; Di Persio, G.; Donnarumma, I.; Evangelista, Y.; Frutti, M.; Lapshov, I.; Lazzarotto, F.; Mastropietro, M.; Morelli, E.; Pacciani, L.; Porrovecchio, G.; Rapisarda, M.; Rubini, A.; Tavani, M.; Argan, A.

2007-01-01

SuperAGILE is a coded mask experiment based on silicon microstrip detectors. It operates in the 15-45 keV nominal energy range, providing crossed one-dimensional images of the X-ray sky with an on-axis angular resolution of 6 arcmin, over a field of view in excess of 1 sr. It was designed as the hard X-ray monitor of the AGILE space mission, a small satellite of the Italian Space Agency devoted to image the gamma-ray sky in the 30 MeV-50 GeV energy band. The AGILE mission was launched in a low-earth orbit on 23rd April 2007. In this paper we describe the SuperAGILE experiment, its construction and test processes, and its performance before flight, based on the on-ground test and calibrations

Super-resolution links vinculin localization to function in focal adhesions.

Science.gov (United States)

Giannone, Grégory

2015-07-01

Integrin-based focal adhesions integrate biochemical and biomechanical signals from the extracellular matrix and the actin cytoskeleton. The combination of three-dimensional super-resolution imaging and loss- or gain-of-function protein mutants now links the nanoscale dynamic localization of proteins to their activation and function within focal adhesions.

An Investigation of Influencing Factors on Practical Sub-Diffraction-Limit Focusing of Planar Super-Oscillation Lenses

Directory of Open Access Journals (Sweden)

Yiting Yu

2018-03-01

Full Text Available Planar super-oscillation lenses (SOLs can fulfill super-resolution focusing and nanoscopic imaging in the far field without the contribution of evanescent waves. Nevertheless, the existing deviations between the design and experimental results have been seldomly investigated, leaving the practical applications of SOLs unpredictable and uncontrollable. In this paper, some application-oriented issues are taken into consideration, such as the inevitable fabrication errors and the size effect of the designed SOLs, with the aim of providing an engineering reference to elaborately customize the demanded focusing light field. It turned out that a thicker structural film makes the focal spots enlarged, while the sloped sidewalls just weaken the intensity of the focal hotspot. Furthermore, the focal lengths are diminished with the decrease of device size, while the focal spots are enlarged. This research will promote the wide-spread applications of SOLs for sub-diffraction-limit far-field focusing in the areas of nanoscopy and high-density optical storage.

Restoration and Super-Resolution of Diffraction-Limited Imagery Data by Bayesian and Set-Theoretic Approaches

National Research Council Canada - National Science Library

Sundareshan, Malur

2001-01-01

This project was primarily aimed at the design of novel algorithms for the restoration and super-resolution processing of imagery data to improve the resolution in images acquired from practical sensing operations...

Super-resolution optical microscopy for studying membrane structure and dynamics.

Science.gov (United States)

Sezgin, Erdinc

2017-07-12

Investigation of cell membrane structure and dynamics requires high spatial and temporal resolution. The spatial resolution of conventional light microscopy is limited due to the diffraction of light. However, recent developments in microscopy enabled us to access the nano-scale regime spatially, thus to elucidate the nanoscopic structures in the cellular membranes. In this review, we will explain the resolution limit, address the working principles of the most commonly used super-resolution microscopy techniques and summarise their recent applications in the biomembrane field.

MIiSR: Molecular Interactions in Super-Resolution Imaging Enables the Analysis of Protein Interactions, Dynamics and Formation of Multi-protein Structures.

Directory of Open Access Journals (Sweden)

Fabiana A Caetano

2015-12-01

Full Text Available Our current understanding of the molecular mechanisms which regulate cellular processes such as vesicular trafficking has been enabled by conventional biochemical and microscopy techniques. However, these methods often obscure the heterogeneity of the cellular environment, thus precluding a quantitative assessment of the molecular interactions regulating these processes. Herein, we present Molecular Interactions in Super Resolution (MIiSR software which provides quantitative analysis tools for use with super-resolution images. MIiSR combines multiple tools for analyzing intermolecular interactions, molecular clustering and image segmentation. These tools enable quantification, in the native environment of the cell, of molecular interactions and the formation of higher-order molecular complexes. The capabilities and limitations of these analytical tools are demonstrated using both modeled data and examples derived from the vesicular trafficking system, thereby providing an established and validated experimental workflow capable of quantitatively assessing molecular interactions and molecular complex formation within the heterogeneous environment of the cell.

Developing Wide-Field Spatio-Spectral Interferometry for Far-Infrared Space Applications

Science.gov (United States)

Leisawitz, David; Bolcar, Matthew R.; Lyon, Richard G.; Maher, Stephen F.; Memarsadeghi, Nargess; Rinehart, Stephen A.; Sinukoff, Evan J.

2012-01-01

Interferometry is an affordable way to bring the benefits of high resolution to space far-IR astrophysics. We summarize an ongoing effort to develop and learn the practical limitations of an interferometric technique that will enable the acquisition of high-resolution far-IR integral field spectroscopic data with a single instrument in a future space-based interferometer. This technique was central to the Space Infrared Interferometric Telescope (SPIRIT) and Submillimeter Probe of the Evolution of Cosmic Structure (SPECS) space mission design concepts, and it will first be used on the Balloon Experimental Twin Telescope for Infrared Interferometry (BETTII). Our experimental approach combines data from a laboratory optical interferometer (the Wide-field Imaging Interferometry Testbed, WIIT), computational optical system modeling, and spatio-spectral synthesis algorithm development. We summarize recent experimental results and future plans.

Super-resolution mapping using multi-viewing CHRIS/PROBA data

Science.gov (United States)

Dwivedi, Manish; Kumar, Vinay

2016-04-01

High-spatial resolution Remote Sensing (RS) data provides detailed information which ensures high-definition visual image analysis of earth surface features. These data sets also support improved information extraction capabilities at a fine scale. In order to improve the spatial resolution of coarser resolution RS data, the Super Resolution Reconstruction (SRR) technique has become widely acknowledged which focused on multi-angular image sequences. In this study multi-angle CHRIS/PROBA data of Kutch area is used for SR image reconstruction to enhance the spatial resolution from 18 m to 6m in the hope to obtain a better land cover classification. Various SR approaches like Projection onto Convex Sets (POCS), Robust, Iterative Back Projection (IBP), Non-Uniform Interpolation and Structure-Adaptive Normalized Convolution (SANC) chosen for this study. Subjective assessment through visual interpretation shows substantial improvement in land cover details. Quantitative measures including peak signal to noise ratio and structural similarity are used for the evaluation of the image quality. It was observed that SANC SR technique using Vandewalle algorithm for the low resolution image registration outperformed the other techniques. After that SVM based classifier is used for the classification of SRR and data resampled to 6m spatial resolution using bi-cubic interpolation. A comparative analysis is carried out between classified data of bicubic interpolated and SR derived images of CHRIS/PROBA and SR derived classified data have shown a significant improvement of 10-12% in the overall accuracy. The results demonstrated that SR methods is able to improve spatial detail of multi-angle images as well as the classification accuracy.

Reducible Dictionaries for Single Image Super-Resolution based on Patch Matching and Mean Shifting

DEFF Research Database (Denmark)

Rasti, Pejman; Nasrollahi, Kamal; Orlova, Olga

2017-01-01

is taken, and its counterpart from the HR dictionary is passed through an illumination enhancement process. By this technique, the noticeable change of illumination between neighbor patches in the super-resolved image is significantly reduced. The enhanced HR patch represents the HR patch of the super......-resolved image. Finally, to remove the blocking effect caused by merging the patches, an average of the obtained HR image and the interpolated image obtained using bicubic interpolation is calculated. The quantitative and qualitative analyses show the superiority of the proposed technique over the conventional...

Robust super-resolution by fusion of interpolated frames for color and grayscale images

Directory of Open Access Journals (Sweden)

Barry eKarch

2015-04-01

Full Text Available Multi-frame super-resolution (SR processing seeks to overcome undersampling issues that can lead to undesirable aliasing artifacts. The key to effective multi-frame SR is accurate subpixel inter-frame registration. This accurate registration is challenging when the motion does not obey a simple global translational model and may include local motion. SR processing is further complicated when the camera uses a division-of-focal-plane (DoFP sensor, such as the Bayer color filter array. Various aspects of these SR challenges have been previously investigated. Fast SR algorithms tend to have difficulty accommodating complex motion and DoFP sensors. Furthermore, methods that can tolerate these complexities tend to be iterative in nature and may not be amenable to real-time processing. In this paper, we present a new fast approach for performing SR in the presence of these challenging imaging conditions. We refer to the new approach as Fusion of Interpolated Frames (FIF SR. The FIF SR method decouples the demosaicing, interpolation, and restoration steps to simplify the algorithm. Frames are first individually demosaiced and interpolated to the desired resolution. Next, FIF uses a novel weighted sum of the interpolated frames to fuse them into an improved resolution estimate. Finally, restoration is applied to deconvolve the modeled system PSF. The proposed FIF approach has a lower computational complexity than most iterative methods, making it a candidate for real-time implementation. We provide a detailed description of the FIF SR method and show experimental results using synthetic and real datasets in both constrained and complex imaging scenarios. The experiments include airborne grayscale imagery and Bayer color array images with affine background motion plus local motion.

Super-virtual refraction interferometry: an engineering field data example

KAUST Repository

Hanafy, Sherif M.

2012-10-01

The theory of super-virtual refraction interferometry (SVI) was recently developed to enhance the signal-to-noise ratio (SNR) of far-offset traces in refraction surveys. This enhancement of the SNR is proportional to √N and can be as high as N if an iterative procedure is used. Here N is the number of post-critical shot positions that coincides with the receiver locations. We now demonstrate the SNR enhancement of super-virtual refraction traces for one engineering-scale synthetic data and two field seismic data sets. The field data are collected over a normal fault in Saudi Arabia. Results show that both the SNR of the super-virtual data set and the number of reliable first-arrival traveltime picks are significantly increased. © 2012 European Association of Geoscientists & Engineers.

Super-virtual refraction interferometry: an engineering field data example

KAUST Repository

Hanafy, Sherif M.; Alhagan, Ola

2012-01-01

The theory of super-virtual refraction interferometry (SVI) was recently developed to enhance the signal-to-noise ratio (SNR) of far-offset traces in refraction surveys. This enhancement of the SNR is proportional to √N and can be as high as N if an iterative procedure is used. Here N is the number of post-critical shot positions that coincides with the receiver locations. We now demonstrate the SNR enhancement of super-virtual refraction traces for one engineering-scale synthetic data and two field seismic data sets. The field data are collected over a normal fault in Saudi Arabia. Results show that both the SNR of the super-virtual data set and the number of reliable first-arrival traveltime picks are significantly increased. © 2012 European Association of Geoscientists & Engineers.

Speckle correlation resolution enhancement of wide-field fluorescence imaging (Conference Presentation)

Science.gov (United States)

Yilmaz, Hasan

2016-03-01

Structured illumination enables high-resolution fluorescence imaging of nanostructures [1]. We demonstrate a new high-resolution fluorescence imaging method that uses a scattering layer with a high-index substrate as a solid immersion lens [2]. Random scattering of coherent light enables a speckle pattern with a very fine structure that illuminates the fluorescent nanospheres on the back surface of the high-index substrate. The speckle pattern is raster-scanned over the fluorescent nanospheres using a speckle correlation effect known as the optical memory effect. A series of standard-resolution fluorescence images per each speckle pattern displacement are recorded by an electron-multiplying CCD camera using a commercial microscope objective. We have developed a new phase-retrieval algorithm to reconstruct a high-resolution, wide-field image from several standard-resolution wide-field images. We have introduced phase information of Fourier components of standard-resolution images as a new constraint in our algorithm which discards ambiguities therefore ensures convergence to a unique solution. We demonstrate two-dimensional fluorescence images of a collection of nanospheres with a deconvolved Abbe resolution of 116 nm and a field of view of 10 µm × 10 µm. Our method is robust against optical aberrations and stage drifts, therefore excellent for imaging nanostructures under ambient conditions. [1] M. G. L. Gustafsson, J. Microsc. 198, 82-87 (2000). [2] H. Yilmaz, E. G. van Putten, J. Bertolotti, A. Lagendijk, W. L. Vos, and A. P. Mosk, Optica 2, 424-429 (2015).

FIRST SCIENCE RESULTS FROM SOFIA/FORCAST: SUPER-RESOLUTION IMAGING OF THE S140 CLUSTER AT 37 {mu}m

Energy Technology Data Exchange (ETDEWEB)

Harvey, Paul M. [Astronomy Department, University of Texas at Austin, 1 University Station C1400, Austin, TX 78712-0259 (United States); Adams, Joseph D.; Herter, Terry L.; Gull, George; Schoenwald, Justin, E-mail: pmh@astro.as.utexas.edu, E-mail: jdadams@astro.cornell.edu, E-mail: tlh10@cornell.edu, E-mail: geg3@cornell.edu, E-mail: jps10@cornell.edu [Center for Radiophysics and Space Research, Space Science Building, Cornell University, Ithaca, NY 14853 (United States); and others

2012-04-20

We present 37 {mu}m imaging of the S140 complex of infrared sources centered on IRS1 made with the FORCAST camera on SOFIA. These observations are the longest wavelength imaging to resolve clearly the three main sources seen at shorter wavelengths, IRS 1, 2, and 3, and are nearly at the diffraction limit of the 2.5 m telescope. We also obtained a small number of images at 11 and 31 {mu}m that are useful for flux measurement. Our images cover the area of several strong submillimeter sources seen in the area-SMM 1, 2, and 3-that are not coincident with any mid-infrared sources and are not visible in our longer wavelength imaging either. Our new observations confirm previous estimates of the relative dust optical depth and source luminosity for the components in this likely cluster of early B stars. We also investigate the use of super-resolution to go beyond the basic diffraction limit in imaging on SOFIA and find that the van Cittert algorithm, together with the 'multi-resolution' technique, provides excellent results.

Compact three-dimensional super-resolution system based on fluorescence emission difference microscopy

Science.gov (United States)

Zhu, Dazhao; Chen, Youhua; Fang, Yue; Hussain, Anwar; Kuang, Cuifang; Zhou, Xiaoxu; Xu, Yingke; Liu, Xu

2017-12-01

A compact microscope system for three-dimensional (3-D) super-resolution imaging is presented. The super-resolution capability of the system is based on a size-reduced effective 3-D point spread function generated through the fluorescence emission difference (FED) method. The appropriate polarization direction distribution and manipulation allows the panel active area of the spatial light modulator to be fully utilized. This allows simultaneous modulation of the incident light by two kinds of phase masks to be performed with a single spatial light modulator in order to generate a 3-D negative spot. The system is more compact than standard 3-D FED systems while maintaining all the advantages of 3-D FED microscopy. The experimental results demonstrated the improvement in 3-D resolution by nearly 1.7 times and 1.6 times compared to the classic confocal resolution in the lateral and axial directions, respectively.

High-resolution and super stacking of time-reversal mirrors in locating seismic sources

KAUST Repository

Cao, Weiping; Hanafy, Sherif M.; Schuster, Gerard T.; Zhan, Ge; Boonyasiriwat, Chaiwoot

2011-01-01

Time reversal mirrors can be used to backpropagate and refocus incident wavefields to their actual source location, with the subsequent benefits of imaging with high-resolution and super-stacking properties. These benefits of time reversal mirrors

Enhanced simulator software for image validation and interpretation for multimodal localization super-resolution fluorescence microscopy

Science.gov (United States)

Erdélyi, Miklós; Sinkó, József; Gajdos, Tamás.; Novák, Tibor

2017-02-01

Optical super-resolution techniques such as single molecule localization have become one of the most dynamically developed areas in optical microscopy. These techniques routinely provide images of fixed cells or tissues with sub-diffraction spatial resolution, and can even be applied for live cell imaging under appropriate circumstances. Localization techniques are based on the precise fitting of the point spread functions (PSF) to the measured images of stochastically excited, identical fluorescent molecules. These techniques require controlling the rate between the on, off and the bleached states, keeping the number of active fluorescent molecules at an optimum value, so their diffraction limited images can be detected separately both spatially and temporally. Because of the numerous (and sometimes unknown) parameters, the imaging system can only be handled stochastically. For example, the rotation of the dye molecules obscures the polarization dependent PSF shape, and only an averaged distribution - typically estimated by a Gaussian function - is observed. TestSTORM software was developed to generate image stacks for traditional localization microscopes, where localization meant the precise determination of the spatial position of the molecules. However, additional optical properties (polarization, spectra, etc.) of the emitted photons can be used for further monitoring the chemical and physical properties (viscosity, pH, etc.) of the local environment. The image stack generating program was upgraded by several new features, such as: multicolour, polarization dependent PSF, built-in 3D visualization, structured background. These features make the program an ideal tool for optimizing the imaging and sample preparation conditions.

Super-resolution with a positive epsilon multi-quantum-well super-lens

International Nuclear Information System (INIS)

Bak, A. O.; Giannini, V.; Maier, S. A.; Phillips, C. C.

2013-01-01

We design an anisotropic and dichroic quantum metamaterial that is able to achieve super-resolution without the need for a negative permittivity. When exploring the parameters of the structure, we take into account the limits of semiconductor fabrication technology based on quantum well stacks. By heavily doping the structure with free electrons, we infer an anisotropic effective medium with a prolate ellipsoid dispersion curve which allows for near-diffractionless propagation of light (similar to an epsilon-near-zero hyperbolic lens). This, coupled with low absorption, allows us to resolve images at the sub-wavelength scale at distances 6 times greater than equivalent natural materials

4D super-resolution microscopy with conventional fluorophores and single wavelength excitation in optically thick cells and tissues.

Directory of Open Access Journals (Sweden)

David Baddeley

Full Text Available BACKGROUND: Optical super-resolution imaging of fluorescently stained biological samples is rapidly becoming an important tool to investigate protein distribution at the molecular scale. It is therefore important to develop practical super-resolution methods that allow capturing the full three-dimensional nature of biological systems and also can visualize multiple protein species in the same sample. METHODOLOGY/PRINCIPAL FINDINGS: We show that the use of a combination of conventional near-infrared dyes, such as Alexa 647, Alexa 680 and Alexa 750, all excited with a 671 nm diode laser, enables 3D multi-colour super-resolution imaging of complex biological samples. Optically thick samples, including human tissue sections, cardiac rat myocytes and densely grown neuronal cultures were imaged with lateral resolutions of ∼15 nm (std. dev. while reducing marker cross-talk to <1%. Using astigmatism an axial resolution of ∼65 nm (std. dev. was routinely achieved. The number of marker species that can be distinguished depends on the mean photon number of single molecule events. With the typical photon yields from Alexa 680 of ∼2000 up to 5 markers may in principle be resolved with <2% crosstalk. CONCLUSIONS/SIGNIFICANCE: Our approach is based entirely on the use of conventional, commercially available markers and requires only a single laser. It provides a very straightforward way to investigate biological samples at the nanometre scale and should help establish practical 4D super-resolution microscopy as a routine research tool in many laboratories.

Super-resolution imaging with Pontamine Fast Scarlet 4BS enables direct visualization of cellulose orientation and cell connection architecture in onion epidermis cells

DEFF Research Database (Denmark)

Liesche, Johannes; Ziomkiewicz, Iwona; Schulz, Alexander

2013-01-01

of cellulose fibril orientation and growth. The fluorescent dye Pontamine Fast Scarlet 4BS (PFS) was shown to stain cellulose with high specificity and could be used to visualize cellulose bundles in cell walls of Arabidopsis root epidermal cells with confocal microscopy. The resolution limit of confocal...... present the first super-resolution images of cellulose bundles in the plant cell wall produced by direct stochastic optical reconstruction microscopy (dSTORM) in combination with total internal reflection fluorescence (TIRF) microscopy. Since TIRF limits observation to the cell surface, we tested...... as alternatives 3D-structured illumination microscopy (3D-SIM) and confocal microscopy, combined with image deconvolution. Both methods offer lower resolution than STORM, but enable 3D imaging. While 3D-SIM produced strong artifacts, deconvolution gave good results. The resolution was improved over conventional...

A high-resolution full-field range imaging system

Science.gov (United States)

Carnegie, D. A.; Cree, M. J.; Dorrington, A. A.

2005-08-01

There exist a number of applications where the range to all objects in a field of view needs to be obtained. Specific examples include obstacle avoidance for autonomous mobile robots, process automation in assembly factories, surface profiling for shape analysis, and surveying. Ranging systems can be typically characterized as being either laser scanning systems where a laser point is sequentially scanned over a scene or a full-field acquisition where the range to every point in the image is simultaneously obtained. The former offers advantages in terms of range resolution, while the latter tend to be faster and involve no moving parts. We present a system for determining the range to any object within a camera's field of view, at the speed of a full-field system and the range resolution of some point laser scans. Initial results obtained have a centimeter range resolution for a 10 second acquisition time. Modifications to the existing system are discussed that should provide faster results with submillimeter resolution.

Special issue on high-resolution optical imaging

Science.gov (United States)

Smith, Peter J. S.; Davis, Ilan; Galbraith, Catherine G.; Stemmer, Andreas

2013-09-01

The pace of development in the field of advanced microscopy is truly breath-taking, and is leading to major breakthroughs in our understanding of molecular machines and cell function. This special issue of Journal of Optics draws attention to a number of interesting approaches, ranging from fluorescence and imaging of unlabelled cells, to computational methods, all of which are describing the ever increasing detail of the dynamic behaviour of molecules in the living cell. This is a field which traditionally, and currently, demonstrates a marvellous interplay between the disciplines of physics, chemistry and biology, where apparent boundaries to resolution dissolve and living cells are viewed in ever more clarity. It is fertile ground for those interested in optics and non-conventional imaging to contribute high-impact outputs in the fields of cell biology and biomedicine. The series of articles presented here has been selected to demonstrate this interdisciplinarity and to encourage all those with a background in the physical sciences to 'dip their toes' into the exciting and dynamic discoveries surrounding cell function. Although single molecule super-resolution microscopy is commercially available, specimen preparation and interpretation of single molecule data remain a major challenge for scientists wanting to adopt the techniques. The paper by Allen and Davidson [1] provides a much needed detailed introduction to the practical aspects of stochastic optical reconstruction microscopy, including sample preparation, image acquisition and image analysis, as well as a brief description of the different variants of single molecule localization microscopy. Since super-resolution microscopy is no longer restricted to three-dimensional imaging of fixed samples, the review by Fiolka [2] is a timely introduction to techniques that have been successfully applied to four-dimensional live cell super-resolution microscopy. The combination of multiple high-resolution techniques

Quantum phase amplification for temporal pulse shaping and super-resolution in remote sensing

Science.gov (United States)

Yin, Yanchun

QPA in the spatial domain has also been studied as a method to enhance the spatial resolution of imaging systems. A detailed model has been developed for achieving both super-resolution and detection of phase-amplified light. The imaging resolution problem considered here is treated as a binary hypotheses testing problem. Resolution enhancement is achieved by magnification of the angular separation of two targets in the sub-Rayleigh regime. The detection model includes optimization of detector segmentation, detector noise, and detection in both the spatial and the spatial frequency domain, which provide strategies for the optimization of the signal-to-noise ratio that take advantage of both the change of the field distribution and the change of energy of the signal in the QPA process. Proof-of-principle experiments have been conducted in the spatial domain. For the first time, beam angular amplification has been demonstrated, and the experimental result is in good agreement with simulations. The experimental demonstration has been achieved by observing the correlation of amplitude and angular phase in the phase-sensitive three-wave mixing process using ultrashort laser pulses and utilizing a type I three-wave mixing process. Several diagnostics have been developed and employed in the experimental measurements, including the near-field diagnostic, the far-field diagnostic, and the interferometry diagnostic. They have all been used to confirm the existence and study the properties of the QPA process on a shot-to-shot basis. Specifically, amplitude was measured in the near-field diagnostic, while the angular phase was indirectly measured in the far-field diagnostic by determining the position of the beam centroid. Interferometric measurements have been found to be of insufficient accuracy for this measurement in the way they were implemented. The demonstration of beam angular amplification by use of QPA lays the foundation for future integrated demonstration of imaging

High resolution NMR imaging using a high field yokeless permanent magnet.

Science.gov (United States)

Kose, Katsumi; Haishi, Tomoyuki

2011-01-01

We measured the homogeneity and stability of the magnetic field of a high field (about 1.04 tesla) yokeless permanent magnet with 40-mm gap for high resolution nuclear magnetic resonance (NMR) imaging. Homogeneity was evaluated using a 3-dimensional (3D) lattice phantom and 3D spin-echo imaging sequences. In the central sphere (20-mm diameter), peak-to-peak magnetic field inhomogeneity was about 60 ppm, and the root-mean-square was 8 ppm. We measured room temperature, magnet temperature, and NMR frequency of the magnet simultaneously every minute for about 68 hours with and without the thermal insulator of the magnet. A simple mathematical model described the magnet's thermal property. Based on magnet performance, we performed high resolution (up to [20 µm](2)) imaging with internal NMR lock sequences of several biological samples. Our results demonstrated the usefulness of the high field small yokeless permanent magnet for high resolution NMR imaging.

High resolution NMR imaging using a high field yokeless permanent magnet

International Nuclear Information System (INIS)

Kose, Katsumi; Haishi, Tomoyuki

2011-01-01

We measured the homogeneity and stability of the magnetic field of a high field (about 1.04 tesla) yokeless permanent magnet with 40-mm gap for high resolution nuclear magnetic resonance (NMR) imaging. Homogeneity was evaluated using a 3-dimensional (3D) lattice phantom and 3D spin-echo imaging sequences. In the central sphere (20-mm diameter), peak-to-peak magnetic field inhomogeneity was about 60 ppm, and the root-mean-square was 8 ppm. We measured room temperature, magnet temperature, and NMR frequency of the magnet simultaneously every minute for about 68 hours with and without the thermal insulator of the magnet. A simple mathematical model described the magnet's thermal property. Based on magnet performance, we performed high resolution (up to [20 μm] 2 ) imaging with internal NMR lock sequences of several biological samples. Our results demonstrated the usefulness of the high field small yokeless permanent magnet for high resolution NMR imaging. (author)

Super-resolution for everybody: An image processing workflow to obtain high-resolution images with a standard confocal microscope.

Science.gov (United States)

Lam, France; Cladière, Damien; Guillaume, Cyndélia; Wassmann, Katja; Bolte, Susanne

2017-02-15

In the presented work we aimed at improving confocal imaging to obtain highest possible resolution in thick biological samples, such as the mouse oocyte. We therefore developed an image processing workflow that allows improving the lateral and axial resolution of a standard confocal microscope. Our workflow comprises refractive index matching, the optimization of microscope hardware parameters and image restoration by deconvolution. We compare two different deconvolution algorithms, evaluate the necessity of denoising and establish the optimal image restoration procedure. We validate our workflow by imaging sub resolution fluorescent beads and measuring the maximum lateral and axial resolution of the confocal system. Subsequently, we apply the parameters to the imaging and data restoration of fluorescently labelled meiotic spindles of mouse oocytes. We measure a resolution increase of approximately 2-fold in the lateral and 3-fold in the axial direction throughout a depth of 60μm. This demonstrates that with our optimized workflow we reach a resolution that is comparable to 3D-SIM-imaging, but with better depth penetration for confocal images of beads and the biological sample. Copyright © 2016 Elsevier Inc. All rights reserved.

Video-to-Video Dynamic Super-Resolution for Grayscale and Color Sequences

Directory of Open Access Journals (Sweden)

Elad Michael

2006-01-01

Full Text Available We address the dynamic super-resolution (SR problem of reconstructing a high-quality set of monochromatic or color super-resolved images from low-quality monochromatic, color, or mosaiced frames. Our approach includes a joint method for simultaneous SR, deblurring, and demosaicing, this way taking into account practical color measurements encountered in video sequences. For the case of translational motion and common space-invariant blur, the proposed method is based on a very fast and memory efficient approximation of the Kalman filter (KF. Experimental results on both simulated and real data are supplied, demonstrating the presented algorithms, and their strength.

Robust isotropic super-resolution by maximizing a Laplace posterior for MRI volumes

Science.gov (United States)

Han, Xian-Hua; Iwamoto, Yutaro; Shiino, Akihiko; Chen, Yen-Wei

2014-03-01

Magnetic resonance imaging can only acquire volume data with finite resolution due to various factors. In particular, the resolution in one direction (such as the slice direction) is much lower than others (such as the in-plane direction), yielding un-realistic visualizations. This study explores to reconstruct MRI isotropic resolution volumes from three orthogonal scans. This proposed super- resolution reconstruction is formulated as a maximum a posterior (MAP) problem, which relies on the generation model of the acquired scans from the unknown high-resolution volumes. Generally, the deviation ensemble of the reconstructed high-resolution (HR) volume from the available LR ones in the MAP is represented as a Gaussian distribution, which usually results in some noise and artifacts in the reconstructed HR volume. Therefore, this paper investigates a robust super-resolution by formulating the deviation set as a Laplace distribution, which assumes sparsity in the deviation ensemble based on the possible insight of the appeared large values only around some unexpected regions. In addition, in order to achieve reliable HR MRI volume, we integrates the priors such as bilateral total variation (BTV) and non-local mean (NLM) into the proposed MAP framework for suppressing artifacts and enriching visual detail. We validate the proposed robust SR strategy using MRI mouse data with high-definition resolution in two direction and low-resolution in one direction, which are imaged in three orthogonal scans: axial, coronal and sagittal planes. Experiments verifies that the proposed strategy can achieve much better HR MRI volumes than the conventional MAP method even with very high-magnification factor: 10.

Science with High Spatial Resolution Far-Infrared Data

Science.gov (United States)

Terebey, Susan (Editor); Mazzarella, Joseph M. (Editor)

1994-01-01

The goal of this workshop was to discuss new science and techniques relevant to high spatial resolution processing of far-infrared data, with particular focus on high resolution processing of IRAS data. Users of the maximum correlation method, maximum entropy, and other resolution enhancement algorithms applicable to far-infrared data gathered at the Infrared Processing and Analysis Center (IPAC) for two days in June 1993 to compare techniques and discuss new results. During a special session on the third day, interested astronomers were introduced to IRAS HIRES processing, which is IPAC's implementation of the maximum correlation method to the IRAS data. Topics discussed during the workshop included: (1) image reconstruction; (2) random noise; (3) imagery; (4) interacting galaxies; (5) spiral galaxies; (6) galactic dust and elliptical galaxies; (7) star formation in Seyfert galaxies; (8) wavelet analysis; and (9) supernova remnants.

Super resolution PLIF demonstrated in turbulent jet flows seeded with I2

Science.gov (United States)

Xu, Wenjiang; Liu, Ning; Ma, Lin

2018-05-01

Planar laser induced fluorescence (PLIF) represents an indispensable tool for flow and flame imaging. However, the PLIF technique suffers from limited spatial resolution or blurring in many situations, which restricts its applicability and capability. This work describes a new method, named SR-PLIF (super-resolution PLIF), to overcome these limitations and enhance the capability of PLIF. The method uses PLIF images captured simultaneously from two (or more) orientations to reconstruct a final PLIF image with resolution enhanced or blurring removed. This paper reports the development of the reconstruction algorithm, and the experimental demonstration of the SR-PLIF method both with controlled samples and with turbulent flows seeded with iodine vapor. Using controlled samples with two cameras, the spatial resolution in the best case was improved from 0.06 mm in the projections to 0.03 mm in the SR image, in terms of the spreading width of a sharp edge. With turbulent flows, an image sharpness measure was developed to quantify the spatial resolution, and SR reconstruction with two cameras can effectively improve the spatial resolution compared to the projections in terms of the sharpness measure.

Super resolution reconstruction of infrared images based on classified dictionary learning

Science.gov (United States)

Liu, Fei; Han, Pingli; Wang, Yi; Li, Xuan; Bai, Lu; Shao, Xiaopeng

2018-05-01

Infrared images always suffer from low-resolution problems resulting from limitations of imaging devices. An economical approach to combat this problem involves reconstructing high-resolution images by reasonable methods without updating devices. Inspired by compressed sensing theory, this study presents and demonstrates a Classified Dictionary Learning method to reconstruct high-resolution infrared images. It classifies features of the samples into several reasonable clusters and trained a dictionary pair for each cluster. The optimal pair of dictionaries is chosen for each image reconstruction and therefore, more satisfactory results is achieved without the increase in computational complexity and time cost. Experiments and results demonstrated that it is a viable method for infrared images reconstruction since it improves image resolution and recovers detailed information of targets.

Mapping the nanoscale energetic landscape in conductive polymer films with spatially super-resolved exciton dynamics

Science.gov (United States)

Ginsberg, Naomi

2015-03-01

The migration of Frenkel excitons, tightly-bound electron-hole pairs, in polymeric organic semiconducting films is critical to the efficiency of bulk heterojunction solar cells. While these materials exhibit a high degree of structural heterogeneity on the nanoscale, traditional measurements of exciton diffusion lengths are performed on bulk samples. Since both the characteristic length scales of structural heterogeneity and the reported bulk diffusion lengths are smaller than the optical diffraction limit, we adapt far-field super-resolution fluorescence imaging to uncover the correlations between the structural and energetic landscapes that the excitons explore.

SuperAGILE: The Hard X-ray Imager of AGILE

International Nuclear Information System (INIS)

Feroci, M.; Costa, E.; Barbanera, L.; Del Monte, E.; Di Persio, G.; Frutti, M.; Lapshov, I.; Lazzarotto, F.; Pacciani, L.; Porrovecchio, G.; Preger, B.; Rapisarda, M.; Rubini, A.; Soffitta, P.; Tavani, M.; Mastropietro, M.; Morelli, E.; Argan, A.; Ghirlanda, G.; Mereghetti, S.

2004-01-01

SuperAGILE is the hard X-ray (10-40 keV) imager for the gamma-ray mission AGILE, currently scheduled for launch in mid-2005. It is based on 4 Si-microstrip detectors, with a total geometric area of 1444 cm 2 (max effective about 300 cm 2 ), equipped with one-dimensional coded masks. The 4 detectors are perpendicularly oriented, in order to provide pairs of orthogonal one-dimensional images of the X-ray sky. The field of view of each 1-D detector is 107 deg. x 68 deg., at zero response, with an overlap in the central 68 deg. x 68 deg. area. The angular resolution on axis is 6 arcmin (pixel size). We present here the current status of the hardware development and the scientific potential for GRBs, for which an onboard trigger and imaging system will allow distributing locations through a fast communication telemetry link from AGILE to the ground

Super-resolution from single photon emission: toward biological application

Science.gov (United States)

Moreva, E.; Traina, P.; Forneris, J.; Ditalia Tchernij, S.; Guarina, L.; Franchino, C.; Picollo, F.; Ruo Berchera, I.; Brida, G.; Degiovanni, I. P.; Carabelli, V.; Olivero, P.; Genovese, M.

2017-08-01

Properties of quantum light represent a tool for overcoming limits of classical optics. Several experiments have demonstrated this advantage ranging from quantum enhanced imaging to quantum illumination. In this work, experimental demonstration of quantum-enhanced resolution in confocal fluorescence microscopy will be presented. This is achieved by exploiting the non-classical photon statistics of fluorescence emission of single nitrogen-vacancy (NV) color centers in diamond. By developing a general model of super-resolution based on the direct sampling of the kth-order autocorrelation function of the photoluminescence signal, we show the possibility to resolve, in principle, arbitrarily close emitting centers. Finally, possible applications of NV-based fluorescent nanodiamonds in biosensing and future developments will be presented.

Super Resolution Algorithm for CCTVs

Science.gov (United States)

Gohshi, Seiichi

2015-03-01

Recently, security cameras and CCTV systems have become an important part of our daily lives. The rising demand for such systems has created business opportunities in this field, especially in big cities. Analogue CCTV systems are being replaced by digital systems, and HDTV CCTV has become quite common. HDTV CCTV can achieve images with high contrast and decent quality if they are clicked in daylight. However, the quality of an image clicked at night does not always have sufficient contrast and resolution because of poor lighting conditions. CCTV systems depend on infrared light at night to compensate for insufficient lighting conditions, thereby producing monochrome images and videos. However, these images and videos do not have high contrast and are blurred. We propose a nonlinear signal processing technique that significantly improves visual and image qualities (contrast and resolution) of low-contrast infrared images. The proposed method enables the use of infrared cameras for various purposes such as night shot and poor lighting environments under poor lighting conditions.

Super-Resolution Microscopy: Shedding Light on the Cellular Plasma Membrane.

Science.gov (United States)

Stone, Matthew B; Shelby, Sarah A; Veatch, Sarah L

2017-06-14

Lipids and the membranes they form are fundamental building blocks of cellular life, and their geometry and chemical properties distinguish membranes from other cellular environments. Collective processes occurring within membranes strongly impact cellular behavior and biochemistry, and understanding these processes presents unique challenges due to the often complex and myriad interactions between membrane components. Super-resolution microscopy offers a significant gain in resolution over traditional optical microscopy, enabling the localization of individual molecules even in densely labeled samples and in cellular and tissue environments. These microscopy techniques have been used to examine the organization and dynamics of plasma membrane components, providing insight into the fundamental interactions that determine membrane functions. Here, we broadly introduce the structure and organization of the mammalian plasma membrane and review recent applications of super-resolution microscopy to the study of membranes. We then highlight some inherent challenges faced when using super-resolution microscopy to study membranes, and we discuss recent technical advancements that promise further improvements to super-resolution microscopy and its application to the plasma membrane.

Super-resolution of facial images in forensics scenarios

DEFF Research Database (Denmark)

Satiro, Joao; Nasrollahi, Kamal; Correia, Paulo

2015-01-01

-resolution (SR) algorithms might be used. But, the problem with these algorithms is that they mostly require motion estimation between LR and low-quality images which is not always practical. To deal with this, we first simply interpolate the LR input images and then perform motion estimation. The estimated...... motion parameters are then used in a non-local mean-based SR algorithm to produce a higher quality image. This image is further fused with the interpolated version of the reference image via an alpha-blending approach. The experimental results on benchmark datasets and locally collected videos from...

Cell-specific STORM super-resolution imaging reveals nanoscale organization of cannabinoid signaling.

Science.gov (United States)

Dudok, Barna; Barna, László; Ledri, Marco; Szabó, Szilárd I; Szabadits, Eszter; Pintér, Balázs; Woodhams, Stephen G; Henstridge, Christopher M; Balla, Gyula Y; Nyilas, Rita; Varga, Csaba; Lee, Sang-Hun; Matolcsi, Máté; Cervenak, Judit; Kacskovics, Imre; Watanabe, Masahiko; Sagheddu, Claudia; Melis, Miriam; Pistis, Marco; Soltesz, Ivan; Katona, István

2015-01-01

A major challenge in neuroscience is to determine the nanoscale position and quantity of signaling molecules in a cell type- and subcellular compartment-specific manner. We developed a new approach to this problem by combining cell-specific physiological and anatomical characterization with super-resolution imaging and studied the molecular and structural parameters shaping the physiological properties of synaptic endocannabinoid signaling in the mouse hippocampus. We found that axon terminals of perisomatically projecting GABAergic interneurons possessed increased CB1 receptor number, active-zone complexity and receptor/effector ratio compared with dendritically projecting interneurons, consistent with higher efficiency of cannabinoid signaling at somatic versus dendritic synapses. Furthermore, chronic Δ(9)-tetrahydrocannabinol administration, which reduces cannabinoid efficacy on GABA release, evoked marked CB1 downregulation in a dose-dependent manner. Full receptor recovery required several weeks after the cessation of Δ(9)-tetrahydrocannabinol treatment. These findings indicate that cell type-specific nanoscale analysis of endogenous protein distribution is possible in brain circuits and identify previously unknown molecular properties controlling endocannabinoid signaling and cannabis-induced cognitive dysfunction.

Super Resolution and Interference Suppression Technique applied to SHARAD Radar Data

Science.gov (United States)

Raguso, M. C.; Mastrogiuseppe, M.; Seu, R.; Piazzo, L.

2017-12-01

We will present a super resolution and interference suppression technique applied to the data acquired by the SHAllow RADar (SHARAD) on board the NASA's 2005 Mars Reconnaissance Orbiter (MRO) mission, currently operating around Mars [1]. The algorithms allow to improve the range resolution roughly by a factor of 3 and the Signal to Noise Ratio (SNR) by a several decibels. Range compression algorithms usually adopt conventional Fourier transform techniques, which are limited in the resolution by the transmitted signal bandwidth, analogous to the Rayleigh's criterion in optics. In this work, we investigate a super resolution method based on autoregressive models and linear prediction techniques [2]. Starting from the estimation of the linear prediction coefficients from the spectral data, the algorithm performs the radar bandwidth extrapolation (BWE), thereby improving the range resolution of the pulse-compressed coherent radar data. Moreover, the EMIs (ElectroMagnetic Interferences) are detected and the spectra is interpolated in order to reconstruct an interference free spectrum, thereby improving the SNR. The algorithm can be applied to the single complex look image after synthetic aperture processing (SAR). We apply the proposed algorithm to simulated as well as to real radar data. We will demonstrate the effective enhancement on vertical resolution with respect to the classical spectral estimator. We will show that the imaging of the subsurface layered structures observed in radargrams is improved, allowing additional insights for the scientific community in the interpretation of the SHARAD radar data, which will help to further our understanding of the formation and evolution of known geological features on Mars. References: [1] Seu et al. 2007, Science, 2007, 317, 1715-1718 [2] K.M. Cuomo, "A Bandwidth Extrapolation Technique for Improved Range Resolution of Coherent Radar Data", Project Report CJP-60, Revision 1, MIT Lincoln Laboratory (4 Dec. 1992).

A Super-resolution Reconstruction Algorithm for Surveillance Video

Directory of Open Access Journals (Sweden)

Jian Shao

2017-01-01

Full Text Available Recent technological developments have resulted in surveillance video becoming a primary method of preserving public security. Many city crimes are observed in surveillance video. The most abundant evidence collected by the police is also acquired through surveillance video sources. Surveillance video footage offers very strong support for solving criminal cases, therefore, creating an effective policy, and applying useful methods to the retrieval of additional evidence is becoming increasingly important. However, surveillance video has had its failings, namely, video footage being captured in low resolution (LR and bad visual quality. In this paper, we discuss the characteristics of surveillance video and describe the manual feature registration – maximum a posteriori – projection onto convex sets to develop a super-resolution reconstruction method, which improves the quality of surveillance video. From this method, we can make optimal use of information contained in the LR video image, but we can also control the image edge clearly as well as the convergence of the algorithm. Finally, we make a suggestion on how to adjust the algorithm adaptability by analyzing the prior information of target image.

Machine Learning Based Single-Frame Super-Resolution Processing for Lensless Blood Cell Counting

Directory of Open Access Journals (Sweden)

Xiwei Huang

2016-11-01

Full Text Available A lensless blood cell counting system integrating microfluidic channel and a complementary metal oxide semiconductor (CMOS image sensor is a promising technique to miniaturize the conventional optical lens based imaging system for point-of-care testing (POCT. However, such a system has limited resolution, making it imperative to improve resolution from the system-level using super-resolution (SR processing. Yet, how to improve resolution towards better cell detection and recognition with low cost of processing resources and without degrading system throughput is still a challenge. In this article, two machine learning based single-frame SR processing types are proposed and compared for lensless blood cell counting, namely the Extreme Learning Machine based SR (ELMSR and Convolutional Neural Network based SR (CNNSR. Moreover, lensless blood cell counting prototypes using commercial CMOS image sensors and custom designed backside-illuminated CMOS image sensors are demonstrated with ELMSR and CNNSR. When one captured low-resolution lensless cell image is input, an improved high-resolution cell image will be output. The experimental results show that the cell resolution is improved by 4×, and CNNSR has 9.5% improvement over the ELMSR on resolution enhancing performance. The cell counting results also match well with a commercial flow cytometer. Such ELMSR and CNNSR therefore have the potential for efficient resolution improvement in lensless blood cell counting systems towards POCT applications.

SuperSegger: robust image segmentation, analysis and lineage tracking of bacterial cells.

Science.gov (United States)

Stylianidou, Stella; Brennan, Connor; Nissen, Silas B; Kuwada, Nathan J; Wiggins, Paul A

2016-11-01

Many quantitative cell biology questions require fast yet reliable automated image segmentation to identify and link cells from frame-to-frame, and characterize the cell morphology and fluorescence. We present SuperSegger, an automated MATLAB-based image processing package well-suited to quantitative analysis of high-throughput live-cell fluorescence microscopy of bacterial cells. SuperSegger incorporates machine-learning algorithms to optimize cellular boundaries and automated error resolution to reliably link cells from frame-to-frame. Unlike existing packages, it can reliably segment microcolonies with many cells, facilitating the analysis of cell-cycle dynamics in bacteria as well as cell-contact mediated phenomena. This package has a range of built-in capabilities for characterizing bacterial cells, including the identification of cell division events, mother, daughter and neighbouring cells, and computing statistics on cellular fluorescence, the location and intensity of fluorescent foci. SuperSegger provides a variety of postprocessing data visualization tools for single cell and population level analysis, such as histograms, kymographs, frame mosaics, movies and consensus images. Finally, we demonstrate the power of the package by analyzing lag phase growth with single cell resolution. © 2016 John Wiley & Sons Ltd.

Transceiver Design for CMUT-Based Super-Resolution Ultrasound Imaging.

Science.gov (United States)

Behnamfar, Parisa; Molavi, Reza; Mirabbasi, Shahriar

2016-04-01

A recently introduced structure for the capacitive micromachined ultrasonic transducers (CMUTs) has focused on the applications of the asymmetric mode of vibration and has shown promising results in construction of super-resolution ultrasound images. This paper presents the first implementation and experimental results of a transceiver circuit to interface such CMUT structures. The multiple input/multiple output receiver in this work supports both fundamental and asymmetric modes of operation and includes transimpedance amplifiers and low-power variable-gain stages. These circuit blocks are designed considering the trade-offs between gain, input impedance, noise, linearity and power consumption. The high-voltage transmitter can generate pulse voltages up to 60 V while occupying a considerably small area. The overall circuit is designed and laid out in a 0.35 μm CMOS process and a four-channel transceiver occupies 0.86 × 0.38 mm(2). The prototype chip is characterized in both electrical and mechanical domains. Measurement results show that each receiver channel has a nominal gain of 110 dBΩ with a 3 dB bandwidth of 9 MHz while consuming 1.02 mW from a 3.3 V supply. The receiver is also highly linear, with 1 dB compression point of minimum 1.05 V which is considerably higher than the previously reported designs. The transmitter consumes 98.1 mW from a 30 V supply while generating 1.38 MHz, 30 V pulses. The CMOS-CMUT system is tested in the transmit mode and shows full functionality in air medium.

Annular dark field electron microscope images with better than 2 A resolution at 100 kV

International Nuclear Information System (INIS)

Shin, D.H.; Kirkland, E.J.; Silcox, J.

1989-01-01

High-resolution scanning transmission electron microscope (STEM) images in the annular dark field (ADF) imaging mode approaching the theoretical point-to-point resolution limit are presented. The ADF images were obtained from a high T c superconducting YBa 2 Cu 3 O 7-x thin-film specimen at 100 kV. The 1.9 A resolution lattice image, which is the smallest lattice spacing in the specimen, corresponds to the minimum resolvable spatial frequency with 5% contrast in the contrast transfer function for annular dark field, and is smaller than the resolution limit given by the Rayleigh criterion. This demonstrates that STEM ADF imaging can have a resolution approximately 40% better than that of the bright field conventional transmission electron microscope (CTEM) imaging at Scherzer condition

Correction of a Depth-Dependent Lateral Distortion in 3D Super-Resolution Imaging.

Directory of Open Access Journals (Sweden)

Lina Carlini

Full Text Available Three-dimensional (3D localization-based super-resolution microscopy (SR requires correction of aberrations to accurately represent 3D structure. Here we show how a depth-dependent lateral shift in the apparent position of a fluorescent point source, which we term `wobble`, results in warped 3D SR images and provide a software tool to correct this distortion. This system-specific, lateral shift is typically > 80 nm across an axial range of ~ 1 μm. A theoretical analysis based on phase retrieval data from our microscope suggests that the wobble is caused by non-rotationally symmetric phase and amplitude aberrations in the microscope's pupil function. We then apply our correction to the bacterial cytoskeletal protein FtsZ in live bacteria and demonstrate that the corrected data more accurately represent the true shape of this vertically-oriented ring-like structure. We also include this correction method in a registration procedure for dual-color, 3D SR data and show that it improves target registration error (TRE at the axial limits over an imaging depth of 1 μm, yielding TRE values of < 20 nm. This work highlights the importance of correcting aberrations in 3D SR to achieve high fidelity between the measurements and the sample.

3D super-resolution imaging with blinking quantum dots

Science.gov (United States)

Wang, Yong; Fruhwirth, Gilbert; Cai, En; Ng, Tony; Selvin, Paul R.

2013-01-01

Quantum dots are promising candidates for single molecule imaging due to their exceptional photophysical properties, including their intense brightness and resistance to photobleaching. They are also notorious for their blinking. Here we report a novel way to take advantage of quantum dot blinking to develop an imaging technique in three-dimensions with nanometric resolution. We first applied this method to simulated images of quantum dots, and then to quantum dots immobilized on microspheres. We achieved imaging resolutions (FWHM) of 8–17 nm in the x-y plane and 58 nm (on coverslip) or 81 nm (deep in solution) in the z-direction, approximately 3–7 times better than what has been achieved previously with quantum dots. This approach was applied to resolve the 3D distribution of epidermal growth factor receptor (EGFR) molecules at, and inside of, the plasma membrane of resting basal breast cancer cells. PMID:24093439

Painting Supramolecular Polymers in Organic Solvents by Super-resolution Microscopy

Science.gov (United States)

2018-01-01

Despite the rapid development of complex functional supramolecular systems, visualization of these architectures under native conditions at high resolution has remained a challenging endeavor. Super-resolution microscopy was recently proposed as an effective tool to unveil one-dimensional nanoscale structures in aqueous media upon chemical functionalization with suitable fluorescent probes. Building upon our previous work, which enabled photoactivation localization microscopy in organic solvents, herein, we present the imaging of one-dimensional supramolecular polymers in their native environment by interface point accumulation for imaging in nanoscale topography (iPAINT). The noncovalent staining, typical of iPAINT, allows the investigation of supramolecular polymers’ structure in situ without any chemical modification. The quasi-permanent adsorption of the dye to the polymer is exploited to identify block-like arrangements within supramolecular fibers, which were obtained upon mixing homopolymers that were prestained with different colors. The staining of the blocks, maintained by the lack of exchange of the dyes, permits the imaging of complex structures for multiple days. This study showcases the potential of PAINT-like strategies such as iPAINT to visualize multicomponent dynamic systems in their native environment with an easy, synthesis-free approach and high spatial resolution. PMID:29697958

Super-nonlinear fluorescence microscopy for high-contrast deep tissue imaging

Science.gov (United States)

Wei, Lu; Zhu, Xinxin; Chen, Zhixing; Min, Wei

2014-02-01

Two-photon excited fluorescence microscopy (TPFM) offers the highest penetration depth with subcellular resolution in light microscopy, due to its unique advantage of nonlinear excitation. However, a fundamental imaging-depth limit, accompanied by a vanishing signal-to-background contrast, still exists for TPFM when imaging deep into scattering samples. Formally, the focusing depth, at which the in-focus signal and the out-of-focus background are equal to each other, is defined as the fundamental imaging-depth limit. To go beyond this imaging-depth limit of TPFM, we report a new class of super-nonlinear fluorescence microscopy for high-contrast deep tissue imaging, including multiphoton activation and imaging (MPAI) harnessing novel photo-activatable fluorophores, stimulated emission reduced fluorescence (SERF) microscopy by adding a weak laser beam for stimulated emission, and two-photon induced focal saturation imaging with preferential depletion of ground-state fluorophores at focus. The resulting image contrasts all exhibit a higher-order (third- or fourth- order) nonlinear signal dependence on laser intensity than that in the standard TPFM. Both the physical principles and the imaging demonstrations will be provided for each super-nonlinear microscopy. In all these techniques, the created super-nonlinearity significantly enhances the imaging contrast and concurrently extends the imaging depth-limit of TPFM. Conceptually different from conventional multiphoton processes mediated by virtual states, our strategy constitutes a new class of fluorescence microscopy where high-order nonlinearity is mediated by real population transfer.

Super-resolution for a point source using positive refraction

Science.gov (United States)

Miñano, Juan C.; Benítez, Pablo; González, Juan C.; Grabovičkić, Dejan; Ahmadpanahi, Hamed

Leonhardt demonstrated (2009) that the 2D Maxwell Fish Eye lens (MFE) can focus perfectly 2D Helmholtz waves of arbitrary frequency, i.e., it can transport perfectly an outward (monopole) 2D Helmholtz wave field, generated by a point source, towards a receptor called "perfect drain" (PD) located at the corresponding MFE image point. The PD has the property of absorbing the complete radiation without radiation or scattering and it has been claimed as necessary to obtain super-resolution (SR) in the MFE. However, a prototype using a "drain" different from the PD has shown λ/5 resolution for microwave frequencies (Ma et al, 2010). Recently, the SR properties of a device equivalent to the MFE, called the Spherical Geodesic Waveguide (SGW) (Miñano et al, 2012) have been analyzed. The reported results show resolution up to λ /3000, for the SGW loaded with the perfect drain, and up to λ /500 for the SGW without perfect drain. The perfect drain was realized as a coaxial probe loaded with properly calculated impedance. The SGW provides SR only in a narrow band of frequencies close to the resonance Schumann frequencies. Here we analyze the SGW loaded with a small "perfect drain region" (González et al, 2011). This drain is designed as a region made of a material with complex permittivity. The comparative results show that there is no significant difference in the SR properties for both perfect drain designs.

Super-Resolution for "Jilin-1" Satellite Video Imagery via a Convolutional Network.

Science.gov (United States)

Xiao, Aoran; Wang, Zhongyuan; Wang, Lei; Ren, Yexian

2018-04-13

Super-resolution for satellite video attaches much significance to earth observation accuracy, and the special imaging and transmission conditions on the video satellite pose great challenges to this task. The existing deep convolutional neural-network-based methods require pre-processing or post-processing to be adapted to a high-resolution size or pixel format, leading to reduced performance and extra complexity. To this end, this paper proposes a five-layer end-to-end network structure without any pre-processing and post-processing, but imposes a reshape or deconvolution layer at the end of the network to retain the distribution of ground objects within the image. Meanwhile, we formulate a joint loss function by combining the output and high-dimensional features of a non-linear mapping network to precisely learn the desirable mapping relationship between low-resolution images and their high-resolution counterparts. Also, we use satellite video data itself as a training set, which favors consistency between training and testing images and promotes the method's practicality. Experimental results on "Jilin-1" satellite video imagery show that this method demonstrates a superior performance in terms of both visual effects and measure metrics over competing methods.

Spatio-temporal image correlation spectroscopy and super-resolution microscopy to quantify molecular dynamics in T cells.

Science.gov (United States)

Ashdown, George W; Owen, Dylan M

2018-02-02

Many cellular processes are regulated by the spatio-temporal organisation of signalling complexes, cytoskeletal components and membranes. One such example is at the T cell immunological synapse where the retrograde flow of cortical filamentous (F)-actin from the synapse periphery drives signalling protein microclusters towards the synapse centre. The density of this mesh however, makes visualisation and analysis of individual actin fibres difficult due to the resolution limit of conventional microscopy. Recently, super-resolution methods such as structured illumination microscopy (SIM) have surpassed this resolution limit. Here, we apply SIM to better visualise the dense cortical actin meshwork in T cell synapses formed against activating, antibody-coated surfaces and image under total-internal reflection fluorescence (TIRF) illumination. To analyse the observed molecular flows, and the relationship between them, we apply spatio-temporal image correlation spectroscopy (STICS) and its cross-correlation variant (STICCS). We show that the dynamic cortical actin mesh can be visualised with unprecedented detail and that STICS/STICCS can output accurate, quantitative maps of molecular flow velocity and directionality from such data. We find that the actin flow can be disrupted using small molecule inhibitors of actin polymerisation. This combination of imaging and quantitative analysis may provide an important new tool for researchers to investigate the molecular dynamics at cellular length scales. Here we demonstrate the retrograde flow of F-actin which may be important for the clustering and dynamics of key signalling proteins within the plasma membrane, a phenomenon which is vital to correct T cell activation and therefore the mounting of an effective immune response. Copyright © 2018. Published by Elsevier Inc.

A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video

Directory of Open Access Journals (Sweden)

Zhang Liangpei

2007-01-01

Full Text Available Super-resolution (SR reconstruction technique is capable of producing a high-resolution image from a sequence of low-resolution images. In this paper, we study an efficient SR algorithm for digital video. To effectively deal with the intractable problems in SR video reconstruction, such as inevitable motion estimation errors, noise, blurring, missing regions, and compression artifacts, the total variation (TV regularization is employed in the reconstruction model. We use the fixed-point iteration method and preconditioning techniques to efficiently solve the associated nonlinear Euler-Lagrange equations of the corresponding variational problem in SR. The proposed algorithm has been tested in several cases of motion and degradation. It is also compared with the Laplacian regularization-based SR algorithm and other TV-based SR algorithms. Experimental results are presented to illustrate the effectiveness of the proposed algorithm.

The Light Field Attachment: Turning a DSLR into a Light Field Camera Using a Low Budget Camera Ring

KAUST Repository

Wang, Yuwang

2016-11-16

We propose a concept for a lens attachment that turns a standard DSLR camera and lens into a light field camera. The attachment consists of 8 low-resolution, low-quality side cameras arranged around the central high-quality SLR lens. Unlike most existing light field camera architectures, this design provides a high-quality 2D image mode, while simultaneously enabling a new high-quality light field mode with a large camera baseline but little added weight, cost, or bulk compared with the base DSLR camera. From an algorithmic point of view, the high-quality light field mode is made possible by a new light field super-resolution method that first improves the spatial resolution and image quality of the side cameras and then interpolates additional views as needed. At the heart of this process is a super-resolution method that we call iterative Patch- And Depth-based Synthesis (iPADS), which combines patch-based and depth-based synthesis in a novel fashion. Experimental results obtained for both real captured data and synthetic data confirm that our method achieves substantial improvements in super-resolution for side-view images as well as the high-quality and view-coherent rendering of dense and high-resolution light fields.

Super-resolution fluorescence imaging of membrane nanoscale architectures of hematopoietic stem cell homing and migration molecules

KAUST Repository

AbuZineh, Karmen

2017-12-01

Recent development of super-resolution (SR) fluorescence microscopy techniques has provided a new tool for direct visualization of subcellular structures and their dynamics in cells. The homing of Hematopoietic stem/progenitor cells (HSPCs) to bone marrow is a multistep process that is initiated by tethering of HSPCs to endothelium and mediated by spatiotemporally organised ligand-receptor interactions of selectins expressed on endothelial cells to their ligands expressed on HSPCs which occurs against the shear stress exerted by blood flow. Although molecules and biological processes involved in this multi-step cellular interaction have been studied extensively, molecular mechanisms of the homing, in particular the nanoscale spatiotemporal behaviour of ligand-receptor interactions and their role in the cellular interaction, remain elusive. Using our new method of microfluidics-based super-resolution fluorescence imaging platform we can now characterize the correlation between both nanoscale ligand-receptor interactions and tethering/rolling of cells under external shear stress. We found that cell rolling on E-selectin caused significant reorganization of the nanoscale clustering behavior of CD44 and CD43, from a patchy clusters of ~ 200 nm in size to an elongated network-like structures where for PSGL-1 the clustering size did not change significantly as it was 85 nm and after cell rolling the PSGL-1 aggregated to one side or even exhibited an increase in the footprint. Furthermore, I have established the use of 3D SR images that indicated that the patchy clusters of CD44 localize to protruding structures of the cell surface. On the other hand, a significant amount of the network-like elongated CD44 clusters observed after the rolling were located in the close proximity to the E-selectin surface. The effect of the nanoscale reorganization of the clusters on the HSPC rolling over selectins is still an open question at this stage. Nevertheless, my results further

Temporal super resolution using variational methods

DEFF Research Database (Denmark)

Keller, Sune Høgild; Lauze, Francois Bernard; Nielsen, Mads

2010-01-01

Temporal super resolution (TSR) is the ability to convert video from one frame rate to another and is as such a key functionality in modern video processing systems. A higher frame rate than what is recorded is desired for high frame rate displays, for super slow-motion, and for video/film format...... observed when watching video on large and bright displays where the motion of high contrast edges often seem jerky and unnatural. A novel motion compensated (MC) TSR algorithm using variational methods for both optical flow calculation and the actual new frame interpolation is presented. The flow...

Far-infrared imaging arrays for fusion plasma density and magnetic field measurements

International Nuclear Information System (INIS)

Neikirk, D.P.; Rutledge, D.B.

1982-01-01

Far-infrared imaging detector arrays are required for the determination of density and local magnetic field in fusion plasmas. Analytic calculations point out the difficulties with simple printed slot and dipole antennas on ungrounded substrates for use in submillimeter wave imaging arrays because of trapped surface waves. This is followed by a discussion of the use of substrate-lens coupling to eliminate the associated trapped surface modes responsible for their poor performance. This integrates well with a modified bow-tie antenna and permits diffraction-limited imaging. Arrays using bismuth microbolometers have been successfully fabricated and tested at 1222μm and 119μm. A 100 channel pilot experiment designed for the UCLA Microtor tokamak is described. (author)

Super-resolution fluorescence imaging of membrane nanoscale architectures of hematopoietic stem cell homing and migration molecules

KAUST Repository

AbuZineh, Karmen

2017-01-01

Recent development of super-resolution (SR) fluorescence microscopy techniques has provided a new tool for direct visualization of subcellular structures and their dynamics in cells. The homing of Hematopoietic stem/progenitor cells (HSPCs) to bone

Image Positioning Accuracy Analysis for Super Low Altitude Remote Sensing Satellites

Directory of Open Access Journals (Sweden)

Ming Xu

2012-10-01

Full Text Available Super low altitude remote sensing satellites maintain lower flight altitudes by means of ion propulsion in order to improve image resolution and positioning accuracy. The use of engineering data in design for achieving image positioning accuracy is discussed in this paper based on the principles of the photogrammetry theory. The exact line-of-sight rebuilding of each detection element and this direction precisely intersecting with the Earth's elliptical when the camera on the satellite is imaging are both ensured by the combined design of key parameters. These parameters include: orbit determination accuracy, attitude determination accuracy, camera exposure time, accurately synchronizing the reception of ephemeris with attitude data, geometric calibration and precise orbit verification. Precise simulation calculations show that image positioning accuracy of super low altitude remote sensing satellites is not obviously improved. The attitude determination error of a satellite still restricts its positioning accuracy.

Benchmark Modeling of the Near-Field and Far-Field Wave Effects of Wave Energy Arrays

Energy Technology Data Exchange (ETDEWEB)

Rhinefrank, Kenneth E; Haller, Merrick C; Ozkan-Haller, H Tuba

2013-01-26

This project is an industry-led partnership between Columbia Power Technologies and Oregon State University that will perform benchmark laboratory experiments and numerical modeling of the near-field and far-field impacts of wave scattering from an array of wave energy devices. These benchmark experimental observations will help to fill a gaping hole in our present knowledge of the near-field effects of multiple, floating wave energy converters and are a critical requirement for estimating the potential far-field environmental effects of wave energy arrays. The experiments will be performed at the Hinsdale Wave Research Laboratory (Oregon State University) and will utilize an array of newly developed Buoys' that are realistic, lab-scale floating power converters. The array of Buoys will be subjected to realistic, directional wave forcing (1:33 scale) that will approximate the expected conditions (waves and water depths) to be found off the Central Oregon Coast. Experimental observations will include comprehensive in-situ wave and current measurements as well as a suite of novel optical measurements. These new optical capabilities will include imaging of the 3D wave scattering using a binocular stereo camera system, as well as 3D device motion tracking using a newly acquired LED system. These observing systems will capture the 3D motion history of individual Buoys as well as resolve the 3D scattered wave field; thus resolving the constructive and destructive wave interference patterns produced by the array at high resolution. These data combined with the device motion tracking will provide necessary information for array design in order to balance array performance with the mitigation of far-field impacts. As a benchmark data set, these data will be an important resource for testing of models for wave/buoy interactions, buoy performance, and far-field effects on wave and current patterns due to the presence of arrays. Under the proposed project we will initiate

Far field acceleration

International Nuclear Information System (INIS)

Fernow, R.C.

1995-07-01

Far fields are propagating electromagnetic waves far from their source, boundary surfaces, and free charges. The general principles governing the acceleration of charged particles by far fields are reviewed. A survey of proposed field configurations is given. The two most important schemes, Inverse Cerenkov acceleration and Inverse free electron laser acceleration, are discussed in detail

Dual Super-Systolic Core for Real-Time Reconstructive Algorithms of High-Resolution Radar/SAR Imaging Systems

Science.gov (United States)

Atoche, Alejandro Castillo; Castillo, Javier Vázquez

2012-01-01

A high-speed dual super-systolic core for reconstructive signal processing (SP) operations consists of a double parallel systolic array (SA) machine in which each processing element of the array is also conceptualized as another SA in a bit-level fashion. In this study, we addressed the design of a high-speed dual super-systolic array (SSA) core for the enhancement/reconstruction of remote sensing (RS) imaging of radar/synthetic aperture radar (SAR) sensor systems. The selected reconstructive SP algorithms are efficiently transformed in their parallel representation and then, they are mapped into an efficient high performance embedded computing (HPEC) architecture in reconfigurable Xilinx field programmable gate array (FPGA) platforms. As an implementation test case, the proposed approach was aggregated in a HW/SW co-design scheme in order to solve the nonlinear ill-posed inverse problem of nonparametric estimation of the power spatial spectrum pattern (SSP) from a remotely sensed scene. We show how such dual SSA core, drastically reduces the computational load of complex RS regularization techniques achieving the required real-time operational mode. PMID:22736964

Super-resolution pupil filtering for visual performance enhancement using adaptive optics

Science.gov (United States)

Zhao, Lina; Dai, Yun; Zhao, Junlei; Zhou, Xiaojun

2018-05-01

Ocular aberration correction can significantly improve visual function of the human eye. However, even under ideal aberration correction conditions, pupil diffraction restricts the resolution of retinal images. Pupil filtering is a simple super-resolution (SR) method that can overcome this diffraction barrier. In this study, a 145-element piezoelectric deformable mirror was used as a pupil phase filter because of its programmability and high fitting accuracy. Continuous phase-only filters were designed based on Zernike polynomial series and fitted through closed-loop adaptive optics. SR results were validated using double-pass point spread function images. Contrast sensitivity was further assessed to verify the SR effect on visual function. An F-test was conducted for nested models to statistically compare different CSFs. These results indicated CSFs for the proposed SR filter were significantly higher than the diffraction correction (p vision optical correction of the human eye.

Single image super resolution algorithm based on edge interpolation in NSCT domain

Science.gov (United States)

Zhang, Mengqun; Zhang, Wei; He, Xinyu

2017-11-01

In order to preserve the texture and edge information and to improve the space resolution of single frame, a superresolution algorithm based on Contourlet (NSCT) is proposed. The original low resolution image is transformed by NSCT, and the directional sub-band coefficients of the transform domain are obtained. According to the scale factor, the high frequency sub-band coefficients are amplified by the interpolation method based on the edge direction to the desired resolution. For high frequency sub-band coefficients with noise and weak targets, Bayesian shrinkage is used to calculate the threshold value. The coefficients below the threshold are determined by the correlation among the sub-bands of the same scale to determine whether it is noise and de-noising. The anisotropic diffusion filter is used to effectively enhance the weak target in the low contrast region of the target and background. Finally, the high-frequency sub-band is amplified by the bilinear interpolation method to the desired resolution, and then combined with the high-frequency subband coefficients after de-noising and small target enhancement, the NSCT inverse transform is used to obtain the desired resolution image. In order to verify the effectiveness of the proposed algorithm, the proposed algorithm and several common image reconstruction methods are used to test the synthetic image, motion blurred image and hyperspectral image, the experimental results show that compared with the traditional single resolution algorithm, the proposed algorithm can obtain smooth edges and good texture features, and the reconstructed image structure is well preserved and the noise is suppressed to some extent.

Parallel detecting super-resolution microscopy using correlation based image restoration

Science.gov (United States)

Yu, Zhongzhi; Liu, Shaocong; Zhu, Dazhao; Kuang, Cuifang; Liu, Xu

2017-12-01

A novel approach to achieve the image restoration is proposed in which each detector's relative position in the detector array is no longer a necessity. We can identify each detector's relative location by extracting a certain area from one of the detector's image and scanning it on other detectors' images. According to this location, we can generate the point spread functions (PSF) for each detector and perform deconvolution for image restoration. Equipped with this method, the microscope with discretionally designed detector array can be easily constructed without the concern of exact relative locations of detectors. The simulated results and experimental results show the total improvement in resolution with a factor of 1.7 compared to conventional confocal fluorescence microscopy. With the significant enhancement in resolution and easiness for application of this method, this novel method should have potential for a wide range of application in fluorescence microscopy based on parallel detecting.

Finite detector based projection model for super resolution CT

Energy Technology Data Exchange (ETDEWEB)

Yu, Hengyong; Wang, Ge [Wake Forest Univ. Health Sciences, Winston-Salem, NC (United States). Dept. of Radiology; Virgina Tech, Blacksburg, VA (United States). Biomedical Imaging Div.

2011-07-01

For finite detector and focal spot sizes, here we propose a projection model for super resolution CT. First, for a given X-ray source point, a projection datum is modeled as an area integral over a narrow fan-beam connecting the detector elemental borders and the X-ray source point. Then, the final projection value is expressed as the integral obtained in the first step over the whole focal spot support. An ordered-subset simultaneous algebraic reconstruction technique (OS-SART) is developed using the proposed projection model. In the numerical simulation, our method produces super spatial resolution and suppresses high-frequency artifacts. (orig.)

Polarization-Dependent Measurements of Molecular Super Rotors with Oriented Angular Momenta

Science.gov (United States)

Murray, Matthew J.; Toro, Carlos; Liu, Qingnan; Mullin, Amy S.

2014-05-01

Controlling molecular motion would enable manipulation of energy flow between molecules. Here we have used an optical centrifuge to investigate energy transfer between molecular super rotors with oriented angular momenta. The polarizable electron cloud of the molecules interacts with the electric field of linearly polarized light that angularly accelerates over the time of the optical pulse. This process drives molecules into high angular momentum states that are oriented with the optical field and have energies far from equilibrium. High resolution transient IR spectroscopy reveals the dynamics of collisional energy transfer for these super excited rotors. The results of this study leads to a more fundamental understanding of energy balance in non-equilibrium environments and the physical and chemical properties of gases in a new regime of energy states. Results will be presented for several super rotor species including carbon monoxide, carbon dioxide, and acetylene. Polarization-dependent measurements reveal the extent to which the super rotors maintain spatial orientation of high angular momentum states.

Extracting 220 Hz information from 55 Hz field data by near-field superresolution imaging

KAUST Repository

Dutta, Gaurav

2016-05-31

Field experiments are used to unequivocally demonstrate seismic superresolution imaging of subwavelength objects in the near-field region of the source. The field test is for a conventional hammer source striking a metal plate near subwavelength scatterers and the seismic data are recorded by vertical-component geophones in the far-field locations of the sources. Time-reversal mirrors (TRMs) are then used to refocus the scattered energy with subwavelength resolution to the position of the original source. A spatial resolution of lambda/10, where lambda is the dominant wavelength associated with the data, is seen in the field tests that exceeds the Abbe resolution limit of lambda/2.

Extracting 220 Hz information from 55 Hz field data by near-field superresolution imaging

KAUST Repository

Dutta, Gaurav; AlTheyab, Abdullah; Tarhini, Ahmad; Hanafy, Sherif; Schuster, Gerard T.

2016-01-01

Field experiments are used to unequivocally demonstrate seismic superresolution imaging of subwavelength objects in the near-field region of the source. The field test is for a conventional hammer source striking a metal plate near subwavelength scatterers and the seismic data are recorded by vertical-component geophones in the far-field locations of the sources. Time-reversal mirrors (TRMs) are then used to refocus the scattered energy with subwavelength resolution to the position of the original source. A spatial resolution of lambda/10, where lambda is the dominant wavelength associated with the data, is seen in the field tests that exceeds the Abbe resolution limit of lambda/2.

Ordinal Regression Based Subpixel Shift Estimation for Video Super-Resolution

Directory of Open Access Journals (Sweden)

Petrovic Nemanja

2007-01-01

Full Text Available We present a supervised learning-based approach for subpixel motion estimation which is then used to perform video super-resolution. The novelty of this work is the formulation of the problem of subpixel motion estimation in a ranking framework. The ranking formulation is a variant of classification and regression formulation, in which the ordering present in class labels namely, the shift between patches is explicitly taken into account. Finally, we demonstrate the applicability of our approach on superresolving synthetically generated images with global subpixel shifts and enhancing real video frames by accounting for both local integer and subpixel shifts.

Topological sensitivity based far-field detection of elastic inclusions

Directory of Open Access Journals (Sweden)

Tasawar Abbas

2018-03-01

Full Text Available The aim of this article is to present and rigorously analyze topological sensitivity based algorithms for detection of diametrically small inclusions in an isotropic homogeneous elastic formation using single and multiple measurements of the far-field scattering amplitudes. A L2-cost functional is considered and a location indicator is constructed from its topological derivative. The performance of the indicator is analyzed in terms of the topological sensitivity for location detection and stability with respect to measurement and medium noises. It is established that the location indicator does not guarantee inclusion detection and achieves only a low resolution when there is mode-conversion in an elastic formation. Accordingly, a weighted location indicator is designed to tackle the mode-conversion phenomenon. It is substantiated that the weighted function renders the location of an inclusion stably with resolution as per Rayleigh criterion. 2000 MSC: 35R30, 35L05, 74B05, 47A52, 65J20, Keywords: Inverse elastic scattering, Elasticity imaging, Topological derivative, Resolution analysis, Stability analysis

Interactive local super-resolution reconstruction of whole-body MRI mouse data: a pilot study with applications to bone and kidney metastases.

Directory of Open Access Journals (Sweden)

Oleh Dzyubachyk

Full Text Available In small animal imaging studies, when the locations of the micro-structures of interest are unknown a priori, there is a simultaneous need for full-body coverage and high resolution. In MRI, additional requirements to image contrast and acquisition time will often make it impossible to acquire such images directly. Recently, a resolution enhancing post-processing technique called super-resolution reconstruction (SRR has been demonstrated to improve visualization and localization of micro-structures in small animal MRI by combining multiple low-resolution acquisitions. However, when the field-of-view is large relative to the desired voxel size, solving the SRR problem becomes very expensive, in terms of both memory requirements and computation time. In this paper we introduce a novel local approach to SRR that aims to overcome the computational problems and allow researchers to efficiently explore both global and local characteristics in whole-body small animal MRI. The method integrates state-of-the-art image processing techniques from the areas of articulated atlas-based segmentation, planar reformation, and SRR. A proof-of-concept is provided with two case studies involving CT, BLI, and MRI data of bone and kidney tumors in a mouse model. We show that local SRR-MRI is a computationally efficient complementary imaging modality for the precise characterization of tumor metastases, and that the method provides a feasible high-resolution alternative to conventional MRI.

Interactive local super-resolution reconstruction of whole-body MRI mouse data: a pilot study with applications to bone and kidney metastases.

Science.gov (United States)

Dzyubachyk, Oleh; Khmelinskii, Artem; Plenge, Esben; Kok, Peter; Snoeks, Thomas J A; Poot, Dirk H J; Löwik, Clemens W G M; Botha, Charl P; Niessen, Wiro J; van der Weerd, Louise; Meijering, Erik; Lelieveldt, Boudewijn P F

2014-01-01

In small animal imaging studies, when the locations of the micro-structures of interest are unknown a priori, there is a simultaneous need for full-body coverage and high resolution. In MRI, additional requirements to image contrast and acquisition time will often make it impossible to acquire such images directly. Recently, a resolution enhancing post-processing technique called super-resolution reconstruction (SRR) has been demonstrated to improve visualization and localization of micro-structures in small animal MRI by combining multiple low-resolution acquisitions. However, when the field-of-view is large relative to the desired voxel size, solving the SRR problem becomes very expensive, in terms of both memory requirements and computation time. In this paper we introduce a novel local approach to SRR that aims to overcome the computational problems and allow researchers to efficiently explore both global and local characteristics in whole-body small animal MRI. The method integrates state-of-the-art image processing techniques from the areas of articulated atlas-based segmentation, planar reformation, and SRR. A proof-of-concept is provided with two case studies involving CT, BLI, and MRI data of bone and kidney tumors in a mouse model. We show that local SRR-MRI is a computationally efficient complementary imaging modality for the precise characterization of tumor metastases, and that the method provides a feasible high-resolution alternative to conventional MRI.

Three-dimensional super-resolved live cell imaging through polarized multi-angle TIRF.

Science.gov (United States)

Zheng, Cheng; Zhao, Guangyuan; Liu, Wenjie; Chen, Youhua; Zhang, Zhimin; Jin, Luhong; Xu, Yingke; Kuang, Cuifang; Liu, Xu

2018-04-01

Measuring three-dimensional nanoscale cellular structures is challenging, especially when the structure is dynamic. Owing to the informative total internal reflection fluorescence (TIRF) imaging under varied illumination angles, multi-angle (MA) TIRF has been examined to offer a nanoscale axial and a subsecond temporal resolution. However, conventional MA-TIRF still performs badly in lateral resolution and fails to characterize the depth image in densely distributed regions. Here, we emphasize the lateral super-resolution in the MA-TIRF, exampled by simply introducing polarization modulation into the illumination procedure. Equipped with a sparsity and accelerated proximal algorithm, we examine a more precise 3D sample structure compared with previous methods, enabling live cell imaging with a temporal resolution of 2 s and recovering high-resolution mitochondria fission and fusion processes. We also shared the recovery program, which is the first open-source recovery code for MA-TIRF, to the best of our knowledge.

Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging

Science.gov (United States)

Errico, Claudia; Pierre, Juliette; Pezet, Sophie; Desailly, Yann; Lenkei, Zsolt; Couture, Olivier; Tanter, Mickael

2015-11-01

Non-invasive imaging deep into organs at microscopic scales remains an open quest in biomedical imaging. Although optical microscopy is still limited to surface imaging owing to optical wave diffusion and fast decorrelation in tissue, revolutionary approaches such as fluorescence photo-activated localization microscopy led to a striking increase in resolution by more than an order of magnitude in the last decade. In contrast with optics, ultrasonic waves propagate deep into organs without losing their coherence and are much less affected by in vivo decorrelation processes. However, their resolution is impeded by the fundamental limits of diffraction, which impose a long-standing trade-off between resolution and penetration. This limits clinical and preclinical ultrasound imaging to a sub-millimetre scale. Here we demonstrate in vivo that ultrasound imaging at ultrafast frame rates (more than 500 frames per second) provides an analogue to optical localization microscopy by capturing the transient signal decorrelation of contrast agents—inert gas microbubbles. Ultrafast ultrasound localization microscopy allowed both non-invasive sub-wavelength structural imaging and haemodynamic quantification of rodent cerebral microvessels (less than ten micrometres in diameter) more than ten millimetres below the tissue surface, leading to transcranial whole-brain imaging within short acquisition times (tens of seconds). After intravenous injection, single echoes from individual microbubbles were detected through ultrafast imaging. Their localization, not limited by diffraction, was accumulated over 75,000 images, yielding 1,000,000 events per coronal plane and statistically independent pixels of ten micrometres in size. Precise temporal tracking of microbubble positions allowed us to extract accurately in-plane velocities of the blood flow with a large dynamic range (from one millimetre per second to several centimetres per second). These results pave the way for deep non

Super-resolution microscopy as a potential approach to diagnosis of platelet granule disorders.

Science.gov (United States)

Westmoreland, D; Shaw, M; Grimes, W; Metcalf, D J; Burden, J J; Gomez, K; Knight, A E; Cutler, D F

2016-04-01

Many platelet functions are dependent on bioactive molecules released from their granules. Deficiencies of these granules in number, shape or content are associated with bleeding. The small size of these granules is such that imaging them for diagnosis has traditionally required electron microscopy. However, recently developed super-resolution microscopes provide sufficient spatial resolution to effectively image platelet granules. When combined with automated image analysis, these methods provide a quantitative, unbiased, rapidly acquired dataset that can readily and reliably reveal differences in platelet granules between individuals. To demonstrate the ability of structured illumination microscopy (SIM) to efficiently differentiate between healthy volunteers and three patients with Hermansky-Pudlak syndrome. Blood samples were taken from three patients with Hermansky-Pudlak syndrome and seven controls. Patients 1-3 have gene defects in HPS1, HPS6 and HPS5, respectively; all controls were healthy volunteers. Platelet-rich plasma was isolated from blood and the platelets fixed, stained for CD63 and processed for analysis by immunofluorescence microscopy, using a custom-built SIM microscope. SIM can successfully resolve CD63-positive structures in fixed platelets. A determination of the number of CD63-positive structures per platelet allowed us to conclude that each patient was significantly different from all of the controls with 99% confidence. A super-resolution imaging approach is effective and rapid in objectively differentiating between patients with a platelet bleeding disorder and healthy volunteers. CD63 is a useful marker for predicting Hermansky-Pudlak syndrome and could be used in the diagnosis of patients suspected of other platelet granule disorders. © 2016 The Authors. Journal of Thrombosis and Haemostasis published by Wiley Periodicals, Inc. on behalf of International Society on Thrombosis and Haemostasis.

Classification of high resolution remote sensing image based on geo-ontology and conditional random fields

Science.gov (United States)

Hong, Liang

2013-10-01

The availability of high spatial resolution remote sensing data provides new opportunities for urban land-cover classification. More geometric details can be observed in the high resolution remote sensing image, Also Ground objects in the high resolution remote sensing image have displayed rich texture, structure, shape and hierarchical semantic characters. More landscape elements are represented by a small group of pixels. Recently years, the an object-based remote sensing analysis methodology is widely accepted and applied in high resolution remote sensing image processing. The classification method based on Geo-ontology and conditional random fields is presented in this paper. The proposed method is made up of four blocks: (1) the hierarchical ground objects semantic framework is constructed based on geoontology; (2) segmentation by mean-shift algorithm, which image objects are generated. And the mean-shift method is to get boundary preserved and spectrally homogeneous over-segmentation regions ;(3) the relations between the hierarchical ground objects semantic and over-segmentation regions are defined based on conditional random fields framework ;(4) the hierarchical classification results are obtained based on geo-ontology and conditional random fields. Finally, high-resolution remote sensed image data -GeoEye, is used to testify the performance of the presented method. And the experimental results have shown the superiority of this method to the eCognition method both on the effectively and accuracy, which implies it is suitable for the classification of high resolution remote sensing image.

Development of a super-resolution optical microscope for directional dark matter search experiment

International Nuclear Information System (INIS)

Alexandrov, A.; Asada, T.; Consiglio, L.; D'Ambrosio, N.; De Lellis, G.; Di Crescenzo, A.; Di Marco, N.; Furuya, S.; Hakamata, K.; Ishikawa, M.; Katsuragawa, T.; Kuwabara, K.; Machii, S.; Naka, T.; Pupilli, F.; Sirignano, C.; Tawara, Y.; Tioukov, V.; Umemoto, A.; Yoshimoto, M.

2016-01-01

Nuclear emulsion is a perfect choice for a detector for directional DM search because of its high density and excellent position accuracy. The minimal detectable track length of a recoil nucleus in emulsion is required to be at least 100 nm, making the resolution of conventional optical microscopes insufficient to resolve them. Here we report about the R&D on a super-resolution optical microscope to be used in future directional DM search experiments with nuclear emulsion as a detector media. The microscope will be fully automatic, will use novel image acquisition and analysis techniques, will achieve the spatial resolution of the order of few tens of nm and will be capable of reconstructing recoil tracks with the length of at least 100 nm with high angular resolution.

SuperDARN HF Scattering and Propagation in the Presence of Polar Patches Imaged Using RISR

Science.gov (United States)

Gillies, R. G.; Perry, G. W.; Varney, R. H.; Gillies, D. M.; Donovan, E.

2017-12-01

The global array of High Frequency (HF) Super Dual Auroral Radar Network (SuperDARN) radars continuously monitors ionospheric convection in the middle-to-high latitude region. The radars measure coherent backscatter from decameter scale field-aligned irregularities. One of the main generation mechanisms for these field-aligned irregularities is the gradient drift instability (GDI). The edges of ionospheric density structures, such as polar cap patches, provide ideal locations for GDI growth. The geometry required for GDI growth results in irregularities forming on the trailing edge of polar patches. However, irregularities generated by the non-linear evolution of the GDI can become prevalent throughout the patch within minutes. Modelling the irregularity growth and measurements of backscatter within patches have both confirmed this. One aspect that has often been overlooked in studies of coherent backscatter within patches is the effect of HF propagation on echo location. This study examines HF echo locations in the vicinity of patches that were imaged using the Resolute Bay Incoherent Scatter Radars (RISR). The effect of both vertical and lateral refraction of the HF wave on echo location is examined.

Low-Power Super-resolution Readout with Antimony Bismuth Alloy Film as Mask layer

International Nuclear Information System (INIS)

Lai-Xin, Jiang; Yi-Qun, Wu; Yang, Wang; Jing-Song, Wei; Fu-Xi, Gan

2009-01-01

Sb–Bi alloy films are proposed as a new kind of super-resolution mask layer with low readout threshold power. Using the Sb–Bi alloy film as a mask layer and SiN as a protective layer in a read-only memory disc, the super-resolution pits with diameters of 380 nm are read out by a dynamic setup, the laser wavelength is 780 nm and the numerical aperture of pickup lens is 0.45. The effects of the Sb–Bi thin film thickness, laser readout power and disc rotating velocity on the readout signal are investigated. The results show that the threshold laser power of super-resolution readout of the Sb–Bi mask layer is about 0.5 mW, and the corresponding carrier-to-noise ratio is about 20 dB at the film thickness of 50 nm. The super-resolution mechanism of the Sb–Bi alloy mask layer is discussed based on its temperature dependence of reflection

Super Talbot effect in indefinite metamaterial.

Science.gov (United States)

Zhao, Wangshi; Huang, Xiaoyue; Lu, Zhaolin

2011-08-01

The Talbot effect (or the self-imaging effect) can be observed for a periodic object with a pitch larger than the diffraction limit of an imaging system, where the paraxial approximation is applied. In this paper, we show that the super Talbot effect can be achieved in an indefinite metamaterial even when the period is much smaller than the diffraction limit in both two-dimensional and three-dimensional numerical simulations, where the paraxial approximation is not applied. This is attributed to the evanescent waves, which carry the information about subwavelength features of the object, can be converted into propagating waves and then conveyed to far field by the metamaterial, where the permittivity in the propagation direction is negative while the transverse ones are positive. The indefinite metamaterial can be approximated by a system of thin, alternating multilayer metal and insulator (MMI) stack. As long as the loss of the metamaterial is small enough, deep subwavelength image size can be obtained in the super Talbot effect.

The Light Field Attachment: Turning a DSLR into a Light Field Camera Using a Low Budget Camera Ring

KAUST Repository

Wang, Yuwang; Liu, Yebin; Heidrich, Wolfgang; Dai, Qionghai

2016-01-01

camera. From an algorithmic point of view, the high-quality light field mode is made possible by a new light field super-resolution method that first improves the spatial resolution and image quality of the side cameras and then interpolates additional

Developing a New Biophysical Tool to Combine Magneto-Optical Tweezers with Super-Resolution Fluorescence Microscopy

Directory of Open Access Journals (Sweden)

Zhaokun Zhou

2015-06-01

Full Text Available We present a novel experimental setup in which magnetic and optical tweezers are combined for torque and force transduction onto single filamentous molecules in a transverse configuration to allow simultaneous mechanical measurement and manipulation. Previously we have developed a super-resolution imaging module which, in conjunction with advanced imaging techniques such as Blinking assisted Localisation Microscopy (BaLM, achieves localisation precision of single fluorescent dye molecules bound to DNA of ~30 nm along the contour of the molecule; our work here describes developments in producing a system which combines tweezing and super-resolution fluorescence imaging. The instrument also features an acousto-optic deflector that temporally divides the laser beam to form multiple traps for high throughput statistics collection. Our motivation for developing the new tool is to enable direct observation of detailed molecular topological transformation and protein binding event localisation in a stretching/twisting mechanical assay that previously could hitherto only be deduced indirectly from the end-to-end length variation of DNA. Our approach is simple and robust enough for reproduction in the lab without the requirement of precise hardware engineering, yet is capable of unveiling the elastic and dynamic properties of filamentous molecules that have been hidden using traditional tools.

A Microfluidic Cytometer for Complete Blood Count With a 3.2-Megapixel, 1.1- μm-Pitch Super-Resolution Image Sensor in 65-nm BSI CMOS.

Science.gov (United States)

Liu, Xu; Huang, Xiwei; Jiang, Yu; Xu, Hang; Guo, Jing; Hou, Han Wei; Yan, Mei; Yu, Hao

2017-08-01

Based on a 3.2-Megapixel 1.1- μm-pitch super-resolution (SR) CMOS image sensor in a 65-nm backside-illumination process, a lens-free microfluidic cytometer for complete blood count (CBC) is demonstrated in this paper. Backside-illumination improves resolution and contrast at the device level with elimination of surface treatment when integrated with microfluidic channels. A single-frame machine-learning-based SR processing is further realized at system level for resolution correction with minimum hardware resources. The demonstrated microfluidic cytometer can detect the platelet cells (< 2 μm) required in CBC, hence is promising for point-of-care diagnostics.

Extending the Capture Volume of an Iris Recognition System Using Wavefront Coding and Super-Resolution.

Science.gov (United States)

Hsieh, Sheng-Hsun; Li, Yung-Hui; Tien, Chung-Hao; Chang, Chin-Chen

2016-12-01

Iris recognition has gained increasing popularity over the last few decades; however, the stand-off distance in a conventional iris recognition system is too short, which limits its application. In this paper, we propose a novel hardware-software hybrid method to increase the stand-off distance in an iris recognition system. When designing the system hardware, we use an optimized wavefront coding technique to extend the depth of field. To compensate for the blurring of the image caused by wavefront coding, on the software side, the proposed system uses a local patch-based super-resolution method to restore the blurred image to its clear version. The collaborative effect of the new hardware design and software post-processing showed great potential in our experiment. The experimental results showed that such improvement cannot be achieved by using a hardware-or software-only design. The proposed system can increase the capture volume of a conventional iris recognition system by three times and maintain the system's high recognition rate.

Adaptive patch-based POCS approach for super resolution reconstruction of 4D-CT lung data

International Nuclear Information System (INIS)

Wang, Tingting; Cao, Lei; Yang, Wei; Feng, Qianjin; Chen, Wufan; Zhang, Yu

2015-01-01

Image enhancement of lung four-dimensional computed tomography (4D-CT) data is highly important because image resolution remains a crucial point in lung cancer radiotherapy. In this paper, we proposed a method for lung 4D-CT super resolution (SR) by using an adaptive-patch-based projection onto convex sets (POCS) approach, which is in contrast with the global POCS SR algorithm, to recover fine details with lesser artifacts in images. The main contribution of this patch-based approach is that the interfering local structure from other phases can be rejected by employing a similar patch adaptive selection strategy. The effectiveness of our approach is demonstrated through experiments on simulated images and real lung 4D-CT datasets. A comparison with previously published SR reconstruction methods highlights the favorable characteristics of the proposed method. (paper)

Super resolution reconstruction of μ-CT image of rock sample using neighbour embedding algorithm

Science.gov (United States)

Wang, Yuzhu; Rahman, Sheik S.; Arns, Christoph H.

2018-03-01

X-ray computed tomography (μ-CT) is considered to be the most effective way to obtain the inner structure of rock sample without destructions. However, its limited resolution hampers its ability to probe sub-micro structures which is critical for flow transportation of rock sample. In this study, we propose an innovative methodology to improve the resolution of μ-CT image using neighbour embedding algorithm where low frequency information is provided by μ-CT image itself while high frequency information is supplemented by high resolution scanning electron microscopy (SEM) image. In order to obtain prior for reconstruction, a large number of image patch pairs contain high- and low- image patches are extracted from the Gaussian image pyramid generated by SEM image. These image patch pairs contain abundant information about tomographic evolution of local porous structures under different resolution spaces. Relying on the assumption of self-similarity of porous structure, this prior information can be used to supervise the reconstruction of high resolution μ-CT image effectively. The experimental results show that the proposed method is able to achieve the state-of-the-art performance.

Direct measurement of the near-field super resolved focused spot in InSb

NARCIS (Netherlands)

Assafrao, A.C.; Wachters, A.J.H.; Verheijen, M.; Nugrowati, A.M.; Pereira, S.F.; Urbach, H.P.; Armand, M.F.; Olivier, S.

2012-01-01

Under appropriate laser exposure, a thin film of InSb exhibits a sub-wavelength thermally modified area that can be used to focus light beyond the diffraction limit. This technique, called Super-Resolution Near-Field Structure, is a potential candidate for ultrahigh density optical data storage and

Super-Resolution for “Jilin-1” Satellite Video Imagery via a Convolutional Network

Directory of Open Access Journals (Sweden)

Aoran Xiao

2018-04-01

Full Text Available Super-resolution for satellite video attaches much significance to earth observation accuracy, and the special imaging and transmission conditions on the video satellite pose great challenges to this task. The existing deep convolutional neural-network-based methods require pre-processing or post-processing to be adapted to a high-resolution size or pixel format, leading to reduced performance and extra complexity. To this end, this paper proposes a five-layer end-to-end network structure without any pre-processing and post-processing, but imposes a reshape or deconvolution layer at the end of the network to retain the distribution of ground objects within the image. Meanwhile, we formulate a joint loss function by combining the output and high-dimensional features of a non-linear mapping network to precisely learn the desirable mapping relationship between low-resolution images and their high-resolution counterparts. Also, we use satellite video data itself as a training set, which favors consistency between training and testing images and promotes the method’s practicality. Experimental results on “Jilin-1” satellite video imagery show that this method demonstrates a superior performance in terms of both visual effects and measure metrics over competing methods.

Field programmable gate array based reconfigurable scanning probe/optical microscope.

Science.gov (United States)

Nowak, Derek B; Lawrence, A J; Dzegede, Zechariah K; Hiester, Justin C; Kim, Cliff; Sánchez, Erik J

2011-10-01

The increasing popularity of nanometrology and nanospectroscopy has pushed researchers to develop complex new analytical systems. This paper describes the development of a platform on which to build a microscopy tool that will allow for flexibility of customization to suit research needs. The novelty of the described system lies in its versatility of capabilities. So far, one version of this microscope has allowed for successful near-field and far-field fluorescence imaging with single molecule detection sensitivity. This system is easily adapted for reflection, polarization (Kerr magneto-optical (MO)), Raman, super-resolution techniques, and other novel scanning probe imaging and spectroscopic designs. While collecting a variety of forms of optical images, the system can simultaneously monitor topographic information of a sample with an integrated tuning fork based shear force system. The instrument has the ability to image at room temperature and atmospheric pressure or under liquid. The core of the design is a field programmable gate array (FPGA) data acquisition card and a single, low cost computer to control the microscope with analog control circuitry using off-the-shelf available components. A detailed description of electronics, mechanical requirements, and software algorithms as well as examples of some different forms of the microscope developed so far are discussed.

Current limitations in super-resolution fluorescence microscopy for biological specimens: How deep can we go from the cover glass?

Science.gov (United States)

Okada, Yasushi

2017-04-01

Diffraction limit of resolution has been one of the biggest limitations in the optical microscopy. Super-resolution fluorescence microscopy has enabled us to break this limit. However, for the observations of real biological specimens, especially for the imaging of tissues or whole body, the target structures of interest are often embedded deep inside the specimen. Here, we would present our results to extend the target of the super-resolution microscopy deeper into the cells. Confocal microscope optics work effectively to minimize the effect by the aberrations by the cellular components, but at the expense of the signal intensities. Spherical aberrations by the refractive index mismatch between the cellular environment and the immersion liquid can be much larger, but can be reduced by adjusting the correction collar at the objective lens.

Single image super-resolution using locally adaptive multiple linear regression.

Science.gov (United States)

Yu, Soohwan; Kang, Wonseok; Ko, Seungyong; Paik, Joonki

2015-12-01

This paper presents a regularized superresolution (SR) reconstruction method using locally adaptive multiple linear regression to overcome the limitation of spatial resolution of digital images. In order to make the SR problem better-posed, the proposed method incorporates the locally adaptive multiple linear regression into the regularization process as a local prior. The local regularization prior assumes that the target high-resolution (HR) pixel is generated by a linear combination of similar pixels in differently scaled patches and optimum weight parameters. In addition, we adapt a modified version of the nonlocal means filter as a smoothness prior to utilize the patch redundancy. Experimental results show that the proposed algorithm better restores HR images than existing state-of-the-art methods in the sense of the most objective measures in the literature.

Super-resolution structure of DNA significantly differs in buccal cells of controls and Alzheimer's patients.

Science.gov (United States)

Garcia, Angeles; Huang, David; Righolt, Amanda; Righolt, Christiaan; Kalaw, Maria Carmela; Mathur, Shubha; McAvoy, Elizabeth; Anderson, James; Luedke, Angela; Itorralba, Justine; Mai, Sabine

2017-09-01

The advent of super-resolution microscopy allowed for new insights into cellular and physiological processes of normal and diseased cells. In this study, we report for the first time on the super-resolved DNA structure of buccal cells from patients with Alzheimer's disease (AD) versus age- and gender-matched healthy, non-caregiver controls. In this super-resolution study cohort of 74 participants, buccal cells were collected and their spatial DNA organization in the nucleus examined by 3D Structured Illumination Microscopy (3D-SIM). Quantitation of the super-resolution DNA structure revealed that the nuclear super-resolution DNA structure of individuals with AD significantly differs from that of their controls (p structure of AD significantly differs in mild, moderate, and severe disease with respect to the DNA-containing and DNA-free/poor spaces. We conclude that whole genome remodeling is a feature of buccal cells in AD. © 2016 The Authors. Journal of Cellular Physiology Published by Wiley Periodicals, Inc.

sl(1|2) Super-Toda Fields

Science.gov (United States)

Yang, Zhan-Ying; Xue, Pan-Pan; Zhao, Liu; Shi, Kang-Jie

2008-11-01

Explicit exact solution of supersymmetric Toda fields associated with the Lie superalgebra sl(2|1) is constructed. The approach used is a super extension of Leznov Saveliev algebraic analysis, which is based on a pair of chiral and antichiral Drienfeld Sokolov systems. Though such approach is well understood for Toda field theories associated with ordinary Lie algebras, its super analogue was only successful in the super Liouville case with the underlying Lie superalgebra osp(1|2). The problem lies in that a key step in the construction makes use of the tensor product decomposition of the highest weight representations of the underlying Lie superalgebra, which is not clear until recently. So our construction made in this paper presents a first explicit example of Leznov Saveliev analysis for super Toda systems associated with underlying Lie superalgebras of the rank higher than 1.

sl(1|2) Super-Toda Fields

International Nuclear Information System (INIS)

Yang Zhanying; Xue Panpan; Zhao Liu; Shi Kangjie

2008-01-01

Explicit exact solution of supersymmetric Toda fields associated with the Lie superalgebra sl(2|1) is constructed. The approach used is a super extension of Leznov-Saveliev algebraic analysis, which is based on a pair of chiral and antichiral Drienfeld-Sokolov systems. Though such approach is well understood for Toda field theories associated with ordinary Lie algebras, its super analogue was only successful in the super Liouville case with the underlying Lie superalgebra osp(1|2). The problem lies in that a key step in the construction makes use of the tensor product decomposition of the highest weight representations of the underlying Lie superalgebra, which is not clear until recently. So our construction made in this paper presents a first explicit example of Leznov-Saveliev analysis for super Toda systems associated with underlying Lie superalgebras of the rank higher than 1

Terahertz-wave near-field imaging with subwavelength resolution using surface-wave-assisted bow-tie aperture

Science.gov (United States)

Ishihara, Kunihiko; Ohashi, Keishi; Ikari, Tomofumi; Minamide, Hiroaki; Yokoyama, Hiroyuki; Shikata, Jun-ichi; Ito, Hiromasa

2006-11-01

We demonstrate the terahertz-wave near-field imaging with subwavelength resolution using a bow-tie shaped aperture surrounded by concentric periodic structures in a metal film. A subwavelength aperture with concentric periodic grooves, which are known as a bull's eye structure, shows extremely large enhanced transmission beyond the diffraction limit caused by the resonant excitation of surface waves. Additionally, a bow-tie aperture exhibits extraordinary field enhancement at the sharp tips of the metal, which enhances the transmission and the subwavelength spatial resolution. We introduced a bow-tie aperture to the bull's eye structure and achieved high spatial resolution (˜λ/17) in the near-field region. The terahertz-wave near-field image of the subwavelength metal pattern (pattern width=20μm) was obtained for the wavelength of 207μm.

Memory-effect based deconvolution microscopy for super-resolution imaging through scattering media

Science.gov (United States)

Edrei, Eitan; Scarcelli, Giuliano

2016-09-01

High-resolution imaging through turbid media is a fundamental challenge of optical sciences that has attracted a lot of attention in recent years for its wide range of potential applications. Here, we demonstrate that the resolution of imaging systems looking behind a highly scattering medium can be improved below the diffraction-limit. To achieve this, we demonstrate a novel microscopy technique enabled by the optical memory effect that uses a deconvolution image processing and thus it does not require iterative focusing, scanning or phase retrieval procedures. We show that this newly established ability of direct imaging through turbid media provides fundamental and practical advantages such as three-dimensional refocusing and unambiguous object reconstruction.

High-resolution imaging of magnetic fields using scanning superconducting quantum interference device (SQUID) microscopy

Science.gov (United States)

Fong de Los Santos, Luis E.

Development of a scanning superconducting quantum interference device (SQUID) microscope system with interchangeable sensor configurations for imaging magnetic fields of room-temperature (RT) samples with sub-millimeter resolution. The low-critical-temperature (Tc) niobium-based monolithic SQUID sensor is mounted in the tip of a sapphire rod and thermally anchored to the cryostat helium reservoir. A 25 mum sapphire window separates the vacuum space from the RT sample. A positioning mechanism allows adjusting the sample-to-sensor spacing from the top of the Dewar. I have achieved a sensor-to-sample spacing of 100 mum, which could be maintained for periods of up to 4 weeks. Different SQUID sensor configurations are necessary to achieve the best combination of spatial resolution and field sensitivity for a given magnetic source. For imaging thin sections of geological samples, I used a custom-designed monolithic low-Tc niobium bare SQUID sensor, with an effective diameter of 80 mum, and achieved a field sensitivity of 1.5 pT/Hz1/2 and a magnetic moment sensitivity of 5.4 x 10-18 Am2/Hz1/2 at a sensor-to-sample spacing of 100 mum in the white noise region for frequencies above 100 Hz. Imaging action currents in cardiac tissue requires higher field sensitivity, which can only be achieved by compromising spatial resolution. I developed a monolithic low-Tc niobium multiloop SQUID sensor, with sensor sizes ranging from 250 mum to 1 mm, and achieved sensitivities of 480 - 180 fT/Hz1/2 in the white noise region for frequencies above 100 Hz, respectively. For all sensor configurations, the spatial resolution was comparable to the effective diameter and limited by the sensor-to-sample spacing. Spatial registration allowed us to compare high-resolution images of magnetic fields associated with action currents and optical recordings of transmembrane potentials to study the bidomain nature of cardiac tissue or to match petrography to magnetic field maps in thin sections of

Coherent optical adaptive technique improves the spatial resolution of STED microscopy in thick samples

Science.gov (United States)

Yan, Wei; Yang, Yanlong; Tan, Yu; Chen, Xun; Li, Yang; Qu, Junle; Ye, Tong

2018-01-01

Stimulated emission depletion microscopy (STED) is one of far-field optical microscopy techniques that can provide sub-diffraction spatial resolution. The spatial resolution of the STED microscopy is determined by the specially engineered beam profile of the depletion beam and its power. However, the beam profile of the depletion beam may be distorted due to aberrations of optical systems and inhomogeneity of specimens’ optical properties, resulting in a compromised spatial resolution. The situation gets deteriorated when thick samples are imaged. In the worst case, the sever distortion of the depletion beam profile may cause complete loss of the super resolution effect no matter how much depletion power is applied to specimens. Previously several adaptive optics approaches have been explored to compensate aberrations of systems and specimens. However, it is hard to correct the complicated high-order optical aberrations of specimens. In this report, we demonstrate that the complicated distorted wavefront from a thick phantom sample can be measured by using the coherent optical adaptive technique (COAT). The full correction can effectively maintain and improve the spatial resolution in imaging thick samples. PMID:29400356

Correlative Super-Resolution Microscopy: New Dimensions and New Opportunities.

Science.gov (United States)

Hauser, Meghan; Wojcik, Michal; Kim, Doory; Mahmoudi, Morteza; Li, Wan; Xu, Ke

2017-06-14

Correlative microscopy, the integration of two or more microscopy techniques performed on the same sample, produces results that emphasize the strengths of each technique while offsetting their individual weaknesses. Light microscopy has historically been a central method in correlative microscopy due to its widespread availability, compatibility with hydrated and live biological samples, and excellent molecular specificity through fluorescence labeling. However, conventional light microscopy can only achieve a resolution of ∼300 nm, undercutting its advantages in correlations with higher-resolution methods. The rise of super-resolution microscopy (SRM) over the past decade has drastically improved the resolution of light microscopy to ∼10 nm, thus creating exciting new opportunities and challenges for correlative microscopy. Here we review how these challenges are addressed to effectively correlate SRM with other microscopy techniques, including light microscopy, electron microscopy, cryomicroscopy, atomic force microscopy, and various forms of spectroscopy. Though we emphasize biological studies, we also discuss the application of correlative SRM to materials characterization and single-molecule reactions. Finally, we point out current limitations and discuss possible future improvements and advances. We thus demonstrate how a correlative approach adds new dimensions of information and provides new opportunities in the fast-growing field of SRM.

Resolution enhancement in medical ultrasound imaging.

Science.gov (United States)

Ploquin, Marie; Basarab, Adrian; Kouamé, Denis

2015-01-01

Image resolution enhancement is a problem of considerable interest in all medical imaging modalities. Unlike general purpose imaging or video processing, for a very long time, medical image resolution enhancement has been based on optimization of the imaging devices. Although some recent works purport to deal with image postprocessing, much remains to be done regarding medical image enhancement via postprocessing, especially in ultrasound imaging. We face a resolution improvement issue in the case of medical ultrasound imaging. We propose to investigate this problem using multidimensional autoregressive (AR) models. Noting that the estimation of the envelope of an ultrasound radio frequency (RF) signal is very similar to the estimation of classical Fourier-based power spectrum estimation, we theoretically show that a domain change and a multidimensional AR model can be used to achieve super-resolution in ultrasound imaging provided the order is estimated correctly. Here, this is done by means of a technique that simultaneously estimates the order and the parameters of a multidimensional model using relevant regression matrix factorization. Doing so, the proposed method specifically fits ultrasound imaging and provides an estimated envelope. Moreover, an expression that links the theoretical image resolution to both the image acquisition features (such as the point spread function) and a postprocessing feature (the AR model) order is derived. The overall contribution of this work is threefold. First, it allows for automatic resolution improvement. Through a simple model and without any specific manual algorithmic parameter tuning, as is used in common methods, the proposed technique simply and exclusively uses the ultrasound RF signal as input and provides the improved B-mode as output. Second, it allows for the a priori prediction of the improvement in resolution via the knowledge of the parametric model order before actual processing. Finally, to achieve the

Graphene-enabled electron microscopy and correlated super-resolution microscopy of wet cells.

Science.gov (United States)

Wojcik, Michal; Hauser, Margaret; Li, Wan; Moon, Seonah; Xu, Ke

2015-06-11

The application of electron microscopy to hydrated biological samples has been limited by high-vacuum operating conditions. Traditional methods utilize harsh and laborious sample dehydration procedures, often leading to structural artefacts and creating difficulties for correlating results with high-resolution fluorescence microscopy. Here, we utilize graphene, a single-atom-thick carbon meshwork, as the thinnest possible impermeable and conductive membrane to protect animal cells from vacuum, thus enabling high-resolution electron microscopy of wet and untreated whole cells with exceptional ease. Our approach further allows for facile correlative super-resolution and electron microscopy of wet cells directly on the culturing substrate. In particular, individual cytoskeletal actin filaments are resolved in hydrated samples through electron microscopy and well correlated with super-resolution results.

Extracting a Good Quality Frontal Face Image from a Low-Resolution Video Sequence

DEFF Research Database (Denmark)

Nasrollahi, Kamal; Moeslund, Thomas B.

2011-01-01

Feeding low-resolution and low-quality images, from inexpensive surveillance cameras, to systems like, e.g., face recognition, produces erroneous and unstable results. Therefore, there is a need for a mechanism to bridge the gap between on one hand low-resolution and low-quality images......, we use a learning-based super-resolution algorithm applied to the result of the reconstruction-based part to improve the quality by another factor of two. This results in an improvement factor of four for the entire system. The proposed system has been tested on 122 low-resolution sequences from two...... different databases. The experimental results show that the proposed system can indeed produce a high-resolution and good quality frontal face image from low-resolution video sequences....

Inverse transformation algorithm of transient electromagnetic field and its high-resolution continuous imaging interpretation method

International Nuclear Information System (INIS)

Qi, Zhipeng; Li, Xiu; Lu, Xushan; Zhang, Yingying; Yao, Weihua

2015-01-01

We introduce a new and potentially useful method for wave field inverse transformation and its application in transient electromagnetic method (TEM) 3D interpretation. The diffusive EM field is known to have a unique integral representation in terms of a fictitious wave field that satisfies a wave equation. The continuous imaging of TEM can be accomplished using the imaging methods in seismic interpretation after the diffusion equation is transformed into a fictitious wave equation. The interpretation method based on the imaging of a fictitious wave field could be used as a fast 3D inversion method. Moreover, the fictitious wave field possesses some wave field features making it possible for the application of a wave field interpretation method in TEM to improve the prospecting resolution.Wave field transformation is a key issue in the migration imaging of a fictitious wave field. The equation in the wave field transformation belongs to the first class Fredholm integration equation, which is a typical ill-posed equation. Additionally, TEM has a large dynamic time range, which also facilitates the weakness of this ill-posed problem. The wave field transformation is implemented by using pre-conditioned regularized conjugate gradient method. The continuous imaging of a fictitious wave field is implemented by using Kirchhoff integration. A synthetic aperture and deconvolution algorithm is also introduced to improve the interpretation resolution. We interpreted field data by the method proposed in this paper, and obtained a satisfying interpretation result. (paper)

Super-Resolution Imaging of Protein Secretion Systems and the Cell Surface of Gram-Negative Bacteria

Directory of Open Access Journals (Sweden)

Sachith D. Gunasinghe

2017-05-01

Full Text Available Gram-negative bacteria have a highly evolved cell wall with two membranes composed of complex arrays of integral and peripheral proteins, as well as phospholipids and glycolipids. In order to sense changes in, respond to, and exploit their environmental niches, bacteria rely on structures assembled into or onto the outer membrane. Protein secretion across the cell wall is a key process in virulence and other fundamental aspects of bacterial cell biology. The final stage of protein secretion in Gram-negative bacteria, translocation across the outer membrane, is energetically challenging so sophisticated nanomachines have evolved to meet this challenge. Advances in fluorescence microscopy now allow for the direct visualization of the protein secretion process, detailing the dynamics of (i outer membrane biogenesis and the assembly of protein secretion systems into the outer membrane, (ii the spatial distribution of these and other membrane proteins on the bacterial cell surface, and (iii translocation of effector proteins, toxins and enzymes by these protein secretion systems. Here we review the frontier research imaging the process of secretion, particularly new studies that are applying various modes of super-resolution microscopy.

Improvement of Breast Cancer Detection Using Non-subsampled Contourlet Transform and Super-Resolution Technique in Mammographic Images

Directory of Open Access Journals (Sweden)

Fatemeh Pak

2015-05-01

Full Text Available Introduction Breast cancer is one of the most life-threatening conditions among women. Early detection of this disease is the only way to reduce the associated mortality rate. Mammography is a standard method for the early detection of breast cancer. Today, considering the importance of breast cancer detection, computer-aided detection techniques have been employed to increase the quality of mammographic images and help physicians reduce false positive rate (FPR. Materials and Methods In this study, a method was proposed for improving the quality of mammographic images to help radiologists establish a prompt and accurate diagnosis. The proposed approach included three major parts including pre-processing, feature extraction, and classification. In the pre-processing stage, the region of interest was determined and the image quality was improved by non-subsampled contourlet transform and super-resolution algorithm. In the feature extraction stage, some features of image components were extracted and skewness of each feature was calculated. Finally, a support vector machine was utilized to classify the features and determine the probability of benignity or malignancy of the disease. Results Based on the obtained results using Mammographic Image Analysis Society (MIAS database, the mean accuracy was estimated at 87.26% and maximum accuracy was 96.29%. Also, the mean and minimum FPRs were estimated at 9.55% and 2.87%, respectively.     Conclusion The results obtained using MIAS database indicated the superiority of the proposed method to other techniques. The reduced FPR in the proposed method was a significant finding in the present article.

Imaging of a large collection of human embryo using a super-parallel MR microscope

International Nuclear Information System (INIS)

Matsuda, Yoshimasa; Ono, Shinya; Otake, Yosuke; Handa, Shinya; Kose, Katsumi; Haishi, Tomoyuki; Yamada, Shigeto; Uwabe, Chikako; Shiota, Kohei

2007-01-01

Using 4 and 8-channel super-parallel magnetic resonance (MR) microscopes with a horizontal bore 2.34T superconducting magnet developed for 3-dimensional MR microscopy of the large Kyoto Collection of Human Embryos, we acquired T 1 -weighted 3D images of 1204 embryos at a spatial resolution of (40 μm) 3 to (150 μm) 3 in about 2 years. Similarity of image contrast between the T 1 -weighted images and stained anatomical sections indicated that T 1 -weighted 3D images could be used for an anatomical 3D image database for human embryology. (author)

High resolution imaging of dielectric surfaces with an evanescent field optical microscope

NARCIS (Netherlands)

van Hulst, N.F.; Segerink, Franciscus B.; Bölger, B.

1992-01-01

An evanescent field optical microscope (EFOM) is presented which employs frustrated total internal reflection o­n a localized scale by scanning a dielectric tip in close proximity to a sample surface. High resolution images of dielectric gratings and spheres containing both topographic and

Optimized labeling of membrane proteins for applications to super-resolution imaging in confined cellular environments using monomeric streptavidin.

Science.gov (United States)

Chamma, Ingrid; Rossier, Olivier; Giannone, Grégory; Thoumine, Olivier; Sainlos, Matthieu

2017-04-01

Recent progress in super-resolution imaging (SRI) has created a strong need to improve protein labeling with probes of small size that minimize the target-to-label distance, increase labeling density, and efficiently penetrate thick biological tissues. This protocol describes a method for labeling genetically modified proteins incorporating a small biotin acceptor peptide with a 3-nm fluorescent probe, monomeric streptavidin. We show how to express, purify, and conjugate the probe to organic dyes with different fluorescent properties, and how to label selectively biotinylated membrane proteins for SRI techniques (point accumulation in nanoscale topography (PAINT), stimulated emission depletion (STED), stochastic optical reconstruction microscopy (STORM)). This method is complementary to the previously described anti-GFP-nanobody/SNAP-tag strategies, with the main advantage being that it requires only a short 15-amino-acid tag, and can thus be used with proteins resistant to fusion with large tags and for multicolor imaging. The protocol requires standard molecular biology/biochemistry equipment, making it easily accessible for laboratories with only basic skills in cell biology and biochemistry. The production/purification/conjugation steps take ∼5 d, and labeling takes a few minutes to an hour.

Study on super-resolution three-dimensional range-gated imaging technology

Science.gov (United States)

Guo, Huichao; Sun, Huayan; Wang, Shuai; Fan, Youchen; Li, Yuanmiao

2018-04-01

Range-gated three dimensional imaging technology is a hotspot in recent years, because of the advantages of high spatial resolution, high range accuracy, long range, and simultaneous reflection of target reflectivity information. Based on the study of the principle of intensity-related method, this paper has carried out theoretical analysis and experimental research. The experimental system adopts the high power pulsed semiconductor laser as light source, gated ICCD as the imaging device, can realize the imaging depth and distance flexible adjustment to achieve different work mode. The imaging experiment of small imaging depth is carried out aiming at building 500m away, and 26 group images were obtained with distance step 1.5m. In this paper, the calculation method of 3D point cloud based on triangle method is analyzed, and 15m depth slice of the target 3D point cloud are obtained by using two frame images, the distance precision is better than 0.5m. The influence of signal to noise ratio, illumination uniformity and image brightness on distance accuracy are analyzed. Based on the comparison with the time-slicing method, a method for improving the linearity of point cloud is proposed.

Sparsity-Based Pixel Super Resolution for Lens-Free Digital In-line Holography.

Science.gov (United States)

Song, Jun; Leon Swisher, Christine; Im, Hyungsoon; Jeong, Sangmoo; Pathania, Divya; Iwamoto, Yoshiko; Pivovarov, Misha; Weissleder, Ralph; Lee, Hakho

2016-04-21

Lens-free digital in-line holography (LDIH) is a promising technology for portable, wide field-of-view imaging. Its resolution, however, is limited by the inherent pixel size of an imaging device. Here we present a new computational approach to achieve sub-pixel resolution for LDIH. The developed method is a sparsity-based reconstruction with the capability to handle the non-linear nature of LDIH. We systematically characterized the algorithm through simulation and LDIH imaging studies. The method achieved the spatial resolution down to one-third of the pixel size, while requiring only single-frame imaging without any hardware modifications. This new approach can be used as a general framework to enhance the resolution in nonlinear holographic systems.

Multispectral image enhancement processing for microsat-borne imager

Science.gov (United States)

Sun, Jianying; Tan, Zheng; Lv, Qunbo; Pei, Linlin

2017-10-01

With the rapid development of remote sensing imaging technology, the micro satellite, one kind of tiny spacecraft, appears during the past few years. A good many studies contribute to dwarfing satellites for imaging purpose. Generally speaking, micro satellites weigh less than 100 kilograms, even less than 50 kilograms, which are slightly larger or smaller than the common miniature refrigerators. However, the optical system design is hard to be perfect due to the satellite room and weight limitation. In most cases, the unprocessed data captured by the imager on the microsatellite cannot meet the application need. Spatial resolution is the key problem. As for remote sensing applications, the higher spatial resolution of images we gain, the wider fields we can apply them. Consequently, how to utilize super resolution (SR) and image fusion to enhance the quality of imagery deserves studying. Our team, the Key Laboratory of Computational Optical Imaging Technology, Academy Opto-Electronics, is devoted to designing high-performance microsat-borne imagers and high-efficiency image processing algorithms. This paper addresses a multispectral image enhancement framework for space-borne imagery, jointing the pan-sharpening and super resolution techniques to deal with the spatial resolution shortcoming of microsatellites. We test the remote sensing images acquired by CX6-02 satellite and give the SR performance. The experiments illustrate the proposed approach provides high-quality images.

In vivo high resolution human corneal imaging using full-field optical coherence tomography.

Science.gov (United States)

Mazlin, Viacheslav; Xiao, Peng; Dalimier, Eugénie; Grieve, Kate; Irsch, Kristina; Sahel, José-Alain; Fink, Mathias; Boccara, A Claude

2018-02-01

We present the first full-field optical coherence tomography (FFOCT) device capable of in vivo imaging of the human cornea. We obtained images of the epithelial structures, Bowman's layer, sub-basal nerve plexus (SNP), anterior and posterior stromal keratocytes, stromal nerves, Descemet's membrane and endothelial cells with visible nuclei. Images were acquired with a high lateral resolution of 1.7 µm and relatively large field-of-view of 1.26 mm x 1.26 mm - a combination, which, to the best of our knowledge, has not been possible with other in vivo human eye imaging methods. The latter together with a contactless operation, make FFOCT a promising candidate for becoming a new tool in ophthalmic diagnostics.

Far field photoluminescence imaging of single AlGaN nanowire in the sub-wavelength scale using confinement of polarized light

Energy Technology Data Exchange (ETDEWEB)

Sivadasan, A.K.; Dhara, Sandip [Nanomaterials and Sensors Section, Surface and Nanoscience Division, Indira Gandhi Centre for Atomic Research, Homi Bhabha National Institute, Kalpakkam (India); Sardar, Manas [Theoretical Studies Section, Materials Physics Division, Indira Gandhi Centre for Atomic Research, Kalpakkam (India)

2017-03-15

Till now the nanoscale focusing and imaging in the sub-diffraction limit is achieved mainly with the help of plasmonic field enhancement by confining the light assisted with noble metal nanostructures. Using far field imaging technique, we have recorded polarized spectroscopic photoluminescence (PL) imaging of a single AlGaN nanowire (NW) of diameter ∝100 nm using confinement of polarized light. It is found that the PL from a single NW is influenced by the proximity to other NWs. The PL intensity is proportional to 1/(l x d), where l and d are the average NW length and separation between the NWs, respectively. We suggest that the proximity induced PL intensity enhancement can be understood by assuming the existence of reasonably long lived photons in the intervening space between the NWs. A nonzero non-equilibrium population of such photons may cause stimulated emission leading to the enhancement of PL emission with the intensity proportional to 1/(l x d). The enhancement of PL emission facilitates far field spectroscopic imaging of a single semiconductor AlGaN NW of sub-wavelength dimension. (copyright 2016 by WILEY-VCH Verlag GmbH and Co. KGaA, Weinheim)

Brain Slice Staining and Preparation for Three-Dimensional Super-Resolution Microscopy

Science.gov (United States)

German, Christopher L.; Gudheti, Manasa V.; Fleckenstein, Annette E.; Jorgensen, Erik M.

2018-01-01

Localization microscopy techniques – such as photoactivation localization microscopy (PALM), fluorescent PALM (FPALM), ground state depletion (GSD), and stochastic optical reconstruction microscopy (STORM) – provide the highest precision for single molecule localization currently available. However, localization microscopy has been largely limited to cell cultures due to the difficulties that arise in imaging thicker tissue sections. Sample fixation and antibody staining, background fluorescence, fluorophore photoinstability, light scattering in thick sections, and sample movement create significant challenges for imaging intact tissue. We have developed a sample preparation and image acquisition protocol to address these challenges in rat brain slices. The sample preparation combined multiple fixation steps, saponin permeabilization, and tissue clarification. Together, these preserve intracellular structures, promote antibody penetration, reduce background fluorescence and light scattering, and allow acquisition of images deep in a 30 μm thick slice. Image acquisition challenges were resolved by overlaying samples with a permeable agarose pad and custom-built stainless steel imaging adapter, and sealing the imaging chamber. This approach kept slices flat, immobile, bathed in imaging buffer, and prevented buffer oxidation during imaging. Using this protocol, we consistently obtained single molecule localizations of synaptic vesicle and active zone proteins in three-dimensions within individual synaptic terminals of the striatum in rat brain slices. These techniques may be easily adapted to the preparation and imaging of other tissues, substantially broadening the application of super-resolution imaging. PMID:28924666

The Far-Field Hubble Constant

Science.gov (United States)

Lauer, Tod

1995-07-01

We request deep, near-IR (F814W) WFPC2 images of five nearby Brightest Cluster Galaxies (BCG) to calibrate the BCG Hubble diagram by the Surface Brightness Fluctuation (SBF) method. Lauer & Postman (1992) show that the BCG Hubble diagram measured out to 15,000 km s^-1 is highly linear. Calibration of the Hubble diagram zeropoint by SBF will thus yield an accurate far-field measure of H_0 based on the entire volume within 15,000 km s^-1, thus circumventing any strong biases caused by local peculiar velocity fields. This method of reaching the far field is contrasted with those using distance ratios between Virgo and Coma, or any other limited sample of clusters. HST is required as the ground-based SBF method is limited to team developed the SBF method, the first BCG Hubble diagram based on a full-sky, volume-limited BCG sample, played major roles in the calibration of WFPC and WFPC2, and are conducting observations of local galaxies that will validate the SBF zeropoint (through GTO programs). This work uses the SBF method to tie both the Cepheid and Local Group giant-branch distances generated by HST to the large scale Hubble flow, which is most accurately traced by BCGs.

Three-dimensional velocity map imaging: Setup and resolution improvement compared to three-dimensional ion imaging

International Nuclear Information System (INIS)

Kauczok, S.; Goedecke, N.; Veckenstedt, M.; Maul, C.; Gericke, K.-H.; Chichinin, A. I.

2009-01-01

For many years the three-dimensional (3D) ion imaging technique has not benefited from the introduction of ion optics into the field of imaging in molecular dynamics. Thus, a lower resolution of kinetic energy as in comparable techniques making use of inhomogeneous electric fields was inevitable. This was basically due to the fact that a homogeneous electric field was needed in order to obtain the velocity component in the direction of the time of flight spectrometer axis. In our approach we superimpose an Einzel lens field with the homogeneous field. We use a simulation based technique to account for the distortion of the ion cloud caused by the inhomogeneous field. In order to demonstrate the gain in kinetic energy resolution compared to conventional 3D Ion Imaging, we use the spatial distribution of H + ions emerging from the photodissociation of HCl following the two photon excitation to the V 1 Σ + state. So far a figure of merit of approximately four has been achieved, which means in absolute numbers Δv/v=0.022 compared to 0.086 at v≅17 000 m/s. However, this is not a theoretical limit of the technique, but due to our rather short TOF spectrometer (15 cm). The photodissociation of HBr near 243 nm has been used to recognize and eliminate systematic deviations between the simulation and the experimentally observed distribution. The technique has also proven to be essential for the precise measurement of translationally cold distributions.

Light-Induced Fluorescence Modulation of Quantum Dot-Crystal Violet Conjugates: Stochastic Off-On-Off Cycles for Multicolor Patterning and Super-Resolution.

Science.gov (United States)

Jung, Sungwook; Park, Joonhyuck; Bang, Jiwon; Kim, Jae-Yeol; Kim, Cheolhee; Jeon, Yongmoon; Lee, Seung Hwan; Jin, Ho; Choi, Sukyung; Kim, Bomi; Lee, Woo Jin; Pack, Chan-Gi; Lee, Jong-Bong; Lee, Nam Ki; Kim, Sungjee

2017-06-07

Photoswitching or modulation of quantum dots (QDs) can be promising for many fields that include display, memory, and super-resolution imaging. However, such modulations have mostly relied on photomodulations of conjugated molecules in QD vicinity, which typically require high power of high energy photons at UV. We report a visible light-induced facile modulation route for QD-dye conjugates. QD crystal violets conjugates (QD-CVs) were prepared and the crystal violet (CV) molecules on QD quenched the fluorescence efficiently. The fluorescence of QD-CVs showed a single cycle of emission burst as they go through three stages of (i) initially quenched "off" to (ii) photoactivated "on" as the result of chemical change of CVs induced by photoelectrons from QD and (iii) back to photodarkened "off" by radical-associated reactions. Multicolor on-demand photopatterning was demonstrated using QD-CV solid films. QD-CVs were introduced into cells, and excitation with visible light yielded photomodulation from "off" to "on" and "off" by nearly ten fold. Individual photoluminescence dynamics of QD-CVs was investigated using fluorescence correlation spectroscopy and single QD emission analysis, which revealed temporally stochastic photoactivations and photodarkenings. Exploiting the stochastic fluorescence burst of QD-CVs, simultaneous multicolor super-resolution localizations were demonstrated.

Deep Learning based Super-Resolution for Improved Action Recognition

DEFF Research Database (Denmark)

Nasrollahi, Kamal; Guerrero, Sergio Escalera; Rasti, Pejman

2015-01-01

with results of a state-of- the-art deep learning-based super-resolution algorithm, through an alpha-blending approach. The experimental results obtained on down-sampled version of a large subset of Hoolywood2 benchmark database show the importance of the proposed system in increasing the recognition rate...

Super-resolution reconstruction of 4D-CT lung data via patch-based low-rank matrix reconstruction

Science.gov (United States)

Fang, Shiting; Wang, Huafeng; Liu, Yueliang; Zhang, Minghui; Yang, Wei; Feng, Qianjin; Chen, Wufan; Zhang, Yu

2017-10-01

Lung 4D computed tomography (4D-CT), which is a time-resolved CT data acquisition, performs an important role in explicitly including respiratory motion in treatment planning and delivery. However, the radiation dose is usually reduced at the expense of inter-slice spatial resolution to minimize radiation-related health risk. Therefore, resolution enhancement along the superior-inferior direction is necessary. In this paper, a super-resolution (SR) reconstruction method based on a patch low-rank matrix reconstruction is proposed to improve the resolution of lung 4D-CT images. Specifically, a low-rank matrix related to every patch is constructed by using a patch searching strategy. Thereafter, the singular value shrinkage is employed to recover the high-resolution patch under the constraints of the image degradation model. The output high-resolution patches are finally assembled to output the entire image. This method is extensively evaluated using two public data sets. Quantitative analysis shows that the proposed algorithm decreases the root mean square error by 9.7%-33.4% and the edge width by 11.4%-24.3%, relative to linear interpolation, back projection (BP) and Zhang et al’s algorithm. A new algorithm has been developed to improve the resolution of 4D-CT. In all experiments, the proposed method outperforms various interpolation methods, as well as BP and Zhang et al’s method, thus indicating the effectivity and competitiveness of the proposed algorithm.

Resolution limits of migration and linearized waveform inversion images in a lossy medium

KAUST Repository

Schuster, Gerard T.; Dutta, Gaurav; Li, Jing

2017-01-01

The vertical-and horizontal-resolution limits Delta x(lossy) and Delta z(lossy) of post-stack migration and linearized waveform inversion images are derived for lossy data in the far-field approximation. Unlike the horizontal resolution limit Delta x proportional to lambda z/L in a lossless medium which linearly worsens in depth z, Delta x(lossy) proportional to z(2)/QL worsens quadratically with depth for a medium with small Q values. Here, Q is the quality factor, lambda is the effective wavelength, L is the recording aperture, and loss in the resolution formulae is accounted for by replacing lambda with z/Q. In contrast, the lossy vertical-resolution limit Delta z(lossy) only worsens linearly in depth compared to Delta z proportional to lambda for a lossless medium. For both the causal and acausal Q models, the resolution limits are linearly proportional to 1/Q for small Q. These theoretical predictions are validated with migration images computed from lossy data.

Resolution limits of migration and linearized waveform inversion images in a lossy medium

KAUST Repository

Schuster, Gerard T.

2017-03-10

The vertical-and horizontal-resolution limits Delta x(lossy) and Delta z(lossy) of post-stack migration and linearized waveform inversion images are derived for lossy data in the far-field approximation. Unlike the horizontal resolution limit Delta x proportional to lambda z/L in a lossless medium which linearly worsens in depth z, Delta x(lossy) proportional to z(2)/QL worsens quadratically with depth for a medium with small Q values. Here, Q is the quality factor, lambda is the effective wavelength, L is the recording aperture, and loss in the resolution formulae is accounted for by replacing lambda with z/Q. In contrast, the lossy vertical-resolution limit Delta z(lossy) only worsens linearly in depth compared to Delta z proportional to lambda for a lossless medium. For both the causal and acausal Q models, the resolution limits are linearly proportional to 1/Q for small Q. These theoretical predictions are validated with migration images computed from lossy data.

Quality of radiation field imaging

International Nuclear Information System (INIS)

Petr, I.

1988-01-01

The questions were studied of the quality of imaging the gamma radiation field and of the limits of the quality in directional detector scanning. A resolution angle was introduced to quantify the imaging quality, and its relation was sought with the detection effective half-angle of the directional detector. The resolution angle was defined for the simplest configuration of the radiation field consisting of two monoenergetic gamma beams in one plane. It was shown that the resolution angle decreases, i.e., resolution in imaging the radiation field is better, with the effective half-angle of the directional detector. It was also found that resolution of both gamma beams deteriorated when the beams were surrounded with an isotropic background field. If the beams are surrounded with a background field showing general distribution, the angle size will be affected not only by the properties of the detector but also by the distribution of the ambient radiation field and the method of its scanning. The method described can be applied in designing a directional detector necessary for imaging the presumed radiation field in the required quality. (Z.M.). 4 figs., 3 refs

Plasmon point spread functions: How do we model plasmon-mediated emission processes?

Science.gov (United States)

Willets, Katherine A.

2014-02-01

A major challenge with studying plasmon-mediated emission events is the small size of plasmonic nanoparticles relative to the wavelength of light. Objects smaller than roughly half the wavelength of light will appear as diffraction-limited spots in far-field optical images, presenting a significant experimental challenge for studying plasmonic processes on the nanoscale. Super-resolution imaging has recently been applied to plasmonic nanosystems and allows plasmon-mediated emission to be resolved on the order of ˜5 nm. In super-resolution imaging, a diffraction-limited spot is fit to some model function in order to calculate the position of the emission centroid, which represents the location of the emitter. However, the accuracy of the centroid position strongly depends on how well the fitting function describes the data. This Perspective discusses the commonly used two-dimensional Gaussian fitting function applied to super-resolution imaging of plasmon-mediated emission, then introduces an alternative model based on dipole point spread functions. The two fitting models are compared and contrasted for super-resolution imaging of nanoparticle scattering/luminescence, surface-enhanced Raman scattering, and surface-enhanced fluorescence.

The Refining Mechanism of Super Gravity on the Solidification Structure of Al-Cu Alloys

Directory of Open Access Journals (Sweden)

Yuhou Yang

2016-12-01

Full Text Available There is far less study of the refining effect of super gravity fields on solidification structures of metals than of the effects of electrical currents, magnetic and ultrasonic fields. Moreover, the refining mechanisms of super gravity are far from clear. This study applied a super gravity field to Al-Cu alloys to investigate its effect on refining their structures and the mechanism of interaction. The experimental results showed that the solidification structure of Al-Cu alloys can be greatly refined by a super gravity field. The major refining effect was mainly achieved when super gravity was applied at the initial solidification stage; only slight refinement could be obtained towards the end of solidification. No refinement was obtained by the super gravity treatment on pure liquid or solid stages. The effectiveness of super gravity results from its promoting the multiplication of crystal nuclei, which we call “Heavy Crystal Rain”, thereby greatly strengthening the migration of crystal nuclei within the alloy. Increasing the solute Cu content can increase nucleation density and restrict the growth of crystals, which further increases the refining effect of super gravity. Within this paper, we also discuss the motile behavior of crystals in a field of super gravity.

High resolution FISH on super-stretched flow-sorted plant chromosomes.

NARCIS (Netherlands)

Valárik, M.; Bartos, J.; Kovarova, P.; Kubalakova, M.; Jong, de J.H.S.G.M.; Dolezel, J.

2004-01-01

A novel high-resolution fluorescence in situ hybridisation (FISH) strategy, using super-stretched flow-sorted plant chromosomes as targets, is described. The technique that allows longitudinal extension of chromosomes of more than 100 times their original metaphase size is especially attractive for

An introduction to optical super-resolution microscopy for the adventurous biologist

Science.gov (United States)

Vangindertael, J.; Camacho, R.; Sempels, W.; Mizuno, H.; Dedecker, P.; Janssen, K. P. F.

2018-04-01

Ever since the inception of light microscopy, the laws of physics have seemingly thwarted every attempt to visualize the processes of life at its most fundamental, sub-cellular, level. The diffraction limit has restricted our view to length scales well above 250 nm and in doing so, severely compromised our ability to gain true insights into many biological systems. Fortunately, continuous advancements in optics, electronics and mathematics have since provided the means to once again make physics work to our advantage. Even though some of the fundamental concepts enabling super-resolution light microscopy have been known for quite some time, practically feasible implementations have long remained elusive. It should therefore not come as a surprise that the 2014 Nobel Prize in Chemistry was awarded to the scientists who, each in their own way, contributed to transforming super-resolution microscopy from a technological tour de force to a staple of the biologist’s toolkit. By overcoming the diffraction barrier, light microscopy could once again be established as an indispensable tool in an age where the importance of understanding life at the molecular level cannot be overstated. This review strives to provide the aspiring life science researcher with an introduction to optical microscopy, starting from the fundamental concepts governing compound and fluorescent confocal microscopy to the current state-of-the-art of super-resolution microscopy techniques and their applications.

Far-field and Fresnel Liquid Crystal Geometric Phase Holograms via Direct-Write Photo-Alignment

Directory of Open Access Journals (Sweden)

Xiao Xiang

2017-12-01

Full Text Available We study computer-generated geometric-phase holograms (GPHs realized by photo-aligned liquid crystals, in both simulation and experiment. We demonstrate both far-field and Fresnel holograms capable of producing far-field and near-field images with preserved fidelity for all wavelengths. The GPHs are fabricated by patterning a photo-alignment layer (PAL using a direct-write laser scanner and coating the surface with a polymerizable liquid crystal (i.e., a reactive mesogen. We study various recording pixel sizes, down to 3 μm, that are easily recorded in the PAL. We characterize the fabricated elements and find good agreement with theory and numerical simulation. Because of the wavelength independent geometric phase, the (phase fidelity of the replay images is preserved for all wavelengths, unlike conventional dynamic phase holograms. However, governed by the diffraction equation, the size and location of a reconstructed image depends on the replay wavelength for far-field and near-field GPHs, respectively. These offer interesting opportunities for white-light holography.

High resolution in-vivo imaging of skin with full field optical coherence tomography

Science.gov (United States)

Dalimier, E.; Bruhat, Alexis; Grieve, K.; Harms, F.; Martins, F.; Boccara, C.

2014-03-01

Full-field OCT (FFOCT) has the ability to provide en-face images with a very good axial sectioning as well as a very high transverse resolution (about 1 microns in all directions). Therefore it offers the possibility to visualize biological tissues with very high resolution both on the axial native view, and on vertical reconstructed sections. Here we investigated the potential dermatological applications of in-vivo skin imaging with FFOCT. A commercial FFOCT device was adapted for the in-vivo acquisition of stacks of images on the arm, hand and finger. Several subjects of different benign and pathological skin conditions were tested. The images allowed measurement of the stratum corneum and epidermis thicknesses, measurement of the stratum corneum refractive index, size measurement and count of the keratinocytes, visualization of the dermal-epidermal junction, and visualization of the melanin granules and of the melanocytes. Skins with different pigmentations could be discriminated and skin pathologies such as eczema could be identified. The very high resolution offered by FFOCT both on axial native images and vertical reconstructed sections allows for the visualization and measurement of a set of parameters useful for cosmetology and dermatology. In particular, FFOCT is a potential tool for the understanding and monitoring of skin hydration and pigmentation, as well as skin inflammation.

SuperSegger

DEFF Research Database (Denmark)

Stylianidou, Stella; Brennan, Connor; Nissen, Silas B

2016-01-01

-colonies with many cells, facilitating the analysis of cell-cycle dynamics in bacteria as well as cell-contact mediated phenomena. This package has a range of built-in capabilities for characterizing bacterial cells, including the identification of cell division events, mother, daughter, and neighboring cells......Many quantitative cell biology questions require fast yet reliable automated image segmentation to identify and link cells from frame-to-frame, and characterize the cell morphology and fluorescence. We present SuperSegger, an automated MATLAB-based image processing package well......-suited to quantitative analysis of high-throughput live-cell fluorescence microscopy of bacterial cells. SuperSegger incorporates machine-learning algorithms to optimize cellular boundaries and automated error resolution to reliably link cells from frame-to-frame. Unlike existing packages, it can reliably segment micro...

Advances in high-resolution imaging--techniques for three-dimensional imaging of cellular structures.

Science.gov (United States)

Lidke, Diane S; Lidke, Keith A

2012-06-01

A fundamental goal in biology is to determine how cellular organization is coupled to function. To achieve this goal, a better understanding of organelle composition and structure is needed. Although visualization of cellular organelles using fluorescence or electron microscopy (EM) has become a common tool for the cell biologist, recent advances are providing a clearer picture of the cell than ever before. In particular, advanced light-microscopy techniques are achieving resolutions below the diffraction limit and EM tomography provides high-resolution three-dimensional (3D) images of cellular structures. The ability to perform both fluorescence and electron microscopy on the same sample (correlative light and electron microscopy, CLEM) makes it possible to identify where a fluorescently labeled protein is located with respect to organelle structures visualized by EM. Here, we review the current state of the art in 3D biological imaging techniques with a focus on recent advances in electron microscopy and fluorescence super-resolution techniques.

Multimode simulations of a wide field of view double-Fourier far-infrared spatio-spectral interferometer

Science.gov (United States)

Bracken, Colm P.; Lightfoot, John; O'Sullivan, Creidhe; Murphy, J. Anthony; Donohoe, Anthony; Savini, Giorgio; Juanola-Parramon, Roser; The Fisica Consortium, On Behalf Of

2018-01-01

In the absence of 50-m class space-based observatories, subarcsecond astronomy spanning the full far-infrared wavelength range will require space-based long-baseline interferometry. The long baselines of up to tens of meters are necessary to achieve subarcsecond resolution demanded by science goals. Also, practical observing times command a field of view toward an arcminute (1‧) or so, not achievable with a single on-axis coherent detector. This paper is concerned with an application of an end-to-end instrument simulator PyFIInS, developed as part of the FISICA project under funding from the European Commission's seventh Framework Programme for Research and Technological Development (FP7). Predicted results of wide field of view spatio-spectral interferometry through simulations of a long-baseline, double-Fourier, far-infrared interferometer concept are presented and analyzed. It is shown how such an interferometer, illuminated by a multimode detector can recover a large field of view at subarcsecond angular resolution, resulting in similar image quality as that achieved by illuminating the system with an array of coherent detectors. Through careful analysis, the importance of accounting for the correct number of higher-order optical modes is demonstrated, as well as accounting for both orthogonal polarizations. Given that it is very difficult to manufacture waveguide and feed structures at sub-mm wavelengths, the larger multimode design is recommended over the array of smaller single mode detectors. A brief note is provided in the conclusion of this paper addressing a more elegant solution to modeling far-infrared interferometers, which holds promise for improving the computational efficiency of the simulations presented here.

Sparse representation based image interpolation with nonlocal autoregressive modeling.

Science.gov (United States)

Dong, Weisheng; Zhang, Lei; Lukac, Rastislav; Shi, Guangming

2013-04-01

Sparse representation is proven to be a promising approach to image super-resolution, where the low-resolution (LR) image is usually modeled as the down-sampled version of its high-resolution (HR) counterpart after blurring. When the blurring kernel is the Dirac delta function, i.e., the LR image is directly down-sampled from its HR counterpart without blurring, the super-resolution problem becomes an image interpolation problem. In such cases, however, the conventional sparse representation models (SRM) become less effective, because the data fidelity term fails to constrain the image local structures. In natural images, fortunately, many nonlocal similar patches to a given patch could provide nonlocal constraint to the local structure. In this paper, we incorporate the image nonlocal self-similarity into SRM for image interpolation. More specifically, a nonlocal autoregressive model (NARM) is proposed and taken as the data fidelity term in SRM. We show that the NARM-induced sampling matrix is less coherent with the representation dictionary, and consequently makes SRM more effective for image interpolation. Our extensive experimental results demonstrate that the proposed NARM-based image interpolation method can effectively reconstruct the edge structures and suppress the jaggy/ringing artifacts, achieving the best image interpolation results so far in terms of PSNR as well as perceptual quality metrics such as SSIM and FSIM.

Isotope specific resolution recovery image reconstruction in high resolution PET imaging

Energy Technology Data Exchange (ETDEWEB)

Kotasidis, Fotis A. [Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva, Switzerland and Wolfson Molecular Imaging Centre, MAHSC, University of Manchester, M20 3LJ, Manchester (United Kingdom); Angelis, Georgios I. [Faculty of Health Sciences, Brain and Mind Research Institute, University of Sydney, NSW 2006, Sydney (Australia); Anton-Rodriguez, Jose; Matthews, Julian C. [Wolfson Molecular Imaging Centre, MAHSC, University of Manchester, Manchester M20 3LJ (United Kingdom); Reader, Andrew J. [Montreal Neurological Institute, McGill University, Montreal QC H3A 2B4, Canada and Department of Biomedical Engineering, Division of Imaging Sciences and Biomedical Engineering, King' s College London, St. Thomas’ Hospital, London SE1 7EH (United Kingdom); Zaidi, Habib [Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva (Switzerland); Geneva Neuroscience Centre, Geneva University, CH-1205 Geneva (Switzerland); Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, PO Box 30 001, Groningen 9700 RB (Netherlands)

2014-05-15

Purpose: Measuring and incorporating a scanner-specific point spread function (PSF) within image reconstruction has been shown to improve spatial resolution in PET. However, due to the short half-life of clinically used isotopes, other long-lived isotopes not used in clinical practice are used to perform the PSF measurements. As such, non-optimal PSF models that do not correspond to those needed for the data to be reconstructed are used within resolution modeling (RM) image reconstruction, usually underestimating the true PSF owing to the difference in positron range. In high resolution brain and preclinical imaging, this effect is of particular importance since the PSFs become more positron range limited and isotope-specific PSFs can help maximize the performance benefit from using resolution recovery image reconstruction algorithms. Methods: In this work, the authors used a printing technique to simultaneously measure multiple point sources on the High Resolution Research Tomograph (HRRT), and the authors demonstrated the feasibility of deriving isotope-dependent system matrices from fluorine-18 and carbon-11 point sources. Furthermore, the authors evaluated the impact of incorporating them within RM image reconstruction, using carbon-11 phantom and clinical datasets on the HRRT. Results: The results obtained using these two isotopes illustrate that even small differences in positron range can result in different PSF maps, leading to further improvements in contrast recovery when used in image reconstruction. The difference is more pronounced in the centre of the field-of-view where the full width at half maximum (FWHM) from the positron range has a larger contribution to the overall FWHM compared to the edge where the parallax error dominates the overall FWHM. Conclusions: Based on the proposed methodology, measured isotope-specific and spatially variant PSFs can be reliably derived and used for improved spatial resolution and variance performance in resolution

Isotope specific resolution recovery image reconstruction in high resolution PET imaging

International Nuclear Information System (INIS)

Kotasidis, Fotis A.; Angelis, Georgios I.; Anton-Rodriguez, Jose; Matthews, Julian C.; Reader, Andrew J.; Zaidi, Habib

2014-01-01

Purpose: Measuring and incorporating a scanner-specific point spread function (PSF) within image reconstruction has been shown to improve spatial resolution in PET. However, due to the short half-life of clinically used isotopes, other long-lived isotopes not used in clinical practice are used to perform the PSF measurements. As such, non-optimal PSF models that do not correspond to those needed for the data to be reconstructed are used within resolution modeling (RM) image reconstruction, usually underestimating the true PSF owing to the difference in positron range. In high resolution brain and preclinical imaging, this effect is of particular importance since the PSFs become more positron range limited and isotope-specific PSFs can help maximize the performance benefit from using resolution recovery image reconstruction algorithms. Methods: In this work, the authors used a printing technique to simultaneously measure multiple point sources on the High Resolution Research Tomograph (HRRT), and the authors demonstrated the feasibility of deriving isotope-dependent system matrices from fluorine-18 and carbon-11 point sources. Furthermore, the authors evaluated the impact of incorporating them within RM image reconstruction, using carbon-11 phantom and clinical datasets on the HRRT. Results: The results obtained using these two isotopes illustrate that even small differences in positron range can result in different PSF maps, leading to further improvements in contrast recovery when used in image reconstruction. The difference is more pronounced in the centre of the field-of-view where the full width at half maximum (FWHM) from the positron range has a larger contribution to the overall FWHM compared to the edge where the parallax error dominates the overall FWHM. Conclusions: Based on the proposed methodology, measured isotope-specific and spatially variant PSFs can be reliably derived and used for improved spatial resolution and variance performance in resolution

Isotope specific resolution recovery image reconstruction in high resolution PET imaging.

Science.gov (United States)

Kotasidis, Fotis A; Angelis, Georgios I; Anton-Rodriguez, Jose; Matthews, Julian C; Reader, Andrew J; Zaidi, Habib

2014-05-01

Measuring and incorporating a scanner-specific point spread function (PSF) within image reconstruction has been shown to improve spatial resolution in PET. However, due to the short half-life of clinically used isotopes, other long-lived isotopes not used in clinical practice are used to perform the PSF measurements. As such, non-optimal PSF models that do not correspond to those needed for the data to be reconstructed are used within resolution modeling (RM) image reconstruction, usually underestimating the true PSF owing to the difference in positron range. In high resolution brain and preclinical imaging, this effect is of particular importance since the PSFs become more positron range limited and isotope-specific PSFs can help maximize the performance benefit from using resolution recovery image reconstruction algorithms. In this work, the authors used a printing technique to simultaneously measure multiple point sources on the High Resolution Research Tomograph (HRRT), and the authors demonstrated the feasibility of deriving isotope-dependent system matrices from fluorine-18 and carbon-11 point sources. Furthermore, the authors evaluated the impact of incorporating them within RM image reconstruction, using carbon-11 phantom and clinical datasets on the HRRT. The results obtained using these two isotopes illustrate that even small differences in positron range can result in different PSF maps, leading to further improvements in contrast recovery when used in image reconstruction. The difference is more pronounced in the centre of the field-of-view where the full width at half maximum (FWHM) from the positron range has a larger contribution to the overall FWHM compared to the edge where the parallax error dominates the overall FWHM. Based on the proposed methodology, measured isotope-specific and spatially variant PSFs can be reliably derived and used for improved spatial resolution and variance performance in resolution recovery image reconstruction. The

In Vivo Optical Imaging for Targeted Drug Kinetics and Localization for Oral Surgery and Super-Resolution, Facilitated by Printed Phantoms

Science.gov (United States)

Bentz, Brian Z.

Many human cancer cell types over-express folate receptors, and this provides an opportunity to develop targeted anti-cancer drugs. For these drugs to be effective, their kinetics must be well understood in vivo and in deep tissue where tumors occur. We demonstrate a method for imaging these parameters by incorporating a kinetic compartment model and fluorescence into optical diffusion tomography (ODT). The kinetics were imaged in a live mouse, and found to be in agreement with previous in vitro studies, demonstrating the validity of the method and its feasibility as an effective tool in preclinical drug development studies. Progress in developing optical imaging for biomedical applications requires customizable and often complex objects known as "phantoms" for testing and evaluation. We present new optical phantoms fabricated using inexpensive 3D printing methods with multiple materials, allowing for the placement of complex inhomogeneities in heterogeneous or anatomically realistic geometries, as opposed to previous phantoms which were limited to simple shapes formed by molds or machining. Furthermore, we show that Mie theory can be used to design the optical properties to match a target tissue. The phantom fabrication methods are versatile, can be applied to optical imaging methods besides diffusive imaging, and can be used in the calibration of live animal imaging data. Applications of diffuse optical imaging in the operating theater have been limited in part due to computational burden. We present an approach for the fast localization of arteries in the roof of the mouth that has the potential to reduce complications. Furthermore, we use the extracted position information to fabricate a custom surgical guide using 3D printing that could protect the arteries during surgery. The resolution of ODT is severely limited by the attenuation of high spatial frequencies. We present a super-resolution method achieved through the point localization of fluorescent

An angle encoder for super-high resolution and super-high accuracy using SelfA

Science.gov (United States)

Watanabe, Tsukasa; Kon, Masahito; Nabeshima, Nobuo; Taniguchi, Kayoko

2014-06-01

Angular measurement technology at high resolution for applications such as in hard disk drive manufacturing machines, precision measurement equipment and aspherical process machines requires a rotary encoder with high accuracy, high resolution and high response speed. However, a rotary encoder has angular deviation factors during operation due to scale error or installation error. It has been assumed to be impossible to achieve accuracy below 0.1″ in angular measurement or control after the installation onto the rotating axis. Self-calibration (Lu and Trumper 2007 CIRP Ann. 56 499; Kim et al 2011 Proc. MacroScale; Probst 2008 Meas. Sci. Technol. 19 015101; Probst et al Meas. Sci. Technol. 9 1059; Tadashi and Makoto 1993 J. Robot. Mechatronics 5 448; Ralf et al 2006 Meas. Sci. Technol. 17 2811) and cross-calibration (Probst et al 1998 Meas. Sci. Technol. 9 1059; Just et al 2009 Precis. Eng. 33 530; Burnashev 2013 Quantum Electron. 43 130) technologies for a rotary encoder have been actively discussed on the basis of the principle of circular closure. This discussion prompted the development of rotary tables which achieve reliable and high accuracy angular verification. We apply these technologies for the development of a rotary encoder not only to meet the requirement of super-high accuracy but also to meet that of super-high resolution. This paper presents the development of an encoder with 221 = 2097 152 resolutions per rotation (360°), that is, corresponding to a 0.62″ signal period, achieved by the combination of a laser rotary encoder supplied by Magnescale Co., Ltd and a self-calibratable encoder (SelfA) supplied by The National Institute of Advanced Industrial Science & Technology (AIST). In addition, this paper introduces the development of a rotary encoder to guarantee ±0.03″ accuracy at any point of the interpolated signal, with respect to the encoder at the minimum resolution of 233, that is, corresponding to a 0.0015″ signal period after

High-resolution fluorescence imaging for red and far-red SIF retrieval at leaf and canopy scales

Science.gov (United States)

Albert, L.; Alonso, L.; Cushman, K.; Kellner, J. R.

2017-12-01

New commercial-off-the-shelf imaging spectrometers promise the combination of high spatial and spectral resolution needed to retrieve solar induced fluorescence (SIF) at multiple wavelengths for individual plants and even individual leaves from low-altitude airborne or ground-based platforms. Data from these instruments could provide insight into the status of the photosynthetic apparatus at scales of space and time not observable from high-altitude and space-based platforms, and could support calibration and validation activities of current and forthcoming space missions to quantify SIF (OCO-2, OCO-3, FLEX, and GEOCARB). High-spectral resolution enables SIF retrieval from regions of strong telluric absorption by molecular oxygen, and also within numerous solar Fraunhofer lines in atmospheric windows not obscured by oxygen or water absorptions. Here we evaluate algorithms for SIF retrieval using a commercial-off-the-shelf diffraction-grating imaging spectrometer with a spectral sampling interval of 0.05 nm and a FWHM 650 or 700 nm. These filters enable a direct measurement of SIF emission > 650 or 700 nm that serves as a benchmark against which retrievals from reflectance spectra can be evaluated. We repeated this comparison between leaf-level SIF emission spectra and retrieved SIF emission spectra for leaves treated with drought stress and an herbicide (DCMU) that inhibits electron transfer from QA to QB of PSII.

Super-Group Field Cosmology in Batalin-Vilkovisky Formulation

Science.gov (United States)

Upadhyay, Sudhaker

2016-09-01

In this paper we study the third quantized super-group field cosmology, a model in multiverse scenario, in Batalin-Vilkovisky (BV) formulation. Further, we propose the superfield/super-antifield dependent BRST symmetry transformations. Within this formulation we establish connection between the two different solutions of the quantum master equation within the BV formulation.

A far-field-viewing sensor for making analytical measurements in remote locations.

Science.gov (United States)

Michael, K L; Taylor, L C; Walt, D R

1999-07-15

We demonstrate a far-field-viewing GRINscope sensor for making analytical measurements in remote locations. The GRINscope was fabricated by permanently affixing a micro-Gradient index (GRIN) lens on the distal face of a 350-micron-diameter optical imaging fiber. The GRINscope can obtain both chemical and visual information. In one application, a thin, pH-sensitive polymer layer was immobilized on the distal end of the GRINscope. The ability of the GRINscope to visually image its far-field surroundings and concurrently detect pH changes in a flowing stream was demonstrated. In a different application, the GRINscope was used to image pH- and O2-sensitive particles on a remote substrate and simultaneously measure their fluorescence intensity in response to pH or pO2 changes.

Super-Resolution Algorithm in Cumulative Virtual Blanking

Science.gov (United States)

Montillet, J. P.; Meng, X.; Roberts, G. W.; Woolfson, M. S.

2008-11-01

The proliferation of mobile devices and the emergence of wireless location-based services have generated consumer demand for precise location. In this paper, the MUSIC super-resolution algorithm is applied to time delay estimation for positioning purposes in cellular networks. The goal is to position a Mobile Station with UMTS technology. The problem of Base-Stations herability is solved using Cumulative Virtual Blanking. A simple simulator is presented using DS-SS signal. The results show that MUSIC algorithm improves the time delay estimation in both the cases whether or not Cumulative Virtual Blanking was carried out.

Resolution enhancement of low quality videos using a high-resolution frame

NARCIS (Netherlands)

Pham, T.Q.; Van Vliet, L.J.; Schutte, K.

2006-01-01

This paper proposes an example-based Super-Resolution (SR) algorithm of compressed videos in the Discrete Cosine Transform (DCT) domain. Input to the system is a Low-Resolution (LR) compressed video together with a High-Resolution (HR) still image of similar content. Using a training set of

Flat super-oscillatory lens for heat-assisted magnetic recording with sub-50 nm resolution.

Science.gov (United States)

Yuan, Guanghui; Rogers, Edward T F; Roy, Tapashree; Shen, Zexiang; Zheludev, Nikolay I

2014-03-24

Heat-assisted magnetic recording (HAMR) is a future roadmap technology to overcome the superparamagnetic limit in high density magnetic recording. Existing HAMR schemes depend on a simultaneous magnetic stimulation and light-induced local heating of the information carrier. To achieve high-density recorded data, near-field plasmonic transducers have been proposed as light concentrators. Here we suggest and investigate in detail an alternative approach exploiting a far-field focusing device that can focus light into sub-50 nm hot-spots in the magnetic recording layer using a laser source operating at 473 nm. It is based on a recently introduced super-oscillatory flat lens improved with the use of solid immersion, giving an effective numerical aperture as high as 4.17. The proposed solution is robust and easy to integrate with the magnetic recording head thus offering a competitive advantage over plasmonic technology.

3D Super-Resolution Motion-Corrected MRI: Validation of Fetal Posterior Fossa Measurements.

Science.gov (United States)

Pier, Danielle B; Gholipour, Ali; Afacan, Onur; Velasco-Annis, Clemente; Clancy, Sean; Kapur, Kush; Estroff, Judy A; Warfield, Simon K

2016-09-01

Current diagnosis of fetal posterior fossa anomalies by sonography and conventional MRI is limited by fetal position, motion, and by two-dimensional (2D), rather than three-dimensional (3D), representation. In this study, we aimed to validate the use of a novel magnetic resonance imaging (MRI) technique, 3D super-resolution motion-corrected MRI, to image the fetal posterior fossa. From a database of pregnant women who received fetal MRIs at our institution, images of 49 normal fetal brains were reconstructed. Six measurements of the cerebellum, vermis, and pons were obtained for all cases on 2D conventional and 3D reconstructed MRI, and the agreement between the two methods was determined using concordance correlation coefficients. Concordance of axial and coronal measurements of the transcerebellar diameter was also assessed within each method. Between the two methods, the concordance of measurements was high for all six structures (P fetal motion and orthogonal slice acquisition. This technique will facilitate further study of fetal abnormalities of the posterior fossa. Copyright © 2016 by the American Society of Neuroimaging.

Sub-wavelength imaging at radio frequency

International Nuclear Information System (INIS)

Wiltshire, M C K; Pendry, J B; Hajnal, J V

2006-01-01

A slab of material with a negative permeability can act as a super-lens for magnetic fields and generate images with a sub-wavelength resolution. We have constructed an effective medium using a metamaterial with negative permeability in the region of 24 MHz, and used this to form images in free space of radio frequency magnetic sources. Measurements of these images show that a resolution of approximately λ/64 has been achieved, consistent with both analytical and numerical predictions. (letter to the editor)

Super-virtual refraction interferometry: Field data example over a colluvial wedge

KAUST Repository

Hanafy, Sherif M.; Alhagan, Ola; Al-Tawash, Feras

2011-01-01

The theory of super-virtual refraction interferometry was recently developed to enhance the signal-to-noise ratio (SNR) of far-offset traces in refraction surveys. This enhancement of SNR is proportional to N, and can be as high as N if an iterative procedure is used. Here N is the number of post-critical shot positions that coincides with the receiver locations. We now demonstrate the enhancement of SNR of the super-virtual refraction traces for seismic data collected over a normal fault in Saudi Arabia. Results show that both the SNR of the super-virtual data set and the number of reliable first-arrival-traveltime picks are significantly increased. © 2011 Society of Exploration Geophysicists.

Resolution doubling in 3D-STORM imaging through improved buffers.

Science.gov (United States)

Olivier, Nicolas; Keller, Debora; Gönczy, Pierre; Manley, Suliana

2013-01-01

Super-resolution imaging methods have revolutionized fluorescence microscopy by revealing the nanoscale organization of labeled proteins. In particular, single-molecule methods such as Stochastic Optical Reconstruction Microscopy (STORM) provide resolutions down to a few tens of nanometers by exploiting the cycling of dyes between fluorescent and non-fluorescent states to obtain a sparse population of emitters and precisely localizing them individually. This cycling of dyes is commonly induced by adding different chemicals, which are combined to create a STORM buffer. Despite their importance, the composition of these buffers has scarcely evolved since they were first introduced, fundamentally limiting what can be resolved with STORM. By identifying a new chemical suitable for STORM and optimizing the buffer composition for Alexa-647, we significantly increased the number of photons emitted per cycle by each dye, providing a simple means to enhance the resolution of STORM independently of the optical setup used. Using this buffer to perform 3D-STORM on biological samples, we obtained images with better than 10 nanometer lateral and 30 nanometer axial resolution.

Resolution doubling in 3D-STORM imaging through improved buffers.

Directory of Open Access Journals (Sweden)

Nicolas Olivier

Full Text Available Super-resolution imaging methods have revolutionized fluorescence microscopy by revealing the nanoscale organization of labeled proteins. In particular, single-molecule methods such as Stochastic Optical Reconstruction Microscopy (STORM provide resolutions down to a few tens of nanometers by exploiting the cycling of dyes between fluorescent and non-fluorescent states to obtain a sparse population of emitters and precisely localizing them individually. This cycling of dyes is commonly induced by adding different chemicals, which are combined to create a STORM buffer. Despite their importance, the composition of these buffers has scarcely evolved since they were first introduced, fundamentally limiting what can be resolved with STORM. By identifying a new chemical suitable for STORM and optimizing the buffer composition for Alexa-647, we significantly increased the number of photons emitted per cycle by each dye, providing a simple means to enhance the resolution of STORM independently of the optical setup used. Using this buffer to perform 3D-STORM on biological samples, we obtained images with better than 10 nanometer lateral and 30 nanometer axial resolution.

A Novel Method to Implement the Matrix Pencil Super Resolution Algorithm for Indoor Positioning

Directory of Open Access Journals (Sweden)

Tariq Jamil Saifullah Khanzada

2011-10-01

Full Text Available This article highlights the estimation of the results for the algorithms implemented in order to estimate the delays and distances for the indoor positioning system. The data sets for the transmitted and received signals are captured at a typical outdoor and indoor area. The estimation super resolution algorithms are applied. Different state of art and super resolution techniques based algorithms are applied to avail the optimal estimates of the delays and distances between the transmitted and received signals and a novel method for matrix pencil algorithm is devised. The algorithms perform variably at different scenarios of transmitted and received positions. Two scenarios are experienced, for the single antenna scenario the super resolution techniques like ESPRIT (Estimation of Signal Parameters via Rotational Invariance Technique and theMatrix Pencil algorithms give optimal performance compared to the conventional techniques. In two antenna scenario RootMUSIC and Matrix Pencil algorithm performed better than other algorithms for the distance estimation, however, the accuracy of all the algorithms is worst than the single antenna scenario. In all cases our devised Matrix Pencil algorithm achieved the best estimation results.

An angle encoder for super-high resolution and super-high accuracy using SelfA

International Nuclear Information System (INIS)

Watanabe, Tsukasa; Kon, Masahito; Nabeshima, Nobuo; Taniguchi, Kayoko

2014-01-01

Angular measurement technology at high resolution for applications such as in hard disk drive manufacturing machines, precision measurement equipment and aspherical process machines requires a rotary encoder with high accuracy, high resolution and high response speed. However, a rotary encoder has angular deviation factors during operation due to scale error or installation error. It has been assumed to be impossible to achieve accuracy below 0.1″ in angular measurement or control after the installation onto the rotating axis. Self-calibration (Lu and Trumper 2007 CIRP Ann. 56 499; Kim et al 2011 Proc. MacroScale; Probst 2008 Meas. Sci. Technol. 19 015101; Probst et al Meas. Sci. Technol. 9 1059; Tadashi and Makoto 1993 J. Robot. Mechatronics 5 448; Ralf et al 2006 Meas. Sci. Technol. 17 2811) and cross-calibration (Probst et al 1998 Meas. Sci. Technol. 9 1059; Just et al 2009 Precis. Eng. 33 530; Burnashev 2013 Quantum Electron. 43 130) technologies for a rotary encoder have been actively discussed on the basis of the principle of circular closure. This discussion prompted the development of rotary tables which achieve reliable and high accuracy angular verification. We apply these technologies for the development of a rotary encoder not only to meet the requirement of super-high accuracy but also to meet that of super-high resolution. This paper presents the development of an encoder with 2 21 = 2097 152 resolutions per rotation (360°), that is, corresponding to a 0.62″ signal period, achieved by the combination of a laser rotary encoder supplied by Magnescale Co., Ltd and a self-calibratable encoder (SelfA) supplied by The National Institute of Advanced Industrial Science and Technology (AIST). In addition, this paper introduces the development of a rotary encoder to guarantee ±0.03″ accuracy at any point of the interpolated signal, with respect to the encoder at the minimum resolution of 2 33 , that is, corresponding to a 0.0015″ signal period

High-resolution electron microscopy

CERN Document Server

Spence, John C H

2013-01-01

This new fourth edition of the standard text on atomic-resolution transmission electron microscopy (TEM) retains previous material on the fundamentals of electron optics and aberration correction, linear imaging theory (including wave aberrations to fifth order) with partial coherence, and multiple-scattering theory. Also preserved are updated earlier sections on practical methods, with detailed step-by-step accounts of the procedures needed to obtain the highest quality images of atoms and molecules using a modern TEM or STEM electron microscope. Applications sections have been updated - these include the semiconductor industry, superconductor research, solid state chemistry and nanoscience, and metallurgy, mineralogy, condensed matter physics, materials science and material on cryo-electron microscopy for structural biology. New or expanded sections have been added on electron holography, aberration correction, field-emission guns, imaging filters, super-resolution methods, Ptychography, Ronchigrams, tomogr...

Variations in Cell Surfaces of Estrogen Treated Breast Cancer Cells Detected by A Combined Instrument for Far-Field and Near-Field Microscopy

Directory of Open Access Journals (Sweden)

P. Perner

2002-01-01

Full Text Available The response of single breast cancer cells (cell line T‐47D to 17β‐estradiol (E2 under different concentrations was studied by using an instrument that allows to combine far‐field light microscopy with high resolution scanning near‐field (AFM/SNOM microscopy on the same cell. Different concentrations of E2 induce clearly different effects as well on cellular shape (in classical bright‐field imaging as on surface topography (atomic force imaging and absorbance (near‐field light transmission imaging. The differences range from a polygonal shape at zero via a roughly spherical shape at physiological up to a spindle‐like shape at un‐physiologically high concentrations. The surface topography of untreated control cells was found to be regular and smooth with small overall height modulations. At physiological E2 concentrations the surfaces became increasingly jagged as detected by an increase in membrane height. After application of the un‐physiological high E2 concentration the cell surface structures appeared to be smoother again with an irregular fine structure. The general behaviour of dose dependent differences was also found in the near‐field light transmission images. In order to quantify the treatment effects, line scans through the normalised topography images were drawn and a rate of co‐localisation between high topography and high transmission areas was calculated. The cell biological aspects of these observations are, so far, not studied in detail but measurements on single cells offer new perspectives to be empirically used in diagnosis and therapy control of breast cancers.

A kind of color image segmentation algorithm based on super-pixel and PCNN

Science.gov (United States)

Xu, GuangZhu; Wang, YaWen; Zhang, Liu; Zhao, JingJing; Fu, YunXia; Lei, BangJun

2018-04-01

Image segmentation is a very important step in the low-level visual computing. Although image segmentation has been studied for many years, there are still many problems. PCNN (Pulse Coupled Neural network) has biological background, when it is applied to image segmentation it can be viewed as a region-based method, but due to the dynamics properties of PCNN, many connectionless neurons will pulse at the same time, so it is necessary to identify different regions for further processing. The existing PCNN image segmentation algorithm based on region growing is used for grayscale image segmentation, cannot be directly used for color image segmentation. In addition, the super-pixel can better reserve the edges of images, and reduce the influences resulted from the individual difference between the pixels on image segmentation at the same time. Therefore, on the basis of the super-pixel, the original PCNN algorithm based on region growing is improved by this paper. First, the color super-pixel image was transformed into grayscale super-pixel image which was used to seek seeds among the neurons that hadn't been fired. And then it determined whether to stop growing by comparing the average of each color channel of all the pixels in the corresponding regions of the color super-pixel image. Experiment results show that the proposed algorithm for the color image segmentation is fast and effective, and has a certain effect and accuracy.

Computer simulation on spatial resolution of X-ray bright-field imaging by dynamical diffraction theory for a Laue-case crystal analyzer

International Nuclear Information System (INIS)

Suzuki, Yoshifumi; Chikaura, Yoshinori; Ando, Masami

2011-01-01

Recently, dark-field imaging (DFI) and bright-field imaging (BFI) have been proposed and applied to visualize X-ray refraction effects yielded in biomedical objects. In order to clarify the spatial resolution due to a crystal analyzer in Laue geometry, a program based on the Takagi-Taupin equation was modified to be used for carrying out simulations to evaluate the spatial resolution of images coming into a Laue angular analyzer (LAA). The calculation was done with a perfect plane wave for diffraction wave-fields, which corresponded to BFI, under the conditions of 35 keV and a diffraction index 440 for a 2100 μm thick LAA. As a result, the spatial resolution along the g-vector direction showed approximately 37.5 μm. 126 μm-thick LAA showed a spatial resolution better than 3.1 μm under the conditions of 13.7 keV and a diffraction index 220.

Superstring field theories on super-flag manifolds: superdiff S1/S1 and superdiff S1/super S1

International Nuclear Information System (INIS)

Zhao Zhiyong; Wu, Ke; Saito, Takesi

1987-01-01

We generalize the geometric approach of Bowick and Rajeev [BR] to superstring field theories. The anomaly is identified with nonvanishing of the Ricci curvature of the super-flag manifold. We explicitly calculate the curvatures of superdiff S 1 /S 1 and superdiff S 1 /superS 1 using super-Toeplitz operator techniques. No regularization is needed in this formalism. The critical dimension D=10 is rediscovered as a result of vanishing curvature of the product bundle over the super-flag manifold. (orig.)

MPGD for breast cancer prevention: a high resolution and low dose radiation medical imaging

Science.gov (United States)

Gutierrez, R. M.; Cerquera, E. A.; Mañana, G.

2012-07-01

Early detection of small calcifications in mammograms is considered the best preventive tool of breast cancer. However, existing digital mammography with relatively low radiation skin exposure has limited accessibility and insufficient spatial resolution for small calcification detection. Micro Pattern Gaseous Detectors (MPGD) and associated technologies, increasingly provide new information useful to generate images of microscopic structures and make more accessible cutting edge technology for medical imaging and many other applications. In this work we foresee and develop an application for the new information provided by a MPGD camera in the form of highly controlled images with high dynamical resolution. We present a new Super Detail Image (S-DI) that efficiently profits of this new information provided by the MPGD camera to obtain very high spatial resolution images. Therefore, the method presented in this work shows that the MPGD camera with SD-I, can produce mammograms with the necessary spatial resolution to detect microcalcifications. It would substantially increase efficiency and accessibility of screening mammography to highly improve breast cancer prevention.

Passive Standoff Super Resolution Imaging using Spatial-Spectral Multiplexing

Science.gov (United States)

2017-08-14

OPD is mainly influenced by the indices of refraction and thicknesses for the two glass plates/fluids (n1/t1 and n2/t2) and the angle of incidence...the algorithm’s robustness. To be specific, this reconstruction algorithm is shown to be effective on both smoothly varying and point cloud objects...applications in the field of hydrology, oceanography, glaciology, forest, climate , urban, military and meteorology [62]. With remotely sensed images

Dual-conjugate adaptive optics for wide-field high-resolution retinal imaging.

Science.gov (United States)

Thaung, Jörgen; Knutsson, Per; Popovic, Zoran; Owner-Petersen, Mette

2009-03-16

We present analysis and preliminary laboratory testing of a real-time dual-conjugate adaptive optics (DCAO) instrument for ophthalmology that will enable wide-field high resolution imaging of the retina in vivo. The setup comprises five retinal guide stars (GS) and two deformable mirrors (DM), one conjugate to the pupil and one conjugate to a plane close to the retina. The DCAO instrument has a closed-loop wavefront sensing wavelength of 834 nm and an imaging wavelength of 575 nm. It incorporates an array of collimator lenses to spatially filter the light from all guide stars using one adjustable iris, and images the Hartmann patterns of multiple reference sources on a single detector. Zemax simulations were performed at 834 nm and 575 nm with the Navarro 99 and the Liou- Brennan eye models. Two correction alternatives were evaluated; conventional single conjugate AO (SCAO, using one GS and a pupil DM) and DCAO (using multiple GS and two DM). Zemax simulations at 575 nm based on the Navarro 99 eye model show that the diameter of the corrected field of view for diffraction-limited imaging (Strehl >or= 0.8) increases from 1.5 deg with SCAO to 6.5 deg using DCAO. The increase for the less stringent condition of a wavefront error of 1 rad or less (Strehl >or= 0.37) is from 3 deg with SCAO to approximately 7.4 deg using DCAO. Corresponding results for the Liou-Brennan eye model are 3.1 deg (SCAO) and 8.2 deg (DCAO) for Strehl >or= 0.8, and 4.8 deg (SCAO) and 9.6 deg (DCAO) for Strehl >or= 0.37. Potential gain in corrected field of view with DCAO is confirmed both by laboratory experiments on a model eye and by preliminary in vivo imaging of a human eye. (c) 2009 Optical Society of America

Energy Resolution of the CMS ECAL Barrel Super-Module Using MGPA Electronics

CERN Document Server

Dewhirst, G

2004-01-01

A method for extracting the amplitude of a pulse has been developed in order to optimise the energy resolution of a CMS ECAL super-module in the 2003 test beam. The method consists of using a set of weights to extract the amplitude as well as subtract the baseline level event by event. For an incident beam impact restricted to an area of 4times 4~mm^2 the resolution of the ECAL, which uses the final prototype version of the MGPA electronics, is shown to match the target resolution.

High-Resolution Imaging Reveals New Features of Nuclear Export of mRNA through the Nuclear Pore Complexes

Directory of Open Access Journals (Sweden)

Joseph M. Kelich

2014-08-01

Full Text Available The nuclear envelope (NE of eukaryotic cells provides a physical barrier for messenger RNA (mRNA and the associated proteins (mRNPs traveling from sites of transcription in the nucleus to locations of translation processing in the cytoplasm. Nuclear pore complexes (NPCs embedded in the NE serve as a dominant gateway for nuclear export of mRNA. However, the fundamental characterization of export dynamics of mRNPs through the NPC has been hindered by several technical limits. First, the size of NPC that is barely below the diffraction limit of conventional light microscopy requires a super-resolution microscopy imaging approach. Next, the fast transit of mRNPs through the NPC further demands a high temporal resolution by the imaging approach. Finally, the inherent three-dimensional (3D movements of mRNPs through the NPC demand the method to provide a 3D mapping of both transport kinetics and transport pathways of mRNPs. This review will highlight the recently developed super-resolution imaging techniques advanced from 1D to 3D for nuclear export of mRNPs and summarize the new features in the dynamic nuclear export process of mRNPs revealed from these technical advances.

A simple model explaining super-resolution in absolute optical instruments

Science.gov (United States)

Leonhardt, Ulf; Sahebdivan, Sahar; Kogan, Alex; Tyc, Tomáš

2015-05-01

We develop a simple, one-dimensional model for super-resolution in absolute optical instruments that is able to describe the interplay between sources and detectors. Our model explains the subwavelength sensitivity of a point detector to a point source reported in previous computer simulations and experiments (Miñano 2011 New J. Phys.13 125009; Miñano 2014 New J. Phys.16 033015).

Near-field electromagnetic holography for high-resolution analysis of network interactions in neuronal tissue.

Science.gov (United States)

Kjeldsen, Henrik D; Kaiser, Marcus; Whittington, Miles A

2015-09-30

Brain function is dependent upon the concerted, dynamical interactions between a great many neurons distributed over many cortical subregions. Current methods of quantifying such interactions are limited by consideration only of single direct or indirect measures of a subsample of all neuronal population activity. Here we present a new derivation of the electromagnetic analogy to near-field acoustic holography allowing high-resolution, vectored estimates of interactions between sources of electromagnetic activity that significantly improves this situation. In vitro voltage potential recordings were used to estimate pseudo-electromagnetic energy flow vector fields, current and energy source densities and energy dissipation in reconstruction planes at depth into the neural tissue parallel to the recording plane of the microelectrode array. The properties of the reconstructed near-field estimate allowed both the utilization of super-resolution techniques to increase the imaging resolution beyond that of the microelectrode array, and facilitated a novel approach to estimating causal relationships between activity in neocortical subregions. The holographic nature of the reconstruction method allowed significantly better estimation of the fine spatiotemporal detail of neuronal population activity, compared with interpolation alone, beyond the spatial resolution of the electrode arrays used. Pseudo-energy flow vector mapping was possible with high temporal precision, allowing a near-realtime estimate of causal interaction dynamics. Basic near-field electromagnetic holography provides a powerful means to increase spatial resolution from electrode array data with careful choice of spatial filters and distance to reconstruction plane. More detailed approaches may provide the ability to volumetrically reconstruct activity patterns on neuronal tissue, but the ability to extract vectored data with the method presented already permits the study of dynamic causal interactions

Wide-field two-dimensional multifocal optical-resolution photoacoustic computed microscopy

Science.gov (United States)

Xia, Jun; Li, Guo; Wang, Lidai; Nasiriavanaki, Mohammadreza; Maslov, Konstantin; Engelbach, John A.; Garbow, Joel R.; Wang, Lihong V.

2014-01-01

Optical-resolution photoacoustic microscopy (OR-PAM) is an emerging technique that directly images optical absorption in tissue at high spatial resolution. To date, the majority of OR-PAM systems are based on single focused optical excitation and ultrasonic detection, limiting the wide-field imaging speed. While one-dimensional multifocal OR-PAM (1D-MFOR-PAM) has been developed, the potential of microlens and transducer arrays has not been fully realized. Here, we present the development of two-dimensional multifocal optical-resolution photoacoustic computed microscopy (2D-MFOR-PACM), using a 2D microlens array and a full-ring ultrasonic transducer array. The 10 × 10 mm2 microlens array generates 1800 optical foci within the focal plane of the 512-element transducer array, and raster scanning the microlens array yields optical-resolution photoacoustic images. The system has improved the in-plane resolution of a full-ring transducer array from ≥100 µm to 29 µm and achieved an imaging time of 36 seconds over a 10 × 10 mm2 field of view. In comparison, the 1D-MFOR-PAM would take more than 4 minutes to image over the same field of view. The imaging capability of the system was demonstrated on phantoms and animals both ex vivo and in vivo. PMID:24322226

Far field optical nanoscopy: How far can you go in nanometric characterization without resolving all the details?

International Nuclear Information System (INIS)

Montgomery, Paul C.; Serio, Bruno; Anstotz, Freddy; Montaner, Denis

2013-01-01

In the development of nanomaterials and biomaterials, new characterization techniques are required that overcome the challenges presented by the increasing dimensional ratio between the different entities to be studied and the growing complexity introduced by the use of heterogeneous materials and technologies. Diffraction limited far field optical nanoscopy techniques are receiving growing interest because of their ability to detect nanometer structures over very large fields and at high speed. We present a classification scheme of the different types of optical nanoscopy techniques. In particular, we highlight four categories of far field diffraction limited techniques based on increasing the contrast, measuring the phase, using deconvolution and using nano-markers. We demonstrate that by increasing the power of detectability, observability or measurability, a wealth of information concerning nanometric structures becomes available even though all the lateral details may not be resolved. For example, it is possible to determine the presence, the structure and orientation of nanostructures, to measure their density, position and 2D and 3D distribution and to measure nanometric surface roughness in bulk materials, surfaces, nano-layers, soft matter and cells. These techniques conserve all the advantages associated with classical imaging such as real time imaging, non-invasiveness, non-destructiveness and ease of use.

Super high field ohmically heated tokamak operation

International Nuclear Information System (INIS)

Cohn, D.R.; Bromberg, L.; Leclaire, R.J.; Potok, R.E.; Jassby, D.L.

1986-01-01

The authors discuss a super high field mode of tokamak operation that uses ohmic heating or near ohmic heating to ignition. The super high field mode of operation uses very high values of Β/sup 2/α, where Β is the magnetic field and a is the minor radius (Β/sup 2/α > 100 T/sup 2/m). We analyze copper magnet devices with major radii from 1.7 to 3.0 meters. Minimizing or eliminating the need for auxiliary heating has the potential advantages of reducing uncertainty in extrapolating the energy confinement time of current tokamak devices, and reducing engineering problems associated with large auxiliary heating requirements. It may be possible to heat relatively short pulse, inertially cooled tokamaks to ignition with ohmic power alone. However, there may be advantages in using a very small amount of auxiliary power (less than the ohmic heating power) to boost the ohmic heating and provide a faster start-up, expecially in relatively compact devices

Comparison of fundamental, second harmonic, and superharmonic imaging: a simulation study.

Science.gov (United States)

van Neer, Paul L M J; Danilouchkine, Mikhail G; Verweij, Martin D; Demi, Libertario; Voormolen, Marco M; van der Steen, Anton F W; de Jong, Nico

2011-11-01

In medical ultrasound, fundamental imaging (FI) uses the reflected echoes from the same spectral band as that of the emitted pulse. The transmission frequency determines the trade-off between penetration depth and spatial resolution. Tissue harmonic imaging (THI) employs the second harmonic of the emitted frequency band to construct images. Recently, superharmonic imaging (SHI) has been introduced, which uses the third to the fifth (super) harmonics. The harmonic level is determined by two competing phenomena: nonlinear propagation and frequency dependent attenuation. Thus, the transmission frequency yielding the optimal trade-off between the spatial resolution and the penetration depth differs for THI and SHI. This paper quantitatively compares the concepts of fundamental, second harmonic, and superharmonic echocardiography at their optimal transmission frequencies. Forward propagation is modeled using a 3D-KZK implementation and the iterative nonlinear contrast source (INCS) method. Backpropagation is assumed to be linear. Results show that the fundamental lateral beamwidth is the narrowest at focus, while the superharmonic one is narrower outside the focus. The lateral superharmonic roll-off exceeds the fundamental and second harmonic roll-off. Also, the axial resolution of SHI exceeds that of FI and THI. The far-field pulse-echo superharmonic pressure is lower than that of the fundamental and second harmonic. SHI appears suited for echocardiography and is expected to improve its image quality at the cost of a slight reduction in depth-of-field.

Super-resolution imaging of ciliary microdomains in isolated olfactory sensory neurons using a custom two-color stimulated emission depletion microscope

Science.gov (United States)

Meyer, Stephanie A.; Ozbay, Baris N.; Potcoava, Mariana; Salcedo, Ernesto; Restrepo, Diego; Gibson, Emily A.

2016-06-01

We performed stimulated emission depletion (STED) imaging of isolated olfactory sensory neurons (OSNs) using a custom-built microscope. The STED microscope uses a single pulsed laser to excite two separate fluorophores, Atto 590 and Atto 647N. A gated timing circuit combined with temporal interleaving of the different color excitation/STED laser pulses filters the two channel detection and greatly minimizes crosstalk. We quantified the instrument resolution to be ˜81 and ˜44 nm, for the Atto 590 and Atto 647N channels. The spatial separation between the two channels was measured to be under 10 nm, well below the resolution limit. The custom-STED microscope is incorporated onto a commercial research microscope allowing brightfield, differential interference contrast, and epifluorescence imaging on the same field of view. We performed immunolabeling of OSNs in mice to image localization of ciliary membrane proteins involved in olfactory transduction. We imaged Ca2+-permeable cyclic nucleotide gated (CNG) channel (Atto 594) and adenylyl cyclase type III (ACIII) (Atto 647N) in distinct cilia. STED imaging resolved well-separated subdiffraction limited clusters for each protein. We quantified the size of each cluster to have a mean value of 88±48 nm and 124±43 nm, for CNG and ACIII, respectively. STED imaging showed separated clusters that were not resolvable in confocal images.

Enhancement of the resolution of full-field optical coherence tomography by using a colour image sensor

Energy Technology Data Exchange (ETDEWEB)

Kalyanov, A L; Lychagov, V V; Smirnov, I V; Ryabukho, V P [N.G. Chernyshevsky Saratov State University, Saratov (Russian Federation)

2013-08-31

The influence of white balance in a colour image detector on the resolution of a full-field optical coherence tomograph (FFOCT) is studied. The change in the interference pulse width depending on the white balance tuning is estimated in the cases of a thermal radiation source (incandescent lamp) and a white light emitting diode. It is shown that by tuning white balance of the detector in a certain range, the FFOCT resolution can be increased by 20 % as compared to the resolution, attained with the use of a monochrome detector. (optical coherence tomography)

Enhancement of the resolution of full-field optical coherence tomography by using a colour image sensor

International Nuclear Information System (INIS)

Kalyanov, A L; Lychagov, V V; Smirnov, I V; Ryabukho, V P

2013-01-01

The influence of white balance in a colour image detector on the resolution of a full-field optical coherence tomograph (FFOCT) is studied. The change in the interference pulse width depending on the white balance tuning is estimated in the cases of a thermal radiation source (incandescent lamp) and a white light emitting diode. It is shown that by tuning white balance of the detector in a certain range, the FFOCT resolution can be increased by 20 % as compared to the resolution, attained with the use of a monochrome detector. (optical coherence tomography)

Managing the Introduction of Super-Resolution Microscopy into a Core Facility.